[2025-09-30T17:00:02.037147] [INFO ] [MAIN ] Using last completed trading day: 2025-09-30 [2025-09-30T17:00:02.282377] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-30T17:00:02.282538] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-30T17:00:02.590550] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-30T17:00:02.591172] [WARN ] [STATE ] State set to: RUNNING [2025-09-30T17:00:02.591278] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-30T17:00:02.591364] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-30T17:00:02.591544] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-30T17:00:02.591634] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-30T17:00:03.538080] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-30T17:00:03.538277] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-30T17:00:03.538513] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-30T17:00:03.539668] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-30T17:00:03.539738] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-30T17:00:03.539775] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-30T17:00:03.539835] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-30T17:00:03.539868] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-30T17:00:03.539931] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-30T17:00:03.540367] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-30T17:00:03.540421] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-30T17:00:03.540583] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-30T17:00:03.540618] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-30T17:00:03.540695] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-30T17:00:03.540749] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-30T17:00:03.568879] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-30T17:00:03.596279] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-30T17:00:03.596400] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-30T17:00:03.596439] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-30T17:00:03.596469] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-30T17:00:03.596528] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-30T17:00:03.596913] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-30T17:00:03.596967] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-30T17:00:03.597001] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-30T17:00:03.597029] [INFO ] [MAIN ] Running in parallel mode [2025-09-30T17:00:03.597221] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-30T17:00:04.284324] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.380926] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-09-30T17:00:04.380775] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.414237] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.421797] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-30T17:00:04.440970] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-30T17:00:04.421707] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445274] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.444928] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.445132] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445370] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445711] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-30T17:00:04.445952] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.446477] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.446624] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-30T17:00:04.446325] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-30T17:00:04.446897] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-30T17:00:04.446198] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-30T17:00:04.447000] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-30T17:00:04.447059] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-30T17:00:04.447152] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.447335] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-30T17:00:04.465837] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-30T17:00:04.465975] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-30T17:00:04.473987] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.474140] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-30T17:00:04.541263] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-30T17:00:04.560917] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-30T17:00:05.825744] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:05.854219] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-30T17:00:05.860868] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:05.898701] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-30T17:00:06.000036] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.011696] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-30T17:00:06.090484] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.090829] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-30T17:00:06.320571] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:00:06.320928] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-30T17:00:06.321013] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:00:06.321073] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-30T17:00:06.321134] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:00:06.321213] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-30T17:00:06.321284] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-30T17:00:06.321327] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-30T17:00:06.321368] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-30T17:00:06.321416] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 47m 37s. Rate: 22.0 symbols/min [2025-09-30T17:00:06.439530] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-30T17:00:06.451242] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-30T17:00:06.522855] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:06.523103] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-09-30T17:00:06.523165] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-09-30T17:00:06.523253] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-30T17:00:06.523294] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-30T17:00:06.523336] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-30T17:00:06.523369] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-30T17:00:06.834760] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-30T17:00:06.850618] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-30T17:00:06.940310] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.940635] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-30T17:00:07.238862] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T17:00:07.239991] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-30T17:00:07.587533] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:00:07.589113] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-30T17:00:07.804485] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:00:07.815273] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-30T17:00:07.942402] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T17:00:07.943710] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-30T17:00:08.008047] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T17:00:08.019010] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-30T17:00:08.280329] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T17:00:08.281213] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-30T17:00:08.859238] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T17:00:08.860567] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-30T17:00:08.954243] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:00:08.967481] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-30T17:00:09.225320] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-30T17:00:09.226245] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-30T17:00:09.662612] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T17:00:09.663741] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-30T17:00:09.869858] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:00:09.881078] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-30T17:00:10.102077] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T17:00:10.102967] [INFO ] [REMOTE ] AAM: Full fetch complete (956 records). [2025-09-30T17:00:10.103047] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-30T17:00:10.309377] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-30T17:00:10.309542] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:10.309674] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:10.309752] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-30T17:00:10.309818] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-30T17:00:10.309863] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-30T17:00:10.309907] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-30T17:00:10.309979] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.7s. Estimated remaining: 2h 12m 31s. Rate: 17.9 symbols/min [2025-09-30T17:00:10.501048] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:10.554770] [DEBUG] [LOCAL ] AAT: Loaded 30539 existing records from primary storage. [2025-09-30T17:00:10.555049] [INFO ] [MAIN ] AAT: Loaded 30539 existing records. [2025-09-30T17:00:10.754611] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:10.754998] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-30T17:00:10.755063] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-30T17:00:10.756411] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-30T17:00:10.756475] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-30T17:00:10.909904] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T17:00:10.957055] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-30T17:00:11.183720] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:11.184142] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-30T17:00:11.634217] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (3.82 seconds). [2025-09-30T17:00:11.644761] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-30T17:00:12.400117] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:00:12.406772] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-30T17:00:12.445013] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:00:12.456306] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-30T17:00:13.316868] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (3.44 seconds). [2025-09-30T17:00:13.329793] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-30T17:00:13.427745] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:00:13.438413] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-30T17:00:13.609345] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:00:13.615150] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-30T17:00:14.127840] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:00:14.140053] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-30T17:00:15.316856] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:00:15.328069] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-30T17:00:15.715948] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-30T17:00:15.727788] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-30T17:00:16.555021] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-30T17:00:16.561301] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-30T17:00:17.438613] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:00:17.450880] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-30T17:00:17.848232] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:00:17.855307] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-30T17:00:18.336398] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-30T17:00:18.353173] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-30T17:00:18.961783] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-09-30T17:00:18.973077] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-30T17:00:19.302196] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T17:00:19.310267] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-30T17:00:19.350549] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T17:00:19.364185] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-30T17:00:20.306307] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:00:20.318899] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-30T17:00:20.363028] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:00:20.370255] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-30T17:00:21.747853] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:00:21.756242] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-30T17:00:22.456624] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-30T17:00:22.468128] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-30T17:00:22.741621] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (3.77 seconds). [2025-09-30T17:00:22.753157] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-30T17:00:23.188605] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:00:23.196147] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-30T17:00:23.995365] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (3.68 seconds). [2025-09-30T17:00:24.008815] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-30T17:00:24.478490] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T17:00:24.485992] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-30T17:00:24.747335] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T17:00:24.759715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-30T17:00:25.208318] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T17:00:25.220442] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-30T17:00:25.615718] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:00:25.622111] [INFO ] [REMOTE ] AAT: Full fetch complete (42443 records). [2025-09-30T17:00:25.622237] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-30T17:00:25.623018] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:25.623130] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:25.623176] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:25.623219] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-30T17:00:25.623278] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-30T17:00:25.623321] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-30T17:00:25.623855] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-30T17:00:25.624484] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 15.3s. Estimated remaining: 4h 49m 47s. Rate: 8.2 symbols/min [2025-09-30T17:00:25.828567] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:25.828823] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-30T17:00:25.829108] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-30T17:00:25.829247] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-30T17:00:25.829502] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-30T17:00:25.829596] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-30T17:00:25.829686] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-30T17:00:26.261791] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T17:00:26.326091] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:26.326979] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-30T17:00:26.329380] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-30T17:00:26.433135] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:00:26.447889] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-30T17:00:26.524633] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:00:26.524980] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-30T17:00:26.525082] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:00:26.525187] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-30T17:00:26.525276] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:00:26.525374] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-30T17:00:26.525459] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-30T17:00:26.525498] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-30T17:00:26.525539] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-30T17:00:26.525587] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 46m 8s. Rate: 10.5 symbols/min [2025-09-30T17:00:26.725775] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:26.759028] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:00:26.775409] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-30T17:00:26.802959] [DEBUG] [LOCAL ] AB: Loaded 27747 existing records from primary storage. [2025-09-30T17:00:26.803252] [INFO ] [MAIN ] AB: Loaded 27747 existing records. [2025-09-30T17:00:27.020229] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:27.020529] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-30T17:00:27.020608] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-30T17:00:27.021905] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-30T17:00:27.021986] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-30T17:00:27.438239] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:27.438726] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-30T17:00:27.861308] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:00:27.873823] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-30T17:00:28.398851] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:00:28.412712] [INFO ] [REMOTE ] AAP: Full fetch complete (75049 records). [2025-09-30T17:00:28.412901] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-30T17:00:28.883240] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-30T17:00:28.883508] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-30T17:00:28.884508] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-30T17:00:28.884858] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-30T17:00:28.915960] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-30T17:00:28.927891] [DEBUG] [LOCAL ] AAP: Trimmed 75049 records to 51971 (keeping 200 days of data) [2025-09-30T17:00:28.931951] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-30T17:00:29.070489] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:00:29.082520] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-30T17:00:29.303373] [DEBUG] [LOCAL ] AAP: Primary data saved (51971 records). [2025-09-30T17:00:29.303528] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-30T17:00:29.303995] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAP took 23.0s. Estimated remaining: 3h 22m 45s. Rate: 11.7 symbols/min [2025-09-30T17:00:29.506195] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:29.573496] [DEBUG] [LOCAL ] ABBV: Loaded 53684 existing records from primary storage. [2025-09-30T17:00:29.573891] [INFO ] [MAIN ] ABBV: Loaded 53684 existing records. [2025-09-30T17:00:29.807130] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:29.812495] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-30T17:00:29.825786] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-30T17:00:29.827620] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-30T17:00:29.827752] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-30T17:00:29.827547] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:00:29.916870] [INFO ] [REMOTE ] AA: Full fetch complete (77148 records). [2025-09-30T17:00:29.923931] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-30T17:00:29.943740] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:29.956241] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:29.962139] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:29.967391] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-30T17:00:29.972670] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-30T17:00:29.977880] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-30T17:00:29.983136] [DEBUG] [LOCAL ] AA: No derivative data file found to delete. [2025-09-30T17:00:29.988396] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AA took 26.4s. Estimated remaining: 2h 53m 23s. Rate: 13.6 symbols/min [2025-09-30T17:00:30.403535] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:30.480460] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:30.482135] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-30T17:00:30.524307] [DEBUG] [LOCAL ] ABCB: Loaded 30510 existing records from primary storage. [2025-09-30T17:00:30.524738] [INFO ] [MAIN ] ABCB: Loaded 30510 existing records. [2025-09-30T17:00:30.728039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:00:30.757367] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-30T17:00:30.781852] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:30.783386] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-30T17:00:30.783454] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-30T17:00:30.784189] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-30T17:00:30.784252] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-30T17:00:30.948465] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T17:00:30.996427] [INFO ] [REMOTE ] A: Full fetch complete (73063 records). [2025-09-30T17:00:31.014697] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-30T17:00:31.432496] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:31.455276] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-30T17:00:31.706763] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-30T17:00:31.706883] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-30T17:00:31.707832] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-30T17:00:31.707984] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-30T17:00:31.709815] [DEBUG] [LOCAL ] A: Trimmed 73063 records to 50719 (keeping 200 days of data) [2025-09-30T17:00:32.069708] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:00:32.083229] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-30T17:00:32.093338] [DEBUG] [LOCAL ] A: Primary data saved (50719 records). [2025-09-30T17:00:32.093502] [INFO ] [MAIN ] A: Full history saved. [2025-09-30T17:00:32.094261] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. A took 28.5s. Estimated remaining: 2h 40m 24s. Rate: 14.7 symbols/min [2025-09-30T17:00:32.331263] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:32.430177] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T17:00:32.442809] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-09-30T17:00:32.443838] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-30T17:00:32.444322] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-09-30T17:00:32.660202] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:32.660565] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-30T17:00:32.660773] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-30T17:00:32.661081] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-30T17:00:32.661142] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-30T17:00:32.971838] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:00:32.997178] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-30T17:00:33.090072] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:33.090514] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-30T17:00:33.710783] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:00:33.722444] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-30T17:00:34.156906] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:00:34.186409] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:00:34.193413] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-30T17:00:34.194963] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-30T17:00:34.806211] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:00:34.815455] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-30T17:00:35.172565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:00:35.179883] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-30T17:00:35.264775] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T17:00:35.279029] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-30T17:00:35.976946] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:00:35.984049] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-30T17:00:36.192937] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:00:36.200330] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-30T17:00:36.316363] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-30T17:00:36.326510] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-30T17:00:36.756709] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:00:36.762912] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-30T17:00:37.107466] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:00:37.118680] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-30T17:00:37.427729] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:00:37.440274] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-30T17:00:38.065407] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:00:38.074162] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-30T17:00:38.200129] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:00:38.212575] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-30T17:00:38.442111] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:00:38.453570] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-30T17:00:38.567149] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:00:38.573985] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-30T17:00:39.293887] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:00:39.299490] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-30T17:00:39.489085] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:00:39.495573] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-30T17:00:40.239754] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:00:40.252683] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-30T17:00:40.274726] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T17:00:40.280489] [INFO ] [REMOTE ] AB: Full fetch complete (45627 records). [2025-09-30T17:00:40.280678] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-30T17:00:40.637410] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T17:00:40.740602] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-30T17:00:40.800485] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-30T17:00:40.800623] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-30T17:00:40.801203] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-30T17:00:40.801288] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-30T17:00:40.825529] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:00:40.825751] [DEBUG] [LOCAL ] AB: Trimmed 45627 records to 27540 (keeping 200 days of data) [2025-09-30T17:00:40.834863] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-30T17:00:41.041764] [DEBUG] [LOCAL ] AB: Primary data saved (27540 records). [2025-09-30T17:00:41.041919] [INFO ] [MAIN ] AB: Full history saved. [2025-09-30T17:00:41.042027] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 14.5s. Estimated remaining: 3h 4m 20s. Rate: 12.8 symbols/min [2025-09-30T17:00:41.229338] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:41.229499] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-09-30T17:00:41.229541] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-09-30T17:00:41.229705] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-30T17:00:41.229763] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-30T17:00:41.229809] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-30T17:00:41.229845] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-30T17:00:41.664637] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:41.665170] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-30T17:00:42.250417] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T17:00:42.258159] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-30T17:00:42.360396] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T17:00:42.372275] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-30T17:00:42.471568] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T17:00:42.484947] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-30T17:00:42.878679] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:00:42.882008] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-30T17:00:43.765497] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:00:43.772199] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-30T17:00:43.964273] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:00:43.971893] [INFO ] [REMOTE ] ABCB: Full fetch complete (44464 records). [2025-09-30T17:00:43.972119] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-30T17:00:44.389285] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-30T17:00:44.456268] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-30T17:00:44.469421] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-30T17:00:44.469777] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-30T17:00:44.470479] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-30T17:00:44.470617] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-30T17:00:44.472329] [DEBUG] [LOCAL ] ABCB: Trimmed 44464 records to 30473 (keeping 200 days of data) [2025-09-30T17:00:44.667752] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T17:00:44.680543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-30T17:00:44.782759] [DEBUG] [LOCAL ] ABCB: Primary data saved (30473 records). [2025-09-30T17:00:44.782916] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-30T17:00:44.783081] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 14.8s. Estimated remaining: 3h 0m 9s. Rate: 13.1 symbols/min [2025-09-30T17:00:44.916469] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:00:44.941946] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-30T17:00:44.996264] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:45.041147] [DEBUG] [LOCAL ] ABM: Loaded 32159 existing records from primary storage. [2025-09-30T17:00:45.041486] [INFO ] [MAIN ] ABM: Loaded 32159 existing records. [2025-09-30T17:00:45.272547] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:45.272808] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-30T17:00:45.272860] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-30T17:00:45.273202] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-30T17:00:45.273288] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-30T17:00:45.697772] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:45.698118] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-30T17:00:46.039014] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:00:46.044505] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-30T17:00:46.596984] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-30T17:00:46.612480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-30T17:00:46.859271] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:00:46.880710] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-30T17:00:47.046943] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:00:47.058484] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-30T17:00:47.088181] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:00:47.098032] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-30T17:00:47.744021] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:00:47.747799] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-30T17:00:48.187698] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:00:48.194919] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-30T17:00:48.232038] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:00:48.246243] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-30T17:00:48.619968] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:00:48.632099] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-30T17:00:48.761226] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:00:48.765279] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-30T17:00:49.087260] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T17:00:49.093914] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-30T17:00:49.832294] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:00:49.845639] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-30T17:00:49.974426] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:00:49.979380] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-30T17:00:50.252059] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T17:00:50.260849] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-30T17:00:50.769257] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T17:00:50.780851] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-09-30T17:00:50.781063] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-30T17:00:50.786147] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:50.786276] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:50.786320] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:50.786386] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-30T17:00:50.786508] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-09-30T17:00:50.786585] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-09-30T17:00:50.787082] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-09-30T17:00:50.787278] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 21.5s. Estimated remaining: 3h 5m 42s. Rate: 12.7 symbols/min [2025-09-30T17:00:50.991964] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:51.056386] [DEBUG] [LOCAL ] ABR: Loaded 52026 existing records from primary storage. [2025-09-30T17:00:51.056813] [INFO ] [MAIN ] ABR: Loaded 52026 existing records. [2025-09-30T17:00:51.219026] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:00:51.276131] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-30T17:00:51.295573] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:51.296431] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-30T17:00:51.296604] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-30T17:00:51.297478] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-30T17:00:51.297558] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-30T17:00:51.739317] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T17:00:51.786967] [INFO ] [REMOTE ] ABEV: Full fetch complete (77208 records). [2025-09-30T17:00:51.787402] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-30T17:00:51.986059] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:51.977533] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T17:00:52.013801] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-30T17:00:52.045155] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-30T17:00:52.368102] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-30T17:00:52.368276] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-30T17:00:52.379022] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-30T17:00:52.379165] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-30T17:00:52.380635] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:00:52.384776] [INFO ] [REMOTE ] ABG: Full fetch complete (26470 records). [2025-09-30T17:00:52.385002] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-30T17:00:52.385246] [DEBUG] [LOCAL ] ABEV: Trimmed 77208 records to 53278 (keeping 200 days of data) [2025-09-30T17:00:52.910745] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-30T17:00:52.911067] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-30T17:00:52.911412] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-30T17:00:52.911781] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-30T17:00:52.914341] [DEBUG] [LOCAL ] ABG: Trimmed 26470 records to 18677 (keeping 200 days of data) [2025-09-30T17:00:53.148702] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:00:53.162218] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-30T17:00:53.199949] [DEBUG] [LOCAL ] ABG: Primary data saved (18677 records). [2025-09-30T17:00:53.203685] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-30T17:00:53.205056] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABG took 12.2s. Estimated remaining: 2h 57m 23s. Rate: 13.3 symbols/min [2025-09-30T17:00:53.413133] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:53.515064] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-09-30T17:00:53.515265] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-30T17:00:53.517538] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABEV took 21.4s. Estimated remaining: 2h 43m 34s. Rate: 14.4 symbols/min [2025-09-30T17:00:53.753223] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-30T17:00:53.792097] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:53.793185] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-09-30T17:00:53.979990] [DEBUG] [LOCAL ] ACA: Loaded 23441 existing records from primary storage. [2025-09-30T17:00:53.991247] [INFO ] [MAIN ] ACA: Loaded 23441 existing records. [2025-09-30T17:00:54.130389] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:54.142256] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-30T17:00:54.150351] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-30T17:00:54.187291] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-30T17:00:54.194959] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-30T17:00:54.284429] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T17:00:54.388845] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:54.401675] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-30T17:00:54.407095] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-30T17:00:54.421699] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-30T17:00:54.477117] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-30T17:00:54.477503] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-30T17:00:55.080775] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:55.086464] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-30T17:00:55.152197] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T17:00:55.214186] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-30T17:00:55.257679] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:55.258499] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-30T17:00:55.950817] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:00:55.961947] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-30T17:00:56.453731] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:00:56.458993] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-30T17:00:56.562002] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:00:56.571996] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-30T17:00:57.077547] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T17:00:57.088899] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-30T17:00:57.435901] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:00:57.441204] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-30T17:00:57.740022] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:00:57.750086] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-30T17:00:58.211984] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T17:00:58.217383] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-30T17:00:58.255423] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:00:58.264034] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-30T17:00:58.625762] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:00:58.637377] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-30T17:00:59.625136] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T17:00:59.633522] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-30T17:00:59.739072] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:00:59.750931] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-30T17:00:59.842440] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:00:59.850588] [INFO ] [REMOTE ] ABM: Full fetch complete (44700 records). [2025-09-30T17:00:59.850753] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-30T17:01:00.256570] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-30T17:01:00.256779] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-30T17:01:00.257353] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-30T17:01:00.257443] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-30T17:01:00.258890] [DEBUG] [LOCAL ] ABM: Trimmed 44700 records to 32024 (keeping 200 days of data) [2025-09-30T17:01:00.468284] [DEBUG] [LOCAL ] ABM: Primary data saved (32024 records). [2025-09-30T17:01:00.468498] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-30T17:01:00.468608] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.7s. Estimated remaining: 2h 51m 56s. Rate: 13.7 symbols/min [2025-09-30T17:01:00.603924] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T17:01:00.672600] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-30T17:01:00.695621] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:00.757620] [DEBUG] [LOCAL ] ACCO: Loaded 37516 existing records from primary storage. [2025-09-30T17:01:00.758031] [INFO ] [MAIN ] ACCO: Loaded 37516 existing records. [2025-09-30T17:01:00.957266] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T17:01:00.962912] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:00.963232] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-30T17:01:00.968756] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-30T17:01:00.969590] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-30T17:01:00.969555] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-30T17:01:00.969736] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-30T17:01:01.407447] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:01.407930] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-30T17:01:02.039155] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:01:02.051128] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-30T17:01:02.480763] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:01:02.487108] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-30T17:01:02.857895] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T17:01:02.870900] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-30T17:01:03.040137] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:01:03.048863] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-30T17:01:03.358747] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:01:03.365380] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-30T17:01:03.751474] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:01:03.763847] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-30T17:01:04.545602] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:01:04.557042] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-30T17:01:04.609940] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:01:04.622745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-30T17:01:04.754950] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:01:04.762905] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-30T17:01:05.680003] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T17:01:05.707278] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-30T17:01:05.708495] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T17:01:05.715987] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-30T17:01:06.022356] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:01:06.031025] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-30T17:01:06.218571] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:01:06.230213] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-30T17:01:06.451537] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:01:06.456209] [INFO ] [REMOTE ] ACA: Full fetch complete (34265 records). [2025-09-30T17:01:06.456324] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-30T17:01:06.889968] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-30T17:01:06.890062] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-30T17:01:06.890452] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-30T17:01:06.890526] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-30T17:01:06.891448] [DEBUG] [LOCAL ] ACA: Trimmed 34265 records to 23379 (keeping 200 days of data) [2025-09-30T17:01:07.047853] [DEBUG] [LOCAL ] ACA: Primary data saved (23379 records). [2025-09-30T17:01:07.048008] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-30T17:01:07.048118] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 13.5s. Estimated remaining: 2h 58m 2s. Rate: 13.2 symbols/min [2025-09-30T17:01:07.252236] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:07.252492] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-30T17:01:07.252550] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-30T17:01:07.252738] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-30T17:01:07.252785] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-30T17:01:07.252834] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-30T17:01:07.252875] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-30T17:01:07.675584] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:07.676605] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-30T17:01:07.705449] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:01:07.716544] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-30T17:01:07.756096] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T17:01:07.769220] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-30T17:01:08.255379] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:01:08.266922] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-30T17:01:08.856999] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:01:08.866464] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-30T17:01:08.956547] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:01:08.962813] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-30T17:01:09.621807] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T17:01:09.633802] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-30T17:01:09.777523] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:01:09.783070] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-30T17:01:10.086536] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:01:10.099365] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-30T17:01:10.576107] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:01:10.585910] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-30T17:01:10.987547] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:01:10.994074] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-30T17:01:11.275853] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:01:11.288013] [INFO ] [REMOTE ] ABR: Full fetch complete (75191 records). [2025-09-30T17:01:11.288199] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-30T17:01:11.735750] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-30T17:01:11.736222] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-30T17:01:11.737154] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-30T17:01:11.737389] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-30T17:01:11.739212] [DEBUG] [LOCAL ] ABR: Trimmed 75191 records to 52005 (keeping 200 days of data) [2025-09-30T17:01:11.868090] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T17:01:11.880412] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-30T17:01:12.144829] [DEBUG] [LOCAL ] ABR: Primary data saved (52005 records). [2025-09-30T17:01:12.145261] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-30T17:01:12.147794] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 21.4s. Estimated remaining: 2h 59m 27s. Rate: 13.1 symbols/min [2025-09-30T17:01:12.300910] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T17:01:12.390841] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:12.391447] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-30T17:01:12.428557] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T17:01:12.442498] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-30T17:01:12.500303] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-30T17:01:12.500738] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-09-30T17:01:12.710766] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:12.710987] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-30T17:01:12.711034] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-30T17:01:12.711908] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-30T17:01:12.712150] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-30T17:01:13.111568] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:13.112001] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-30T17:01:13.498507] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:01:13.506927] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-30T17:01:13.913949] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:01:13.922212] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-30T17:01:14.452957] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T17:01:14.464992] [INFO ] [REMOTE ] ABT: Full fetch complete (77592 records). [2025-09-30T17:01:14.465150] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-30T17:01:14.904082] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-30T17:01:14.904336] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-30T17:01:14.905348] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-30T17:01:14.905685] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-30T17:01:14.932412] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:01:14.940556] [DEBUG] [LOCAL ] ABT: Trimmed 77592 records to 53620 (keeping 200 days of data) [2025-09-30T17:01:14.942372] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-30T17:01:15.216096] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T17:01:15.223929] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-30T17:01:15.332761] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-09-30T17:01:15.332949] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-30T17:01:15.335048] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABT took 22.1s. Estimated remaining: 2h 55m 59s. Rate: 13.4 symbols/min [2025-09-30T17:01:15.568720] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:15.634060] [DEBUG] [LOCAL ] ACI: Loaded 53256 existing records from primary storage. [2025-09-30T17:01:15.634490] [INFO ] [MAIN ] ACI: Loaded 53256 existing records. [2025-09-30T17:01:15.838112] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:15.838462] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-30T17:01:15.838666] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-30T17:01:15.839282] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-30T17:01:15.839404] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-30T17:01:15.999666] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-30T17:01:16.037490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-30T17:01:16.272637] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T17:01:16.352190] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:16.353546] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-30T17:01:16.352882] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-30T17:01:16.378974] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:01:16.387542] [INFO ] [REMOTE ] ACCO: Full fetch complete (54119 records). [2025-09-30T17:01:16.387777] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-30T17:01:16.844962] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-30T17:01:16.845065] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-30T17:01:16.845629] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-30T17:01:16.845725] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-30T17:01:16.847467] [DEBUG] [LOCAL ] ACCO: Trimmed 54119 records to 37420 (keeping 200 days of data) [2025-09-30T17:01:17.083259] [DEBUG] [LOCAL ] ACCO: Primary data saved (37420 records). [2025-09-30T17:01:17.083425] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-30T17:01:17.083515] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 16.6s. Estimated remaining: 2h 49m 36s. Rate: 13.9 symbols/min [2025-09-30T17:01:17.270395] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:17.323270] [DEBUG] [LOCAL ] ACM: Loaded 43033 existing records from primary storage. [2025-09-30T17:01:17.323741] [INFO ] [MAIN ] ACM: Loaded 43033 existing records. [2025-09-30T17:01:17.541263] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:17.541511] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-30T17:01:17.541563] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-30T17:01:17.541987] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-30T17:01:17.542054] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-30T17:01:17.687523] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:01:17.732835] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-30T17:01:18.002683] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:18.003171] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-30T17:01:18.041661] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:01:18.654369] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-30T17:01:18.705511] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-30T17:01:18.826125] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:01:19.454335] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-30T17:01:19.557862] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:01:20.254368] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-30T17:01:20.345118] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:01:21.054393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-30T17:01:21.535754] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:01:21.541284] [INFO ] [REMOTE ] ACEL: Full fetch complete (38722 records). [2025-09-30T17:01:21.541388] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-30T17:01:21.859068] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-30T17:01:22.003393] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-30T17:01:22.003502] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-30T17:01:22.004064] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-30T17:01:22.004199] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-30T17:01:22.037229] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-30T17:01:22.048169] [DEBUG] [LOCAL ] ACEL: Trimmed 38722 records to 26829 (keeping 200 days of data) [2025-09-30T17:01:22.230326] [DEBUG] [LOCAL ] ACEL: Primary data saved (26829 records). [2025-09-30T17:01:22.230476] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-30T17:01:22.230554] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 15.2s. Estimated remaining: 2h 51m 19s. Rate: 13.7 symbols/min [2025-09-30T17:01:22.411730] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:22.471872] [DEBUG] [LOCAL ] ACN: Loaded 53425 existing records from primary storage. [2025-09-30T17:01:22.472228] [INFO ] [MAIN ] ACN: Loaded 53425 existing records. [2025-09-30T17:01:22.662989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-30T17:01:22.669474] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:22.670898] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-30T17:01:22.671055] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-30T17:01:22.671713] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-30T17:01:22.671777] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-30T17:01:23.090936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T17:01:23.127067] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:23.239051] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:01:23.454371] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-30T17:01:24.254397] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-30T17:01:25.054373] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-30T17:01:25.356077] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-30T17:01:25.503497] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-30T17:01:25.566047] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:01:25.854590] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-30T17:01:26.654377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-30T17:01:26.802765] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:01:27.308715] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:01:27.454396] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-30T17:01:28.254606] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-30T17:01:29.054393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-30T17:01:29.387942] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-30T17:01:29.432769] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:01:29.854383] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-30T17:01:30.250868] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:01:30.654360] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-30T17:01:31.189982] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T17:01:31.414582] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T17:01:31.454373] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-30T17:01:32.181036] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T17:01:32.254382] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-30T17:01:33.054390] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-30T17:01:33.825394] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:01:33.854315] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-30T17:01:33.931043] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T17:01:34.630117] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:01:34.654313] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-30T17:01:35.454376] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-30T17:01:35.542446] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:01:36.254375] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-30T17:01:36.445663] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T17:01:37.054365] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-30T17:01:37.391441] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:01:37.833185] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:01:37.854333] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-30T17:01:38.654423] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-30T17:01:39.454440] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-30T17:01:39.553096] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:01:39.677886] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-30T17:01:40.221921] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:01:40.254414] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-30T17:01:41.054436] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-30T17:01:41.439711] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T17:01:41.854364] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-30T17:01:42.472875] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:01:42.483429] [INFO ] [REMOTE ] ACM: Full fetch complete (62741 records). [2025-09-30T17:01:42.483671] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-30T17:01:42.659466] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-30T17:01:42.949845] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-30T17:01:42.949957] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-30T17:01:42.950636] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-30T17:01:42.950727] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-30T17:01:42.952114] [DEBUG] [LOCAL ] ACM: Trimmed 62741 records to 42987 (keeping 200 days of data) [2025-09-30T17:01:43.252962] [DEBUG] [LOCAL ] ACM: Primary data saved (42987 records). [2025-09-30T17:01:43.253155] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-30T17:01:43.255295] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 26.2s. Estimated remaining: 3h 25m 37s. Rate: 11.4 symbols/min [2025-09-30T17:01:43.446412] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:43.446587] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-09-30T17:01:43.446628] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-09-30T17:01:43.446956] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-30T17:01:43.446998] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-30T17:01:43.447040] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-30T17:01:43.447072] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-30T17:01:43.878229] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:43.878909] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-30T17:01:43.928875] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T17:01:43.985072] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-30T17:01:44.254374] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-30T17:01:44.587416] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:01:44.599480] [INFO ] [REMOTE ] ACI: Full fetch complete (76668 records). [2025-09-30T17:01:44.599747] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-30T17:01:44.600854] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:01:44.600954] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:01:44.601000] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:01:44.601077] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-30T17:01:44.601161] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-09-30T17:01:44.601210] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-09-30T17:01:44.601500] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-09-30T17:01:44.601605] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 29.3s. Estimated remaining: 3h 17m 53s. Rate: 11.9 symbols/min [2025-09-30T17:01:44.801607] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:44.810127] [DEBUG] [LOCAL ] ACR: Loaded 6054 existing records from primary storage. [2025-09-30T17:01:44.810363] [INFO ] [MAIN ] ACR: Loaded 6054 existing records. [2025-09-30T17:01:45.022030] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:45.022277] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-30T17:01:45.022333] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-30T17:01:45.022551] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-30T17:01:45.022631] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-30T17:01:45.059533] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-30T17:01:45.440889] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:45.591531] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:01:45.854407] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-30T17:01:46.643393] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T17:01:46.654334] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-30T17:01:47.073345] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T17:01:47.092020] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-30T17:01:47.167055] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T17:01:47.454423] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-30T17:01:48.099450] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T17:01:48.254368] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-30T17:01:49.054382] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-30T17:01:49.854405] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-30T17:01:50.628094] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T17:01:50.654347] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-30T17:01:51.269168] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-30T17:01:51.298961] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-30T17:01:51.299273] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-30T17:01:51.311442] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-30T17:01:51.447717] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:01:51.455423] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-30T17:01:51.787226] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-30T17:01:51.787334] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-30T17:01:51.788188] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-30T17:01:51.788315] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-30T17:01:51.790011] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-30T17:01:52.134382] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-30T17:01:52.134547] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-30T17:01:52.134678] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 40.0s. Estimated remaining: 3h 22m 26s. Rate: 11.6 symbols/min [2025-09-30T17:01:52.256845] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-30T17:01:52.293178] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T17:01:52.353934] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:52.388815] [DEBUG] [LOCAL ] ACRE: Loaded 33528 existing records from primary storage. [2025-09-30T17:01:52.389192] [INFO ] [MAIN ] ACRE: Loaded 33528 existing records. [2025-09-30T17:01:52.636701] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:52.636989] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-30T17:01:52.637073] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-30T17:01:52.637421] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-30T17:01:52.637503] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-30T17:01:53.028762] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:53.054371] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-30T17:01:53.854390] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-30T17:01:54.265372] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T17:01:54.303220] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:01:54.645432] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:01:54.654303] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-30T17:01:55.454409] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-30T17:01:55.733201] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T17:01:56.254372] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-30T17:01:57.043879] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:01:57.054344] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-30T17:01:57.407311] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:01:57.420190] [INFO ] [REMOTE ] ACN: Full fetch complete (77116 records). [2025-09-30T17:01:57.420365] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-30T17:01:57.732186] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:01:57.855271] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-30T17:01:57.874967] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-30T17:01:57.875999] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-30T17:01:57.876863] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-30T17:01:57.876975] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-30T17:01:57.879025] [DEBUG] [LOCAL ] ACN: Trimmed 77116 records to 53425 (keeping 200 days of data) [2025-09-30T17:01:58.268716] [DEBUG] [LOCAL ] ACN: Primary data saved (53425 records). [2025-09-30T17:01:58.268874] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-30T17:01:58.270571] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 36.0s. Estimated remaining: 3h 24m 4s. Rate: 11.5 symbols/min [2025-09-30T17:01:58.494679] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:58.506581] [DEBUG] [LOCAL ] ACV: Loaded 7105 existing records from primary storage. [2025-09-30T17:01:58.506861] [INFO ] [MAIN ] ACV: Loaded 7105 existing records. [2025-09-30T17:01:58.573122] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T17:01:58.609127] [INFO ] [REMOTE ] ACR: Full fetch complete (8546 records). [2025-09-30T17:01:58.630043] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-30T17:01:58.650231] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:01:58.650500] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:01:58.656473] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-30T17:01:58.656605] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:01:58.673007] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-30T17:01:58.697857] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-09-30T17:01:58.754881] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-09-30T17:01:58.754252] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:58.755552] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-30T17:01:58.755627] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-30T17:01:58.755718] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-09-30T17:01:58.755905] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACR took 14.2s. Estimated remaining: 3h 15m 56s. Rate: 12.0 symbols/min [2025-09-30T17:01:58.761671] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-30T17:01:58.807741] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-30T17:01:59.207639] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:59.421944] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:59.456868] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-30T17:01:59.459160] [DEBUG] [LOCAL ] ACVA: Loaded 49259 existing records from primary storage. [2025-09-30T17:01:59.459633] [INFO ] [MAIN ] ACVA: Loaded 49259 existing records. [2025-09-30T17:01:59.701943] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:59.702363] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-30T17:01:59.702426] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-30T17:01:59.702874] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-30T17:01:59.702936] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-30T17:02:00.146160] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:00.233706] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T17:02:00.254340] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-30T17:02:00.773038] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:02:00.922853] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:02:01.054420] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-30T17:02:01.667916] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:02:01.854373] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-30T17:02:02.654448] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-30T17:02:03.124613] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:02:03.287531] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:02:03.454375] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-30T17:02:04.206895] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:02:04.254418] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-30T17:02:05.054396] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-30T17:02:05.889945] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-30T17:02:05.907484] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:02:05.926680] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T17:02:06.654357] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-30T17:02:07.459479] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-30T17:02:07.477327] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:02:07.668963] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T17:02:08.254927] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-30T17:02:08.256212] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T17:02:09.054390] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-30T17:02:09.511824] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:02:09.854379] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-30T17:02:10.451221] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:02:10.522377] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T17:02:10.654391] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-30T17:02:11.454410] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-30T17:02:11.896117] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T17:02:12.254422] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-30T17:02:12.899419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T17:02:13.054363] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-30T17:02:13.589686] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:02:13.603847] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T17:02:13.854394] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-30T17:02:14.654366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-30T17:02:15.217755] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T17:02:15.454386] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-30T17:02:15.928521] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T17:02:16.254397] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-30T17:02:16.979946] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:02:16.987217] [INFO ] [REMOTE ] ACRE: Full fetch complete (50677 records). [2025-09-30T17:02:16.987323] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-30T17:02:17.060096] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-30T17:02:17.445118] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-30T17:02:17.445239] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-30T17:02:17.445830] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-30T17:02:17.445900] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-30T17:02:17.447164] [DEBUG] [LOCAL ] ACRE: Trimmed 50677 records to 33553 (keeping 200 days of data) [2025-09-30T17:02:17.668690] [DEBUG] [LOCAL ] ACRE: Primary data saved (33553 records). [2025-09-30T17:02:17.668972] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-30T17:02:17.669406] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACRE took 25.5s. Estimated remaining: 3h 38m 31s. Rate: 10.7 symbols/min [2025-09-30T17:02:17.809531] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:02:17.860754] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-30T17:02:17.885437] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:17.887487] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-30T17:02:17.887595] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-30T17:02:17.887786] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-30T17:02:17.887858] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-30T17:02:17.887936] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-30T17:02:17.888008] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-30T17:02:18.282635] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:18.314543] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:02:18.654373] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-30T17:02:18.844482] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T17:02:18.847782] [INFO ] [REMOTE ] ACV: Full fetch complete (9918 records). [2025-09-30T17:02:18.847889] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-30T17:02:18.876588] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:02:18.920215] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-30T17:02:18.942485] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:02:18.954922] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-30T17:02:18.969969] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:02:18.973341] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-30T17:02:18.973448] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-30T17:02:18.973516] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-30T17:02:18.973964] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-30T17:02:18.979498] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 1.3s. Estimated remaining: 3h 31m 44s. Rate: 11.1 symbols/min [2025-09-30T17:02:19.411215] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:19.457344] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-30T17:02:19.492338] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-30T17:02:19.492504] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-30T17:02:19.492797] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-30T17:02:19.492978] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-30T17:02:19.493848] [DEBUG] [LOCAL ] ACV: Trimmed 9918 records to 7194 (keeping 200 days of data) [2025-09-30T17:02:19.568681] [DEBUG] [LOCAL ] ACV: Primary data saved (7194 records). [2025-09-30T17:02:19.568977] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-30T17:02:19.569107] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 21.3s. Estimated remaining: 3h 24m 24s. Rate: 11.5 symbols/min [2025-09-30T17:02:19.734612] [DEBUG] [LOCAL ] ADC: Loaded 46182 existing records from primary storage. [2025-09-30T17:02:19.759091] [INFO ] [MAIN ] ADC: Loaded 46182 existing records. [2025-09-30T17:02:19.840757] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:20.012334] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:20.012668] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-30T17:02:20.012735] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-30T17:02:20.013099] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-30T17:02:20.013164] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-30T17:02:20.190460] [DEBUG] [LOCAL ] ADCT: Loaded 34320 existing records from primary storage. [2025-09-30T17:02:20.216061] [INFO ] [MAIN ] ADCT: Loaded 34320 existing records. [2025-09-30T17:02:20.255248] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-30T17:02:20.708581] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:20.715409] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:20.716015] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-30T17:02:20.716414] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-30T17:02:20.716990] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-30T17:02:20.717069] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-30T17:02:21.054867] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-30T17:02:21.156589] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:21.183391] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:02:21.854333] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-30T17:02:22.215674] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T17:02:22.654380] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-30T17:02:22.771508] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:02:23.331867] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:02:23.454366] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-30T17:02:23.745391] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:02:24.254413] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-30T17:02:24.571156] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:02:25.054368] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-30T17:02:25.552281] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:02:25.854377] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-30T17:02:26.654376] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-30T17:02:26.824385] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T17:02:27.233743] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:02:27.454364] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-30T17:02:28.141305] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:02:28.254413] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-30T17:02:28.720367] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T17:02:29.054377] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-30T17:02:29.854340] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-30T17:02:29.885132] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:02:30.376117] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T17:02:30.654373] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-30T17:02:31.094496] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:02:31.454360] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-30T17:02:32.037865] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:02:32.254366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-30T17:02:33.054373] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-30T17:02:33.164719] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:02:33.612005] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:02:33.854424] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-30T17:02:34.447151] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:02:34.455567] [INFO ] [REMOTE ] ACP: Full fetch complete (47495 records). [2025-09-30T17:02:34.455779] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-30T17:02:34.654762] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-30T17:02:34.905030] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-30T17:02:34.905150] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-30T17:02:34.905699] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-30T17:02:34.905778] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-30T17:02:34.907037] [DEBUG] [LOCAL ] ACP: Trimmed 47495 records to 30970 (keeping 200 days of data) [2025-09-30T17:02:35.125768] [DEBUG] [LOCAL ] ACP: Primary data saved (30970 records). [2025-09-30T17:02:35.125921] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-30T17:02:35.126001] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACP took 51.9s. Estimated remaining: 3h 39m 15s. Rate: 10.7 symbols/min [2025-09-30T17:02:35.355209] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:02:35.353796] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:35.362872] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-09-30T17:02:35.363094] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-09-30T17:02:35.363673] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-30T17:02:35.363795] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-30T17:02:35.363850] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-30T17:02:35.363886] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-30T17:02:35.459529] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-30T17:02:35.795791] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:36.254407] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-30T17:02:36.335577] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:02:37.054341] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-30T17:02:37.120689] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:02:37.716408] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:02:37.854424] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-30T17:02:38.654442] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-30T17:02:39.182527] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:02:39.193979] [INFO ] [REMOTE ] ACVA: Full fetch complete (70322 records). [2025-09-30T17:02:39.194157] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-30T17:02:39.460535] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-30T17:02:39.671207] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-30T17:02:39.671406] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-30T17:02:39.672184] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-30T17:02:39.672323] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-30T17:02:39.674898] [DEBUG] [LOCAL ] ACVA: Trimmed 70322 records to 49249 (keeping 200 days of data) [2025-09-30T17:02:39.838743] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T17:02:40.030880] [DEBUG] [LOCAL ] ACVA: Primary data saved (49249 records). [2025-09-30T17:02:40.031029] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-30T17:02:40.031128] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 41.3s. Estimated remaining: 3h 38m 10s. Rate: 10.7 symbols/min [2025-09-30T17:02:40.237306] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:40.237691] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-09-30T17:02:40.237818] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-09-30T17:02:40.238131] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-30T17:02:40.238220] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-30T17:02:40.238398] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-30T17:02:40.238457] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-30T17:02:40.277854] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-30T17:02:40.600465] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:02:40.702676] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:40.990099] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:02:41.054335] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-30T17:02:41.854395] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-30T17:02:42.252600] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T17:02:42.304073] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T17:02:42.654414] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-30T17:02:43.306806] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:02:43.454456] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-30T17:02:44.202527] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:02:44.254353] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-30T17:02:44.631927] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:02:44.640909] [INFO ] [REMOTE ] ADCT: Full fetch complete (51592 records). [2025-09-30T17:02:44.641066] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-30T17:02:45.056806] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-30T17:02:45.099813] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-30T17:02:45.099916] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-30T17:02:45.100524] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-30T17:02:45.100669] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-30T17:02:45.102629] [DEBUG] [LOCAL ] ADCT: Trimmed 51592 records to 34480 (keeping 200 days of data) [2025-09-30T17:02:45.318674] [DEBUG] [LOCAL ] ADCT: Primary data saved (34480 records). [2025-09-30T17:02:45.318839] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-30T17:02:45.320206] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADCT took 25.8s. Estimated remaining: 3h 37m 41s. Rate: 10.8 symbols/min [2025-09-30T17:02:45.510860] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:45.569563] [DEBUG] [LOCAL ] ADT: Loaded 53469 existing records from primary storage. [2025-09-30T17:02:45.569992] [INFO ] [MAIN ] ADT: Loaded 53469 existing records. [2025-09-30T17:02:45.759967] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:45.760331] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-30T17:02:45.760407] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-30T17:02:45.761158] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-30T17:02:45.761221] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-30T17:02:45.855717] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-30T17:02:46.195676] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:46.239570] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:02:46.654383] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-30T17:02:46.921533] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:02:47.186941] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:02:47.454403] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-30T17:02:48.254353] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-30T17:02:48.326863] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T17:02:48.592709] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:02:49.054417] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-30T17:02:49.794068] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:02:49.854417] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-30T17:02:50.654414] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-30T17:02:50.940707] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T17:02:51.171829] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:02:51.454385] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-30T17:02:52.254349] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-30T17:02:52.371969] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:02:52.955891] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:02:53.054423] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-30T17:02:53.854399] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-30T17:02:54.239497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T17:02:54.484477] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:02:54.654370] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-30T17:02:55.243834] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T17:02:55.454412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-30T17:02:56.254410] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-30T17:02:56.344393] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:02:57.054401] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-30T17:02:57.379449] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:02:57.854435] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-30T17:02:57.906104] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:02:58.278859] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:02:58.654388] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-30T17:02:59.454622] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-30T17:02:59.614065] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:03:00.254369] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-30T17:03:00.371129] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:03:00.756492] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:03:01.054400] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-30T17:03:01.854395] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-30T17:03:02.200138] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:03:02.364104] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:03:02.654416] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-30T17:03:03.454419] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-30T17:03:03.927739] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T17:03:04.254418] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-30T17:03:04.382762] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:03:04.392732] [INFO ] [REMOTE ] ADNT: Full fetch complete (67995 records). [2025-09-30T17:03:04.392895] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-30T17:03:04.900370] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-30T17:03:04.900540] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-30T17:03:04.901734] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-30T17:03:04.901913] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-30T17:03:04.904082] [DEBUG] [LOCAL ] ADNT: Trimmed 67995 records to 47238 (keeping 200 days of data) [2025-09-30T17:03:04.944099] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:03:05.055901] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-30T17:03:05.254751] [DEBUG] [LOCAL ] ADNT: Primary data saved (47238 records). [2025-09-30T17:03:05.254906] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-30T17:03:05.254986] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADNT took 25.2s. Estimated remaining: 3h 56m 15s. Rate: 9.9 symbols/min [2025-09-30T17:03:05.447263] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:05.478232] [DEBUG] [LOCAL ] ADX: Loaded 27588 existing records from primary storage. [2025-09-30T17:03:05.478805] [INFO ] [MAIN ] ADX: Loaded 27588 existing records. [2025-09-30T17:03:05.743958] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:05.744259] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-30T17:03:05.744322] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-30T17:03:05.744818] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-30T17:03:05.744881] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-30T17:03:05.859472] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-30T17:03:06.186978] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:06.213690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T17:03:06.223770] [INFO ] [REMOTE ] ADC: Full fetch complete (66125 records). [2025-09-30T17:03:06.223952] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-30T17:03:06.649093] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-30T17:03:06.649219] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-30T17:03:06.649937] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-30T17:03:06.650004] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-30T17:03:06.651585] [DEBUG] [LOCAL ] ADC: Trimmed 66125 records to 46153 (keeping 200 days of data) [2025-09-30T17:03:06.654423] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-30T17:03:06.955905] [DEBUG] [LOCAL ] ADC: Primary data saved (46153 records). [2025-09-30T17:03:06.956045] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-30T17:03:06.956130] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADC took 48.0s. Estimated remaining: 3h 50m 41s. Rate: 10.1 symbols/min [2025-09-30T17:03:07.139238] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:07.173631] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T17:03:07.230904] [DEBUG] [LOCAL ] AEE: Loaded 50084 existing records from primary storage. [2025-09-30T17:03:07.231239] [INFO ] [MAIN ] AEE: Loaded 50084 existing records. [2025-09-30T17:03:07.444183] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:07.444418] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-30T17:03:07.444471] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-30T17:03:07.444932] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-30T17:03:07.444993] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-30T17:03:07.460549] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-30T17:03:07.883579] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:07.912701] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:03:07.941004] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:03:08.254419] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-30T17:03:09.054347] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-30T17:03:09.485615] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T17:03:09.501022] [INFO ] [REMOTE ] ADM: Full fetch complete (76848 records). [2025-09-30T17:03:09.501276] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-30T17:03:09.502610] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:03:09.502798] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:03:09.502845] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:03:09.502889] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-30T17:03:09.502950] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-30T17:03:09.502985] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-09-30T17:03:09.503043] [DEBUG] [LOCAL ] ADM: No derivative data file found to delete. [2025-09-30T17:03:09.503130] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADM took 34.4s. Estimated remaining: 3h 46m 29s. Rate: 10.3 symbols/min [2025-09-30T17:03:09.694272] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:09.705666] [DEBUG] [LOCAL ] AEFC: Loaded 8491 existing records from primary storage. [2025-09-30T17:03:09.705942] [INFO ] [MAIN ] AEFC: Loaded 8491 existing records. [2025-09-30T17:03:09.861502] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-30T17:03:09.910279] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:09.911705] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-30T17:03:09.911862] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-30T17:03:09.912253] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-30T17:03:09.912356] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-30T17:03:10.160406] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T17:03:10.377483] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:10.399812] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:03:10.654409] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-30T17:03:11.454335] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-30T17:03:11.726572] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T17:03:12.254421] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-30T17:03:12.747910] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:03:12.760065] [INFO ] [REMOTE ] ADT: Full fetch complete (77200 records). [2025-09-30T17:03:12.760224] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-30T17:03:12.927789] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:03:13.067010] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-30T17:03:13.259122] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-30T17:03:13.259209] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-30T17:03:13.260027] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-30T17:03:13.260095] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-30T17:03:13.262092] [DEBUG] [LOCAL ] ADT: Trimmed 77200 records to 53463 (keeping 200 days of data) [2025-09-30T17:03:13.620443] [DEBUG] [LOCAL ] ADT: Primary data saved (53463 records). [2025-09-30T17:03:13.620607] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-30T17:03:13.621674] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 28.3s. Estimated remaining: 3h 44m 23s. Rate: 10.4 symbols/min [2025-09-30T17:03:13.825240] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:13.856226] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T17:03:13.854514] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-30T17:03:13.909501] [DEBUG] [LOCAL ] AEG: Loaded 49547 existing records from primary storage. [2025-09-30T17:03:13.909889] [INFO ] [MAIN ] AEG: Loaded 49547 existing records. [2025-09-30T17:03:14.104117] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:03:14.135221] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:14.135941] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-30T17:03:14.135991] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-30T17:03:14.136490] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-30T17:03:14.136551] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-30T17:03:14.597259] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:14.654417] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-30T17:03:15.278192] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:03:15.454371] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-30T17:03:16.254355] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-30T17:03:16.330620] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:03:16.847095] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:03:16.990167] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T17:03:17.054360] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-30T17:03:17.755830] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T17:03:17.854371] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-30T17:03:18.654360] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-30T17:03:19.022072] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:03:19.094378] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T17:03:19.454378] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-30T17:03:20.254358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-30T17:03:21.054338] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-30T17:03:21.131177] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:03:21.219367] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T17:03:21.854358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-30T17:03:22.654387] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-30T17:03:23.101791] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:03:23.172348] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T17:03:23.454365] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-30T17:03:24.073319] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:03:24.254366] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-30T17:03:24.749532] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:03:25.054367] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-30T17:03:25.839106] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:03:25.854315] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-30T17:03:26.654386] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-30T17:03:26.797737] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:03:27.454382] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-30T17:03:27.735194] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:03:27.758109] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T17:03:28.254405] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-30T17:03:28.971152] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:03:29.054390] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-30T17:03:29.854392] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-30T17:03:30.005417] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:03:30.611584] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:03:30.654406] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-30T17:03:31.337710] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:03:31.345415] [INFO ] [REMOTE ] ADX: Full fetch complete (42034 records). [2025-09-30T17:03:31.345612] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-30T17:03:31.459505] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-30T17:03:31.749777] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-30T17:03:31.749918] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-30T17:03:31.750498] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-30T17:03:31.750542] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-30T17:03:31.751768] [DEBUG] [LOCAL ] ADX: Trimmed 42034 records to 27514 (keeping 200 days of data) [2025-09-30T17:03:31.928517] [DEBUG] [LOCAL ] ADX: Primary data saved (27514 records). [2025-09-30T17:03:31.928752] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-30T17:03:31.928872] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 26.7s. Estimated remaining: 3h 58m 40s. Rate: 9.8 symbols/min [2025-09-30T17:03:32.139809] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:32.207298] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-30T17:03:32.207926] [INFO ] [MAIN ] AEM: Loaded 53465 existing records. [2025-09-30T17:03:32.263520] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-30T17:03:32.385669] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T17:03:32.438723] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:32.440503] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-30T17:03:32.457822] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-30T17:03:32.473480] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-30T17:03:32.474114] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-30T17:03:32.476231] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:03:32.938974] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:33.054378] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-30T17:03:33.854424] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-30T17:03:33.931563] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:03:34.654444] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-30T17:03:34.857970] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:03:35.454372] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-30T17:03:35.811413] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:03:36.254432] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-30T17:03:36.271124] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:03:36.381544] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:03:37.054569] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-30T17:03:37.854466] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-30T17:03:37.996152] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:03:38.007480] [INFO ] [REMOTE ] AEE: Full fetch complete (72586 records). [2025-09-30T17:03:38.007694] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-30T17:03:38.437361] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-30T17:03:38.437470] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-30T17:03:38.438246] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-30T17:03:38.438349] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-30T17:03:38.440015] [DEBUG] [LOCAL ] AEE: Trimmed 72586 records to 50091 (keeping 200 days of data) [2025-09-30T17:03:38.673617] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-30T17:03:38.682679] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:03:38.790157] [DEBUG] [LOCAL ] AEE: Primary data saved (50091 records). [2025-09-30T17:03:38.790290] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-30T17:03:38.790377] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 31.8s. Estimated remaining: 3h 59m 23s. Rate: 9.8 symbols/min [2025-09-30T17:03:38.977390] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:39.016507] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:03:39.080203] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-30T17:03:39.080594] [INFO ] [MAIN ] AEO: Loaded 53558 existing records. [2025-09-30T17:03:39.277611] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:39.277882] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-30T17:03:39.277956] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-30T17:03:39.278597] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-30T17:03:39.278706] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-30T17:03:39.464622] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-30T17:03:39.660248] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:40.251319] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:03:40.254302] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-30T17:03:40.390130] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:03:41.054349] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-30T17:03:41.116850] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:03:41.854459] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-30T17:03:42.591109] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:03:42.593037] [INFO ] [REMOTE ] AEFC: Full fetch complete (12264 records). [2025-09-30T17:03:42.593112] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-30T17:03:42.661086] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-30T17:03:43.030807] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-30T17:03:43.030998] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-30T17:03:43.031245] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-30T17:03:43.031322] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-30T17:03:43.032175] [DEBUG] [LOCAL ] AEFC: Trimmed 12264 records to 8535 (keeping 200 days of data) [2025-09-30T17:03:43.101085] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-30T17:03:43.124907] [DEBUG] [LOCAL ] AEFC: Primary data saved (8535 records). [2025-09-30T17:03:43.125060] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-30T17:03:43.125145] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 33.6s. Estimated remaining: 3h 57m 19s. Rate: 9.8 symbols/min [2025-09-30T17:03:43.319545] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:43.383692] [DEBUG] [LOCAL ] AER: Loaded 48447 existing records from primary storage. [2025-09-30T17:03:43.384228] [INFO ] [MAIN ] AER: Loaded 48447 existing records. [2025-09-30T17:03:43.459470] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-30T17:03:43.640573] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:43.640864] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-30T17:03:43.640920] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-30T17:03:43.641232] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-30T17:03:43.641292] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-30T17:03:44.033214] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:44.254415] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-30T17:03:44.514120] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:03:45.054398] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-30T17:03:45.450217] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:03:45.854435] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-30T17:03:46.020257] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:03:46.516046] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:03:46.526956] [INFO ] [REMOTE ] AEG: Full fetch complete (70367 records). [2025-09-30T17:03:46.527166] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-30T17:03:46.659545] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-30T17:03:46.949068] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-30T17:03:46.949154] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-30T17:03:46.949955] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-30T17:03:46.950023] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-30T17:03:46.951818] [DEBUG] [LOCAL ] AEG: Trimmed 70367 records to 49547 (keeping 200 days of data) [2025-09-30T17:03:47.261305] [DEBUG] [LOCAL ] AEG: Primary data saved (49547 records). [2025-09-30T17:03:47.261496] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-30T17:03:47.262270] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 33.6s. Estimated remaining: 3h 55m 9s. Rate: 9.9 symbols/min [2025-09-30T17:03:47.454406] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-30T17:03:48.148062] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:03:48.259993] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-30T17:03:48.272167] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:03:49.054369] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-30T17:03:49.229422] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T17:03:49.854430] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-30T17:03:50.314182] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T17:03:50.654407] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-30T17:03:50.707182] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:03:51.241107] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T17:03:51.454371] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-30T17:03:52.254328] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-30T17:03:52.521870] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T17:03:53.054320] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-30T17:03:53.135486] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:03:53.612015] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:03:53.854374] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-30T17:03:54.654412] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-30T17:03:55.113200] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T17:03:55.454327] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-30T17:03:55.668156] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:03:56.254363] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-30T17:03:56.333135] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:03:57.056193] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:03:57.056355] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-30T17:03:57.854403] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-30T17:03:58.159958] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T17:03:58.475382] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:03:58.654393] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-30T17:03:59.454434] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-30T17:04:00.022198] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:04:00.118475] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-30T17:04:00.130495] [INFO ] [REMOTE ] AEM: Full fetch complete (77151 records). [2025-09-30T17:04:00.130670] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-30T17:04:00.259541] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-30T17:04:00.560404] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-30T17:04:00.560498] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-30T17:04:00.561225] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-30T17:04:00.561292] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-30T17:04:00.562928] [DEBUG] [LOCAL ] AEM: Trimmed 77151 records to 53464 (keeping 200 days of data) [2025-09-30T17:04:00.926044] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-09-30T17:04:00.926196] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-30T17:04:00.926297] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 29.0s. Estimated remaining: 4h 2m 51s. Rate: 9.6 symbols/min [2025-09-30T17:04:01.457992] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T17:04:01.470391] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-30T17:04:02.030295] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:04:02.041832] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-30T17:04:03.564127] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T17:04:03.581065] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-30T17:04:03.703589] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:04:03.714562] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-30T17:04:05.358231] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:04:05.369184] [INFO ] [REMOTE ] AER: Full fetch complete (69552 records). [2025-09-30T17:04:05.369352] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-30T17:04:05.830961] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-30T17:04:05.831330] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-30T17:04:05.832233] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-30T17:04:05.832326] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-30T17:04:05.837077] [DEBUG] [LOCAL ] AER: Trimmed 69552 records to 48382 (keeping 200 days of data) [2025-09-30T17:04:05.972154] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T17:04:05.986346] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-30T17:04:06.220149] [DEBUG] [LOCAL ] AER: Primary data saved (48382 records). [2025-09-30T17:04:06.220372] [INFO ] [MAIN ] AER: Full history saved. [2025-09-30T17:04:06.222370] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 23.1s. Estimated remaining: 4h 1m 48s. Rate: 9.6 symbols/min [2025-09-30T17:04:08.192763] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:04:08.204529] [INFO ] [REMOTE ] AEO: Full fetch complete (77443 records). [2025-09-30T17:04:08.204737] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-30T17:04:08.636239] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-30T17:04:08.636321] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-30T17:04:08.637115] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-30T17:04:08.637186] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-30T17:04:08.638838] [DEBUG] [LOCAL ] AEO: Trimmed 77443 records to 53557 (keeping 200 days of data) [2025-09-30T17:04:08.968115] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-09-30T17:04:08.968297] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-30T17:04:08.968414] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 30.2s. Estimated remaining: 3h 58m 19s. Rate: 9.8 symbols/min [2025-09-30T17:04:09.607293] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.683111] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-30T17:04:09.768043] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-30T17:04:09.786968] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.796449] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.784869] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-30T17:04:09.814722] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-30T17:04:09.847638] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-30T17:04:09.852257] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.852480] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-30T17:04:09.939329] [DEBUG] [LOCAL ] AFB: Loaded 11281 existing records from primary storage. [2025-09-30T17:04:09.956769] [INFO ] [MAIN ] AFB: Loaded 11281 existing records. [2025-09-30T17:04:10.367877] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-09-30T17:04:10.431226] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-09-30T17:04:10.442444] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:10.533706] [DEBUG] [LOCAL ] AESI: Loaded 49449 existing records from primary storage. [2025-09-30T17:04:10.575625] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-30T17:04:10.575835] [INFO ] [MAIN ] AESI: Loaded 49449 existing records. [2025-09-30T17:04:10.605167] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:10.583446] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-30T17:04:10.633089] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-30T17:04:10.627795] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-30T17:04:10.649963] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-30T17:04:11.042488] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:11.054321] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-30T17:04:11.038890] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:04:11.054511] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-30T17:04:11.077660] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:11.086899] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-30T17:04:11.078081] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-30T17:04:11.092416] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-30T17:04:11.092511] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:04:11.092828] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-30T17:04:11.092748] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-30T17:04:11.113579] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-30T17:04:11.125199] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:04:11.155423] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-30T17:04:11.175443] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-30T17:04:11.221337] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-30T17:04:11.322863] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-30T17:04:11.350393] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-30T17:04:11.448447] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-30T17:04:11.501113] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.5s. Estimated remaining: 3h 54m 48s. Rate: 9.9 symbols/min [2025-09-30T17:04:12.041112] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.067852] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-30T17:04:12.363520] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:12.359527] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.380159] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-30T17:04:12.451241] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.452034] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-30T17:04:12.488181] [DEBUG] [LOCAL ] AFG: Loaded 32404 existing records from primary storage. [2025-09-30T17:04:12.488618] [INFO ] [MAIN ] AFG: Loaded 32404 existing records. [2025-09-30T17:04:12.684768] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:12.685009] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-30T17:04:12.685058] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-30T17:04:12.685313] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-30T17:04:12.685372] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-30T17:04:13.006290] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T17:04:13.025667] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-30T17:04:13.096426] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:13.096993] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-30T17:04:13.801823] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T17:04:13.805030] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-30T17:04:14.375703] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:04:14.387140] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-30T17:04:14.415414] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T17:04:14.418383] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-30T17:04:14.476750] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T17:04:14.483576] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-30T17:04:14.808486] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-30T17:04:14.819875] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-30T17:04:14.945759] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T17:04:14.949385] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-30T17:04:15.656808] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:04:15.664065] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-30T17:04:15.689873] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:04:15.694179] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-30T17:04:15.865246] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T17:04:16.254394] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-30T17:04:16.339891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:04:16.496957] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:04:17.054379] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-30T17:04:17.134223] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:04:17.836486] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T17:04:17.859856] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-30T17:04:17.864277] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:04:18.654364] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-30T17:04:19.403913] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:04:19.454356] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-30T17:04:20.255586] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-30T17:04:20.261600] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:04:20.788048] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T17:04:21.033436] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:04:21.054318] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-30T17:04:21.806539] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:04:21.854354] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-30T17:04:22.654327] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-30T17:04:22.694216] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T17:04:22.697352] [INFO ] [REMOTE ] AFB: Full fetch complete (16568 records). [2025-09-30T17:04:22.697503] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-30T17:04:23.110448] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-30T17:04:23.110676] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-30T17:04:23.110991] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-30T17:04:23.111049] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-30T17:04:23.111674] [DEBUG] [LOCAL ] AFB: Trimmed 16568 records to 11253 (keeping 200 days of data) [2025-09-30T17:04:23.184635] [DEBUG] [LOCAL ] AFB: Primary data saved (11253 records). [2025-09-30T17:04:23.184808] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-30T17:04:23.184941] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 14.2s. Estimated remaining: 3h 59m 55s. Rate: 9.7 symbols/min [2025-09-30T17:04:23.364218] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:23.370105] [DEBUG] [LOCAL ] AFGB: Loaded 2333 existing records from primary storage. [2025-09-30T17:04:23.370325] [INFO ] [MAIN ] AFGB: Loaded 2333 existing records. [2025-09-30T17:04:23.462313] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-30T17:04:23.576540] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:23.576985] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-30T17:04:23.577088] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-30T17:04:23.577430] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-30T17:04:23.577510] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-30T17:04:23.969993] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:24.254406] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-30T17:04:24.651429] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:04:25.054379] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-30T17:04:25.366311] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:04:25.851847] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:04:25.858793] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-30T17:04:26.654383] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-30T17:04:27.129774] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:04:27.174530] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:04:27.221584] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:04:27.454376] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-30T17:04:28.254424] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-30T17:04:28.726493] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T17:04:29.055391] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-30T17:04:29.058307] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:04:29.854368] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-30T17:04:30.654331] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-30T17:04:31.161342] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:04:31.454409] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-30T17:04:31.528519] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:04:31.654808] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:04:32.254425] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-30T17:04:33.054371] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-30T17:04:33.421605] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:04:33.437174] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T17:04:33.854337] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-30T17:04:33.963443] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:04:34.238314] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T17:04:34.654408] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-30T17:04:35.455281] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-30T17:04:36.231466] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:04:36.254321] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-30T17:04:37.054326] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-30T17:04:37.330077] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:04:37.341015] [INFO ] [REMOTE ] AESI: Full fetch complete (70377 records). [2025-09-30T17:04:37.341153] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-30T17:04:37.847774] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-30T17:04:37.849188] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:04:37.849334] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-30T17:04:37.850198] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-30T17:04:37.857064] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-30T17:04:37.856967] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-30T17:04:37.860859] [DEBUG] [LOCAL ] AESI: Trimmed 70377 records to 49451 (keeping 200 days of data) [2025-09-30T17:04:38.171600] [DEBUG] [LOCAL ] AESI: Primary data saved (49451 records). [2025-09-30T17:04:38.171762] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-30T17:04:38.171856] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 29.2s. Estimated remaining: 4h 7m 45s. Rate: 9.4 symbols/min [2025-09-30T17:04:38.362027] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:38.367197] [DEBUG] [LOCAL ] AFGC: Loaded 2542 existing records from primary storage. [2025-09-30T17:04:38.367367] [INFO ] [MAIN ] AFGC: Loaded 2542 existing records. [2025-09-30T17:04:38.483731] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T17:04:38.574341] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:38.574544] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-30T17:04:38.574593] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-30T17:04:38.574825] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-30T17:04:38.574886] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-30T17:04:38.659774] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-30T17:04:38.987698] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:39.028984] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T17:04:39.061079] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T17:04:39.454398] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-30T17:04:39.912739] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:04:40.254347] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-30T17:04:40.570971] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-30T17:04:41.054383] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-30T17:04:41.854389] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-30T17:04:42.524116] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:04:42.654331] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-30T17:04:43.166482] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T17:04:43.249442] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-30T17:04:43.250581] [INFO ] [REMOTE ] AFGB: Full fetch complete (3644 records). [2025-09-30T17:04:43.250756] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-30T17:04:43.251531] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:04:43.251681] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:04:43.251759] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:04:43.251818] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-30T17:04:43.251920] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-30T17:04:43.252008] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-09-30T17:04:43.252626] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-09-30T17:04:43.252850] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 20.1s. Estimated remaining: 4h 6m 30s. Rate: 9.4 symbols/min [2025-09-30T17:04:43.452444] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:43.454340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-30T17:04:43.459359] [DEBUG] [LOCAL ] AFGD: Loaded 1812 existing records from primary storage. [2025-09-30T17:04:43.459815] [INFO ] [MAIN ] AFGD: Loaded 1812 existing records. [2025-09-30T17:04:43.659759] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:43.659989] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-30T17:04:43.660037] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-30T17:04:43.660199] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-30T17:04:43.660268] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-30T17:04:44.072192] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:44.254379] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-30T17:04:44.858071] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T17:04:45.054601] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-30T17:04:45.060807] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T17:04:45.854344] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-30T17:04:45.911694] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:04:46.654378] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-30T17:04:46.984544] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T17:04:47.454338] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-30T17:04:47.479472] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:04:47.487142] [INFO ] [REMOTE ] AFG: Full fetch complete (45861 records). [2025-09-30T17:04:47.487325] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-30T17:04:47.923147] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-30T17:04:47.923272] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-30T17:04:47.923815] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-30T17:04:47.923882] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-30T17:04:47.925000] [DEBUG] [LOCAL ] AFG: Trimmed 45861 records to 32433 (keeping 200 days of data) [2025-09-30T17:04:48.149252] [DEBUG] [LOCAL ] AFG: Primary data saved (32433 records). [2025-09-30T17:04:48.149402] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-30T17:04:48.151030] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 36.5s. Estimated remaining: 4h 5m 8s. Rate: 9.5 symbols/min [2025-09-30T17:04:48.262351] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-30T17:04:48.354226] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:48.360762] [DEBUG] [LOCAL ] AFGE: Loaded 2470 existing records from primary storage. [2025-09-30T17:04:48.361006] [INFO ] [MAIN ] AFGE: Loaded 2470 existing records. [2025-09-30T17:04:48.561178] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:48.562189] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-30T17:04:48.562252] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-30T17:04:48.562441] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-30T17:04:48.562503] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-30T17:04:48.676477] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T17:04:48.949125] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:49.054330] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-30T17:04:49.346273] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-30T17:04:49.563334] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:04:49.576210] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-30T17:04:49.576389] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-30T17:04:49.864150] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-30T17:04:50.019238] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-30T17:04:50.019340] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-30T17:04:50.020202] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-30T17:04:50.020287] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-30T17:04:50.022049] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-09-30T17:04:50.370227] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-09-30T17:04:50.370384] [INFO ] [MAIN ] AES: Full history saved. [2025-09-30T17:04:50.370535] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AES took 41.4s. Estimated remaining: 4h 1m 35s. Rate: 9.6 symbols/min [2025-09-30T17:04:50.489899] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T17:04:50.568623] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:50.568848] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-09-30T17:04:50.568891] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-09-30T17:04:50.569038] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-30T17:04:50.569105] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-30T17:04:50.569176] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-30T17:04:50.569212] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-30T17:04:50.659515] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-30T17:04:50.967917] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:51.174199] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:04:51.454375] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-30T17:04:52.254348] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-30T17:04:52.537267] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-30T17:04:52.903328] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:04:53.054367] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-30T17:04:53.538422] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:04:53.854370] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-30T17:04:54.180328] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T17:04:54.654414] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-30T17:04:55.080754] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T17:04:55.454423] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-30T17:04:56.008084] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T17:04:56.254346] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-30T17:04:56.816430] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T17:04:57.054361] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-30T17:04:57.648472] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T17:04:57.854415] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-30T17:04:58.654406] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-30T17:04:58.964057] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-30T17:04:59.454376] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-30T17:04:59.683422] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:04:59.983618] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:05:00.254378] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-30T17:05:00.869103] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T17:05:01.054407] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-30T17:05:01.545321] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T17:05:01.854439] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-30T17:05:02.318013] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:05:02.654404] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-30T17:05:03.454418] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-30T17:05:03.970499] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T17:05:04.254362] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-30T17:05:04.319293] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T17:05:04.539493] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T17:05:05.054380] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-30T17:05:05.854329] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-30T17:05:05.989579] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T17:05:05.990779] [INFO ] [REMOTE ] AFGD: Full fetch complete (3178 records). [2025-09-30T17:05:05.990850] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-30T17:05:06.379659] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-30T17:05:06.379751] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-30T17:05:06.379865] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-30T17:05:06.379928] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-30T17:05:06.380303] [DEBUG] [LOCAL ] AFGD: Trimmed 3178 records to 1830 (keeping 200 days of data) [2025-09-30T17:05:06.391982] [DEBUG] [LOCAL ] AFGD: Primary data saved (1830 records). [2025-09-30T17:05:06.392105] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-30T17:05:06.392201] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 23.1s. Estimated remaining: 4h 9m 32s. Rate: 9.3 symbols/min [2025-09-30T17:05:06.576454] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:06.576665] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-09-30T17:05:06.576724] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-09-30T17:05:06.576854] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-30T17:05:06.576896] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-30T17:05:06.576939] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-30T17:05:06.576972] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-30T17:05:06.662326] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-30T17:05:07.030006] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:07.350808] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:05:07.454365] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-30T17:05:07.751909] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:05:07.949855] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T17:05:08.254351] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-30T17:05:08.835675] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T17:05:09.054357] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-30T17:05:09.854386] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-30T17:05:10.311696] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:05:10.654347] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-30T17:05:10.850317] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:05:11.118185] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:05:11.454362] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-30T17:05:12.254368] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-30T17:05:13.054363] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-30T17:05:13.291353] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:05:13.528781] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T17:05:13.775235] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:05:13.854371] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-30T17:05:14.654365] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-30T17:05:15.230890] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:05:15.232133] [INFO ] [REMOTE ] AFGC: Full fetch complete (3724 records). [2025-09-30T17:05:15.232237] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-30T17:05:15.232730] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:15.232825] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:15.232871] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:15.232943] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-30T17:05:15.233027] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-30T17:05:15.233074] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-09-30T17:05:15.233439] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-09-30T17:05:15.233546] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 37.1s. Estimated remaining: 4h 11m 22s. Rate: 9.2 symbols/min [2025-09-30T17:05:15.441030] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:15.454373] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-30T17:05:15.504633] [DEBUG] [LOCAL ] AGCO: Loaded 42413 existing records from primary storage. [2025-09-30T17:05:15.505054] [INFO ] [MAIN ] AGCO: Loaded 42413 existing records. [2025-09-30T17:05:15.717027] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:15.717442] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-30T17:05:15.717509] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-30T17:05:15.718095] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-30T17:05:15.718171] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-30T17:05:15.855512] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:05:16.176290] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:16.254363] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-30T17:05:17.054341] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-30T17:05:17.538450] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T17:05:17.840889] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T17:05:17.841975] [INFO ] [REMOTE ] AFGE: Full fetch complete (3462 records). [2025-09-30T17:05:17.842138] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-30T17:05:17.842706] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:17.842799] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:17.842885] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:17.842981] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-30T17:05:17.843065] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-30T17:05:17.843105] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-09-30T17:05:17.843343] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-09-30T17:05:17.843449] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.7s. Estimated remaining: 4h 8m 11s. Rate: 9.4 symbols/min [2025-09-30T17:05:17.859451] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-30T17:05:18.040998] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:18.072625] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:05:18.099305] [DEBUG] [LOCAL ] AGD: Loaded 17846 existing records from primary storage. [2025-09-30T17:05:18.099555] [INFO ] [MAIN ] AGD: Loaded 17846 existing records. [2025-09-30T17:05:18.288846] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:18.289084] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-30T17:05:18.289154] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-30T17:05:18.289524] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-30T17:05:18.289585] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-30T17:05:18.661061] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:18.657279] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-30T17:05:19.454389] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-30T17:05:20.047720] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T17:05:20.254364] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-30T17:05:20.344399] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:05:20.369140] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:05:21.054419] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-30T17:05:21.650013] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:05:21.854407] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-30T17:05:22.654418] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-30T17:05:23.165205] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:05:23.466220] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-30T17:05:23.473068] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:05:24.192040] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:05:24.254353] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-30T17:05:24.699294] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:05:25.054380] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-30T17:05:25.859206] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-30T17:05:25.861286] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:05:26.119274] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:05:26.654424] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-30T17:05:27.403677] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:05:27.442187] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T17:05:27.454362] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-30T17:05:28.254443] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-30T17:05:29.054417] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-30T17:05:29.436224] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:05:29.854420] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-30T17:05:29.994745] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T17:05:30.091119] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T17:05:30.103153] [INFO ] [REMOTE ] AFL: Full fetch complete (76917 records). [2025-09-30T17:05:30.103319] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-30T17:05:30.571204] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-30T17:05:30.571327] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-30T17:05:30.572237] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-30T17:05:30.572313] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-30T17:05:30.578605] [DEBUG] [LOCAL ] AFL: Trimmed 76917 records to 53145 (keeping 200 days of data) [2025-09-30T17:05:30.674017] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-30T17:05:30.933892] [DEBUG] [LOCAL ] AFL: Primary data saved (53145 records). [2025-09-30T17:05:30.934047] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-30T17:05:30.934148] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 40.6s. Estimated remaining: 4h 13m 15s. Rate: 9.2 symbols/min [2025-09-30T17:05:31.124116] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:31.182444] [DEBUG] [LOCAL ] AGI: Loaded 53415 existing records from primary storage. [2025-09-30T17:05:31.182825] [INFO ] [MAIN ] AGI: Loaded 53415 existing records. [2025-09-30T17:05:31.419412] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:31.419858] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-30T17:05:31.419964] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-30T17:05:31.420591] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-30T17:05:31.420688] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-30T17:05:31.462124] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-30T17:05:31.600365] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:05:31.783769] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:05:31.891316] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:32.254351] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-30T17:05:33.054403] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-30T17:05:33.515568] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:05:33.598456] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-30T17:05:33.827920] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:05:33.854312] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-30T17:05:34.654331] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-30T17:05:34.682841] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T17:05:35.454407] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-30T17:05:36.106066] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:05:36.254400] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-30T17:05:37.054377] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-30T17:05:37.292567] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:05:37.673763] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:05:37.854372] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-30T17:05:38.432512] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:05:38.654367] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-30T17:05:39.043810] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:05:39.050757] [INFO ] [REMOTE ] AGD: Full fetch complete (25513 records). [2025-09-30T17:05:39.050860] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-30T17:05:39.456297] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-30T17:05:39.467581] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-30T17:05:39.468404] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-30T17:05:39.468859] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-30T17:05:39.468926] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-30T17:05:39.469776] [DEBUG] [LOCAL ] AGD: Trimmed 25513 records to 17925 (keeping 200 days of data) [2025-09-30T17:05:39.582486] [DEBUG] [LOCAL ] AGD: Primary data saved (17925 records). [2025-09-30T17:05:39.582632] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-30T17:05:39.582760] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 21.7s. Estimated remaining: 4h 14m 44s. Rate: 9.1 symbols/min [2025-09-30T17:05:39.762849] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:39.822728] [DEBUG] [LOCAL ] AGL: Loaded 52425 existing records from primary storage. [2025-09-30T17:05:39.823074] [INFO ] [MAIN ] AGL: Loaded 52425 existing records. [2025-09-30T17:05:40.020830] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:40.021103] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-30T17:05:40.021154] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-30T17:05:40.021621] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-30T17:05:40.021720] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-30T17:05:40.258772] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-30T17:05:40.418984] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:40.587708] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:05:41.054383] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-30T17:05:41.202994] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:05:41.854336] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-30T17:05:41.890765] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T17:05:42.656147] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-30T17:05:42.662455] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:05:43.454391] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-30T17:05:43.982993] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:05:43.995532] [INFO ] [REMOTE ] AG: Full fetch complete (77214 records). [2025-09-30T17:05:43.995733] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-30T17:05:43.996528] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:43.996626] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:43.996714] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:43.996767] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-30T17:05:43.996887] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-30T17:05:43.996947] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-30T17:05:43.997028] [DEBUG] [LOCAL ] AG: No derivative data file found to delete. [2025-09-30T17:05:43.997113] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 37.6s. Estimated remaining: 4h 13m 1s. Rate: 9.2 symbols/min [2025-09-30T17:05:44.213748] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:44.228732] [DEBUG] [LOCAL ] AGM: Loaded 10075 existing records from primary storage. [2025-09-30T17:05:44.228982] [INFO ] [MAIN ] AGM: Loaded 10075 existing records. [2025-09-30T17:05:44.263344] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-30T17:05:44.469536] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:05:44.475922] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:44.485609] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-30T17:05:44.485899] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-30T17:05:44.486342] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-30T17:05:44.486404] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-30T17:05:44.923929] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:45.054356] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-30T17:05:45.180479] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T17:05:45.574733] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:05:45.813469] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:05:45.854349] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-30T17:05:46.654385] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-30T17:05:47.454339] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-30T17:05:47.556584] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:05:48.254361] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-30T17:05:48.445776] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T17:05:48.792381] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T17:05:48.802685] [INFO ] [REMOTE ] AGCO: Full fetch complete (61915 records). [2025-09-30T17:05:48.802831] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-30T17:05:49.059490] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-30T17:05:49.224807] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-30T17:05:49.224900] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-30T17:05:49.225513] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-30T17:05:49.225560] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-30T17:05:49.226931] [DEBUG] [LOCAL ] AGCO: Trimmed 61915 records to 42360 (keeping 200 days of data) [2025-09-30T17:05:49.522762] [DEBUG] [LOCAL ] AGCO: Primary data saved (42360 records). [2025-09-30T17:05:49.522902] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-30T17:05:49.522988] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 34.3s. Estimated remaining: 4h 12m 9s. Rate: 9.2 symbols/min [2025-09-30T17:05:49.716527] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:49.751361] [DEBUG] [LOCAL ] AGO: Loaded 27898 existing records from primary storage. [2025-09-30T17:05:49.751717] [INFO ] [MAIN ] AGO: Loaded 27898 existing records. [2025-09-30T17:05:49.865734] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-30T17:05:49.966154] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:49.966629] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-30T17:05:49.966740] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-30T17:05:49.967168] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-30T17:05:49.967229] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-30T17:05:50.252097] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T17:05:50.431528] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:50.654339] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-30T17:05:50.718008] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:05:50.841434] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:05:51.454407] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-30T17:05:52.158118] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T17:05:52.215126] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:05:52.254349] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-30T17:05:53.054367] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-30T17:05:53.854371] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-30T17:05:54.055401] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:05:54.654440] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-30T17:05:55.086133] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T17:05:55.087350] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:05:55.162380] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:05:55.454396] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-30T17:05:56.254353] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-30T17:05:57.054356] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-30T17:05:57.151322] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:05:57.553615] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:05:57.757061] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T17:05:57.854384] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-30T17:05:58.654390] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-30T17:05:59.454347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-30T17:05:59.498783] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:06:00.124000] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:06:00.261963] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-30T17:06:00.291698] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:06:01.054382] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-30T17:06:01.387116] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:06:01.854380] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-30T17:06:02.654371] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-30T17:06:02.753912] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:06:03.300886] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:06:03.454360] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-30T17:06:04.016278] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:06:04.254361] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-30T17:06:05.054347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-30T17:06:05.114771] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T17:06:05.126464] [INFO ] [REMOTE ] AGI: Full fetch complete (76790 records). [2025-09-30T17:06:05.126635] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-30T17:06:05.584487] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-30T17:06:05.584682] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-30T17:06:05.585580] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-30T17:06:05.585709] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-30T17:06:05.597710] [DEBUG] [LOCAL ] AGI: Trimmed 76790 records to 53414 (keeping 200 days of data) [2025-09-30T17:06:05.618773] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:06:05.863052] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-30T17:06:05.997481] [DEBUG] [LOCAL ] AGI: Primary data saved (53414 records). [2025-09-30T17:06:05.997636] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-30T17:06:05.998685] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 35.1s. Estimated remaining: 4h 19m 10s. Rate: 8.9 symbols/min [2025-09-30T17:06:06.135021] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:06:06.205416] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:06.246484] [DEBUG] [LOCAL ] AGRO: Loaded 33601 existing records from primary storage. [2025-09-30T17:06:06.246835] [INFO ] [MAIN ] AGRO: Loaded 33601 existing records. [2025-09-30T17:06:06.438440] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:06.438721] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-30T17:06:06.438792] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-30T17:06:06.439113] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-30T17:06:06.439190] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-30T17:06:06.664050] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-30T17:06:06.847885] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:07.454375] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-30T17:06:07.971004] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:06:08.123742] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-30T17:06:08.254353] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-30T17:06:08.576534] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:06:09.054373] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-30T17:06:09.821961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:06:09.833222] [INFO ] [REMOTE ] AGL: Full fetch complete (75119 records). [2025-09-30T17:06:09.833389] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-30T17:06:09.834343] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:06:09.834458] [FATAL] [MAIN ] AGL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:06:09.834504] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:06:09.834569] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-30T17:06:09.834635] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-09-30T17:06:09.834713] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-09-30T17:06:09.835029] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-09-30T17:06:09.835128] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 30.3s. Estimated remaining: 4h 17m 2s. Rate: 9.0 symbols/min [2025-09-30T17:06:09.859514] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-30T17:06:10.043398] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:10.089519] [DEBUG] [LOCAL ] AGX: Loaded 33224 existing records from primary storage. [2025-09-30T17:06:10.089888] [INFO ] [MAIN ] AGX: Loaded 33224 existing records. [2025-09-30T17:06:10.303762] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:10.304089] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-30T17:06:10.304147] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-30T17:06:10.304419] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-30T17:06:10.304478] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-30T17:06:10.656515] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-30T17:06:10.719503] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:10.740845] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:06:10.765789] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:06:11.454392] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-30T17:06:11.523073] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:06:12.254344] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-30T17:06:13.025430] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T17:06:13.054328] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-30T17:06:13.139015] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:06:13.854375] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-30T17:06:14.511768] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:06:14.654444] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-30T17:06:15.211755] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:06:15.454404] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-30T17:06:16.120897] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:06:16.254375] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-30T17:06:16.887954] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:06:17.054413] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-30T17:06:17.155699] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:06:17.158487] [INFO ] [REMOTE ] AGM: Full fetch complete (12708 records). [2025-09-30T17:06:17.158584] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-30T17:06:17.567362] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-30T17:06:17.567502] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-30T17:06:17.567853] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-30T17:06:17.567926] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-30T17:06:17.568766] [DEBUG] [LOCAL ] AGM: Trimmed 12708 records to 10121 (keeping 200 days of data) [2025-09-30T17:06:17.639760] [DEBUG] [LOCAL ] AGM: Primary data saved (10121 records). [2025-09-30T17:06:17.639914] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-30T17:06:17.640000] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGM took 33.6s. Estimated remaining: 4h 17m 43s. Rate: 9.0 symbols/min [2025-09-30T17:06:17.832067] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:17.858362] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-30T17:06:17.877892] [DEBUG] [LOCAL ] AHH: Loaded 41228 existing records from primary storage. [2025-09-30T17:06:17.878229] [INFO ] [MAIN ] AHH: Loaded 41228 existing records. [2025-09-30T17:06:18.079947] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:18.080276] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-30T17:06:18.080338] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-30T17:06:18.080698] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-30T17:06:18.080759] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-30T17:06:18.465352] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:18.484093] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:06:18.654318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-30T17:06:19.454373] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-30T17:06:19.527866] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:06:19.592070] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:06:20.254392] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-30T17:06:21.054330] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-30T17:06:21.156225] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:06:21.771090] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:06:21.854360] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-30T17:06:22.188074] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:06:22.654359] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-30T17:06:23.454374] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-30T17:06:23.553979] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:06:23.589063] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:06:23.595216] [INFO ] [REMOTE ] AGO: Full fetch complete (39276 records). [2025-09-30T17:06:23.595422] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-30T17:06:24.000002] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-30T17:06:24.000089] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-30T17:06:24.000526] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-30T17:06:24.000571] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-30T17:06:24.001630] [DEBUG] [LOCAL ] AGO: Trimmed 39276 records to 27896 (keeping 200 days of data) [2025-09-30T17:06:24.184195] [DEBUG] [LOCAL ] AGO: Primary data saved (27896 records). [2025-09-30T17:06:24.184361] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-30T17:06:24.184464] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 34.7s. Estimated remaining: 4h 17m 31s. Rate: 9.0 symbols/min [2025-09-30T17:06:24.263737] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-30T17:06:24.374560] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:24.375021] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-30T17:06:24.375105] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-30T17:06:24.375292] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-30T17:06:24.375341] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-30T17:06:24.375396] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-30T17:06:24.375437] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-30T17:06:24.634502] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T17:06:24.818906] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:25.054417] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-30T17:06:25.565957] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:06:25.854360] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-30T17:06:26.506415] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:06:26.654330] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-30T17:06:27.331682] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:06:27.454381] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-30T17:06:27.589070] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:06:28.254355] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-30T17:06:28.965978] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:06:29.054426] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-30T17:06:29.794575] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:06:29.854326] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-30T17:06:30.062723] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:06:30.654396] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-30T17:06:31.454413] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-30T17:06:31.658869] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:06:31.689544] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:06:31.689908] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-30T17:06:31.689999] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:06:31.690048] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-30T17:06:31.690081] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:06:31.690119] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-30T17:06:31.690195] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-30T17:06:31.690251] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-30T17:06:31.690309] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-30T17:06:31.690394] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 7.5s. Estimated remaining: 4h 17m 57s. Rate: 9.0 symbols/min [2025-09-30T17:06:31.884135] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:31.933912] [DEBUG] [LOCAL ] AHR: Loaded 49171 existing records from primary storage. [2025-09-30T17:06:31.934290] [INFO ] [MAIN ] AHR: Loaded 49171 existing records. [2025-09-30T17:06:32.145772] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:32.146437] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-30T17:06:32.146630] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-30T17:06:32.147448] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-30T17:06:32.147609] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-30T17:06:32.263709] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-30T17:06:32.282137] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:06:32.315756] [INFO ] [REMOTE ] AGX: Full fetch complete (48782 records). [2025-09-30T17:06:32.326178] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-30T17:06:32.848253] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:33.058684] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-30T17:06:33.076909] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-30T17:06:33.076991] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-30T17:06:33.077550] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-30T17:06:33.077596] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-30T17:06:33.078874] [DEBUG] [LOCAL ] AGX: Trimmed 48782 records to 33204 (keeping 200 days of data) [2025-09-30T17:06:33.302602] [DEBUG] [LOCAL ] AGX: Primary data saved (33204 records). [2025-09-30T17:06:33.302785] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-30T17:06:33.306702] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 23.5s. Estimated remaining: 4h 14m 31s. Rate: 9.1 symbols/min [2025-09-30T17:06:33.504851] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:33.514455] [DEBUG] [LOCAL ] AHT: Loaded 6127 existing records from primary storage. [2025-09-30T17:06:33.514705] [INFO ] [MAIN ] AHT: Loaded 6127 existing records. [2025-09-30T17:06:33.710551] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:33.710945] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-30T17:06:33.711117] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-30T17:06:33.711363] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-30T17:06:33.711453] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-30T17:06:33.859346] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-30T17:06:34.041932] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:06:34.149180] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:34.654363] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-30T17:06:34.725349] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:06:35.454421] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-30T17:06:35.591788] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:06:35.958216] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:06:36.254317] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-30T17:06:36.405507] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T17:06:37.054390] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-30T17:06:37.501831] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:06:37.854455] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-30T17:06:38.074810] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:06:38.654378] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-30T17:06:38.910146] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:06:39.454373] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-30T17:06:40.058004] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:06:40.066234] [INFO ] [REMOTE ] AGRO: Full fetch complete (49831 records). [2025-09-30T17:06:40.066370] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-30T17:06:40.262230] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-30T17:06:40.484676] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-30T17:06:40.484771] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-30T17:06:40.485296] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-30T17:06:40.485340] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-30T17:06:40.486574] [DEBUG] [LOCAL ] AGRO: Trimmed 49831 records to 33600 (keeping 200 days of data) [2025-09-30T17:06:40.700452] [DEBUG] [LOCAL ] AGRO: Primary data saved (33600 records). [2025-09-30T17:06:40.700605] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-30T17:06:40.700744] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGRO took 34.7s. Estimated remaining: 4h 14m 55s. Rate: 9.1 symbols/min [2025-09-30T17:06:40.900921] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:40.961849] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T17:06:40.978672] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T17:06:40.999626] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-09-30T17:06:41.000031] [INFO ] [MAIN ] AI: Loaded 53750 existing records. [2025-09-30T17:06:41.059551] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-30T17:06:41.210614] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:41.210948] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-30T17:06:41.211046] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-30T17:06:41.211464] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-30T17:06:41.211523] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-30T17:06:41.587924] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:41.854402] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-30T17:06:42.654386] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-30T17:06:42.740633] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T17:06:42.751268] [INFO ] [REMOTE ] AHH: Full fetch complete (60245 records). [2025-09-30T17:06:42.751474] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-30T17:06:43.178764] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-30T17:06:43.178863] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-30T17:06:43.179534] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-30T17:06:43.179666] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-30T17:06:43.183410] [DEBUG] [LOCAL ] AHH: Trimmed 60245 records to 41175 (keeping 200 days of data) [2025-09-30T17:06:43.409961] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:06:43.445492] [DEBUG] [LOCAL ] AHH: Primary data saved (41175 records). [2025-09-30T17:06:43.445630] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-30T17:06:43.445799] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 25.8s. Estimated remaining: 4h 12m 22s. Rate: 9.2 symbols/min [2025-09-30T17:06:43.459517] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-30T17:06:43.653796] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:43.717561] [DEBUG] [LOCAL ] AIG: Loaded 53471 existing records from primary storage. [2025-09-30T17:06:43.717966] [INFO ] [MAIN ] AIG: Loaded 53471 existing records. [2025-09-30T17:06:43.914135] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:43.914393] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-30T17:06:43.914459] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-30T17:06:43.914853] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-30T17:06:43.914933] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-30T17:06:44.270267] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-30T17:06:44.309779] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:44.438677] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-30T17:06:44.910694] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:06:45.054348] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-30T17:06:45.105624] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:06:45.764176] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T17:06:45.854380] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-30T17:06:46.654325] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-30T17:06:46.725365] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:06:47.454349] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-30T17:06:48.221915] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:06:48.254337] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-30T17:06:48.514134] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:06:48.950517] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:06:49.054367] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-30T17:06:49.854375] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-30T17:06:50.654363] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-30T17:06:50.808682] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:06:51.454440] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-30T17:06:52.254341] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-30T17:06:52.346347] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-30T17:06:52.556959] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:06:52.900170] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:06:53.054383] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-30T17:06:53.802477] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-30T17:06:53.854379] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-30T17:06:54.654375] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-30T17:06:54.842944] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:06:54.845250] [INFO ] [REMOTE ] AHT: Full fetch complete (9345 records). [2025-09-30T17:06:54.845323] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-30T17:06:55.231395] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-30T17:06:55.231598] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-30T17:06:55.231949] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-30T17:06:55.232051] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-30T17:06:55.232673] [DEBUG] [LOCAL ] AHT: Trimmed 9345 records to 6106 (keeping 200 days of data) [2025-09-30T17:06:55.290313] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-30T17:06:55.310311] [DEBUG] [LOCAL ] AHT: Primary data saved (6106 records). [2025-09-30T17:06:55.310434] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-30T17:06:55.310594] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 22.0s. Estimated remaining: 4h 15m 33s. Rate: 9.0 symbols/min [2025-09-30T17:06:55.459541] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-30T17:06:55.494691] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:55.494874] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-30T17:06:55.494913] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-30T17:06:55.495028] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-30T17:06:55.495071] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-30T17:06:55.495114] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-30T17:06:55.495148] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-30T17:06:55.879369] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:56.254327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-30T17:06:56.306279] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:06:57.054399] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-30T17:06:57.152118] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T17:06:57.854373] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-30T17:06:58.639453] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-30T17:06:58.654312] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-30T17:06:58.907886] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:06:59.454336] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-30T17:06:59.650526] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:06:59.665731] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:06:59.666072] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-30T17:06:59.666176] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:06:59.666241] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-30T17:06:59.666305] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:06:59.666425] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-30T17:06:59.666523] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-30T17:06:59.666602] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-30T17:06:59.666727] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-30T17:06:59.666801] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 4.4s. Estimated remaining: 4h 14m 3s. Rate: 9.1 symbols/min [2025-09-30T17:06:59.860156] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:59.890880] [DEBUG] [LOCAL ] AIN: Loaded 24535 existing records from primary storage. [2025-09-30T17:06:59.891192] [INFO ] [MAIN ] AIN: Loaded 24535 existing records. [2025-09-30T17:07:00.124179] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:00.124421] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-30T17:07:00.124469] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-30T17:07:00.124742] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-30T17:07:00.124801] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-30T17:07:00.259494] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-30T17:07:00.510735] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:01.060191] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-30T17:07:01.066141] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-30T17:07:01.854395] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-30T17:07:01.992592] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:07:02.053484] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:07:02.654357] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-30T17:07:03.454356] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-30T17:07:03.781637] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:07:04.138224] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:07:04.254374] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-30T17:07:05.064614] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-30T17:07:05.071695] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:07:05.122808] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T17:07:05.854363] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-30T17:07:06.654367] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-30T17:07:06.839115] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:07:07.454339] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-30T17:07:07.529143] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T17:07:08.024540] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:07:08.254371] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-30T17:07:08.570498] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:07:09.054387] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-30T17:07:09.829403] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:07:09.854314] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-30T17:07:10.341457] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:07:10.654397] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-30T17:07:11.454324] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-30T17:07:11.526061] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:07:11.576393] [DEBUG] [REMOTE ] AIN: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-30T17:07:11.576713] [WARN ] [REMOTE ] AIN: No data returned for month 2025-05 [2025-09-30T17:07:11.576800] [FATAL] [REMOTE ] AIN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:07:11.576869] [FATAL] [MAIN ] AIN: Failed to fetch primary data. [2025-09-30T17:07:11.576931] [WARN ] [MAIN ] AIN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:07:11.577002] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-30T17:07:11.577067] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-09-30T17:07:11.577105] [INFO ] [LOCAL ] AIN: Starting deletion of derivative data. [2025-09-30T17:07:11.577342] [DEBUG] [LOCAL ] AIN: Deleted derivative data file. [2025-09-30T17:07:11.577428] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AIN took 11.9s. Estimated remaining: 4h 17m 7s. Rate: 9.0 symbols/min [2025-09-30T17:07:11.766171] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:11.782453] [DEBUG] [LOCAL ] AIO: Loaded 13223 existing records from primary storage. [2025-09-30T17:07:11.782711] [INFO ] [MAIN ] AIO: Loaded 13223 existing records. [2025-09-30T17:07:11.978082] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:11.978473] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-30T17:07:11.978668] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-30T17:07:11.978898] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-30T17:07:11.978959] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-30T17:07:12.257016] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-30T17:07:12.393422] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:12.426756] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T17:07:13.054376] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-30T17:07:13.854403] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-30T17:07:14.086459] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:07:14.654333] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-30T17:07:14.839589] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-30T17:07:15.449826] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:07:15.454824] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-30T17:07:16.051511] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T17:07:16.063565] [INFO ] [REMOTE ] AIG: Full fetch complete (77376 records). [2025-09-30T17:07:16.063820] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-30T17:07:16.259487] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-30T17:07:16.495909] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-30T17:07:16.495999] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-30T17:07:16.496833] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-30T17:07:16.496907] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-30T17:07:16.498628] [DEBUG] [LOCAL ] AIG: Trimmed 77376 records to 53471 (keeping 200 days of data) [2025-09-30T17:07:16.848753] [DEBUG] [LOCAL ] AIG: Primary data saved (53471 records). [2025-09-30T17:07:16.848895] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-30T17:07:16.848991] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 33.4s. Estimated remaining: 4h 16m 10s. Rate: 9.0 symbols/min [2025-09-30T17:07:17.026374] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:17.054989] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-30T17:07:17.056459] [DEBUG] [LOCAL ] AIR: Loaded 27816 existing records from primary storage. [2025-09-30T17:07:17.056717] [INFO ] [MAIN ] AIR: Loaded 27816 existing records. [2025-09-30T17:07:17.254846] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:17.255057] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-30T17:07:17.255118] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-30T17:07:17.255417] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-30T17:07:17.255477] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-30T17:07:17.670499] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:17.854383] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-30T17:07:17.914258] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-30T17:07:18.014495] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:07:18.014886] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:07:18.030389] [INFO ] [REMOTE ] AHR: Full fetch complete (70856 records). [2025-09-30T17:07:18.030540] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-30T17:07:18.453620] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-30T17:07:18.453747] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-30T17:07:18.454525] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-30T17:07:18.454588] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-30T17:07:18.456209] [DEBUG] [LOCAL ] AHR: Trimmed 70856 records to 49168 (keeping 200 days of data) [2025-09-30T17:07:18.683313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-30T17:07:18.778723] [DEBUG] [LOCAL ] AHR: Primary data saved (49168 records). [2025-09-30T17:07:18.778872] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-30T17:07:18.779021] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AHR took 47.1s. Estimated remaining: 4h 13m 18s. Rate: 9.1 symbols/min [2025-09-30T17:07:18.966231] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:18.966449] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-09-30T17:07:18.966509] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-09-30T17:07:18.966707] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-30T17:07:18.966769] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-30T17:07:18.966827] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-30T17:07:18.966863] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-30T17:07:19.210801] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T17:07:19.463823] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-30T17:07:19.476837] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:19.490129] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T17:07:20.254411] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-30T17:07:20.731897] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T17:07:21.054412] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-30T17:07:21.854373] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-30T17:07:21.979443] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:07:22.054788] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:07:22.654373] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-30T17:07:23.294162] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T17:07:23.454381] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-30T17:07:24.254327] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-30T17:07:24.312622] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:07:24.690992] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-09-30T17:07:24.703028] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-30T17:07:24.703185] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-30T17:07:25.067332] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-30T17:07:25.133932] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-30T17:07:25.134064] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-30T17:07:25.134912] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-30T17:07:25.134984] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-30T17:07:25.137311] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53750 (keeping 200 days of data) [2025-09-30T17:07:25.478461] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:07:25.508387] [DEBUG] [LOCAL ] AI: Primary data saved (53750 records). [2025-09-30T17:07:25.508570] [INFO ] [MAIN ] AI: Full history saved. [2025-09-30T17:07:25.509842] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AI took 44.8s. Estimated remaining: 4h 13m 17s. Rate: 9.1 symbols/min [2025-09-30T17:07:25.757080] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:25.803426] [DEBUG] [LOCAL ] AIV: Loaded 40298 existing records from primary storage. [2025-09-30T17:07:25.803767] [INFO ] [MAIN ] AIV: Loaded 40298 existing records. [2025-09-30T17:07:25.859716] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-30T17:07:25.995921] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:25.996860] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-30T17:07:25.997132] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-30T17:07:25.997635] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-30T17:07:25.997734] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-30T17:07:26.403091] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:26.500338] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:07:26.654336] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-30T17:07:26.679940] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:07:27.454371] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-30T17:07:27.889003] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T17:07:28.254376] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-30T17:07:28.601847] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:07:29.054375] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-30T17:07:29.473207] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:07:29.854396] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-30T17:07:30.215660] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:07:30.656952] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-30T17:07:30.677455] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:07:31.454447] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-30T17:07:32.213564] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:07:32.254319] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-30T17:07:32.528684] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T17:07:33.054437] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-30T17:07:33.595696] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:07:33.854413] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-30T17:07:34.202473] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T17:07:34.654368] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-30T17:07:35.355257] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:07:35.454361] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-30T17:07:35.470224] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:07:35.473949] [INFO ] [REMOTE ] AIO: Full fetch complete (20003 records). [2025-09-30T17:07:35.474059] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-30T17:07:35.474502] [FATAL] [VALIDATOR ] AIO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:07:35.474589] [FATAL] [MAIN ] AIO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:07:35.474684] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:07:35.474765] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-30T17:07:35.474834] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-09-30T17:07:35.474878] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-09-30T17:07:35.475155] [DEBUG] [LOCAL ] AIO: Deleted derivative data file. [2025-09-30T17:07:35.475249] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 23.9s. Estimated remaining: 4h 15m 4s. Rate: 9.0 symbols/min [2025-09-30T17:07:35.694303] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:35.740903] [DEBUG] [LOCAL ] AIZ: Loaded 29952 existing records from primary storage. [2025-09-30T17:07:35.741225] [INFO ] [MAIN ] AIZ: Loaded 29952 existing records. [2025-09-30T17:07:35.938846] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:35.939077] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-30T17:07:35.939126] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-30T17:07:35.939434] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-30T17:07:35.939493] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-30T17:07:36.257826] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-30T17:07:36.360700] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:36.386205] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:07:37.054401] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-30T17:07:37.825158] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:07:37.854310] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-30T17:07:38.133109] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:07:38.654370] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-30T17:07:38.997127] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T17:07:39.454407] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-30T17:07:39.860230] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:07:40.254361] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-30T17:07:40.793103] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T17:07:41.054398] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-30T17:07:41.632152] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T17:07:41.854400] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-30T17:07:42.474945] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:07:42.654371] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-30T17:07:43.157636] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:07:43.454373] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-30T17:07:43.675142] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:07:44.254369] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-30T17:07:44.545081] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:07:45.054368] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-30T17:07:45.698525] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:07:45.854419] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-30T17:07:46.116747] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T17:07:46.654376] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-30T17:07:47.229788] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T17:07:47.237470] [INFO ] [REMOTE ] AIR: Full fetch complete (38675 records). [2025-09-30T17:07:47.237686] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-30T17:07:47.459492] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-30T17:07:47.656552] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-30T17:07:47.656664] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-30T17:07:47.657111] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-30T17:07:47.657156] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-30T17:07:47.658192] [DEBUG] [LOCAL ] AIR: Trimmed 38675 records to 27931 (keeping 200 days of data) [2025-09-30T17:07:47.825912] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:07:47.870164] [DEBUG] [LOCAL ] AIR: Primary data saved (27931 records). [2025-09-30T17:07:47.870447] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-30T17:07:47.870566] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 31.0s. Estimated remaining: 4h 18m 9s. Rate: 8.9 symbols/min [2025-09-30T17:07:48.053147] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:48.059975] [DEBUG] [LOCAL ] AIZN: Loaded 3911 existing records from primary storage. [2025-09-30T17:07:48.060183] [INFO ] [MAIN ] AIZN: Loaded 3911 existing records. [2025-09-30T17:07:48.256057] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:48.256675] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-30T17:07:48.256171] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-30T17:07:48.256797] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-30T17:07:48.258102] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-30T17:07:48.258163] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-30T17:07:48.665247] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:48.686703] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T17:07:49.054410] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-30T17:07:49.414916] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:07:49.854380] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-30T17:07:50.078014] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:07:50.349748] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T17:07:50.654414] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-30T17:07:51.454411] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-30T17:07:51.817487] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T17:07:51.822031] [INFO ] [REMOTE ] AIT: Full fetch complete (39457 records). [2025-09-30T17:07:51.822136] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-30T17:07:52.148409] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T17:07:52.262909] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-30T17:07:52.263029] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-30T17:07:52.260380] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-30T17:07:52.263491] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-30T17:07:52.263914] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-30T17:07:52.265738] [DEBUG] [LOCAL ] AIT: Trimmed 39457 records to 27638 (keeping 200 days of data) [2025-09-30T17:07:52.456478] [DEBUG] [LOCAL ] AIT: Primary data saved (27638 records). [2025-09-30T17:07:52.456633] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-30T17:07:52.456760] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 33.7s. Estimated remaining: 4h 16m 52s. Rate: 9.0 symbols/min [2025-09-30T17:07:52.662417] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:52.708947] [DEBUG] [LOCAL ] AJG: Loaded 46911 existing records from primary storage. [2025-09-30T17:07:52.709280] [INFO ] [MAIN ] AJG: Loaded 46911 existing records. [2025-09-30T17:07:52.846505] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:07:52.921044] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:52.921298] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-30T17:07:52.921388] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-30T17:07:52.921762] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-30T17:07:52.921823] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-30T17:07:53.068738] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-30T17:07:53.305940] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:53.854403] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-30T17:07:54.654399] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-30T17:07:54.746113] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:07:55.397232] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:07:55.454349] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-30T17:07:55.816512] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:07:56.108042] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:07:56.254357] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-30T17:07:57.054399] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-30T17:07:57.618889] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:07:57.854335] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-30T17:07:57.943673] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:07:58.654387] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-30T17:07:59.459453] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-30T17:07:59.471508] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:07:59.482109] [INFO ] [REMOTE ] AIV: Full fetch complete (59596 records). [2025-09-30T17:07:59.482272] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-30T17:07:59.886570] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-30T17:07:59.886746] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-30T17:07:59.887477] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-30T17:07:59.887563] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-30T17:07:59.906799] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:07:59.906917] [DEBUG] [LOCAL ] AIV: Trimmed 59596 records to 40347 (keeping 200 days of data) [2025-09-30T17:08:00.147318] [DEBUG] [LOCAL ] AIV: Primary data saved (40347 records). [2025-09-30T17:08:00.147490] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-30T17:08:00.148323] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 34.6s. Estimated remaining: 4h 17m 18s. Rate: 8.9 symbols/min [2025-09-30T17:08:00.256955] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-30T17:08:00.331349] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:00.331559] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-30T17:08:00.331618] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-30T17:08:00.331791] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-30T17:08:00.331850] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-30T17:08:00.331900] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-30T17:08:00.331940] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-30T17:08:00.713881] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:00.869735] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:08:00.980905] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:08:01.054352] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-30T17:08:01.854357] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-30T17:08:02.367552] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:08:02.484699] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:08:02.654361] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-30T17:08:03.454354] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-30T17:08:04.254324] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-30T17:08:04.449436] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:08:04.686805] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T17:08:05.054345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-30T17:08:05.076475] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:08:05.640755] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:08:05.854374] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-30T17:08:06.170441] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T17:08:06.654368] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-30T17:08:07.454387] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-30T17:08:07.981065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T17:08:07.987504] [INFO ] [REMOTE ] AIZ: Full fetch complete (42891 records). [2025-09-30T17:08:07.987620] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-30T17:08:08.103134] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T17:08:08.260411] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-30T17:08:08.416543] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-30T17:08:08.416622] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-30T17:08:08.417168] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-30T17:08:08.417230] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-30T17:08:08.418454] [DEBUG] [LOCAL ] AIZ: Trimmed 42891 records to 29883 (keeping 200 days of data) [2025-09-30T17:08:08.632517] [DEBUG] [LOCAL ] AIZ: Primary data saved (29883 records). [2025-09-30T17:08:08.632715] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-30T17:08:08.633936] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 33.2s. Estimated remaining: 4h 18m 7s. Rate: 8.9 symbols/min [2025-09-30T17:08:08.809693] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T17:08:08.832454] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:08.898845] [DEBUG] [LOCAL ] AKR: Loaded 45716 existing records from primary storage. [2025-09-30T17:08:08.899245] [INFO ] [MAIN ] AKR: Loaded 45716 existing records. [2025-09-30T17:08:09.059479] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-30T17:08:09.104920] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:09.105130] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-30T17:08:09.105182] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-30T17:08:09.105512] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-30T17:08:09.105573] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-30T17:08:09.496206] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:09.804404] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:08:09.805987] [INFO ] [REMOTE ] AIZN: Full fetch complete (5891 records). [2025-09-30T17:08:09.806062] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-30T17:08:09.859497] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-30T17:08:10.214223] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-30T17:08:10.214307] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-30T17:08:10.214494] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-30T17:08:10.214535] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-30T17:08:10.215107] [DEBUG] [LOCAL ] AIZN: Trimmed 5891 records to 4008 (keeping 200 days of data) [2025-09-30T17:08:10.242459] [DEBUG] [LOCAL ] AIZN: Primary data saved (4008 records). [2025-09-30T17:08:10.242608] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-30T17:08:10.242730] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 22.4s. Estimated remaining: 4h 15m 19s. Rate: 9.0 symbols/min [2025-09-30T17:08:10.450210] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:10.494569] [DEBUG] [LOCAL ] AL: Loaded 44176 existing records from primary storage. [2025-09-30T17:08:10.494958] [INFO ] [MAIN ] AL: Loaded 44176 existing records. [2025-09-30T17:08:10.660454] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-30T17:08:10.694794] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:10.695173] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-30T17:08:10.695222] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-30T17:08:10.695473] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-30T17:08:10.695531] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-30T17:08:11.091018] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:11.454412] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-30T17:08:11.603289] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:08:11.804487] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:08:12.254379] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-30T17:08:12.525761] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:08:12.675708] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T17:08:13.054426] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-30T17:08:13.854373] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-30T17:08:14.490588] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T17:08:14.654399] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-30T17:08:15.156665] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:08:15.156930] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:08:15.454367] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-30T17:08:15.903938] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:08:16.254375] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-30T17:08:16.568260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-30T17:08:17.054408] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-30T17:08:17.854366] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-30T17:08:18.407000] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:08:18.654422] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-30T17:08:19.454403] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-30T17:08:19.584400] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:08:19.788074] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T17:08:20.147906] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:08:20.254356] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-30T17:08:20.667627] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T17:08:20.668510] [INFO ] [REMOTE ] AKA: Full fetch complete (2426 records). [2025-09-30T17:08:20.668586] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-30T17:08:20.909142] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T17:08:20.909397] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:08:20.909474] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:08:20.909547] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-30T17:08:20.909629] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-30T17:08:20.909741] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-30T17:08:20.909819] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-30T17:08:20.909913] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 20.8s. Estimated remaining: 4h 17m 17s. Rate: 8.9 symbols/min [2025-09-30T17:08:21.059521] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-30T17:08:21.187258] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:21.249176] [DEBUG] [LOCAL ] ALB: Loaded 53226 existing records from primary storage. [2025-09-30T17:08:21.249575] [INFO ] [MAIN ] ALB: Loaded 53226 existing records. [2025-09-30T17:08:21.439089] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:21.439315] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-30T17:08:21.439400] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-30T17:08:21.439749] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-30T17:08:21.439809] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-30T17:08:21.859500] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-30T17:08:21.935950] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:22.337253] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T17:08:22.654419] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-30T17:08:23.270920] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:08:23.454400] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-30T17:08:24.095706] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:08:24.254380] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-30T17:08:25.033224] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:08:25.054353] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-30T17:08:25.854382] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-30T17:08:26.183637] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:08:26.654345] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-30T17:08:26.687402] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:08:27.381034] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:08:27.454402] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-30T17:08:28.254400] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-30T17:08:28.570278] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:08:29.054369] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-30T17:08:29.170533] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:08:29.694762] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:08:29.705591] [INFO ] [REMOTE ] AJG: Full fetch complete (69667 records). [2025-09-30T17:08:29.705789] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-30T17:08:29.864394] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-30T17:08:30.141361] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-30T17:08:30.141462] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-30T17:08:30.142182] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-30T17:08:30.142258] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-30T17:08:30.143821] [DEBUG] [LOCAL ] AJG: Trimmed 69667 records to 46898 (keeping 200 days of data) [2025-09-30T17:08:30.461874] [DEBUG] [LOCAL ] AJG: Primary data saved (46898 records). [2025-09-30T17:08:30.462057] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-30T17:08:30.462160] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 38.0s. Estimated remaining: 4h 18m 37s. Rate: 8.9 symbols/min [2025-09-30T17:08:30.681765] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-30T17:08:30.684581] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:30.734436] [DEBUG] [LOCAL ] ALC: Loaded 50776 existing records from primary storage. [2025-09-30T17:08:30.734959] [INFO ] [MAIN ] ALC: Loaded 50776 existing records. [2025-09-30T17:08:30.883423] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:08:30.992530] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:30.992815] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-30T17:08:30.992870] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-30T17:08:30.993268] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-30T17:08:30.993330] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-30T17:08:31.424541] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:31.450639] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:08:31.459193] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-30T17:08:32.254411] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-30T17:08:32.333570] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:08:32.830811] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:08:33.054400] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-30T17:08:33.854367] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-30T17:08:33.936827] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:08:34.534942] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T17:08:34.654375] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-30T17:08:35.454327] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-30T17:08:35.492150] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:08:36.177109] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:08:36.254425] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-30T17:08:37.007940] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:08:37.054370] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-30T17:08:37.854338] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-30T17:08:38.005563] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:08:38.020414] [INFO ] [REMOTE ] AL: Full fetch complete (62519 records). [2025-09-30T17:08:38.020599] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-30T17:08:38.462001] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-30T17:08:38.462161] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-30T17:08:38.462932] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-30T17:08:38.463001] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-30T17:08:38.464398] [DEBUG] [LOCAL ] AL: Trimmed 62519 records to 44215 (keeping 200 days of data) [2025-09-30T17:08:38.662170] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-30T17:08:38.730011] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:08:38.800581] [DEBUG] [LOCAL ] AL: Primary data saved (44215 records). [2025-09-30T17:08:38.800759] [INFO ] [MAIN ] AL: Full history saved. [2025-09-30T17:08:38.800858] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 28.6s. Estimated remaining: 4h 19m 18s. Rate: 8.9 symbols/min [2025-09-30T17:08:38.987172] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:39.016607] [DEBUG] [LOCAL ] ALE: Loaded 30436 existing records from primary storage. [2025-09-30T17:08:39.017065] [INFO ] [MAIN ] ALE: Loaded 30436 existing records. [2025-09-30T17:08:39.208182] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:39.208438] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-30T17:08:39.208488] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-30T17:08:39.208755] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-30T17:08:39.208813] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-30T17:08:39.464131] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-30T17:08:39.592948] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:39.841170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:08:40.217379] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:08:40.254363] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-30T17:08:41.054342] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-30T17:08:41.228387] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T17:08:41.854361] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-30T17:08:41.910229] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T17:08:42.654393] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-30T17:08:43.077213] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T17:08:43.114805] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:08:43.454363] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-30T17:08:44.254359] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-30T17:08:44.412204] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:08:45.008245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T17:08:45.054313] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-30T17:08:45.854342] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-30T17:08:45.963288] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:08:46.654379] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-30T17:08:46.872747] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T17:08:47.262419] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T17:08:47.454367] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-30T17:08:48.052379] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:08:48.062939] [INFO ] [REMOTE ] AKR: Full fetch complete (65480 records). [2025-09-30T17:08:48.063143] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-30T17:08:48.259622] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-30T17:08:48.487322] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-30T17:08:48.487495] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-30T17:08:48.488366] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-30T17:08:48.488431] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-30T17:08:48.489815] [DEBUG] [LOCAL ] AKR: Trimmed 65480 records to 45732 (keeping 200 days of data) [2025-09-30T17:08:48.791302] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:08:48.804476] [DEBUG] [LOCAL ] AKR: Primary data saved (45732 records). [2025-09-30T17:08:48.804570] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-30T17:08:48.805600] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 40.2s. Estimated remaining: 4h 20m 47s. Rate: 8.8 symbols/min [2025-09-30T17:08:49.054381] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-30T17:08:49.854353] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-30T17:08:50.039203] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:08:50.654438] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-30T17:08:51.082226] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T17:08:51.267491] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:08:51.454375] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-30T17:08:52.254386] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-30T17:08:52.317080] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T17:08:52.655844] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:08:53.054363] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-30T17:08:53.854374] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-30T17:08:54.473232] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T17:08:54.535387] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:08:54.654365] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-30T17:08:55.454377] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-30T17:08:55.692119] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T17:08:56.254369] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-30T17:08:56.619263] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:08:56.770170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:08:56.782039] [INFO ] [REMOTE ] ALB: Full fetch complete (76812 records). [2025-09-30T17:08:56.782205] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-30T17:08:57.060784] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-30T17:08:57.217743] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-30T17:08:57.217840] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-30T17:08:57.218699] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-30T17:08:57.218771] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-30T17:08:57.220758] [DEBUG] [LOCAL ] ALB: Trimmed 76812 records to 53236 (keeping 200 days of data) [2025-09-30T17:08:57.555877] [DEBUG] [LOCAL ] ALB: Primary data saved (53236 records). [2025-09-30T17:08:57.556036] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-30T17:08:57.556808] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 36.6s. Estimated remaining: 4h 21m 37s. Rate: 8.8 symbols/min [2025-09-30T17:08:57.920236] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:08:57.931728] [INFO ] [REMOTE ] ALC: Full fetch complete (72862 records). [2025-09-30T17:08:57.931900] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-30T17:08:58.294198] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T17:08:58.339571] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-30T17:08:58.403478] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-30T17:08:58.403567] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-30T17:08:58.404328] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-30T17:08:58.404401] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-30T17:08:58.406239] [DEBUG] [LOCAL ] ALC: Trimmed 72862 records to 50789 (keeping 200 days of data) [2025-09-30T17:08:58.726528] [DEBUG] [LOCAL ] ALC: Primary data saved (50789 records). [2025-09-30T17:08:58.726705] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-30T17:08:58.726805] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 28.3s. Estimated remaining: 4h 18m 46s. Rate: 8.9 symbols/min [2025-09-30T17:08:59.735925] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T17:08:59.744301] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-30T17:09:00.880891] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T17:09:00.889100] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-30T17:09:02.110257] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:09:02.117996] [INFO ] [REMOTE ] ALE: Full fetch complete (42425 records). [2025-09-30T17:09:02.118113] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-30T17:09:02.118784] [FATAL] [VALIDATOR ] ALE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:09:02.118869] [FATAL] [MAIN ] ALE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:09:02.118913] [WARN ] [MAIN ] ALE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:09:02.118986] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-30T17:09:02.119054] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-09-30T17:09:02.119090] [INFO ] [LOCAL ] ALE: Starting deletion of derivative data. [2025-09-30T17:09:02.119412] [DEBUG] [LOCAL ] ALE: Deleted derivative data file. [2025-09-30T17:09:02.119542] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 23.3s. Estimated remaining: 4h 17m 2s. Rate: 8.9 symbols/min [2025-09-30T17:09:02.843671] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.895489] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.934489] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.940333] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-09-30T17:09:02.939200] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.940493] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-09-30T17:09:02.942147] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-30T17:09:02.942238] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-30T17:09:02.942313] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-30T17:09:02.942352] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-30T17:09:03.084600] [DEBUG] [LOCAL ] ALG: Loaded 10273 existing records from primary storage. [2025-09-30T17:09:03.085966] [INFO ] [MAIN ] ALG: Loaded 10273 existing records. [2025-09-30T17:09:03.219768] [DEBUG] [LOCAL ] ALEX: Loaded 31165 existing records from primary storage. [2025-09-30T17:09:03.282106] [INFO ] [MAIN ] ALEX: Loaded 31165 existing records. [2025-09-30T17:09:03.651764] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:03.704697] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-30T17:09:03.716365] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-30T17:09:03.695783] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-09-30T17:09:03.747611] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-30T17:09:03.777142] [INFO ] [MAIN ] ALIT: Loaded 52760 existing records. [2025-09-30T17:09:03.777329] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-30T17:09:03.967398] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:03.978995] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:04.016189] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-30T17:09:04.045761] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-30T17:09:04.027046] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-30T17:09:04.067610] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-30T17:09:04.125610] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-30T17:09:04.368900] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:04.486736] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-30T17:09:04.545078] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-30T17:09:04.573285] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-30T17:09:04.573410] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-30T17:09:04.900971] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:04.934879] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-30T17:09:05.226534] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:05.240189] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-30T17:09:05.344965] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:05.345354] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-30T17:09:05.883368] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:09:05.895915] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-30T17:09:05.905530] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:09:05.909031] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-30T17:09:06.721722] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:09:06.732099] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-30T17:09:06.757084] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:09:06.760603] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-30T17:09:06.791299] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:09:06.803334] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-30T17:09:07.386143] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:09:07.454386] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-30T17:09:07.632789] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:09:07.944308] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:09:08.254405] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-30T17:09:08.485378] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:09:09.054380] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-30T17:09:09.276036] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:09:09.340422] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:09:09.854386] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-30T17:09:10.491355] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:09:10.654372] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-30T17:09:11.454370] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-30T17:09:11.529175] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:09:12.254458] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-30T17:09:12.316462] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:09:12.890634] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T17:09:13.054369] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-30T17:09:13.165242] [DEBUG] [REMOTE ] ALIT: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T17:09:13.165603] [WARN ] [REMOTE ] ALIT: No data returned for month 2025-04 [2025-09-30T17:09:13.165706] [FATAL] [REMOTE ] ALIT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:09:13.165793] [FATAL] [MAIN ] ALIT: Failed to fetch primary data. [2025-09-30T17:09:13.165833] [WARN ] [MAIN ] ALIT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:09:13.165902] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-30T17:09:13.165969] [DEBUG] [LOCAL ] ALIT: No primary data file found to delete. [2025-09-30T17:09:13.166006] [INFO ] [LOCAL ] ALIT: Starting deletion of derivative data. [2025-09-30T17:09:13.166465] [DEBUG] [LOCAL ] ALIT: Deleted derivative data file. [2025-09-30T17:09:13.166568] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALIT took 11.0s. Estimated remaining: 4h 18m 57s. Rate: 8.8 symbols/min [2025-09-30T17:09:13.299894] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:09:13.377788] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:13.378026] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-09-30T17:09:13.378073] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-09-30T17:09:13.378189] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-30T17:09:13.378234] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-30T17:09:13.378283] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-09-30T17:09:13.378356] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-30T17:09:13.764778] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:13.854377] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-30T17:09:14.654404] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-30T17:09:15.454383] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-30T17:09:15.535251] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:09:16.253048] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:09:16.262883] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-30T17:09:16.594294] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:09:17.054436] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-30T17:09:17.854416] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-30T17:09:18.202802] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T17:09:18.254589] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:09:18.654356] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-30T17:09:19.454365] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-30T17:09:19.569915] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:09:19.831686] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T17:09:20.224730] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:09:20.254324] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-30T17:09:21.054376] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-30T17:09:21.694183] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:09:21.854379] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-30T17:09:22.457080] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T17:09:22.654426] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-30T17:09:22.768175] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:09:23.454385] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-30T17:09:24.239241] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:09:24.254352] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-30T17:09:24.278159] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:09:25.054601] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-30T17:09:25.850113] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T17:09:25.860912] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-30T17:09:26.164740] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T17:09:26.654419] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-30T17:09:26.741541] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:09:27.454400] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-30T17:09:27.829967] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:09:27.837232] [INFO ] [REMOTE ] ALEX: Full fetch complete (44587 records). [2025-09-30T17:09:27.837352] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-30T17:09:28.260127] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-30T17:09:28.259572] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-30T17:09:28.260260] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-30T17:09:28.263191] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-30T17:09:28.263284] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-30T17:09:28.264713] [DEBUG] [LOCAL ] ALEX: Trimmed 44587 records to 31102 (keeping 200 days of data) [2025-09-30T17:09:28.484405] [DEBUG] [LOCAL ] ALEX: Primary data saved (31102 records). [2025-09-30T17:09:28.484573] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-30T17:09:28.484779] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 26.4s. Estimated remaining: 4h 22m 49s. Rate: 8.7 symbols/min [2025-09-30T17:09:28.678248] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:28.737499] [DEBUG] [LOCAL ] ALLE: Loaded 44821 existing records from primary storage. [2025-09-30T17:09:28.737915] [INFO ] [MAIN ] ALLE: Loaded 44821 existing records. [2025-09-30T17:09:28.929916] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:28.930234] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-30T17:09:28.930297] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-30T17:09:28.930613] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-30T17:09:28.930720] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-30T17:09:29.054963] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-30T17:09:29.346923] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:29.375847] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:09:29.817258] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:09:29.854358] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-30T17:09:30.052487] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T17:09:30.056235] [INFO ] [REMOTE ] ALG: Full fetch complete (15867 records). [2025-09-30T17:09:30.056355] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-30T17:09:30.460166] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-30T17:09:30.460307] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-30T17:09:30.460558] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-30T17:09:30.460599] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-30T17:09:30.462004] [DEBUG] [LOCAL ] ALG: Trimmed 15867 records to 10240 (keeping 200 days of data) [2025-09-30T17:09:30.536558] [DEBUG] [LOCAL ] ALG: Primary data saved (10240 records). [2025-09-30T17:09:30.536728] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-30T17:09:30.536840] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALG took 28.4s. Estimated remaining: 4h 20m 28s. Rate: 8.8 symbols/min [2025-09-30T17:09:30.659572] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-30T17:09:30.723521] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:30.797670] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-09-30T17:09:30.798047] [INFO ] [MAIN ] ALLY: Loaded 53217 existing records. [2025-09-30T17:09:30.995566] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:30.995872] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-30T17:09:30.995930] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-30T17:09:30.996533] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-30T17:09:30.996631] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-30T17:09:31.394777] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:31.454410] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-30T17:09:31.620500] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:09:31.632758] [INFO ] [REMOTE ] ALK: Full fetch complete (76835 records). [2025-09-30T17:09:31.632967] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-30T17:09:32.073206] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-30T17:09:32.073381] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-30T17:09:32.074228] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-30T17:09:32.074325] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-30T17:09:32.077955] [DEBUG] [LOCAL ] ALK: Trimmed 76835 records to 53053 (keeping 200 days of data) [2025-09-30T17:09:32.277489] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-30T17:09:32.438580] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:09:32.473688] [DEBUG] [LOCAL ] ALK: Primary data saved (53053 records). [2025-09-30T17:09:32.473865] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-30T17:09:32.473976] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALK took 30.4s. Estimated remaining: 4h 18m 8s. Rate: 8.9 symbols/min [2025-09-30T17:09:32.654241] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:32.697676] [DEBUG] [LOCAL ] ALSN: Loaded 43263 existing records from primary storage. [2025-09-30T17:09:32.698071] [INFO ] [MAIN ] ALSN: Loaded 43263 existing records. [2025-09-30T17:09:32.895703] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:32.895912] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-30T17:09:32.895960] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-30T17:09:32.896302] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-30T17:09:32.896367] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-30T17:09:33.060551] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-30T17:09:33.301616] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:33.337380] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T17:09:33.854374] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-30T17:09:34.180276] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:09:34.654358] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-30T17:09:34.704953] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:09:35.454340] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-30T17:09:35.692441] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:09:36.254385] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-30T17:09:36.396600] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:09:37.058215] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-30T17:09:37.063216] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T17:09:37.621598] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:09:37.854368] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-30T17:09:38.654352] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-30T17:09:38.758802] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:09:39.454340] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-30T17:09:39.490125] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:09:40.024434] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:09:40.254374] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-30T17:09:41.054408] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-30T17:09:41.200378] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:09:41.655528] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:09:41.854363] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-30T17:09:42.593423] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:09:42.654353] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-30T17:09:43.433387] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:09:43.454442] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-30T17:09:44.209266] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:09:44.254345] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-30T17:09:44.779156] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:09:45.054375] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-30T17:09:45.854386] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-30T17:09:46.180062] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:09:46.654365] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-30T17:09:46.745390] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:09:47.347197] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:09:47.454364] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-30T17:09:48.254334] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-30T17:09:48.440391] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:09:48.980691] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:09:49.054377] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-30T17:09:49.763907] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:09:49.854350] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-30T17:09:50.659507] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-30T17:09:50.677300] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:09:51.454341] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-30T17:09:51.701749] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:09:52.228985] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:09:52.254311] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-30T17:09:52.842370] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:09:52.852276] [INFO ] [REMOTE ] ALLE: Full fetch complete (64737 records). [2025-09-30T17:09:52.852470] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-30T17:09:53.055699] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-30T17:09:53.315794] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-30T17:09:53.315903] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-30T17:09:53.316668] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-30T17:09:53.316745] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-30T17:09:53.318320] [DEBUG] [LOCAL ] ALLE: Trimmed 64737 records to 44763 (keeping 200 days of data) [2025-09-30T17:09:53.477714] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:09:53.662485] [DEBUG] [LOCAL ] ALLE: Primary data saved (44763 records). [2025-09-30T17:09:53.662685] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-30T17:09:53.664165] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 25.2s. Estimated remaining: 4h 24m 29s. Rate: 8.6 symbols/min [2025-09-30T17:09:53.862831] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-30T17:09:53.868460] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:53.904996] [DEBUG] [LOCAL ] ALTG: Loaded 23671 existing records from primary storage. [2025-09-30T17:09:53.905325] [INFO ] [MAIN ] ALTG: Loaded 23671 existing records. [2025-09-30T17:09:54.112137] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:54.112384] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-30T17:09:54.112478] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-30T17:09:54.112869] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-30T17:09:54.112934] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-30T17:09:54.514173] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:54.654376] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-30T17:09:55.026781] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:09:55.454361] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-30T17:09:55.633476] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:09:55.814701] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T17:09:56.254371] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-30T17:09:57.054366] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-30T17:09:57.101822] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:09:57.208261] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:09:57.854409] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-30T17:09:58.654347] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-30T17:09:58.841737] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:09:59.061133] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T17:09:59.454380] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-30T17:10:00.254340] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-30T17:10:00.458497] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:10:00.472153] [INFO ] [REMOTE ] ALL: Full fetch complete (72485 records). [2025-09-30T17:10:00.472289] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-30T17:10:00.924693] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-30T17:10:00.924815] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-30T17:10:00.925733] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-30T17:10:00.925911] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-30T17:10:00.927717] [DEBUG] [LOCAL ] ALL: Trimmed 72485 records to 50072 (keeping 200 days of data) [2025-09-30T17:10:01.054374] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-30T17:10:01.215859] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:10:01.241995] [INFO ] [REMOTE ] ALLY: Full fetch complete (76906 records). [2025-09-30T17:10:01.247278] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-30T17:10:01.840893] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-30T17:10:01.844861] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-30T17:10:01.846876] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-30T17:10:01.851140] [DEBUG] [LOCAL ] ALL: Primary data saved (50072 records). [2025-09-30T17:10:01.848435] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-30T17:10:01.851347] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-30T17:10:01.851971] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALL took 48.7s. Estimated remaining: 4h 24m 55s. Rate: 8.6 symbols/min [2025-09-30T17:10:01.927865] [DEBUG] [LOCAL ] ALLY: Trimmed 76906 records to 53219 (keeping 200 days of data) [2025-09-30T17:10:02.198006] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:02.213260] [DEBUG] [LOCAL ] ALUR: No existing data file found in primary storage. [2025-09-30T17:10:02.217165] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:10:02.213527] [WARN ] [MAIN ] ALUR: No existing data found, performing full refresh instead. [2025-09-30T17:10:02.236269] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-30T17:10:02.245709] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-30T17:10:02.249734] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-30T17:10:02.249574] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:10:02.252126] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-30T17:10:02.258753] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-30T17:10:02.655285] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-30T17:10:02.815500] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:02.918352] [DEBUG] [LOCAL ] ALLY: Primary data saved (53219 records). [2025-09-30T17:10:02.918523] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-30T17:10:02.919400] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 32.4s. Estimated remaining: 4h 22m 14s. Rate: 8.7 symbols/min [2025-09-30T17:10:03.104194] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:03.155972] [DEBUG] [LOCAL ] ALV: Loaded 42485 existing records from primary storage. [2025-09-30T17:10:03.156280] [INFO ] [MAIN ] ALV: Loaded 42485 existing records. [2025-09-30T17:10:03.358545] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:03.358764] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-30T17:10:03.358817] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-30T17:10:03.359258] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-30T17:10:03.359318] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-30T17:10:03.454697] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-30T17:10:03.782787] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:03.811690] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:10:03.836797] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:10:04.254357] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-30T17:10:05.054360] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-30T17:10:05.217857] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:10:05.854377] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-30T17:10:05.930838] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:10:06.520946] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T17:10:06.654369] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-30T17:10:07.223263] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:10:07.454327] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-30T17:10:07.472176] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:10:08.254385] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-30T17:10:08.600268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:10:09.054411] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-30T17:10:09.841535] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:10:09.851771] [INFO ] [REMOTE ] ALSN: Full fetch complete (62153 records). [2025-09-30T17:10:09.851940] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-30T17:10:09.864770] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-30T17:10:10.304959] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-30T17:10:10.305062] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-30T17:10:10.305830] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-30T17:10:10.305897] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-30T17:10:10.307382] [DEBUG] [LOCAL ] ALSN: Trimmed 62153 records to 43237 (keeping 200 days of data) [2025-09-30T17:10:10.593336] [DEBUG] [LOCAL ] ALSN: Primary data saved (43237 records). [2025-09-30T17:10:10.593481] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-30T17:10:10.593584] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 38.1s. Estimated remaining: 4h 22m 27s. Rate: 8.7 symbols/min [2025-09-30T17:10:10.660956] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-30T17:10:10.792198] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:10.818363] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:10:10.834013] [DEBUG] [LOCAL ] ALX: Loaded 6134 existing records from primary storage. [2025-09-30T17:10:10.834278] [INFO ] [MAIN ] ALX: Loaded 6134 existing records. [2025-09-30T17:10:11.037694] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:11.038062] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-30T17:10:11.038214] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-30T17:10:11.049680] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-30T17:10:11.050180] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-30T17:10:11.050607] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:10:11.472512] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-30T17:10:11.489713] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:11.607929] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:10:12.254401] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-30T17:10:12.834852] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:10:12.889690] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T17:10:13.054385] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-30T17:10:13.594133] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T17:10:13.854365] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-30T17:10:14.346213] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-30T17:10:14.654422] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-30T17:10:15.454340] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-30T17:10:15.514716] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:10:15.960419] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:10:16.254399] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-30T17:10:17.054416] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-30T17:10:17.830614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:10:17.854396] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-30T17:10:18.373858] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T17:10:18.379421] [INFO ] [REMOTE ] ALTG: Full fetch complete (33640 records). [2025-09-30T17:10:18.379552] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-30T17:10:18.659478] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-30T17:10:18.786349] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-30T17:10:18.786432] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-30T17:10:18.786857] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-30T17:10:18.786961] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-30T17:10:18.787968] [DEBUG] [LOCAL ] ALTG: Trimmed 33640 records to 23519 (keeping 200 days of data) [2025-09-30T17:10:18.925583] [DEBUG] [LOCAL ] ALTG: Primary data saved (23519 records). [2025-09-30T17:10:18.925751] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-30T17:10:18.925846] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 25.3s. Estimated remaining: 4h 22m 57s. Rate: 8.7 symbols/min [2025-09-30T17:10:19.113918] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:19.179531] [DEBUG] [LOCAL ] AM: Loaded 52096 existing records from primary storage. [2025-09-30T17:10:19.180148] [INFO ] [MAIN ] AM: Loaded 52096 existing records. [2025-09-30T17:10:19.274359] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:10:19.408009] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:19.408373] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-30T17:10:19.408580] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-30T17:10:19.409125] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-30T17:10:19.409188] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-30T17:10:19.458987] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-30T17:10:19.635669] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:10:19.899829] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:20.149798] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:10:20.254384] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-30T17:10:21.054389] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-30T17:10:21.854421] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-30T17:10:21.956932] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T17:10:22.152589] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T17:10:22.654373] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-30T17:10:23.454363] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-30T17:10:23.472724] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:10:23.666801] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T17:10:24.254443] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-30T17:10:24.950941] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:10:25.054424] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-30T17:10:25.854436] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-30T17:10:25.955339] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T17:10:25.983019] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T17:10:26.654388] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-30T17:10:26.697087] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:10:27.454393] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-30T17:10:28.254331] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-30T17:10:28.498881] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T17:10:28.535104] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:10:29.054391] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-30T17:10:29.854356] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-30T17:10:30.017612] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:10:30.654362] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-30T17:10:30.784688] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:10:30.968276] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T17:10:31.406256] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:10:31.454389] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-30T17:10:32.254418] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-30T17:10:32.971692] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:10:32.986820] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T17:10:32.986531] [INFO ] [REMOTE ] ALV: Full fetch complete (61865 records). [2025-09-30T17:10:32.989329] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-30T17:10:33.059612] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-30T17:10:33.422748] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-30T17:10:33.422842] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-30T17:10:33.423487] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-30T17:10:33.423537] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-30T17:10:33.425022] [DEBUG] [LOCAL ] ALV: Trimmed 61865 records to 42426 (keeping 200 days of data) [2025-09-30T17:10:33.725404] [DEBUG] [LOCAL ] ALV: Primary data saved (42426 records). [2025-09-30T17:10:33.725562] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-30T17:10:33.726263] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALV took 30.8s. Estimated remaining: 4h 26m 10s. Rate: 8.6 symbols/min [2025-09-30T17:10:33.859463] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-30T17:10:33.917785] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:33.958453] [DEBUG] [LOCAL ] AMBC: Loaded 36595 existing records from primary storage. [2025-09-30T17:10:33.958812] [INFO ] [MAIN ] AMBC: Loaded 36595 existing records. [2025-09-30T17:10:34.230204] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:34.231474] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-30T17:10:34.231524] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-30T17:10:34.231818] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-30T17:10:34.231878] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-30T17:10:34.630398] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:34.654341] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-30T17:10:34.986723] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:10:35.047012] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:10:35.050441] [INFO ] [REMOTE ] ALX: Full fetch complete (7057 records). [2025-09-30T17:10:35.050564] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-30T17:10:35.454376] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-30T17:10:35.460980] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-30T17:10:35.462001] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-30T17:10:35.462223] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-30T17:10:35.462267] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-30T17:10:35.462914] [DEBUG] [LOCAL ] ALX: Trimmed 7057 records to 6175 (keeping 200 days of data) [2025-09-30T17:10:35.499392] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T17:10:35.503289] [INFO ] [REMOTE ] ALUR: Full fetch complete (20428 records). [2025-09-30T17:10:35.505851] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-30T17:10:35.625257] [DEBUG] [LOCAL ] ALX: Primary data saved (6175 records). [2025-09-30T17:10:35.640803] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-30T17:10:35.644854] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 25.1s. Estimated remaining: 4h 23m 56s. Rate: 8.6 symbols/min [2025-09-30T17:10:36.017280] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:36.154192] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-30T17:10:36.154306] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-30T17:10:36.154601] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-30T17:10:36.154681] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-30T17:10:36.155374] [DEBUG] [LOCAL ] ALUR: Trimmed 20428 records to 10769 (keeping 200 days of data) [2025-09-30T17:10:36.231111] [DEBUG] [LOCAL ] ALUR: Primary data saved (10769 records). [2025-09-30T17:10:36.243109] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-30T17:10:36.244527] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALUR took 34.4s. Estimated remaining: 4h 21m 12s. Rate: 8.7 symbols/min [2025-09-30T17:10:36.259610] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-30T17:10:36.295455] [DEBUG] [LOCAL ] AMBP: Loaded 45121 existing records from primary storage. [2025-09-30T17:10:36.310750] [INFO ] [MAIN ] AMBP: Loaded 45121 existing records. [2025-09-30T17:10:36.601714] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:36.613254] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-30T17:10:36.624854] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-30T17:10:36.646610] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:36.646926] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-30T17:10:36.647074] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-30T17:10:36.647201] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-30T17:10:36.647012] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-30T17:10:36.647380] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-30T17:10:36.647445] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-30T17:10:36.652681] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-30T17:10:36.652763] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-30T17:10:37.423232] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:37.451401] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-30T17:10:37.501590] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:37.557826] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:10:37.559886] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:10:37.779114] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:10:37.779423] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-30T17:10:37.779520] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:10:37.779594] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-30T17:10:37.779683] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:10:37.779806] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-30T17:10:37.779914] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-30T17:10:37.779993] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-30T17:10:37.780087] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-30T17:10:37.780142] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 18m 54s. Rate: 8.8 symbols/min [2025-09-30T17:10:37.859499] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-30T17:10:37.970275] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:38.023203] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-09-30T17:10:38.023576] [INFO ] [MAIN ] AMC: Loaded 53760 existing records. [2025-09-30T17:10:38.223849] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:38.224087] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-30T17:10:38.224134] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-30T17:10:38.224480] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-30T17:10:38.224539] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-30T17:10:38.611391] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:38.654350] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-30T17:10:39.145089] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:10:39.454374] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-30T17:10:40.254397] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-30T17:10:40.391302] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:10:41.054356] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-30T17:10:41.107315] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:10:41.461173] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:10:41.854406] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-30T17:10:42.654359] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-30T17:10:43.400543] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:10:43.454383] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-30T17:10:43.493889] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-30T17:10:43.803198] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:10:44.254389] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-30T17:10:44.959070] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:10:45.054380] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-30T17:10:45.854411] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-30T17:10:46.373305] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T17:10:46.555304] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:10:46.654433] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-30T17:10:47.444106] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T17:10:47.454304] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-30T17:10:48.254397] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-30T17:10:48.580817] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:10:48.942820] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-30T17:10:49.054404] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-30T17:10:49.854373] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-30T17:10:50.034225] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:10:50.108839] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:10:50.654401] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-30T17:10:51.454410] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-30T17:10:51.919705] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-30T17:10:52.254356] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-30T17:10:52.313239] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:10:52.823218] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:10:53.054360] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-30T17:10:53.854386] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-30T17:10:54.078336] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:10:54.521807] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:10:54.530424] [INFO ] [REMOTE ] AMBC: Full fetch complete (51220 records). [2025-09-30T17:10:54.530576] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-30T17:10:54.657101] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-30T17:10:54.967091] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-30T17:10:54.967176] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-30T17:10:54.967710] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-30T17:10:54.967774] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-30T17:10:54.969201] [DEBUG] [LOCAL ] AMBC: Trimmed 51220 records to 36609 (keeping 200 days of data) [2025-09-30T17:10:55.178217] [DEBUG] [LOCAL ] AMBC: Primary data saved (36609 records). [2025-09-30T17:10:55.178406] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-30T17:10:55.179231] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 21.5s. Estimated remaining: 4h 23m 4s. Rate: 8.7 symbols/min [2025-09-30T17:10:55.362571] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:55.423489] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-30T17:10:55.423846] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-09-30T17:10:55.459517] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-30T17:10:55.644811] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:55.645115] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-30T17:10:55.645169] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-30T17:10:55.645515] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-30T17:10:55.645574] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-30T17:10:56.078433] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:56.257606] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-30T17:10:56.261295] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-30T17:10:56.438773] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T17:10:57.067418] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-30T17:10:57.070337] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T17:10:57.854373] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-30T17:10:57.972083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:10:58.654373] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-30T17:10:59.454400] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-30T17:10:59.503280] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:10:59.613352] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-30T17:11:00.254366] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-30T17:11:00.624673] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T17:11:00.636062] [INFO ] [REMOTE ] AM: Full fetch complete (75600 records). [2025-09-30T17:11:00.636237] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-30T17:11:01.054795] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-30T17:11:01.098277] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-30T17:11:01.098515] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-30T17:11:01.099427] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-30T17:11:01.099704] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-30T17:11:01.132395] [DEBUG] [LOCAL ] AM: Trimmed 75600 records to 52080 (keeping 200 days of data) [2025-09-30T17:11:01.134743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:11:01.503447] [DEBUG] [LOCAL ] AM: Primary data saved (52080 records). [2025-09-30T17:11:01.503845] [INFO ] [MAIN ] AM: Full history saved. [2025-09-30T17:11:01.505503] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 42.6s. Estimated remaining: 4h 22m 42s. Rate: 8.7 symbols/min [2025-09-30T17:11:01.628202] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:11:01.773970] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:01.838097] [DEBUG] [LOCAL ] AME: Loaded 48537 existing records from primary storage. [2025-09-30T17:11:01.838475] [INFO ] [MAIN ] AME: Loaded 48537 existing records. [2025-09-30T17:11:01.860145] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-30T17:11:02.044372] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:02.044631] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-30T17:11:02.044729] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-30T17:11:02.045391] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-30T17:11:02.045454] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-30T17:11:02.472284] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:02.654374] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-30T17:11:03.467296] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-30T17:11:03.473884] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-30T17:11:03.590466] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:11:04.254334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-30T17:11:04.356211] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:11:05.054344] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-30T17:11:05.411020] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T17:11:05.721007] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T17:11:05.854355] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-30T17:11:06.654460] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-30T17:11:07.288780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T17:11:07.459731] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-30T17:11:07.473903] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:11:08.254379] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-30T17:11:08.318424] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:11:09.054413] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-30T17:11:09.789286] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T17:11:09.804376] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T17:11:09.814805] [INFO ] [REMOTE ] AMBP: Full fetch complete (65809 records). [2025-09-30T17:11:09.814946] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-30T17:11:09.859497] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-30T17:11:10.233632] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-30T17:11:10.233760] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-30T17:11:10.234543] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-30T17:11:10.234635] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-30T17:11:10.236406] [DEBUG] [LOCAL ] AMBP: Trimmed 65809 records to 45060 (keeping 200 days of data) [2025-09-30T17:11:10.570057] [DEBUG] [LOCAL ] AMBP: Primary data saved (45060 records). [2025-09-30T17:11:10.570209] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-30T17:11:10.570309] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 34.9s. Estimated remaining: 4h 23m 26s. Rate: 8.6 symbols/min [2025-09-30T17:11:10.656480] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-30T17:11:10.774461] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:10.820898] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:11:10.841165] [DEBUG] [LOCAL ] AMG: Loaded 20495 existing records from primary storage. [2025-09-30T17:11:10.841497] [INFO ] [MAIN ] AMG: Loaded 20495 existing records. [2025-09-30T17:11:11.033979] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:11.034231] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-30T17:11:11.034281] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-30T17:11:11.034518] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-30T17:11:11.034578] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-30T17:11:11.418978] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:11.454320] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-30T17:11:12.177313] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T17:11:12.254412] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-30T17:11:12.436732] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-30T17:11:12.449753] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-30T17:11:12.449932] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-30T17:11:12.922797] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-30T17:11:12.924529] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-30T17:11:12.924403] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T17:11:12.925873] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-30T17:11:12.933883] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-30T17:11:12.936025] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53760 (keeping 200 days of data) [2025-09-30T17:11:13.056185] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-30T17:11:13.283760] [DEBUG] [LOCAL ] AMC: Primary data saved (53760 records). [2025-09-30T17:11:13.284043] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-30T17:11:13.284157] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 35.5s. Estimated remaining: 4h 21m 40s. Rate: 8.7 symbols/min [2025-09-30T17:11:13.516345] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:13.570312] [DEBUG] [LOCAL ] AMH: Loaded 51699 existing records from primary storage. [2025-09-30T17:11:13.570743] [INFO ] [MAIN ] AMH: Loaded 51699 existing records. [2025-09-30T17:11:13.779838] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:13.780120] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-30T17:11:13.780178] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-30T17:11:13.780567] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-30T17:11:13.780630] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-30T17:11:13.855163] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-30T17:11:14.186767] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:14.218340] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:11:14.283808] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:11:14.654373] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-30T17:11:15.426240] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:11:15.454380] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-30T17:11:16.254377] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-30T17:11:16.597226] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T17:11:17.054460] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-30T17:11:17.274321] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T17:11:17.320861] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:11:17.854472] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-30T17:11:18.654351] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-30T17:11:18.837930] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:11:19.454350] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-30T17:11:19.760006] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:11:19.853505] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T17:11:20.254410] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-30T17:11:21.044342] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T17:11:21.054314] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-30T17:11:21.435169] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:11:21.854367] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-30T17:11:22.654334] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-30T17:11:22.988266] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T17:11:23.454366] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-30T17:11:23.531638] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T17:11:23.955732] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:11:24.254407] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-30T17:11:24.750786] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:11:25.054447] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-30T17:11:25.854423] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-30T17:11:26.009593] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:11:26.120460] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:11:26.654403] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-30T17:11:27.335839] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T17:11:27.454449] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-30T17:11:28.254427] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-30T17:11:28.963261] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T17:11:28.976053] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-30T17:11:28.976239] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-30T17:11:29.057750] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-30T17:11:29.405168] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:11:29.419335] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:11:29.499979] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-30T17:11:29.500204] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-30T17:11:29.501088] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-30T17:11:29.501176] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-30T17:11:29.503224] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-30T17:11:29.848282] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-30T17:11:29.848954] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-30T17:11:29.849581] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 34.7s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-09-30T17:11:29.862881] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-30T17:11:30.035971] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:30.081512] [DEBUG] [LOCAL ] AMN: Loaded 41796 existing records from primary storage. [2025-09-30T17:11:30.081877] [INFO ] [MAIN ] AMN: Loaded 41796 existing records. [2025-09-30T17:11:30.270733] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:30.270990] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-30T17:11:30.271038] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-30T17:11:30.271402] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-30T17:11:30.271459] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-30T17:11:30.658504] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:30.658624] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-30T17:11:30.879597] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:11:30.918961] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:11:31.454367] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-30T17:11:32.040665] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:11:32.254411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-30T17:11:32.722319] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:11:32.727537] [INFO ] [REMOTE ] AMG: Full fetch complete (29817 records). [2025-09-30T17:11:32.727712] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-30T17:11:33.059464] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-30T17:11:33.140571] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-30T17:11:33.140695] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-30T17:11:33.141100] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-30T17:11:33.141149] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-30T17:11:33.142201] [DEBUG] [LOCAL ] AMG: Trimmed 29817 records to 20444 (keeping 200 days of data) [2025-09-30T17:11:33.275665] [DEBUG] [LOCAL ] AMG: Primary data saved (20444 records). [2025-09-30T17:11:33.275839] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-30T17:11:33.275934] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMG took 22.7s. Estimated remaining: 4h 23m 48s. Rate: 8.6 symbols/min [2025-09-30T17:11:33.469931] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:33.507894] [DEBUG] [LOCAL ] AMP: Loaded 32281 existing records from primary storage. [2025-09-30T17:11:33.508204] [INFO ] [MAIN ] AMP: Loaded 32281 existing records. [2025-09-30T17:11:33.737898] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:33.738121] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-30T17:11:33.738176] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-30T17:11:33.738686] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-30T17:11:33.738779] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-30T17:11:33.859455] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-30T17:11:34.144328] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:34.177602] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:11:34.654367] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-30T17:11:34.905893] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T17:11:34.918302] [INFO ] [REMOTE ] AME: Full fetch complete (69862 records). [2025-09-30T17:11:34.918523] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-30T17:11:35.355332] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-30T17:11:35.355449] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-30T17:11:35.356285] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-30T17:11:35.356355] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-30T17:11:35.357855] [DEBUG] [LOCAL ] AME: Trimmed 69862 records to 48527 (keeping 200 days of data) [2025-09-30T17:11:35.467411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-30T17:11:35.659186] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:11:35.743617] [DEBUG] [LOCAL ] AME: Primary data saved (48527 records). [2025-09-30T17:11:35.743795] [INFO ] [MAIN ] AME: Full history saved. [2025-09-30T17:11:35.746717] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 34.2s. Estimated remaining: 4h 21m 59s. Rate: 8.7 symbols/min [2025-09-30T17:11:35.953714] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:36.029744] [DEBUG] [LOCAL ] AMPX: Loaded 52224 existing records from primary storage. [2025-09-30T17:11:36.030169] [INFO ] [MAIN ] AMPX: Loaded 52224 existing records. [2025-09-30T17:11:36.230082] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:36.230558] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-30T17:11:36.230697] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-30T17:11:36.231324] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-30T17:11:36.231428] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-30T17:11:36.265158] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-30T17:11:36.583962] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T17:11:36.742733] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:36.943417] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:11:37.054406] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-30T17:11:37.746634] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T17:11:37.854418] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-30T17:11:38.642321] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:11:38.654306] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-30T17:11:39.380902] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:11:39.454389] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-30T17:11:40.254381] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-30T17:11:40.326298] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:11:40.899964] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:11:41.054365] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-30T17:11:41.758202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:11:41.854382] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-30T17:11:42.550328] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:11:42.654344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-30T17:11:43.425903] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T17:11:43.454374] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-30T17:11:44.142064] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:11:44.254369] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-30T17:11:45.054364] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-30T17:11:45.442071] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:11:45.854346] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-30T17:11:45.928396] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:11:46.307452] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T17:11:46.654363] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-30T17:11:47.430986] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:11:47.454344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-30T17:11:48.190378] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:11:48.254353] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-30T17:11:48.862426] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T17:11:49.054388] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-30T17:11:49.751111] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:11:49.854396] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-30T17:11:50.572750] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:11:50.654365] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-30T17:11:51.316405] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:11:51.454402] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-30T17:11:52.254339] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-30T17:11:52.526415] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:11:52.545966] [INFO ] [REMOTE ] AMH: Full fetch complete (74789 records). [2025-09-30T17:11:52.546297] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-30T17:11:52.899575] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:11:53.020401] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-30T17:11:53.020501] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-30T17:11:53.021255] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-30T17:11:53.021326] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-30T17:11:53.022947] [DEBUG] [LOCAL ] AMH: Trimmed 74789 records to 51702 (keeping 200 days of data) [2025-09-30T17:11:53.084345] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-30T17:11:53.356872] [DEBUG] [LOCAL ] AMH: Primary data saved (51702 records). [2025-09-30T17:11:53.357092] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-30T17:11:53.357271] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 40.1s. Estimated remaining: 4h 25m 52s. Rate: 8.5 symbols/min [2025-09-30T17:11:53.552332] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:53.552537] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-09-30T17:11:53.552595] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-09-30T17:11:53.552745] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-30T17:11:53.552800] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-30T17:11:53.552851] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-30T17:11:53.552907] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-30T17:11:53.859129] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-30T17:11:53.985444] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:54.026537] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:11:54.390614] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T17:11:54.398995] [INFO ] [REMOTE ] AMP: Full fetch complete (47388 records). [2025-09-30T17:11:54.399184] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-30T17:11:54.399923] [FATAL] [VALIDATOR ] AMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:11:54.400008] [FATAL] [MAIN ] AMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:11:54.400051] [WARN ] [MAIN ] AMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:11:54.400118] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-30T17:11:54.400182] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-09-30T17:11:54.400218] [INFO ] [LOCAL ] AMP: Starting deletion of derivative data. [2025-09-30T17:11:54.400731] [DEBUG] [LOCAL ] AMP: Deleted derivative data file. [2025-09-30T17:11:54.400843] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMP took 21.1s. Estimated remaining: 4h 23m 32s. Rate: 8.6 symbols/min [2025-09-30T17:11:54.584659] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:54.626065] [DEBUG] [LOCAL ] AMR: Loaded 28957 existing records from primary storage. [2025-09-30T17:11:54.626352] [INFO ] [MAIN ] AMR: Loaded 28957 existing records. [2025-09-30T17:11:54.659952] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-30T17:11:54.821744] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:54.821953] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-30T17:11:54.822001] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-30T17:11:54.822416] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-30T17:11:54.822475] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-30T17:11:55.204167] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:55.424220] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T17:11:55.454345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-30T17:11:55.871050] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:11:56.254373] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-30T17:11:57.054325] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-30T17:11:57.282460] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T17:11:57.465236] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:11:57.854330] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-30T17:11:57.912156] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:11:58.654343] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-30T17:11:59.013327] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:11:59.454420] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-30T17:12:00.254326] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-30T17:12:00.365636] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:12:00.985939] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:12:01.054345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-30T17:12:01.633997] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:12:01.854400] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-30T17:12:02.408875] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T17:12:02.418774] [INFO ] [REMOTE ] AMN: Full fetch complete (60292 records). [2025-09-30T17:12:02.418965] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-30T17:12:02.660209] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-30T17:12:02.867320] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-30T17:12:02.867423] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-30T17:12:02.868152] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-30T17:12:02.868218] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-30T17:12:02.869532] [DEBUG] [LOCAL ] AMN: Trimmed 60292 records to 41757 (keeping 200 days of data) [2025-09-30T17:12:03.141001] [DEBUG] [LOCAL ] AMN: Primary data saved (41757 records). [2025-09-30T17:12:03.141180] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-30T17:12:03.142411] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 33.3s. Estimated remaining: 4h 24m 4s. Rate: 8.6 symbols/min [2025-09-30T17:12:03.329276] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:03.369107] [DEBUG] [LOCAL ] AMRC: Loaded 38202 existing records from primary storage. [2025-09-30T17:12:03.369610] [INFO ] [MAIN ] AMRC: Loaded 38202 existing records. [2025-09-30T17:12:03.455830] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-30T17:12:03.580576] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:03.580889] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-30T17:12:03.580954] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-30T17:12:03.581285] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-30T17:12:03.581346] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-30T17:12:04.005715] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-30T17:12:04.009758] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:04.254423] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-30T17:12:04.374536] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:12:04.577967] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:12:05.054428] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-30T17:12:05.854396] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-30T17:12:06.221057] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T17:12:06.654347] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-30T17:12:06.717090] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T17:12:06.885427] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:12:07.454394] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-30T17:12:07.912865] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T17:12:08.254410] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-30T17:12:08.709610] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:12:09.054409] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-30T17:12:09.562370] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:12:09.854403] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-30T17:12:10.454963] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:12:10.654442] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-30T17:12:11.454366] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-30T17:12:12.006993] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T17:12:12.072542] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:12:12.254394] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-30T17:12:13.054402] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-30T17:12:13.126324] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:12:13.422097] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T17:12:13.854409] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-30T17:12:14.654433] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-30T17:12:14.804805] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:12:15.050057] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T17:12:15.062631] [INFO ] [REMOTE ] AMPX: Full fetch complete (74646 records). [2025-09-30T17:12:15.062897] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-30T17:12:15.459611] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-30T17:12:15.524745] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-30T17:12:15.524866] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-30T17:12:15.525630] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-30T17:12:15.525748] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-30T17:12:15.527231] [DEBUG] [LOCAL ] AMPX: Trimmed 74646 records to 52247 (keeping 200 days of data) [2025-09-30T17:12:15.870710] [DEBUG] [LOCAL ] AMPX: Primary data saved (52247 records). [2025-09-30T17:12:15.870876] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-30T17:12:15.870995] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 40.1s. Estimated remaining: 4h 26m 2s. Rate: 8.5 symbols/min [2025-09-30T17:12:16.060867] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:16.061138] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-30T17:12:16.061250] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-30T17:12:16.061546] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-30T17:12:16.061591] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-30T17:12:16.061688] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-30T17:12:16.061742] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-30T17:12:16.234085] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:12:16.275858] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-30T17:12:16.506223] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:17.054419] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-30T17:12:17.562268] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:12:17.562607] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-30T17:12:17.562720] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:12:17.562773] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-30T17:12:17.562809] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:12:17.562849] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-30T17:12:17.562908] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-30T17:12:17.562944] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-30T17:12:17.562986] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-30T17:12:17.563035] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 1.7s. Estimated remaining: 4h 23m 60s. Rate: 8.6 symbols/min [2025-09-30T17:12:17.788361] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:17.792922] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-30T17:12:17.834256] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:12:17.870790] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-30T17:12:17.899112] [DEBUG] [LOCAL ] AMT: Loaded 52433 existing records from primary storage. [2025-09-30T17:12:17.899536] [INFO ] [MAIN ] AMT: Loaded 52433 existing records. [2025-09-30T17:12:18.093287] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:18.093560] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-30T17:12:18.093615] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-30T17:12:18.094153] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-30T17:12:18.094213] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-30T17:12:18.489766] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:18.654396] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-30T17:12:19.445311] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:12:19.454536] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-30T17:12:20.254347] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-30T17:12:20.664278] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:12:20.885166] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T17:12:21.054385] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-30T17:12:21.653483] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T17:12:21.854385] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-30T17:12:22.659526] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-30T17:12:22.681974] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T17:12:23.454320] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-30T17:12:23.559922] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:12:23.567886] [INFO ] [REMOTE ] AMPY: Full fetch complete (51038 records). [2025-09-30T17:12:23.568017] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-30T17:12:24.029061] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-30T17:12:24.029178] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-30T17:12:24.029781] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-30T17:12:24.029848] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-30T17:12:24.031126] [DEBUG] [LOCAL ] AMPY: Trimmed 51038 records to 37712 (keeping 200 days of data) [2025-09-30T17:12:24.246166] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:12:24.254970] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-30T17:12:24.286525] [DEBUG] [LOCAL ] AMPY: Primary data saved (37712 records). [2025-09-30T17:12:24.286721] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-30T17:12:24.286818] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 30.9s. Estimated remaining: 4h 23m 47s. Rate: 8.6 symbols/min [2025-09-30T17:12:24.475328] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:24.498407] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T17:12:24.527967] [DEBUG] [LOCAL ] AMTB: Loaded 20251 existing records from primary storage. [2025-09-30T17:12:24.528269] [INFO ] [MAIN ] AMTB: Loaded 20251 existing records. [2025-09-30T17:12:24.719159] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:24.719513] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-30T17:12:24.719569] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-30T17:12:24.719934] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-30T17:12:24.719995] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-30T17:12:25.062976] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-30T17:12:25.108533] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:25.676333] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:12:25.854383] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-30T17:12:26.645314] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:12:26.654699] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-30T17:12:27.360884] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T17:12:27.454365] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-30T17:12:27.768554] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:12:27.774746] [INFO ] [REMOTE ] AMR: Full fetch complete (39853 records). [2025-09-30T17:12:27.774883] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-30T17:12:28.196921] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-30T17:12:28.197031] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-30T17:12:28.197528] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-30T17:12:28.197574] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-30T17:12:28.198772] [DEBUG] [LOCAL ] AMR: Trimmed 39853 records to 28930 (keeping 200 days of data) [2025-09-30T17:12:28.257161] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-30T17:12:28.390738] [DEBUG] [LOCAL ] AMR: Primary data saved (28930 records). [2025-09-30T17:12:28.390889] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-30T17:12:28.390973] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 34.0s. Estimated remaining: 4h 22m 39s. Rate: 8.6 symbols/min [2025-09-30T17:12:28.581699] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:28.587569] [DEBUG] [LOCAL ] AMTD: Loaded 3600 existing records from primary storage. [2025-09-30T17:12:28.587814] [INFO ] [MAIN ] AMTD: Loaded 3600 existing records. [2025-09-30T17:12:28.792505] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:28.792924] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-30T17:12:28.793080] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-30T17:12:28.793565] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-30T17:12:28.793626] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-30T17:12:29.063106] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-30T17:12:29.225884] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:29.251709] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:12:29.526814] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:12:29.854382] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-30T17:12:30.654384] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-30T17:12:31.052953] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:12:31.245024] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T17:12:31.243526] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T17:12:31.454410] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-30T17:12:32.254412] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-30T17:12:33.054348] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-30T17:12:33.144454] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:12:33.153942] [INFO ] [REMOTE ] AMRC: Full fetch complete (52918 records). [2025-09-30T17:12:33.154106] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-30T17:12:33.589416] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-30T17:12:33.589510] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-30T17:12:33.590200] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-30T17:12:33.590292] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-30T17:12:33.592552] [DEBUG] [LOCAL ] AMRC: Trimmed 52918 records to 38174 (keeping 200 days of data) [2025-09-30T17:12:33.847228] [DEBUG] [LOCAL ] AMRC: Primary data saved (38174 records). [2025-09-30T17:12:33.847391] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-30T17:12:33.848106] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 30.7s. Estimated remaining: 4h 22m 1s. Rate: 8.6 symbols/min [2025-09-30T17:12:33.871798] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-30T17:12:34.046810] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:34.081735] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T17:12:34.132254] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:12:34.154945] [DEBUG] [LOCAL ] AMTM: Loaded 50658 existing records from primary storage. [2025-09-30T17:12:34.155341] [INFO ] [MAIN ] AMTM: Loaded 50658 existing records. [2025-09-30T17:12:34.344432] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:34.344709] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-30T17:12:34.344770] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-30T17:12:34.345058] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-30T17:12:34.345130] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-30T17:12:34.656006] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-30T17:12:34.664318] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:12:34.753966] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:35.454402] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-30T17:12:36.038717] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T17:12:36.254341] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-30T17:12:36.419230] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:12:37.054371] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-30T17:12:37.243046] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:12:37.456803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T17:12:37.854431] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-30T17:12:38.344078] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T17:12:38.654389] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-30T17:12:39.454412] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-30T17:12:39.934951] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:12:40.254333] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-30T17:12:40.541356] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T17:12:40.921439] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T17:12:41.054373] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-30T17:12:41.854403] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-30T17:12:42.654333] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-30T17:12:42.827514] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:12:42.925291] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T17:12:43.454373] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-30T17:12:44.254328] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-30T17:12:44.332172] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T17:12:44.687960] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T17:12:45.054362] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-30T17:12:45.587445] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:12:45.602935] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T17:12:45.854366] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-30T17:12:46.654368] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-30T17:12:47.301920] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:12:47.454339] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-30T17:12:47.650272] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T17:12:48.254371] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-30T17:12:49.035844] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:12:49.054350] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-30T17:12:49.582164] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:12:49.595590] [INFO ] [REMOTE ] AMT: Full fetch complete (76010 records). [2025-09-30T17:12:49.595825] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-30T17:12:49.859536] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-30T17:12:50.106293] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-30T17:12:50.106418] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-30T17:12:50.107205] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-30T17:12:50.107333] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-30T17:12:50.109335] [DEBUG] [LOCAL ] AMT: Trimmed 76010 records to 52429 (keeping 200 days of data) [2025-09-30T17:12:50.231314] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:12:50.488520] [DEBUG] [LOCAL ] AMT: Primary data saved (52429 records). [2025-09-30T17:12:50.488835] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-30T17:12:50.490324] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMT took 32.9s. Estimated remaining: 4h 25m 15s. Rate: 8.5 symbols/min [2025-09-30T17:12:50.658505] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-30T17:12:50.697081] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:50.698691] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T17:12:50.701832] [INFO ] [REMOTE ] AMTD: Full fetch complete (5557 records). [2025-09-30T17:12:50.701953] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-30T17:12:50.807958] [DEBUG] [LOCAL ] AMWL: Loaded 8685 existing records from primary storage. [2025-09-30T17:12:50.824763] [INFO ] [MAIN ] AMWL: Loaded 8685 existing records. [2025-09-30T17:12:51.242206] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:51.263435] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-30T17:12:51.273759] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-30T17:12:51.278080] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-30T17:12:51.288778] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-30T17:12:51.443462] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-30T17:12:51.462099] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-30T17:12:51.462227] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-30T17:12:51.499095] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-30T17:12:51.513058] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-30T17:12:51.514315] [DEBUG] [LOCAL ] AMTD: Trimmed 5557 records to 3603 (keeping 200 days of data) [2025-09-30T17:12:51.759849] [DEBUG] [LOCAL ] AMTD: Primary data saved (3603 records). [2025-09-30T17:12:51.778600] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:12:51.783938] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-30T17:12:51.873490] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:51.873612] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 23.5s. Estimated remaining: 4h 23m 12s. Rate: 8.6 symbols/min [2025-09-30T17:12:52.062832] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:52.111259] [DEBUG] [LOCAL ] AMX: Loaded 49128 existing records from primary storage. [2025-09-30T17:12:52.111668] [INFO ] [MAIN ] AMX: Loaded 49128 existing records. [2025-09-30T17:12:52.260110] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-30T17:12:52.303756] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:52.304155] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-30T17:12:52.304222] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-30T17:12:52.304568] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-30T17:12:52.304631] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-30T17:12:52.689478] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:53.043915] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:12:53.054369] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-30T17:12:53.520483] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:12:53.524776] [INFO ] [REMOTE ] AMTB: Full fetch complete (29993 records). [2025-09-30T17:12:53.524888] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-30T17:12:53.859459] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-30T17:12:53.925248] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-30T17:12:53.925329] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-30T17:12:53.925725] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-30T17:12:53.925815] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-30T17:12:53.926725] [DEBUG] [LOCAL ] AMTB: Trimmed 29993 records to 20278 (keeping 200 days of data) [2025-09-30T17:12:54.054989] [DEBUG] [LOCAL ] AMTB: Primary data saved (20278 records). [2025-09-30T17:12:54.055123] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-30T17:12:54.055239] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTB took 29.8s. Estimated remaining: 4h 21m 27s. Rate: 8.6 symbols/min [2025-09-30T17:12:54.239040] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:54.279133] [DEBUG] [LOCAL ] AN: Loaded 32121 existing records from primary storage. [2025-09-30T17:12:54.279505] [INFO ] [MAIN ] AN: Loaded 32121 existing records. [2025-09-30T17:12:54.471770] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:54.472072] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-30T17:12:54.472130] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-30T17:12:54.472513] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-30T17:12:54.472576] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-30T17:12:54.666034] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-30T17:12:54.780842] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:12:54.907360] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:12:54.913552] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:55.454381] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-30T17:12:56.254413] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-30T17:12:56.301764] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:12:56.397370] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:12:57.054386] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-30T17:12:57.859553] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-30T17:12:57.865182] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:12:58.654369] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-30T17:12:58.780637] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:12:58.831994] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:12:59.454369] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-30T17:13:00.173640] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:13:00.254359] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-30T17:13:01.054383] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-30T17:13:01.252975] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:13:01.594203] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:13:01.854404] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-30T17:13:02.066738] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:13:02.654445] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-30T17:13:03.348382] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:13:03.454408] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-30T17:13:03.967200] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:13:04.058819] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:13:04.254388] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-30T17:13:05.054370] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-30T17:13:05.854390] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-30T17:13:06.055779] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:13:06.091597] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T17:13:06.654404] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-30T17:13:07.454428] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-30T17:13:07.670311] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:13:08.104744] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:13:08.107168] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:13:08.254356] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-30T17:13:09.054402] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-30T17:13:09.139732] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:13:09.854369] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-30T17:13:10.459103] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T17:13:10.654385] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-30T17:13:11.454399] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-30T17:13:11.665079] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:13:12.201078] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:13:12.254380] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-30T17:13:12.813068] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:13:13.054384] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-30T17:13:13.772165] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T17:13:13.854346] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-30T17:13:13.929861] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T17:13:14.654379] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-30T17:13:15.454337] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-30T17:13:15.501495] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:13:15.519058] [INFO ] [REMOTE ] AMTM: Full fetch complete (73951 records). [2025-09-30T17:13:15.519252] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-30T17:13:15.969811] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-30T17:13:15.969932] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-30T17:13:15.970749] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-30T17:13:15.970831] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-30T17:13:15.972698] [DEBUG] [LOCAL ] AMTM: Trimmed 73951 records to 50639 (keeping 200 days of data) [2025-09-30T17:13:16.001589] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:13:16.276187] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-30T17:13:16.320255] [DEBUG] [LOCAL ] AMTM: Primary data saved (50639 records). [2025-09-30T17:13:16.320416] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-30T17:13:16.320506] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 42.5s. Estimated remaining: 4h 26m 29s. Rate: 8.5 symbols/min [2025-09-30T17:13:16.526581] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:16.550450] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:13:16.607317] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-30T17:13:16.607720] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-30T17:13:16.799999] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:16.800315] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-30T17:13:16.800366] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-30T17:13:16.800765] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-30T17:13:16.800826] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-30T17:13:17.059624] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-30T17:13:17.194350] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:17.854421] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-30T17:13:18.048989] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:13:18.059870] [INFO ] [REMOTE ] AMX: Full fetch complete (70736 records). [2025-09-30T17:13:18.059992] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-30T17:13:18.151713] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:13:18.499998] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-30T17:13:18.500110] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-30T17:13:18.500905] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-30T17:13:18.500971] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-30T17:13:18.502606] [DEBUG] [LOCAL ] AMX: Trimmed 70736 records to 49110 (keeping 200 days of data) [2025-09-30T17:13:18.687543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-30T17:13:18.825879] [DEBUG] [LOCAL ] AMX: Primary data saved (49110 records). [2025-09-30T17:13:18.826024] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-30T17:13:18.826138] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 27.0s. Estimated remaining: 4h 24m 51s. Rate: 8.5 symbols/min [2025-09-30T17:13:19.026032] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:19.088629] [DEBUG] [LOCAL ] ANF: Loaded 52173 existing records from primary storage. [2025-09-30T17:13:19.089095] [INFO ] [MAIN ] ANF: Loaded 52173 existing records. [2025-09-30T17:13:19.330992] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:19.331307] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-30T17:13:19.331368] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-30T17:13:19.331939] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-30T17:13:19.331999] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-30T17:13:19.461233] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-30T17:13:19.872871] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:13:19.878579] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:19.883112] [INFO ] [REMOTE ] AMWL: Full fetch complete (14023 records). [2025-09-30T17:13:19.883238] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-30T17:13:20.256608] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-30T17:13:20.296313] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-30T17:13:20.296469] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-30T17:13:20.296824] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-30T17:13:20.296982] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-30T17:13:20.297954] [DEBUG] [LOCAL ] AMWL: Trimmed 14023 records to 8761 (keeping 200 days of data) [2025-09-30T17:13:20.375676] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-30T17:13:20.399195] [DEBUG] [LOCAL ] AMWL: Primary data saved (8761 records). [2025-09-30T17:13:20.399383] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-30T17:13:20.399575] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMWL took 29.9s. Estimated remaining: 4h 22m 55s. Rate: 8.6 symbols/min [2025-09-30T17:13:20.608606] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:20.627068] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-30T17:13:20.628109] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:13:20.627156] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-30T17:13:20.635345] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-30T17:13:20.635441] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-30T17:13:20.635539] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-30T17:13:20.635613] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-30T17:13:21.037196] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:21.054327] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-30T17:13:21.259322] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:13:21.259670] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-30T17:13:21.259760] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:13:21.259811] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-30T17:13:21.259874] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:13:21.259947] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-30T17:13:21.260015] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-30T17:13:21.260053] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-30T17:13:21.260113] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-30T17:13:21.260185] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 0.9s. Estimated remaining: 4h 20m 48s. Rate: 8.7 symbols/min [2025-09-30T17:13:21.440222] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:21.459802] [DEBUG] [LOCAL ] ANRO: Loaded 18969 existing records from primary storage. [2025-09-30T17:13:21.460065] [INFO ] [MAIN ] ANRO: Loaded 18969 existing records. [2025-09-30T17:13:21.647912] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:21.648120] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-30T17:13:21.648169] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-30T17:13:21.648441] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-30T17:13:21.648505] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-30T17:13:21.860018] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-30T17:13:22.028578] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:22.342061] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:13:22.654403] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-30T17:13:23.454425] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-30T17:13:24.145579] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T17:13:24.254341] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-30T17:13:24.499006] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:13:25.022248] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:13:25.054344] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-30T17:13:25.854353] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-30T17:13:26.230021] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T17:13:26.430418] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-30T17:13:26.654375] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-30T17:13:26.894795] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:13:27.454413] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-30T17:13:28.254418] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-30T17:13:28.759608] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T17:13:29.031921] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T17:13:29.054371] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-30T17:13:29.698969] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:13:29.706899] [INFO ] [REMOTE ] AN: Full fetch complete (47588 records). [2025-09-30T17:13:29.707100] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-30T17:13:29.866888] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-30T17:13:30.132787] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-30T17:13:30.132896] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-30T17:13:30.133458] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-30T17:13:30.133505] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-30T17:13:30.134586] [DEBUG] [LOCAL ] AN: Trimmed 47588 records to 32016 (keeping 200 days of data) [2025-09-30T17:13:30.340735] [DEBUG] [LOCAL ] AN: Primary data saved (32016 records). [2025-09-30T17:13:30.340883] [INFO ] [MAIN ] AN: Full history saved. [2025-09-30T17:13:30.341003] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 36.3s. Estimated remaining: 4h 21m 23s. Rate: 8.6 symbols/min [2025-09-30T17:13:30.530580] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:30.554542] [DEBUG] [LOCAL ] ANVS: Loaded 23113 existing records from primary storage. [2025-09-30T17:13:30.554890] [INFO ] [MAIN ] ANVS: Loaded 23113 existing records. [2025-09-30T17:13:30.662141] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-30T17:13:30.749896] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:30.750173] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-30T17:13:30.750231] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-30T17:13:30.750708] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-30T17:13:30.750769] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-30T17:13:31.129268] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:31.454425] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-30T17:13:31.569979] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-30T17:13:31.687233] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:13:31.877982] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T17:13:32.254385] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-30T17:13:33.021465] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:13:33.054315] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-30T17:13:33.296429] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:13:33.854363] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-30T17:13:34.654379] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-30T17:13:34.880496] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:13:35.086185] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:13:35.454373] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-30T17:13:36.254409] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-30T17:13:36.539698] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:13:37.054386] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-30T17:13:37.099559] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-30T17:13:37.854369] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-30T17:13:38.079327] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:13:38.127975] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-30T17:13:38.654382] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-30T17:13:39.454359] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-30T17:13:40.042258] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-30T17:13:40.254348] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-30T17:13:40.410353] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:13:40.518843] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T17:13:41.054369] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-30T17:13:41.356741] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:13:41.854384] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-30T17:13:42.654375] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-30T17:13:42.697487] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:13:43.077070] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:13:43.454371] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-30T17:13:43.978201] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:13:44.254364] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-30T17:13:45.054388] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-30T17:13:45.206201] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T17:13:45.585019] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T17:13:45.854377] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-30T17:13:46.063281] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:13:46.654366] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-30T17:13:47.454412] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-30T17:13:47.559503] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T17:13:48.154326] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-30T17:13:48.254377] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-30T17:13:48.659928] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:13:49.054355] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-30T17:13:49.854363] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-30T17:13:50.057385] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:13:50.210611] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:13:50.654348] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-30T17:13:51.454364] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-30T17:13:51.689896] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T17:13:52.073676] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:13:52.086115] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-30T17:13:52.086306] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-30T17:13:52.260966] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-30T17:13:52.532306] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T17:13:52.561663] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-30T17:13:52.561949] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-30T17:13:52.562805] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-30T17:13:52.562904] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-30T17:13:52.561861] [INFO ] [REMOTE ] ANRO: Full fetch complete (29688 records). [2025-09-30T17:13:52.563287] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-30T17:13:52.634733] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-30T17:13:53.064338] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-30T17:13:53.120173] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-30T17:13:53.120952] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-30T17:13:53.126947] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-30T17:13:53.128028] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-30T17:13:53.139851] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:13:53.139022] [DEBUG] [LOCAL ] ANRO: Trimmed 29688 records to 18824 (keeping 200 days of data) [2025-09-30T17:13:53.374860] [DEBUG] [LOCAL ] ANRO: Primary data saved (18824 records). [2025-09-30T17:13:53.375526] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-30T17:13:53.375966] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANRO took 32.1s. Estimated remaining: 4h 26m 26s. Rate: 8.5 symbols/min [2025-09-30T17:13:53.482334] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-30T17:13:53.482489] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-30T17:13:53.484403] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 37.2s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-09-30T17:13:53.854363] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-30T17:13:54.714861] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:13:54.730501] [INFO ] [REMOTE ] ANF: Full fetch complete (75592 records). [2025-09-30T17:13:54.730769] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-30T17:13:55.119930] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:13:55.160627] [INFO ] [REMOTE ] ANVS: Full fetch complete (36457 records). [2025-09-30T17:13:55.198972] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-30T17:13:55.203041] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-30T17:13:55.203391] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-30T17:13:55.204442] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-30T17:13:55.204532] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-30T17:13:55.315966] [DEBUG] [LOCAL ] ANF: Trimmed 75592 records to 52136 (keeping 200 days of data) [2025-09-30T17:13:55.768962] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-30T17:13:55.769382] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-30T17:13:55.769981] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-30T17:13:55.770082] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-30T17:13:55.773982] [DEBUG] [LOCAL ] ANVS: Trimmed 36457 records to 23170 (keeping 200 days of data) [2025-09-30T17:13:56.054015] [DEBUG] [LOCAL ] ANVS: Primary data saved (23170 records). [2025-09-30T17:13:56.055336] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-30T17:13:56.058352] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 25.7s. Estimated remaining: 4h 22m 34s. Rate: 8.6 symbols/min [2025-09-30T17:13:56.143254] [DEBUG] [LOCAL ] ANF: Primary data saved (52136 records). [2025-09-30T17:13:56.143398] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-30T17:13:56.143525] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 37.3s. Estimated remaining: 4h 20m 17s. Rate: 8.6 symbols/min [2025-09-30T17:13:56.747544] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.906802] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.926122] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.857328] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.926450] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-30T17:13:56.927290] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-30T17:13:56.927462] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-30T17:13:56.927595] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-30T17:13:56.927951] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-30T17:13:56.928059] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-30T17:13:57.099140] [DEBUG] [LOCAL ] AOMR: Loaded 16553 existing records from primary storage. [2025-09-30T17:13:57.127946] [INFO ] [MAIN ] AOMR: Loaded 16553 existing records. [2025-09-30T17:13:57.321269] [DEBUG] [LOCAL ] AOD: Loaded 30055 existing records from primary storage. [2025-09-30T17:13:57.406448] [INFO ] [MAIN ] AOD: Loaded 30055 existing records. [2025-09-30T17:13:57.432441] [DEBUG] [LOCAL ] AON: Loaded 45463 existing records from primary storage. [2025-09-30T17:13:57.512724] [INFO ] [MAIN ] AON: Loaded 45463 existing records. [2025-09-30T17:13:57.661906] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:57.757570] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:57.778028] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-30T17:13:57.797953] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-30T17:13:57.813431] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-30T17:13:57.868569] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-30T17:13:57.873956] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-30T17:13:57.957728] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:57.984992] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-30T17:13:58.021083] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-30T17:13:58.056553] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-30T17:13:58.056737] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-30T17:13:58.070733] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:13:58.104227] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-30T17:13:58.140331] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:58.174289] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:13:58.199726] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-30T17:13:58.223562] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-30T17:13:58.209227] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-30T17:13:58.229017] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:13:58.239848] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-30T17:13:58.260547] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-30T17:13:58.234688] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-30T17:13:58.379464] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-30T17:13:58.419248] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-30T17:13:58.479986] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-30T17:13:58.586003] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 18m 47s. Rate: 8.7 symbols/min [2025-09-30T17:13:59.173994] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.216292] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-30T17:13:59.374192] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:59.423823] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.447335] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-30T17:13:59.510630] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.511241] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-30T17:13:59.541229] [DEBUG] [LOCAL ] AORT: Loaded 29482 existing records from primary storage. [2025-09-30T17:13:59.541590] [INFO ] [MAIN ] AORT: Loaded 29482 existing records. [2025-09-30T17:13:59.751833] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:59.752122] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-30T17:13:59.752186] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-30T17:13:59.752446] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-30T17:13:59.752508] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-30T17:14:00.152215] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:00.152567] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-30T17:14:00.182230] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:14:00.185760] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-30T17:14:00.756622] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T17:14:00.763190] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-30T17:14:00.952805] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T17:14:00.955831] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-30T17:14:01.159539] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:14:01.168821] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-30T17:14:01.463841] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T17:14:01.562416] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T17:14:01.854381] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-30T17:14:02.065150] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:14:02.654333] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-30T17:14:02.834408] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:14:03.159277] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:14:03.454399] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-30T17:14:03.649474] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:14:04.254407] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-30T17:14:04.892033] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:14:05.054345] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-30T17:14:05.348768] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:14:05.854374] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-30T17:14:06.609148] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:14:06.654350] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-30T17:14:07.130329] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:14:07.454407] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-30T17:14:08.141245] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:14:08.254415] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-30T17:14:08.515270] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:14:09.054410] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-30T17:14:09.854388] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-30T17:14:10.129445] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:14:10.347042] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:14:10.654358] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-30T17:14:11.074372] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:14:11.454402] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-30T17:14:12.254399] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-30T17:14:12.423792] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T17:14:12.774847] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:14:13.054396] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-30T17:14:13.677521] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:14:13.854440] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-30T17:14:14.594629] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:14:14.654430] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-30T17:14:14.760497] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:14:15.454422] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-30T17:14:15.606940] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:14:16.254418] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-30T17:14:16.505380] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:14:17.057273] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-30T17:14:17.061298] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:14:17.854358] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-30T17:14:17.927488] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:14:18.654389] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-30T17:14:19.233681] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:14:19.433283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:14:19.454303] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-30T17:14:20.254329] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-30T17:14:20.669927] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:14:21.054380] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-30T17:14:21.690031] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:14:21.854429] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-30T17:14:22.065070] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:14:22.069434] [INFO ] [REMOTE ] AOMR: Full fetch complete (23154 records). [2025-09-30T17:14:22.069568] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-30T17:14:22.487751] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-30T17:14:22.487848] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-30T17:14:22.488177] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-30T17:14:22.488234] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-30T17:14:22.488994] [DEBUG] [LOCAL ] AOMR: Trimmed 23154 records to 16575 (keeping 200 days of data) [2025-09-30T17:14:22.591007] [DEBUG] [LOCAL ] AOMR: Primary data saved (16575 records). [2025-09-30T17:14:22.591171] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-30T17:14:22.591293] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 26.4s. Estimated remaining: 4h 23m 55s. Rate: 8.5 symbols/min [2025-09-30T17:14:22.664550] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-30T17:14:22.787405] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:22.842530] [DEBUG] [LOCAL ] AOS: Loaded 48890 existing records from primary storage. [2025-09-30T17:14:22.842926] [INFO ] [MAIN ] AOS: Loaded 48890 existing records. [2025-09-30T17:14:23.041574] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:14:23.041924] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-30T17:14:23.041983] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-30T17:14:23.042358] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-30T17:14:23.042440] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-30T17:14:23.371635] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:14:23.422018] [INFO ] [REMOTE ] AOD: Full fetch complete (44171 records). [2025-09-30T17:14:23.443423] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-30T17:14:23.464367] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-30T17:14:23.489576] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:23.888723] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-30T17:14:23.888861] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-30T17:14:23.889463] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-30T17:14:23.889526] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-30T17:14:23.890608] [DEBUG] [LOCAL ] AOD: Trimmed 44171 records to 30085 (keeping 200 days of data) [2025-09-30T17:14:24.084325] [DEBUG] [LOCAL ] AOD: Primary data saved (30085 records). [2025-09-30T17:14:24.084468] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-30T17:14:24.086324] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 27.9s. Estimated remaining: 4h 22m 7s. Rate: 8.6 symbols/min [2025-09-30T17:14:24.255964] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-30T17:14:24.287031] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:24.303328] [DEBUG] [LOCAL ] AP: Loaded 7191 existing records from primary storage. [2025-09-30T17:14:24.303563] [INFO ] [MAIN ] AP: Loaded 7191 existing records. [2025-09-30T17:14:24.507416] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:14:24.508169] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-30T17:14:24.508295] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-30T17:14:24.523677] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-30T17:14:24.526116] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-30T17:14:24.545609] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:14:24.862426] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-30T17:14:25.066671] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-30T17:14:25.090034] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:25.854373] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-30T17:14:25.926404] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:14:26.510778] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:14:26.654415] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-30T17:14:27.194978] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:14:27.454378] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-30T17:14:28.252273] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:14:28.261441] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-30T17:14:28.263748] [INFO ] [REMOTE ] AON: Full fetch complete (64808 records). [2025-09-30T17:14:28.263884] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-30T17:14:28.691796] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-30T17:14:28.691904] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-30T17:14:28.692723] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-30T17:14:28.692819] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-30T17:14:28.713161] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:14:28.720392] [DEBUG] [LOCAL ] AON: Trimmed 64808 records to 45425 (keeping 200 days of data) [2025-09-30T17:14:28.721043] [INFO ] [REMOTE ] AORT: Full fetch complete (41788 records). [2025-09-30T17:14:28.721452] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-30T17:14:29.059782] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-30T17:14:29.295982] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-30T17:14:29.296623] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-30T17:14:29.297392] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-30T17:14:29.298006] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-30T17:14:29.305142] [DEBUG] [LOCAL ] AORT: Trimmed 41788 records to 29478 (keeping 200 days of data) [2025-09-30T17:14:29.692692] [DEBUG] [LOCAL ] AON: Primary data saved (45425 records). [2025-09-30T17:14:29.695073] [INFO ] [MAIN ] AON: Full history saved. [2025-09-30T17:14:29.702095] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AON took 33.6s. Estimated remaining: 4h 21m 35s. Rate: 8.6 symbols/min [2025-09-30T17:14:29.704531] [DEBUG] [LOCAL ] AORT: Primary data saved (29478 records). [2025-09-30T17:14:29.705065] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-30T17:14:29.728184] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 31.1s. Estimated remaining: 4h 19m 23s. Rate: 8.7 symbols/min [2025-09-30T17:14:29.991027] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:14:30.015500] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-30T17:14:30.121144] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:30.151521] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-30T17:14:30.162042] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-30T17:14:30.186201] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-30T17:14:30.200748] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-30T17:14:30.210585] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-30T17:14:30.239729] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:30.215931] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T17:14:30.239965] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-30T17:14:30.240413] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-09-30T17:14:30.250342] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-09-30T17:14:30.315478] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-30T17:14:30.344359] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-30T17:14:30.367917] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-30T17:14:30.372347] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-30T17:14:30.660289] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-30T17:14:30.879016] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:14:31.109013] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:31.186963] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:31.454364] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-30T17:14:32.254392] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-30T17:14:32.397181] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:14:33.052390] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:14:33.059004] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-30T17:14:33.640015] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:14:33.854389] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-30T17:14:34.522046] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:14:34.654375] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-30T17:14:35.454343] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-30T17:14:35.627722] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T17:14:35.682231] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:14:35.855744] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T17:14:36.254358] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-30T17:14:37.054369] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-30T17:14:37.615894] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T17:14:37.859457] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-30T17:14:37.881070] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:14:38.490415] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T17:14:38.654366] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-30T17:14:39.454359] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-30T17:14:39.951627] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:14:40.254365] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-30T17:14:41.054341] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-30T17:14:41.217774] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:14:41.355370] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:14:41.854372] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-30T17:14:42.482340] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:14:42.636343] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:14:42.654306] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-30T17:14:43.259511] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:14:43.454363] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-30T17:14:44.254361] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-30T17:14:44.978014] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:14:45.054370] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-30T17:14:45.854362] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-30T17:14:46.130697] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T17:14:46.305534] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:14:46.544345] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:14:46.654384] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-30T17:14:47.454423] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-30T17:14:47.546479] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:14:47.549640] [INFO ] [REMOTE ] AP: Full fetch complete (8884 records). [2025-09-30T17:14:47.549838] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-30T17:14:47.550346] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:14:47.550433] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:14:47.550477] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:14:47.550518] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-30T17:14:47.550591] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-30T17:14:47.550672] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-30T17:14:47.551234] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-30T17:14:47.551332] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 23.5s. Estimated remaining: 4h 22m 30s. Rate: 8.6 symbols/min [2025-09-30T17:14:47.752959] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:47.753167] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-30T17:14:47.753206] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-30T17:14:47.753325] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-30T17:14:47.753367] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-30T17:14:47.753409] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-30T17:14:47.753443] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-30T17:14:48.142760] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:48.254361] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-30T17:14:49.054368] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-30T17:14:49.468015] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T17:14:49.816938] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T17:14:49.854357] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-30T17:14:50.663497] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-30T17:14:50.684102] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:14:51.147029] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:14:51.454354] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-30T17:14:51.824538] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:14:52.254399] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-30T17:14:53.026786] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T17:14:53.054319] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-30T17:14:53.854351] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-30T17:14:53.909950] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:14:54.382681] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T17:14:54.654411] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-30T17:14:55.239106] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:14:55.454363] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-30T17:14:56.080008] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:14:56.254375] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-30T17:14:57.010151] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:14:57.054370] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-30T17:14:57.831604] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:14:57.854311] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-30T17:14:58.625565] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:14:58.654321] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-30T17:14:59.438571] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T17:14:59.454300] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-30T17:14:59.989488] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:15:00.254402] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-30T17:15:01.054344] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-30T17:15:01.389726] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:15:01.399570] [INFO ] [REMOTE ] APAM: Full fetch complete (51602 records). [2025-09-30T17:15:01.399772] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-30T17:15:01.821456] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-30T17:15:01.859990] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-30T17:15:01.917360] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-30T17:15:01.917600] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-30T17:15:01.918270] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-30T17:15:01.918444] [INFO ] [REMOTE ] APD: Full fetch complete (66354 records). [2025-09-30T17:15:01.918673] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-30T17:15:01.918808] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-30T17:15:01.920340] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:15:01.920558] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:15:01.920910] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:15:01.920987] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-30T17:15:01.921297] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-30T17:15:01.921443] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-30T17:15:01.921167] [DEBUG] [LOCAL ] APAM: Trimmed 51602 records to 36128 (keeping 200 days of data) [2025-09-30T17:15:01.921807] [DEBUG] [LOCAL ] APD: No derivative data file found to delete. [2025-09-30T17:15:01.922309] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APD took 32.2s. Estimated remaining: 4h 24m 33s. Rate: 8.5 symbols/min [2025-09-30T17:15:02.215424] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:02.384959] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-30T17:15:02.386235] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-30T17:15:02.562392] [DEBUG] [LOCAL ] APAM: Primary data saved (36128 records). [2025-09-30T17:15:02.606849] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-30T17:15:02.606589] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:02.607404] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 32.9s. Estimated remaining: 4h 22m 34s. Rate: 8.5 symbols/min [2025-09-30T17:15:02.607698] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-30T17:15:02.632038] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-30T17:15:02.672501] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-30T17:15:02.672808] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-30T17:15:02.975396] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:03.342800] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:15:03.347203] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:03.359289] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-30T17:15:03.360994] [DEBUG] [LOCAL ] APLE: Loaded 51976 existing records from primary storage. [2025-09-30T17:15:03.363776] [INFO ] [MAIN ] APLE: Loaded 51976 existing records. [2025-09-30T17:15:03.461015] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-30T17:15:03.599297] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:03.602234] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-30T17:15:03.602458] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-30T17:15:03.603907] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:15:03.603954] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-30T17:15:03.604091] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-30T17:15:04.022351] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:04.254373] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-30T17:15:05.054412] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-30T17:15:06.638876] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (3.28 seconds). [2025-09-30T17:15:06.654512] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-30T17:15:07.381697] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (3.92 seconds). [2025-09-30T17:15:07.395200] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-30T17:15:07.637164] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-09-30T17:15:07.653483] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-30T17:15:08.412058] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (3.36 seconds). [2025-09-30T17:15:08.421996] [INFO ] [REMOTE ] AOS: Full fetch complete (70594 records). [2025-09-30T17:15:08.422156] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-30T17:15:08.869123] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-30T17:15:08.869508] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-30T17:15:08.870267] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-30T17:15:08.870426] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-30T17:15:08.872046] [DEBUG] [LOCAL ] AOS: Trimmed 70594 records to 48866 (keeping 200 days of data) [2025-09-30T17:15:09.150058] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-30T17:15:09.166270] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-30T17:15:09.205238] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:15:09.221061] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-30T17:15:09.264429] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:15:09.341877] [DEBUG] [LOCAL ] AOS: Primary data saved (48866 records). [2025-09-30T17:15:09.342025] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-30T17:15:09.342114] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. AOS took 46.8s. Estimated remaining: 4h 22m 22s. Rate: 8.5 symbols/min [2025-09-30T17:15:09.531103] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:09.587563] [DEBUG] [LOCAL ] APO: Loaded 53382 existing records from primary storage. [2025-09-30T17:15:09.587957] [INFO ] [MAIN ] APO: Loaded 53382 existing records. [2025-09-30T17:15:09.787975] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:09.788240] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-30T17:15:09.788300] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-30T17:15:09.788826] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-30T17:15:09.788889] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-30T17:15:09.859623] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-30T17:15:10.165564] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:10.654434] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-30T17:15:10.794468] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:15:10.930554] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:15:11.454357] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-30T17:15:11.564222] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:15:12.254390] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-30T17:15:12.305835] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:15:13.054350] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-30T17:15:13.317123] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:15:13.854390] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-30T17:15:13.998465] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:15:14.545233] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:15:14.654393] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-30T17:15:15.454398] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-30T17:15:15.697904] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:15:16.254400] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-30T17:15:17.054367] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-30T17:15:17.950151] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:15:17.963565] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-30T17:15:18.063552] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-30T17:15:18.082465] [INFO ] [REMOTE ] APG: Full fetch complete (71639 records). [2025-09-30T17:15:18.082696] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-30T17:15:18.528034] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-30T17:15:18.528129] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-30T17:15:18.529043] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-30T17:15:18.529305] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-30T17:15:18.530923] [DEBUG] [LOCAL ] APG: Trimmed 71639 records to 50186 (keeping 200 days of data) [2025-09-30T17:15:18.900437] [DEBUG] [LOCAL ] APG: Primary data saved (50186 records). [2025-09-30T17:15:18.900608] [INFO ] [MAIN ] APG: Full history saved. [2025-09-30T17:15:18.900731] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 31.3s. Estimated remaining: 4h 22m 58s. Rate: 8.5 symbols/min [2025-09-30T17:15:19.144939] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:19.155369] [DEBUG] [LOCAL ] APOS: Loaded 7514 existing records from primary storage. [2025-09-30T17:15:19.155587] [INFO ] [MAIN ] APOS: Loaded 7514 existing records. [2025-09-30T17:15:19.367482] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:19.368260] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-30T17:15:19.368469] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-30T17:15:19.368804] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-30T17:15:19.368867] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-30T17:15:19.700790] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (3.45 seconds). [2025-09-30T17:15:19.816730] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-30T17:15:19.850857] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:19.852883] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-30T17:15:19.891683] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-30T17:15:19.939164] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:15:20.254373] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-30T17:15:20.715839] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:15:21.054404] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-30T17:15:21.491236] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:15:21.854388] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-30T17:15:22.047455] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:15:22.478387] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:15:22.654373] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-30T17:15:23.454406] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-30T17:15:23.840237] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T17:15:24.069111] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:15:24.254398] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-30T17:15:24.409896] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:15:25.054429] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-30T17:15:25.656589] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:15:25.800387] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:15:25.854402] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-30T17:15:26.654450] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-30T17:15:27.454382] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-30T17:15:27.826931] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:15:28.254413] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-30T17:15:28.304314] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:15:28.965869] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-30T17:15:29.054416] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-30T17:15:29.854391] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-30T17:15:30.624951] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:15:30.624675] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-30T17:15:30.640117] [INFO ] [REMOTE ] APH: Full fetch complete (77684 records). [2025-09-30T17:15:30.640268] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-30T17:15:30.664533] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-30T17:15:31.101799] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-30T17:15:31.102045] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-30T17:15:31.102965] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-30T17:15:31.103219] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-30T17:15:31.104935] [DEBUG] [LOCAL ] APH: Trimmed 77684 records to 53691 (keeping 200 days of data) [2025-09-30T17:15:31.238711] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T17:15:31.459130] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-30T17:15:31.518152] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-30T17:15:31.518351] [INFO ] [MAIN ] APH: Full history saved. [2025-09-30T17:15:31.519299] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 29.6s. Estimated remaining: 4h 24m 27s. Rate: 8.5 symbols/min [2025-09-30T17:15:31.649176] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T17:15:31.742981] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:31.801879] [DEBUG] [LOCAL ] APTV: Loaded 52148 existing records from primary storage. [2025-09-30T17:15:31.802434] [INFO ] [MAIN ] APTV: Loaded 52148 existing records. [2025-09-30T17:15:32.009661] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:32.009948] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-30T17:15:32.010006] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-30T17:15:32.010309] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-30T17:15:32.010369] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-30T17:15:32.259441] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-30T17:15:32.419585] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:33.054379] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-30T17:15:33.429412] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:15:33.763923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T17:15:33.854335] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-30T17:15:34.014893] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:15:34.654400] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-30T17:15:35.459455] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-30T17:15:35.485993] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:15:36.091517] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T17:15:36.254350] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-30T17:15:36.735770] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:15:36.752957] [INFO ] [REMOTE ] APLE: Full fetch complete (74275 records). [2025-09-30T17:15:36.753148] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-30T17:15:36.881678] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T17:15:37.059599] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-30T17:15:37.226461] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-30T17:15:37.226563] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-30T17:15:37.227405] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-30T17:15:37.227480] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-30T17:15:37.229090] [DEBUG] [LOCAL ] APLE: Trimmed 74275 records to 51941 (keeping 200 days of data) [2025-09-30T17:15:37.565849] [DEBUG] [LOCAL ] APLE: Primary data saved (51941 records). [2025-09-30T17:15:37.566020] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-30T17:15:37.566133] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 35.0s. Estimated remaining: 4h 24m 2s. Rate: 8.5 symbols/min [2025-09-30T17:15:37.763756] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:37.763979] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-09-30T17:15:37.764037] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-09-30T17:15:37.764152] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-30T17:15:37.764194] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-30T17:15:37.764237] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-09-30T17:15:37.764284] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-30T17:15:37.859500] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-30T17:15:38.144550] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:38.654382] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-30T17:15:39.070824] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T17:15:39.440931] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T17:15:39.443761] [INFO ] [REMOTE ] APOS: Full fetch complete (10483 records). [2025-09-30T17:15:39.444070] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-30T17:15:39.459511] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-30T17:15:39.842503] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-30T17:15:39.842667] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-30T17:15:39.843007] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-30T17:15:39.858137] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-30T17:15:39.872844] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T17:15:39.872950] [DEBUG] [LOCAL ] APOS: Trimmed 10483 records to 7580 (keeping 200 days of data) [2025-09-30T17:15:39.930304] [DEBUG] [LOCAL ] APOS: Primary data saved (7580 records). [2025-09-30T17:15:39.930451] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-30T17:15:39.930536] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 21.0s. Estimated remaining: 4h 22m 36s. Rate: 8.5 symbols/min [2025-09-30T17:15:40.117945] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:40.125047] [DEBUG] [LOCAL ] AQNB: Loaded 4142 existing records from primary storage. [2025-09-30T17:15:40.125270] [INFO ] [MAIN ] AQNB: Loaded 4142 existing records. [2025-09-30T17:15:40.259496] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-30T17:15:40.330157] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:40.330385] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-30T17:15:40.330435] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-30T17:15:40.330668] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-30T17:15:40.330739] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-30T17:15:40.726184] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:41.054357] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-30T17:15:41.594106] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T17:15:41.638949] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:15:41.854376] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-30T17:15:42.654408] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-30T17:15:43.014233] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:15:43.454335] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-30T17:15:43.557932] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:15:44.257089] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-30T17:15:44.281579] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T17:15:44.285824] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:15:44.298963] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-09-30T17:15:44.299134] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-30T17:15:44.736907] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-30T17:15:44.737037] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-30T17:15:44.737849] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-30T17:15:44.737918] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-30T17:15:44.739582] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53383 (keeping 200 days of data) [2025-09-30T17:15:45.070517] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-30T17:15:45.098235] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-09-30T17:15:45.098415] [INFO ] [MAIN ] APO: Full history saved. [2025-09-30T17:15:45.098537] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 35.8s. Estimated remaining: 4h 21m 57s. Rate: 8.5 symbols/min [2025-09-30T17:15:45.279142] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:45.332063] [DEBUG] [LOCAL ] AR: Loaded 53584 existing records from primary storage. [2025-09-30T17:15:45.332411] [INFO ] [MAIN ] AR: Loaded 53584 existing records. [2025-09-30T17:15:45.530853] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:45.531088] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-30T17:15:45.531136] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-30T17:15:45.531496] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-30T17:15:45.531557] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-30T17:15:45.616185] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:15:45.857031] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-30T17:15:45.944335] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:45.976985] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:15:46.388971] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T17:15:46.654351] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-30T17:15:47.205947] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T17:15:47.454393] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-30T17:15:48.254358] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-30T17:15:48.692181] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:15:49.054413] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-30T17:15:49.580471] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:15:49.854414] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-30T17:15:50.445347] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:15:50.654359] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-30T17:15:50.911186] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T17:15:51.060252] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:15:51.454383] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-30T17:15:52.254408] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-30T17:15:53.054387] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-30T17:15:53.274533] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:15:53.440848] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T17:15:53.824092] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:15:53.854371] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-30T17:15:54.654366] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-30T17:15:55.283198] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T17:15:55.454377] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-30T17:15:55.631959] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:15:56.254400] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-30T17:15:57.054409] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-30T17:15:57.096215] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:15:57.854345] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-30T17:15:58.124840] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:15:58.654442] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-30T17:15:58.867879] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:15:59.110910] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:15:59.422096] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:15:59.454453] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-30T17:16:00.254382] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-30T17:16:00.922989] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T17:16:00.924740] [INFO ] [REMOTE ] AQNB: Full fetch complete (5864 records). [2025-09-30T17:16:00.924844] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-30T17:16:00.925680] [FATAL] [VALIDATOR ] AQNB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:16:00.925795] [FATAL] [MAIN ] AQNB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:16:00.925893] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:16:00.926013] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-30T17:16:00.926113] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-30T17:16:00.926189] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-09-30T17:16:00.926636] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-09-30T17:16:00.926877] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 21.0s. Estimated remaining: 4h 24m 16s. Rate: 8.5 symbols/min [2025-09-30T17:16:01.059494] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-30T17:16:01.133871] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:01.192085] [DEBUG] [LOCAL ] ARCO: Loaded 44534 existing records from primary storage. [2025-09-30T17:16:01.192590] [INFO ] [MAIN ] ARCO: Loaded 44534 existing records. [2025-09-30T17:16:01.421295] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:01.422216] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-30T17:16:01.422307] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-30T17:16:01.422803] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-30T17:16:01.422911] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-30T17:16:01.598158] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T17:16:01.859504] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-30T17:16:01.961958] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:02.654375] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-30T17:16:03.042114] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:16:03.321229] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:16:03.454405] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-30T17:16:04.259743] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-30T17:16:04.271869] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:16:04.720814] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T17:16:05.054418] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-30T17:16:05.861138] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-30T17:16:05.885154] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T17:16:06.654361] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-30T17:16:06.887785] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:16:07.454334] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-30T17:16:07.491737] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T17:16:08.024630] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:16:08.254384] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-30T17:16:09.054346] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-30T17:16:09.388554] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:16:09.400617] [INFO ] [REMOTE ] APTV: Full fetch complete (75964 records). [2025-09-30T17:16:09.400828] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-30T17:16:09.850183] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-30T17:16:09.850305] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-30T17:16:09.851200] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-30T17:16:09.851321] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-30T17:16:09.853186] [DEBUG] [LOCAL ] APTV: Trimmed 75964 records to 52122 (keeping 200 days of data) [2025-09-30T17:16:09.854682] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-30T17:16:09.977193] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:16:10.225176] [DEBUG] [LOCAL ] APTV: Primary data saved (52122 records). [2025-09-30T17:16:10.225368] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-30T17:16:10.225539] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 38.7s. Estimated remaining: 4h 24m 45s. Rate: 8.4 symbols/min [2025-09-30T17:16:10.410812] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:10.427510] [DEBUG] [LOCAL ] ARDC: Loaded 14689 existing records from primary storage. [2025-09-30T17:16:10.427763] [INFO ] [MAIN ] ARDC: Loaded 14689 existing records. [2025-09-30T17:16:10.625933] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:10.626390] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-30T17:16:10.626499] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-30T17:16:10.626824] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-30T17:16:10.626887] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-30T17:16:10.663577] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-30T17:16:11.043683] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:11.080404] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:16:11.454346] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-30T17:16:11.787186] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:16:12.130016] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:16:12.254380] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-30T17:16:13.054392] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-30T17:16:13.361184] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T17:16:13.867328] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-30T17:16:13.874512] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:16:13.887341] [INFO ] [REMOTE ] AQN: Full fetch complete (75292 records). [2025-09-30T17:16:13.887614] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-30T17:16:14.178247] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:16:14.393913] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-30T17:16:14.394029] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-30T17:16:14.395848] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-30T17:16:14.395960] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-30T17:16:14.400908] [DEBUG] [LOCAL ] AQN: Trimmed 75292 records to 51903 (keeping 200 days of data) [2025-09-30T17:16:14.679542] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-30T17:16:14.800078] [DEBUG] [LOCAL ] AQN: Primary data saved (51903 records). [2025-09-30T17:16:14.800396] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-30T17:16:14.800505] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 37.2s. Estimated remaining: 4h 23m 57s. Rate: 8.5 symbols/min [2025-09-30T17:16:15.004989] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:15.005248] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-09-30T17:16:15.005314] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-09-30T17:16:15.005458] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-30T17:16:15.005522] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-30T17:16:15.005598] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-30T17:16:15.005637] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-30T17:16:15.457355] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:15.457451] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-30T17:16:15.468701] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:16:15.756486] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T17:16:16.254378] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-30T17:16:16.991163] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:16:17.054356] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-30T17:16:17.462176] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:16:17.812633] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:16:17.854398] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-30T17:16:18.654380] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-30T17:16:19.062842] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:16:19.278608] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T17:16:19.454371] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-30T17:16:20.254376] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-30T17:16:20.699747] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T17:16:21.054400] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-30T17:16:21.243063] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T17:16:21.854392] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-30T17:16:22.605266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:16:22.654317] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-30T17:16:23.050523] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:16:23.130733] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:16:23.454368] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-30T17:16:24.254379] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-30T17:16:24.890388] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:16:25.054369] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-30T17:16:25.771984] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:16:25.854404] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-30T17:16:26.387910] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:16:26.402292] [INFO ] [REMOTE ] AR: Full fetch complete (77533 records). [2025-09-30T17:16:26.402480] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-30T17:16:26.672825] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-30T17:16:26.918066] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-30T17:16:26.918236] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-30T17:16:26.919156] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-30T17:16:26.919226] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-30T17:16:26.920919] [DEBUG] [LOCAL ] AR: Trimmed 77533 records to 53584 (keeping 200 days of data) [2025-09-30T17:16:27.259186] [DEBUG] [LOCAL ] AR: Primary data saved (53584 records). [2025-09-30T17:16:27.259465] [INFO ] [MAIN ] AR: Full history saved. [2025-09-30T17:16:27.259596] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 42.2s. Estimated remaining: 4h 25m 17s. Rate: 8.4 symbols/min [2025-09-30T17:16:27.473675] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-30T17:16:27.473556] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:27.559703] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:16:27.571307] [DEBUG] [LOCAL ] ARE: Loaded 50593 existing records from primary storage. [2025-09-30T17:16:27.572292] [INFO ] [MAIN ] ARE: Loaded 50593 existing records. [2025-09-30T17:16:27.765947] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:27.766157] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-30T17:16:27.766316] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-30T17:16:27.766869] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-30T17:16:27.766932] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-30T17:16:28.084473] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:16:28.173828] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:28.254320] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-30T17:16:28.509024] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:16:29.054386] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-30T17:16:29.862903] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-30T17:16:29.868945] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:16:29.927907] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:16:30.654362] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-30T17:16:31.193998] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:16:31.454417] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-30T17:16:31.784986] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:16:32.254366] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-30T17:16:32.489712] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:16:33.054366] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-30T17:16:33.333338] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T17:16:33.338931] [INFO ] [REMOTE ] ARDC: Full fetch complete (20575 records). [2025-09-30T17:16:33.339115] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-30T17:16:33.772463] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-30T17:16:33.772582] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-30T17:16:33.772983] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-30T17:16:33.773108] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-30T17:16:33.773876] [DEBUG] [LOCAL ] ARDC: Trimmed 20575 records to 14721 (keeping 200 days of data) [2025-09-30T17:16:33.854467] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-30T17:16:33.874242] [DEBUG] [LOCAL ] ARDC: Primary data saved (14721 records). [2025-09-30T17:16:33.874442] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-30T17:16:33.874541] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 23.6s. Estimated remaining: 4h 25m 1s. Rate: 8.4 symbols/min [2025-09-30T17:16:34.087317] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:34.088922] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:16:34.159701] [DEBUG] [LOCAL ] ARES: Loaded 49525 existing records from primary storage. [2025-09-30T17:16:34.160132] [INFO ] [MAIN ] ARES: Loaded 49525 existing records. [2025-09-30T17:16:34.384174] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:34.384466] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-30T17:16:34.384515] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-30T17:16:34.384909] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-30T17:16:34.384971] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-30T17:16:34.659538] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-30T17:16:34.798856] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:35.405760] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:16:35.454401] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-30T17:16:35.955276] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:16:36.254370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-30T17:16:37.054372] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-30T17:16:37.112181] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:16:37.854329] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-30T17:16:37.969196] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:16:38.371491] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T17:16:38.654354] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-30T17:16:39.468873] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-30T17:16:39.497530] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:16:40.254362] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-30T17:16:40.572817] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:16:41.054415] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-30T17:16:41.320979] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T17:16:41.333085] [INFO ] [REMOTE ] ARCO: Full fetch complete (65303 records). [2025-09-30T17:16:41.333254] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-30T17:16:41.336382] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:16:41.336498] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:16:41.336563] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:16:41.336608] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-30T17:16:41.336707] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-09-30T17:16:41.336764] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-09-30T17:16:41.337216] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-09-30T17:16:41.340185] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 40.4s. Estimated remaining: 4h 24m 60s. Rate: 8.4 symbols/min [2025-09-30T17:16:41.533842] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:41.594580] [DEBUG] [LOCAL ] ARI: Loaded 43363 existing records from primary storage. [2025-09-30T17:16:41.594995] [INFO ] [MAIN ] ARI: Loaded 43363 existing records. [2025-09-30T17:16:41.793703] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:41.794037] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-30T17:16:41.794102] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-30T17:16:41.794505] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-30T17:16:41.794589] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-30T17:16:41.865824] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-30T17:16:41.998110] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:16:42.237857] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:42.654318] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-30T17:16:42.705753] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:16:43.316970] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:16:43.322927] [INFO ] [REMOTE ] ARDT: Full fetch complete (41216 records). [2025-09-30T17:16:43.323063] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-30T17:16:43.459466] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-30T17:16:43.753139] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-30T17:16:43.753235] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-30T17:16:43.753826] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-30T17:16:43.753899] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-30T17:16:43.754875] [DEBUG] [LOCAL ] ARDT: Trimmed 41216 records to 27698 (keeping 200 days of data) [2025-09-30T17:16:43.928443] [DEBUG] [LOCAL ] ARDT: Primary data saved (27698 records). [2025-09-30T17:16:43.928595] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-30T17:16:43.928710] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 29.1s. Estimated remaining: 4h 23m 41s. Rate: 8.5 symbols/min [2025-09-30T17:16:44.120023] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:44.120316] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-30T17:16:44.120387] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-30T17:16:44.120632] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-30T17:16:44.120717] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-30T17:16:44.120771] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-30T17:16:44.120806] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-30T17:16:44.262942] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-30T17:16:44.520960] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:44.559661] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T17:16:44.850062] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:16:45.054372] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-30T17:16:45.854332] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-30T17:16:46.028075] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T17:16:46.477235] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:16:46.654407] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-30T17:16:47.439463] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:16:47.454314] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-30T17:16:48.128255] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:16:48.254405] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-30T17:16:49.054338] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-30T17:16:49.256989] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:16:49.854358] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-30T17:16:49.932202] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:16:50.654426] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-30T17:16:51.454464] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-30T17:16:51.585571] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:16:51.664855] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-30T17:16:52.254389] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-30T17:16:52.476249] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:16:52.585789] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:16:53.054379] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-30T17:16:53.854365] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-30T17:16:54.032161] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:16:54.501956] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:16:54.654402] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-30T17:16:55.235077] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:16:55.454370] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-30T17:16:56.254368] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-30T17:16:56.437170] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T17:16:57.054364] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-30T17:16:57.101677] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:16:57.854370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-30T17:16:57.968007] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:16:58.654374] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-30T17:16:58.954635] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:16:58.965977] [INFO ] [REMOTE ] ARES: Full fetch complete (70699 records). [2025-09-30T17:16:58.966144] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-30T17:16:59.419682] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-30T17:16:59.419802] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-30T17:16:59.420491] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-30T17:16:59.420540] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-30T17:16:59.422063] [DEBUG] [LOCAL ] ARES: Trimmed 70699 records to 49530 (keeping 200 days of data) [2025-09-30T17:16:59.480433] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-30T17:16:59.753209] [DEBUG] [LOCAL ] ARES: Primary data saved (49530 records). [2025-09-30T17:16:59.753367] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-30T17:16:59.754761] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARES took 25.9s. Estimated remaining: 4h 25m 51s. Rate: 8.4 symbols/min [2025-09-30T17:16:59.971271] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:59.973742] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-09-30T17:16:59.973577] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:16:59.973938] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-09-30T17:16:59.984464] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-30T17:16:59.984724] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-30T17:16:59.984794] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-30T17:16:59.984834] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-30T17:17:00.000267] [INFO ] [REMOTE ] ARE: Full fetch complete (72599 records). [2025-09-30T17:17:00.041856] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-30T17:17:00.838926] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:00.850910] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-30T17:17:00.942354] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-30T17:17:00.945475] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-30T17:17:00.946712] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-30T17:17:00.949094] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:17:00.947167] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-30T17:17:00.961832] [DEBUG] [LOCAL ] ARE: Trimmed 72599 records to 50614 (keeping 200 days of data) [2025-09-30T17:17:01.062803] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-30T17:17:01.235176] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:17:01.337254] [DEBUG] [LOCAL ] ARE: Primary data saved (50614 records). [2025-09-30T17:17:01.337412] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-30T17:17:01.337505] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARE took 34.1s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-09-30T17:17:01.546015] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:01.546243] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-30T17:17:01.546298] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-30T17:17:01.546468] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-30T17:17:01.546568] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-30T17:17:01.546635] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-30T17:17:01.546715] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-30T17:17:01.859932] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-30T17:17:01.973160] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:02.548838] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:17:02.654415] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-30T17:17:02.852905] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:17:03.144952] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:17:03.454398] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-30T17:17:04.254351] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-30T17:17:04.392422] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:17:05.028904] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:17:05.054318] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-30T17:17:05.854339] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-30T17:17:05.949987] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T17:17:06.654342] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-30T17:17:06.704240] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:17:07.116855] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:17:07.454387] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-30T17:17:08.058523] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:17:08.254387] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-30T17:17:09.054371] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-30T17:17:09.408285] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:17:09.417908] [INFO ] [REMOTE ] ARIS: Full fetch complete (60297 records). [2025-09-30T17:17:09.418045] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-30T17:17:09.873989] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-30T17:17:09.870706] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-30T17:17:09.875119] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-30T17:17:09.875849] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-30T17:17:09.875938] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-30T17:17:09.919871] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:17:09.917988] [DEBUG] [LOCAL ] ARIS: Trimmed 60297 records to 42103 (keeping 200 days of data) [2025-09-30T17:17:10.211788] [DEBUG] [LOCAL ] ARIS: Primary data saved (42103 records). [2025-09-30T17:17:10.211927] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-30T17:17:10.212005] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 26.3s. Estimated remaining: 4h 24m 37s. Rate: 8.4 symbols/min [2025-09-30T17:17:10.421628] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:10.421935] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-09-30T17:17:10.422074] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-09-30T17:17:10.422277] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-30T17:17:10.422471] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-30T17:17:10.422590] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-30T17:17:10.422681] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-30T17:17:10.624329] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:17:10.662768] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-30T17:17:10.881409] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:11.454389] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-30T17:17:11.533444] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:17:12.023775] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:17:12.254391] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-30T17:17:12.956141] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T17:17:13.054378] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-30T17:17:13.769441] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:17:13.854387] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-30T17:17:14.493029] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:17:14.654402] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-30T17:17:15.454390] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-30T17:17:15.501105] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:17:15.900834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:17:16.254370] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-30T17:17:17.054400] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-30T17:17:17.142928] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:17:17.812581] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:17:17.854396] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-30T17:17:18.573979] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:17:18.584046] [INFO ] [REMOTE ] ARI: Full fetch complete (62765 records). [2025-09-30T17:17:18.584217] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-30T17:17:18.665573] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-30T17:17:19.075403] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-30T17:17:19.075502] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-30T17:17:19.076233] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-30T17:17:19.076465] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-30T17:17:19.078076] [DEBUG] [LOCAL ] ARI: Trimmed 62765 records to 43459 (keeping 200 days of data) [2025-09-30T17:17:19.369399] [DEBUG] [LOCAL ] ARI: Primary data saved (43459 records). [2025-09-30T17:17:19.369551] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-30T17:17:19.370673] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARI took 38.0s. Estimated remaining: 4h 25m 1s. Rate: 8.4 symbols/min [2025-09-30T17:17:19.454742] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-30T17:17:19.563315] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:19.592708] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:17:19.655872] [DEBUG] [LOCAL ] ARR: Loaded 52025 existing records from primary storage. [2025-09-30T17:17:19.656231] [INFO ] [MAIN ] ARR: Loaded 52025 existing records. [2025-09-30T17:17:19.847421] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:19.847666] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-30T17:17:19.847730] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-30T17:17:19.848049] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-30T17:17:19.848123] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-30T17:17:20.259924] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-30T17:17:20.271168] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:20.494187] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T17:17:21.054371] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-30T17:17:21.114753] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T17:17:21.524311] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T17:17:21.854367] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-30T17:17:22.654362] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-30T17:17:22.815454] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:17:23.299517] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:17:23.454370] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-30T17:17:24.254377] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-30T17:17:24.378491] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:17:24.390104] [INFO ] [REMOTE ] ARLO: Full fetch complete (62279 records). [2025-09-30T17:17:24.390265] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-30T17:17:24.391380] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:24.391480] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:24.391525] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:24.391567] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-30T17:17:24.391627] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-30T17:17:24.391703] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-09-30T17:17:24.391762] [DEBUG] [LOCAL ] ARLO: No derivative data file found to delete. [2025-09-30T17:17:24.391823] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 24.6s. Estimated remaining: 4h 24m 21s. Rate: 8.4 symbols/min [2025-09-30T17:17:24.587327] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:24.631661] [DEBUG] [LOCAL ] ARW: Loaded 33065 existing records from primary storage. [2025-09-30T17:17:24.631947] [INFO ] [MAIN ] ARW: Loaded 33065 existing records. [2025-09-30T17:17:24.820781] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:24.821030] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-30T17:17:24.821121] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-30T17:17:24.821613] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-30T17:17:24.821708] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-30T17:17:25.055133] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-30T17:17:25.223933] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:25.253538] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:17:25.854369] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-30T17:17:26.116080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T17:17:26.654368] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-30T17:17:26.881095] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:17:27.260487] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-30T17:17:27.454367] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-30T17:17:28.254329] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-30T17:17:28.347918] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T17:17:28.808101] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:17:29.054361] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-30T17:17:29.728034] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:17:29.854371] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-30T17:17:30.654357] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-30T17:17:31.134442] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:17:31.454352] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-30T17:17:31.855432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T17:17:32.254332] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-30T17:17:32.427696] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:17:32.594198] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:17:33.054426] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-30T17:17:33.854387] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-30T17:17:33.992961] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:17:34.004960] [INFO ] [REMOTE ] ARMK: Full fetch complete (72233 records). [2025-09-30T17:17:34.005222] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-30T17:17:34.006500] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:34.006629] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:34.006712] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:34.006764] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-30T17:17:34.006857] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-30T17:17:34.006914] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-30T17:17:34.006958] [DEBUG] [LOCAL ] ARMK: No derivative data file found to delete. [2025-09-30T17:17:34.007030] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 32.7s. Estimated remaining: 4h 24m 52s. Rate: 8.4 symbols/min [2025-09-30T17:17:34.192375] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:34.192683] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-30T17:17:34.192742] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-30T17:17:34.192915] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-30T17:17:34.192988] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-30T17:17:34.193056] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-30T17:17:34.193101] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-30T17:17:34.562843] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:34.654349] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-30T17:17:34.880777] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:17:34.881310] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-30T17:17:34.881437] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:17:34.881518] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-30T17:17:34.881605] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:17:34.881731] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-30T17:17:34.881816] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-30T17:17:34.881858] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-30T17:17:34.881900] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-30T17:17:34.881959] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 0.9s. Estimated remaining: 4h 23m 11s. Rate: 8.4 symbols/min [2025-09-30T17:17:35.071268] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:35.071572] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-30T17:17:35.071630] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-30T17:17:35.071778] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-30T17:17:35.071820] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-30T17:17:35.071861] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-30T17:17:35.071893] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-30T17:17:35.450834] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:35.465970] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-30T17:17:35.494701] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-30T17:17:35.545256] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:17:36.254394] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-30T17:17:37.054490] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-30T17:17:37.294338] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T17:17:37.854347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-30T17:17:37.950065] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T17:17:38.654345] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-30T17:17:38.999958] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:17:39.222240] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:17:39.454358] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-30T17:17:40.144330] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:17:40.254361] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-30T17:17:41.054302] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-30T17:17:41.332352] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T17:17:41.854346] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-30T17:17:42.105068] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:17:42.287451] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:17:42.654432] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-30T17:17:43.441430] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:17:43.454303] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-30T17:17:44.254393] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-30T17:17:44.573121] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T17:17:45.054397] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-30T17:17:45.207897] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:17:45.316913] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:17:45.854377] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-30T17:17:46.654419] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-30T17:17:47.071409] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:17:47.164985] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-30T17:17:47.454376] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-30T17:17:48.254356] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-30T17:17:48.409818] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:17:48.766137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:17:49.054384] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-30T17:17:49.854420] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-30T17:17:49.989031] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:17:50.654395] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-30T17:17:51.088841] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T17:17:51.099418] [INFO ] [REMOTE ] AROC: Full fetch complete (70412 records). [2025-09-30T17:17:51.099566] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-30T17:17:51.100461] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:51.100552] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:51.100596] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:51.100636] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-30T17:17:51.100752] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-30T17:17:51.100806] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-09-30T17:17:51.100849] [DEBUG] [LOCAL ] AROC: No derivative data file found to delete. [2025-09-30T17:17:51.100919] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 40.9s. Estimated remaining: 4h 25m 19s. Rate: 8.4 symbols/min [2025-09-30T17:17:51.302555] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:51.318702] [DEBUG] [LOCAL ] ASA: Loaded 14041 existing records from primary storage. [2025-09-30T17:17:51.318965] [INFO ] [MAIN ] ASA: Loaded 14041 existing records. [2025-09-30T17:17:51.458952] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-30T17:17:51.545792] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:51.546500] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-30T17:17:51.546583] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-30T17:17:51.547161] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-30T17:17:51.547344] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-30T17:17:51.946529] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:17:51.994534] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:51.994828] [INFO ] [REMOTE ] ARR: Full fetch complete (75179 records). [2025-09-30T17:17:51.995119] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-30T17:17:52.265447] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-30T17:17:52.295185] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T17:17:52.463123] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-30T17:17:52.463242] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-30T17:17:52.464063] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-30T17:17:52.464134] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-30T17:17:52.465795] [DEBUG] [LOCAL ] ARR: Trimmed 75179 records to 52041 (keeping 200 days of data) [2025-09-30T17:17:52.823351] [DEBUG] [LOCAL ] ARR: Primary data saved (52041 records). [2025-09-30T17:17:52.823525] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-30T17:17:52.828582] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARR took 33.5s. Estimated remaining: 4h 23m 52s. Rate: 8.4 symbols/min [2025-09-30T17:17:53.006031] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:53.006219] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-09-30T17:17:53.006283] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-09-30T17:17:53.006399] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-30T17:17:53.006442] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-30T17:17:53.006484] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-30T17:17:53.006517] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-30T17:17:53.063795] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-30T17:17:53.394665] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:53.429929] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:17:53.603122] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T17:17:53.854438] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-30T17:17:54.356582] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T17:17:54.363922] [INFO ] [REMOTE ] ARW: Full fetch complete (47863 records). [2025-09-30T17:17:54.364031] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-30T17:17:54.659495] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-30T17:17:54.779799] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-30T17:17:54.779892] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-30T17:17:54.780418] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-30T17:17:54.780467] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-30T17:17:54.781594] [DEBUG] [LOCAL ] ARW: Trimmed 47863 records to 33054 (keeping 200 days of data) [2025-09-30T17:17:54.984275] [DEBUG] [LOCAL ] ARW: Primary data saved (33054 records). [2025-09-30T17:17:54.984424] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-30T17:17:54.984509] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 30.6s. Estimated remaining: 4h 22m 32s. Rate: 8.5 symbols/min [2025-09-30T17:17:55.188108] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:55.245310] [DEBUG] [LOCAL ] ASB: Loaded 49512 existing records from primary storage. [2025-09-30T17:17:55.245819] [INFO ] [MAIN ] ASB: Loaded 49512 existing records. [2025-09-30T17:17:55.470794] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-30T17:17:55.477217] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:55.478001] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-30T17:17:55.479161] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-30T17:17:55.488277] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:17:55.491169] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-30T17:17:55.492269] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-30T17:17:55.897405] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:56.145689] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-30T17:17:56.254363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-30T17:17:57.054392] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-30T17:17:57.205312] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:17:57.757839] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:17:57.854361] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-30T17:17:58.654347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-30T17:17:58.828911] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:17:59.454424] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-30T17:17:59.694389] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:18:00.082380] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:18:00.239551] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:18:00.254374] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-30T17:18:01.054434] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-30T17:18:01.094395] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T17:18:01.854381] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-30T17:18:02.573012] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:18:02.654369] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-30T17:18:03.454326] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-30T17:18:03.658037] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:18:03.698386] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:18:04.254387] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-30T17:18:05.054448] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-30T17:18:05.105728] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T17:18:05.274054] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:18:05.854434] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-30T17:18:06.622516] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:18:06.654374] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-30T17:18:07.009322] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:18:07.023547] [INFO ] [REMOTE ] AS: Full fetch complete (76526 records). [2025-09-30T17:18:07.023809] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-30T17:18:07.455101] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-30T17:18:07.498160] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:18:07.504369] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-30T17:18:07.504547] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-30T17:18:07.509576] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-30T17:18:07.509819] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-30T17:18:07.515004] [DEBUG] [LOCAL ] AS: Trimmed 76526 records to 53084 (keeping 200 days of data) [2025-09-30T17:18:07.843398] [DEBUG] [LOCAL ] AS: Primary data saved (53084 records). [2025-09-30T17:18:07.843545] [INFO ] [MAIN ] AS: Full history saved. [2025-09-30T17:18:07.843704] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 33.0s. Estimated remaining: 4h 23m 49s. Rate: 8.4 symbols/min [2025-09-30T17:18:08.026853] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:08.033458] [DEBUG] [LOCAL ] ASBA: Loaded 3427 existing records from primary storage. [2025-09-30T17:18:08.033685] [INFO ] [MAIN ] ASBA: Loaded 3427 existing records. [2025-09-30T17:18:08.217675] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:08.217904] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-30T17:18:08.218003] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-30T17:18:08.218196] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-30T17:18:08.218285] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-30T17:18:08.261861] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-30T17:18:08.607308] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:09.054431] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-30T17:18:09.285916] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:18:09.473465] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T17:18:09.806310] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T17:18:09.854384] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-30T17:18:10.458201] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T17:18:10.654409] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-30T17:18:11.206709] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:18:11.454386] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-30T17:18:12.254363] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-30T17:18:12.640997] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T17:18:13.054330] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-30T17:18:13.178047] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:18:13.854399] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-30T17:18:14.303186] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:18:14.308132] [INFO ] [REMOTE ] ASA: Full fetch complete (18634 records). [2025-09-30T17:18:14.308217] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-30T17:18:14.308738] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:14.308843] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:14.308892] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:14.308976] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-30T17:18:14.309063] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-09-30T17:18:14.309128] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-09-30T17:18:14.309525] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-09-30T17:18:14.309661] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 23.2s. Estimated remaining: 4h 23m 32s. Rate: 8.4 symbols/min [2025-09-30T17:18:14.529844] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:14.530043] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-09-30T17:18:14.530082] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-09-30T17:18:14.530196] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-30T17:18:14.530238] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-30T17:18:14.530280] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-30T17:18:14.530315] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-30T17:18:14.659600] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-30T17:18:14.917320] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:15.220863] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:18:15.382287] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T17:18:15.454375] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-30T17:18:16.254374] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-30T17:18:16.853717] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T17:18:17.054403] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-30T17:18:17.138034] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:18:17.534731] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T17:18:17.854401] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-30T17:18:18.238615] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T17:18:18.654362] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-30T17:18:19.272702] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:18:19.454378] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-30T17:18:20.254363] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-30T17:18:21.032677] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T17:18:21.034117] [INFO ] [REMOTE ] ASBA: Full fetch complete (5293 records). [2025-09-30T17:18:21.034197] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-30T17:18:21.059587] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-30T17:18:21.452136] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-30T17:18:21.452409] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-30T17:18:21.452743] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-30T17:18:21.452872] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-30T17:18:21.453428] [DEBUG] [LOCAL ] ASBA: Trimmed 5293 records to 3450 (keeping 200 days of data) [2025-09-30T17:18:21.475819] [DEBUG] [LOCAL ] ASBA: Primary data saved (3450 records). [2025-09-30T17:18:21.476018] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-30T17:18:21.476127] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASBA took 13.6s. Estimated remaining: 4h 23m 25s. Rate: 8.4 symbols/min [2025-09-30T17:18:21.707044] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:21.709797] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-30T17:18:21.710002] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-09-30T17:18:21.720438] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-09-30T17:18:21.721386] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-30T17:18:21.721468] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-30T17:18:21.721558] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-30T17:18:21.722044] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-30T17:18:21.859500] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-30T17:18:22.145025] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:22.654420] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-30T17:18:22.711361] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:18:23.454410] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-30T17:18:23.874880] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:18:24.254430] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-30T17:18:24.318541] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T17:18:25.054373] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-30T17:18:25.854431] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-30T17:18:25.951490] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-30T17:18:26.654369] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-30T17:18:27.237672] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:18:27.454366] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-30T17:18:27.584406] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-30T17:18:28.254329] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-30T17:18:28.320730] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (4.07 seconds). [2025-09-30T17:18:28.557150] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:18:28.588076] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:18:29.054356] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-30T17:18:29.854334] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-30T17:18:30.035720] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:18:30.047396] [INFO ] [REMOTE ] ASAN: Full fetch complete (76148 records). [2025-09-30T17:18:30.047552] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-30T17:18:30.048433] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:30.048564] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:30.048610] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:30.048700] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-30T17:18:30.048776] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-30T17:18:30.048815] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-09-30T17:18:30.048857] [DEBUG] [LOCAL ] ASAN: No derivative data file found to delete. [2025-09-30T17:18:30.048938] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASAN took 37.2s. Estimated remaining: 4h 23m 39s. Rate: 8.4 symbols/min [2025-09-30T17:18:30.249132] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:30.283554] [DEBUG] [LOCAL ] ASGI: Loaded 22549 existing records from primary storage. [2025-09-30T17:18:30.283912] [INFO ] [MAIN ] ASGI: Loaded 22549 existing records. [2025-09-30T17:18:30.495444] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:30.496254] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-30T17:18:30.496397] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-30T17:18:30.496710] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-30T17:18:30.496796] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-30T17:18:30.662852] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-30T17:18:30.927683] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:18:30.963045] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:31.433397] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:18:31.454354] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-30T17:18:31.989786] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:18:32.254350] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-30T17:18:32.982324] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:18:33.054355] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-30T17:18:33.866387] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-30T17:18:33.889881] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:18:34.246985] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:18:34.654404] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-30T17:18:35.023030] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:18:35.454368] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-30T17:18:35.547263] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T17:18:36.254367] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-30T17:18:37.054371] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-30T17:18:37.854351] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-30T17:18:38.238835] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-30T17:18:38.654382] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-30T17:18:38.994223] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-30T17:18:39.397479] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-30T17:18:39.454327] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-30T17:18:39.522886] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:18:40.169695] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:18:40.254350] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-30T17:18:40.480823] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:18:41.054385] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-30T17:18:41.830189] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T17:18:41.854313] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-30T17:18:42.346600] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T17:18:42.654353] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-30T17:18:43.454336] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-30T17:18:43.647930] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:18:43.658501] [INFO ] [REMOTE ] ASB: Full fetch complete (71240 records). [2025-09-30T17:18:43.658735] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-30T17:18:43.659590] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:43.659704] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:43.659752] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:43.659851] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-30T17:18:43.659935] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-09-30T17:18:43.659983] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-09-30T17:18:43.660293] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-09-30T17:18:43.660955] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 48.7s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-09-30T17:18:43.785355] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:18:43.865982] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:43.914962] [DEBUG] [LOCAL ] ASGN: Loaded 35955 existing records from primary storage. [2025-09-30T17:18:43.915270] [INFO ] [MAIN ] ASGN: Loaded 35955 existing records. [2025-09-30T17:18:44.112806] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:44.113032] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-30T17:18:44.113080] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-30T17:18:44.113527] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-30T17:18:44.113587] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-30T17:18:44.267214] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-30T17:18:44.403749] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T17:18:44.523378] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:45.054408] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-30T17:18:45.854443] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-30T17:18:45.886890] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:18:45.897865] [INFO ] [REMOTE ] ASC: Full fetch complete (56777 records). [2025-09-30T17:18:45.898052] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-30T17:18:46.331368] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-30T17:18:46.331488] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-30T17:18:46.332174] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-30T17:18:46.332242] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-30T17:18:46.333516] [DEBUG] [LOCAL ] ASC: Trimmed 56777 records to 37479 (keeping 200 days of data) [2025-09-30T17:18:46.572913] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:18:46.614932] [DEBUG] [LOCAL ] ASC: Primary data saved (37479 records). [2025-09-30T17:18:46.615108] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-30T17:18:46.615204] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 32.3s. Estimated remaining: 4h 23m 57s. Rate: 8.4 symbols/min [2025-09-30T17:18:46.654394] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-30T17:18:47.024228] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:18:47.454370] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-30T17:18:48.049285] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:18:48.254383] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-30T17:18:48.766484] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:18:49.054403] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-30T17:18:49.613296] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:18:49.854361] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-30T17:18:50.113367] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:18:50.117457] [INFO ] [REMOTE ] ASG: Full fetch complete (31206 records). [2025-09-30T17:18:50.117548] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-30T17:18:50.118087] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:50.118176] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:50.118221] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:50.118285] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-30T17:18:50.118396] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-30T17:18:50.118452] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-30T17:18:50.118496] [DEBUG] [LOCAL ] ASG: No derivative data file found to delete. [2025-09-30T17:18:50.118552] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 28.6s. Estimated remaining: 4h 22m 58s. Rate: 8.4 symbols/min [2025-09-30T17:18:50.654399] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-30T17:18:51.021239] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:18:51.454398] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-30T17:18:51.832454] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:18:52.254365] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-30T17:18:52.928910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:18:53.054574] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-30T17:18:53.384500] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:18:53.854432] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-30T17:18:54.411615] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:18:54.654342] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-30T17:18:54.827199] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:18:55.454415] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-30T17:18:56.017390] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T17:18:56.254388] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-30T17:18:56.570226] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T17:18:57.054389] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-30T17:18:57.563034] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:18:57.732903] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:18:57.854364] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-30T17:18:58.654406] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-30T17:18:59.028379] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:18:59.034811] [INFO ] [REMOTE ] ASGI: Full fetch complete (33625 records). [2025-09-30T17:18:59.034948] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-30T17:18:59.452480] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-30T17:18:59.452571] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-30T17:18:59.453021] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-30T17:18:59.453089] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-30T17:18:59.454097] [DEBUG] [LOCAL ] ASGI: Trimmed 33625 records to 22639 (keeping 200 days of data) [2025-09-30T17:18:59.623918] [DEBUG] [LOCAL ] ASGI: Primary data saved (22639 records). [2025-09-30T17:18:59.624080] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-30T17:18:59.624233] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 29.6s. Estimated remaining: 4h 23m 24s. Rate: 8.4 symbols/min [2025-09-30T17:18:59.858411] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:18:59.867444] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-30T17:19:01.448033] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:19:01.457326] [INFO ] [REMOTE ] ASGN: Full fetch complete (52162 records). [2025-09-30T17:19:01.457555] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-30T17:19:01.884792] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-30T17:19:01.884887] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-30T17:19:01.885484] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-30T17:19:01.885532] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-30T17:19:01.886956] [DEBUG] [LOCAL ] ASGN: Trimmed 52162 records to 35994 (keeping 200 days of data) [2025-09-30T17:19:02.129918] [DEBUG] [LOCAL ] ASGN: Primary data saved (35994 records). [2025-09-30T17:19:02.130301] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-30T17:19:02.130412] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 18.5s. Estimated remaining: 4h 22m 13s. Rate: 8.4 symbols/min [2025-09-30T17:19:02.858288] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.909947] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.917189] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.944629] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.945533] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-30T17:19:02.945759] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-30T17:19:02.945823] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-30T17:19:02.945909] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-30T17:19:02.945947] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-30T17:19:02.945990] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-30T17:19:02.946024] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-30T17:19:02.945630] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-30T17:19:02.954179] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-30T17:19:02.960617] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-30T17:19:02.971463] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-30T17:19:02.971621] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-30T17:19:03.387387] [DEBUG] [LOCAL ] ASH: Loaded 37715 existing records from primary storage. [2025-09-30T17:19:03.542535] [INFO ] [MAIN ] ASH: Loaded 37715 existing records. [2025-09-30T17:19:03.537200] [DEBUG] [LOCAL ] ASPN: Loaded 49585 existing records from primary storage. [2025-09-30T17:19:03.548044] [INFO ] [MAIN ] ASPN: Loaded 49585 existing records. [2025-09-30T17:19:04.028231] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:04.150569] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-30T17:19:04.188614] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:04.203728] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-30T17:19:04.250251] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:04.258093] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:04.258569] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-30T17:19:04.258690] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-30T17:19:04.258454] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-30T17:19:04.258790] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-30T17:19:04.259266] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-30T17:19:04.259337] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-30T17:19:04.264912] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-30T17:19:04.271246] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-30T17:19:05.014497] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:05.039923] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-30T17:19:05.081295] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:05.081845] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-30T17:19:05.136031] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:19:05.138542] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-30T17:19:05.341042] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:19:05.345028] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-30T17:19:05.783264] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:19:05.785476] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-30T17:19:06.130516] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:19:06.135082] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-30T17:19:06.248051] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:19:06.514712] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T17:19:06.654358] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-30T17:19:06.721958] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:19:07.113309] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:19:07.454362] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-30T17:19:08.073397] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T17:19:08.082106] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:19:08.254359] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-30T17:19:09.054354] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-30T17:19:09.512080] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:19:09.854402] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-30T17:19:10.654359] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-30T17:19:10.669155] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:19:10.764845] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:19:11.454383] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-30T17:19:11.751920] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:19:12.254362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-30T17:19:13.054371] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-30T17:19:13.217943] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:19:13.370843] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:19:13.854368] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-30T17:19:14.375044] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:19:14.654384] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-30T17:19:15.216624] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:19:15.454384] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-30T17:19:16.002396] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:19:16.254367] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-30T17:19:17.037080] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:19:17.054320] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-30T17:19:17.221072] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:19:17.854344] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-30T17:19:18.540148] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:19:18.654371] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-30T17:19:19.454363] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-30T17:19:19.611316] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:19:19.879436] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:19:20.254362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-30T17:19:20.608115] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T17:19:21.054346] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-30T17:19:21.182304] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:19:21.854377] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-30T17:19:22.571603] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:19:22.654343] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-30T17:19:22.676806] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:19:23.454355] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-30T17:19:24.059796] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:19:24.084026] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:19:24.254414] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-30T17:19:25.054357] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-30T17:19:25.635896] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:19:25.810488] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T17:19:25.854371] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-30T17:19:26.654381] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-30T17:19:27.454344] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-30T17:19:27.487376] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:19:27.545798] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:19:28.254361] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-30T17:19:29.054327] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-30T17:19:29.176306] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:19:29.184717] [INFO ] [REMOTE ] ASH: Full fetch complete (55000 records). [2025-09-30T17:19:29.184849] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-30T17:19:29.598478] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-30T17:19:29.598604] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-30T17:19:29.599273] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-30T17:19:29.599336] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-30T17:19:29.600496] [DEBUG] [LOCAL ] ASH: Trimmed 55000 records to 37777 (keeping 200 days of data) [2025-09-30T17:19:29.848821] [DEBUG] [LOCAL ] ASH: Primary data saved (37777 records). [2025-09-30T17:19:29.848977] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-30T17:19:29.849069] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASH took 27.7s. Estimated remaining: 4h 26m 49s. Rate: 8.3 symbols/min [2025-09-30T17:19:29.881979] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-30T17:19:30.035233] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:30.070329] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:19:30.124287] [DEBUG] [LOCAL ] ASX: Loaded 52837 existing records from primary storage. [2025-09-30T17:19:30.124625] [INFO ] [MAIN ] ASX: Loaded 52837 existing records. [2025-09-30T17:19:30.336130] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:30.337871] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:19:30.342522] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-30T17:19:30.343058] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-30T17:19:30.343427] [INFO ] [REMOTE ] ASIX: Full fetch complete (30044 records). [2025-09-30T17:19:30.343542] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-30T17:19:30.343670] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-30T17:19:30.343521] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-30T17:19:30.694529] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-30T17:19:31.014173] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:19:31.111836] [INFO ] [REMOTE ] ASR: Full fetch complete (12492 records). [2025-09-30T17:19:31.117866] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:31.149839] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-30T17:19:31.302379] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-30T17:19:31.302841] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-30T17:19:31.308810] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-30T17:19:31.314034] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-30T17:19:31.369043] [DEBUG] [LOCAL ] ASIX: Trimmed 30044 records to 22624 (keeping 200 days of data) [2025-09-30T17:19:31.456028] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-30T17:19:31.706134] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-30T17:19:31.706568] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-30T17:19:31.707725] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-30T17:19:31.708365] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-30T17:19:31.710948] [DEBUG] [LOCAL ] ASR: Trimmed 12492 records to 9385 (keeping 200 days of data) [2025-09-30T17:19:31.795830] [DEBUG] [LOCAL ] ASR: Primary data saved (9385 records). [2025-09-30T17:19:31.797355] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-30T17:19:31.797489] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASR took 29.6s. Estimated remaining: 4h 25m 29s. Rate: 8.3 symbols/min [2025-09-30T17:19:32.006733] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:32.007381] [DEBUG] [LOCAL ] ASIX: Primary data saved (22624 records). [2025-09-30T17:19:32.007692] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-30T17:19:32.008118] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASIX took 29.9s. Estimated remaining: 4h 23m 47s. Rate: 8.4 symbols/min [2025-09-30T17:19:32.194609] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:32.224567] [DEBUG] [LOCAL ] ATEN: Loaded 39679 existing records from primary storage. [2025-09-30T17:19:32.224933] [INFO ] [MAIN ] ATEN: Loaded 39679 existing records. [2025-09-30T17:19:32.417238] [DEBUG] [LOCAL ] ATGE: Loaded 31631 existing records from primary storage. [2025-09-30T17:19:32.441027] [INFO ] [MAIN ] ATGE: Loaded 31631 existing records. [2025-09-30T17:19:32.440787] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:32.485165] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-30T17:19:32.518701] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-30T17:19:32.546859] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-30T17:19:32.547183] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-30T17:19:32.716212] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:32.733013] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-30T17:19:32.748460] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-30T17:19:32.773353] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-30T17:19:32.773473] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-30T17:19:33.083546] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T17:19:33.184188] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-30T17:19:33.371311] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:33.427202] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-30T17:19:33.526298] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:33.560734] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:19:33.854372] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-30T17:19:34.654434] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-30T17:19:35.059715] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:19:35.256140] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T17:19:35.267604] [INFO ] [REMOTE ] ASPN: Full fetch complete (72283 records). [2025-09-30T17:19:35.267821] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-30T17:19:35.455839] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-30T17:19:35.620757] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T17:19:35.733431] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-30T17:19:35.733592] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-30T17:19:35.734350] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-30T17:19:35.734432] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-30T17:19:35.752700] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:19:35.759486] [DEBUG] [LOCAL ] ASPN: Trimmed 72283 records to 49569 (keeping 200 days of data) [2025-09-30T17:19:36.063539] [DEBUG] [LOCAL ] ASPN: Primary data saved (49569 records). [2025-09-30T17:19:36.063763] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-30T17:19:36.063858] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 33.9s. Estimated remaining: 4h 22m 58s. Rate: 8.4 symbols/min [2025-09-30T17:19:36.244079] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:36.261997] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-30T17:19:36.276631] [DEBUG] [LOCAL ] ATHM: Loaded 32365 existing records from primary storage. [2025-09-30T17:19:36.276938] [INFO ] [MAIN ] ATHM: Loaded 32365 existing records. [2025-09-30T17:19:36.462201] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:36.462848] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-30T17:19:36.462903] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-30T17:19:36.463203] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-30T17:19:36.463262] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-30T17:19:36.855432] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:36.952971] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:19:37.054365] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-30T17:19:37.651930] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:19:37.854381] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-30T17:19:38.563233] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:19:38.654332] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-30T17:19:39.307866] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:19:39.454361] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-30T17:19:40.254331] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-30T17:19:40.516916] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T17:19:40.769364] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:19:41.054369] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-30T17:19:41.394031] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:19:41.854357] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-30T17:19:42.654341] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-30T17:19:42.937919] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:19:43.097968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:19:43.454351] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-30T17:19:44.198235] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:19:44.254337] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-30T17:19:45.054429] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-30T17:19:45.243452] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:19:45.854421] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-30T17:19:45.975441] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:19:46.613146] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:19:46.654352] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-30T17:19:47.288018] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:19:47.454384] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-30T17:19:47.767478] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:19:48.254423] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-30T17:19:49.054383] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-30T17:19:49.344254] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T17:19:49.515487] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T17:19:49.854377] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-30T17:19:50.400391] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:19:50.654393] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-30T17:19:51.454358] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-30T17:19:51.555237] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:19:52.132370] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:19:52.254358] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-30T17:19:52.821525] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:19:53.054365] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-30T17:19:53.745560] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:19:53.854416] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-30T17:19:54.530259] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T17:19:54.654328] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-30T17:19:55.107039] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:19:55.454398] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-30T17:19:55.906450] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:19:55.914804] [INFO ] [REMOTE ] ATEN: Full fetch complete (57390 records). [2025-09-30T17:19:55.914976] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-30T17:19:56.259607] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-30T17:19:56.345595] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-30T17:19:56.346065] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-30T17:19:56.346784] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-30T17:19:56.346852] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-30T17:19:56.348173] [DEBUG] [LOCAL ] ATEN: Trimmed 57390 records to 39539 (keeping 200 days of data) [2025-09-30T17:19:56.582144] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T17:19:56.624046] [DEBUG] [LOCAL ] ATEN: Primary data saved (39539 records). [2025-09-30T17:19:56.624201] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-30T17:19:56.624821] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 24.8s. Estimated remaining: 4h 25m 50s. Rate: 8.3 symbols/min [2025-09-30T17:19:56.811174] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:56.821581] [DEBUG] [LOCAL ] ATHS: Loaded 6984 existing records from primary storage. [2025-09-30T17:19:56.821864] [INFO ] [MAIN ] ATHS: Loaded 6984 existing records. [2025-09-30T17:19:57.020032] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:57.020260] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-30T17:19:57.020310] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-30T17:19:57.020675] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-30T17:19:57.020736] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-30T17:19:57.059436] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-30T17:19:57.405042] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:57.854407] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-30T17:19:58.364014] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T17:19:58.378026] [INFO ] [REMOTE ] ASX: Full fetch complete (76591 records). [2025-09-30T17:19:58.378203] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-30T17:19:58.512067] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:19:58.664192] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-30T17:19:58.835665] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-30T17:19:58.835803] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-30T17:19:58.836805] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-30T17:19:58.836878] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-30T17:19:58.844721] [DEBUG] [LOCAL ] ASX: Trimmed 76591 records to 52849 (keeping 200 days of data) [2025-09-30T17:19:59.175689] [DEBUG] [LOCAL ] ASX: Primary data saved (52849 records). [2025-09-30T17:19:59.175834] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-30T17:19:59.175979] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 29.3s. Estimated remaining: 4h 24m 41s. Rate: 8.3 symbols/min [2025-09-30T17:19:59.373724] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:59.400369] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:19:59.460776] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T17:19:59.460898] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-30T17:19:59.467765] [DEBUG] [LOCAL ] ATI: Loaded 51503 existing records from primary storage. [2025-09-30T17:19:59.468192] [INFO ] [MAIN ] ATI: Loaded 51503 existing records. [2025-09-30T17:19:59.659838] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:59.660199] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-30T17:19:59.660266] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-30T17:19:59.661562] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-30T17:19:59.661630] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-30T17:20:00.038928] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:00.254372] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-30T17:20:01.054327] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-30T17:20:01.166725] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:20:01.854381] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-30T17:20:02.202193] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T17:20:02.303117] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T17:20:02.455259] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:20:02.461740] [INFO ] [REMOTE ] ATGE: Full fetch complete (46229 records). [2025-09-30T17:20:02.461982] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-30T17:20:02.660865] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-30T17:20:02.886561] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-30T17:20:02.886887] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-30T17:20:02.887418] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-30T17:20:02.887466] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-30T17:20:02.888962] [DEBUG] [LOCAL ] ATGE: Trimmed 46229 records to 31544 (keeping 200 days of data) [2025-09-30T17:20:03.102127] [DEBUG] [LOCAL ] ATGE: Primary data saved (31544 records). [2025-09-30T17:20:03.102278] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-30T17:20:03.102366] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 31.1s. Estimated remaining: 4h 23m 51s. Rate: 8.4 symbols/min [2025-09-30T17:20:03.213917] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:20:03.300248] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:03.335846] [DEBUG] [LOCAL ] ATKR: Loaded 35560 existing records from primary storage. [2025-09-30T17:20:03.336167] [INFO ] [MAIN ] ATKR: Loaded 35560 existing records. [2025-09-30T17:20:03.455504] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-30T17:20:03.594615] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:03.594909] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-30T17:20:03.594961] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-30T17:20:03.595320] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-30T17:20:03.595382] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-30T17:20:04.002506] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:04.254388] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-30T17:20:05.054359] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-30T17:20:05.293792] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:20:05.732757] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:20:05.834567] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:20:05.854311] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-30T17:20:06.579700] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T17:20:06.654367] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-30T17:20:07.454384] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-30T17:20:08.254360] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-30T17:20:08.340519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:20:08.943937] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:20:09.054397] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-30T17:20:09.854389] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-30T17:20:09.928098] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:20:10.160561] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:20:10.608570] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:20:10.654415] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-30T17:20:11.454385] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-30T17:20:12.254335] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-30T17:20:12.615734] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:20:12.706270] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:20:13.054359] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-30T17:20:13.178444] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:20:13.854423] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-30T17:20:14.562540] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:20:14.654371] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-30T17:20:15.036335] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:20:15.454397] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-30T17:20:16.034784] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T17:20:16.246570] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:20:16.255057] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-30T17:20:17.054424] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-30T17:20:17.724747] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:20:17.854400] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-30T17:20:17.905393] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:20:18.654433] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-30T17:20:18.875035] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:20:19.381553] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T17:20:19.383434] [INFO ] [REMOTE ] ATHS: Full fetch complete (10053 records). [2025-09-30T17:20:19.383571] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-30T17:20:19.462254] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-30T17:20:19.809224] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-30T17:20:19.809392] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-30T17:20:19.809729] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-30T17:20:19.809794] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-30T17:20:19.810276] [DEBUG] [LOCAL ] ATHS: Trimmed 10053 records to 6995 (keeping 200 days of data) [2025-09-30T17:20:19.856274] [DEBUG] [LOCAL ] ATHS: Primary data saved (6995 records). [2025-09-30T17:20:19.856412] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-30T17:20:19.856539] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHS took 23.2s. Estimated remaining: 4h 25m 49s. Rate: 8.3 symbols/min [2025-09-30T17:20:20.040527] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:20.091403] [DEBUG] [LOCAL ] ATMU: Loaded 39533 existing records from primary storage. [2025-09-30T17:20:20.091803] [INFO ] [MAIN ] ATMU: Loaded 39533 existing records. [2025-09-30T17:20:20.259745] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-30T17:20:20.287414] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:20.288912] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-30T17:20:20.289064] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-30T17:20:20.289701] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-30T17:20:20.289798] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-30T17:20:20.692348] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:21.054367] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-30T17:20:21.120882] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:20:21.764487] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:20:21.770072] [INFO ] [REMOTE ] ATHM: Full fetch complete (51168 records). [2025-09-30T17:20:21.770189] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-30T17:20:21.770871] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:20:21.770960] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:20:21.771005] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:20:21.771049] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-30T17:20:21.771146] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-09-30T17:20:21.771204] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-09-30T17:20:21.771904] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-09-30T17:20:21.777842] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHM took 45.7s. Estimated remaining: 4h 24m 32s. Rate: 8.3 symbols/min [2025-09-30T17:20:21.859522] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-30T17:20:21.997053] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:22.064232] [DEBUG] [LOCAL ] ATO: Loaded 41864 existing records from primary storage. [2025-09-30T17:20:22.064677] [INFO ] [MAIN ] ATO: Loaded 41864 existing records. [2025-09-30T17:20:22.288407] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:22.288747] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-30T17:20:22.288805] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-30T17:20:22.289225] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-30T17:20:22.289332] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-30T17:20:22.655789] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-30T17:20:22.697955] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:22.723335] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:20:23.454355] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-30T17:20:23.512133] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:20:24.254374] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-30T17:20:24.310704] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:20:24.401329] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:20:25.054359] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-30T17:20:25.735798] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:20:25.854361] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-30T17:20:26.505718] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:20:26.654396] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-30T17:20:27.395235] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:20:27.454364] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-30T17:20:27.529802] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:20:28.254368] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-30T17:20:29.054359] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-30T17:20:29.437661] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T17:20:29.471569] [INFO ] [REMOTE ] ATI: Full fetch complete (73937 records). [2025-09-30T17:20:29.472260] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-30T17:20:29.473317] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:20:29.862225] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-30T17:20:29.916130] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-30T17:20:29.916223] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-30T17:20:29.917056] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-30T17:20:29.917136] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-30T17:20:29.923707] [DEBUG] [LOCAL ] ATI: Trimmed 73937 records to 51513 (keeping 200 days of data) [2025-09-30T17:20:30.245301] [DEBUG] [LOCAL ] ATI: Primary data saved (51513 records). [2025-09-30T17:20:30.245458] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-30T17:20:30.245544] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 31.1s. Estimated remaining: 4h 24m 41s. Rate: 8.3 symbols/min [2025-09-30T17:20:30.430493] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:30.465804] [DEBUG] [LOCAL ] ATR: Loaded 30406 existing records from primary storage. [2025-09-30T17:20:30.466078] [INFO ] [MAIN ] ATR: Loaded 30406 existing records. [2025-09-30T17:20:30.656771] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-30T17:20:30.698202] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:30.721775] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-30T17:20:30.722230] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-30T17:20:30.723585] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-30T17:20:30.723517] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:20:30.732332] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-30T17:20:31.138939] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:31.166504] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:20:31.454356] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-30T17:20:32.081149] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:20:32.254390] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-30T17:20:32.532249] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T17:20:33.054403] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-30T17:20:33.785049] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T17:20:33.854380] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-30T17:20:34.406747] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:20:34.654393] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-30T17:20:35.460080] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-30T17:20:35.465410] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:20:35.474593] [INFO ] [REMOTE ] ATKR: Full fetch complete (53770 records). [2025-09-30T17:20:35.474801] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-30T17:20:35.906347] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-30T17:20:35.906465] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-30T17:20:35.907154] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-30T17:20:35.907239] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-30T17:20:35.908566] [DEBUG] [LOCAL ] ATKR: Trimmed 53770 records to 35629 (keeping 200 days of data) [2025-09-30T17:20:36.069259] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T17:20:36.176938] [DEBUG] [LOCAL ] ATKR: Primary data saved (35629 records). [2025-09-30T17:20:36.177088] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-30T17:20:36.177211] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 33.1s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-09-30T17:20:36.259517] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-30T17:20:36.362138] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:36.381351] [DEBUG] [LOCAL ] ATS: Loaded 17851 existing records from primary storage. [2025-09-30T17:20:36.381597] [INFO ] [MAIN ] ATS: Loaded 17851 existing records. [2025-09-30T17:20:36.570084] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:36.570358] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-30T17:20:36.570407] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-30T17:20:36.570733] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-30T17:20:36.570797] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-30T17:20:36.971883] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:36.998942] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:20:37.054395] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-30T17:20:37.854381] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-30T17:20:37.913714] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:20:38.012270] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T17:20:38.654437] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-30T17:20:39.228422] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T17:20:39.454397] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-30T17:20:40.000154] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:20:40.254317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-30T17:20:40.718093] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:20:41.054377] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-30T17:20:41.614744] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:20:41.854386] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-30T17:20:42.654326] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-30T17:20:42.739602] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:20:43.189568] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:20:43.454393] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-30T17:20:43.680506] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:20:44.254375] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-30T17:20:44.912120] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T17:20:45.054368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-30T17:20:45.843840] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:20:45.854296] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-30T17:20:46.172858] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:20:46.654399] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-30T17:20:47.398895] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:20:47.454359] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-30T17:20:48.071322] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:20:48.254357] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-30T17:20:48.285089] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T17:20:49.054378] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-30T17:20:49.300226] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:20:49.854400] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-30T17:20:50.654342] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-30T17:20:50.688772] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:20:50.699586] [INFO ] [REMOTE ] ATMU: Full fetch complete (56839 records). [2025-09-30T17:20:50.699795] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-30T17:20:51.142549] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-30T17:20:51.142706] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-30T17:20:51.143727] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-30T17:20:51.143980] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-30T17:20:51.146058] [DEBUG] [LOCAL ] ATMU: Trimmed 56839 records to 39448 (keeping 200 days of data) [2025-09-30T17:20:51.443531] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:20:51.454854] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-30T17:20:51.474072] [DEBUG] [LOCAL ] ATMU: Primary data saved (39448 records). [2025-09-30T17:20:51.474240] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-30T17:20:51.475362] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 31.6s. Estimated remaining: 4h 25m 54s. Rate: 8.3 symbols/min [2025-09-30T17:20:51.701622] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:51.763316] [DEBUG] [LOCAL ] ATUS: Loaded 49225 existing records from primary storage. [2025-09-30T17:20:51.764059] [INFO ] [MAIN ] ATUS: Loaded 49225 existing records. [2025-09-30T17:20:51.971877] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:51.972235] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-30T17:20:51.972360] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-30T17:20:51.980034] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-30T17:20:51.991776] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-30T17:20:52.030557] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:20:52.254760] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-30T17:20:52.418305] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:52.572823] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:20:53.054379] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-30T17:20:53.463735] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:20:53.842300] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T17:20:53.854304] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-30T17:20:54.654361] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-30T17:20:54.785016] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T17:20:55.454410] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-30T17:20:56.094240] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:20:56.254402] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-30T17:20:57.054390] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-30T17:20:57.214146] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:20:57.823534] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:20:57.854418] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-30T17:20:58.098496] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T17:20:58.105386] [INFO ] [REMOTE ] ATR: Full fetch complete (43460 records). [2025-09-30T17:20:58.105538] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-30T17:20:58.529862] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-30T17:20:58.529948] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-30T17:20:58.530505] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-30T17:20:58.530572] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-30T17:20:58.531824] [DEBUG] [LOCAL ] ATR: Trimmed 43460 records to 30427 (keeping 200 days of data) [2025-09-30T17:20:58.654524] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-30T17:20:58.744137] [DEBUG] [LOCAL ] ATR: Primary data saved (30427 records). [2025-09-30T17:20:58.744306] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-30T17:20:58.744396] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATR took 28.5s. Estimated remaining: 4h 25m 47s. Rate: 8.3 symbols/min [2025-09-30T17:20:58.936221] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:58.991467] [DEBUG] [LOCAL ] AU: Loaded 52987 existing records from primary storage. [2025-09-30T17:20:58.991893] [INFO ] [MAIN ] AU: Loaded 52987 existing records. [2025-09-30T17:20:59.203380] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:59.203595] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-30T17:20:59.203667] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-30T17:20:59.204301] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-30T17:20:59.204377] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-30T17:20:59.458787] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-30T17:20:59.631305] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:59.658535] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:20:59.668054] [INFO ] [REMOTE ] ATO: Full fetch complete (60494 records). [2025-09-30T17:20:59.668281] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-30T17:20:59.935542] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T17:21:00.121479] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-30T17:21:00.121562] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-30T17:21:00.122390] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-30T17:21:00.122463] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-30T17:21:00.123846] [DEBUG] [LOCAL ] ATO: Trimmed 60494 records to 41879 (keeping 200 days of data) [2025-09-30T17:21:00.254431] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-30T17:21:00.428907] [DEBUG] [LOCAL ] ATO: Primary data saved (41879 records). [2025-09-30T17:21:00.429238] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-30T17:21:00.430872] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATO took 38.7s. Estimated remaining: 4h 24m 29s. Rate: 8.3 symbols/min [2025-09-30T17:21:00.671756] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:00.731958] [DEBUG] [LOCAL ] AUB: Loaded 46313 existing records from primary storage. [2025-09-30T17:21:00.732308] [INFO ] [MAIN ] AUB: Loaded 46313 existing records. [2025-09-30T17:21:00.967125] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:00.967562] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-30T17:21:00.967761] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-30T17:21:00.977337] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-30T17:21:00.997314] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-30T17:21:01.048324] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:21:01.085938] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-30T17:21:01.468220] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:01.835143] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:21:01.854325] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-30T17:21:02.101429] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:21:02.654385] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-30T17:21:03.280404] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:21:03.454368] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-30T17:21:03.705531] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T17:21:03.709612] [INFO ] [REMOTE ] ATS: Full fetch complete (25626 records). [2025-09-30T17:21:03.709777] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-30T17:21:04.136527] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-30T17:21:04.136618] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-30T17:21:04.137051] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-30T17:21:04.137116] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-30T17:21:04.138489] [DEBUG] [LOCAL ] ATS: Trimmed 25626 records to 17824 (keeping 200 days of data) [2025-09-30T17:21:04.248856] [DEBUG] [LOCAL ] ATS: Primary data saved (17824 records). [2025-09-30T17:21:04.249005] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-30T17:21:04.249092] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 28.1s. Estimated remaining: 4h 23m 39s. Rate: 8.3 symbols/min [2025-09-30T17:21:04.260964] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-30T17:21:04.452576] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:04.461835] [DEBUG] [LOCAL ] AUNA: Loaded 4872 existing records from primary storage. [2025-09-30T17:21:04.462097] [INFO ] [MAIN ] AUNA: Loaded 4872 existing records. [2025-09-30T17:21:04.679530] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:04.679837] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-30T17:21:04.679972] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-30T17:21:04.680378] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-30T17:21:04.680437] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-30T17:21:05.080933] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:05.073958] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-30T17:21:05.109691] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:21:05.465469] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:21:05.854388] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-30T17:21:06.654357] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-30T17:21:06.951058] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T17:21:07.011852] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:21:07.454388] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-30T17:21:08.254360] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-30T17:21:08.461325] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:21:08.899133] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T17:21:08.951750] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:21:09.054376] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-30T17:21:09.854379] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-30T17:21:10.535663] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T17:21:10.654376] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-30T17:21:10.752363] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:21:11.093592] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:21:11.454365] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-30T17:21:12.254364] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-30T17:21:12.659045] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T17:21:12.905124] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:21:13.054356] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-30T17:21:13.854376] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-30T17:21:14.654386] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-30T17:21:14.803946] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:21:15.199846] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:21:15.454398] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-30T17:21:15.528103] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:21:16.254387] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-30T17:21:17.047218] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:21:17.057204] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-30T17:21:17.854401] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-30T17:21:18.137470] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T17:21:18.654332] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-30T17:21:18.695150] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T17:21:19.454355] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-30T17:21:19.575241] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T17:21:19.640613] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:21:19.652978] [INFO ] [REMOTE ] ATUS: Full fetch complete (70922 records). [2025-09-30T17:21:19.653165] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-30T17:21:20.183020] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-30T17:21:20.183105] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-30T17:21:20.183813] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-30T17:21:20.183882] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-30T17:21:20.185421] [DEBUG] [LOCAL ] ATUS: Trimmed 70922 records to 49257 (keeping 200 days of data) [2025-09-30T17:21:20.276238] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-30T17:21:20.501381] [DEBUG] [LOCAL ] ATUS: Primary data saved (49257 records). [2025-09-30T17:21:20.501551] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-30T17:21:20.502137] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 29.0s. Estimated remaining: 4h 25m 25s. Rate: 8.3 symbols/min [2025-09-30T17:21:20.715968] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:20.759930] [DEBUG] [LOCAL ] AVA: Loaded 39461 existing records from primary storage. [2025-09-30T17:21:20.760256] [INFO ] [MAIN ] AVA: Loaded 39461 existing records. [2025-09-30T17:21:20.965952] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:20.967144] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-30T17:21:20.967306] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-30T17:21:20.967784] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-30T17:21:20.967882] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-30T17:21:21.055404] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-30T17:21:21.130076] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:21:21.132214] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:21:21.427754] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:21.854376] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-30T17:21:22.654403] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-30T17:21:22.931229] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:21:23.454357] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-30T17:21:23.708891] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:21:23.910020] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:21:24.254386] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-30T17:21:25.054366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-30T17:21:25.545857] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T17:21:25.854325] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-30T17:21:26.026543] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:21:26.150401] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:21:26.654404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-30T17:21:27.454353] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-30T17:21:27.900184] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T17:21:28.254374] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-30T17:21:28.314924] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:21:28.380944] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:21:29.054408] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-30T17:21:29.854404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-30T17:21:30.306342] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T17:21:30.381762] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:21:30.654413] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-30T17:21:31.311029] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:21:31.320458] [INFO ] [REMOTE ] AUB: Full fetch complete (65651 records). [2025-09-30T17:21:31.320596] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-30T17:21:31.468132] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-30T17:21:31.751920] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-30T17:21:31.752021] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-30T17:21:31.752726] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-30T17:21:31.752796] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-30T17:21:31.754704] [DEBUG] [LOCAL ] AUB: Trimmed 65651 records to 46327 (keeping 200 days of data) [2025-09-30T17:21:32.068256] [DEBUG] [LOCAL ] AUB: Primary data saved (46327 records). [2025-09-30T17:21:32.071815] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-30T17:21:32.073009] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 31.6s. Estimated remaining: 4h 26m 11s. Rate: 8.2 symbols/min [2025-09-30T17:21:32.211897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:21:32.259492] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-30T17:21:32.312282] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:32.324956] [DEBUG] [LOCAL ] AVAL: Loaded 8780 existing records from primary storage. [2025-09-30T17:21:32.325307] [INFO ] [MAIN ] AVAL: Loaded 8780 existing records. [2025-09-30T17:21:32.536891] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:32.537146] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-30T17:21:32.537223] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-30T17:21:32.537512] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-30T17:21:32.537577] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-30T17:21:32.960528] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:33.054396] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-30T17:21:33.117524] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:21:33.677135] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:21:33.854401] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-30T17:21:34.581887] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:21:34.654335] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-30T17:21:35.454338] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-30T17:21:35.811273] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T17:21:36.010405] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T17:21:36.089858] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T17:21:36.254380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-30T17:21:36.992110] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T17:21:37.054391] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-30T17:21:37.854417] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-30T17:21:38.580406] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:21:38.654364] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-30T17:21:38.665400] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:21:39.454364] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-30T17:21:39.804807] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T17:21:40.254371] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-30T17:21:40.369823] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:21:40.371926] [INFO ] [REMOTE ] AUNA: Full fetch complete (7750 records). [2025-09-30T17:21:40.372002] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-30T17:21:40.769974] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-30T17:21:40.770055] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-30T17:21:40.770249] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-30T17:21:40.770289] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-30T17:21:40.770733] [DEBUG] [LOCAL ] AUNA: Trimmed 7750 records to 4917 (keeping 200 days of data) [2025-09-30T17:21:40.798809] [DEBUG] [LOCAL ] AUNA: Primary data saved (4917 records). [2025-09-30T17:21:40.798920] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-30T17:21:40.799003] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 36.5s. Estimated remaining: 4h 26m 22s. Rate: 8.2 symbols/min [2025-09-30T17:21:40.976907] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:41.027870] [DEBUG] [LOCAL ] AVB: Loaded 41892 existing records from primary storage. [2025-09-30T17:21:41.028316] [INFO ] [MAIN ] AVB: Loaded 41892 existing records. [2025-09-30T17:21:41.059572] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-30T17:21:41.238419] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:41.238692] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-30T17:21:41.238774] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-30T17:21:41.239119] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-30T17:21:41.239180] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-30T17:21:41.638089] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:41.854404] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-30T17:21:42.308982] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:21:42.320879] [INFO ] [REMOTE ] AU: Full fetch complete (76276 records). [2025-09-30T17:21:42.321055] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-30T17:21:42.654472] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-30T17:21:42.775350] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-30T17:21:42.775562] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-30T17:21:42.776685] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-30T17:21:42.776774] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-30T17:21:42.778683] [DEBUG] [LOCAL ] AU: Trimmed 76276 records to 52991 (keeping 200 days of data) [2025-09-30T17:21:42.909685] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T17:21:42.927333] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:21:42.939037] [INFO ] [REMOTE ] AVA: Full fetch complete (55721 records). [2025-09-30T17:21:42.939735] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-30T17:21:43.452479] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-30T17:21:43.452586] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-30T17:21:43.453336] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-30T17:21:43.508616] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-30T17:21:43.508818] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-30T17:21:43.558666] [DEBUG] [LOCAL ] AVA: Trimmed 55721 records to 39426 (keeping 200 days of data) [2025-09-30T17:21:43.920448] [DEBUG] [LOCAL ] AVA: Primary data saved (39426 records). [2025-09-30T17:21:43.920864] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-30T17:21:43.921809] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AVA took 23.4s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-09-30T17:21:44.132528] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:44.133324] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-30T17:21:44.139685] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-30T17:21:44.140306] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-30T17:21:44.145999] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-30T17:21:44.156110] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-30T17:21:44.160802] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-30T17:21:44.177864] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:21:44.271689] [DEBUG] [LOCAL ] AU: Primary data saved (52991 records). [2025-09-30T17:21:44.266125] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-30T17:21:44.300944] [INFO ] [MAIN ] AU: Full history saved. [2025-09-30T17:21:44.301308] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AU took 45.6s. Estimated remaining: 4h 23m 52s. Rate: 8.3 symbols/min [2025-09-30T17:21:44.625125] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:21:44.744316] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:44.829711] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:44.848047] [DEBUG] [LOCAL ] AVD: Loaded 22711 existing records from primary storage. [2025-09-30T17:21:44.848445] [INFO ] [MAIN ] AVD: Loaded 22711 existing records. [2025-09-30T17:21:45.045194] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:45.045530] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-30T17:21:45.045592] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-30T17:21:45.045925] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-30T17:21:45.045988] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-30T17:21:45.054405] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-30T17:21:45.437447] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:45.451927] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:21:45.452316] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-30T17:21:45.452410] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:21:45.452492] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-30T17:21:45.452565] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:21:45.452660] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-30T17:21:45.452772] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-30T17:21:45.452867] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-30T17:21:45.452937] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-30T17:21:45.453049] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 22m 32s. Rate: 8.3 symbols/min [2025-09-30T17:21:45.649611] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:45.674589] [DEBUG] [LOCAL ] AVK: Loaded 17863 existing records from primary storage. [2025-09-30T17:21:45.674913] [INFO ] [MAIN ] AVK: Loaded 17863 existing records. [2025-09-30T17:21:45.854361] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-30T17:21:45.883906] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:45.884389] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-30T17:21:45.884462] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-30T17:21:45.892567] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-30T17:21:45.906398] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-30T17:21:45.913480] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:21:46.348868] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:46.654381] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-30T17:21:47.408063] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:21:47.454373] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-30T17:21:47.791474] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:21:48.254456] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-30T17:21:48.320496] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T17:21:49.054446] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-30T17:21:49.356606] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:21:49.854381] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-30T17:21:49.928377] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:21:50.654363] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-30T17:21:50.725214] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:21:51.390760] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T17:21:51.454355] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-30T17:21:52.254379] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-30T17:21:52.285183] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:21:53.054406] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-30T17:21:53.811776] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T17:21:53.854767] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-30T17:21:53.858086] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:21:54.654525] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-30T17:21:54.777438] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:21:55.454386] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-30T17:21:56.254416] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-30T17:21:56.379927] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:21:56.381360] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T17:21:57.054368] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-30T17:21:57.098267] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:21:57.854408] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-30T17:21:58.504789] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:21:58.654502] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-30T17:21:58.896552] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:21:59.454349] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-30T17:21:59.720583] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-30T17:22:00.254381] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-30T17:22:00.890966] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:01.061271] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-30T17:22:01.067839] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:22:01.854383] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-30T17:22:01.922304] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:22:02.654380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-30T17:22:02.947483] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:22:03.353882] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:22:03.355884] [INFO ] [REMOTE ] AVAL: Full fetch complete (14619 records). [2025-09-30T17:22:03.356021] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-30T17:22:03.459503] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-30T17:22:03.772208] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-30T17:22:03.772338] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-30T17:22:03.773494] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-30T17:22:03.773580] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-30T17:22:03.774504] [DEBUG] [LOCAL ] AVAL: Trimmed 14619 records to 8759 (keeping 200 days of data) [2025-09-30T17:22:03.834864] [DEBUG] [LOCAL ] AVAL: Primary data saved (8759 records). [2025-09-30T17:22:03.835005] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-30T17:22:03.835166] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 31.8s. Estimated remaining: 4h 24m 39s. Rate: 8.3 symbols/min [2025-09-30T17:22:04.026443] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:04.076293] [DEBUG] [LOCAL ] AVNS: Loaded 33542 existing records from primary storage. [2025-09-30T17:22:04.076664] [INFO ] [MAIN ] AVNS: Loaded 33542 existing records. [2025-09-30T17:22:04.266582] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-30T17:22:04.272998] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:04.274393] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-30T17:22:04.274446] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-30T17:22:04.274889] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-30T17:22:04.274978] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-30T17:22:04.655008] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:22:04.732177] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:05.054383] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-30T17:22:05.770119] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:22:05.854387] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-30T17:22:06.149247] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T17:22:06.654371] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-30T17:22:07.223783] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:22:07.455089] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-30T17:22:07.457819] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T17:22:08.254401] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-30T17:22:08.849812] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:22:09.054339] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-30T17:22:09.094967] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:22:09.854407] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-30T17:22:10.110414] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:22:10.654401] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-30T17:22:11.269248] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:22:11.454355] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-30T17:22:12.254404] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-30T17:22:12.503171] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T17:22:13.055838] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-30T17:22:13.062454] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T17:22:13.299747] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T17:22:13.854376] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-30T17:22:14.236948] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:22:14.241683] [INFO ] [REMOTE ] AVK: Full fetch complete (26601 records). [2025-09-30T17:22:14.241830] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-30T17:22:14.666257] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-30T17:22:14.746074] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-30T17:22:14.746182] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-30T17:22:14.746787] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-30T17:22:14.746872] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-30T17:22:14.748197] [DEBUG] [LOCAL ] AVK: Trimmed 26601 records to 17882 (keeping 200 days of data) [2025-09-30T17:22:14.867109] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:22:14.873945] [INFO ] [REMOTE ] AVD: Full fetch complete (33734 records). [2025-09-30T17:22:14.874555] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-30T17:22:15.311807] [DEBUG] [LOCAL ] AVK: Primary data saved (17882 records). [2025-09-30T17:22:15.348171] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-30T17:22:15.348295] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-30T17:22:15.347977] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-30T17:22:15.348490] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVK took 29.9s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-09-30T17:22:15.349317] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-30T17:22:15.349633] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-30T17:22:15.442485] [DEBUG] [LOCAL ] AVD: Trimmed 33734 records to 22636 (keeping 200 days of data) [2025-09-30T17:22:15.455287] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-30T17:22:15.635953] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:15.637828] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-09-30T17:22:15.637901] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-09-30T17:22:15.641127] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-30T17:22:15.652725] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-30T17:22:15.660668] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-30T17:22:15.668091] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-30T17:22:15.773210] [DEBUG] [LOCAL ] AVD: Primary data saved (22636 records). [2025-09-30T17:22:15.794878] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-30T17:22:15.798751] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 31.5s. Estimated remaining: 4h 23m 54s. Rate: 8.3 symbols/min [2025-09-30T17:22:16.180926] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:16.204112] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-09-30T17:22:16.209360] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-09-30T17:22:16.221471] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-30T17:22:16.236286] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-30T17:22:16.250852] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-30T17:22:16.256142] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-30T17:22:16.513310] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:16.551338] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-30T17:22:16.809841] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:16.837178] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:22:16.847320] [INFO ] [REMOTE ] AVB: Full fetch complete (58229 records). [2025-09-30T17:22:16.847477] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-30T17:22:16.848199] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:22:16.848304] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:22:16.848375] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:22:16.848440] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-30T17:22:16.848502] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-09-30T17:22:16.848539] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-09-30T17:22:16.849062] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-09-30T17:22:16.849178] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVB took 36.1s. Estimated remaining: 4h 22m 34s. Rate: 8.3 symbols/min [2025-09-30T17:22:17.034817] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:22:17.072940] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-30T17:22:17.077350] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:17.136615] [DEBUG] [LOCAL ] AVY: Loaded 37420 existing records from primary storage. [2025-09-30T17:22:17.136988] [INFO ] [MAIN ] AVY: Loaded 37420 existing records. [2025-09-30T17:22:17.345924] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:17.346158] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-30T17:22:17.346206] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-30T17:22:17.346592] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-30T17:22:17.346690] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-30T17:22:17.758820] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:17.783468] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:22:17.854391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-30T17:22:18.644815] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:22:18.656050] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-30T17:22:19.344195] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:22:19.454388] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-30T17:22:20.117746] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:22:20.254363] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-30T17:22:20.976288] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:22:21.054366] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-30T17:22:21.181281] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:22:21.854367] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-30T17:22:22.654363] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-30T17:22:22.858952] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:22:23.449175] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:22:23.458566] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-30T17:22:24.033294] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T17:22:24.254403] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-30T17:22:25.054357] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-30T17:22:25.103617] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:22:25.726152] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:22:25.854388] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-30T17:22:26.314863] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:22:26.654379] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-30T17:22:27.454380] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-30T17:22:27.668337] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:22:28.254391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-30T17:22:28.481442] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:22:28.514141] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T17:22:29.054406] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-30T17:22:29.837591] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:22:29.854315] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-30T17:22:30.654411] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-30T17:22:30.811241] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:22:31.047476] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:22:31.454386] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-30T17:22:32.144729] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T17:22:32.254422] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-30T17:22:32.980301] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:22:33.054399] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-30T17:22:33.679977] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:22:33.854374] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-30T17:22:34.654369] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-30T17:22:34.699209] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:22:35.298332] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:35.454432] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-30T17:22:36.254341] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-30T17:22:36.666420] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:22:36.968758] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:22:37.054405] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-30T17:22:37.672153] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:22:37.679832] [INFO ] [REMOTE ] AVNS: Full fetch complete (48196 records). [2025-09-30T17:22:37.679966] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-30T17:22:37.857114] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-30T17:22:38.095795] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-30T17:22:38.095917] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-30T17:22:38.096608] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-30T17:22:38.096742] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-30T17:22:38.098581] [DEBUG] [LOCAL ] AVNS: Trimmed 48196 records to 33665 (keeping 200 days of data) [2025-09-30T17:22:38.227363] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T17:22:38.356529] [DEBUG] [LOCAL ] AVNS: Primary data saved (33665 records). [2025-09-30T17:22:38.356708] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-30T17:22:38.356804] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 34.5s. Estimated remaining: 4h 25m 15s. Rate: 8.2 symbols/min [2025-09-30T17:22:38.541396] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:38.568184] [DEBUG] [LOCAL ] AWF: Loaded 24244 existing records from primary storage. [2025-09-30T17:22:38.568515] [INFO ] [MAIN ] AWF: Loaded 24244 existing records. [2025-09-30T17:22:38.659758] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-30T17:22:38.782332] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:38.782701] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-30T17:22:38.782762] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-30T17:22:38.783495] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-30T17:22:38.783559] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-30T17:22:39.218179] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:39.241846] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:22:39.454368] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-30T17:22:40.098020] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:40.254324] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-30T17:22:40.685831] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:22:40.697279] [INFO ] [REMOTE ] AVNT: Full fetch complete (56273 records). [2025-09-30T17:22:40.697422] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-30T17:22:41.059446] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-30T17:22:41.135130] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-30T17:22:41.135213] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-30T17:22:41.135904] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-30T17:22:41.135970] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-30T17:22:41.137261] [DEBUG] [LOCAL ] AVNT: Trimmed 56273 records to 39241 (keeping 200 days of data) [2025-09-30T17:22:41.414293] [DEBUG] [LOCAL ] AVNT: Primary data saved (39241 records). [2025-09-30T17:22:41.414451] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-30T17:22:41.414534] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 26.1s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-09-30T17:22:41.635739] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:41.635995] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-09-30T17:22:41.636072] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-09-30T17:22:41.636234] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-30T17:22:41.636297] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-30T17:22:41.636368] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-30T17:22:41.636425] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-30T17:22:41.875735] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-30T17:22:42.233771] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:22:42.234933] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T17:22:42.373733] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:42.654417] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-30T17:22:43.454397] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-30T17:22:43.588976] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:22:43.829726] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T17:22:44.254368] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-30T17:22:44.866489] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:22:45.054405] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-30T17:22:45.644459] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T17:22:45.854324] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-30T17:22:46.195016] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:22:46.654387] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-30T17:22:47.454367] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-30T17:22:47.667908] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T17:22:47.676987] [INFO ] [REMOTE ] AVY: Full fetch complete (56223 records). [2025-09-30T17:22:47.677140] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-30T17:22:48.099952] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-30T17:22:48.100168] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-30T17:22:48.101016] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-30T17:22:48.101094] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-30T17:22:48.102451] [DEBUG] [LOCAL ] AVY: Trimmed 56223 records to 37441 (keeping 200 days of data) [2025-09-30T17:22:48.294316] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-30T17:22:48.385213] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:22:48.401563] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-09-30T17:22:48.403805] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-30T17:22:48.534696] [DEBUG] [LOCAL ] AVY: Primary data saved (37441 records). [2025-09-30T17:22:48.571292] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-30T17:22:48.593497] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVY took 31.7s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-09-30T17:22:49.063997] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-30T17:22:49.087094] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:49.085340] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-30T17:22:49.088424] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-30T17:22:49.088634] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-30T17:22:49.083366] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:22:49.097910] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-30T17:22:49.099988] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 53562 (keeping 200 days of data) [2025-09-30T17:22:49.263177] [DEBUG] [LOCAL ] AWK: Loaded 48718 existing records from primary storage. [2025-09-30T17:22:49.264510] [INFO ] [MAIN ] AWK: Loaded 48718 existing records. [2025-09-30T17:22:49.482976] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:49.486307] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-30T17:22:49.486717] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-30T17:22:49.492465] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-30T17:22:49.560262] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-30T17:22:49.561225] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:22:49.860452] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-30T17:22:50.044758] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:50.138170] [DEBUG] [LOCAL ] AVTR: Primary data saved (53562 records). [2025-09-30T17:22:50.138329] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-30T17:22:50.138448] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 34.3s. Estimated remaining: 4h 22m 57s. Rate: 8.3 symbols/min [2025-09-30T17:22:50.322190] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:50.339064] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:22:50.367554] [DEBUG] [LOCAL ] AWP: Loaded 21606 existing records from primary storage. [2025-09-30T17:22:50.367870] [INFO ] [MAIN ] AWP: Loaded 21606 existing records. [2025-09-30T17:22:50.558071] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:50.558321] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-30T17:22:50.558434] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-30T17:22:50.558803] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-30T17:22:50.558875] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-30T17:22:50.657954] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-30T17:22:50.975935] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:22:50.981985] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:51.454327] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-30T17:22:51.547618] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:22:52.254374] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-30T17:22:53.054398] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-30T17:22:53.854428] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-30T17:23:05.206468] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (11.35 seconds). [2025-09-30T17:23:05.212895] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-30T17:23:05.285747] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (13.03 seconds). [2025-09-30T17:23:05.291702] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-30T17:23:05.447695] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (13.99 seconds). [2025-09-30T17:23:05.453352] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-30T17:23:05.556217] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (12.50 seconds). [2025-09-30T17:23:05.567434] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-30T17:23:06.739916] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:23:06.746256] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-30T17:23:06.966126] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T17:23:06.974313] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-30T17:23:06.995354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:23:07.001814] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-30T17:23:07.203121] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:23:07.213399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-30T17:23:07.641545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T17:23:07.646115] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-30T17:23:08.303113] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:23:08.309840] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-30T17:23:08.430861] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:23:08.437764] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-30T17:23:08.652596] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:23:08.658717] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-30T17:23:08.850722] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:23:08.861122] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-30T17:23:09.429334] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:23:09.435167] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-30T17:23:09.472710] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:23:09.478479] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-30T17:23:09.500357] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:23:09.506466] [INFO ] [REMOTE ] AWF: Full fetch complete (35870 records). [2025-09-30T17:23:09.506665] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-30T17:23:09.507410] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:23:09.507503] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:23:09.507550] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:23:09.507596] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-30T17:23:09.507688] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-30T17:23:09.507807] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-09-30T17:23:09.508290] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-09-30T17:23:09.508436] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.2s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-09-30T17:23:09.731322] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:09.766276] [DEBUG] [LOCAL ] AWR: Loaded 22508 existing records from primary storage. [2025-09-30T17:23:09.766558] [INFO ] [MAIN ] AWR: Loaded 22508 existing records. [2025-09-30T17:23:09.969791] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:09.970039] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-30T17:23:09.970109] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-30T17:23:09.970469] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-30T17:23:09.970531] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-30T17:23:10.428027] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:10.430948] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:23:10.431785] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-30T17:23:10.439449] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-30T17:23:10.464619] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:23:10.472308] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-30T17:23:10.517301] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:23:10.529432] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-30T17:23:11.628439] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:23:11.633358] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-30T17:23:11.875329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:23:11.880438] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-30T17:23:11.910132] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:23:11.917525] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-30T17:23:12.086895] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:23:12.254397] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-30T17:23:12.672386] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T17:23:12.843229] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:23:12.952384] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T17:23:13.054407] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-30T17:23:13.854341] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-30T17:23:13.912169] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T17:23:13.978162] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:23:14.654340] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-30T17:23:14.962790] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T17:23:15.454349] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-30T17:23:15.808295] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T17:23:15.814277] [INFO ] [REMOTE ] AWI: Full fetch complete (35287 records). [2025-09-30T17:23:15.814424] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-30T17:23:15.815077] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:23:15.815184] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:23:15.815229] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:23:15.815271] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-30T17:23:15.815329] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-30T17:23:15.815366] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-09-30T17:23:15.815439] [DEBUG] [LOCAL ] AWI: No derivative data file found to delete. [2025-09-30T17:23:15.815523] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 34.4s. Estimated remaining: 4h 24m 50s. Rate: 8.2 symbols/min [2025-09-30T17:23:15.996283] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:16.025628] [DEBUG] [LOCAL ] AX: Loaded 28381 existing records from primary storage. [2025-09-30T17:23:16.025944] [INFO ] [MAIN ] AX: Loaded 28381 existing records. [2025-09-30T17:23:16.220573] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:16.220841] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-30T17:23:16.220891] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-30T17:23:16.221116] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-30T17:23:16.221176] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-30T17:23:16.259534] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-30T17:23:16.704430] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:16.794241] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T17:23:17.054365] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-30T17:23:17.476397] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:23:17.480994] [INFO ] [REMOTE ] AWP: Full fetch complete (32474 records). [2025-09-30T17:23:17.481130] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-30T17:23:17.865223] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-30T17:23:17.959735] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-30T17:23:17.959824] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-30T17:23:17.960268] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-30T17:23:17.960313] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-30T17:23:17.961388] [DEBUG] [LOCAL ] AWP: Trimmed 32474 records to 21576 (keeping 200 days of data) [2025-09-30T17:23:18.098917] [DEBUG] [LOCAL ] AWP: Primary data saved (21576 records). [2025-09-30T17:23:18.099077] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-30T17:23:18.099176] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 28.0s. Estimated remaining: 4h 23m 46s. Rate: 8.3 symbols/min [2025-09-30T17:23:18.285795] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:18.335228] [DEBUG] [LOCAL ] AXL: Loaded 50519 existing records from primary storage. [2025-09-30T17:23:18.335577] [INFO ] [MAIN ] AXL: Loaded 50519 existing records. [2025-09-30T17:23:18.539371] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:18.539628] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-30T17:23:18.539863] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-30T17:23:18.540290] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-30T17:23:18.540352] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-30T17:23:18.660605] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-30T17:23:18.974577] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:18.976892] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:23:19.022479] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:23:19.454347] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-30T17:23:19.856998] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:23:20.262608] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-30T17:23:20.268548] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:23:21.054436] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-30T17:23:21.520140] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T17:23:21.854399] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-30T17:23:22.144425] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:23:22.654393] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-30T17:23:23.290217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:23:23.454366] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-30T17:23:24.191167] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:23:24.254368] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-30T17:23:24.988697] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:23:25.054326] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-30T17:23:25.293139] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T17:23:25.854432] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-30T17:23:26.643948] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:23:26.658953] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-30T17:23:26.661072] [INFO ] [REMOTE ] AWK: Full fetch complete (70604 records). [2025-09-30T17:23:26.661256] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-30T17:23:27.119786] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-30T17:23:27.120054] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-30T17:23:27.120872] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-30T17:23:27.121013] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-30T17:23:27.149367] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:23:27.158439] [DEBUG] [LOCAL ] AWK: Trimmed 70604 records to 48708 (keeping 200 days of data) [2025-09-30T17:23:27.454791] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-30T17:23:27.492736] [DEBUG] [LOCAL ] AWK: Primary data saved (48708 records). [2025-09-30T17:23:27.492903] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-30T17:23:27.493020] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 38.9s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-09-30T17:23:27.723931] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:27.789997] [DEBUG] [LOCAL ] AXP: Loaded 53201 existing records from primary storage. [2025-09-30T17:23:27.790354] [INFO ] [MAIN ] AXP: Loaded 53201 existing records. [2025-09-30T17:23:27.984905] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:27.985189] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-30T17:23:27.985246] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-30T17:23:27.985774] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-30T17:23:27.985834] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-30T17:23:28.259109] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-30T17:23:28.410816] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:28.445370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T17:23:28.518155] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:23:29.054367] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-30T17:23:29.641120] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:23:29.854406] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-30T17:23:30.145021] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:23:30.654389] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-30T17:23:31.279794] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:23:31.454366] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-30T17:23:31.817992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T17:23:31.824196] [INFO ] [REMOTE ] AWR: Full fetch complete (31997 records). [2025-09-30T17:23:31.824352] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-30T17:23:32.247521] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-30T17:23:32.247675] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-30T17:23:32.248165] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-30T17:23:32.248232] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-30T17:23:32.249270] [DEBUG] [LOCAL ] AWR: Trimmed 31997 records to 22569 (keeping 200 days of data) [2025-09-30T17:23:32.307833] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-30T17:23:32.406607] [DEBUG] [LOCAL ] AWR: Primary data saved (22569 records). [2025-09-30T17:23:32.406786] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-30T17:23:32.406879] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 22.9s. Estimated remaining: 4h 23m 29s. Rate: 8.3 symbols/min [2025-09-30T17:23:32.607301] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:32.613488] [DEBUG] [LOCAL ] AXR: Loaded 3112 existing records from primary storage. [2025-09-30T17:23:32.613752] [INFO ] [MAIN ] AXR: Loaded 3112 existing records. [2025-09-30T17:23:32.824545] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:32.825048] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-30T17:23:32.825157] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-30T17:23:32.825404] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-30T17:23:32.825468] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-30T17:23:32.930630] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:23:33.062867] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-30T17:23:33.270847] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:33.854404] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-30T17:23:34.300856] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T17:23:34.654356] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-30T17:23:34.761078] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T17:23:35.106488] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T17:23:35.454716] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-30T17:23:36.163860] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T17:23:36.254416] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-30T17:23:36.446130] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T17:23:36.914700] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T17:23:37.054415] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-30T17:23:37.517522] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T17:23:37.854380] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-30T17:23:38.654386] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-30T17:23:38.942103] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T17:23:39.454376] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-30T17:23:40.254366] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-30T17:23:40.368205] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:23:40.560520] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:23:41.054404] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-30T17:23:41.854404] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-30T17:23:42.189693] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T17:23:42.286333] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T17:23:42.654400] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-30T17:23:42.936518] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:23:43.454391] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-30T17:23:44.017061] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:23:44.254369] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-30T17:23:44.479204] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:23:44.486047] [INFO ] [REMOTE ] AX: Full fetch complete (42663 records). [2025-09-30T17:23:44.486301] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-30T17:23:44.917070] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-30T17:23:44.917176] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-30T17:23:44.918008] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-30T17:23:44.918078] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-30T17:23:44.919314] [DEBUG] [LOCAL ] AX: Trimmed 42663 records to 28340 (keeping 200 days of data) [2025-09-30T17:23:45.054698] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-30T17:23:45.116687] [DEBUG] [LOCAL ] AX: Primary data saved (28340 records). [2025-09-30T17:23:45.116846] [INFO ] [MAIN ] AX: Full history saved. [2025-09-30T17:23:45.116965] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 29.3s. Estimated remaining: 4h 24m 23s. Rate: 8.2 symbols/min [2025-09-30T17:23:45.315989] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:45.368810] [DEBUG] [LOCAL ] AXS: Loaded 38385 existing records from primary storage. [2025-09-30T17:23:45.369178] [INFO ] [MAIN ] AXS: Loaded 38385 existing records. [2025-09-30T17:23:45.579517] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:45.579799] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-30T17:23:45.579854] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-30T17:23:45.580391] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-30T17:23:45.580452] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-30T17:23:45.859602] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-30T17:23:46.030743] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:46.364098] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T17:23:46.453557] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T17:23:46.654399] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-30T17:23:46.811302] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:23:47.454399] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-30T17:23:48.254371] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-30T17:23:48.724685] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:23:48.952292] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T17:23:49.054363] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-30T17:23:49.630957] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T17:23:49.642231] [INFO ] [REMOTE ] AXL: Full fetch complete (72621 records). [2025-09-30T17:23:49.642397] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-30T17:23:49.738287] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T17:23:49.854938] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-30T17:23:50.116700] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-30T17:23:50.116815] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-30T17:23:50.117630] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-30T17:23:50.117715] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-30T17:23:50.119187] [DEBUG] [LOCAL ] AXL: Trimmed 72621 records to 50501 (keeping 200 days of data) [2025-09-30T17:23:50.428416] [DEBUG] [LOCAL ] AXL: Primary data saved (50501 records). [2025-09-30T17:23:50.428580] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-30T17:23:50.428703] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 32.3s. Estimated remaining: 4h 23m 53s. Rate: 8.2 symbols/min [2025-09-30T17:23:50.611512] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:50.660558] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-30T17:23:50.663963] [DEBUG] [LOCAL ] AXTA: Loaded 52065 existing records from primary storage. [2025-09-30T17:23:50.664418] [INFO ] [MAIN ] AXTA: Loaded 52065 existing records. [2025-09-30T17:23:50.872498] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:50.872740] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-30T17:23:50.872805] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-30T17:23:50.873411] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-30T17:23:50.873473] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-30T17:23:51.284179] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:51.344256] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:23:51.454342] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-30T17:23:52.254384] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-30T17:23:52.659817] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:23:52.830609] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T17:23:53.054389] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-30T17:23:53.553779] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:23:53.854407] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-30T17:23:54.654463] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-30T17:23:55.218528] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T17:23:55.289634] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:23:55.353831] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-30T17:23:55.454414] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-30T17:23:56.164149] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T17:23:56.254402] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-30T17:23:57.054365] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-30T17:23:57.477556] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T17:23:57.830104] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T17:23:57.854341] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-30T17:23:58.654398] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-30T17:23:59.346868] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T17:23:59.349127] [INFO ] [REMOTE ] AXR: Full fetch complete (4930 records). [2025-09-30T17:23:59.349223] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-30T17:23:59.460845] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-30T17:23:59.661506] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:23:59.906528] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-30T17:23:59.906607] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-30T17:23:59.906775] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-30T17:23:59.906836] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-30T17:23:59.907198] [DEBUG] [LOCAL ] AXR: Trimmed 4930 records to 3063 (keeping 200 days of data) [2025-09-30T17:23:59.925208] [DEBUG] [LOCAL ] AXR: Primary data saved (3063 records). [2025-09-30T17:23:59.925278] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-30T17:23:59.925354] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 27.5s. Estimated remaining: 4h 24m 11s. Rate: 8.2 symbols/min [2025-09-30T17:24:00.254376] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-30T17:24:01.054363] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-30T17:24:01.232781] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:24:01.854412] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-30T17:24:02.096993] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T17:24:02.634327] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:24:02.654369] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-30T17:24:03.044760] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T17:24:03.454378] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-30T17:24:04.254525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-30T17:24:04.625479] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:24:04.879761] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:24:05.054392] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-30T17:24:05.691836] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:24:05.854400] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-30T17:24:06.654361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-30T17:24:06.707847] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:24:07.147150] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:24:07.454401] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-30T17:24:08.254397] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-30T17:24:08.845050] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T17:24:08.861447] [INFO ] [REMOTE ] AXP: Full fetch complete (76891 records). [2025-09-30T17:24:08.861699] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-30T17:24:09.325400] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-30T17:24:09.325913] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-30T17:24:09.326858] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-30T17:24:09.337092] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-30T17:24:09.356539] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T17:24:09.365424] [DEBUG] [LOCAL ] AXP: Trimmed 76891 records to 53200 (keeping 200 days of data) [2025-09-30T17:24:09.367571] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-30T17:24:09.755586] [DEBUG] [LOCAL ] AXP: Primary data saved (53200 records). [2025-09-30T17:24:09.755785] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-30T17:24:09.755971] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 42.3s. Estimated remaining: 4h 24m 31s. Rate: 8.2 symbols/min [2025-09-30T17:24:09.927256] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:24:09.939428] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-30T17:24:10.859885] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:24:10.869495] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-30T17:24:11.581414] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:24:11.593536] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-30T17:24:12.373923] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:24:12.383066] [INFO ] [REMOTE ] AXS: Full fetch complete (55631 records). [2025-09-30T17:24:12.383227] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-30T17:24:12.791002] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-30T17:24:12.791102] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-30T17:24:12.791746] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-30T17:24:12.791812] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-30T17:24:12.792995] [DEBUG] [LOCAL ] AXS: Trimmed 55631 records to 38397 (keeping 200 days of data) [2025-09-30T17:24:13.037990] [DEBUG] [LOCAL ] AXS: Primary data saved (38397 records). [2025-09-30T17:24:13.038179] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-30T17:24:13.039730] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 27.9s. Estimated remaining: 4h 23m 40s. Rate: 8.2 symbols/min [2025-09-30T17:24:13.276385] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:24:13.288690] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-30T17:24:14.826728] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:24:14.839259] [INFO ] [REMOTE ] AXTA: Full fetch complete (74585 records). [2025-09-30T17:24:14.839564] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-30T17:24:14.843255] [FATAL] [VALIDATOR ] AXTA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:24:14.843436] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:24:14.843883] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:24:14.843953] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-30T17:24:14.844025] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-09-30T17:24:14.844082] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-09-30T17:24:14.844751] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-09-30T17:24:14.844938] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 24.4s. Estimated remaining: 4h 22m 33s. Rate: 8.3 symbols/min [2025-09-30T17:24:15.513508] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.764913] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.765177] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-30T17:24:15.724457] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.784707] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.785259] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-30T17:24:15.785424] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-30T17:24:15.785628] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-30T17:24:15.785811] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-30T17:24:15.786101] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-30T17:24:15.926898] [DEBUG] [LOCAL ] AZO: Loaded 11372 existing records from primary storage. [2025-09-30T17:24:15.961047] [INFO ] [MAIN ] AZO: Loaded 11372 existing records. [2025-09-30T17:24:16.002498] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-09-30T17:24:16.007924] [DEBUG] [LOCAL ] AYI: Loaded 25060 existing records from primary storage. [2025-09-30T17:24:16.048759] [INFO ] [MAIN ] AYI: Loaded 25060 existing records. [2025-09-30T17:24:16.113121] [INFO ] [MAIN ] AZZ: Loaded 21975 existing records. [2025-09-30T17:24:16.857326] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:16.916399] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:16.907730] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:16.922194] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-30T17:24:16.921856] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-30T17:24:16.960348] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-30T17:24:16.960174] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-30T17:24:16.997371] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-30T17:24:17.001676] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-30T17:24:17.001510] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:17.007409] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-30T17:24:17.007173] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-30T17:24:17.015103] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-30T17:24:17.015043] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-30T17:24:17.015230] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-30T17:24:17.039509] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-30T17:24:17.044815] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-30T17:24:18.188085] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.236305] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-30T17:24:18.260927] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.284054] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-30T17:24:18.352465] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.353452] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-30T17:24:18.377609] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:24:18.385970] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-30T17:24:19.211748] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T17:24:19.216223] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-30T17:24:19.287861] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T17:24:19.295337] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-30T17:24:19.308999] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:24:19.313931] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-30T17:24:19.375955] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:24:19.454350] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-30T17:24:19.509998] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:24:19.510354] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-30T17:24:19.510499] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:24:19.510577] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-30T17:24:19.510667] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:24:19.510739] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-30T17:24:19.510805] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-30T17:24:19.510841] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-30T17:24:19.510899] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-30T17:24:19.510971] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.6s. Estimated remaining: 4h 21m 58s. Rate: 8.3 symbols/min [2025-09-30T17:24:19.692739] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:19.767482] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-30T17:24:19.767917] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-30T17:24:19.980126] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:19.980446] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-30T17:24:19.980510] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-30T17:24:19.981234] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-30T17:24:19.981350] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-30T17:24:20.132349] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:24:20.262155] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-30T17:24:20.440968] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:20.454235] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:24:20.592617] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:24:20.988988] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T17:24:21.054381] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-30T17:24:21.854338] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-30T17:24:22.161415] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:24:22.649268] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:24:22.654781] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-30T17:24:23.441837] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:24:23.454402] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-30T17:24:24.254417] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-30T17:24:24.816023] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:24:25.054364] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-30T17:24:25.338473] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:24:25.854415] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-30T17:24:26.654397] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-30T17:24:26.946360] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:24:27.454444] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-30T17:24:27.629482] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-30T17:24:27.944500] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:24:28.254412] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-30T17:24:28.348506] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:24:29.054405] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-30T17:24:29.854396] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-30T17:24:30.488820] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T17:24:30.531628] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:24:30.654416] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-30T17:24:31.067842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:24:31.454371] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-30T17:24:32.254420] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-30T17:24:32.482240] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:24:32.594736] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T17:24:33.054415] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-30T17:24:33.115500] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:24:33.854370] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-30T17:24:34.089824] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:24:34.654603] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-30T17:24:35.454416] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-30T17:24:35.738314] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:24:36.134971] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-30T17:24:36.254367] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-30T17:24:36.613842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:24:37.054417] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-30T17:24:37.232124] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T17:24:37.854327] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-30T17:24:37.930308] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:24:38.654410] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-30T17:24:38.680326] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T17:24:39.454412] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-30T17:24:39.679255] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:24:39.684736] [INFO ] [REMOTE ] AYI: Full fetch complete (36823 records). [2025-09-30T17:24:39.684900] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-30T17:24:40.121521] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-30T17:24:40.121624] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-30T17:24:40.122154] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-30T17:24:40.122236] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-30T17:24:40.123258] [DEBUG] [LOCAL ] AYI: Trimmed 36823 records to 25081 (keeping 200 days of data) [2025-09-30T17:24:40.254481] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-30T17:24:40.335877] [DEBUG] [LOCAL ] AYI: Primary data saved (25081 records). [2025-09-30T17:24:40.336057] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-30T17:24:40.336225] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AYI took 25.5s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min [2025-09-30T17:24:40.538796] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:40.612049] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-30T17:24:40.613345] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-30T17:24:40.612856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T17:24:40.821692] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:40.821970] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-30T17:24:40.822022] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-30T17:24:40.822418] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-30T17:24:40.822480] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-30T17:24:41.034907] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:24:41.063055] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-30T17:24:41.250525] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:41.854364] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-30T17:24:42.336796] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:24:42.342440] [INFO ] [REMOTE ] AZZ: Full fetch complete (30838 records). [2025-09-30T17:24:42.342623] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-30T17:24:42.659803] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-30T17:24:42.825765] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-30T17:24:42.825863] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-30T17:24:42.826372] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-30T17:24:42.826441] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-30T17:24:42.827502] [DEBUG] [LOCAL ] AZZ: Trimmed 30838 records to 21981 (keeping 200 days of data) [2025-09-30T17:24:42.979153] [DEBUG] [LOCAL ] AZZ: Primary data saved (21981 records). [2025-09-30T17:24:42.979291] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-30T17:24:42.979383] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 28.1s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-09-30T17:24:43.167032] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:43.228862] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-30T17:24:43.229252] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-30T17:24:43.430497] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:43.430825] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-30T17:24:43.430926] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-30T17:24:43.431589] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-30T17:24:43.431689] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-30T17:24:43.465416] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-30T17:24:43.854691] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:43.864357] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:24:43.867831] [INFO ] [REMOTE ] AZO: Full fetch complete (16188 records). [2025-09-30T17:24:43.868018] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-30T17:24:44.257339] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-30T17:24:44.300637] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-30T17:24:44.300881] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-30T17:24:44.301269] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-30T17:24:44.301550] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-30T17:24:44.302503] [DEBUG] [LOCAL ] AZO: Trimmed 16188 records to 11334 (keeping 200 days of data) [2025-09-30T17:24:44.396074] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-30T17:24:44.436308] [DEBUG] [LOCAL ] AZO: Primary data saved (11334 records). [2025-09-30T17:24:44.436498] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-30T17:24:44.436752] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.6s. Estimated remaining: 4h 22m 10s. Rate: 8.3 symbols/min [2025-09-30T17:24:44.626914] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:44.690974] [DEBUG] [LOCAL ] BAH: Loaded 51698 existing records from primary storage. [2025-09-30T17:24:44.691582] [INFO ] [MAIN ] BAH: Loaded 51698 existing records. [2025-09-30T17:24:44.902127] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:44.902546] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-30T17:24:44.902595] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-30T17:24:44.903128] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-30T17:24:44.903189] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-30T17:24:45.060267] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-30T17:24:45.326831] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:45.854409] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-30T17:24:46.199547] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-30T17:24:46.437177] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-30T17:24:46.654385] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-30T17:24:47.454585] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-30T17:24:47.654921] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:24:47.758780] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-30T17:24:48.254416] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-30T17:24:48.727038] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T17:24:49.054587] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-30T17:24:49.854405] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-30T17:24:50.035102] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T17:24:50.135572] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T17:24:50.654389] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-30T17:24:51.008457] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T17:24:51.454387] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-30T17:24:51.854462] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:24:52.035190] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:24:52.254368] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-30T17:24:53.054391] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-30T17:24:53.401510] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T17:24:53.772603] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:24:53.854360] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-30T17:24:54.654398] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-30T17:24:55.454357] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-30T17:24:55.604059] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-30T17:24:55.899025] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T17:24:56.196026] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:24:56.254372] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-30T17:24:57.054360] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-30T17:24:57.863044] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-30T17:24:57.869693] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T17:24:58.102849] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-30T17:24:58.654374] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-30T17:24:59.437727] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-30T17:24:59.454300] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-30T17:25:00.254413] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-30T17:25:00.370848] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-30T17:25:01.054337] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-30T17:25:01.132987] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-30T17:25:01.145321] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-09-30T17:25:01.145507] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-30T17:25:01.632978] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-30T17:25:01.633167] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-30T17:25:01.634231] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-30T17:25:01.634316] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-30T17:25:01.636715] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-09-30T17:25:01.808291] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:25:01.887443] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-30T17:25:02.070882] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-09-30T17:25:02.071042] [INFO ] [MAIN ] BA: Full history saved. [2025-09-30T17:25:02.071142] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 42.6s. Estimated remaining: 4h 23m 53s. Rate: 8.2 symbols/min [2025-09-30T17:25:02.277531] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:02.317674] [DEBUG] [LOCAL ] BAK: Loaded 39012 existing records from primary storage. [2025-09-30T17:25:02.318082] [INFO ] [MAIN ] BAK: Loaded 39012 existing records. [2025-09-30T17:25:02.525585] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:02.525863] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-30T17:25:02.525946] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-30T17:25:02.526274] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-30T17:25:02.526339] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-30T17:25:02.756739] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:25:02.921687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-30T17:25:03.020205] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:03.454407] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-30T17:25:03.539386] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-30T17:25:03.586487] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:25:04.254395] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-30T17:25:04.823335] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:25:05.054417] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-30T17:25:05.318830] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-30T17:25:05.535501] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T17:25:05.854406] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-30T17:25:06.654369] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-30T17:25:07.080249] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:25:07.146831] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:25:07.454390] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-30T17:25:08.254409] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-30T17:25:08.789244] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:25:08.801403] [INFO ] [REMOTE ] BAH: Full fetch complete (74787 records). [2025-09-30T17:25:08.801575] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-30T17:25:09.063906] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-30T17:25:09.255952] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-30T17:25:09.256120] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-30T17:25:09.257047] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-30T17:25:09.257138] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-30T17:25:09.258974] [DEBUG] [LOCAL ] BAH: Trimmed 74787 records to 51655 (keeping 200 days of data) [2025-09-30T17:25:09.629425] [DEBUG] [LOCAL ] BAH: Primary data saved (51655 records). [2025-09-30T17:25:09.629592] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-30T17:25:09.629762] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAH took 25.2s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-09-30T17:25:09.852207] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:09.889117] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:25:09.898722] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-30T17:25:09.948767] [DEBUG] [LOCAL ] BALL: Loaded 51786 existing records from primary storage. [2025-09-30T17:25:09.949177] [INFO ] [MAIN ] BALL: Loaded 51786 existing records. [2025-09-30T17:25:10.197964] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:10.200360] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-30T17:25:10.200081] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-30T17:25:10.211092] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-30T17:25:10.212376] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-30T17:25:10.212447] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-30T17:25:10.609771] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:10.654433] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-30T17:25:11.077448] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:25:11.276712] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:25:11.454435] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-30T17:25:11.981704] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:25:12.254399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-30T17:25:13.054380] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-30T17:25:13.860014] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-30T17:25:13.875455] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T17:25:14.068988] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:25:14.654363] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-30T17:25:15.264245] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T17:25:15.454400] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-30T17:25:15.677590] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-30T17:25:16.254427] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-30T17:25:16.823129] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:25:16.842391] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-30T17:25:16.842625] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-30T17:25:17.059358] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-30T17:25:17.109484] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:25:17.357900] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-30T17:25:17.357998] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-30T17:25:17.358884] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-30T17:25:17.358952] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-30T17:25:17.360743] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-30T17:25:17.657695] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:25:17.783526] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-30T17:25:17.783714] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-30T17:25:17.784713] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 34.8s. Estimated remaining: 4h 23m 49s. Rate: 8.2 symbols/min [2025-09-30T17:25:17.864029] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-30T17:25:17.994162] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:17.994383] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-30T17:25:17.994430] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-30T17:25:17.994546] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-30T17:25:17.994591] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-30T17:25:17.994639] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-30T17:25:17.994729] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-30T17:25:18.393884] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:18.654399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-30T17:25:19.400064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:25:19.454399] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-30T17:25:19.756819] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-30T17:25:20.254393] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-30T17:25:20.468827] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:25:20.745264] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T17:25:21.054378] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-30T17:25:21.854411] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-30T17:25:22.254360] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:25:22.654359] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-30T17:25:22.918551] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-30T17:25:22.944149] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:25:22.944341] [INFO ] [REMOTE ] BABA: Full fetch complete (77593 records). [2025-09-30T17:25:22.949876] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-30T17:25:22.950790] [FATAL] [VALIDATOR ] BABA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:22.950888] [FATAL] [MAIN ] BABA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:22.950935] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:22.951002] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-30T17:25:22.951069] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-09-30T17:25:22.951108] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-09-30T17:25:22.951429] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-09-30T17:25:22.953936] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BABA took 42.6s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-09-30T17:25:23.142837] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:23.209487] [DEBUG] [LOCAL ] BAM: Loaded 51993 existing records from primary storage. [2025-09-30T17:25:23.209857] [INFO ] [MAIN ] BAM: Loaded 51993 existing records. [2025-09-30T17:25:23.405393] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:23.405661] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-30T17:25:23.405727] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-30T17:25:23.406176] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-30T17:25:23.406237] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-30T17:25:23.465400] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-30T17:25:23.816570] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:24.238502] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:25:24.247376] [INFO ] [REMOTE ] BAK: Full fetch complete (56771 records). [2025-09-30T17:25:24.247530] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-30T17:25:24.248529] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:24.248636] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:24.248732] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:24.248814] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-30T17:25:24.248912] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-09-30T17:25:24.248969] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-09-30T17:25:24.249272] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-09-30T17:25:24.249392] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 22.2s. Estimated remaining: 4h 22m 10s. Rate: 8.2 symbols/min [2025-09-30T17:25:24.262723] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-30T17:25:24.482420] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:24.543437] [DEBUG] [LOCAL ] BANC: Loaded 51232 existing records from primary storage. [2025-09-30T17:25:24.543878] [INFO ] [MAIN ] BANC: Loaded 51232 existing records. [2025-09-30T17:25:24.744477] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:24.744762] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-30T17:25:24.744863] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-30T17:25:24.745547] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-30T17:25:24.745609] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-30T17:25:25.062334] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-30T17:25:25.163979] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:25.204540] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:25:25.703156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:25:25.854315] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-30T17:25:26.330683] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T17:25:26.654522] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-30T17:25:27.243448] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:25:27.454403] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-30T17:25:27.576870] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:25:28.254419] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-30T17:25:29.021840] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:25:29.054711] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-30T17:25:29.057415] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T17:25:29.854433] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-30T17:25:30.452310] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:25:30.654418] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-30T17:25:31.460039] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-30T17:25:31.466583] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T17:25:31.945315] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:25:32.208061] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T17:25:32.254373] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-30T17:25:33.054399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-30T17:25:33.854358] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-30T17:25:33.967625] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:25:34.559251] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:25:34.654401] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-30T17:25:35.245273] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:25:35.454378] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-30T17:25:36.124170] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:25:36.254371] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-30T17:25:36.283062] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:25:37.054428] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-30T17:25:37.854428] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-30T17:25:37.929737] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:25:38.654392] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-30T17:25:39.079986] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T17:25:39.368464] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T17:25:39.454386] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-30T17:25:40.254413] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-30T17:25:40.327295] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:25:41.057154] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-30T17:25:41.060164] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:25:41.180708] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:25:41.854417] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-30T17:25:42.593143] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:25:42.654391] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-30T17:25:43.172033] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T17:25:43.454396] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-30T17:25:43.922456] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:25:44.254371] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-30T17:25:44.631402] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-30T17:25:44.825879] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:25:45.054387] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-30T17:25:45.854397] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-30T17:25:46.654355] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-30T17:25:47.114587] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T17:25:47.125817] [INFO ] [REMOTE ] BAM: Full fetch complete (73842 records). [2025-09-30T17:25:47.125993] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-30T17:25:47.126834] [FATAL] [VALIDATOR ] BAM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:47.126929] [FATAL] [MAIN ] BAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:47.126976] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:47.127021] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-30T17:25:47.127096] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-09-30T17:25:47.127155] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-09-30T17:25:47.127431] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-09-30T17:25:47.128281] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 24.2s. Estimated remaining: 4h 24m 44s. Rate: 8.2 symbols/min [2025-09-30T17:25:47.324688] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:47.335033] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T17:25:47.338457] [INFO ] [REMOTE ] BALY: Full fetch complete (17041 records). [2025-09-30T17:25:47.338681] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-30T17:25:47.458812] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-30T17:25:47.595232] [DEBUG] [LOCAL ] BAP: Loaded 26168 existing records from primary storage. [2025-09-30T17:25:47.611317] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T17:25:47.611843] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:47.611955] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:47.612055] [INFO ] [MAIN ] BAP: Loaded 26168 existing records. [2025-09-30T17:25:47.651449] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-30T17:25:47.733755] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-30T17:25:47.776685] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-30T17:25:47.792275] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-30T17:25:47.812894] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALY took 30.0s. Estimated remaining: 4h 23m 28s. Rate: 8.2 symbols/min [2025-09-30T17:25:47.826195] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:25:47.867342] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:47.890623] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-30T17:25:47.907082] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-30T17:25:47.960181] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-30T17:25:47.973834] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-30T17:25:48.197127] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:48.269244] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-30T17:25:48.511314] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:48.512484] [DEBUG] [LOCAL ] BARK: Loaded 38149 existing records from primary storage. [2025-09-30T17:25:48.513068] [INFO ] [MAIN ] BARK: Loaded 38149 existing records. [2025-09-30T17:25:48.708969] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:48.709217] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-30T17:25:48.709272] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-30T17:25:48.709616] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-30T17:25:48.709714] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-30T17:25:49.067667] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-30T17:25:49.115231] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:49.152741] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:25:49.164115] [INFO ] [REMOTE ] BALL: Full fetch complete (75366 records). [2025-09-30T17:25:49.164277] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-30T17:25:49.620741] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-30T17:25:49.620968] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-30T17:25:49.621891] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-30T17:25:49.621959] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-30T17:25:49.623671] [DEBUG] [LOCAL ] BALL: Trimmed 75366 records to 51794 (keeping 200 days of data) [2025-09-30T17:25:49.860852] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-30T17:25:49.885184] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T17:25:50.010193] [DEBUG] [LOCAL ] BALL: Primary data saved (51794 records). [2025-09-30T17:25:50.010360] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-30T17:25:50.010463] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 40.4s. Estimated remaining: 4h 22m 29s. Rate: 8.2 symbols/min [2025-09-30T17:25:50.215198] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:50.215503] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-09-30T17:25:50.215717] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-09-30T17:25:50.215847] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-30T17:25:50.215890] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-30T17:25:50.215932] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-30T17:25:50.215966] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-30T17:25:50.615184] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:25:50.657383] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:50.657492] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-30T17:25:51.415544] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:25:51.454338] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-30T17:25:51.605373] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:25:52.254372] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-30T17:25:52.646608] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:25:53.054375] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-30T17:25:53.854376] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-30T17:25:54.024714] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:25:54.654359] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-30T17:25:54.789847] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:25:54.894558] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:25:55.454358] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-30T17:25:55.790144] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:25:56.254377] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-30T17:25:57.054348] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-30T17:25:57.110205] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:25:57.854401] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-30T17:25:58.004896] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T17:25:58.165936] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:25:58.654385] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-30T17:25:59.255747] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:25:59.454416] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-30T17:26:00.254411] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-30T17:26:00.566082] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:26:01.030360] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T17:26:01.042090] [INFO ] [REMOTE ] BANC: Full fetch complete (74227 records). [2025-09-30T17:26:01.042281] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-30T17:26:01.059491] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-30T17:26:01.539023] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-30T17:26:01.539204] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-30T17:26:01.540378] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-30T17:26:01.540456] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-30T17:26:01.542368] [DEBUG] [LOCAL ] BANC: Trimmed 74227 records to 51234 (keeping 200 days of data) [2025-09-30T17:26:01.697964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T17:26:01.854464] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-30T17:26:01.971121] [DEBUG] [LOCAL ] BANC: Primary data saved (51234 records). [2025-09-30T17:26:01.971337] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-30T17:26:01.971591] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 37.7s. Estimated remaining: 4h 23m 9s. Rate: 8.2 symbols/min [2025-09-30T17:26:02.197054] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:02.262365] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-09-30T17:26:02.262874] [INFO ] [MAIN ] BB: Loaded 52924 existing records. [2025-09-30T17:26:02.504428] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:26:02.529893] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:02.537386] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-30T17:26:02.537862] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-30T17:26:02.538305] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-30T17:26:02.538399] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-30T17:26:02.659588] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-30T17:26:02.965528] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:03.454353] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-30T17:26:03.575201] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:26:04.107440] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:26:04.254401] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-30T17:26:05.054455] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-30T17:26:05.290615] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:26:05.854425] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-30T17:26:05.903214] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:26:05.976398] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:26:06.654396] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-30T17:26:07.454404] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-30T17:26:07.848286] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T17:26:07.919470] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:26:08.254331] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-30T17:26:08.309559] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:26:09.054408] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-30T17:26:09.854383] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-30T17:26:10.364147] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T17:26:10.617185] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:26:10.654401] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-30T17:26:10.900231] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T17:26:11.454427] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-30T17:26:12.254387] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-30T17:26:12.569686] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:26:12.626221] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:26:12.633451] [INFO ] [REMOTE ] BAP: Full fetch complete (37714 records). [2025-09-30T17:26:12.633669] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-30T17:26:13.060080] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-30T17:26:13.078820] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-30T17:26:13.078923] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-30T17:26:13.079440] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-30T17:26:13.079509] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-30T17:26:13.080516] [DEBUG] [LOCAL ] BAP: Trimmed 37714 records to 26131 (keeping 200 days of data) [2025-09-30T17:26:13.262294] [DEBUG] [LOCAL ] BAP: Primary data saved (26131 records). [2025-09-30T17:26:13.262490] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-30T17:26:13.262633] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 26.1s. Estimated remaining: 4h 23m 41s. Rate: 8.2 symbols/min [2025-09-30T17:26:13.462004] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:13.485272] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:26:13.557132] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-30T17:26:13.557530] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-30T17:26:13.758759] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:13.758992] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-30T17:26:13.759042] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-30T17:26:13.759635] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-30T17:26:13.759766] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-30T17:26:13.861936] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-30T17:26:14.164344] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:14.654564] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-30T17:26:14.786367] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T17:26:15.454383] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-30T17:26:15.734909] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:26:15.743107] [INFO ] [REMOTE ] BARK: Full fetch complete (56364 records). [2025-09-30T17:26:15.743286] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-30T17:26:15.744061] [FATAL] [VALIDATOR ] BARK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:26:15.744172] [FATAL] [MAIN ] BARK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:26:15.744248] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:26:15.744360] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-30T17:26:15.744470] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-30T17:26:15.744541] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-09-30T17:26:15.744926] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-09-30T17:26:15.745043] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 27.9s. Estimated remaining: 4h 22m 45s. Rate: 8.2 symbols/min [2025-09-30T17:26:15.957943] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:16.017067] [DEBUG] [LOCAL ] BBAR: Loaded 41378 existing records from primary storage. [2025-09-30T17:26:16.017440] [INFO ] [MAIN ] BBAR: Loaded 41378 existing records. [2025-09-30T17:26:16.229174] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:16.229475] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-30T17:26:16.229551] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-30T17:26:16.229951] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-30T17:26:16.230012] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-30T17:26:16.264338] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-30T17:26:16.695039] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:17.044225] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:26:17.056696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-30T17:26:17.216411] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-30T17:26:17.854415] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-30T17:26:18.427309] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T17:26:18.488569] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T17:26:18.654404] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-30T17:26:19.454368] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-30T17:26:19.929717] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:26:20.254359] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-30T17:26:20.324785] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:26:21.050293] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:26:21.061084] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-30T17:26:21.854359] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-30T17:26:22.136716] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:26:22.649811] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:26:22.660269] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-30T17:26:23.454406] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-30T17:26:24.081261] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T17:26:24.254408] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-30T17:26:24.580459] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:26:25.054371] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-30T17:26:25.468551] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T17:26:25.482956] [INFO ] [REMOTE ] BAX: Full fetch complete (77443 records). [2025-09-30T17:26:25.483182] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-30T17:26:25.858530] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-30T17:26:25.962681] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-30T17:26:25.972247] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-30T17:26:25.973422] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-30T17:26:25.973530] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-30T17:26:25.977279] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:26:25.988334] [DEBUG] [LOCAL ] BAX: Trimmed 77443 records to 53492 (keeping 200 days of data) [2025-09-30T17:26:26.339983] [DEBUG] [LOCAL ] BAX: Primary data saved (53492 records). [2025-09-30T17:26:26.340140] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-30T17:26:26.340221] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 36.3s. Estimated remaining: 4h 23m 11s. Rate: 8.2 symbols/min [2025-09-30T17:26:26.548602] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:26.608302] [DEBUG] [LOCAL ] BBD: Loaded 53196 existing records from primary storage. [2025-09-30T17:26:26.608746] [INFO ] [MAIN ] BBD: Loaded 53196 existing records. [2025-09-30T17:26:26.660713] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-30T17:26:26.842686] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:26.842938] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-30T17:26:26.843000] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-30T17:26:26.843404] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-30T17:26:26.843466] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-30T17:26:27.273934] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:27.305079] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-30T17:26:27.454381] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-30T17:26:27.878899] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T17:26:27.948595] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:26:28.254418] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-30T17:26:29.054439] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-30T17:26:29.383027] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T17:26:29.857101] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-30T17:26:29.930243] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:26:30.654411] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-30T17:26:31.036885] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:26:31.454422] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-30T17:26:31.869213] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:26:32.254386] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-30T17:26:32.479611] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-30T17:26:33.054422] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-30T17:26:33.114850] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:26:33.854457] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-30T17:26:34.020880] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T17:26:34.654440] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-30T17:26:34.756696] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:26:35.222539] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:26:35.454374] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-30T17:26:36.254389] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-30T17:26:37.054394] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-30T17:26:37.147937] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:26:37.396961] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-30T17:26:37.810438] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:26:37.854410] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-30T17:26:38.654415] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-30T17:26:39.142348] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:26:39.154785] [INFO ] [REMOTE ] BB: Full fetch complete (76983 records). [2025-09-30T17:26:39.154962] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-30T17:26:39.456262] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-30T17:26:39.627439] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-30T17:26:39.641683] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-30T17:26:39.642791] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-30T17:26:39.643332] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-30T17:26:39.645296] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:26:39.656872] [INFO ] [REMOTE ] BBAR: Full fetch complete (60804 records). [2025-09-30T17:26:39.657219] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-30T17:26:39.657112] [DEBUG] [LOCAL ] BB: Trimmed 76983 records to 52928 (keeping 200 days of data) [2025-09-30T17:26:40.188128] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-30T17:26:40.189222] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-30T17:26:40.190525] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-30T17:26:40.191832] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-30T17:26:40.197702] [DEBUG] [LOCAL ] BBAR: Trimmed 60804 records to 41447 (keeping 200 days of data) [2025-09-30T17:26:40.473485] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:26:40.492779] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-30T17:26:40.719605] [DEBUG] [LOCAL ] BB: Primary data saved (52928 records). [2025-09-30T17:26:40.720278] [INFO ] [MAIN ] BB: Full history saved. [2025-09-30T17:26:40.720623] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 38.7s. Estimated remaining: 4h 24m 13s. Rate: 8.2 symbols/min [2025-09-30T17:26:40.939671] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:40.954805] [DEBUG] [LOCAL ] BBAR: Primary data saved (41447 records). [2025-09-30T17:26:40.954973] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-30T17:26:40.955779] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 25.2s. Estimated remaining: 4h 22m 56s. Rate: 8.2 symbols/min [2025-09-30T17:26:41.184731] [DEBUG] [LOCAL ] BBDC: Loaded 33080 existing records from primary storage. [2025-09-30T17:26:41.204633] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:41.203148] [INFO ] [MAIN ] BBDC: Loaded 33080 existing records. [2025-09-30T17:26:41.340820] [DEBUG] [LOCAL ] BBDO: Loaded 4954 existing records from primary storage. [2025-09-30T17:26:41.366030] [INFO ] [MAIN ] BBDO: Loaded 4954 existing records. [2025-09-30T17:26:41.502080] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:41.513799] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-30T17:26:41.514097] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-30T17:26:41.530053] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-30T17:26:41.535237] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-30T17:26:41.719681] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:41.725451] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-30T17:26:41.730673] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-30T17:26:41.761130] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-30T17:26:41.800524] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-30T17:26:42.169866] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:42.181471] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-30T17:26:42.453992] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:42.470359] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-30T17:26:42.482500] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T17:26:42.501317] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-30T17:26:42.654367] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-30T17:26:43.347158] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T17:26:43.454380] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-30T17:26:43.824128] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:26:44.018836] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:26:44.254372] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-30T17:26:45.054349] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-30T17:26:45.230510] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-30T17:26:45.525063] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T17:26:45.854333] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-30T17:26:45.908046] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:26:46.654380] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-30T17:26:47.454372] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-30T17:26:47.499412] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:26:47.676941] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T17:26:47.898423] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:26:48.254480] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-30T17:26:49.054392] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-30T17:26:49.709073] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:26:49.854369] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-30T17:26:50.181144] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:26:50.654380] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-30T17:26:51.454416] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-30T17:26:51.765302] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T17:26:51.777146] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-09-30T17:26:51.777317] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-30T17:26:51.909091] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:26:52.242138] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:26:52.263387] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-30T17:26:52.276837] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-30T17:26:52.277351] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-30T17:26:52.278256] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-30T17:26:52.278468] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-30T17:26:52.280627] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53195 (keeping 200 days of data) [2025-09-30T17:26:52.617566] [DEBUG] [LOCAL ] BBD: Primary data saved (53195 records). [2025-09-30T17:26:52.617757] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-30T17:26:52.617872] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 26.3s. Estimated remaining: 4h 23m 31s. Rate: 8.2 symbols/min [2025-09-30T17:26:52.815452] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:52.837810] [DEBUG] [LOCAL ] BBN: Loaded 18016 existing records from primary storage. [2025-09-30T17:26:52.838125] [INFO ] [MAIN ] BBN: Loaded 18016 existing records. [2025-09-30T17:26:53.060876] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-30T17:26:53.068914] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:53.070226] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-30T17:26:53.070282] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-30T17:26:53.070723] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-30T17:26:53.070819] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-30T17:26:53.477806] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:53.854409] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-30T17:26:54.025935] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:26:54.654408] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-30T17:26:54.991317] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-30T17:26:55.086307] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:26:55.141255] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T17:26:55.454401] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-30T17:26:56.254387] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-30T17:26:56.813872] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:26:57.054357] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-30T17:26:57.854388] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-30T17:26:58.456173] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:26:58.654320] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-30T17:26:58.790766] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:26:58.877924] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-30T17:26:59.454380] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-30T17:26:59.810764] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:27:00.254389] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-30T17:27:00.370956] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:27:00.973815] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:27:01.054353] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-30T17:27:01.647380] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T17:27:01.854363] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-30T17:27:02.441092] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T17:27:02.654399] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-30T17:27:03.454396] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-30T17:27:04.102379] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:27:04.254429] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-30T17:27:04.452944] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:27:05.054406] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-30T17:27:05.463465] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:27:05.471287] [INFO ] [REMOTE ] BBDC: Full fetch complete (48728 records). [2025-09-30T17:27:05.471404] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-30T17:27:05.859499] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-30T17:27:05.877191] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-30T17:27:05.877274] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-30T17:27:05.877922] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-30T17:27:05.878057] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-30T17:27:05.879286] [DEBUG] [LOCAL ] BBDC: Trimmed 48728 records to 33001 (keeping 200 days of data) [2025-09-30T17:27:06.091747] [DEBUG] [LOCAL ] BBDC: Primary data saved (33001 records). [2025-09-30T17:27:06.091895] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-30T17:27:06.092006] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 25.4s. Estimated remaining: 4h 24m 24s. Rate: 8.1 symbols/min [2025-09-30T17:27:06.286522] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:06.286722] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-30T17:27:06.286775] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-30T17:27:06.286893] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-30T17:27:06.286935] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-30T17:27:06.286979] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-30T17:27:06.287013] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-30T17:27:06.661067] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T17:27:06.661168] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-30T17:27:06.710281] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:06.704107] [INFO ] [REMOTE ] BBDO: Full fetch complete (7609 records). [2025-09-30T17:27:06.711553] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-30T17:27:07.112046] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-30T17:27:07.112172] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-30T17:27:07.112461] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-30T17:27:07.112521] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-30T17:27:07.112978] [DEBUG] [LOCAL ] BBDO: Trimmed 7609 records to 4915 (keeping 200 days of data) [2025-09-30T17:27:07.142719] [DEBUG] [LOCAL ] BBDO: Primary data saved (4915 records). [2025-09-30T17:27:07.142855] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-30T17:27:07.142938] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 26.2s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-09-30T17:27:07.326019] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:07.332368] [DEBUG] [LOCAL ] BBU: Loaded 4536 existing records from primary storage. [2025-09-30T17:27:07.332549] [INFO ] [MAIN ] BBU: Loaded 4536 existing records. [2025-09-30T17:27:07.459549] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-30T17:27:07.533859] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:07.534781] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-30T17:27:07.535115] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-30T17:27:07.535393] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-30T17:27:07.535454] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-30T17:27:07.797402] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:27:07.828923] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-30T17:27:07.856845] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:27:07.870414] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-30T17:27:07.890476] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:27:07.901153] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-30T17:27:07.911841] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-30T17:27:07.945945] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:27:07.991547] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-30T17:27:08.033132] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-30T17:27:08.032970] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:08.034401] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 1.9s. Estimated remaining: 4h 22m 5s. Rate: 8.2 symbols/min [2025-09-30T17:27:08.216919] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.16 seconds). [2025-09-30T17:27:08.261460] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-30T17:27:08.266363] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-30T17:27:08.267373] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-30T17:27:08.266157] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:08.267805] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-09-30T17:27:08.267875] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-09-30T17:27:08.325823] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-30T17:27:08.364016] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-30T17:27:08.374897] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-09-30T17:27:08.375007] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-30T17:27:09.076251] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-30T17:27:09.091195] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-30T17:27:09.120178] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-30T17:27:09.132765] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-30T17:27:09.182826] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-30T17:27:09.182711] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:09.202903] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:27:09.205487] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-30T17:27:09.547690] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-30T17:27:09.547840] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-30T17:27:09.550172] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBAI took 56.3s. Estimated remaining: 4h 21m 2s. Rate: 8.2 symbols/min [2025-09-30T17:27:09.740246] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:09.745503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:27:09.808682] [DEBUG] [LOCAL ] BBVA: Loaded 49353 existing records from primary storage. [2025-09-30T17:27:09.809051] [INFO ] [MAIN ] BBVA: Loaded 49353 existing records. [2025-09-30T17:27:09.859534] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-30T17:27:10.032164] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:10.032439] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-30T17:27:10.032489] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-30T17:27:10.033076] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-30T17:27:10.033137] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-30T17:27:10.424184] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:10.498259] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:27:10.654382] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-30T17:27:11.242066] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:27:11.454360] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-30T17:27:12.254335] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-30T17:27:12.275686] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T17:27:12.673294] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T17:27:13.054391] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-30T17:27:13.855901] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-30T17:27:13.857703] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:27:14.654409] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-30T17:27:15.272963] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T17:27:15.454328] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-30T17:27:15.529174] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:27:16.254370] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-30T17:27:16.426925] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:27:16.713638] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T17:27:17.054402] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-30T17:27:17.507860] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:27:17.854387] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-30T17:27:18.654392] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-30T17:27:18.677758] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:27:19.454394] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-30T17:27:19.645857] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:27:19.975608] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T17:27:20.254364] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-30T17:27:21.054329] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-30T17:27:21.207024] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T17:27:21.854417] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-30T17:27:22.562583] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T17:27:22.654410] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-30T17:27:22.868294] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:27:23.454422] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-30T17:27:24.254331] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-30T17:27:24.295476] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:27:24.330119] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T17:27:24.334877] [INFO ] [REMOTE ] BBN: Full fetch complete (26660 records). [2025-09-30T17:27:24.335020] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-30T17:27:24.731538] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-30T17:27:24.731621] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-30T17:27:24.732046] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-30T17:27:24.732103] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-30T17:27:24.732856] [DEBUG] [LOCAL ] BBN: Trimmed 26660 records to 18034 (keeping 200 days of data) [2025-09-30T17:27:24.845783] [DEBUG] [LOCAL ] BBN: Primary data saved (18034 records). [2025-09-30T17:27:24.845944] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-30T17:27:24.846037] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 32.2s. Estimated remaining: 4h 22m 11s. Rate: 8.2 symbols/min [2025-09-30T17:27:25.031488] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:25.039194] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:27:25.056466] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-30T17:27:25.071023] [DEBUG] [LOCAL ] BBW: Loaded 26648 existing records from primary storage. [2025-09-30T17:27:25.071348] [INFO ] [MAIN ] BBW: Loaded 26648 existing records. [2025-09-30T17:27:25.259929] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:25.260170] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-30T17:27:25.260253] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-30T17:27:25.260688] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-30T17:27:25.260747] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-30T17:27:25.654151] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:25.730685] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:27:25.854384] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-30T17:27:26.654399] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-30T17:27:26.846246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:27:27.454387] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-30T17:27:28.159468] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:27:28.254362] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-30T17:27:28.772892] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T17:27:28.982527] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:27:29.054407] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-30T17:27:29.679195] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T17:27:29.854381] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-30T17:27:30.654379] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-30T17:27:30.746768] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:27:31.454341] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-30T17:27:31.524434] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T17:27:31.526856] [INFO ] [REMOTE ] BBU: Full fetch complete (6580 records). [2025-09-30T17:27:31.526930] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-30T17:27:31.932720] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-30T17:27:31.932809] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-30T17:27:31.933006] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-30T17:27:31.933070] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-30T17:27:31.933510] [DEBUG] [LOCAL ] BBU: Trimmed 6580 records to 4648 (keeping 200 days of data) [2025-09-30T17:27:31.963482] [DEBUG] [LOCAL ] BBU: Primary data saved (4648 records). [2025-09-30T17:27:31.963634] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-30T17:27:31.963763] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 24.8s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-09-30T17:27:32.151029] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:32.207192] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-30T17:27:32.207600] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-09-30T17:27:32.259517] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-30T17:27:32.410134] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:32.410377] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-30T17:27:32.410434] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-30T17:27:32.410957] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-30T17:27:32.411018] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-30T17:27:32.763532] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T17:27:32.834938] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:33.054383] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-30T17:27:33.854367] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-30T17:27:33.914046] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:27:34.112194] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:27:34.116179] [INFO ] [REMOTE ] BBUC: Full fetch complete (17930 records). [2025-09-30T17:27:34.116271] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-30T17:27:34.517752] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-30T17:27:34.517839] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-30T17:27:34.518197] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-30T17:27:34.518274] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-30T17:27:34.518942] [DEBUG] [LOCAL ] BBUC: Trimmed 17930 records to 13313 (keeping 200 days of data) [2025-09-30T17:27:34.607158] [DEBUG] [LOCAL ] BBUC: Primary data saved (13313 records). [2025-09-30T17:27:34.607306] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-30T17:27:34.607383] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBUC took 26.6s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-09-30T17:27:34.665165] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-30T17:27:34.796231] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:34.850432] [DEBUG] [LOCAL ] BBY: Loaded 53470 existing records from primary storage. [2025-09-30T17:27:34.850846] [INFO ] [MAIN ] BBY: Loaded 53470 existing records. [2025-09-30T17:27:35.053527] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:35.053924] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-30T17:27:35.054033] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-30T17:27:35.060518] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-30T17:27:35.071337] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-30T17:27:35.077117] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:27:35.480865] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-30T17:27:35.486964] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:36.254352] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-30T17:27:36.709047] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T17:27:36.744074] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T17:27:37.054374] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-30T17:27:37.577821] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:27:37.854369] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-30T17:27:38.112354] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:27:38.654364] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-30T17:27:39.454372] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-30T17:27:39.667607] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T17:27:40.254328] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-30T17:27:40.390289] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:27:40.442404] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:27:41.054370] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-30T17:27:41.854360] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-30T17:27:41.993468] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:27:42.655370] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-30T17:27:42.673510] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T17:27:42.734997] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:27:43.454365] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-30T17:27:44.254364] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-30T17:27:44.429500] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T17:27:45.054360] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-30T17:27:45.174496] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:27:45.302431] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:27:45.854374] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-30T17:27:46.442144] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:27:46.654416] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-30T17:27:47.207207] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:27:47.454395] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-30T17:27:48.155280] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:27:48.254351] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-30T17:27:48.514460] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:27:49.054369] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-30T17:27:49.758057] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:27:49.854344] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-30T17:27:50.654351] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-30T17:27:50.745832] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:27:50.756548] [INFO ] [REMOTE ] BBVA: Full fetch complete (71583 records). [2025-09-30T17:27:50.756721] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-30T17:27:51.172115] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-30T17:27:51.172207] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-30T17:27:51.172945] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-30T17:27:51.173011] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-30T17:27:51.174422] [DEBUG] [LOCAL ] BBVA: Trimmed 71583 records to 49310 (keeping 200 days of data) [2025-09-30T17:27:51.462251] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-30T17:27:51.501335] [DEBUG] [LOCAL ] BBVA: Primary data saved (49310 records). [2025-09-30T17:27:51.501543] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-30T17:27:51.502827] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBVA took 42.0s. Estimated remaining: 4h 22m 33s. Rate: 8.2 symbols/min [2025-09-30T17:27:51.726175] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:51.764113] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T17:27:51.817537] [DEBUG] [LOCAL ] BC: Loaded 44259 existing records from primary storage. [2025-09-30T17:27:51.817914] [INFO ] [MAIN ] BC: Loaded 44259 existing records. [2025-09-30T17:27:52.014403] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:52.014663] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-30T17:27:52.014725] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-30T17:27:52.015093] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-30T17:27:52.015153] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-30T17:27:52.259261] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-30T17:27:52.417453] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:52.453026] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:27:52.737226] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:27:52.744933] [INFO ] [REMOTE ] BBW: Full fetch complete (39116 records). [2025-09-30T17:27:52.745075] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-30T17:27:53.059519] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-30T17:27:53.152410] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-30T17:27:53.152490] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-30T17:27:53.153053] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-30T17:27:53.153143] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-30T17:27:53.154209] [DEBUG] [LOCAL ] BBW: Trimmed 39116 records to 26640 (keeping 200 days of data) [2025-09-30T17:27:53.325019] [DEBUG] [LOCAL ] BBW: Primary data saved (26640 records). [2025-09-30T17:27:53.325157] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-30T17:27:53.325243] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBW took 28.5s. Estimated remaining: 4h 21m 34s. Rate: 8.2 symbols/min [2025-09-30T17:27:53.512069] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:53.512321] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-30T17:27:53.512390] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-30T17:27:53.512531] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-30T17:27:53.512588] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-30T17:27:53.512683] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-30T17:27:53.512751] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-30T17:27:53.856895] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-30T17:27:53.947020] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:54.060222] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:27:54.654367] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-30T17:27:54.691707] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:27:55.314965] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:27:55.454363] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-30T17:27:56.135188] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:27:56.254375] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-30T17:27:57.054335] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-30T17:27:57.214548] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:27:57.344496] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T17:27:57.854359] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-30T17:27:58.252602] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:27:58.654369] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-30T17:27:59.359922] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:27:59.454380] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-30T17:28:00.078210] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:28:00.254384] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-30T17:28:00.986945] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:28:01.054382] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-30T17:28:01.863614] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-30T17:28:01.869475] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T17:28:02.654369] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-30T17:28:02.753625] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:28:03.196002] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:28:03.454384] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-30T17:28:04.121287] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:28:04.254439] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-30T17:28:04.984884] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:28:05.054388] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-30T17:28:05.849755] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:28:05.860063] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-30T17:28:06.654436] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-30T17:28:07.001798] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:28:07.013966] [INFO ] [REMOTE ] BBY: Full fetch complete (77239 records). [2025-09-30T17:28:07.014198] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-30T17:28:07.354692] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:28:07.459582] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-30T17:28:07.516038] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-30T17:28:07.516169] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-30T17:28:07.517247] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-30T17:28:07.517323] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-30T17:28:07.519723] [DEBUG] [LOCAL ] BBY: Trimmed 77239 records to 53467 (keeping 200 days of data) [2025-09-30T17:28:07.929098] [DEBUG] [LOCAL ] BBY: Primary data saved (53467 records). [2025-09-30T17:28:07.929274] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-30T17:28:07.929422] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBY took 33.3s. Estimated remaining: 4h 22m 35s. Rate: 8.2 symbols/min [2025-09-30T17:28:08.195487] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:08.234710] [DEBUG] [LOCAL ] BCC: Loaded 28242 existing records from primary storage. [2025-09-30T17:28:08.235125] [INFO ] [MAIN ] BCC: Loaded 28242 existing records. [2025-09-30T17:28:08.262373] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-30T17:28:08.452636] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:08.453138] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-30T17:28:08.453305] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-30T17:28:08.453794] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-30T17:28:08.453912] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-30T17:28:08.807129] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:28:08.882786] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-30T17:28:08.942701] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:08.942962] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-30T17:28:09.060245] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-30T17:28:09.197709] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T17:28:09.466087] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-30T17:28:09.466291] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-30T17:28:09.467286] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-30T17:28:09.467367] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-30T17:28:09.469047] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 53580 (keeping 200 days of data) [2025-09-30T17:28:09.748058] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:28:09.857228] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-30T17:28:09.859588] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-30T17:28:09.860781] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-30T17:28:09.862045] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBWI took 37.9s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-09-30T17:28:10.060135] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:10.118298] [DEBUG] [LOCAL ] BCE: Loaded 52283 existing records from primary storage. [2025-09-30T17:28:10.118821] [INFO ] [MAIN ] BCE: Loaded 52283 existing records. [2025-09-30T17:28:10.323149] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:10.323543] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-30T17:28:10.323742] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-30T17:28:10.324268] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-30T17:28:10.324329] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-30T17:28:10.665251] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-30T17:28:10.700480] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:28:10.775385] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:11.378282] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:28:11.454397] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-30T17:28:11.800339] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T17:28:12.254435] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-30T17:28:12.417810] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:28:13.054385] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-30T17:28:13.490252] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:28:13.854380] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-30T17:28:14.543809] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:28:14.654362] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-30T17:28:15.454434] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-30T17:28:15.575174] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:28:15.588439] [INFO ] [REMOTE ] BC: Full fetch complete (63820 records). [2025-09-30T17:28:15.589001] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-30T17:28:16.110570] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:28:16.202333] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-30T17:28:16.202430] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-30T17:28:16.203179] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-30T17:28:16.203254] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-30T17:28:16.204836] [DEBUG] [LOCAL ] BC: Trimmed 63820 records to 44228 (keeping 200 days of data) [2025-09-30T17:28:16.263492] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-30T17:28:16.490773] [DEBUG] [LOCAL ] BC: Primary data saved (44228 records). [2025-09-30T17:28:16.490917] [INFO ] [MAIN ] BC: Full history saved. [2025-09-30T17:28:16.494470] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 25.0s. Estimated remaining: 4h 21m 23s. Rate: 8.2 symbols/min [2025-09-30T17:28:16.714247] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:16.752812] [DEBUG] [LOCAL ] BCH: Loaded 29497 existing records from primary storage. [2025-09-30T17:28:16.753200] [INFO ] [MAIN ] BCH: Loaded 29497 existing records. [2025-09-30T17:28:16.943156] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:16.943407] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-30T17:28:16.943458] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-30T17:28:16.943691] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-30T17:28:16.943769] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-30T17:28:17.059933] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-30T17:28:17.342783] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:17.366837] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:28:17.409560] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:28:17.854413] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-30T17:28:18.467575] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T17:28:18.654389] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-30T17:28:18.826851] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:28:19.454393] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-30T17:28:20.254365] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-30T17:28:20.415103] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:28:20.780835] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T17:28:21.054407] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-30T17:28:21.624889] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:28:21.854399] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-30T17:28:22.162789] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:28:22.654416] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-30T17:28:23.119536] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:28:23.454384] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-30T17:28:24.079283] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T17:28:24.254386] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-30T17:28:24.492301] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T17:28:25.054333] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-30T17:28:25.229101] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T17:28:25.854329] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-30T17:28:26.085426] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:28:26.654378] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-30T17:28:27.453540] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:28:27.461181] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-30T17:28:27.463225] [INFO ] [REMOTE ] BCAT: Full fetch complete (50066 records). [2025-09-30T17:28:27.463350] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-30T17:28:27.952629] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-30T17:28:27.952763] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-30T17:28:27.953493] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-30T17:28:27.953636] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-30T17:28:27.981948] [DEBUG] [LOCAL ] BCAT: Trimmed 50066 records to 34276 (keeping 200 days of data) [2025-09-30T17:28:27.983549] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:28:28.219304] [DEBUG] [LOCAL ] BCAT: Primary data saved (34276 records). [2025-09-30T17:28:28.219480] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-30T17:28:28.219576] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 34.9s. Estimated remaining: 4h 21m 56s. Rate: 8.2 symbols/min [2025-09-30T17:28:28.259464] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-30T17:28:28.429482] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:28.461067] [DEBUG] [LOCAL ] BCO: Loaded 26212 existing records from primary storage. [2025-09-30T17:28:28.461400] [INFO ] [MAIN ] BCO: Loaded 26212 existing records. [2025-09-30T17:28:28.683279] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:28.683565] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-30T17:28:28.683625] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-30T17:28:28.683943] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-30T17:28:28.684005] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-30T17:28:29.064209] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-30T17:28:29.112728] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:29.149089] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T17:28:29.683920] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:28:29.854385] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-30T17:28:30.167285] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:28:30.176449] [INFO ] [REMOTE ] BCC: Full fetch complete (40507 records). [2025-09-30T17:28:30.176602] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-30T17:28:30.576592] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-30T17:28:30.576745] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-30T17:28:30.577302] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-30T17:28:30.577378] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-30T17:28:30.580211] [DEBUG] [LOCAL ] BCC: Trimmed 40507 records to 28207 (keeping 200 days of data) [2025-09-30T17:28:30.677834] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-30T17:28:30.771158] [DEBUG] [LOCAL ] BCC: Primary data saved (28207 records). [2025-09-30T17:28:30.771303] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-30T17:28:30.771387] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 22.8s. Estimated remaining: 4h 21m 5s. Rate: 8.2 symbols/min [2025-09-30T17:28:30.990495] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:31.047077] [DEBUG] [LOCAL ] BCS: Loaded 53457 existing records from primary storage. [2025-09-30T17:28:31.047456] [INFO ] [MAIN ] BCS: Loaded 53457 existing records. [2025-09-30T17:28:31.261740] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:31.262025] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-30T17:28:31.262111] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-30T17:28:31.262752] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-30T17:28:31.262835] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-30T17:28:31.458886] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-30T17:28:31.679174] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:31.729697] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:28:31.730194] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:28:32.254374] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-30T17:28:32.948220] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:28:33.054398] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-30T17:28:33.312548] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T17:28:33.854385] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-30T17:28:34.654351] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-30T17:28:34.906276] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:28:34.972417] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:28:35.454355] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-30T17:28:36.080436] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T17:28:36.254372] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-30T17:28:36.898160] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:28:37.054409] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-30T17:28:37.854386] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-30T17:28:38.144066] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T17:28:38.171584] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:28:38.654373] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-30T17:28:39.454397] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-30T17:28:39.613087] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:28:40.213694] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:28:40.254373] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-30T17:28:40.781565] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:28:41.054371] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-30T17:28:41.854346] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-30T17:28:42.034069] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:28:42.527709] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T17:28:42.654412] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-30T17:28:42.907308] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:28:43.454415] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-30T17:28:44.105832] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:28:44.254345] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-30T17:28:44.646307] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T17:28:45.054417] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-30T17:28:45.854331] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-30T17:28:45.900035] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:28:46.500018] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:28:46.511389] [INFO ] [REMOTE ] BCE: Full fetch complete (76074 records). [2025-09-30T17:28:46.511532] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-30T17:28:46.666272] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-30T17:28:46.962333] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-30T17:28:46.962488] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-30T17:28:46.963423] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-30T17:28:46.963622] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-30T17:28:46.965487] [DEBUG] [LOCAL ] BCE: Trimmed 76074 records to 52277 (keeping 200 days of data) [2025-09-30T17:28:47.240753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T17:28:47.333081] [DEBUG] [LOCAL ] BCE: Primary data saved (52277 records). [2025-09-30T17:28:47.333224] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-30T17:28:47.333923] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 37.5s. Estimated remaining: 4h 22m 22s. Rate: 8.1 symbols/min [2025-09-30T17:28:47.459518] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-30T17:28:47.514115] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:47.547886] [DEBUG] [LOCAL ] BCSF: Loaded 27789 existing records from primary storage. [2025-09-30T17:28:47.548169] [INFO ] [MAIN ] BCSF: Loaded 27789 existing records. [2025-09-30T17:28:47.745042] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:47.745334] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-30T17:28:47.745386] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-30T17:28:47.745675] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-30T17:28:47.745737] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-30T17:28:48.148771] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:48.168638] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:28:48.175606] [INFO ] [REMOTE ] BCH: Full fetch complete (40855 records). [2025-09-30T17:28:48.175796] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-30T17:28:48.263435] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-30T17:28:48.591226] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-30T17:28:48.591334] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-30T17:28:48.591887] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-30T17:28:48.591986] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-30T17:28:48.593160] [DEBUG] [LOCAL ] BCH: Trimmed 40855 records to 29483 (keeping 200 days of data) [2025-09-30T17:28:48.772435] [DEBUG] [LOCAL ] BCH: Primary data saved (29483 records). [2025-09-30T17:28:48.772586] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-30T17:28:48.772707] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 32.3s. Estimated remaining: 4h 21m 21s. Rate: 8.2 symbols/min [2025-09-30T17:28:48.981374] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:49.004925] [DEBUG] [LOCAL ] BCX: Loaded 21626 existing records from primary storage. [2025-09-30T17:28:49.005184] [INFO ] [MAIN ] BCX: Loaded 21626 existing records. [2025-09-30T17:28:49.069674] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-30T17:28:49.215005] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:49.215299] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-30T17:28:49.215350] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-30T17:28:49.215807] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-30T17:28:49.215872] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-30T17:28:49.632760] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:49.651965] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:28:49.690275] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T17:28:49.854392] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-30T17:28:50.312566] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:28:50.654397] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-30T17:28:51.454331] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-30T17:28:51.551933] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:28:51.651427] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:28:52.254337] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-30T17:28:52.347386] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:28:53.054379] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-30T17:28:53.334075] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:28:53.854393] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-30T17:28:54.016826] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:28:54.654396] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-30T17:28:55.024380] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:28:55.454408] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-30T17:28:55.704201] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T17:28:56.254345] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-30T17:28:56.319005] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:28:57.054344] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-30T17:28:57.305522] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T17:28:57.854577] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-30T17:28:58.255567] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:28:58.260959] [INFO ] [REMOTE ] BCO: Full fetch complete (36745 records). [2025-09-30T17:28:58.261089] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-30T17:28:58.659444] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-30T17:28:58.702286] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-30T17:28:58.702552] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-30T17:28:58.703159] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-30T17:28:58.703309] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-30T17:28:58.704618] [DEBUG] [LOCAL ] BCO: Trimmed 36745 records to 26127 (keeping 200 days of data) [2025-09-30T17:28:58.874895] [DEBUG] [LOCAL ] BCO: Primary data saved (26127 records). [2025-09-30T17:28:58.875031] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-30T17:28:58.875117] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 30.7s. Estimated remaining: 4h 21m 38s. Rate: 8.2 symbols/min [2025-09-30T17:28:59.088210] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:59.089796] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:28:59.119445] [DEBUG] [LOCAL ] BDC: Loaded 24595 existing records from primary storage. [2025-09-30T17:28:59.119746] [INFO ] [MAIN ] BDC: Loaded 24595 existing records. [2025-09-30T17:28:59.304200] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:59.304458] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-30T17:28:59.304507] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-30T17:28:59.304871] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-30T17:28:59.304931] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-30T17:28:59.463254] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-30T17:28:59.706536] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:59.734140] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T17:29:00.254373] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-30T17:29:01.054364] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-30T17:29:01.424573] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:29:01.426378] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T17:29:01.854368] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-30T17:29:02.192012] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:29:02.654379] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-30T17:29:03.454376] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-30T17:29:03.602052] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:29:03.630634] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T17:29:04.254334] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-30T17:29:04.321308] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:29:05.054379] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-30T17:29:05.844073] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:29:05.855131] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-30T17:29:06.047181] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T17:29:06.654351] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-30T17:29:06.783038] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:29:07.454359] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-30T17:29:07.528592] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:29:08.254371] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-30T17:29:09.054344] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-30T17:29:09.168880] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T17:29:09.279489] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T17:29:09.290972] [INFO ] [REMOTE ] BCS: Full fetch complete (77302 records). [2025-09-30T17:29:09.291146] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-30T17:29:09.719173] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-30T17:29:09.719511] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-30T17:29:09.720443] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-30T17:29:09.720515] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-30T17:29:09.722273] [DEBUG] [LOCAL ] BCS: Trimmed 77302 records to 53457 (keeping 200 days of data) [2025-09-30T17:29:09.855449] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-30T17:29:10.069469] [DEBUG] [LOCAL ] BCS: Primary data saved (53457 records). [2025-09-30T17:29:10.069679] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-30T17:29:10.069815] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCS took 39.3s. Estimated remaining: 4h 22m 6s. Rate: 8.1 symbols/min [2025-09-30T17:29:10.169282] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:29:10.654380] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-30T17:29:10.720620] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:29:11.454381] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-30T17:29:11.695771] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:29:12.254393] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-30T17:29:12.412232] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T17:29:12.417024] [INFO ] [REMOTE ] BCX: Full fetch complete (33896 records). [2025-09-30T17:29:12.417132] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-30T17:29:12.836334] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-30T17:29:12.836426] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-30T17:29:12.836884] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-30T17:29:12.836985] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-30T17:29:12.838011] [DEBUG] [LOCAL ] BCX: Trimmed 33896 records to 21589 (keeping 200 days of data) [2025-09-30T17:29:12.975947] [DEBUG] [LOCAL ] BCX: Primary data saved (21589 records). [2025-09-30T17:29:12.976091] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-30T17:29:12.976178] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 24.2s. Estimated remaining: 4h 21m 18s. Rate: 8.2 symbols/min [2025-09-30T17:29:13.054408] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-30T17:29:13.381192] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:29:13.854431] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-30T17:29:14.261268] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:29:14.654394] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-30T17:29:15.146012] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:29:15.454388] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-30T17:29:15.799135] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T17:29:16.254349] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-30T17:29:16.346537] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:29:17.054397] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-30T17:29:18.153409] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:29:18.162459] [INFO ] [REMOTE ] BCSF: Full fetch complete (38315 records). [2025-09-30T17:29:18.162631] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-30T17:29:18.582770] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-30T17:29:18.582875] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-30T17:29:18.583419] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-30T17:29:18.583513] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-30T17:29:18.585847] [DEBUG] [LOCAL ] BCSF: Trimmed 38315 records to 27698 (keeping 200 days of data) [2025-09-30T17:29:18.773463] [DEBUG] [LOCAL ] BCSF: Primary data saved (27698 records). [2025-09-30T17:29:18.773632] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-30T17:29:18.774336] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCSF took 31.4s. Estimated remaining: 4h 20m 57s. Rate: 8.2 symbols/min [2025-09-30T17:29:19.235868] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T17:29:19.241552] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-30T17:29:20.798967] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:29:20.805219] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-30T17:29:21.721437] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T17:29:21.727346] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-30T17:29:22.730023] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T17:29:22.735611] [INFO ] [REMOTE ] BDC: Full fetch complete (35830 records). [2025-09-30T17:29:22.735772] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-30T17:29:23.176194] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-30T17:29:23.176303] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-30T17:29:23.176889] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-30T17:29:23.176959] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-30T17:29:23.178129] [DEBUG] [LOCAL ] BDC: Trimmed 35830 records to 24593 (keeping 200 days of data) [2025-09-30T17:29:23.335760] [DEBUG] [LOCAL ] BDC: Primary data saved (24593 records). [2025-09-30T17:29:23.335893] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-30T17:29:23.335978] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 24.5s. Estimated remaining: 4h 20m 25s. Rate: 8.2 symbols/min [2025-09-30T17:29:24.011121] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.069170] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.106936] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.162092] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.187361] [DEBUG] [LOCAL ] BDJ: Loaded 28915 existing records from primary storage. [2025-09-30T17:29:24.187888] [INFO ] [MAIN ] BDJ: Loaded 28915 existing records. [2025-09-30T17:29:24.430299] [DEBUG] [LOCAL ] BDN: Loaded 47512 existing records from primary storage. [2025-09-30T17:29:24.488748] [INFO ] [MAIN ] BDN: Loaded 47512 existing records. [2025-09-30T17:29:24.596230] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-30T17:29:24.595323] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:24.629875] [DEBUG] [LOCAL ] BDX: Loaded 52378 existing records from primary storage. [2025-09-30T17:29:24.635729] [INFO ] [MAIN ] BDX: Loaded 52378 existing records. [2025-09-30T17:29:24.635839] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-30T17:29:24.635231] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-30T17:29:24.652432] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-30T17:29:24.705283] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-30T17:29:24.843913] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-30T17:29:25.101694] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.223270] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.263857] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-30T17:29:25.299835] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.371229] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.365828] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.371336] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-30T17:29:25.398516] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-30T17:29:25.398834] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-30T17:29:25.435363] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.447348] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-30T17:29:25.447714] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-30T17:29:25.461906] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-30T17:29:25.476561] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-30T17:29:25.528703] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-30T17:29:26.512458] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:26.638053] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-30T17:29:27.129784] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.197157] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.197893] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-30T17:29:27.232920] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-30T17:29:27.277911] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.278255] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-30T17:29:27.934845] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:29:27.942034] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-30T17:29:30.132564] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-30T17:29:30.144257] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-30T17:29:30.303165] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (3.07 seconds). [2025-09-30T17:29:30.315815] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-30T17:29:30.318988] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-30T17:29:30.326800] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-30T17:29:30.384584] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-30T17:29:30.396012] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-30T17:29:31.239961] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T17:29:31.246359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-30T17:29:31.811088] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T17:29:31.824231] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-30T17:29:31.906187] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:29:31.917851] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-30T17:29:32.150696] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:29:32.161276] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-30T17:29:32.447543] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:29:32.454329] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-30T17:29:33.190474] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:29:33.200686] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-30T17:29:33.509172] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:29:33.518940] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-30T17:29:33.664285] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:29:33.672849] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-30T17:29:33.779719] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T17:29:33.854360] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-30T17:29:34.565103] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:29:34.659808] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-30T17:29:34.673496] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T17:29:34.832677] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:29:35.454342] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-30T17:29:35.494317] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:29:36.151135] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T17:29:36.216539] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:29:36.254378] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-30T17:29:37.054406] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-30T17:29:37.325445] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:29:37.854364] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-30T17:29:38.408884] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:29:38.654363] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-30T17:29:38.729572] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:29:39.454360] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-30T17:29:40.254344] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-30T17:29:40.486705] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T17:29:40.878233] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:29:41.054359] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-30T17:29:41.115828] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:29:41.123361] [INFO ] [REMOTE ] BDJ: Full fetch complete (42936 records). [2025-09-30T17:29:41.123553] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-30T17:29:41.529633] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-30T17:29:41.529769] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-30T17:29:41.530268] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-30T17:29:41.530312] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-30T17:29:41.531428] [DEBUG] [LOCAL ] BDJ: Trimmed 42936 records to 28950 (keeping 200 days of data) [2025-09-30T17:29:41.712142] [DEBUG] [LOCAL ] BDJ: Primary data saved (28950 records). [2025-09-30T17:29:41.712293] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-30T17:29:41.712419] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 18.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-09-30T17:29:41.869670] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-30T17:29:41.906675] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:41.906853] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-30T17:29:41.906894] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-30T17:29:41.907017] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-30T17:29:41.907093] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-30T17:29:41.907162] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-30T17:29:41.907198] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-30T17:29:42.297523] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:42.654385] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-30T17:29:42.706372] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:29:43.034063] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:29:43.048453] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-30T17:29:43.454363] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-30T17:29:44.254372] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-30T17:29:44.696916] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T17:29:45.054405] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-30T17:29:45.373696] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T17:29:45.854374] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-30T17:29:46.117768] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-30T17:29:46.261367] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:29:46.654369] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-30T17:29:47.454376] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-30T17:29:47.859969] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:29:48.254374] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-30T17:29:48.669926] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T17:29:48.953972] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T17:29:49.054382] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-30T17:29:49.854373] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-30T17:29:50.654351] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-30T17:29:50.776775] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T17:29:50.993823] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:29:51.440249] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:29:51.454316] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-30T17:29:52.254359] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-30T17:29:52.584425] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T17:29:53.054322] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-30T17:29:53.249583] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:29:53.261008] [INFO ] [REMOTE ] BDN: Full fetch complete (69261 records). [2025-09-30T17:29:53.261156] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-30T17:29:53.705160] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-30T17:29:53.705255] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-30T17:29:53.706074] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-30T17:29:53.706146] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-30T17:29:53.707717] [DEBUG] [LOCAL ] BDN: Trimmed 69261 records to 47511 (keeping 200 days of data) [2025-09-30T17:29:53.854597] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-30T17:29:54.028061] [DEBUG] [LOCAL ] BDN: Primary data saved (47511 records). [2025-09-30T17:29:54.028218] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-30T17:29:54.028308] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 30.7s. Estimated remaining: 4h 22m 31s. Rate: 8.1 symbols/min [2025-09-30T17:29:54.213314] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:54.268144] [DEBUG] [LOCAL ] BEKE: Loaded 53241 existing records from primary storage. [2025-09-30T17:29:54.268573] [INFO ] [MAIN ] BEKE: Loaded 53241 existing records. [2025-09-30T17:29:54.367358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T17:29:54.463865] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:54.464103] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-30T17:29:54.464151] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-30T17:29:54.465632] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-30T17:29:54.465717] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-30T17:29:54.662134] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-30T17:29:54.850912] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:55.019301] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-30T17:29:55.383440] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-30T17:29:55.454384] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-30T17:29:55.844630] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T17:29:56.254355] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-30T17:29:56.629009] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-30T17:29:56.629897] [INFO ] [REMOTE ] BEDU: Full fetch complete (1453 records). [2025-09-30T17:29:56.629970] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-30T17:29:56.818980] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-30T17:29:56.819187] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:29:56.819259] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:29:56.819331] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-30T17:29:56.819418] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-30T17:29:56.819457] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-30T17:29:56.819523] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-30T17:29:56.819604] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BEDU took 15.1s. Estimated remaining: 4h 21m 44s. Rate: 8.1 symbols/min [2025-09-30T17:29:57.003629] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:57.059459] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-30T17:29:57.061936] [DEBUG] [LOCAL ] BEN: Loaded 53054 existing records from primary storage. [2025-09-30T17:29:57.062454] [INFO ] [MAIN ] BEN: Loaded 53054 existing records. [2025-09-30T17:29:57.270606] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:57.270865] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-30T17:29:57.270914] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-30T17:29:57.272405] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-30T17:29:57.272469] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-30T17:29:57.648857] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:57.854363] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-30T17:29:58.654364] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-30T17:29:58.818992] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:29:59.454340] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-30T17:29:59.924075] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T17:30:00.061774] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:30:00.254368] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-30T17:30:01.059467] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-30T17:30:01.074059] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:30:01.707809] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:30:01.854377] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-30T17:30:02.654365] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-30T17:30:03.178508] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:30:03.189855] [INFO ] [REMOTE ] BDX: Full fetch complete (75777 records). [2025-09-30T17:30:03.190031] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-30T17:30:03.459485] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-30T17:30:03.645944] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-30T17:30:03.646181] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-30T17:30:03.647136] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-30T17:30:03.647256] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-30T17:30:03.649048] [DEBUG] [LOCAL ] BDX: Trimmed 75777 records to 52372 (keeping 200 days of data) [2025-09-30T17:30:03.779754] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T17:30:04.055711] [DEBUG] [LOCAL ] BDX: Primary data saved (52372 records). [2025-09-30T17:30:04.055868] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-30T17:30:04.055959] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 40.7s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-09-30T17:30:04.267475] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:04.263197] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-30T17:30:04.305396] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:30:04.352499] [DEBUG] [LOCAL ] BEP: Loaded 38575 existing records from primary storage. [2025-09-30T17:30:04.352876] [INFO ] [MAIN ] BEP: Loaded 38575 existing records. [2025-09-30T17:30:04.573159] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:04.573484] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-30T17:30:04.573547] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-30T17:30:04.574024] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-30T17:30:04.574093] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-30T17:30:04.994979] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:05.054387] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-30T17:30:05.854343] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-30T17:30:06.124449] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-30T17:30:06.136023] [INFO ] [REMOTE ] BE: Full fetch complete (77272 records). [2025-09-30T17:30:06.136200] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-30T17:30:06.137198] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:30:06.137304] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:30:06.137355] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:30:06.137446] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-30T17:30:06.137548] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-30T17:30:06.137827] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-30T17:30:06.138232] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-30T17:30:06.138338] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BE took 42.8s. Estimated remaining: 4h 20m 42s. Rate: 8.2 symbols/min [2025-09-30T17:30:06.350906] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:06.379767] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:30:06.425567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T17:30:06.480695] [DEBUG] [LOCAL ] BEPC: Loaded 46440 existing records from primary storage. [2025-09-30T17:30:06.481055] [INFO ] [MAIN ] BEPC: Loaded 46440 existing records. [2025-09-30T17:30:06.660765] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-30T17:30:06.699686] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:06.699951] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-30T17:30:06.700007] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-30T17:30:06.700773] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-30T17:30:06.700837] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-30T17:30:07.104389] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:07.179018] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:30:07.454431] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-30T17:30:08.017820] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:30:08.254425] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-30T17:30:09.054391] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-30T17:30:09.110787] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:30:09.854402] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-30T17:30:10.018877] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T17:30:10.292441] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T17:30:10.654364] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-30T17:30:11.454407] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-30T17:30:11.815122] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T17:30:12.066405] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-30T17:30:12.254376] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-30T17:30:12.835731] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T17:30:13.054358] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-30T17:30:13.447323] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:30:13.854383] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-30T17:30:14.654334] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-30T17:30:14.947150] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T17:30:15.135676] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:30:15.454368] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-30T17:30:16.072160] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:30:16.254401] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-30T17:30:17.054431] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-30T17:30:17.304121] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:30:17.579320] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:30:17.854408] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-30T17:30:18.629170] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:30:18.654452] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-30T17:30:19.454390] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-30T17:30:19.779386] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:30:20.177014] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:30:20.254370] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-30T17:30:20.638447] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T17:30:21.054377] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-30T17:30:21.624500] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:30:21.854383] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-30T17:30:22.364340] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:30:22.654358] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-30T17:30:23.042057] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:30:23.454391] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-30T17:30:24.254319] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-30T17:30:24.347159] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T17:30:25.055087] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-30T17:30:25.055011] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:30:25.311153] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:30:25.854357] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-30T17:30:26.654363] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-30T17:30:26.928662] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T17:30:27.454336] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-30T17:30:27.551540] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:30:27.570674] [INFO ] [REMOTE ] BEKE: Full fetch complete (77192 records). [2025-09-30T17:30:27.570931] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-30T17:30:27.992238] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:30:28.109952] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-30T17:30:28.110053] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-30T17:30:28.110865] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-30T17:30:28.110932] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-30T17:30:28.112430] [DEBUG] [LOCAL ] BEKE: Trimmed 77192 records to 53241 (keeping 200 days of data) [2025-09-30T17:30:28.295180] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-30T17:30:28.470384] [DEBUG] [LOCAL ] BEKE: Primary data saved (53241 records). [2025-09-30T17:30:28.470574] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-30T17:30:28.474087] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEKE took 34.4s. Estimated remaining: 4h 22m 44s. Rate: 8.1 symbols/min [2025-09-30T17:30:28.708131] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:28.708343] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-09-30T17:30:28.708422] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-09-30T17:30:28.708559] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-30T17:30:28.708603] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-30T17:30:28.708672] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-09-30T17:30:28.708728] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-30T17:30:29.059407] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-30T17:30:29.143043] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:29.181889] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T17:30:29.863470] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-30T17:30:29.869274] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:30:29.879179] [INFO ] [REMOTE ] BEP: Full fetch complete (58361 records). [2025-09-30T17:30:29.879363] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-30T17:30:30.291629] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-30T17:30:30.291751] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-30T17:30:30.292453] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-30T17:30:30.292507] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-30T17:30:30.294762] [DEBUG] [LOCAL ] BEP: Trimmed 58361 records to 38613 (keeping 200 days of data) [2025-09-30T17:30:30.536465] [DEBUG] [LOCAL ] BEP: Primary data saved (38613 records). [2025-09-30T17:30:30.536675] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-30T17:30:30.538446] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 26.5s. Estimated remaining: 4h 21m 50s. Rate: 8.1 symbols/min [2025-09-30T17:30:30.654328] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-30T17:30:30.671253] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T17:30:30.751635] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:30.765877] [DEBUG] [LOCAL ] BEPI: Loaded 3481 existing records from primary storage. [2025-09-30T17:30:30.766190] [INFO ] [MAIN ] BEPI: Loaded 3481 existing records. [2025-09-30T17:30:30.991413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T17:30:30.997667] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:31.008069] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-30T17:30:31.008281] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-30T17:30:31.008913] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-30T17:30:31.008994] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-30T17:30:31.407944] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:31.454374] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-30T17:30:31.967266] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:30:32.138799] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:30:32.155404] [INFO ] [REMOTE ] BEN: Full fetch complete (76504 records). [2025-09-30T17:30:32.155607] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-30T17:30:32.156670] [FATAL] [VALIDATOR ] BEN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:30:32.156763] [FATAL] [MAIN ] BEN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:30:32.156808] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:30:32.156848] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-30T17:30:32.156920] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-09-30T17:30:32.156990] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-09-30T17:30:32.157265] [DEBUG] [LOCAL ] BEN: Deleted derivative data file. [2025-09-30T17:30:32.157421] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEN took 35.3s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-30T17:30:32.259524] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-30T17:30:32.357610] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:32.363365] [DEBUG] [LOCAL ] BEPJ: Loaded 3138 existing records from primary storage. [2025-09-30T17:30:32.363581] [INFO ] [MAIN ] BEPJ: Loaded 3138 existing records. [2025-09-30T17:30:32.589570] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:32.589903] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-30T17:30:32.589965] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-30T17:30:32.590323] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-30T17:30:32.590391] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-30T17:30:32.884010] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:30:33.003288] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:33.054321] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-30T17:30:33.607421] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T17:30:33.854388] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-30T17:30:34.427690] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:30:34.654375] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-30T17:30:35.122790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T17:30:35.454378] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-30T17:30:35.885287] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T17:30:36.254393] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-30T17:30:36.659291] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T17:30:37.054387] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-30T17:30:37.854401] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-30T17:30:38.243886] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T17:30:38.413465] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T17:30:38.654409] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-30T17:30:39.454426] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-30T17:30:40.124727] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T17:30:40.254392] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-30T17:30:40.344098] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:30:40.356384] [INFO ] [REMOTE ] BEPC: Full fetch complete (68466 records). [2025-09-30T17:30:40.356539] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-30T17:30:40.746585] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T17:30:40.790329] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-30T17:30:40.790433] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-30T17:30:40.791228] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-30T17:30:40.791296] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-30T17:30:40.792748] [DEBUG] [LOCAL ] BEPC: Trimmed 68466 records to 46429 (keeping 200 days of data) [2025-09-30T17:30:41.055141] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-30T17:30:41.100004] [DEBUG] [LOCAL ] BEPC: Primary data saved (46429 records). [2025-09-30T17:30:41.100196] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-30T17:30:41.100345] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPC took 35.0s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-09-30T17:30:41.289440] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:41.324873] [DEBUG] [LOCAL ] BFAM: Loaded 33077 existing records from primary storage. [2025-09-30T17:30:41.325195] [INFO ] [MAIN ] BFAM: Loaded 33077 existing records. [2025-09-30T17:30:41.522942] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:41.523160] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-30T17:30:41.523208] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-30T17:30:41.524165] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-30T17:30:41.524267] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-30T17:30:41.619932] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:30:41.859531] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-30T17:30:41.945767] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:42.312827] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:30:42.654409] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-30T17:30:43.454390] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-30T17:30:43.866434] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:30:44.084391] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:30:44.254372] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-30T17:30:44.700328] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:30:45.054391] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-30T17:30:45.776041] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:30:45.854316] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-30T17:30:46.514109] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:30:46.654383] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-30T17:30:47.176409] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:30:47.454417] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-30T17:30:48.073585] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:30:48.254405] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-30T17:30:49.054423] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-30T17:30:49.405765] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:30:49.761068] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T17:30:49.762854] [INFO ] [REMOTE ] BEPH: Full fetch complete (7713 records). [2025-09-30T17:30:49.763029] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-30T17:30:49.859492] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-30T17:30:50.165631] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-30T17:30:50.165747] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-30T17:30:50.165974] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-30T17:30:50.166027] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-30T17:30:50.166591] [DEBUG] [LOCAL ] BEPH: Trimmed 7713 records to 5285 (keeping 200 days of data) [2025-09-30T17:30:50.200110] [DEBUG] [LOCAL ] BEPH: Primary data saved (5285 records). [2025-09-30T17:30:50.200248] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-30T17:30:50.200374] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 21.7s. Estimated remaining: 4h 21m 7s. Rate: 8.1 symbols/min [2025-09-30T17:30:50.407122] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:50.461020] [DEBUG] [LOCAL ] BFH: Loaded 41647 existing records from primary storage. [2025-09-30T17:30:50.461319] [INFO ] [MAIN ] BFH: Loaded 41647 existing records. [2025-09-30T17:30:50.582832] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:30:50.658842] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-30T17:30:50.662923] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:50.664383] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-30T17:30:50.664456] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-30T17:30:50.666413] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-30T17:30:50.666483] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-30T17:30:51.053843] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:51.264192] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:30:51.454390] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-30T17:30:51.904168] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T17:30:52.254370] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-30T17:30:53.054392] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-30T17:30:53.503554] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:30:53.505455] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T17:30:53.854398] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-30T17:30:54.278740] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T17:30:54.279980] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4492 records). [2025-09-30T17:30:54.280054] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-30T17:30:54.661421] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-30T17:30:54.701528] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-30T17:30:54.701616] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-30T17:30:54.701805] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-30T17:30:54.701862] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-30T17:30:54.702299] [DEBUG] [LOCAL ] BEPJ: Trimmed 4492 records to 3144 (keeping 200 days of data) [2025-09-30T17:30:54.724390] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3144 records). [2025-09-30T17:30:54.724539] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-30T17:30:54.724624] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 22.6s. Estimated remaining: 4h 20m 35s. Rate: 8.1 symbols/min [2025-09-30T17:30:54.933324] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:54.949789] [DEBUG] [LOCAL ] BFK: Loaded 13908 existing records from primary storage. [2025-09-30T17:30:54.950032] [INFO ] [MAIN ] BFK: Loaded 13908 existing records. [2025-09-30T17:30:55.161350] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:55.161976] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-30T17:30:55.162073] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-30T17:30:55.162887] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-30T17:30:55.162959] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-30T17:30:55.459580] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-30T17:30:55.570947] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:56.137247] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:30:56.254368] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-30T17:30:56.981835] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T17:30:57.013978] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:30:57.054422] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-30T17:30:57.465764] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T17:30:57.854421] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-30T17:30:58.253269] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T17:30:58.654411] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-30T17:30:59.110509] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:30:59.454445] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-30T17:30:59.972777] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T17:30:59.973992] [INFO ] [REMOTE ] BEPI: Full fetch complete (5015 records). [2025-09-30T17:30:59.974091] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-30T17:31:00.259560] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-30T17:31:00.383104] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-30T17:31:00.383210] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-30T17:31:00.383402] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-30T17:31:00.383444] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-30T17:31:00.383861] [DEBUG] [LOCAL ] BEPI: Trimmed 5015 records to 3514 (keeping 200 days of data) [2025-09-30T17:31:00.405855] [DEBUG] [LOCAL ] BEPI: Primary data saved (3514 records). [2025-09-30T17:31:00.405973] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-30T17:31:00.406059] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPI took 29.9s. Estimated remaining: 4h 20m 13s. Rate: 8.1 symbols/min [2025-09-30T17:31:00.599660] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:00.670168] [DEBUG] [LOCAL ] BFLY: Loaded 51799 existing records from primary storage. [2025-09-30T17:31:00.670552] [INFO ] [MAIN ] BFLY: Loaded 51799 existing records. [2025-09-30T17:31:00.870975] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:00.871338] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-30T17:31:00.871398] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-30T17:31:00.873389] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-30T17:31:00.873453] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-30T17:31:01.056619] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-30T17:31:01.255807] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:01.391960] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:31:01.854439] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-30T17:31:02.244406] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:31:02.654361] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-30T17:31:03.304385] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:31:03.454400] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-30T17:31:03.485508] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:31:04.254354] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-30T17:31:04.537399] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:31:05.054359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-30T17:31:05.854347] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-30T17:31:05.995073] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:31:06.032461] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T17:31:06.654383] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-30T17:31:06.959480] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:31:07.454359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-30T17:31:08.254403] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-30T17:31:08.411145] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:31:08.446865] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:31:09.054424] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-30T17:31:09.508287] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:31:09.854392] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-30T17:31:10.565840] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:31:10.593234] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:31:10.654638] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-30T17:31:11.360014] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T17:31:11.454747] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-30T17:31:12.254360] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-30T17:31:12.923512] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:31:13.048888] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T17:31:13.054327] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-30T17:31:13.854372] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-30T17:31:14.111967] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:31:14.654402] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-30T17:31:15.352342] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:31:15.454353] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-30T17:31:16.134554] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:31:16.199413] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T17:31:16.254362] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-30T17:31:17.054356] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-30T17:31:17.214539] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T17:31:17.854389] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-30T17:31:18.654370] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-30T17:31:18.812307] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:31:18.872791] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:31:18.876779] [INFO ] [REMOTE ] BFK: Full fetch complete (19240 records). [2025-09-30T17:31:18.876866] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-30T17:31:19.297288] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-30T17:31:19.297608] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-30T17:31:19.298093] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-30T17:31:19.298163] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-30T17:31:19.299177] [DEBUG] [LOCAL ] BFK: Trimmed 19240 records to 13853 (keeping 200 days of data) [2025-09-30T17:31:19.390400] [DEBUG] [LOCAL ] BFK: Primary data saved (13853 records). [2025-09-30T17:31:19.390579] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-30T17:31:19.390706] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFK took 24.7s. Estimated remaining: 4h 21m 43s. Rate: 8.1 symbols/min [2025-09-30T17:31:19.460800] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-30T17:31:19.583094] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:19.583288] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-09-30T17:31:19.583337] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-09-30T17:31:19.583473] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-30T17:31:19.583515] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-30T17:31:19.583557] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-30T17:31:19.583590] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-30T17:31:19.980210] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:20.251520] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:31:20.265080] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-30T17:31:20.756125] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:31:21.054370] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-30T17:31:21.482222] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:31:21.822907] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T17:31:21.854373] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-30T17:31:22.654374] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-30T17:31:23.330957] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:31:23.454367] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-30T17:31:23.739393] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:31:24.254355] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-30T17:31:25.054351] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-30T17:31:25.251479] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:31:25.706298] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:31:25.714961] [INFO ] [REMOTE ] BFH: Full fetch complete (59713 records). [2025-09-30T17:31:25.715135] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-30T17:31:25.859447] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-30T17:31:26.155164] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-30T17:31:26.155289] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-30T17:31:26.156014] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-30T17:31:26.156081] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-30T17:31:26.157405] [DEBUG] [LOCAL ] BFH: Trimmed 59713 records to 41617 (keeping 200 days of data) [2025-09-30T17:31:26.419989] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T17:31:26.435442] [INFO ] [REMOTE ] BFAM: Full fetch complete (46693 records). [2025-09-30T17:31:26.445808] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:31:26.445989] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-30T17:31:26.451462] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:31:26.453441] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:31:26.455558] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:31:26.457708] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-30T17:31:26.458873] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-09-30T17:31:26.460180] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-09-30T17:31:26.461314] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-09-30T17:31:26.461995] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFAM took 45.4s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-09-30T17:31:26.668064] [DEBUG] [LOCAL ] BFH: Primary data saved (41617 records). [2025-09-30T17:31:26.667962] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-30T17:31:26.669699] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-30T17:31:26.671980] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 36.5s. Estimated remaining: 4h 20m 26s. Rate: 8.1 symbols/min [2025-09-30T17:31:26.694224] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:26.757073] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-09-30T17:31:26.785915] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-09-30T17:31:26.813451] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-30T17:31:26.819252] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-30T17:31:26.834704] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-09-30T17:31:26.839897] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-30T17:31:26.980987] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:27.316563] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:27.332127] [DEBUG] [LOCAL ] BG: Loaded 50382 existing records from primary storage. [2025-09-30T17:31:27.332415] [INFO ] [MAIN ] BG: Loaded 50382 existing records. [2025-09-30T17:31:27.452339] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:31:27.463383] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-30T17:31:27.543155] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:27.543382] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-30T17:31:27.543435] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-30T17:31:27.545255] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-30T17:31:27.545321] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-30T17:31:27.934478] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:28.254445] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-30T17:31:28.999519] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:31:29.054410] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-30T17:31:29.827135] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T17:31:29.854333] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-30T17:31:29.955720] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:31:30.654411] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-30T17:31:31.454342] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-30T17:31:31.474488] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T17:31:31.703964] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:31:32.122949] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T17:31:32.254390] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-30T17:31:32.861385] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:31:33.054410] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-30T17:31:33.854372] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-30T17:31:34.513067] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T17:31:34.654374] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-30T17:31:34.999480] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T17:31:35.414478] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T17:31:35.454424] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-30T17:31:36.083548] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T17:31:36.254367] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-30T17:31:37.054398] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-30T17:31:37.821459] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:31:37.854332] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-30T17:31:37.974260] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:31:37.985278] [INFO ] [REMOTE ] BFLY: Full fetch complete (75245 records). [2025-09-30T17:31:37.985450] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-30T17:31:38.404089] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-30T17:31:38.404183] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-30T17:31:38.405091] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-30T17:31:38.405162] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-30T17:31:38.406766] [DEBUG] [LOCAL ] BFLY: Trimmed 75245 records to 51779 (keeping 200 days of data) [2025-09-30T17:31:38.671415] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-30T17:31:38.716147] [DEBUG] [LOCAL ] BFLY: Primary data saved (51779 records). [2025-09-30T17:31:38.716265] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-30T17:31:38.716947] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 38.3s. Estimated remaining: 4h 20m 57s. Rate: 8.1 symbols/min [2025-09-30T17:31:38.806389] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T17:31:38.915916] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:38.937424] [DEBUG] [LOCAL ] BGB: Loaded 17484 existing records from primary storage. [2025-09-30T17:31:38.937754] [INFO ] [MAIN ] BGB: Loaded 17484 existing records. [2025-09-30T17:31:39.135691] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:39.135950] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-30T17:31:39.136009] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-30T17:31:39.136629] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-30T17:31:39.136728] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-30T17:31:39.459473] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-30T17:31:39.519967] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:40.226322] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:31:40.254315] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-30T17:31:40.380525] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:31:40.383827] [INFO ] [REMOTE ] BFS: Full fetch complete (12654 records). [2025-09-30T17:31:40.383917] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-30T17:31:40.787252] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-30T17:31:40.787333] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-30T17:31:40.787634] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-30T17:31:40.787715] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-30T17:31:40.788194] [DEBUG] [LOCAL ] BFS: Trimmed 12654 records to 9115 (keeping 200 days of data) [2025-09-30T17:31:40.845553] [DEBUG] [LOCAL ] BFS: Primary data saved (9115 records). [2025-09-30T17:31:40.845724] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-30T17:31:40.845810] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 21.5s. Estimated remaining: 4h 20m 6s. Rate: 8.1 symbols/min [2025-09-30T17:31:41.035371] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:41.054563] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-30T17:31:41.055036] [DEBUG] [LOCAL ] BGH: Loaded 16600 existing records from primary storage. [2025-09-30T17:31:41.056445] [INFO ] [MAIN ] BGH: Loaded 16600 existing records. [2025-09-30T17:31:41.252018] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:41.252245] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-30T17:31:41.252293] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-30T17:31:41.252919] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-30T17:31:41.252980] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-30T17:31:41.661894] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:41.724457] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:31:41.854376] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-30T17:31:41.980776] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T17:31:42.654407] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-30T17:31:42.949609] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:31:43.454329] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-30T17:31:43.733883] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:31:44.254405] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-30T17:31:44.272843] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T17:31:44.997470] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T17:31:45.054376] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-30T17:31:45.854423] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-30T17:31:46.314878] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T17:31:46.654361] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-30T17:31:46.703338] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:31:47.294529] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T17:31:47.454373] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-30T17:31:48.254372] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-30T17:31:48.427554] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:31:48.779432] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T17:31:49.054375] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-30T17:31:49.814167] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:31:49.854320] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-30T17:31:50.654410] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-30T17:31:51.258637] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:31:51.363293] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:31:51.454386] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-30T17:31:52.254361] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-30T17:31:53.030581] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:31:53.054317] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-30T17:31:53.072220] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T17:31:53.854392] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-30T17:31:54.639572] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:31:54.654362] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-30T17:31:54.948985] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T17:31:55.454395] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-30T17:31:55.505904] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T17:31:56.254360] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-30T17:31:56.288121] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T17:31:57.054396] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-30T17:31:57.505243] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:31:57.854478] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-30T17:31:58.595215] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:31:58.654378] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-30T17:31:58.844547] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:31:59.454382] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-30T17:32:00.188832] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:32:00.251905] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T17:32:00.255876] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-30T17:32:00.256935] [INFO ] [REMOTE ] BFZ: Full fetch complete (18103 records). [2025-09-30T17:32:00.257765] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-30T17:32:00.681194] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-30T17:32:00.681290] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-30T17:32:00.681638] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-30T17:32:00.681724] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-30T17:32:00.682364] [DEBUG] [LOCAL ] BFZ: Trimmed 18103 records to 12147 (keeping 200 days of data) [2025-09-30T17:32:00.764680] [DEBUG] [LOCAL ] BFZ: Primary data saved (12147 records). [2025-09-30T17:32:00.764846] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-30T17:32:00.764929] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 34.3s. Estimated remaining: 4h 21m 41s. Rate: 8.1 symbols/min [2025-09-30T17:32:00.967200] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:00.982595] [DEBUG] [LOCAL ] BGR: Loaded 13477 existing records from primary storage. [2025-09-30T17:32:00.982823] [INFO ] [MAIN ] BGR: Loaded 13477 existing records. [2025-09-30T17:32:01.059587] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-30T17:32:01.187956] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:01.188191] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-30T17:32:01.188248] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-30T17:32:01.188993] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-30T17:32:01.189089] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-30T17:32:01.606879] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:01.758520] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T17:32:01.854423] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-30T17:32:02.341256] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:32:02.352936] [INFO ] [REMOTE ] BG: Full fetch complete (72778 records). [2025-09-30T17:32:02.353103] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-30T17:32:02.503776] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T17:32:02.664148] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-30T17:32:02.811944] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-30T17:32:02.812031] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-30T17:32:02.812901] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-30T17:32:02.812977] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-30T17:32:02.814488] [DEBUG] [LOCAL ] BG: Trimmed 72778 records to 50409 (keeping 200 days of data) [2025-09-30T17:32:03.147836] [DEBUG] [LOCAL ] BG: Primary data saved (50409 records). [2025-09-30T17:32:03.147986] [INFO ] [MAIN ] BG: Full history saved. [2025-09-30T17:32:03.149543] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BG took 36.5s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-30T17:32:03.354323] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:03.374582] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T17:32:03.440931] [DEBUG] [LOCAL ] BGS: Loaded 50439 existing records from primary storage. [2025-09-30T17:32:03.441400] [INFO ] [MAIN ] BGS: Loaded 50439 existing records. [2025-09-30T17:32:03.459725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-30T17:32:03.738941] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:03.739201] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-30T17:32:03.739283] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-30T17:32:03.741224] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-30T17:32:03.741322] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-30T17:32:04.259730] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-30T17:32:04.387149] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:04.495513] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T17:32:05.006127] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T17:32:05.054412] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-30T17:32:05.854369] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-30T17:32:06.195089] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:32:06.199389] [INFO ] [REMOTE ] BGH: Full fetch complete (22215 records). [2025-09-30T17:32:06.199494] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-30T17:32:06.592383] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-30T17:32:06.592481] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-30T17:32:06.592865] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-30T17:32:06.592927] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-30T17:32:06.593587] [DEBUG] [LOCAL ] BGH: Trimmed 22215 records to 16746 (keeping 200 days of data) [2025-09-30T17:32:06.654923] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-30T17:32:06.715969] [DEBUG] [LOCAL ] BGH: Primary data saved (16746 records). [2025-09-30T17:32:06.716157] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-30T17:32:06.716266] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGH took 25.9s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min [2025-09-30T17:32:06.907934] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:06.908128] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-09-30T17:32:06.908175] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-09-30T17:32:06.908296] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-30T17:32:06.908339] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-30T17:32:06.908433] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-30T17:32:06.908472] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-30T17:32:07.301576] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:07.345310] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T17:32:07.454327] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-30T17:32:07.842893] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:32:07.930842] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T17:32:08.254380] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-30T17:32:09.054383] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-30T17:32:09.849021] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:32:09.854299] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-30T17:32:09.967514] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:32:10.424544] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T17:32:10.654376] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-30T17:32:11.454379] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-30T17:32:11.485598] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T17:32:11.489350] [INFO ] [REMOTE ] BGB: Full fetch complete (26795 records). [2025-09-30T17:32:11.489497] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-30T17:32:11.490058] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:32:11.490148] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:32:11.490192] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:32:11.490252] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-30T17:32:11.490369] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-09-30T17:32:11.490409] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-09-30T17:32:11.490774] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-09-30T17:32:11.490873] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGB took 32.8s. Estimated remaining: 4h 19m 46s. Rate: 8.1 symbols/min [2025-09-30T17:32:11.690288] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:11.709532] [DEBUG] [LOCAL ] BGT: Loaded 16594 existing records from primary storage. [2025-09-30T17:32:11.709918] [INFO ] [MAIN ] BGT: Loaded 16594 existing records. [2025-09-30T17:32:11.925743] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:11.925966] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-30T17:32:11.926021] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-30T17:32:11.926265] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-30T17:32:11.926331] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-30T17:32:12.259534] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-30T17:32:12.329909] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:12.741403] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:32:13.054342] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-30T17:32:13.100265] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:32:13.362836] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T17:32:13.854397] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-30T17:32:14.654365] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-30T17:32:15.022554] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:32:15.454357] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-30T17:32:15.976157] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:32:16.254407] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-30T17:32:16.524731] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:32:16.976886] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T17:32:17.054380] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-30T17:32:17.803566] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:32:17.854347] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-30T17:32:18.654350] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-30T17:32:18.789784] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T17:32:19.454375] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-30T17:32:20.092817] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T17:32:20.197548] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:32:20.254383] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-30T17:32:20.885843] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T17:32:21.054358] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-30T17:32:21.854372] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-30T17:32:22.059414] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:32:22.659800] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-30T17:32:22.667337] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T17:32:23.454390] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-30T17:32:24.045705] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T17:32:24.254380] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-30T17:32:24.345238] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T17:32:24.942908] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T17:32:25.054389] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-30T17:32:25.854393] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-30T17:32:26.327632] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T17:32:26.531862] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:32:26.654412] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-30T17:32:27.118226] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-30T17:32:27.454376] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-30T17:32:28.254361] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-30T17:32:28.524008] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:32:29.054324] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-30T17:32:29.358800] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:32:29.854381] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-30T17:32:30.507514] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:32:30.654373] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-30T17:32:30.756154] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:32:31.407170] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T17:32:31.411273] [INFO ] [REMOTE ] BGT: Full fetch complete (24340 records). [2025-09-30T17:32:31.411374] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-30T17:32:31.459550] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-30T17:32:31.838806] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-30T17:32:31.838909] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-30T17:32:31.839281] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-30T17:32:31.839329] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-30T17:32:31.840061] [DEBUG] [LOCAL ] BGT: Trimmed 24340 records to 16599 (keeping 200 days of data) [2025-09-30T17:32:31.945884] [DEBUG] [LOCAL ] BGT: Primary data saved (16599 records). [2025-09-30T17:32:31.946032] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-30T17:32:31.946141] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGT took 20.5s. Estimated remaining: 4h 21m 23s. Rate: 8.1 symbols/min [2025-09-30T17:32:32.129157] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:32.142864] [DEBUG] [LOCAL ] BGX: Loaded 10834 existing records from primary storage. [2025-09-30T17:32:32.143065] [INFO ] [MAIN ] BGX: Loaded 10834 existing records. [2025-09-30T17:32:32.259465] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-30T17:32:32.334282] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:32.334558] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-30T17:32:32.334608] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-30T17:32:32.335376] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-30T17:32:32.335438] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-30T17:32:32.472901] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:32:32.758445] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:33.054371] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-30T17:32:33.854394] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-30T17:32:33.915064] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:32:33.977441] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:32:34.517430] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:32:34.654398] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-30T17:32:35.454388] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-30T17:32:35.491857] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:32:36.254368] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-30T17:32:36.319687] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:32:37.054391] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-30T17:32:37.615298] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:32:37.739811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:32:37.854388] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-30T17:32:38.654418] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-30T17:32:39.454377] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-30T17:32:39.588991] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:32:39.608104] [INFO ] [REMOTE ] BGS: Full fetch complete (72496 records). [2025-09-30T17:32:39.609289] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-30T17:32:39.609101] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:32:40.044004] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-30T17:32:40.044105] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-30T17:32:40.044894] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-30T17:32:40.044977] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-30T17:32:40.048162] [DEBUG] [LOCAL ] BGS: Trimmed 72496 records to 50452 (keeping 200 days of data) [2025-09-30T17:32:40.264383] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-30T17:32:40.364556] [DEBUG] [LOCAL ] BGS: Primary data saved (50452 records). [2025-09-30T17:32:40.364741] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-30T17:32:40.367455] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 37.2s. Estimated remaining: 4h 21m 24s. Rate: 8.1 symbols/min [2025-09-30T17:32:40.563137] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:40.576354] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:32:40.581912] [INFO ] [REMOTE ] BGSF: Full fetch complete (8546 records). [2025-09-30T17:32:40.582036] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-30T17:32:40.778899] [DEBUG] [LOCAL ] BGY: Loaded 22400 existing records from primary storage. [2025-09-30T17:32:40.839584] [INFO ] [MAIN ] BGY: Loaded 22400 existing records. [2025-09-30T17:32:41.055277] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-30T17:32:41.180715] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-30T17:32:41.180425] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:32:41.201883] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-30T17:32:41.221188] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-30T17:32:41.234922] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-30T17:32:41.261185] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:41.262460] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-30T17:32:41.262526] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-30T17:32:41.262820] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-30T17:32:41.263134] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-30T17:32:41.334103] [DEBUG] [LOCAL ] BGSF: Trimmed 8546 records to 7130 (keeping 200 days of data) [2025-09-30T17:32:41.621186] [DEBUG] [LOCAL ] BGSF: Primary data saved (7130 records). [2025-09-30T17:32:41.624026] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-30T17:32:41.629826] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGSF took 34.9s. Estimated remaining: 4h 20m 27s. Rate: 8.1 symbols/min [2025-09-30T17:32:41.803047] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:41.869828] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-30T17:32:41.905203] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:41.905417] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-09-30T17:32:41.905473] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-09-30T17:32:41.905620] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-30T17:32:41.905715] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-30T17:32:41.905848] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-30T17:32:41.905906] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-30T17:32:42.277144] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:32:42.313273] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:42.549420] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T17:32:42.654426] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-30T17:32:43.454380] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-30T17:32:43.524587] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:32:44.045565] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:32:44.254394] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-30T17:32:45.020666] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:32:45.054379] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-30T17:32:45.854388] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-30T17:32:45.943769] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:32:46.654354] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-30T17:32:46.849044] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:32:46.852857] [INFO ] [REMOTE ] BGR: Full fetch complete (20100 records). [2025-09-30T17:32:46.853000] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-30T17:32:46.853574] [FATAL] [VALIDATOR ] BGR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:32:46.853691] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:32:46.853775] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:32:46.853851] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-30T17:32:46.853917] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-09-30T17:32:46.853965] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-09-30T17:32:46.854252] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-09-30T17:32:46.854344] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGR took 46.1s. Estimated remaining: 4h 20m 2s. Rate: 8.1 symbols/min [2025-09-30T17:32:47.046688] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:47.046904] [DEBUG] [LOCAL ] BHC: No existing data file found in primary storage. [2025-09-30T17:32:47.046970] [WARN ] [MAIN ] BHC: No existing data found, performing full refresh instead. [2025-09-30T17:32:47.047103] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-30T17:32:47.047146] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-30T17:32:47.047189] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-09-30T17:32:47.047223] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-30T17:32:47.454424] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-30T17:32:47.457992] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:47.571463] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:32:48.254329] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-30T17:32:48.290848] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:32:49.054419] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-30T17:32:49.854388] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-30T17:32:49.864604] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:32:49.939431] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:32:50.654405] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-30T17:32:50.687935] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:32:51.454398] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-30T17:32:51.634707] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:32:51.982348] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T17:32:52.254413] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-30T17:32:53.054363] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-30T17:32:53.463518] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:32:53.495702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:32:53.854355] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-30T17:32:54.654388] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-30T17:32:54.940607] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:32:55.454379] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-30T17:32:55.872199] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:32:56.254378] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-30T17:32:56.284548] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T17:32:56.288636] [INFO ] [REMOTE ] BGX: Full fetch complete (16008 records). [2025-09-30T17:32:56.288798] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-30T17:32:56.685905] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-30T17:32:56.686001] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-30T17:32:56.686330] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-30T17:32:56.686374] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-30T17:32:56.687715] [DEBUG] [LOCAL ] BGX: Trimmed 16008 records to 10830 (keeping 200 days of data) [2025-09-30T17:32:56.765432] [DEBUG] [LOCAL ] BGX: Primary data saved (10830 records). [2025-09-30T17:32:56.765611] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-30T17:32:56.765779] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 24.8s. Estimated remaining: 4h 20m 15s. Rate: 8.1 symbols/min [2025-09-30T17:32:56.952790] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:56.952950] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-09-30T17:32:56.952987] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-09-30T17:32:56.953096] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-30T17:32:56.953137] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-30T17:32:56.953178] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-30T17:32:56.953209] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-30T17:32:57.059521] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-30T17:32:57.117291] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T17:32:57.360964] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:57.854344] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-30T17:32:58.047079] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:32:58.654402] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-30T17:32:59.202713] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:32:59.261672] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:32:59.454437] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-30T17:33:00.254396] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-30T17:33:00.343103] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:33:01.054347] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-30T17:33:01.365186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:33:01.834728] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T17:33:01.854322] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-30T17:33:02.654361] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-30T17:33:03.051582] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:33:03.454348] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-30T17:33:03.493297] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:33:04.254389] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-30T17:33:04.900960] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:33:05.054332] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-30T17:33:05.136419] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T17:33:05.854410] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-30T17:33:06.139168] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:33:06.654329] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-30T17:33:06.746014] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:33:07.454433] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-30T17:33:08.010038] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:33:08.254373] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-30T17:33:08.422001] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:33:09.054369] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-30T17:33:09.530752] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:33:09.854376] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-30T17:33:10.625153] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:33:10.629511] [INFO ] [REMOTE ] BH: Full fetch complete (19497 records). [2025-09-30T17:33:10.629589] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-30T17:33:10.662033] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-30T17:33:10.975697] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:33:11.016472] [INFO ] [REMOTE ] BGY: Full fetch complete (33252 records). [2025-09-30T17:33:11.034990] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-30T17:33:11.062142] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-30T17:33:11.095178] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-30T17:33:11.120307] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-30T17:33:11.141048] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-30T17:33:11.175333] [DEBUG] [LOCAL ] BH: Trimmed 19497 records to 15828 (keeping 200 days of data) [2025-09-30T17:33:11.459437] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-30T17:33:11.596827] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-30T17:33:11.597306] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-30T17:33:11.597856] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-30T17:33:11.597939] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-30T17:33:11.602063] [DEBUG] [LOCAL ] BGY: Trimmed 33252 records to 22377 (keeping 200 days of data) [2025-09-30T17:33:11.762458] [DEBUG] [LOCAL ] BH: Primary data saved (15828 records). [2025-09-30T17:33:11.769668] [INFO ] [MAIN ] BH: Full history saved. [2025-09-30T17:33:11.771721] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BH took 30.1s. Estimated remaining: 4h 21m 7s. Rate: 8.1 symbols/min [2025-09-30T17:33:11.771568] [DEBUG] [LOCAL ] BGY: Primary data saved (22377 records). [2025-09-30T17:33:11.784506] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-30T17:33:11.811966] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BGY took 31.4s. Estimated remaining: 4h 20m 2s. Rate: 8.1 symbols/min [2025-09-30T17:33:12.205714] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:12.238745] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:12.260089] [DEBUG] [LOCAL ] BHK: Loaded 22906 existing records from primary storage. [2025-09-30T17:33:12.260604] [INFO ] [MAIN ] BHK: Loaded 22906 existing records. [2025-09-30T17:33:12.497942] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:12.526501] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-09-30T17:33:12.526668] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-30T17:33:12.530358] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-30T17:33:12.530807] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-09-30T17:33:12.536129] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-30T17:33:12.553492] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-30T17:33:12.586790] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:33:12.722877] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-30T17:33:12.875627] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:12.897194] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-30T17:33:12.961214] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-30T17:33:13.003135] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-30T17:33:13.015536] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-30T17:33:13.220909] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:33:13.324991] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-30T17:33:13.399390] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:13.627371] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:13.854397] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-30T17:33:14.386450] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:33:14.654386] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-30T17:33:14.744882] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:33:14.777477] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:33:15.454437] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-30T17:33:16.030092] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:33:16.254356] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-30T17:33:16.373742] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:33:17.054356] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-30T17:33:17.588091] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:33:17.854359] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-30T17:33:17.978196] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:33:18.654362] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-30T17:33:19.289388] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:33:19.454371] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-30T17:33:19.617999] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:33:20.254401] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-30T17:33:21.054374] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-30T17:33:21.211897] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:33:21.616369] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-30T17:33:21.854358] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-30T17:33:22.515367] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T17:33:22.654336] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-30T17:33:22.815933] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T17:33:23.454406] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-30T17:33:24.073429] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:33:24.078707] [INFO ] [REMOTE ] BHE: Full fetch complete (36525 records). [2025-09-30T17:33:24.078823] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-30T17:33:24.284294] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-30T17:33:24.514856] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-30T17:33:24.514950] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-30T17:33:24.515491] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-30T17:33:24.515583] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-30T17:33:24.516687] [DEBUG] [LOCAL ] BHE: Trimmed 36525 records to 24753 (keeping 200 days of data) [2025-09-30T17:33:24.674798] [DEBUG] [LOCAL ] BHE: Primary data saved (24753 records). [2025-09-30T17:33:24.674964] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-30T17:33:24.675076] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 27.9s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-09-30T17:33:24.883171] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:24.908898] [DEBUG] [LOCAL ] BHR: Loaded 21364 existing records from primary storage. [2025-09-30T17:33:24.909243] [INFO ] [MAIN ] BHR: Loaded 21364 existing records. [2025-09-30T17:33:25.059492] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-30T17:33:25.181788] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:25.182999] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-30T17:33:25.183130] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-30T17:33:25.183736] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-30T17:33:25.183816] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-30T17:33:25.449589] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:33:25.553079] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-30T17:33:25.723261] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:25.854353] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-30T17:33:26.654321] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-30T17:33:26.729910] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T17:33:26.952202] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T17:33:26.965946] [INFO ] [REMOTE ] BHC: Full fetch complete (66977 records). [2025-09-30T17:33:26.966114] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-30T17:33:27.381432] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-30T17:33:27.381572] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-30T17:33:27.382340] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-30T17:33:27.382410] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-30T17:33:27.384545] [DEBUG] [LOCAL ] BHC: Trimmed 66977 records to 46835 (keeping 200 days of data) [2025-09-30T17:33:27.462240] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-30T17:33:27.492246] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:33:27.693142] [DEBUG] [LOCAL ] BHC: Primary data saved (46835 records). [2025-09-30T17:33:27.693301] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-30T17:33:27.693414] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 40.8s. Estimated remaining: 4h 19m 55s. Rate: 8.1 symbols/min [2025-09-30T17:33:27.882983] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:27.883169] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-30T17:33:27.883214] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-30T17:33:27.883350] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-30T17:33:27.883392] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-30T17:33:27.883434] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-30T17:33:27.883468] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-30T17:33:28.255822] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-30T17:33:28.342463] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:28.587401] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:33:29.054365] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-30T17:33:29.418885] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T17:33:29.854362] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-30T17:33:30.069926] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:33:30.111226] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-30T17:33:30.654410] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-30T17:33:31.454390] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-30T17:33:32.153206] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T17:33:32.254338] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-30T17:33:32.576269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T17:33:32.671694] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:33:33.054372] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-30T17:33:33.854408] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-30T17:33:34.129589] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-30T17:33:34.200736] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:33:34.654372] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-30T17:33:35.454375] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-30T17:33:35.645864] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:33:36.254404] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-30T17:33:36.455852] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T17:33:37.054362] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-30T17:33:37.854370] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-30T17:33:38.116408] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T17:33:38.193639] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:33:38.323824] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:33:38.331165] [INFO ] [REMOTE ] BHK: Full fetch complete (30184 records). [2025-09-30T17:33:38.331288] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-30T17:33:38.659844] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-30T17:33:38.755768] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-30T17:33:38.755849] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-30T17:33:38.756342] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-30T17:33:38.756406] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-30T17:33:38.757242] [DEBUG] [LOCAL ] BHK: Trimmed 30184 records to 23022 (keeping 200 days of data) [2025-09-30T17:33:38.908847] [DEBUG] [LOCAL ] BHK: Primary data saved (23022 records). [2025-09-30T17:33:38.908995] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-30T17:33:38.909097] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 27.1s. Estimated remaining: 4h 20m 17s. Rate: 8.1 symbols/min [2025-09-30T17:33:39.105940] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:39.160259] [DEBUG] [LOCAL ] BHVN: Loaded 49696 existing records from primary storage. [2025-09-30T17:33:39.160599] [INFO ] [MAIN ] BHVN: Loaded 49696 existing records. [2025-09-30T17:33:39.361611] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:39.361882] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-30T17:33:39.361975] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-30T17:33:39.362697] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-30T17:33:39.362760] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-30T17:33:39.459468] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-30T17:33:39.754991] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:40.139151] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:33:40.254365] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-30T17:33:40.299989] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T17:33:40.732786] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:33:41.054378] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-30T17:33:41.299041] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-30T17:33:41.854382] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-30T17:33:42.654333] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-30T17:33:42.992552] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-30T17:33:43.016398] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:33:43.454361] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-30T17:33:44.254353] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-30T17:33:44.561965] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:33:45.054401] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-30T17:33:45.725493] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:33:45.768303] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:33:45.854359] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-30T17:33:46.303795] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T17:33:46.304843] [INFO ] [REMOTE ] BHV: Full fetch complete (1373 records). [2025-09-30T17:33:46.304916] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-30T17:33:46.506686] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T17:33:46.506941] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:33:46.507015] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:33:46.507089] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-30T17:33:46.507160] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-30T17:33:46.507201] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-30T17:33:46.507258] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-30T17:33:46.507341] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHV took 18.8s. Estimated remaining: 4h 20m 11s. Rate: 8.1 symbols/min [2025-09-30T17:33:46.663173] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-30T17:33:46.693336] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:46.751744] [DEBUG] [LOCAL ] BILL: Loaded 52329 existing records from primary storage. [2025-09-30T17:33:46.752105] [INFO ] [MAIN ] BILL: Loaded 52329 existing records. [2025-09-30T17:33:46.942511] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:46.942771] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-30T17:33:46.942822] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-30T17:33:46.943157] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-30T17:33:46.943216] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-30T17:33:47.325139] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:47.454359] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-30T17:33:48.262925] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-30T17:33:48.282100] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:33:48.932879] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:33:49.054367] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-30T17:33:49.146761] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:33:49.854366] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-30T17:33:50.258537] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:33:50.654394] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-30T17:33:51.454323] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-30T17:33:51.690294] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:33:51.701989] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:33:52.254369] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-30T17:33:52.847425] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:33:53.059466] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-30T17:33:53.068964] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T17:33:53.854390] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-30T17:33:54.654375] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-30T17:33:54.792063] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:33:55.377104] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:33:55.383556] [INFO ] [REMOTE ] BHR: Full fetch complete (30609 records). [2025-09-30T17:33:55.383720] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-30T17:33:55.464592] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-30T17:33:55.834673] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-30T17:33:55.834768] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-30T17:33:55.835230] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-30T17:33:55.835272] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-30T17:33:55.836148] [DEBUG] [LOCAL ] BHR: Trimmed 30609 records to 21377 (keeping 200 days of data) [2025-09-30T17:33:55.968638] [DEBUG] [LOCAL ] BHR: Primary data saved (21377 records). [2025-09-30T17:33:55.968915] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-30T17:33:55.969080] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 31.3s. Estimated remaining: 4h 20m 19s. Rate: 8.1 symbols/min [2025-09-30T17:33:56.159114] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:56.185491] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:33:56.220141] [DEBUG] [LOCAL ] BIO: Loaded 25004 existing records from primary storage. [2025-09-30T17:33:56.220415] [INFO ] [MAIN ] BIO: Loaded 25004 existing records. [2025-09-30T17:33:56.259550] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-30T17:33:56.423861] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:56.424114] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-30T17:33:56.424164] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-30T17:33:56.424525] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-30T17:33:56.424592] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-30T17:33:56.807006] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:57.054329] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-30T17:33:57.531209] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T17:33:57.854352] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-30T17:33:58.209749] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T17:33:58.397040] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T17:33:58.654360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-30T17:33:58.802503] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T17:33:59.454378] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-30T17:34:00.254342] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-30T17:34:00.536702] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:34:00.548266] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T17:34:01.054361] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-30T17:34:01.854329] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-30T17:34:02.035872] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:34:02.048073] [INFO ] [REMOTE ] BHP: Full fetch complete (77247 records). [2025-09-30T17:34:02.048231] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-30T17:34:02.473076] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-30T17:34:02.473165] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-30T17:34:02.473959] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-30T17:34:02.474028] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-30T17:34:02.475723] [DEBUG] [LOCAL ] BHP: Trimmed 77247 records to 53373 (keeping 200 days of data) [2025-09-30T17:34:02.666459] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-30T17:34:02.830787] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-09-30T17:34:02.830942] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-30T17:34:02.832476] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHP took 51.0s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-09-30T17:34:03.056282] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:03.059016] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T17:34:03.126105] [DEBUG] [LOCAL ] BIP: Loaded 39545 existing records from primary storage. [2025-09-30T17:34:03.126447] [INFO ] [MAIN ] BIP: Loaded 39545 existing records. [2025-09-30T17:34:03.322473] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:03.322750] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-30T17:34:03.322838] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-30T17:34:03.323298] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-30T17:34:03.323387] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-30T17:34:03.457096] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-30T17:34:03.738619] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:03.787135] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:34:03.794474] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T17:34:04.254363] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-30T17:34:05.054347] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-30T17:34:05.313915] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:34:05.854332] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-30T17:34:05.967663] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T17:34:06.020638] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T17:34:06.654387] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-30T17:34:06.989089] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:34:07.454765] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-30T17:34:07.709246] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:34:08.254360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-30T17:34:09.054339] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-30T17:34:09.551670] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T17:34:09.848265] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:34:09.858618] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-30T17:34:10.370066] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:34:10.654357] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-30T17:34:11.452591] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:34:11.460133] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-30T17:34:12.254330] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-30T17:34:12.755416] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:34:12.765083] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T17:34:13.054348] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-30T17:34:13.638756] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:34:13.854355] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-30T17:34:14.654359] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-30T17:34:14.792446] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:34:15.454348] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-30T17:34:15.727112] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:34:16.002605] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:34:16.254356] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-30T17:34:17.051016] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:34:17.063401] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-30T17:34:17.066913] [INFO ] [REMOTE ] BILL: Full fetch complete (75250 records). [2025-09-30T17:34:17.067179] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-30T17:34:17.068375] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:34:17.068479] [FATAL] [MAIN ] BILL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:34:17.068555] [WARN ] [MAIN ] BILL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:34:17.068635] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-30T17:34:17.068754] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-30T17:34:17.068797] [INFO ] [LOCAL ] BILL: Starting deletion of derivative data. [2025-09-30T17:34:17.069068] [DEBUG] [LOCAL ] BILL: Deleted derivative data file. [2025-09-30T17:34:17.069202] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BILL took 30.6s. Estimated remaining: 4h 20m 51s. Rate: 8.0 symbols/min [2025-09-30T17:34:17.254986] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:17.255176] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-09-30T17:34:17.255219] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-09-30T17:34:17.255336] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-30T17:34:17.255377] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-30T17:34:17.255419] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-09-30T17:34:17.255450] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-30T17:34:17.646441] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:17.810078] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T17:34:17.821573] [INFO ] [REMOTE ] BHVN: Full fetch complete (69809 records). [2025-09-30T17:34:17.821777] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-30T17:34:17.859521] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-30T17:34:18.255209] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-30T17:34:18.255315] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-30T17:34:18.256431] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-30T17:34:18.256528] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-30T17:34:18.258375] [DEBUG] [LOCAL ] BHVN: Trimmed 69809 records to 49759 (keeping 200 days of data) [2025-09-30T17:34:18.569695] [DEBUG] [LOCAL ] BHVN: Primary data saved (49759 records). [2025-09-30T17:34:18.569885] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-30T17:34:18.569993] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 39.7s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-09-30T17:34:18.663265] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-30T17:34:18.771505] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:18.800007] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:34:18.811810] [DEBUG] [LOCAL ] BIPH: Loaded 2572 existing records from primary storage. [2025-09-30T17:34:18.812162] [INFO ] [MAIN ] BIPH: Loaded 2572 existing records. [2025-09-30T17:34:19.015078] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:19.015357] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-30T17:34:19.015407] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-30T17:34:19.015606] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-30T17:34:19.015702] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-30T17:34:19.415757] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:19.437521] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:34:19.454310] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-30T17:34:19.683537] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:34:20.254378] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-30T17:34:20.833351] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:34:20.926304] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:34:21.054404] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-30T17:34:21.854377] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-30T17:34:22.201092] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:34:22.654406] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-30T17:34:22.964885] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T17:34:23.454374] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-30T17:34:24.022551] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:34:24.254362] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-30T17:34:24.720452] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:34:25.054367] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-30T17:34:25.854335] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-30T17:34:25.907734] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:34:26.154245] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:34:26.158872] [INFO ] [REMOTE ] BIO: Full fetch complete (34089 records). [2025-09-30T17:34:26.159015] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-30T17:34:26.588300] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-30T17:34:26.588427] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-30T17:34:26.588924] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-30T17:34:26.588990] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-30T17:34:26.590057] [DEBUG] [LOCAL ] BIO: Trimmed 34089 records to 24946 (keeping 200 days of data) [2025-09-30T17:34:26.655312] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-30T17:34:26.750243] [DEBUG] [LOCAL ] BIO: Primary data saved (24946 records). [2025-09-30T17:34:26.750387] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-30T17:34:26.750477] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIO took 30.8s. Estimated remaining: 4h 19m 57s. Rate: 8.1 symbols/min [2025-09-30T17:34:27.072566] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:34:27.327877] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T17:34:27.454412] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-30T17:34:28.016712] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T17:34:28.254385] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-30T17:34:29.054416] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-30T17:34:29.455585] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:34:29.854418] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-30T17:34:30.643903] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:34:30.654306] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-30T17:34:31.282322] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T17:34:31.291701] [INFO ] [REMOTE ] BIP: Full fetch complete (56832 records). [2025-09-30T17:34:31.291858] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-30T17:34:31.471296] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-30T17:34:31.786189] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-30T17:34:31.786475] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-30T17:34:31.787319] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-30T17:34:31.787391] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-30T17:34:31.788911] [DEBUG] [LOCAL ] BIP: Trimmed 56832 records to 39540 (keeping 200 days of data) [2025-09-30T17:34:32.064791] [DEBUG] [LOCAL ] BIP: Primary data saved (39540 records). [2025-09-30T17:34:32.065009] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-30T17:34:32.066244] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIP took 29.2s. Estimated remaining: 4h 19m 33s. Rate: 8.1 symbols/min [2025-09-30T17:34:32.189185] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:34:32.203173] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T17:34:32.254371] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-30T17:34:32.809190] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:34:33.054398] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-30T17:34:33.555942] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:34:33.854379] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-30T17:34:34.654417] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-30T17:34:35.017702] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:34:35.080899] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T17:34:35.454415] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-30T17:34:35.940097] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T17:34:36.254397] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-30T17:34:37.054428] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-30T17:34:37.450675] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:34:37.763762] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:34:37.854354] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-30T17:34:38.385267] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T17:34:38.386419] [INFO ] [REMOTE ] BIPH: Full fetch complete (4335 records). [2025-09-30T17:34:38.386492] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-30T17:34:38.669605] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-30T17:34:38.868747] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-30T17:34:38.868845] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-30T17:34:38.869022] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-30T17:34:38.869070] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-30T17:34:38.869516] [DEBUG] [LOCAL ] BIPH: Trimmed 4335 records to 2575 (keeping 200 days of data) [2025-09-30T17:34:38.891631] [DEBUG] [LOCAL ] BIPH: Primary data saved (2575 records). [2025-09-30T17:34:38.891842] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-30T17:34:38.891947] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPH took 20.3s. Estimated remaining: 4h 19m 21s. Rate: 8.1 symbols/min [2025-09-30T17:34:40.216618] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:34:40.226603] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-30T17:34:41.921891] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:34:41.930744] [INFO ] [REMOTE ] BIPC: Full fetch complete (59879 records). [2025-09-30T17:34:41.930895] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-30T17:34:42.335533] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-30T17:34:42.335620] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-30T17:34:42.336302] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-30T17:34:42.336360] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-30T17:34:42.337635] [DEBUG] [LOCAL ] BIPC: Trimmed 59879 records to 41499 (keeping 200 days of data) [2025-09-30T17:34:42.599949] [DEBUG] [LOCAL ] BIPC: Primary data saved (41499 records). [2025-09-30T17:34:42.600098] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-30T17:34:42.600180] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 25.5s. Estimated remaining: 4h 18m 46s. Rate: 8.1 symbols/min [2025-09-30T17:34:43.293436] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.351809] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.362483] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.382173] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.394352] [DEBUG] [LOCAL ] BIPI: Loaded 3221 existing records from primary storage. [2025-09-30T17:34:43.391629] [DEBUG] [LOCAL ] BIPJ: Loaded 3022 existing records from primary storage. [2025-09-30T17:34:43.395089] [INFO ] [MAIN ] BIPJ: Loaded 3022 existing records. [2025-09-30T17:34:43.394836] [INFO ] [MAIN ] BIPI: Loaded 3221 existing records. [2025-09-30T17:34:43.629949] [DEBUG] [LOCAL ] BIT: Loaded 22570 existing records from primary storage. [2025-09-30T17:34:43.680222] [INFO ] [MAIN ] BIT: Loaded 22570 existing records. [2025-09-30T17:34:43.732436] [DEBUG] [LOCAL ] BIRK: Loaded 50899 existing records from primary storage. [2025-09-30T17:34:43.881841] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:43.899951] [INFO ] [MAIN ] BIRK: Loaded 50899 existing records. [2025-09-30T17:34:43.925342] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-30T17:34:43.946813] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:43.930617] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-30T17:34:43.988266] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.017279] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-30T17:34:44.017222] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-30T17:34:44.028086] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-30T17:34:44.094525] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-30T17:34:44.181835] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-30T17:34:44.286599] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:44.365417] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.436759] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-30T17:34:44.448076] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-30T17:34:44.426350] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:44.483377] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-30T17:34:44.515433] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.536944] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-30T17:34:44.624947] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-30T17:34:44.671305] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-30T17:34:45.481417] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.575302] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-30T17:34:45.583749] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.621863] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-30T17:34:45.735402] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.774824] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-30T17:34:45.868878] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.869191] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-30T17:34:46.390401] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T17:34:46.393302] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-30T17:34:46.553221] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:34:46.554837] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-30T17:34:46.898804] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T17:34:46.900171] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-30T17:34:46.983688] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:34:46.987021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-30T17:34:46.985122] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:34:46.993296] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-30T17:34:47.270259] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-30T17:34:47.407042] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:34:47.441720] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:34:47.454308] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-30T17:34:48.147240] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:34:48.254405] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-30T17:34:48.665017] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:34:48.918848] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T17:34:49.054405] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-30T17:34:49.507673] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:34:49.854373] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-30T17:34:50.388952] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:34:50.654397] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-30T17:34:51.454387] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-30T17:34:51.853173] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T17:34:51.973733] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:34:52.254390] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-30T17:34:52.586226] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T17:34:53.054366] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-30T17:34:53.466288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:34:53.854380] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-30T17:34:54.182000] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-30T17:34:54.654407] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-30T17:34:55.454370] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-30T17:34:55.628029] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:34:56.254363] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-30T17:34:56.806970] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:34:57.002624] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:34:57.054402] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-30T17:34:57.519602] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T17:34:57.854379] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-30T17:34:58.654391] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-30T17:34:58.937846] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:34:59.454425] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-30T17:34:59.996110] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T17:35:00.254414] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-30T17:35:00.333737] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:35:00.715625] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:35:01.054393] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-30T17:35:01.854445] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-30T17:35:02.028142] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T17:35:02.654408] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-30T17:35:03.194225] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T17:35:03.304353] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:35:03.454377] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-30T17:35:04.130408] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:35:04.254367] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-30T17:35:04.772325] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T17:35:04.773763] [INFO ] [REMOTE ] BIPI: Full fetch complete (5146 records). [2025-09-30T17:35:04.773837] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-30T17:35:05.059530] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-30T17:35:05.187868] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-30T17:35:05.187961] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-30T17:35:05.188176] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-30T17:35:05.188249] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-30T17:35:05.189046] [DEBUG] [LOCAL ] BIPI: Trimmed 5146 records to 3193 (keeping 200 days of data) [2025-09-30T17:35:05.213037] [DEBUG] [LOCAL ] BIPI: Primary data saved (3193 records). [2025-09-30T17:35:05.213135] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-30T17:35:05.213303] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPI took 22.6s. Estimated remaining: 4h 20m 31s. Rate: 8.0 symbols/min [2025-09-30T17:35:05.396618] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:05.396845] [DEBUG] [LOCAL ] BJ: No existing data file found in primary storage. [2025-09-30T17:35:05.396886] [WARN ] [MAIN ] BJ: No existing data found, performing full refresh instead. [2025-09-30T17:35:05.397053] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-30T17:35:05.397108] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-30T17:35:05.397153] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-30T17:35:05.397217] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-30T17:35:05.823981] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:05.830375] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T17:35:05.832044] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4332 records). [2025-09-30T17:35:05.832180] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-30T17:35:05.832691] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:35:05.832776] [FATAL] [MAIN ] BIPJ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:35:05.832821] [WARN ] [MAIN ] BIPJ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:35:05.832872] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-30T17:35:05.832972] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-09-30T17:35:05.833073] [INFO ] [LOCAL ] BIPJ: Starting deletion of derivative data. [2025-09-30T17:35:05.833429] [DEBUG] [LOCAL ] BIPJ: Deleted derivative data file. [2025-09-30T17:35:05.833699] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPJ took 23.2s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-09-30T17:35:05.859523] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-30T17:35:06.052854] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:06.119276] [DEBUG] [LOCAL ] BK: Loaded 53539 existing records from primary storage. [2025-09-30T17:35:06.119663] [INFO ] [MAIN ] BK: Loaded 53539 existing records. [2025-09-30T17:35:06.321425] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:06.321665] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-30T17:35:06.321729] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-30T17:35:06.322120] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-30T17:35:06.322192] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-30T17:35:06.659517] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-30T17:35:06.737409] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:07.028135] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:35:07.454367] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-30T17:35:08.043549] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:35:08.254379] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-30T17:35:08.751033] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:35:09.054405] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-30T17:35:09.854341] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-30T17:35:09.945784] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T17:35:10.567823] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:35:10.654373] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-30T17:35:11.316256] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:35:11.454365] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-30T17:35:12.254366] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-30T17:35:12.587544] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:35:12.770303] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T17:35:13.054369] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-30T17:35:13.854365] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-30T17:35:14.257352] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:35:14.654351] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-30T17:35:14.798814] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:35:14.810289] [INFO ] [REMOTE ] BIRK: Full fetch complete (72942 records). [2025-09-30T17:35:14.810467] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-30T17:35:15.268301] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-30T17:35:15.268451] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-30T17:35:15.269627] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-30T17:35:15.269743] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-30T17:35:15.272913] [DEBUG] [LOCAL ] BIRK: Trimmed 72942 records to 50901 (keeping 200 days of data) [2025-09-30T17:35:15.455558] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-30T17:35:15.600666] [DEBUG] [LOCAL ] BIRK: Primary data saved (50901 records). [2025-09-30T17:35:15.600829] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-30T17:35:15.600951] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIRK took 33.0s. Estimated remaining: 4h 19m 43s. Rate: 8.0 symbols/min [2025-09-30T17:35:15.801350] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:15.831754] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T17:35:15.883806] [DEBUG] [LOCAL ] BKD: Loaded 50182 existing records from primary storage. [2025-09-30T17:35:15.884153] [INFO ] [MAIN ] BKD: Loaded 50182 existing records. [2025-09-30T17:35:16.081089] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:16.081395] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-30T17:35:16.081533] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-30T17:35:16.081839] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-30T17:35:16.081900] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-30T17:35:16.257685] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-30T17:35:16.420822] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:35:16.485073] [INFO ] [REMOTE ] BIT: Full fetch complete (31491 records). [2025-09-30T17:35:16.504515] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-30T17:35:16.528847] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:16.949889] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-30T17:35:16.949990] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-30T17:35:16.950545] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-30T17:35:16.950747] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-30T17:35:16.951875] [DEBUG] [LOCAL ] BIT: Trimmed 31491 records to 22692 (keeping 200 days of data) [2025-09-30T17:35:17.055332] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-30T17:35:17.090194] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:35:17.156968] [DEBUG] [LOCAL ] BIT: Primary data saved (22692 records). [2025-09-30T17:35:17.157134] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-30T17:35:17.157297] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIT took 34.5s. Estimated remaining: 4h 18m 52s. Rate: 8.1 symbols/min [2025-09-30T17:35:17.395091] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:17.440048] [DEBUG] [LOCAL ] BKE: Loaded 34611 existing records from primary storage. [2025-09-30T17:35:17.440340] [INFO ] [MAIN ] BKE: Loaded 34611 existing records. [2025-09-30T17:35:17.632079] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:17.632308] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-30T17:35:17.632367] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-30T17:35:17.632728] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-30T17:35:17.632787] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-30T17:35:17.865473] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-30T17:35:18.040385] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:18.071262] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:35:18.654368] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-30T17:35:18.725402] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:35:19.459480] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-30T17:35:19.481618] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T17:35:19.992233] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:35:20.254410] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-30T17:35:20.614871] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:35:21.054415] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-30T17:35:21.854418] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-30T17:35:22.207755] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:35:22.420989] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:35:22.654402] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-30T17:35:23.454352] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-30T17:35:23.778953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:35:24.254321] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-30T17:35:24.757142] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T17:35:24.977455] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T17:35:25.054396] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-30T17:35:25.854325] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-30T17:35:26.118275] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:35:26.654405] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-30T17:35:26.696276] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:35:27.454625] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-30T17:35:27.579232] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:35:28.001953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T17:35:28.254383] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-30T17:35:29.054378] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-30T17:35:29.162815] [DEBUG] [REMOTE ] BKE: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-30T17:35:29.163266] [WARN ] [REMOTE ] BKE: No data returned for month 2025-01 [2025-09-30T17:35:29.163439] [FATAL] [REMOTE ] BKE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:35:29.163542] [FATAL] [MAIN ] BKE: Failed to fetch primary data. [2025-09-30T17:35:29.163615] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:35:29.163792] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-30T17:35:29.163890] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-30T17:35:29.163956] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-09-30T17:35:29.164425] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-09-30T17:35:29.164529] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BKE took 12.0s. Estimated remaining: 4h 19m 18s. Rate: 8.0 symbols/min [2025-09-30T17:35:29.360454] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:29.416883] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:35:29.442054] [DEBUG] [LOCAL ] BKH: Loaded 36557 existing records from primary storage. [2025-09-30T17:35:29.442380] [INFO ] [MAIN ] BKH: Loaded 36557 existing records. [2025-09-30T17:35:29.643674] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:29.643894] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-30T17:35:29.643982] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-30T17:35:29.644250] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-30T17:35:29.644309] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-30T17:35:29.860455] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-30T17:35:30.060913] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:30.205314] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:35:30.654390] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-30T17:35:31.454321] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-30T17:35:31.717025] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:35:31.855695] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:35:32.254390] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-30T17:35:33.054335] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-30T17:35:33.227385] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:35:33.434532] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T17:35:33.854380] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-30T17:35:34.654385] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-30T17:35:34.860781] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T17:35:34.872983] [INFO ] [REMOTE ] BK: Full fetch complete (77480 records). [2025-09-30T17:35:34.873177] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-30T17:35:35.313383] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-30T17:35:35.313502] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-30T17:35:35.315399] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-30T17:35:35.315486] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-30T17:35:35.355403] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:35:35.366379] [DEBUG] [LOCAL ] BK: Trimmed 77480 records to 53538 (keeping 200 days of data) [2025-09-30T17:35:35.470678] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-30T17:35:35.721373] [DEBUG] [LOCAL ] BK: Primary data saved (53538 records). [2025-09-30T17:35:35.721521] [INFO ] [MAIN ] BK: Full history saved. [2025-09-30T17:35:35.722869] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 29.9s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-09-30T17:35:35.901468] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:35.943831] [DEBUG] [LOCAL ] BKKT: Loaded 34818 existing records from primary storage. [2025-09-30T17:35:35.944145] [INFO ] [MAIN ] BKKT: Loaded 34818 existing records. [2025-09-30T17:35:36.137631] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:36.137896] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-30T17:35:36.137944] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-30T17:35:36.138311] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-30T17:35:36.138398] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-30T17:35:36.257797] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-30T17:35:36.572051] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:36.595176] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T17:35:36.631956] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:35:37.054382] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-30T17:35:37.698802] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:35:37.854410] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-30T17:35:38.654320] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-30T17:35:38.702160] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:35:39.454401] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-30T17:35:39.534340] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:35:40.000569] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:35:40.254442] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-30T17:35:41.057779] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-30T17:35:41.060342] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:35:41.854395] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-30T17:35:42.014371] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:35:42.025942] [INFO ] [REMOTE ] BKD: Full fetch complete (71601 records). [2025-09-30T17:35:42.026109] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-30T17:35:42.471299] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-30T17:35:42.471630] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-30T17:35:42.472585] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-30T17:35:42.472666] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-30T17:35:42.474201] [DEBUG] [LOCAL ] BKD: Trimmed 71601 records to 50188 (keeping 200 days of data) [2025-09-30T17:35:42.675754] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-30T17:35:42.779350] [DEBUG] [LOCAL ] BKD: Primary data saved (50188 records). [2025-09-30T17:35:42.779503] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-30T17:35:42.779607] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 27.2s. Estimated remaining: 4h 18m 53s. Rate: 8.0 symbols/min [2025-09-30T17:35:42.970922] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:43.008062] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:35:43.023629] [DEBUG] [LOCAL ] BKN: Loaded 7759 existing records from primary storage. [2025-09-30T17:35:43.024048] [INFO ] [MAIN ] BKN: Loaded 7759 existing records. [2025-09-30T17:35:43.023839] [INFO ] [REMOTE ] BJ: Full fetch complete (73809 records). [2025-09-30T17:35:43.024175] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-30T17:35:43.454103] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:43.519306] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-30T17:35:43.533859] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-30T17:35:43.594966] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-30T17:35:43.600728] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-30T17:35:43.875439] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T17:35:43.875714] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-30T17:35:43.905888] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-30T17:35:43.912766] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-30T17:35:43.913210] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-30T17:35:43.920080] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-30T17:35:44.010572] [DEBUG] [LOCAL ] BJ: Trimmed 73809 records to 51365 (keeping 200 days of data) [2025-09-30T17:35:44.261500] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:35:44.292279] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-30T17:35:44.367052] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:44.593156] [DEBUG] [LOCAL ] BJ: Primary data saved (51365 records). [2025-09-30T17:35:44.593312] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-30T17:35:44.593392] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BJ took 39.4s. Estimated remaining: 4h 18m 5s. Rate: 8.1 symbols/min [2025-09-30T17:35:44.831929] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:44.885845] [DEBUG] [LOCAL ] BKSY: Loaded 48195 existing records from primary storage. [2025-09-30T17:35:44.886198] [INFO ] [MAIN ] BKSY: Loaded 48195 existing records. [2025-09-30T17:35:45.061172] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-30T17:35:45.095590] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:45.096858] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-30T17:35:45.097052] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-30T17:35:45.097585] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-30T17:35:45.097677] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-30T17:35:45.426764] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:35:45.522301] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:45.854373] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-30T17:35:45.972770] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:35:45.988919] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:35:46.654407] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-30T17:35:47.435961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:35:47.454325] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-30T17:35:48.007453] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:35:48.254395] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-30T17:35:48.872679] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:35:49.054410] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-30T17:35:49.206124] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:35:49.651333] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T17:35:49.854396] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-30T17:35:50.592577] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T17:35:50.654374] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-30T17:35:51.454397] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-30T17:35:52.006868] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:35:52.106625] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:35:52.254409] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-30T17:35:53.054532] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-30T17:35:53.854379] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-30T17:35:54.094908] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:35:54.493179] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T17:35:54.571626] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:35:54.654404] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-30T17:35:55.454395] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-30T17:35:56.254324] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-30T17:35:56.294392] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:35:56.967155] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:35:57.054399] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-30T17:35:57.854336] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-30T17:35:58.027475] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:35:58.448227] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T17:35:58.654370] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-30T17:35:58.687137] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:35:59.454403] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-30T17:35:59.855025] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T17:36:00.254365] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-30T17:36:00.854307] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:36:00.862750] [INFO ] [REMOTE ] BKH: Full fetch complete (52347 records). [2025-09-30T17:36:00.862913] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-30T17:36:01.059685] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-30T17:36:01.325026] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-30T17:36:01.325138] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-30T17:36:01.325943] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-30T17:36:01.326029] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-30T17:36:01.327468] [DEBUG] [LOCAL ] BKH: Trimmed 52347 records to 36624 (keeping 200 days of data) [2025-09-30T17:36:01.572213] [DEBUG] [LOCAL ] BKH: Primary data saved (36624 records). [2025-09-30T17:36:01.572389] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-30T17:36:01.572482] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 32.4s. Estimated remaining: 4h 19m 6s. Rate: 8.0 symbols/min [2025-09-30T17:36:01.808986] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:01.812095] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:36:01.835326] [DEBUG] [LOCAL ] BKT: Loaded 11191 existing records from primary storage. [2025-09-30T17:36:01.835670] [INFO ] [MAIN ] BKT: Loaded 11191 existing records. [2025-09-30T17:36:01.859524] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-30T17:36:02.046254] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:02.046501] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-30T17:36:02.046551] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-30T17:36:02.046774] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-30T17:36:02.046836] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-30T17:36:02.437546] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:02.654378] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-30T17:36:02.695815] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:36:03.148085] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T17:36:03.454375] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-30T17:36:03.615713] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:36:03.853955] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:36:04.254355] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-30T17:36:05.054337] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-30T17:36:05.118142] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:36:05.121182] [INFO ] [REMOTE ] BKN: Full fetch complete (11911 records). [2025-09-30T17:36:05.121287] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-30T17:36:05.528089] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-30T17:36:05.528177] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-30T17:36:05.528545] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-30T17:36:05.528608] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-30T17:36:05.529103] [DEBUG] [LOCAL ] BKN: Trimmed 11911 records to 7734 (keeping 200 days of data) [2025-09-30T17:36:05.581129] [DEBUG] [LOCAL ] BKN: Primary data saved (7734 records). [2025-09-30T17:36:05.581278] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-30T17:36:05.581366] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 22.8s. Estimated remaining: 4h 18m 34s. Rate: 8.0 symbols/min [2025-09-30T17:36:05.762875] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:05.803550] [DEBUG] [LOCAL ] BKU: Loaded 41557 existing records from primary storage. [2025-09-30T17:36:05.803896] [INFO ] [MAIN ] BKU: Loaded 41557 existing records. [2025-09-30T17:36:05.863000] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-30T17:36:06.000611] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:06.000854] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-30T17:36:06.000905] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-30T17:36:06.001228] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-30T17:36:06.001287] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-30T17:36:06.399435] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:06.654329] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-30T17:36:06.725320] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:36:06.924582] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:36:07.454368] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-30T17:36:07.925170] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:36:08.254358] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-30T17:36:08.581172] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:36:08.751565] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T17:36:09.054368] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-30T17:36:09.854360] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-30T17:36:10.653851] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:36:10.661365] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-30T17:36:11.454374] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-30T17:36:11.981563] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:36:11.992215] [INFO ] [REMOTE ] BKKT: Full fetch complete (50182 records). [2025-09-30T17:36:11.992375] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-30T17:36:12.267621] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-30T17:36:12.421712] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-30T17:36:12.421967] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-30T17:36:12.422806] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-30T17:36:12.422890] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-30T17:36:12.424233] [DEBUG] [LOCAL ] BKKT: Trimmed 50182 records to 35076 (keeping 200 days of data) [2025-09-30T17:36:12.570236] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T17:36:12.694160] [DEBUG] [LOCAL ] BKKT: Primary data saved (35076 records). [2025-09-30T17:36:12.694331] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-30T17:36:12.695514] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 37.0s. Estimated remaining: 4h 18m 24s. Rate: 8.0 symbols/min [2025-09-30T17:36:12.878970] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:12.906968] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:36:12.951886] [DEBUG] [LOCAL ] BKV: Loaded 29665 existing records from primary storage. [2025-09-30T17:36:12.952965] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T17:36:12.953301] [INFO ] [MAIN ] BKV: Loaded 29665 existing records. [2025-09-30T17:36:13.059565] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-30T17:36:13.170513] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:13.170813] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-30T17:36:13.170898] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-30T17:36:13.172110] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-30T17:36:13.172174] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-30T17:36:13.548155] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:13.854380] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-30T17:36:14.654351] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-30T17:36:14.697145] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T17:36:15.003891] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T17:36:15.454386] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-30T17:36:16.134326] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:36:16.254413] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-30T17:36:16.646487] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:36:17.054383] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-30T17:36:17.823603] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:36:17.859561] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-30T17:36:17.884149] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:36:18.654372] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-30T17:36:19.188449] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:36:19.454417] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-30T17:36:20.254413] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-30T17:36:20.406633] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T17:36:20.800297] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:36:20.811505] [INFO ] [REMOTE ] BKSY: Full fetch complete (69513 records). [2025-09-30T17:36:20.811721] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-30T17:36:21.066309] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-30T17:36:21.094528] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:36:21.283552] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-30T17:36:21.283691] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-30T17:36:21.284701] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-30T17:36:21.284773] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-30T17:36:21.286350] [DEBUG] [LOCAL ] BKSY: Trimmed 69513 records to 48205 (keeping 200 days of data) [2025-09-30T17:36:21.573951] [DEBUG] [LOCAL ] BKSY: Primary data saved (48205 records). [2025-09-30T17:36:21.574091] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-30T17:36:21.574922] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 37.0s. Estimated remaining: 4h 18m 27s. Rate: 8.0 symbols/min [2025-09-30T17:36:21.757430] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:21.801167] [DEBUG] [LOCAL ] BLCO: Loaded 35418 existing records from primary storage. [2025-09-30T17:36:21.801570] [INFO ] [MAIN ] BLCO: Loaded 35418 existing records. [2025-09-30T17:36:21.866470] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-30T17:36:21.998235] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:21.998608] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-30T17:36:21.998699] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-30T17:36:21.999873] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-30T17:36:21.999941] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-30T17:36:22.383514] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:22.484193] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:36:22.654373] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-30T17:36:23.076639] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:36:23.454396] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-30T17:36:23.480502] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T17:36:24.254377] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-30T17:36:24.681203] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:36:25.054356] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-30T17:36:25.671031] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:36:25.854370] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-30T17:36:26.077428] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:36:26.082188] [INFO ] [REMOTE ] BKT: Full fetch complete (15339 records). [2025-09-30T17:36:26.082579] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-30T17:36:26.495335] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-30T17:36:26.495439] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-30T17:36:26.495861] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-30T17:36:26.495962] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-30T17:36:26.496721] [DEBUG] [LOCAL ] BKT: Trimmed 15339 records to 11267 (keeping 200 days of data) [2025-09-30T17:36:26.578130] [DEBUG] [LOCAL ] BKT: Primary data saved (11267 records). [2025-09-30T17:36:26.578371] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-30T17:36:26.578485] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 25.0s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-09-30T17:36:26.659551] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-30T17:36:26.770253] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:26.804306] [DEBUG] [LOCAL ] BLD: Loaded 27802 existing records from primary storage. [2025-09-30T17:36:26.804607] [INFO ] [MAIN ] BLD: Loaded 27802 existing records. [2025-09-30T17:36:27.012553] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:27.012885] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-30T17:36:27.012956] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-30T17:36:27.013801] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-30T17:36:27.013870] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-30T17:36:27.359184] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:36:27.455323] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:27.455444] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-30T17:36:27.757843] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:36:28.254388] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-30T17:36:29.054378] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-30T17:36:29.181110] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:36:29.636023] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:36:29.854385] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-30T17:36:30.087458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:36:30.654354] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-30T17:36:31.239110] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:36:31.454329] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-30T17:36:31.637773] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T17:36:32.254409] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-30T17:36:32.909055] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T17:36:33.054375] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-30T17:36:33.854355] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-30T17:36:34.047061] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:36:34.216448] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:36:34.654395] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-30T17:36:34.971800] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T17:36:35.454337] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-30T17:36:35.592528] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:36:36.254374] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-30T17:36:36.917085] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:36:37.054369] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-30T17:36:37.549128] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:36:37.854427] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-30T17:36:38.657013] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-30T17:36:38.662377] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T17:36:39.356173] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:36:39.454403] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-30T17:36:39.928568] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T17:36:40.254401] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-30T17:36:40.989041] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:36:41.054344] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-30T17:36:41.324620] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:36:41.854368] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-30T17:36:42.432613] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:36:42.654369] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-30T17:36:43.224254] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T17:36:43.230679] [INFO ] [REMOTE ] BKV: Full fetch complete (45068 records). [2025-09-30T17:36:43.230817] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-30T17:36:43.459556] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-30T17:36:43.675886] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-30T17:36:43.675988] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-30T17:36:43.676638] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-30T17:36:43.676735] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-30T17:36:43.677953] [DEBUG] [LOCAL ] BKV: Trimmed 45068 records to 29775 (keeping 200 days of data) [2025-09-30T17:36:43.901381] [DEBUG] [LOCAL ] BKV: Primary data saved (29775 records). [2025-09-30T17:36:43.901537] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-30T17:36:43.901626] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 31.2s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-09-30T17:36:44.098855] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:44.126783] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:36:44.136079] [INFO ] [REMOTE ] BKU: Full fetch complete (59772 records). [2025-09-30T17:36:44.136272] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-30T17:36:44.256896] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-30T17:36:44.517525] [DEBUG] [LOCAL ] BLDR: Loaded 51635 existing records from primary storage. [2025-09-30T17:36:44.569688] [INFO ] [MAIN ] BLDR: Loaded 51635 existing records. [2025-09-30T17:36:44.681421] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-30T17:36:44.706898] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-30T17:36:44.722498] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-30T17:36:44.747331] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-30T17:36:44.875685] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:36:44.873673] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:44.876427] [DEBUG] [LOCAL ] BKU: Trimmed 59772 records to 41483 (keeping 200 days of data) [2025-09-30T17:36:44.883322] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-30T17:36:44.884253] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-30T17:36:44.885167] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-30T17:36:44.885238] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-30T17:36:45.076802] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-30T17:36:45.379607] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:45.419073] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:36:45.596125] [DEBUG] [LOCAL ] BKU: Primary data saved (41483 records). [2025-09-30T17:36:45.596269] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-30T17:36:45.596356] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 40.0s. Estimated remaining: 4h 18m 16s. Rate: 8.0 symbols/min [2025-09-30T17:36:45.775094] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:45.796176] [DEBUG] [LOCAL ] BLE: Loaded 14424 existing records from primary storage. [2025-09-30T17:36:45.796438] [INFO ] [MAIN ] BLE: Loaded 14424 existing records. [2025-09-30T17:36:45.860564] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-30T17:36:45.986846] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:45.987081] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-30T17:36:45.987132] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-30T17:36:45.987431] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-30T17:36:45.987494] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-30T17:36:46.373985] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:46.393071] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T17:36:46.654402] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-30T17:36:47.365970] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:36:47.454391] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-30T17:36:47.774669] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:36:48.254385] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-30T17:36:49.031335] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T17:36:49.054371] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-30T17:36:49.164241] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:36:49.854364] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-30T17:36:50.336815] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:36:50.343768] [INFO ] [REMOTE ] BLCO: Full fetch complete (52868 records). [2025-09-30T17:36:50.343919] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-30T17:36:50.659438] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-30T17:36:50.787548] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-30T17:36:50.787825] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-30T17:36:50.788498] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-30T17:36:50.788562] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-30T17:36:50.789820] [DEBUG] [LOCAL ] BLCO: Trimmed 52868 records to 35436 (keeping 200 days of data) [2025-09-30T17:36:51.046413] [DEBUG] [LOCAL ] BLCO: Primary data saved (35436 records). [2025-09-30T17:36:51.046562] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-30T17:36:51.048041] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 29.5s. Estimated remaining: 4h 17m 55s. Rate: 8.0 symbols/min [2025-09-30T17:36:51.271725] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:51.334152] [DEBUG] [LOCAL ] BLK: Loaded 34520 existing records from primary storage. [2025-09-30T17:36:51.334672] [INFO ] [MAIN ] BLK: Loaded 34520 existing records. [2025-09-30T17:36:51.455371] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-30T17:36:51.588923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T17:36:51.593587] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:51.600398] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:36:51.600821] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-30T17:36:51.600974] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-30T17:36:51.611889] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-30T17:36:51.611967] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-30T17:36:52.023590] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:52.254364] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-30T17:36:52.642106] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T17:36:53.054369] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-30T17:36:53.854353] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-30T17:36:54.057214] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:36:54.402595] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:36:54.594526] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T17:36:54.654370] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-30T17:36:55.454369] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-30T17:36:55.797849] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:36:56.254360] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-30T17:36:57.054349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-30T17:36:57.195420] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:36:57.815317] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:36:57.854363] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-30T17:36:58.248193] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:36:58.254386] [INFO ] [REMOTE ] BLD: Full fetch complete (40358 records). [2025-09-30T17:36:58.254540] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-30T17:36:58.656681] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-30T17:36:58.656589] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-30T17:36:58.656845] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-30T17:36:58.658521] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-30T17:36:58.658606] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-30T17:36:58.659722] [DEBUG] [LOCAL ] BLD: Trimmed 40358 records to 27707 (keeping 200 days of data) [2025-09-30T17:36:58.857869] [DEBUG] [LOCAL ] BLD: Primary data saved (27707 records). [2025-09-30T17:36:58.858053] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-30T17:36:58.858159] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 32.3s. Estimated remaining: 4h 17m 50s. Rate: 8.0 symbols/min [2025-09-30T17:36:59.059884] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:59.113185] [DEBUG] [LOCAL ] BLND: Loaded 49330 existing records from primary storage. [2025-09-30T17:36:59.113521] [INFO ] [MAIN ] BLND: Loaded 49330 existing records. [2025-09-30T17:36:59.323467] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:59.323834] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-30T17:36:59.323904] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-30T17:36:59.325234] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-30T17:36:59.325301] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-30T17:36:59.455109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-30T17:36:59.701510] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:36:59.771043] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:00.254365] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-30T17:37:00.403765] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:37:00.818854] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:37:01.054362] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-30T17:37:01.854433] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-30T17:37:02.137298] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T17:37:02.355631] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:37:02.457971] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:37:02.654424] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-30T17:37:03.454366] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-30T17:37:03.571493] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:37:04.254366] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-30T17:37:04.740020] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:37:05.054360] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-30T17:37:05.202683] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:37:05.854368] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-30T17:37:06.348305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:37:06.654376] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-30T17:37:07.454391] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-30T17:37:07.863069] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T17:37:08.254484] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-30T17:37:08.341120] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:37:08.341482] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:37:09.054369] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-30T17:37:09.854375] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-30T17:37:10.072897] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:37:10.654384] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-30T17:37:10.695913] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:37:10.764013] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T17:37:10.767345] [INFO ] [REMOTE ] BLE: Full fetch complete (20384 records). [2025-09-30T17:37:10.767491] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-30T17:37:11.183908] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-30T17:37:11.184001] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-30T17:37:11.184406] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-30T17:37:11.184479] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-30T17:37:11.185221] [DEBUG] [LOCAL ] BLE: Trimmed 20384 records to 14340 (keeping 200 days of data) [2025-09-30T17:37:11.296727] [DEBUG] [LOCAL ] BLE: Primary data saved (14340 records). [2025-09-30T17:37:11.296913] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-30T17:37:11.297092] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 25.7s. Estimated remaining: 4h 18m 17s. Rate: 8.0 symbols/min [2025-09-30T17:37:11.464699] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-30T17:37:11.495188] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:11.495368] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-30T17:37:11.495405] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-30T17:37:11.495570] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-30T17:37:11.495688] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-30T17:37:11.495749] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-30T17:37:11.495784] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-30T17:37:11.886777] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:12.254466] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-30T17:37:12.441273] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:37:12.441730] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-30T17:37:12.441837] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:37:12.445163] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-30T17:37:12.445485] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:37:12.446080] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-30T17:37:12.447733] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:37:12.458498] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-30T17:37:12.459095] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-30T17:37:12.459190] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-30T17:37:12.459340] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 1.2s. Estimated remaining: 4h 17m 25s. Rate: 8.0 symbols/min [2025-09-30T17:37:12.643697] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:12.662145] [DEBUG] [LOCAL ] BLW: Loaded 12943 existing records from primary storage. [2025-09-30T17:37:12.662449] [INFO ] [MAIN ] BLW: Loaded 12943 existing records. [2025-09-30T17:37:12.852781] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:12.853160] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-30T17:37:12.853231] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-30T17:37:12.854076] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-30T17:37:12.854149] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-30T17:37:13.059505] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-30T17:37:13.243941] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:37:13.289379] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:13.854407] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-30T17:37:14.654382] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-30T17:37:14.849176] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:37:14.894590] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:37:15.454360] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-30T17:37:16.254406] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-30T17:37:16.452411] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:37:17.054392] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-30T17:37:17.528180] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T17:37:17.854345] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-30T17:37:18.192844] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T17:37:18.582574] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T17:37:18.654346] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-30T17:37:18.728815] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T17:37:19.454384] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-30T17:37:20.065373] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:37:20.254414] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-30T17:37:20.434413] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:37:21.054340] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-30T17:37:21.737659] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T17:37:21.854376] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-30T17:37:21.956290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T17:37:22.654381] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-30T17:37:23.246172] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:37:23.254226] [INFO ] [REMOTE ] BLK: Full fetch complete (52751 records). [2025-09-30T17:37:23.254352] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-30T17:37:23.458537] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-30T17:37:23.714399] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-30T17:37:23.715269] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-30T17:37:23.715165] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:37:23.716329] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-30T17:37:23.721141] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-30T17:37:23.722584] [DEBUG] [LOCAL ] BLK: Trimmed 52751 records to 34458 (keeping 200 days of data) [2025-09-30T17:37:23.992776] [DEBUG] [LOCAL ] BLK: Primary data saved (34458 records). [2025-09-30T17:37:23.992926] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-30T17:37:23.995321] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 32.9s. Estimated remaining: 4h 17m 46s. Rate: 8.0 symbols/min [2025-09-30T17:37:24.184241] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:24.211120] [DEBUG] [LOCAL ] BLX: Loaded 15569 existing records from primary storage. [2025-09-30T17:37:24.211381] [INFO ] [MAIN ] BLX: Loaded 15569 existing records. [2025-09-30T17:37:24.259483] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-30T17:37:24.404485] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:24.404739] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-30T17:37:24.404819] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-30T17:37:24.405446] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-30T17:37:24.405509] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-30T17:37:24.794159] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:25.054404] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-30T17:37:25.568332] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-30T17:37:25.854341] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-30T17:37:26.138098] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:37:26.161736] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T17:37:26.654411] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-30T17:37:27.291899] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T17:37:27.461548] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-30T17:37:27.490121] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:37:27.502032] [INFO ] [REMOTE ] BLDR: Full fetch complete (74406 records). [2025-09-30T17:37:27.502182] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-30T17:37:27.940527] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-30T17:37:27.940608] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-30T17:37:27.941396] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-30T17:37:27.941495] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-30T17:37:27.943053] [DEBUG] [LOCAL ] BLDR: Trimmed 74406 records to 51633 (keeping 200 days of data) [2025-09-30T17:37:28.254517] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-30T17:37:28.280313] [DEBUG] [LOCAL ] BLDR: Primary data saved (51633 records). [2025-09-30T17:37:28.280443] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-30T17:37:28.284793] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLDR took 44.4s. Estimated remaining: 4h 17m 17s. Rate: 8.0 symbols/min [2025-09-30T17:37:28.418707] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:37:28.482865] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:28.518902] [DEBUG] [LOCAL ] BMA: Loaded 35091 existing records from primary storage. [2025-09-30T17:37:28.519205] [INFO ] [MAIN ] BMA: Loaded 35091 existing records. [2025-09-30T17:37:28.701381] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:28.701612] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-30T17:37:28.701695] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-30T17:37:28.702481] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-30T17:37:28.702546] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-30T17:37:29.054390] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-30T17:37:29.081439] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:29.815936] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T17:37:29.854307] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-30T17:37:29.929270] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:37:29.943763] [INFO ] [REMOTE ] BLND: Full fetch complete (71898 records). [2025-09-30T17:37:29.943934] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-30T17:37:29.944902] [FATAL] [VALIDATOR ] BLND: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:37:29.945030] [FATAL] [MAIN ] BLND: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:37:29.945113] [WARN ] [MAIN ] BLND: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:37:29.945217] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-30T17:37:29.945307] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-09-30T17:37:29.945350] [INFO ] [LOCAL ] BLND: Starting deletion of derivative data. [2025-09-30T17:37:29.945693] [DEBUG] [LOCAL ] BLND: Deleted derivative data file. [2025-09-30T17:37:29.945829] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 31.1s. Estimated remaining: 4h 16m 30s. Rate: 8.1 symbols/min [2025-09-30T17:37:30.130913] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:30.142797] [DEBUG] [LOCAL ] BME: Loaded 10831 existing records from primary storage. [2025-09-30T17:37:30.143035] [INFO ] [MAIN ] BME: Loaded 10831 existing records. [2025-09-30T17:37:30.344334] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:30.344633] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-30T17:37:30.344751] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-30T17:37:30.345268] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-30T17:37:30.345357] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-30T17:37:30.661107] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-30T17:37:30.676005] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:37:30.812573] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:31.454386] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-30T17:37:32.056613] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T17:37:32.254360] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-30T17:37:32.459182] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T17:37:33.054392] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-30T17:37:33.268954] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:37:33.854360] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-30T17:37:34.625583] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:37:34.659720] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-30T17:37:34.661333] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:37:35.454362] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-30T17:37:35.586526] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:37:35.590393] [INFO ] [REMOTE ] BLW: Full fetch complete (19054 records). [2025-09-30T17:37:35.590474] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-30T17:37:35.970699] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-30T17:37:35.970793] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-30T17:37:35.971177] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-30T17:37:35.971274] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-30T17:37:35.972360] [DEBUG] [LOCAL ] BLW: Trimmed 19054 records to 12979 (keeping 200 days of data) [2025-09-30T17:37:36.056164] [DEBUG] [LOCAL ] BLW: Primary data saved (12979 records). [2025-09-30T17:37:36.056304] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-30T17:37:36.056386] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 23.6s. Estimated remaining: 4h 16m 13s. Rate: 8.1 symbols/min [2025-09-30T17:37:36.240110] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:36.255881] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-30T17:37:36.269988] [DEBUG] [LOCAL ] BMEZ: Loaded 26001 existing records from primary storage. [2025-09-30T17:37:36.270445] [INFO ] [MAIN ] BMEZ: Loaded 26001 existing records. [2025-09-30T17:37:36.471208] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:36.471432] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-30T17:37:36.471514] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-30T17:37:36.483407] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-30T17:37:36.484738] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-30T17:37:36.484674] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T17:37:36.889251] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:37.054414] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-30T17:37:37.357510] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:37:37.846307] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:37:37.854307] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-30T17:37:38.600893] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:37:38.654388] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-30T17:37:39.454363] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-30T17:37:39.538687] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:37:40.254336] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-30T17:37:40.403600] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:37:41.054389] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-30T17:37:41.592429] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:37:41.854371] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-30T17:37:41.971415] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:37:42.654364] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-30T17:37:43.100474] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:37:43.454341] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-30T17:37:43.624033] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:37:44.254365] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-30T17:37:44.606667] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:37:45.054375] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-30T17:37:45.122279] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:37:45.854377] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-30T17:37:46.191771] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:37:46.195550] [INFO ] [REMOTE ] BLX: Full fetch complete (22697 records). [2025-09-30T17:37:46.195634] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-30T17:37:46.622734] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-30T17:37:46.623413] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-30T17:37:46.623694] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T17:37:46.624233] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-30T17:37:46.627190] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-30T17:37:46.628418] [DEBUG] [LOCAL ] BLX: Trimmed 22697 records to 15578 (keeping 200 days of data) [2025-09-30T17:37:46.669179] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-30T17:37:46.725327] [DEBUG] [LOCAL ] BLX: Primary data saved (15578 records). [2025-09-30T17:37:46.725481] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-30T17:37:46.725566] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 22.7s. Estimated remaining: 4h 16m 28s. Rate: 8.1 symbols/min [2025-09-30T17:37:46.901243] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:46.926162] [DEBUG] [LOCAL ] BMI: Loaded 24272 existing records from primary storage. [2025-09-30T17:37:46.926421] [INFO ] [MAIN ] BMI: Loaded 24272 existing records. [2025-09-30T17:37:47.122836] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:47.123073] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-30T17:37:47.123121] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-30T17:37:47.124118] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-30T17:37:47.124181] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-30T17:37:47.473259] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-30T17:37:47.517031] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:47.525921] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:37:48.254386] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-30T17:37:48.874222] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:37:49.054350] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-30T17:37:49.471897] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:37:49.854376] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-30T17:37:50.465854] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T17:37:50.654415] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-30T17:37:50.904290] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:37:51.346073] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:37:51.454371] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-30T17:37:52.254344] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-30T17:37:52.295799] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T17:37:53.054367] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-30T17:37:53.814464] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:37:53.856873] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-30T17:37:53.860689] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:37:54.654361] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-30T17:37:55.454451] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-30T17:37:55.720141] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:37:55.730384] [INFO ] [REMOTE ] BMA: Full fetch complete (51400 records). [2025-09-30T17:37:55.730563] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-30T17:37:56.041562] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:37:56.263563] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-30T17:37:56.266488] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-30T17:37:56.267530] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-30T17:37:56.268237] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-30T17:37:56.268427] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-30T17:37:56.269705] [DEBUG] [LOCAL ] BMA: Trimmed 51400 records to 35166 (keeping 200 days of data) [2025-09-30T17:37:56.300560] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:37:56.607023] [DEBUG] [LOCAL ] BMA: Primary data saved (35166 records). [2025-09-30T17:37:56.607229] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-30T17:37:56.607395] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 28.3s. Estimated remaining: 4h 16m 37s. Rate: 8.1 symbols/min [2025-09-30T17:37:56.790727] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:56.796070] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-30T17:37:56.796236] [INFO ] [MAIN ] BMN: Loaded 2561 existing records. [2025-09-30T17:37:56.982322] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:56.982568] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-30T17:37:56.982615] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-30T17:37:56.983073] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-30T17:37:56.983153] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-30T17:37:57.058454] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-30T17:37:57.376001] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:57.392975] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:37:57.854365] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-30T17:37:58.200541] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:37:58.654360] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-30T17:37:58.827681] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:37:59.354177] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T17:37:59.454359] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-30T17:38:00.254417] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-30T17:38:01.054378] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-30T17:38:01.432264] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:38:01.854320] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-30T17:38:02.020415] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:38:02.127611] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:38:02.654345] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-30T17:38:02.927534] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T17:38:03.454330] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-30T17:38:03.774722] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T17:38:04.144026] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T17:38:04.254369] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-30T17:38:05.054337] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-30T17:38:05.157296] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T17:38:05.854358] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-30T17:38:06.052230] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:38:06.654363] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-30T17:38:06.911901] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:38:06.915147] [INFO ] [REMOTE ] BME: Full fetch complete (16101 records). [2025-09-30T17:38:06.915351] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-30T17:38:07.338816] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-30T17:38:07.338925] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-30T17:38:07.339314] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-30T17:38:07.339362] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-30T17:38:07.339962] [DEBUG] [LOCAL ] BME: Trimmed 16101 records to 10880 (keeping 200 days of data) [2025-09-30T17:38:07.411796] [DEBUG] [LOCAL ] BME: Primary data saved (10880 records). [2025-09-30T17:38:07.411951] [INFO ] [MAIN ] BME: Full history saved. [2025-09-30T17:38:07.412045] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 37.5s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-09-30T17:38:07.461870] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-30T17:38:07.620686] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:07.670360] [DEBUG] [LOCAL ] BMO: Loaded 41236 existing records from primary storage. [2025-09-30T17:38:07.670952] [INFO ] [MAIN ] BMO: Loaded 41236 existing records. [2025-09-30T17:38:07.889093] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:07.889360] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-30T17:38:07.895434] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-30T17:38:07.908058] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-30T17:38:07.907982] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:38:07.908338] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-30T17:38:08.277638] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-30T17:38:08.364611] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:08.868486] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:38:09.054366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-30T17:38:09.169165] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:38:09.854377] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-30T17:38:10.664800] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-30T17:38:10.697143] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:38:11.319910] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:38:11.326152] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40961 records). [2025-09-30T17:38:11.326260] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-30T17:38:11.459522] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-30T17:38:11.800257] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-30T17:38:11.800455] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-30T17:38:11.801264] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-30T17:38:11.801632] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-30T17:38:11.802909] [DEBUG] [LOCAL ] BMEZ: Trimmed 40961 records to 26164 (keeping 200 days of data) [2025-09-30T17:38:11.931808] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:38:12.006898] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26164 records). [2025-09-30T17:38:12.007048] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-30T17:38:12.007141] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 36.0s. Estimated remaining: 4h 16m 25s. Rate: 8.0 symbols/min [2025-09-30T17:38:12.189572] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:12.246199] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-30T17:38:12.246587] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-30T17:38:12.259581] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-30T17:38:12.454336] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:12.454588] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-30T17:38:12.454639] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-30T17:38:12.457004] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-30T17:38:12.457112] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-30T17:38:12.865532] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:12.972154] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T17:38:12.975585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:38:13.054341] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-30T17:38:13.656840] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T17:38:13.854384] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-30T17:38:14.654375] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-30T17:38:15.341737] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:38:15.454358] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-30T17:38:16.254339] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-30T17:38:16.650070] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T17:38:16.690292] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T17:38:16.981271] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:38:16.988045] [INFO ] [REMOTE ] BMI: Full fetch complete (32976 records). [2025-09-30T17:38:16.988179] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-30T17:38:17.063269] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-30T17:38:17.401543] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-30T17:38:17.401638] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-30T17:38:17.402205] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-30T17:38:17.402258] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-30T17:38:17.403315] [DEBUG] [LOCAL ] BMI: Trimmed 32976 records to 24271 (keeping 200 days of data) [2025-09-30T17:38:17.589201] [DEBUG] [LOCAL ] BMI: Primary data saved (24271 records). [2025-09-30T17:38:17.589345] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-30T17:38:17.589433] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMI took 30.9s. Estimated remaining: 4h 16m 5s. Rate: 8.1 symbols/min [2025-09-30T17:38:17.681224] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T17:38:17.777438] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:17.834939] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-09-30T17:38:17.835273] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-09-30T17:38:17.859489] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-30T17:38:18.034181] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:18.034436] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-30T17:38:18.034486] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-30T17:38:18.036020] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-30T17:38:18.036088] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-30T17:38:18.415810] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:18.654358] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-30T17:38:19.103809] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:38:19.459984] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-30T17:38:19.465710] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:38:19.779872] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T17:38:20.254377] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-30T17:38:21.054409] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-30T17:38:21.520271] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T17:38:21.854364] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-30T17:38:22.020406] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:38:22.318938] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:38:22.654364] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-30T17:38:23.454379] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-30T17:38:24.179088] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T17:38:24.180700] [INFO ] [REMOTE ] BMN: Full fetch complete (3721 records). [2025-09-30T17:38:24.180782] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-30T17:38:24.181189] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:38:24.181276] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:38:24.181323] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:38:24.181367] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-30T17:38:24.181427] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-30T17:38:24.181464] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-09-30T17:38:24.181733] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-09-30T17:38:24.181828] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMN took 27.6s. Estimated remaining: 4h 15m 52s. Rate: 8.1 symbols/min [2025-09-30T17:38:24.259504] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-30T17:38:24.346429] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:38:24.441992] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:24.479429] [DEBUG] [LOCAL ] BNED: Loaded 29579 existing records from primary storage. [2025-09-30T17:38:24.479812] [INFO ] [MAIN ] BNED: Loaded 29579 existing records. [2025-09-30T17:38:24.688041] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:24.688344] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-30T17:38:24.688407] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-30T17:38:24.689451] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-30T17:38:24.689521] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-30T17:38:25.063192] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-30T17:38:25.096762] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:25.854338] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-30T17:38:26.109437] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:38:26.191534] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:38:26.654386] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-30T17:38:27.454420] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-30T17:38:27.923702] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:38:28.228384] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:38:28.254340] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-30T17:38:29.054616] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-30T17:38:29.055496] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:38:29.628716] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:38:29.854390] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-30T17:38:30.654388] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-30T17:38:30.865855] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:38:31.454340] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-30T17:38:31.490608] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:38:31.567510] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T17:38:32.254382] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-30T17:38:33.054329] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-30T17:38:33.168162] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:38:33.335811] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:38:33.854359] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-30T17:38:34.654389] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-30T17:38:34.789745] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:38:35.454330] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-30T17:38:35.800217] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T17:38:36.055011] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:38:36.254398] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-30T17:38:37.054378] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-30T17:38:37.601403] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-30T17:38:37.854357] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-30T17:38:38.217543] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T17:38:38.300534] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:38:38.654344] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-30T17:38:39.454333] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-30T17:38:39.573477] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:38:39.917906] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:38:40.254368] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-30T17:38:41.054336] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-30T17:38:41.294695] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T17:38:41.635709] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:38:41.854393] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-30T17:38:42.654358] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-30T17:38:43.159879] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:38:43.169272] [INFO ] [REMOTE ] BMO: Full fetch complete (59696 records). [2025-09-30T17:38:43.169397] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-30T17:38:43.468759] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-30T17:38:43.588174] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-30T17:38:43.588327] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-30T17:38:43.589050] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-30T17:38:43.589115] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-30T17:38:43.590809] [DEBUG] [LOCAL ] BMO: Trimmed 59696 records to 41237 (keeping 200 days of data) [2025-09-30T17:38:43.864958] [DEBUG] [LOCAL ] BMO: Primary data saved (41237 records). [2025-09-30T17:38:43.865263] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-30T17:38:43.865385] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 36.5s. Estimated remaining: 4h 17m 6s. Rate: 8.0 symbols/min [2025-09-30T17:38:44.062704] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:44.099080] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T17:38:44.112853] [DEBUG] [LOCAL ] BNH: Loaded 4916 existing records from primary storage. [2025-09-30T17:38:44.113500] [INFO ] [MAIN ] BNH: Loaded 4916 existing records. [2025-09-30T17:38:44.259470] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-30T17:38:44.322609] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:44.323600] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-30T17:38:44.323703] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-30T17:38:44.323930] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-30T17:38:44.324020] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-30T17:38:44.634777] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:38:44.818585] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:44.839911] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:38:45.054397] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-30T17:38:45.854367] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-30T17:38:46.443306] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:38:46.654378] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-30T17:38:46.798353] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:38:47.013934] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:38:47.454589] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-30T17:38:48.076006] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T17:38:48.254442] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-30T17:38:48.449588] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:38:49.054395] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-30T17:38:49.521982] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:38:49.528162] [INFO ] [REMOTE ] BNED: Full fetch complete (43987 records). [2025-09-30T17:38:49.528336] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-30T17:38:49.859494] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-30T17:38:49.948667] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-30T17:38:49.948761] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-30T17:38:49.949335] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-30T17:38:49.949378] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-30T17:38:49.950411] [DEBUG] [LOCAL ] BNED: Trimmed 43987 records to 29561 (keeping 200 days of data) [2025-09-30T17:38:50.157283] [DEBUG] [LOCAL ] BNED: Primary data saved (29561 records). [2025-09-30T17:38:50.157453] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-30T17:38:50.157546] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BNED took 26.0s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-09-30T17:38:50.349090] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:50.354598] [DEBUG] [LOCAL ] BNJ: Loaded 2582 existing records from primary storage. [2025-09-30T17:38:50.354911] [INFO ] [MAIN ] BNJ: Loaded 2582 existing records. [2025-09-30T17:38:50.558048] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:50.558371] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-30T17:38:50.558431] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-30T17:38:50.558600] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-30T17:38:50.558692] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-30T17:38:50.659749] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-30T17:38:51.027318] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:51.054610] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:38:51.067551] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T17:38:51.070605] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-30T17:38:51.070858] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-30T17:38:51.222375] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-30T17:38:51.459561] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-30T17:38:51.621891] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-30T17:38:51.621975] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-30T17:38:51.622944] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-30T17:38:51.623012] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-30T17:38:51.624830] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-30T17:38:52.015056] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-30T17:38:52.015237] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-30T17:38:52.015340] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 40.0s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-09-30T17:38:52.200526] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:52.251327] [DEBUG] [LOCAL ] BNL: Loaded 46846 existing records from primary storage. [2025-09-30T17:38:52.251629] [INFO ] [MAIN ] BNL: Loaded 46846 existing records. [2025-09-30T17:38:52.262998] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-30T17:38:52.435809] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:52.436010] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-30T17:38:52.436056] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-30T17:38:52.437045] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-30T17:38:52.437107] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-30T17:38:52.798759] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:52.953511] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T17:38:53.054398] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-30T17:38:53.671860] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:38:53.686149] [INFO ] [REMOTE ] BN: Full fetch complete (76661 records). [2025-09-30T17:38:53.686325] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-30T17:38:53.863502] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-30T17:38:54.138705] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-30T17:38:54.138807] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-30T17:38:54.139688] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-30T17:38:54.139756] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-30T17:38:54.141444] [DEBUG] [LOCAL ] BN: Trimmed 76661 records to 52993 (keeping 200 days of data) [2025-09-30T17:38:54.448464] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T17:38:54.450269] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T17:38:54.558377] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-09-30T17:38:54.558535] [INFO ] [MAIN ] BN: Full history saved. [2025-09-30T17:38:54.558625] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 37.0s. Estimated remaining: 4h 15m 26s. Rate: 8.1 symbols/min [2025-09-30T17:38:54.659671] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-30T17:38:54.763940] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:54.815089] [DEBUG] [LOCAL ] BNS: Loaded 51439 existing records from primary storage. [2025-09-30T17:38:54.815445] [INFO ] [MAIN ] BNS: Loaded 51439 existing records. [2025-09-30T17:38:55.016085] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:55.016391] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-30T17:38:55.016452] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-30T17:38:55.017886] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-30T17:38:55.017958] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-30T17:38:55.421786] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T17:38:55.428684] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:55.454334] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-30T17:38:56.159915] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T17:38:56.254421] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-30T17:38:56.872130] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T17:38:57.054363] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-30T17:38:57.635038] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T17:38:57.854366] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-30T17:38:58.557998] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:38:58.654360] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-30T17:38:59.454376] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-30T17:38:59.924806] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T17:39:00.254342] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-30T17:39:00.434922] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:39:00.951316] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:39:00.952985] [INFO ] [REMOTE ] BNH: Full fetch complete (6990 records). [2025-09-30T17:39:00.953059] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-30T17:39:01.059476] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-30T17:39:01.356203] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-30T17:39:01.356283] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-30T17:39:01.356470] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-30T17:39:01.356510] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-30T17:39:01.356945] [DEBUG] [LOCAL ] BNH: Trimmed 6990 records to 5055 (keeping 200 days of data) [2025-09-30T17:39:01.390374] [DEBUG] [LOCAL ] BNH: Primary data saved (5055 records). [2025-09-30T17:39:01.390495] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-30T17:39:01.390612] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 17.5s. Estimated remaining: 4h 15m 15s. Rate: 8.1 symbols/min [2025-09-30T17:39:01.584017] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:01.590351] [DEBUG] [LOCAL ] BNT: Loaded 3382 existing records from primary storage. [2025-09-30T17:39:01.590557] [INFO ] [MAIN ] BNT: Loaded 3382 existing records. [2025-09-30T17:39:01.798540] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:01.798808] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-30T17:39:01.798862] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-30T17:39:01.799377] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-30T17:39:01.799489] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-30T17:39:01.864279] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-30T17:39:02.227328] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:02.449282] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T17:39:02.654368] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-30T17:39:02.819204] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:39:03.454368] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-30T17:39:03.930688] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T17:39:04.174079] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:39:04.254355] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-30T17:39:04.733130] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:39:05.054360] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-30T17:39:05.607577] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:39:05.854399] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-30T17:39:06.219042] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:39:06.654347] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-30T17:39:07.213360] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:39:07.454407] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-30T17:39:07.898375] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T17:39:08.254438] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-30T17:39:08.760789] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T17:39:09.054406] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-30T17:39:09.854360] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-30T17:39:10.183105] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-30T17:39:10.463815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:39:10.654341] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-30T17:39:11.454405] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-30T17:39:11.798276] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T17:39:12.254380] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-30T17:39:12.377998] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:39:12.528696] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-30T17:39:13.054392] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-30T17:39:13.854378] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-30T17:39:14.654357] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-30T17:39:14.866036] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:39:15.318125] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:39:15.429842] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:39:15.454332] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-30T17:39:16.064334] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:39:16.254370] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-30T17:39:17.054367] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-30T17:39:17.637412] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:39:17.638789] [INFO ] [REMOTE ] BNJ: Full fetch complete (4398 records). [2025-09-30T17:39:17.638864] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-30T17:39:17.860197] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-30T17:39:18.033937] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-30T17:39:18.034104] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-30T17:39:18.034488] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-30T17:39:18.034598] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-30T17:39:18.035181] [DEBUG] [LOCAL ] BNJ: Trimmed 4398 records to 2607 (keeping 200 days of data) [2025-09-30T17:39:18.080999] [DEBUG] [LOCAL ] BNJ: Primary data saved (2607 records). [2025-09-30T17:39:18.080885] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:39:18.081185] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-30T17:39:18.093144] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 27.9s. Estimated remaining: 4h 16m 8s. Rate: 8.0 symbols/min [2025-09-30T17:39:18.278500] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:18.287802] [DEBUG] [LOCAL ] BNY: Loaded 7148 existing records from primary storage. [2025-09-30T17:39:18.288063] [INFO ] [MAIN ] BNY: Loaded 7148 existing records. [2025-09-30T17:39:18.486077] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:18.486343] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-30T17:39:18.486397] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-30T17:39:18.486874] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-30T17:39:18.486938] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-30T17:39:18.656335] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-30T17:39:18.914118] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:19.331087] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:39:19.454352] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-30T17:39:19.617925] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T17:39:19.897659] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T17:39:20.254358] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-30T17:39:21.054405] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-30T17:39:21.854358] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-30T17:39:21.888021] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:39:22.613306] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:39:22.654338] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-30T17:39:22.761552] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:39:23.454403] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-30T17:39:24.254345] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-30T17:39:24.301557] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:39:24.336169] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T17:39:25.054370] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-30T17:39:25.736275] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:39:25.751154] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:39:25.854353] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-30T17:39:26.294080] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T17:39:26.654360] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-30T17:39:27.454404] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-30T17:39:28.110792] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T17:39:28.112581] [INFO ] [REMOTE ] BNT: Full fetch complete (4480 records). [2025-09-30T17:39:28.112699] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-30T17:39:28.257440] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-30T17:39:28.578119] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:39:28.596439] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-30T17:39:28.597175] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-30T17:39:28.597637] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-30T17:39:28.597744] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-30T17:39:28.598587] [DEBUG] [LOCAL ] BNT: Trimmed 4480 records to 3373 (keeping 200 days of data) [2025-09-30T17:39:28.622563] [DEBUG] [LOCAL ] BNT: Primary data saved (3373 records). [2025-09-30T17:39:28.622756] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-30T17:39:28.622909] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 27.2s. Estimated remaining: 4h 16m 20s. Rate: 8.0 symbols/min [2025-09-30T17:39:28.810321] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:28.834031] [DEBUG] [LOCAL ] BOC: Loaded 18267 existing records from primary storage. [2025-09-30T17:39:28.834284] [INFO ] [MAIN ] BOC: Loaded 18267 existing records. [2025-09-30T17:39:28.946538] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T17:39:29.034817] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:29.035041] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-30T17:39:29.035091] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-30T17:39:29.036488] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-30T17:39:29.036570] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-30T17:39:29.059522] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-30T17:39:29.432466] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:29.854373] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-30T17:39:30.654375] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-30T17:39:30.804958] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T17:39:30.901447] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:39:31.454424] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-30T17:39:31.562472] [DEBUG] [REMOTE ] BNL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-30T17:39:31.562865] [WARN ] [REMOTE ] BNL: No data returned for month 2025-07 [2025-09-30T17:39:31.562955] [FATAL] [REMOTE ] BNL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:39:31.563046] [FATAL] [MAIN ] BNL: Failed to fetch primary data. [2025-09-30T17:39:31.563116] [WARN ] [MAIN ] BNL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:39:31.563185] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-30T17:39:31.563251] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-09-30T17:39:31.563288] [INFO ] [LOCAL ] BNL: Starting deletion of derivative data. [2025-09-30T17:39:31.563547] [DEBUG] [LOCAL ] BNL: Deleted derivative data file. [2025-09-30T17:39:31.563688] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNL took 39.5s. Estimated remaining: 4h 15m 43s. Rate: 8.0 symbols/min [2025-09-30T17:39:32.247830] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:39:32.257930] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-30T17:39:32.259887] [INFO ] [REMOTE ] BNS: Full fetch complete (73828 records). [2025-09-30T17:39:32.260076] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-30T17:39:32.261121] [FATAL] [VALIDATOR ] BNS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:39:32.261215] [FATAL] [MAIN ] BNS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:39:32.261285] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:39:32.261366] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-30T17:39:32.261439] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-09-30T17:39:32.261477] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-09-30T17:39:32.261803] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-09-30T17:39:32.261939] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 37.7s. Estimated remaining: 4h 14m 52s. Rate: 8.1 symbols/min [2025-09-30T17:39:33.054353] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-30T17:39:33.226520] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:39:33.799109] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T17:39:33.854362] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-30T17:39:34.505084] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:39:34.654390] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-30T17:39:35.454468] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-30T17:39:35.521125] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:39:36.155086] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T17:39:36.254366] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-30T17:39:37.054457] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-30T17:39:37.250909] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:39:37.516597] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:39:37.854443] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-30T17:39:38.598409] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T17:39:38.654339] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-30T17:39:39.349899] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T17:39:39.454438] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-30T17:39:40.254460] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-30T17:39:40.509140] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:39:41.054369] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-30T17:39:41.151274] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:39:41.153338] [INFO ] [REMOTE ] BNY: Full fetch complete (10417 records). [2025-09-30T17:39:41.153420] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-30T17:39:41.583880] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-30T17:39:41.584005] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-30T17:39:41.584565] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-30T17:39:41.584679] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-30T17:39:41.585431] [DEBUG] [LOCAL ] BNY: Trimmed 10417 records to 7119 (keeping 200 days of data) [2025-09-30T17:39:41.631827] [DEBUG] [LOCAL ] BNY: Primary data saved (7119 records). [2025-09-30T17:39:41.631976] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-30T17:39:41.632067] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 23.5s. Estimated remaining: 4h 14m 57s. Rate: 8.0 symbols/min [2025-09-30T17:39:41.883676] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:39:41.887593] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-30T17:39:42.867873] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T17:39:42.872253] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-30T17:39:43.850871] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T17:39:43.856072] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-30T17:39:44.633810] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:39:44.639137] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-30T17:39:45.868396] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:39:45.872487] [INFO ] [REMOTE ] BOC: Full fetch complete (25791 records). [2025-09-30T17:39:45.872579] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-30T17:39:46.257843] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-30T17:39:46.257933] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-30T17:39:46.258434] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-30T17:39:46.258500] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-30T17:39:46.259294] [DEBUG] [LOCAL ] BOC: Trimmed 25791 records to 18278 (keeping 200 days of data) [2025-09-30T17:39:46.372393] [DEBUG] [LOCAL ] BOC: Primary data saved (18278 records). [2025-09-30T17:39:46.372536] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-30T17:39:46.372617] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 17.7s. Estimated remaining: 4h 14m 32s. Rate: 8.1 symbols/min [2025-09-30T17:39:47.131717] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.134983] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.165997] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.139150] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.218365] [DEBUG] [LOCAL ] BOE: Loaded 17601 existing records from primary storage. [2025-09-30T17:39:47.226926] [DEBUG] [LOCAL ] BOND: Loaded 32075 existing records from primary storage. [2025-09-30T17:39:47.227412] [INFO ] [MAIN ] BOE: Loaded 17601 existing records. [2025-09-30T17:39:47.239258] [INFO ] [MAIN ] BOND: Loaded 32075 existing records. [2025-09-30T17:39:47.409190] [DEBUG] [LOCAL ] BOH: Loaded 30949 existing records from primary storage. [2025-09-30T17:39:47.461598] [INFO ] [MAIN ] BOH: Loaded 30949 existing records. [2025-09-30T17:39:47.657543] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:47.683701] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-30T17:39:47.706081] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-30T17:39:47.764566] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:47.752692] [DEBUG] [LOCAL ] BOOT: Loaded 40631 existing records from primary storage. [2025-09-30T17:39:47.765074] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-30T17:39:47.765185] [INFO ] [MAIN ] BOOT: Loaded 40631 existing records. [2025-09-30T17:39:47.770488] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-30T17:39:47.775799] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-30T17:39:47.775876] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-30T17:39:48.040596] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:48.000978] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-30T17:39:48.076172] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-30T17:39:48.099279] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-30T17:39:48.122193] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-30T17:39:48.277864] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-30T17:39:48.352827] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-30T17:39:48.390392] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:48.560504] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-30T17:39:48.747106] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-30T17:39:48.927404] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-30T17:39:49.022788] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-30T17:39:49.086924] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.175302] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.215960] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-30T17:39:49.268597] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-30T17:39:49.567889] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.598348] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-30T17:39:49.787876] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.788229] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-30T17:39:50.369942] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:39:50.377031] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-30T17:39:50.482561] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:39:50.487587] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-30T17:39:50.848618] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T17:39:50.857216] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-30T17:39:51.012360] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T17:39:51.018626] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-30T17:39:51.293869] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:39:51.454389] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-30T17:39:51.506840] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T17:39:52.160548] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:39:52.222233] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:39:52.254340] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-30T17:39:52.396194] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:39:53.054338] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-30T17:39:53.286614] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:39:53.854386] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-30T17:39:54.654353] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-30T17:39:54.720179] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:39:54.885415] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:39:55.454360] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-30T17:39:55.836578] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:39:56.254355] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-30T17:39:56.457005] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:39:57.054356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-30T17:39:57.582161] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:39:57.854395] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-30T17:39:58.170963] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:39:58.654391] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-30T17:39:59.454333] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-30T17:39:59.556049] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:39:59.582566] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T17:40:00.254372] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-30T17:40:01.054328] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-30T17:40:01.308776] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T17:40:01.854369] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-30T17:40:02.654337] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-30T17:40:02.792799] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:40:02.882402] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-30T17:40:02.959986] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:40:03.454354] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-30T17:40:03.956379] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:40:04.081971] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T17:40:04.254330] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-30T17:40:05.054357] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-30T17:40:05.854337] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-30T17:40:06.058961] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:40:06.066304] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:40:06.654422] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-30T17:40:07.101337] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:40:07.454363] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-30T17:40:07.759504] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:40:08.254325] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-30T17:40:08.366369] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T17:40:09.054404] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-30T17:40:09.601299] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:40:09.840743] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T17:40:09.854309] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-30T17:40:10.654477] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-30T17:40:11.166920] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:40:11.454422] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-30T17:40:12.072253] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T17:40:12.254384] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-30T17:40:13.054461] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-30T17:40:13.324347] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:40:13.804747] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:40:13.854402] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-30T17:40:14.026528] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:40:14.654408] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-30T17:40:15.326474] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:40:15.335046] [INFO ] [REMOTE ] BOOT: Full fetch complete (60257 records). [2025-09-30T17:40:15.335368] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-30T17:40:15.459579] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-30T17:40:15.735535] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-30T17:40:15.735717] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-30T17:40:15.736682] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-30T17:40:15.736896] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-30T17:40:15.738865] [DEBUG] [LOCAL ] BOOT: Trimmed 60257 records to 40594 (keeping 200 days of data) [2025-09-30T17:40:16.000402] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T17:40:16.012705] [INFO ] [REMOTE ] BOH: Full fetch complete (44721 records). [2025-09-30T17:40:16.013457] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-30T17:40:16.015126] [FATAL] [VALIDATOR ] BOH: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:40:16.015635] [FATAL] [MAIN ] BOH: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:40:16.015736] [WARN ] [MAIN ] BOH: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:40:16.015787] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-30T17:40:16.016244] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-09-30T17:40:16.016689] [INFO ] [LOCAL ] BOH: Starting deletion of derivative data. [2025-09-30T17:40:16.017156] [DEBUG] [LOCAL ] BOH: Deleted derivative data file. [2025-09-30T17:40:16.017322] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOH took 29.6s. Estimated remaining: 4h 16m 46s. Rate: 8.0 symbols/min [2025-09-30T17:40:16.208669] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:16.258750] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-30T17:40:16.261520] [DEBUG] [LOCAL ] BOOT: Primary data saved (40594 records). [2025-09-30T17:40:16.261722] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-30T17:40:16.262200] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOOT took 29.9s. Estimated remaining: 4h 15m 53s. Rate: 8.0 symbols/min [2025-09-30T17:40:16.412438] [DEBUG] [LOCAL ] BORR: Loaded 51131 existing records from primary storage. [2025-09-30T17:40:16.426503] [INFO ] [MAIN ] BORR: Loaded 51131 existing records. [2025-09-30T17:40:16.640461] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:16.712531] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:16.713466] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-30T17:40:16.713598] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-30T17:40:16.713995] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-30T17:40:16.714213] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-30T17:40:16.867519] [DEBUG] [LOCAL ] BOW: Loaded 23476 existing records from primary storage. [2025-09-30T17:40:16.889228] [INFO ] [MAIN ] BOW: Loaded 23476 existing records. [2025-09-30T17:40:17.293293] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:17.321951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-30T17:40:17.361742] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:17.382863] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-30T17:40:17.383266] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-30T17:40:17.384616] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:40:17.384725] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-30T17:40:17.391846] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-30T17:40:17.446586] [INFO ] [REMOTE ] BOND: Full fetch complete (46408 records). [2025-09-30T17:40:17.483555] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-30T17:40:18.118378] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:18.139369] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-30T17:40:18.279780] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-30T17:40:18.279867] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-30T17:40:18.280437] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-30T17:40:18.280480] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-30T17:40:18.281688] [DEBUG] [LOCAL ] BOND: Trimmed 46408 records to 32125 (keeping 200 days of data) [2025-09-30T17:40:18.506788] [DEBUG] [LOCAL ] BOND: Primary data saved (32125 records). [2025-09-30T17:40:18.506945] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-30T17:40:18.507033] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 32.1s. Estimated remaining: 4h 15m 12s. Rate: 8.0 symbols/min [2025-09-30T17:40:18.705765] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:18.763095] [DEBUG] [LOCAL ] BOX: Loaded 50244 existing records from primary storage. [2025-09-30T17:40:18.763447] [INFO ] [MAIN ] BOX: Loaded 50244 existing records. [2025-09-30T17:40:19.005957] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:19.006354] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-30T17:40:19.006415] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-30T17:40:19.008365] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-30T17:40:19.008430] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-30T17:40:19.442742] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:19.443317] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-30T17:40:19.498837] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-30T17:40:19.510409] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-30T17:40:20.378700] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (4.12 seconds). [2025-09-30T17:40:20.383536] [INFO ] [REMOTE ] BOE: Full fetch complete (26486 records). [2025-09-30T17:40:20.383690] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-30T17:40:20.384233] [FATAL] [VALIDATOR ] BOE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:40:20.384324] [FATAL] [MAIN ] BOE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:40:20.384384] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:40:20.384475] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-30T17:40:20.384550] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-09-30T17:40:20.384593] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-09-30T17:40:20.384782] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-09-30T17:40:20.384878] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOE took 34.0s. Estimated remaining: 4h 14m 29s. Rate: 8.0 symbols/min [2025-09-30T17:40:20.582840] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:20.644582] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-30T17:40:20.645050] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-30T17:40:20.843896] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:20.844130] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-30T17:40:20.844179] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-30T17:40:20.844448] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-30T17:40:20.844508] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-30T17:40:21.267378] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:21.268740] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-30T17:40:21.285734] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-09-30T17:40:21.290928] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-30T17:40:21.337559] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:40:21.854416] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-30T17:40:22.270174] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:40:22.330972] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-30T17:40:22.654371] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-30T17:40:23.091977] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:40:23.454373] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-30T17:40:23.488410] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:40:23.618230] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:40:24.254390] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-30T17:40:25.054332] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-30T17:40:25.511544] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-30T17:40:25.512700] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T17:40:25.854408] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-30T17:40:26.654325] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-30T17:40:26.852136] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:40:27.223403] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:40:27.454364] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-30T17:40:28.254345] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-30T17:40:28.387291] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T17:40:29.044719] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T17:40:29.054308] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-30T17:40:29.371154] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:40:29.854378] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-30T17:40:30.052280] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:40:30.654377] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-30T17:40:31.454380] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-30T17:40:32.098471] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-30T17:40:32.254336] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-30T17:40:32.358286] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:40:32.489017] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:40:33.054375] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-30T17:40:33.854330] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-30T17:40:33.888131] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:40:34.274453] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:40:34.654332] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-30T17:40:35.454382] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-30T17:40:35.847273] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:40:35.853288] [INFO ] [REMOTE ] BOW: Full fetch complete (31272 records). [2025-09-30T17:40:35.853454] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-30T17:40:36.256052] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-30T17:40:36.255849] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-30T17:40:36.257229] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-30T17:40:36.257801] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-30T17:40:36.257898] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-30T17:40:36.259196] [DEBUG] [LOCAL ] BOW: Trimmed 31272 records to 23531 (keeping 200 days of data) [2025-09-30T17:40:36.380240] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-30T17:40:36.462402] [DEBUG] [LOCAL ] BOW: Primary data saved (23531 records). [2025-09-30T17:40:36.462543] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-30T17:40:36.462632] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 20.2s. Estimated remaining: 4h 15m 16s. Rate: 8.0 symbols/min [2025-09-30T17:40:36.651263] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:36.689077] [DEBUG] [LOCAL ] BR: Loaded 34585 existing records from primary storage. [2025-09-30T17:40:36.689490] [INFO ] [MAIN ] BR: Loaded 34585 existing records. [2025-09-30T17:40:36.881257] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:36.881681] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-30T17:40:36.881765] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-30T17:40:36.882934] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-30T17:40:36.882998] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-30T17:40:37.069726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-30T17:40:37.224788] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:40:37.328238] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:37.854331] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-30T17:40:38.208481] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:40:38.654370] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-30T17:40:39.160464] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T17:40:39.454358] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-30T17:40:39.501564] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:40:40.170049] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:40:40.254335] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-30T17:40:41.054354] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-30T17:40:41.510229] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-30T17:40:41.854368] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-30T17:40:41.953487] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:40:42.416398] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:40:42.654390] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-30T17:40:43.454346] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-30T17:40:43.599255] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:40:43.663065] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T17:40:44.254372] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-30T17:40:45.054381] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-30T17:40:45.293110] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:40:45.854367] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-30T17:40:46.472143] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:40:46.578750] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T17:40:46.654331] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-30T17:40:47.125172] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:40:47.454364] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-30T17:40:48.254358] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-30T17:40:48.745191] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:40:48.758007] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-30T17:40:48.758168] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-30T17:40:49.059439] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-30T17:40:49.223868] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-30T17:40:49.223986] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-30T17:40:49.224967] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-30T17:40:49.225187] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-30T17:40:49.271246] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:40:49.285220] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-30T17:40:49.710939] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-30T17:40:49.711212] [INFO ] [MAIN ] BP: Full history saved. [2025-09-30T17:40:49.711368] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BP took 29.3s. Estimated remaining: 4h 15m 44s. Rate: 8.0 symbols/min [2025-09-30T17:40:49.859531] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-30T17:40:50.071581] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:50.075368] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:40:50.159889] [DEBUG] [LOCAL ] BRBR: Loaded 51250 existing records from primary storage. [2025-09-30T17:40:50.160524] [INFO ] [MAIN ] BRBR: Loaded 51250 existing records. [2025-09-30T17:40:50.413539] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:50.414253] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-30T17:40:50.414391] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-30T17:40:50.423867] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-30T17:40:50.440370] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-30T17:40:50.449132] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:40:50.668468] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-30T17:40:50.885033] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:51.454345] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-30T17:40:51.533721] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:40:52.248051] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:40:52.255755] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-30T17:40:53.054350] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-30T17:40:53.101228] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:40:53.854423] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-30T17:40:53.901475] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:40:53.913326] [INFO ] [REMOTE ] BOX: Full fetch complete (72077 records). [2025-09-30T17:40:53.913510] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-30T17:40:54.345455] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-30T17:40:54.345571] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-30T17:40:54.346482] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-30T17:40:54.346575] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-30T17:40:54.348735] [DEBUG] [LOCAL ] BOX: Trimmed 72077 records to 50231 (keeping 200 days of data) [2025-09-30T17:40:54.478187] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:40:54.500744] [INFO ] [REMOTE ] BORR: Full fetch complete (74695 records). [2025-09-30T17:40:54.501703] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-30T17:40:54.656968] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-30T17:40:55.112154] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-30T17:40:55.112912] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-30T17:40:55.114052] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-30T17:40:55.122811] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-30T17:40:55.153861] [DEBUG] [LOCAL ] BORR: Trimmed 74695 records to 51149 (keeping 200 days of data) [2025-09-30T17:40:55.248881] [DEBUG] [LOCAL ] BOX: Primary data saved (50231 records). [2025-09-30T17:40:55.271582] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-30T17:40:55.304889] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 36.8s. Estimated remaining: 4h 15m 25s. Rate: 8.0 symbols/min [2025-09-30T17:40:55.344712] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:40:55.456353] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-30T17:40:55.529957] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:55.561025] [DEBUG] [LOCAL ] BRC: Loaded 19180 existing records from primary storage. [2025-09-30T17:40:55.562107] [INFO ] [MAIN ] BRC: Loaded 19180 existing records. [2025-09-30T17:40:55.783875] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:55.786342] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-30T17:40:55.786472] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-30T17:40:55.786798] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-30T17:40:55.786862] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-30T17:40:56.331377] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:56.334104] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:40:56.334497] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-30T17:40:56.425812] [DEBUG] [LOCAL ] BORR: Primary data saved (51149 records). [2025-09-30T17:40:56.425956] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-30T17:40:56.426931] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BORR took 40.4s. Estimated remaining: 4h 14m 38s. Rate: 8.0 symbols/min [2025-09-30T17:40:56.608746] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:56.636011] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:40:56.690334] [DEBUG] [LOCAL ] BRCC: Loaded 40218 existing records from primary storage. [2025-09-30T17:40:56.690762] [INFO ] [MAIN ] BRCC: Loaded 40218 existing records. [2025-09-30T17:40:56.920458] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:56.920684] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-30T17:40:56.920743] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-30T17:40:56.921540] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-30T17:40:56.921603] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-30T17:40:57.059432] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-30T17:40:57.320303] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:57.630000] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:40:57.854406] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-30T17:40:58.389721] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T17:40:58.654370] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-30T17:40:59.454377] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-30T17:40:59.503677] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:40:59.599050] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T17:41:00.254347] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-30T17:41:00.699732] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:41:01.054366] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-30T17:41:01.850463] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:41:01.858958] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-30T17:41:02.134252] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:41:02.654377] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-30T17:41:03.454390] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-30T17:41:03.624815] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:41:04.084384] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:41:04.254361] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-30T17:41:04.737841] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:41:05.054388] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-30T17:41:05.553664] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:41:05.854419] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-30T17:41:06.563415] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:41:06.654371] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-30T17:41:07.065909] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:41:07.454404] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-30T17:41:08.031132] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:41:08.254399] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-30T17:41:09.039560] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:41:09.048785] [INFO ] [REMOTE ] BR: Full fetch complete (49177 records). [2025-09-30T17:41:09.048939] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-30T17:41:09.059534] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-30T17:41:09.563057] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:41:09.562033] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-30T17:41:09.563206] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-30T17:41:09.568926] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-30T17:41:09.569332] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-30T17:41:09.570449] [DEBUG] [LOCAL ] BR: Trimmed 49177 records to 34609 (keeping 200 days of data) [2025-09-30T17:41:09.812432] [DEBUG] [LOCAL ] BR: Primary data saved (34609 records). [2025-09-30T17:41:09.812582] [INFO ] [MAIN ] BR: Full history saved. [2025-09-30T17:41:09.812692] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 33.3s. Estimated remaining: 4h 15m 7s. Rate: 8.0 symbols/min [2025-09-30T17:41:09.859549] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-30T17:41:10.000777] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:10.055848] [DEBUG] [LOCAL ] BRO: Loaded 51890 existing records from primary storage. [2025-09-30T17:41:10.056196] [INFO ] [MAIN ] BRO: Loaded 51890 existing records. [2025-09-30T17:41:10.296927] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:10.298084] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-30T17:41:10.298189] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-30T17:41:10.298631] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-30T17:41:10.298755] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-30T17:41:10.660034] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-30T17:41:10.758925] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:10.781030] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T17:41:11.454335] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-30T17:41:11.508777] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:41:11.920432] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:41:12.254369] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-30T17:41:12.961901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:41:13.054423] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-30T17:41:13.117517] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:41:13.854406] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-30T17:41:14.654379] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-30T17:41:14.802582] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T17:41:14.864806] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:41:15.454355] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-30T17:41:16.254422] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-30T17:41:16.636694] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:41:17.059543] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-30T17:41:17.072432] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:41:17.796280] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:41:17.854419] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-30T17:41:18.387079] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:41:18.654445] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-30T17:41:18.961228] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:41:18.966046] [INFO ] [REMOTE ] BRC: Full fetch complete (29052 records). [2025-09-30T17:41:18.966190] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-30T17:41:19.372069] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-30T17:41:19.372154] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-30T17:41:19.372666] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-30T17:41:19.372736] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-30T17:41:19.373514] [DEBUG] [LOCAL ] BRC: Trimmed 29052 records to 19102 (keeping 200 days of data) [2025-09-30T17:41:19.462784] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-30T17:41:19.502631] [DEBUG] [LOCAL ] BRC: Primary data saved (19102 records). [2025-09-30T17:41:19.502860] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-30T17:41:19.502965] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 24.2s. Estimated remaining: 4h 15m 13s. Rate: 8.0 symbols/min [2025-09-30T17:41:19.692132] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:19.751975] [DEBUG] [LOCAL ] BROS: Loaded 53289 existing records from primary storage. [2025-09-30T17:41:19.752382] [INFO ] [MAIN ] BROS: Loaded 53289 existing records. [2025-09-30T17:41:19.962592] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:19.962841] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-30T17:41:19.962891] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-30T17:41:19.963181] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-30T17:41:19.963240] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-30T17:41:20.256491] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-30T17:41:20.410312] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:20.498495] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:41:21.054348] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-30T17:41:21.158730] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:41:21.775236] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:41:21.854384] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-30T17:41:22.654406] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-30T17:41:22.877830] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:41:23.454332] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-30T17:41:23.864732] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T17:41:23.936699] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:41:23.948409] [INFO ] [REMOTE ] BRBR: Full fetch complete (71966 records). [2025-09-30T17:41:23.948582] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-30T17:41:24.260885] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-30T17:41:24.375619] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-30T17:41:24.375747] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-30T17:41:24.376521] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-30T17:41:24.376629] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-30T17:41:24.378216] [DEBUG] [LOCAL ] BRBR: Trimmed 71966 records to 51262 (keeping 200 days of data) [2025-09-30T17:41:24.729379] [DEBUG] [LOCAL ] BRBR: Primary data saved (51262 records). [2025-09-30T17:41:24.729943] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-30T17:41:24.730146] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 35.0s. Estimated remaining: 4h 14m 52s. Rate: 8.0 symbols/min [2025-09-30T17:41:24.914825] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:24.915169] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-30T17:41:24.915293] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-30T17:41:24.915426] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-30T17:41:24.915469] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-30T17:41:24.915518] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-30T17:41:24.915553] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-30T17:41:25.064284] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-30T17:41:25.314919] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:25.351017] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:41:25.854420] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-30T17:41:26.364737] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:41:26.654444] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-30T17:41:26.731911] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:41:26.750581] [INFO ] [REMOTE ] BRCC: Full fetch complete (57806 records). [2025-09-30T17:41:26.750812] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-30T17:41:27.180862] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-30T17:41:27.181004] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-30T17:41:27.181803] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-30T17:41:27.181871] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-30T17:41:27.183163] [DEBUG] [LOCAL ] BRCC: Trimmed 57806 records to 40248 (keeping 200 days of data) [2025-09-30T17:41:27.331637] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:41:27.454487] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-30T17:41:27.491207] [DEBUG] [LOCAL ] BRCC: Primary data saved (40248 records). [2025-09-30T17:41:27.491338] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-30T17:41:27.492580] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 31.1s. Estimated remaining: 4h 14m 15s. Rate: 8.0 symbols/min [2025-09-30T17:41:27.667438] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:41:27.686500] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-30T17:41:27.691381] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:27.691613] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:41:27.692403] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-30T17:41:27.692483] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:41:27.692557] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-30T17:41:27.692633] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-30T17:41:27.692765] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-30T17:41:27.692846] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-30T17:41:27.692939] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRSL took 3.0s. Estimated remaining: 4h 13m 23s. Rate: 8.0 symbols/min [2025-09-30T17:41:27.896994] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:27.912795] [DEBUG] [LOCAL ] BRSP: Loaded 36849 existing records from primary storage. [2025-09-30T17:41:27.914776] [INFO ] [MAIN ] BRSP: Loaded 36849 existing records. [2025-09-30T17:41:28.000718] [DEBUG] [LOCAL ] BRT: Loaded 4966 existing records from primary storage. [2025-09-30T17:41:28.015262] [INFO ] [MAIN ] BRT: Loaded 4966 existing records. [2025-09-30T17:41:28.273034] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-30T17:41:28.280776] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:28.282151] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-30T17:41:28.282235] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-30T17:41:28.310166] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-30T17:41:28.310350] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-30T17:41:28.372735] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:28.396069] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-30T17:41:28.396188] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-30T17:41:28.425011] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-30T17:41:28.446492] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-30T17:41:29.090288] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:29.102815] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-30T17:41:29.233474] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:29.237430] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T17:41:29.809887] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:41:29.854412] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-30T17:41:30.146474] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:41:30.654366] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-30T17:41:31.454426] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-30T17:41:31.837366] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T17:41:31.982236] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:41:32.176740] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T17:41:32.254400] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-30T17:41:33.054380] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-30T17:41:33.422097] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T17:41:33.854385] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-30T17:41:34.654384] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-30T17:41:35.048126] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T17:41:35.454366] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-30T17:41:35.844854] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:41:36.005854] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T17:41:36.254395] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-30T17:41:37.054400] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-30T17:41:37.381412] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:41:37.854379] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-30T17:41:38.492625] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T17:41:38.532565] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:41:38.654401] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-30T17:41:39.445272] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:41:39.456052] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-30T17:41:39.459042] [INFO ] [REMOTE ] BRO: Full fetch complete (74211 records). [2025-09-30T17:41:39.459237] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-30T17:41:39.954587] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-30T17:41:39.954741] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-30T17:41:39.955667] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-30T17:41:39.955770] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-30T17:41:39.960695] [DEBUG] [LOCAL ] BRO: Trimmed 74211 records to 51886 (keeping 200 days of data) [2025-09-30T17:41:40.275225] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-30T17:41:40.334878] [DEBUG] [LOCAL ] BRO: Primary data saved (51886 records). [2025-09-30T17:41:40.335026] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-30T17:41:40.335255] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 30.5s. Estimated remaining: 4h 13m 47s. Rate: 8.0 symbols/min [2025-09-30T17:41:40.532098] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:40.554935] [DEBUG] [LOCAL ] BRW: Loaded 19790 existing records from primary storage. [2025-09-30T17:41:40.555200] [INFO ] [MAIN ] BRW: Loaded 19790 existing records. [2025-09-30T17:41:40.756689] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:40.757780] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-30T17:41:40.762846] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-30T17:41:40.763557] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T17:41:40.763767] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-30T17:41:40.765735] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-30T17:41:40.905421] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:41:41.005637] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-30T17:41:41.059404] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-30T17:41:41.255365] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:41.854424] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-30T17:41:42.654888] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-30T17:41:42.708116] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:41:43.141494] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T17:41:43.454388] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-30T17:41:44.233116] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:41:44.235351] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:41:44.254328] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-30T17:41:45.054373] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-30T17:41:45.655579] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T17:41:45.854347] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-30T17:41:46.255317] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T17:41:46.654404] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-30T17:41:46.769699] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:41:47.454410] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-30T17:41:47.464050] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:41:48.254388] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-30T17:41:48.717491] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T17:41:48.977070] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:41:49.054390] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-30T17:41:49.620768] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T17:41:49.854405] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-30T17:41:50.426685] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T17:41:50.654386] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-30T17:41:51.454375] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-30T17:41:52.153860] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:41:52.254400] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-30T17:41:52.435045] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:41:53.054372] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-30T17:41:53.854329] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-30T17:41:54.183447] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:41:54.537523] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:41:54.563237] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:41:54.571557] [INFO ] [REMOTE ] BRSP: Full fetch complete (54182 records). [2025-09-30T17:41:54.571795] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-30T17:41:54.659543] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-30T17:41:54.999900] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-30T17:41:55.000042] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-30T17:41:55.000771] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-30T17:41:55.000856] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-30T17:41:55.002258] [DEBUG] [LOCAL ] BRSP: Trimmed 54182 records to 36799 (keeping 200 days of data) [2025-09-30T17:41:55.220031] [DEBUG] [LOCAL ] BRSP: Primary data saved (36799 records). [2025-09-30T17:41:55.220184] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-30T17:41:55.220834] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 27.7s. Estimated remaining: 4h 14m 25s. Rate: 8.0 symbols/min [2025-09-30T17:41:55.420406] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:55.460456] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-30T17:41:55.483629] [DEBUG] [LOCAL ] BRX: Loaded 51703 existing records from primary storage. [2025-09-30T17:41:55.484025] [INFO ] [MAIN ] BRX: Loaded 51703 existing records. [2025-09-30T17:41:55.686398] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:55.686809] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-30T17:41:55.686911] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-30T17:41:55.688426] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-30T17:41:55.688488] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-30T17:41:55.838859] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:41:56.107047] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:56.160068] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:41:56.161895] [INFO ] [REMOTE ] BRT: Full fetch complete (6797 records). [2025-09-30T17:41:56.161988] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-30T17:41:56.259553] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-30T17:41:56.592971] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-30T17:41:56.593063] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-30T17:41:56.593325] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-30T17:41:56.593398] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-30T17:41:56.593897] [DEBUG] [LOCAL ] BRT: Trimmed 6797 records to 4982 (keeping 200 days of data) [2025-09-30T17:41:56.625627] [DEBUG] [LOCAL ] BRT: Primary data saved (4982 records). [2025-09-30T17:41:56.625749] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-30T17:41:56.625853] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 28.9s. Estimated remaining: 4h 13m 40s. Rate: 8.0 symbols/min [2025-09-30T17:41:56.841764] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:56.883758] [DEBUG] [LOCAL ] BSAC: Loaded 32849 existing records from primary storage. [2025-09-30T17:41:56.884050] [INFO ] [MAIN ] BSAC: Loaded 32849 existing records. [2025-09-30T17:41:57.054519] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-30T17:41:57.081074] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:57.081481] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-30T17:41:57.081532] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-30T17:41:57.081936] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-30T17:41:57.081999] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-30T17:41:57.461834] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:57.857808] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-30T17:41:57.862194] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:41:58.075292] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:41:58.654370] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-30T17:41:58.983437] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:41:59.454415] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-30T17:41:59.900956] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:42:00.254344] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-30T17:42:00.397890] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:42:01.054407] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-30T17:42:01.854342] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-30T17:42:02.095691] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T17:42:02.303509] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:42:02.321676] [INFO ] [REMOTE ] BROS: Full fetch complete (77015 records). [2025-09-30T17:42:02.321895] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-30T17:42:02.658627] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-30T17:42:02.778614] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-30T17:42:02.778804] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-30T17:42:02.779700] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-30T17:42:02.779765] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-30T17:42:02.781392] [DEBUG] [LOCAL ] BROS: Trimmed 77015 records to 53289 (keeping 200 days of data) [2025-09-30T17:42:02.807141] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:42:03.187705] [DEBUG] [LOCAL ] BROS: Primary data saved (53289 records). [2025-09-30T17:42:03.187971] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-30T17:42:03.189738] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BROS took 43.7s. Estimated remaining: 4h 13m 27s. Rate: 8.0 symbols/min [2025-09-30T17:42:03.405167] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:03.447579] [DEBUG] [LOCAL ] BSBR: Loaded 35252 existing records from primary storage. [2025-09-30T17:42:03.448001] [INFO ] [MAIN ] BSBR: Loaded 35252 existing records. [2025-09-30T17:42:03.459611] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-30T17:42:03.649412] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:03.649713] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-30T17:42:03.649774] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-30T17:42:03.650858] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-30T17:42:03.650948] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-30T17:42:04.067117] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:42:04.071312] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:04.254377] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-30T17:42:05.054395] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-30T17:42:05.209899] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:42:05.276835] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:42:05.854412] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-30T17:42:06.421507] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T17:42:06.654404] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-30T17:42:07.119585] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T17:42:07.454376] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-30T17:42:08.064958] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T17:42:08.254399] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-30T17:42:08.337097] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:42:09.054382] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-30T17:42:09.854379] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-30T17:42:10.180211] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:42:10.218984] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:42:10.654417] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-30T17:42:11.232221] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:42:11.454394] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-30T17:42:11.949042] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T17:42:12.254398] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-30T17:42:12.364431] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T17:42:13.054411] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-30T17:42:13.388488] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:42:13.854371] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-30T17:42:14.084885] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T17:42:14.654429] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-30T17:42:14.865014] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:42:15.454379] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-30T17:42:16.157544] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:42:16.254414] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-30T17:42:17.054355] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-30T17:42:17.100960] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:42:17.484040] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:42:17.854367] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-30T17:42:18.144343] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:42:18.654427] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-30T17:42:19.463033] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-30T17:42:19.469074] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T17:42:19.802749] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T17:42:19.809799] [INFO ] [REMOTE ] BRW: Full fetch complete (30038 records). [2025-09-30T17:42:19.809929] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-30T17:42:20.206927] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-30T17:42:20.207004] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-30T17:42:20.207423] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-30T17:42:20.207467] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-30T17:42:20.208192] [DEBUG] [LOCAL ] BRW: Trimmed 30038 records to 19912 (keeping 200 days of data) [2025-09-30T17:42:20.257973] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-30T17:42:20.341407] [DEBUG] [LOCAL ] BRW: Primary data saved (19912 records). [2025-09-30T17:42:20.341905] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-30T17:42:20.342062] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 40.0s. Estimated remaining: 4h 14m 18s. Rate: 8.0 symbols/min [2025-09-30T17:42:20.533561] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:20.547356] [DEBUG] [LOCAL ] BSL: Loaded 8156 existing records from primary storage. [2025-09-30T17:42:20.547637] [INFO ] [MAIN ] BSL: Loaded 8156 existing records. [2025-09-30T17:42:20.755910] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:20.756116] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-30T17:42:20.756164] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-30T17:42:20.756751] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-30T17:42:20.756812] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-30T17:42:21.055270] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-30T17:42:21.188832] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:21.191482] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:42:21.199341] [INFO ] [REMOTE ] BSAC: Full fetch complete (43794 records). [2025-09-30T17:42:21.199497] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-30T17:42:21.696986] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-30T17:42:21.697197] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-30T17:42:21.698126] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-30T17:42:21.698818] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-30T17:42:21.700221] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:42:21.712726] [DEBUG] [LOCAL ] BSAC: Trimmed 43794 records to 32974 (keeping 200 days of data) [2025-09-30T17:42:21.877136] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-30T17:42:21.926081] [DEBUG] [LOCAL ] BSAC: Primary data saved (32974 records). [2025-09-30T17:42:21.926242] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-30T17:42:21.926333] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 25.3s. Estimated remaining: 4h 13m 35s. Rate: 8.0 symbols/min [2025-09-30T17:42:22.118592] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:22.158512] [DEBUG] [LOCAL ] BSM: Loaded 32184 existing records from primary storage. [2025-09-30T17:42:22.158850] [INFO ] [MAIN ] BSM: Loaded 32184 existing records. [2025-09-30T17:42:22.358928] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:22.359166] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-30T17:42:22.359213] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-30T17:42:22.359604] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-30T17:42:22.359700] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-30T17:42:22.654777] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-30T17:42:22.775070] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:22.782848] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:42:22.985730] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T17:42:23.454409] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-30T17:42:24.119031] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:42:24.254399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-30T17:42:24.814381] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:42:24.902266] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:42:25.054361] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-30T17:42:25.854384] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-30T17:42:26.335048] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T17:42:26.654405] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-30T17:42:27.351517] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:42:27.454378] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-30T17:42:27.579631] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:42:28.254398] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-30T17:42:29.052579] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:42:29.062960] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-30T17:42:29.251848] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:42:29.854348] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-30T17:42:30.573148] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:42:30.581918] [INFO ] [REMOTE ] BSBR: Full fetch complete (50673 records). [2025-09-30T17:42:30.582074] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-30T17:42:30.659487] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-30T17:42:30.991554] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-30T17:42:30.991666] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-30T17:42:30.992276] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-30T17:42:30.992321] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-30T17:42:30.993518] [DEBUG] [LOCAL ] BSBR: Trimmed 50673 records to 35311 (keeping 200 days of data) [2025-09-30T17:42:31.260190] [DEBUG] [LOCAL ] BSBR: Primary data saved (35311 records). [2025-09-30T17:42:31.260377] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-30T17:42:31.260471] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSBR took 28.1s. Estimated remaining: 4h 13m 39s. Rate: 8.0 symbols/min [2025-09-30T17:42:31.449096] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:31.454332] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-30T17:42:31.475988] [DEBUG] [LOCAL ] BST: Loaded 18957 existing records from primary storage. [2025-09-30T17:42:31.476389] [INFO ] [MAIN ] BST: Loaded 18957 existing records. [2025-09-30T17:42:31.621840] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:42:31.701381] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:31.701980] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-30T17:42:31.702114] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-30T17:42:31.702980] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-30T17:42:31.703075] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-30T17:42:31.962428] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:42:32.058056] [INFO ] [REMOTE ] BRX: Full fetch complete (74905 records). [2025-09-30T17:42:32.078024] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-30T17:42:32.265703] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-30T17:42:32.303185] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:32.622294] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-30T17:42:32.622470] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-30T17:42:32.623573] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-30T17:42:32.623711] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-30T17:42:32.626447] [DEBUG] [LOCAL ] BRX: Trimmed 74905 records to 51710 (keeping 200 days of data) [2025-09-30T17:42:32.783282] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T17:42:32.899181] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:42:33.027969] [DEBUG] [LOCAL ] BRX: Primary data saved (51710 records). [2025-09-30T17:42:33.028140] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-30T17:42:33.028818] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 37.8s. Estimated remaining: 4h 12m 57s. Rate: 8.0 symbols/min [2025-09-30T17:42:33.060237] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-30T17:42:33.227975] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:33.262425] [DEBUG] [LOCAL ] BSTZ: Loaded 24704 existing records from primary storage. [2025-09-30T17:42:33.262754] [INFO ] [MAIN ] BSTZ: Loaded 24704 existing records. [2025-09-30T17:42:33.460061] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:33.460322] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-30T17:42:33.460372] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-30T17:42:33.461187] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-30T17:42:33.461249] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-30T17:42:33.837102] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:33.854327] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-30T17:42:34.211000] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:42:34.654392] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-30T17:42:34.901995] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:42:35.454407] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-30T17:42:36.191329] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T17:42:36.255277] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-30T17:42:36.259581] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:42:37.054418] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-30T17:42:37.630275] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:42:37.805147] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T17:42:37.854350] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-30T17:42:38.654388] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-30T17:42:39.229779] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:42:39.454337] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-30T17:42:39.817268] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:42:40.254384] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-30T17:42:40.918162] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T17:42:41.039451] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:42:41.054313] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-30T17:42:41.854389] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-30T17:42:42.504487] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:42:42.512302] [INFO ] [REMOTE ] BSM: Full fetch complete (47576 records). [2025-09-30T17:42:42.512418] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-30T17:42:42.663755] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-30T17:42:42.948179] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:42:42.952420] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-30T17:42:42.952769] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-30T17:42:42.953699] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-30T17:42:42.954155] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-30T17:42:42.955162] [DEBUG] [LOCAL ] BSM: Trimmed 47576 records to 32206 (keeping 200 days of data) [2025-09-30T17:42:43.162705] [DEBUG] [LOCAL ] BSM: Primary data saved (32206 records). [2025-09-30T17:42:43.162855] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-30T17:42:43.162947] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSM took 21.2s. Estimated remaining: 4h 13m 5s. Rate: 8.0 symbols/min [2025-09-30T17:42:43.344447] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:43.407354] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-30T17:42:43.407833] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-30T17:42:43.459525] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-30T17:42:43.637360] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:43.638312] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-30T17:42:43.639253] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:42:43.638412] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-30T17:42:43.646127] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-30T17:42:43.646199] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-30T17:42:44.020606] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:44.254333] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-30T17:42:44.417997] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T17:42:45.054377] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-30T17:42:45.854340] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-30T17:42:46.112152] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:42:46.342964] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:42:46.654367] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-30T17:42:47.133636] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:42:47.454375] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-30T17:42:47.681539] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:42:48.254332] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-30T17:42:48.417582] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:42:49.027674] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:42:49.054319] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-30T17:42:49.854375] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-30T17:42:50.222702] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:42:50.592198] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T17:42:50.654362] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-30T17:42:51.454327] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-30T17:42:51.729701] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:42:52.254355] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-30T17:42:53.054328] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-30T17:42:53.115621] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:42:53.320507] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:42:53.854350] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-30T17:42:54.135951] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:42:54.654377] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-30T17:42:55.454349] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-30T17:42:55.549437] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:42:55.571398] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:42:56.254362] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-30T17:42:56.516610] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:42:56.524237] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36642 records). [2025-09-30T17:42:56.524438] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-30T17:42:56.951501] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-30T17:42:56.951736] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-30T17:42:56.952415] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-30T17:42:56.952575] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-30T17:42:56.973883] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T17:42:56.976608] [DEBUG] [LOCAL ] BSTZ: Trimmed 36642 records to 24736 (keeping 200 days of data) [2025-09-30T17:42:57.059466] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-30T17:42:57.173221] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24736 records). [2025-09-30T17:42:57.173384] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-30T17:42:57.173476] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSTZ took 24.1s. Estimated remaining: 4h 13m 36s. Rate: 8.0 symbols/min [2025-09-30T17:42:57.362245] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:57.369858] [DEBUG] [LOCAL ] BTA: Loaded 5413 existing records from primary storage. [2025-09-30T17:42:57.370041] [INFO ] [MAIN ] BTA: Loaded 5413 existing records. [2025-09-30T17:42:57.556177] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:57.556393] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-30T17:42:57.556448] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-30T17:42:57.556756] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-30T17:42:57.556820] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-30T17:42:57.862534] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-30T17:42:57.963100] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:58.654345] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-30T17:42:58.840392] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T17:42:58.933714] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T17:42:58.939168] [INFO ] [REMOTE ] BST: Full fetch complete (28798 records). [2025-09-30T17:42:58.939318] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-30T17:42:59.266253] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:42:59.358038] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-30T17:42:59.358135] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-30T17:42:59.358615] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-30T17:42:59.358705] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-30T17:42:59.359512] [DEBUG] [LOCAL ] BST: Trimmed 28798 records to 19010 (keeping 200 days of data) [2025-09-30T17:42:59.454838] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-30T17:42:59.482117] [DEBUG] [LOCAL ] BST: Primary data saved (19010 records). [2025-09-30T17:42:59.482283] [INFO ] [MAIN ] BST: Full history saved. [2025-09-30T17:42:59.482421] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 28.2s. Estimated remaining: 4h 12m 58s. Rate: 8.0 symbols/min [2025-09-30T17:42:59.678145] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:59.696228] [DEBUG] [LOCAL ] BTCM: Loaded 15156 existing records from primary storage. [2025-09-30T17:42:59.696507] [INFO ] [MAIN ] BTCM: Loaded 15156 existing records. [2025-09-30T17:42:59.886017] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:59.886231] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-30T17:42:59.886279] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-30T17:42:59.886543] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-30T17:42:59.886605] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-30T17:43:00.260903] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-30T17:43:00.294790] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:00.302349] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T17:43:01.054370] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-30T17:43:01.738069] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T17:43:01.854382] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-30T17:43:02.298760] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T17:43:02.362177] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T17:43:02.654402] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-30T17:43:03.454595] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-30T17:43:04.162190] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T17:43:04.254379] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-30T17:43:04.539899] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T17:43:05.054409] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-30T17:43:05.279423] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T17:43:05.282591] [INFO ] [REMOTE ] BSL: Full fetch complete (12709 records). [2025-09-30T17:43:05.282730] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-30T17:43:05.641542] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T17:43:05.733818] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-30T17:43:05.733934] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-30T17:43:05.734458] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-30T17:43:05.734504] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-30T17:43:05.735473] [DEBUG] [LOCAL ] BSL: Trimmed 12709 records to 8187 (keeping 200 days of data) [2025-09-30T17:43:05.794399] [DEBUG] [LOCAL ] BSL: Primary data saved (8187 records). [2025-09-30T17:43:05.794558] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-30T17:43:05.794674] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSL took 45.5s. Estimated remaining: 4h 12m 44s. Rate: 8.0 symbols/min [2025-09-30T17:43:05.861231] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-30T17:43:06.013224] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:06.085069] [DEBUG] [LOCAL ] BTE: Loaded 52726 existing records from primary storage. [2025-09-30T17:43:06.085547] [INFO ] [MAIN ] BTE: Loaded 52726 existing records. [2025-09-30T17:43:06.334840] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:06.335057] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-30T17:43:06.335107] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-30T17:43:06.337066] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-30T17:43:06.337131] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-30T17:43:06.660443] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-30T17:43:06.750150] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:07.392666] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T17:43:07.454319] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-30T17:43:07.813132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:43:08.254402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-30T17:43:08.929542] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T17:43:09.054391] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-30T17:43:09.617207] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-30T17:43:09.841920] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:43:09.854318] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-30T17:43:10.550915] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T17:43:10.654402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-30T17:43:11.383727] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T17:43:11.454359] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-30T17:43:12.078944] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T17:43:12.254398] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-30T17:43:13.054402] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-30T17:43:13.854363] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-30T17:43:14.072228] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:43:14.454175] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T17:43:14.654341] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-30T17:43:14.828516] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:43:15.454402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-30T17:43:16.051800] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T17:43:16.254332] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-30T17:43:16.428162] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:43:16.440029] [INFO ] [REMOTE ] BSX: Full fetch complete (77695 records). [2025-09-30T17:43:16.440281] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-30T17:43:16.875772] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-30T17:43:16.875894] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-30T17:43:16.876822] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-30T17:43:16.876894] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-30T17:43:16.878586] [DEBUG] [LOCAL ] BSX: Trimmed 77695 records to 53688 (keeping 200 days of data) [2025-09-30T17:43:17.067408] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-30T17:43:17.109911] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:43:17.236908] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-30T17:43:17.237059] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-30T17:43:17.237193] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 34.1s. Estimated remaining: 4h 12m 60s. Rate: 8.0 symbols/min [2025-09-30T17:43:17.428224] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:17.484317] [DEBUG] [LOCAL ] BTI: Loaded 53554 existing records from primary storage. [2025-09-30T17:43:17.484743] [INFO ] [MAIN ] BTI: Loaded 53554 existing records. [2025-09-30T17:43:17.716535] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:17.717590] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-30T17:43:17.717700] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-30T17:43:17.718126] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:43:17.720580] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-30T17:43:17.721300] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-30T17:43:17.859737] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-30T17:43:18.116363] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:18.654326] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-30T17:43:18.785386] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:43:18.787362] [INFO ] [REMOTE ] BTA: Full fetch complete (9584 records). [2025-09-30T17:43:18.787435] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-30T17:43:19.193299] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-30T17:43:19.193380] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-30T17:43:19.193667] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-30T17:43:19.193730] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-30T17:43:19.194163] [DEBUG] [LOCAL ] BTA: Trimmed 9584 records to 5400 (keeping 200 days of data) [2025-09-30T17:43:19.229816] [DEBUG] [LOCAL ] BTA: Primary data saved (5400 records). [2025-09-30T17:43:19.229940] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-30T17:43:19.230029] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 22.1s. Estimated remaining: 4h 12m 20s. Rate: 8.0 symbols/min [2025-09-30T17:43:19.412147] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:19.423721] [DEBUG] [LOCAL ] BTO: Loaded 8806 existing records from primary storage. [2025-09-30T17:43:19.423979] [INFO ] [MAIN ] BTO: Loaded 8806 existing records. [2025-09-30T17:43:19.459523] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-30T17:43:19.633246] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:19.633483] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-30T17:43:19.633539] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-30T17:43:19.633799] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-30T17:43:19.633861] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-30T17:43:20.018838] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:20.254398] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-30T17:43:20.449706] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:43:20.737995] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T17:43:21.054381] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-30T17:43:21.854396] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-30T17:43:21.968195] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:43:22.600748] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:43:22.654346] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-30T17:43:22.816782] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:43:23.454410] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-30T17:43:23.980018] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:43:24.254368] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-30T17:43:25.054356] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-30T17:43:25.219133] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T17:43:25.426444] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T17:43:25.854383] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-30T17:43:26.458030] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:43:26.654415] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-30T17:43:26.794157] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:43:27.454391] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-30T17:43:28.254389] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-30T17:43:28.406921] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:43:29.054402] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-30T17:43:29.487625] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T17:43:29.785236] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:43:29.804632] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:43:29.854385] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-30T17:43:30.654402] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-30T17:43:31.454414] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-30T17:43:31.773543] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:43:31.866535] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:43:31.927249] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T17:43:32.254370] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-30T17:43:33.054418] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-30T17:43:33.680499] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:43:33.854329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-30T17:43:33.944106] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T17:43:34.654393] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-30T17:43:35.454337] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-30T17:43:35.551564] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:43:36.254329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-30T17:43:36.356924] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:43:36.723036] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:43:37.054382] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-30T17:43:37.859469] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-30T17:43:37.881479] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:43:37.899741] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T17:43:38.654375] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-30T17:43:39.137455] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T17:43:39.454384] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-30T17:43:39.775077] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T17:43:39.976975] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:43:40.254374] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-30T17:43:40.990900] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T17:43:41.054363] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-30T17:43:41.854383] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-30T17:43:41.870911] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:43:41.873290] [INFO ] [REMOTE ] BTO: Full fetch complete (13309 records). [2025-09-30T17:43:41.873371] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-30T17:43:42.280624] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-30T17:43:42.280737] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-30T17:43:42.281066] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-30T17:43:42.281110] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-30T17:43:42.281602] [DEBUG] [LOCAL ] BTO: Trimmed 13309 records to 8761 (keeping 200 days of data) [2025-09-30T17:43:42.337813] [DEBUG] [LOCAL ] BTO: Primary data saved (8761 records). [2025-09-30T17:43:42.337939] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-30T17:43:42.338027] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTO took 23.1s. Estimated remaining: 4h 13m 43s. Rate: 8.0 symbols/min [2025-09-30T17:43:42.522997] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:42.523160] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-09-30T17:43:42.523199] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-09-30T17:43:42.523343] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-30T17:43:42.523412] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-30T17:43:42.523465] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-30T17:43:42.523540] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-30T17:43:42.659427] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-30T17:43:42.922732] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:43.454365] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-30T17:43:43.843357] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T17:43:44.263445] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-30T17:43:44.273508] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:43:44.287370] [INFO ] [REMOTE ] BTE: Full fetch complete (76024 records). [2025-09-30T17:43:44.287565] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-30T17:43:44.753314] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-30T17:43:44.753443] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-30T17:43:44.759563] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-30T17:43:44.768146] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-30T17:43:44.771334] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T17:43:44.777629] [INFO ] [REMOTE ] BTCM: Full fetch complete (19301 records). [2025-09-30T17:43:44.777943] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-30T17:43:44.778484] [DEBUG] [LOCAL ] BTE: Trimmed 76024 records to 52722 (keeping 200 days of data) [2025-09-30T17:43:45.055854] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-30T17:43:45.490173] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:43:45.490381] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-30T17:43:45.496679] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-30T17:43:45.498088] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-30T17:43:45.499204] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-30T17:43:45.503311] [DEBUG] [LOCAL ] BTCM: Trimmed 19301 records to 15242 (keeping 200 days of data) [2025-09-30T17:43:45.611846] [DEBUG] [LOCAL ] BTCM: Primary data saved (15242 records). [2025-09-30T17:43:45.613398] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-30T17:43:45.613542] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTCM took 46.1s. Estimated remaining: 4h 13m 11s. Rate: 8.0 symbols/min [2025-09-30T17:43:45.834483] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:45.874427] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-30T17:43:45.943447] [DEBUG] [LOCAL ] BTE: Primary data saved (52722 records). [2025-09-30T17:43:45.943608] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-30T17:43:45.943729] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 40.1s. Estimated remaining: 4h 12m 22s. Rate: 8.0 symbols/min [2025-09-30T17:43:46.086900] [DEBUG] [LOCAL ] BTU: Loaded 53306 existing records from primary storage. [2025-09-30T17:43:46.108410] [INFO ] [MAIN ] BTU: Loaded 53306 existing records. [2025-09-30T17:43:46.288626] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:46.299831] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-30T17:43:46.305101] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-30T17:43:46.315596] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-30T17:43:46.320849] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-30T17:43:46.344159] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-30T17:43:46.353500] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-30T17:43:46.422582] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:46.457179] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-30T17:43:46.465340] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-30T17:43:46.512076] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-30T17:43:46.517537] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-30T17:43:46.771084] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T17:43:46.864102] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-30T17:43:47.057944] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:47.273153] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:47.306426] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T17:43:47.454361] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-30T17:43:47.926889] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:43:47.927281] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-30T17:43:47.927385] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:43:47.927446] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-30T17:43:47.927516] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:43:47.927597] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-30T17:43:47.927788] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-30T17:43:47.927848] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-30T17:43:47.928032] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-30T17:43:47.938481] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:43:47.938035] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 2.0s. Estimated remaining: 4h 11m 43s. Rate: 8.0 symbols/min [2025-09-30T17:43:48.135293] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:48.164735] [DEBUG] [LOCAL ] BTZ: Loaded 22647 existing records from primary storage. [2025-09-30T17:43:48.165084] [INFO ] [MAIN ] BTZ: Loaded 22647 existing records. [2025-09-30T17:43:48.259421] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-30T17:43:48.361634] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:48.361839] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-30T17:43:48.361899] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-30T17:43:48.362290] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-30T17:43:48.362351] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-30T17:43:48.755128] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:49.054335] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-30T17:43:49.209125] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T17:43:49.854353] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-30T17:43:50.654374] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-30T17:43:50.844705] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T17:43:51.009874] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:43:51.454381] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-30T17:43:51.662702] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T17:43:52.254434] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-30T17:43:53.006394] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:43:53.054319] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-30T17:43:53.211829] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:43:53.854412] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-30T17:43:54.505704] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:43:54.660889] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-30T17:43:54.665159] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:43:55.454407] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-30T17:43:55.548938] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T17:43:56.254381] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-30T17:43:57.054345] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-30T17:43:57.120478] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:43:57.312117] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:43:57.854363] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-30T17:43:58.654383] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-30T17:43:58.987772] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:43:59.006382] [INFO ] [REMOTE ] BTI: Full fetch complete (77437 records). [2025-09-30T17:43:59.006593] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-30T17:43:59.469856] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-30T17:43:59.465770] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-30T17:43:59.470416] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-30T17:43:59.472333] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-30T17:43:59.474345] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-30T17:43:59.480118] [DEBUG] [LOCAL ] BTI: Trimmed 77437 records to 53556 (keeping 200 days of data) [2025-09-30T17:43:59.592762] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:43:59.647398] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:43:59.911539] [DEBUG] [LOCAL ] BTI: Primary data saved (53556 records). [2025-09-30T17:43:59.911909] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-30T17:43:59.912039] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 42.7s. Estimated remaining: 4h 12m 1s. Rate: 8.0 symbols/min [2025-09-30T17:44:00.095846] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:00.152228] [DEBUG] [LOCAL ] BUD: Loaded 52720 existing records from primary storage. [2025-09-30T17:44:00.152595] [INFO ] [MAIN ] BUD: Loaded 52720 existing records. [2025-09-30T17:44:00.254971] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-30T17:44:00.358383] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:00.358827] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-30T17:44:00.358984] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-30T17:44:00.366323] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-30T17:44:00.371607] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-30T17:44:00.445340] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:44:00.788919] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:01.054402] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-30T17:44:01.854344] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-30T17:44:01.994717] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T17:44:02.291714] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:44:02.654410] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-30T17:44:03.454336] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-30T17:44:03.802154] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T17:44:03.868157] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:44:04.254377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-30T17:44:04.501072] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T17:44:04.505291] [INFO ] [REMOTE ] BTT: Full fetch complete (24233 records). [2025-09-30T17:44:04.505385] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-30T17:44:04.930597] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-30T17:44:04.930704] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-30T17:44:04.931129] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-30T17:44:04.931172] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-30T17:44:04.931852] [DEBUG] [LOCAL ] BTT: Trimmed 24233 records to 15894 (keeping 200 days of data) [2025-09-30T17:44:05.034020] [DEBUG] [LOCAL ] BTT: Primary data saved (15894 records). [2025-09-30T17:44:05.034175] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-30T17:44:05.034276] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 22.7s. Estimated remaining: 4h 11m 40s. Rate: 8.0 symbols/min [2025-09-30T17:44:05.059570] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-30T17:44:05.240925] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:05.254457] [DEBUG] [LOCAL ] BUI: Loaded 11526 existing records from primary storage. [2025-09-30T17:44:05.254747] [INFO ] [MAIN ] BUI: Loaded 11526 existing records. [2025-09-30T17:44:05.464484] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:05.464769] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-30T17:44:05.464834] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-30T17:44:05.465282] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-30T17:44:05.465344] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-30T17:44:05.859506] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-30T17:44:05.937362] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:06.050116] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:44:06.652774] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:44:06.663334] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-30T17:44:06.688480] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:44:07.454404] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-30T17:44:08.254869] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-30T17:44:08.426396] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:44:08.980592] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-30T17:44:09.054369] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-30T17:44:09.465915] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:44:09.854396] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-30T17:44:10.654407] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-30T17:44:10.768364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:44:10.956308] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T17:44:11.454392] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-30T17:44:12.247426] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:44:12.254315] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-30T17:44:12.539406] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:44:13.016347] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:44:13.054367] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-30T17:44:13.838137] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:44:13.854333] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-30T17:44:14.654401] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-30T17:44:14.712060] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:44:15.454407] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-30T17:44:16.254414] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-30T17:44:16.803996] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:44:16.818248] [INFO ] [REMOTE ] BTU: Full fetch complete (76886 records). [2025-09-30T17:44:16.818581] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-30T17:44:17.057398] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-30T17:44:17.112545] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T17:44:17.293933] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-30T17:44:17.294054] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-30T17:44:17.295018] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-30T17:44:17.295102] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-30T17:44:17.297815] [DEBUG] [LOCAL ] BTU: Trimmed 76886 records to 53307 (keeping 200 days of data) [2025-09-30T17:44:17.439077] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T17:44:17.710487] [DEBUG] [LOCAL ] BTU: Primary data saved (53307 records). [2025-09-30T17:44:17.710691] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-30T17:44:17.710828] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 32.1s. Estimated remaining: 4h 12m 2s. Rate: 8.0 symbols/min [2025-09-30T17:44:17.856677] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-30T17:44:17.957497] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:17.957745] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-30T17:44:17.957811] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-30T17:44:17.957931] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-30T17:44:17.958016] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-30T17:44:17.958088] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-30T17:44:17.958143] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-30T17:44:18.390034] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:18.440291] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:44:18.654409] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-30T17:44:19.454346] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-30T17:44:19.827806] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T17:44:20.133157] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:44:20.255425] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-30T17:44:20.259438] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T17:44:20.265245] [INFO ] [REMOTE ] BTZ: Full fetch complete (33662 records). [2025-09-30T17:44:20.265441] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-30T17:44:20.690069] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-30T17:44:20.690218] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-30T17:44:20.690908] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-30T17:44:20.690988] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-30T17:44:20.691947] [DEBUG] [LOCAL ] BTZ: Trimmed 33662 records to 22619 (keeping 200 days of data) [2025-09-30T17:44:20.841684] [DEBUG] [LOCAL ] BTZ: Primary data saved (22619 records). [2025-09-30T17:44:20.841823] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-30T17:44:20.841940] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTZ took 32.9s. Estimated remaining: 4h 11m 30s. Rate: 8.0 symbols/min [2025-09-30T17:44:21.028521] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:21.061226] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-30T17:44:21.087940] [DEBUG] [LOCAL ] BURL: Loaded 46116 existing records from primary storage. [2025-09-30T17:44:21.088263] [INFO ] [MAIN ] BURL: Loaded 46116 existing records. [2025-09-30T17:44:21.294612] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:21.294878] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-30T17:44:21.294952] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-30T17:44:21.297080] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-30T17:44:21.297146] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-30T17:44:21.426263] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:44:21.717028] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:21.854368] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-30T17:44:22.399842] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:44:22.654364] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-30T17:44:23.454383] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-30T17:44:23.554272] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:44:24.163769] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:44:24.254435] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-30T17:44:25.054344] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-30T17:44:25.327115] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T17:44:25.754395] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:44:25.854386] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-30T17:44:25.974027] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:44:26.654424] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-30T17:44:27.333744] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:44:27.454388] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-30T17:44:28.149733] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:44:28.254363] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-30T17:44:29.002225] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:44:29.054390] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-30T17:44:29.420109] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:44:29.854367] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-30T17:44:30.549001] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:44:30.654362] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-30T17:44:31.050402] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:44:31.054489] [INFO ] [REMOTE ] BUI: Full fetch complete (16299 records). [2025-09-30T17:44:31.054594] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-30T17:44:31.459745] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-30T17:44:31.512207] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-30T17:44:31.512282] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-30T17:44:31.512601] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-30T17:44:31.512731] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-30T17:44:31.513292] [DEBUG] [LOCAL ] BUI: Trimmed 16299 records to 11559 (keeping 200 days of data) [2025-09-30T17:44:31.590972] [DEBUG] [LOCAL ] BUI: Primary data saved (11559 records). [2025-09-30T17:44:31.591119] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-30T17:44:31.591204] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 26.6s. Estimated remaining: 4h 11m 41s. Rate: 8.0 symbols/min [2025-09-30T17:44:31.788471] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:31.806988] [DEBUG] [LOCAL ] BUXX: Loaded 15148 existing records from primary storage. [2025-09-30T17:44:31.807277] [INFO ] [MAIN ] BUXX: Loaded 15148 existing records. [2025-09-30T17:44:32.011867] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:32.012116] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-30T17:44:32.012168] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-30T17:44:32.012749] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-30T17:44:32.012812] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-30T17:44:32.266768] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-30T17:44:32.453967] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:32.488748] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:44:33.054400] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-30T17:44:33.342088] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:44:33.687563] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:44:33.854403] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-30T17:44:33.946162] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:44:34.654361] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-30T17:44:35.455019] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-30T17:44:35.458256] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:44:36.254371] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-30T17:44:36.643385] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T17:44:37.054359] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-30T17:44:37.447302] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T17:44:37.463141] [INFO ] [REMOTE ] BUD: Full fetch complete (76483 records). [2025-09-30T17:44:37.463358] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-30T17:44:37.768914] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T17:44:37.814176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T17:44:37.857203] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-30T17:44:38.139169] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-30T17:44:38.139347] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-30T17:44:38.140859] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-30T17:44:38.140954] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-30T17:44:38.143154] [DEBUG] [LOCAL ] BUD: Trimmed 76483 records to 52713 (keeping 200 days of data) [2025-09-30T17:44:38.581802] [DEBUG] [LOCAL ] BUD: Primary data saved (52713 records). [2025-09-30T17:44:38.582119] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-30T17:44:38.582239] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 38.7s. Estimated remaining: 4h 11m 31s. Rate: 8.0 symbols/min [2025-09-30T17:44:38.654426] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-30T17:44:39.454352] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-30T17:44:39.477892] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T17:44:39.656328] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:44:40.254372] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-30T17:44:41.054406] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-30T17:44:41.090244] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:44:41.798315] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:44:41.854351] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-30T17:44:41.901738] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:44:42.654405] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-30T17:44:43.395930] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:44:43.454342] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-30T17:44:43.619808] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:44:44.254392] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-30T17:44:44.991047] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:44:45.000843] [INFO ] [REMOTE ] BUR: Full fetch complete (63493 records). [2025-09-30T17:44:45.001028] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-30T17:44:45.059494] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-30T17:44:45.367354] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:44:45.465568] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-30T17:44:45.465693] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-30T17:44:45.466431] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-30T17:44:45.466479] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-30T17:44:45.468139] [DEBUG] [LOCAL ] BUR: Trimmed 63493 records to 45112 (keeping 200 days of data) [2025-09-30T17:44:45.761500] [DEBUG] [LOCAL ] BUR: Primary data saved (45112 records). [2025-09-30T17:44:45.761703] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-30T17:44:45.761852] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 28.1s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-09-30T17:44:45.854380] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-30T17:44:46.793594] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:44:46.804620] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-30T17:44:46.979060] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:44:47.454361] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-30T17:44:48.228438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:44:48.254376] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-30T17:44:48.503392] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:44:49.054451] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-30T17:44:49.073874] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:44:49.854380] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-30T17:44:50.813989] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:44:50.824836] [INFO ] [REMOTE ] BURL: Full fetch complete (65715 records). [2025-09-30T17:44:50.825029] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-30T17:44:50.954006] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:44:50.993758] [INFO ] [REMOTE ] BUXX: Full fetch complete (20378 records). [2025-09-30T17:44:51.004805] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-30T17:44:51.454024] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-30T17:44:51.492691] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-30T17:44:51.542146] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-30T17:44:51.553767] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-30T17:44:51.627486] [DEBUG] [LOCAL ] BURL: Trimmed 65715 records to 46056 (keeping 200 days of data) [2025-09-30T17:44:51.724038] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-30T17:44:51.733082] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-30T17:44:51.760841] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-30T17:44:51.761910] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-30T17:44:51.765912] [DEBUG] [LOCAL ] BUXX: Trimmed 20378 records to 15166 (keeping 200 days of data) [2025-09-30T17:44:52.010915] [DEBUG] [LOCAL ] BUXX: Primary data saved (15166 records). [2025-09-30T17:44:52.011583] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-30T17:44:52.012093] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 20.4s. Estimated remaining: 4h 11m 7s. Rate: 8.0 symbols/min [2025-09-30T17:44:52.079872] [DEBUG] [LOCAL ] BURL: Primary data saved (46056 records). [2025-09-30T17:44:52.080023] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-30T17:44:52.080110] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 31.2s. Estimated remaining: 4h 10m 18s. Rate: 8.0 symbols/min [2025-09-30T17:44:52.747667] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.840507] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.847490] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.847614] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-09-30T17:44:52.873639] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.873829] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-09-30T17:44:52.874618] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-30T17:44:52.874726] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-30T17:44:52.874785] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-09-30T17:44:52.874820] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-30T17:44:53.055525] [DEBUG] [LOCAL ] BW: Loaded 39676 existing records from primary storage. [2025-09-30T17:44:53.117232] [INFO ] [MAIN ] BW: Loaded 39676 existing records. [2025-09-30T17:44:53.218353] [DEBUG] [LOCAL ] BVN: Loaded 43956 existing records from primary storage. [2025-09-30T17:44:53.296744] [INFO ] [MAIN ] BVN: Loaded 43956 existing records. [2025-09-30T17:44:53.494670] [DEBUG] [LOCAL ] BWA: Loaded 52193 existing records from primary storage. [2025-09-30T17:44:53.500726] [INFO ] [MAIN ] BWA: Loaded 52193 existing records. [2025-09-30T17:44:53.792019] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:53.850279] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-30T17:44:54.025880] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.077533] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.119805] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.104065] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.149916] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-30T17:44:54.164738] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-30T17:44:54.164665] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.164913] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-30T17:44:54.158603] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-30T17:44:54.170385] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.177839] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-30T17:44:54.178057] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-30T17:44:54.198868] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-30T17:44:54.238710] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-30T17:44:54.303827] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-30T17:44:55.251742] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.299008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-30T17:44:55.332111] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.380439] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-30T17:44:55.429120] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.429546] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-30T17:44:55.451731] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:44:55.460487] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-30T17:44:56.664411] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:44:56.671003] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-30T17:44:56.975206] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:44:56.985773] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-30T17:44:57.067762] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:44:57.080064] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-30T17:44:57.108760] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:44:57.119187] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-30T17:44:57.797149] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:44:57.854340] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-30T17:44:58.132361] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:44:58.609382] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:44:58.654345] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-30T17:44:58.740993] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:44:59.454356] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-30T17:44:59.527839] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:45:00.035399] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:45:00.254377] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-30T17:45:01.054372] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-30T17:45:01.174979] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:45:01.854350] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-30T17:45:02.264337] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T17:45:02.627508] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:45:02.654381] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-30T17:45:03.454333] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-30T17:45:03.839971] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:45:04.159014] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:45:04.254414] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-30T17:45:05.000744] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:45:05.054385] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-30T17:45:05.655759] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T17:45:05.854396] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-30T17:45:06.654351] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-30T17:45:06.683941] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:45:07.313862] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:45:07.454372] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-30T17:45:08.153685] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:45:08.254392] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-30T17:45:08.661985] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:45:09.054375] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-30T17:45:09.854347] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-30T17:45:09.960036] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:45:10.164763] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:45:10.654402] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-30T17:45:11.421939] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:45:11.454315] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-30T17:45:12.168408] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:45:12.254422] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-30T17:45:12.942267] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:45:13.054402] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-30T17:45:13.854364] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-30T17:45:13.939989] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:45:14.588248] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:45:14.597716] [INFO ] [REMOTE ] BV: Full fetch complete (53663 records). [2025-09-30T17:45:14.597927] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-30T17:45:14.599030] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:14.599135] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:14.599182] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:14.599224] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-30T17:45:14.599286] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-09-30T17:45:14.599324] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-09-30T17:45:14.599383] [DEBUG] [LOCAL ] BV: No derivative data file found to delete. [2025-09-30T17:45:14.599468] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 22.5s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-09-30T17:45:14.666783] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-30T17:45:14.827977] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:14.843963] [DEBUG] [LOCAL ] BWG: Loaded 12382 existing records from primary storage. [2025-09-30T17:45:14.844240] [INFO ] [MAIN ] BWG: Loaded 12382 existing records. [2025-09-30T17:45:15.068357] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:15.068790] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-30T17:45:15.068865] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-30T17:45:15.069487] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-30T17:45:15.069551] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-30T17:45:15.352787] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:45:15.459441] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-30T17:45:15.520389] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:15.943829] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T17:45:16.254373] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-30T17:45:16.483012] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:45:17.054431] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-30T17:45:17.854356] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-30T17:45:18.099445] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:45:18.351021] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:45:18.654365] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-30T17:45:19.340058] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T17:45:19.454372] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-30T17:45:20.254324] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-30T17:45:20.308358] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:45:20.323757] [INFO ] [REMOTE ] BW: Full fetch complete (58833 records). [2025-09-30T17:45:20.323973] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-30T17:45:20.810085] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-30T17:45:20.810266] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-30T17:45:20.811737] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-30T17:45:20.811815] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-30T17:45:20.813386] [DEBUG] [LOCAL ] BW: Trimmed 58833 records to 39796 (keeping 200 days of data) [2025-09-30T17:45:21.054603] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-30T17:45:21.087523] [DEBUG] [LOCAL ] BW: Primary data saved (39796 records). [2025-09-30T17:45:21.087706] [INFO ] [MAIN ] BW: Full history saved. [2025-09-30T17:45:21.087816] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BW took 29.0s. Estimated remaining: 4h 11m 21s. Rate: 8.0 symbols/min [2025-09-30T17:45:21.322702] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:21.325446] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:45:21.370789] [DEBUG] [LOCAL ] BWLP: Loaded 32466 existing records from primary storage. [2025-09-30T17:45:21.371128] [INFO ] [MAIN ] BWLP: Loaded 32466 existing records. [2025-09-30T17:45:21.575034] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:21.575289] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-30T17:45:21.575351] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-30T17:45:21.576539] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-30T17:45:21.576604] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-30T17:45:21.858005] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-30T17:45:21.948255] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:45:22.017366] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:22.051911] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:45:22.654395] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-30T17:45:23.454332] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-30T17:45:23.642099] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:45:23.656041] [INFO ] [REMOTE ] BVN: Full fetch complete (62892 records). [2025-09-30T17:45:23.656239] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-30T17:45:23.817867] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:45:24.118773] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-30T17:45:24.118872] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-30T17:45:24.119727] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-30T17:45:24.119800] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-30T17:45:24.121531] [DEBUG] [LOCAL ] BVN: Trimmed 62892 records to 43983 (keeping 200 days of data) [2025-09-30T17:45:24.300268] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-30T17:45:24.406443] [DEBUG] [LOCAL ] BVN: Primary data saved (43983 records). [2025-09-30T17:45:24.406628] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-30T17:45:24.406751] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BVN took 32.3s. Estimated remaining: 4h 10m 51s. Rate: 8.0 symbols/min [2025-09-30T17:45:24.605547] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:24.615760] [DEBUG] [LOCAL ] BWMX: Loaded 7635 existing records from primary storage. [2025-09-30T17:45:24.616038] [INFO ] [MAIN ] BWMX: Loaded 7635 existing records. [2025-09-30T17:45:24.808703] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:24.809091] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-30T17:45:24.809153] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-30T17:45:24.809694] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-30T17:45:24.809758] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-30T17:45:25.065675] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-30T17:45:25.242276] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:25.245168] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:45:25.256947] [INFO ] [REMOTE ] BWA: Full fetch complete (75714 records). [2025-09-30T17:45:25.257136] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-30T17:45:25.697938] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-30T17:45:25.698134] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-30T17:45:25.699208] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-30T17:45:25.699369] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-30T17:45:25.697814] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:45:25.704592] [DEBUG] [LOCAL ] BWA: Trimmed 75714 records to 52185 (keeping 200 days of data) [2025-09-30T17:45:25.732614] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T17:45:25.854414] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-30T17:45:26.082324] [DEBUG] [LOCAL ] BWA: Primary data saved (52185 records). [2025-09-30T17:45:26.082478] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-30T17:45:26.082578] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 34.0s. Estimated remaining: 4h 10m 11s. Rate: 8.0 symbols/min [2025-09-30T17:45:26.267923] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:26.268146] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-09-30T17:45:26.268196] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-09-30T17:45:26.268406] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-30T17:45:26.268473] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-30T17:45:26.268537] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-30T17:45:26.268589] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-30T17:45:26.673396] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-30T17:45:26.699607] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:26.700744] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:45:27.454378] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-30T17:45:27.547900] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:45:28.254394] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-30T17:45:28.856051] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:45:28.869258] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:45:29.054399] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-30T17:45:29.690364] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T17:45:29.854369] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-30T17:45:30.419872] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T17:45:30.654431] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-30T17:45:31.453384] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T17:45:31.454838] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-30T17:45:32.183140] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T17:45:32.254391] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-30T17:45:32.902773] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:45:33.054419] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-30T17:45:33.854399] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-30T17:45:33.958764] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:45:34.195316] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T17:45:34.654369] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-30T17:45:35.037520] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T17:45:35.454394] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-30T17:45:36.254362] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-30T17:45:36.796981] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:45:36.895229] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:45:37.054378] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-30T17:45:37.854406] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-30T17:45:37.880811] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:45:38.654398] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-30T17:45:38.966461] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:45:39.454376] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-30T17:45:39.479224] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:45:39.988325] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:45:40.254363] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-30T17:45:40.923027] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:45:41.054358] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-30T17:45:41.854365] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-30T17:45:42.133527] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:45:42.623309] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:45:42.654339] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-30T17:45:43.454404] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-30T17:45:43.919677] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T17:45:44.118060] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:45:44.254392] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-30T17:45:44.918884] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:45:45.054383] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-30T17:45:45.854399] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-30T17:45:46.060430] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:45:46.654419] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-30T17:45:47.051535] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:45:47.077393] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:45:47.454379] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-30T17:45:48.254402] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-30T17:45:48.358891] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T17:45:49.054402] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-30T17:45:49.613688] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:45:49.854334] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-30T17:45:49.897432] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T17:45:50.654375] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-30T17:45:51.092431] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:45:51.354845] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:45:51.356743] [INFO ] [REMOTE ] BWMX: Full fetch complete (10016 records). [2025-09-30T17:45:51.356836] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-30T17:45:51.357327] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:51.357416] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:51.357462] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:51.357528] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-30T17:45:51.357595] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-30T17:45:51.357633] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-30T17:45:51.358047] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-09-30T17:45:51.358166] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 27.0s. Estimated remaining: 4h 11m 41s. Rate: 8.0 symbols/min [2025-09-30T17:45:51.459544] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-30T17:45:51.556869] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:51.557115] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-30T17:45:51.557169] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-30T17:45:51.557285] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-30T17:45:51.557328] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-30T17:45:51.557370] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-30T17:45:51.557404] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-30T17:45:51.982099] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:52.129585] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T17:45:52.130952] [INFO ] [REMOTE ] BWNB: Full fetch complete (5753 records). [2025-09-30T17:45:52.131026] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-30T17:45:52.259490] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-30T17:45:52.539069] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-30T17:45:52.539152] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-30T17:45:52.539336] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-30T17:45:52.539375] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-30T17:45:52.539843] [DEBUG] [LOCAL ] BWNB: Trimmed 5753 records to 4448 (keeping 200 days of data) [2025-09-30T17:45:52.570830] [DEBUG] [LOCAL ] BWNB: Primary data saved (4448 records). [2025-09-30T17:45:52.570940] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-30T17:45:52.571010] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWNB took 26.5s. Estimated remaining: 4h 10m 59s. Rate: 8.0 symbols/min [2025-09-30T17:45:52.756189] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:52.803806] [DEBUG] [LOCAL ] BWXT: Loaded 46789 existing records from primary storage. [2025-09-30T17:45:52.804181] [INFO ] [MAIN ] BWXT: Loaded 46789 existing records. [2025-09-30T17:45:52.987286] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T17:45:53.012622] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:53.012907] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-30T17:45:53.012959] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-30T17:45:53.014459] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-30T17:45:53.014528] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-30T17:45:53.059616] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-30T17:45:53.404413] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:53.854384] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-30T17:45:54.312051] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:45:54.318811] [INFO ] [REMOTE ] BWLP: Full fetch complete (48047 records). [2025-09-30T17:45:54.318937] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-30T17:45:54.319742] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:54.319853] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:54.319923] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:54.320025] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-30T17:45:54.320322] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-30T17:45:54.320361] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-09-30T17:45:54.320611] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-09-30T17:45:54.321478] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWLP took 33.2s. Estimated remaining: 4h 10m 20s. Rate: 8.0 symbols/min [2025-09-30T17:45:54.519494] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T17:45:54.523958] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:54.588967] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-09-30T17:45:54.589321] [INFO ] [MAIN ] BX: Loaded 53489 existing records. [2025-09-30T17:45:54.659461] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-30T17:45:54.793035] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:54.793259] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-30T17:45:54.793308] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-30T17:45:54.794831] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-30T17:45:54.794895] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-30T17:45:55.361166] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:55.454374] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-30T17:45:56.254384] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-30T17:45:56.410364] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T17:45:57.054406] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-30T17:45:57.227269] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T17:45:57.854457] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-30T17:45:58.087635] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T17:45:58.266731] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-30T17:45:58.654390] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-30T17:45:58.794919] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:45:59.011359] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T17:45:59.454391] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-30T17:46:00.046386] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T17:46:00.254408] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-30T17:46:01.054393] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-30T17:46:01.622514] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T17:46:01.854376] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-30T17:46:01.978154] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:46:02.629551] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:46:02.654377] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-30T17:46:03.454387] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-30T17:46:03.896406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T17:46:04.207352] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:46:04.254428] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-30T17:46:04.935194] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:46:05.054414] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-30T17:46:05.854385] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-30T17:46:06.660979] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-30T17:46:06.666991] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:46:07.454432] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-30T17:46:07.665165] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:46:07.791701] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:46:07.795234] [INFO ] [REMOTE ] BWG: Full fetch complete (17735 records). [2025-09-30T17:46:07.795332] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-30T17:46:07.796038] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:07.796124] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:07.796182] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:07.796243] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-30T17:46:07.796303] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-09-30T17:46:07.796393] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-09-30T17:46:07.796689] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-09-30T17:46:07.796806] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWG took 53.2s. Estimated remaining: 4h 10m 45s. Rate: 8.0 symbols/min [2025-09-30T17:46:08.005810] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:08.009902] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T17:46:08.011520] [INFO ] [REMOTE ] BWSN: Full fetch complete (6144 records). [2025-09-30T17:46:08.011612] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-30T17:46:08.163424] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-09-30T17:46:08.189814] [INFO ] [MAIN ] BXC: Loaded 13669 existing records. [2025-09-30T17:46:08.277283] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-30T17:46:08.575825] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:08.615988] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-30T17:46:08.644779] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-30T17:46:08.645042] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-30T17:46:08.645182] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-30T17:46:08.645433] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-30T17:46:08.645516] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-30T17:46:08.645754] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-30T17:46:08.646394] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-30T17:46:08.646551] [DEBUG] [LOCAL ] BWSN: Trimmed 6144 records to 5105 (keeping 200 days of data) [2025-09-30T17:46:09.056741] [DEBUG] [LOCAL ] BWSN: Primary data saved (5105 records). [2025-09-30T17:46:09.056616] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-30T17:46:09.101725] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:09.097098] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-30T17:46:09.103245] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 17.7s. Estimated remaining: 4h 10m 4s. Rate: 8.0 symbols/min [2025-09-30T17:46:09.300555] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:09.350230] [DEBUG] [LOCAL ] BXMT: Loaded 47211 existing records from primary storage. [2025-09-30T17:46:09.350585] [INFO ] [MAIN ] BXMT: Loaded 47211 existing records. [2025-09-30T17:46:09.554493] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:09.554829] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-30T17:46:09.554937] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-30T17:46:09.557012] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-30T17:46:09.557077] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-30T17:46:09.858463] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-30T17:46:09.951215] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:10.199388] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:46:10.448022] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T17:46:10.654369] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-30T17:46:11.085826] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T17:46:11.439689] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:46:11.454346] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-30T17:46:12.227224] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T17:46:12.254314] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-30T17:46:12.877525] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T17:46:13.054397] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-30T17:46:13.854418] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-30T17:46:14.624313] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:46:14.654329] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-30T17:46:15.118235] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:46:15.196720] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T17:46:15.454407] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-30T17:46:16.254387] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-30T17:46:16.294089] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:46:17.054379] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-30T17:46:17.854346] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-30T17:46:18.067525] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:46:18.258425] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T17:46:18.654404] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-30T17:46:19.298281] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:46:19.454358] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-30T17:46:20.142618] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:46:20.254378] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-30T17:46:21.054391] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-30T17:46:21.267702] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:46:21.854402] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-30T17:46:22.250240] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T17:46:22.382854] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:46:22.457433] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T17:46:22.654353] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-30T17:46:23.454407] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-30T17:46:24.266378] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-30T17:46:24.295241] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:46:25.054355] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-30T17:46:25.101103] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:46:25.234733] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T17:46:25.237914] [INFO ] [REMOTE ] BXC: Full fetch complete (17760 records). [2025-09-30T17:46:25.238053] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-30T17:46:25.238726] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:25.238838] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:25.238917] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:25.238995] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-30T17:46:25.239106] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-30T17:46:25.239173] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-09-30T17:46:25.239496] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-09-30T17:46:25.239679] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 17.4s. Estimated remaining: 4h 10m 43s. Rate: 8.0 symbols/min [2025-09-30T17:46:25.427320] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:25.453052] [DEBUG] [LOCAL ] BXMX: Loaded 19482 existing records from primary storage. [2025-09-30T17:46:25.453408] [INFO ] [MAIN ] BXMX: Loaded 19482 existing records. [2025-09-30T17:46:25.662718] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:25.662962] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-30T17:46:25.663014] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-30T17:46:25.663849] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-30T17:46:25.663913] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-30T17:46:25.858952] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-30T17:46:26.065057] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:26.654410] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-30T17:46:27.303669] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T17:46:27.454360] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-30T17:46:27.515206] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:46:27.770330] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:46:28.254365] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-30T17:46:29.054371] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-30T17:46:29.373002] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:46:29.799778] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T17:46:29.854348] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-30T17:46:30.036700] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:46:30.654375] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-30T17:46:31.454344] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-30T17:46:31.549687] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:46:32.254418] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-30T17:46:32.551840] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:46:32.567341] [INFO ] [REMOTE ] BWXT: Full fetch complete (67399 records). [2025-09-30T17:46:32.567584] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-30T17:46:32.734877] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T17:46:33.054410] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-30T17:46:33.054581] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-30T17:46:33.054703] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-30T17:46:33.057343] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-30T17:46:33.057559] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-30T17:46:33.062718] [DEBUG] [LOCAL ] BWXT: Trimmed 67399 records to 46809 (keeping 200 days of data) [2025-09-30T17:46:33.380275] [DEBUG] [LOCAL ] BWXT: Primary data saved (46809 records). [2025-09-30T17:46:33.380448] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-30T17:46:33.380587] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 40.8s. Estimated remaining: 4h 10m 39s. Rate: 8.0 symbols/min [2025-09-30T17:46:33.565598] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:33.565840] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-09-30T17:46:33.565909] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-09-30T17:46:33.566035] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-30T17:46:33.566078] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-30T17:46:33.566148] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-09-30T17:46:33.566219] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-30T17:46:33.858480] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-30T17:46:33.948031] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:34.302114] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:46:34.313483] [INFO ] [REMOTE ] BX: Full fetch complete (77012 records). [2025-09-30T17:46:34.313636] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-30T17:46:34.317171] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:34.317274] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:34.317346] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:34.317423] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-30T17:46:34.317493] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-09-30T17:46:34.317533] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-09-30T17:46:34.317876] [DEBUG] [LOCAL ] BX: Deleted derivative data file. [2025-09-30T17:46:34.319798] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 40.0s. Estimated remaining: 4h 9m 56s. Rate: 8.0 symbols/min [2025-09-30T17:46:34.512697] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:34.574147] [DEBUG] [LOCAL ] BXSL: Loaded 47578 existing records from primary storage. [2025-09-30T17:46:34.574582] [INFO ] [MAIN ] BXSL: Loaded 47578 existing records. [2025-09-30T17:46:34.659425] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-30T17:46:34.808966] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:46:34.838988] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:34.850175] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:46:34.850363] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-30T17:46:34.855950] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-30T17:46:34.858939] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-30T17:46:34.859007] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-30T17:46:35.266333] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:35.454353] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-30T17:46:36.254365] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-30T17:46:36.503462] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:46:36.567902] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:46:37.054378] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-30T17:46:37.697962] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:46:37.854327] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-30T17:46:37.997032] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:46:38.654357] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-30T17:46:39.454338] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-30T17:46:39.532212] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:46:39.705061] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T17:46:40.254427] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-30T17:46:41.054352] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-30T17:46:41.202228] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:46:41.417253] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:46:41.854351] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-30T17:46:42.083079] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:46:42.654363] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-30T17:46:43.394689] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:46:43.454367] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-30T17:46:43.835969] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:46:44.254372] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-30T17:46:45.061371] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-30T17:46:45.067119] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:46:45.077880] [INFO ] [REMOTE ] BXMT: Full fetch complete (69262 records). [2025-09-30T17:46:45.078069] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-30T17:46:45.079169] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:45.079297] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:45.079351] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:45.079424] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-30T17:46:45.079567] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-09-30T17:46:45.079626] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-09-30T17:46:45.079932] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-09-30T17:46:45.080041] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 36.0s. Estimated remaining: 4h 10m 6s. Rate: 8.0 symbols/min [2025-09-30T17:46:45.222636] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:46:45.279508] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:45.303196] [DEBUG] [LOCAL ] BY: Loaded 21703 existing records from primary storage. [2025-09-30T17:46:45.303685] [INFO ] [MAIN ] BY: Loaded 21703 existing records. [2025-09-30T17:46:45.499558] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:45.499828] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-30T17:46:45.499880] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-30T17:46:45.500703] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-30T17:46:45.500765] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-30T17:46:45.859555] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-30T17:46:45.936493] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:46.654352] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-30T17:46:47.064950] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:46:47.070806] [INFO ] [REMOTE ] BXMX: Full fetch complete (28702 records). [2025-09-30T17:46:47.071010] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-30T17:46:47.071887] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:47.071995] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:47.072040] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:47.072090] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-30T17:46:47.072150] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-30T17:46:47.072188] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-09-30T17:46:47.072691] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-09-30T17:46:47.072808] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 21.8s. Estimated remaining: 4h 9m 29s. Rate: 8.0 symbols/min [2025-09-30T17:46:47.300213] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:47.323149] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-30T17:46:47.391414] [DEBUG] [LOCAL ] BYD: Loaded 45040 existing records from primary storage. [2025-09-30T17:46:47.391788] [INFO ] [MAIN ] BYD: Loaded 45040 existing records. [2025-09-30T17:46:47.467874] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-30T17:46:47.601896] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:47.602216] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-30T17:46:47.602356] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-30T17:46:47.608773] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-30T17:46:47.616265] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-30T17:46:47.641956] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:46:48.009374] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:48.254359] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-30T17:46:49.054349] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-30T17:46:49.127548] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:46:49.854327] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-30T17:46:49.943422] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:46:50.068391] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:46:50.654393] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-30T17:46:51.454331] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-30T17:46:51.649382] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:46:52.200206] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:46:52.254347] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-30T17:46:52.654804] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:46:53.054398] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-30T17:46:53.850279] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T17:46:53.854927] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-30T17:46:53.934485] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:46:54.654430] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-30T17:46:54.863012] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:46:55.454361] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-30T17:46:56.254424] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-30T17:46:56.713920] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T17:46:56.742237] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:46:57.054368] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-30T17:46:57.854370] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-30T17:46:58.044748] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:46:58.122047] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:46:58.654394] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-30T17:46:59.454420] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-30T17:46:59.522637] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:47:00.263804] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-30T17:47:00.295431] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:47:00.529501] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T17:47:01.054411] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-30T17:47:01.706989] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:47:01.854366] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-30T17:47:02.539966] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:47:02.654319] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-30T17:47:03.264511] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:47:03.454358] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-30T17:47:03.994598] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T17:47:04.254407] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-30T17:47:05.054373] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-30T17:47:05.192874] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:47:05.778578] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:47:05.854389] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-30T17:47:06.310777] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:47:06.654405] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-30T17:47:07.454382] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-30T17:47:07.936929] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:47:07.948475] [INFO ] [REMOTE ] BXSL: Full fetch complete (69403 records). [2025-09-30T17:47:07.948667] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-30T17:47:08.256507] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-30T17:47:08.361773] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-30T17:47:08.362010] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-30T17:47:08.362972] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-30T17:47:08.363160] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-30T17:47:08.364992] [DEBUG] [LOCAL ] BXSL: Trimmed 69403 records to 47607 (keeping 200 days of data) [2025-09-30T17:47:08.518028] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:47:08.730075] [DEBUG] [LOCAL ] BXSL: Primary data saved (47607 records). [2025-09-30T17:47:08.730284] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-30T17:47:08.731137] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXSL took 34.4s. Estimated remaining: 4h 10m 37s. Rate: 8.0 symbols/min [2025-09-30T17:47:08.965055] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:08.980177] [DEBUG] [LOCAL ] BYM: Loaded 12098 existing records from primary storage. [2025-09-30T17:47:08.980435] [INFO ] [MAIN ] BYM: Loaded 12098 existing records. [2025-09-30T17:47:09.055555] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-30T17:47:09.170443] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:09.171253] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-30T17:47:09.171341] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-30T17:47:09.185792] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-30T17:47:09.197175] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-30T17:47:09.238818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:47:09.353536] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T17:47:09.629579] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:09.854400] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-30T17:47:10.654326] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-30T17:47:10.869953] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:47:11.095720] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T17:47:11.107260] [INFO ] [REMOTE ] BXP: Full fetch complete (71417 records). [2025-09-30T17:47:11.107437] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-30T17:47:11.459503] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-30T17:47:11.565863] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-30T17:47:11.566002] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-30T17:47:11.567159] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-30T17:47:11.567244] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-30T17:47:11.569366] [DEBUG] [LOCAL ] BXP: Trimmed 71417 records to 49851 (keeping 200 days of data) [2025-09-30T17:47:11.853231] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T17:47:11.941899] [DEBUG] [LOCAL ] BXP: Primary data saved (49851 records). [2025-09-30T17:47:11.942045] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-30T17:47:11.942124] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 38.6s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-09-30T17:47:12.141017] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:12.174608] [DEBUG] [LOCAL ] BZH: Loaded 32490 existing records from primary storage. [2025-09-30T17:47:12.174946] [INFO ] [MAIN ] BZH: Loaded 32490 existing records. [2025-09-30T17:47:12.259498] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-30T17:47:12.367026] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:12.367331] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-30T17:47:12.367390] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-30T17:47:12.368771] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-30T17:47:12.368835] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-30T17:47:12.735263] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:13.054394] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-30T17:47:13.201260] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:47:13.381169] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T17:47:13.742165] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T17:47:13.854380] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-30T17:47:14.654404] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-30T17:47:15.465867] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-30T17:47:15.473163] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:47:15.492627] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T17:47:16.254431] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-30T17:47:16.635883] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:47:16.644377] [INFO ] [REMOTE ] BY: Full fetch complete (29477 records). [2025-09-30T17:47:16.644613] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-30T17:47:17.059688] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-30T17:47:17.245122] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-30T17:47:17.245247] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-30T17:47:17.245878] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-30T17:47:17.245946] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-30T17:47:17.247085] [DEBUG] [LOCAL ] BY: Trimmed 29477 records to 21722 (keeping 200 days of data) [2025-09-30T17:47:17.416794] [DEBUG] [LOCAL ] BY: Primary data saved (21722 records). [2025-09-30T17:47:17.416969] [INFO ] [MAIN ] BY: Full history saved. [2025-09-30T17:47:17.417070] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 32.3s. Estimated remaining: 4h 9m 48s. Rate: 8.0 symbols/min [2025-09-30T17:47:17.612216] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:17.675864] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-30T17:47:17.676268] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-30T17:47:17.855419] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-30T17:47:17.891798] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:17.893626] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-30T17:47:17.893894] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-30T17:47:17.904142] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-30T17:47:17.909526] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-30T17:47:18.006688] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:47:18.073851] [INFO ] [REMOTE ] BYD: Full fetch complete (64984 records). [2025-09-30T17:47:18.103248] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-30T17:47:18.350414] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:47:18.666203] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:18.674829] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-30T17:47:18.827933] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-30T17:47:18.828092] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-30T17:47:18.828908] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-30T17:47:18.828982] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-30T17:47:18.830425] [DEBUG] [LOCAL ] BYD: Trimmed 64984 records to 45002 (keeping 200 days of data) [2025-09-30T17:47:19.085106] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:47:19.147888] [DEBUG] [LOCAL ] BYD: Primary data saved (45002 records). [2025-09-30T17:47:19.148023] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-30T17:47:19.148117] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYD took 32.1s. Estimated remaining: 4h 9m 10s. Rate: 8.0 symbols/min [2025-09-30T17:47:19.328878] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:19.349946] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-09-30T17:47:19.350200] [INFO ] [MAIN ] CAAP: Loaded 19823 existing records. [2025-09-30T17:47:19.459503] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-30T17:47:19.549093] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:19.549367] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-30T17:47:19.549480] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-30T17:47:19.550471] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-30T17:47:19.550539] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-30T17:47:19.767384] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:47:20.032729] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:20.254364] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-30T17:47:20.781124] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T17:47:21.054364] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-30T17:47:21.399494] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:47:21.854363] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-30T17:47:22.654364] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-30T17:47:22.988457] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:47:23.189676] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-30T17:47:23.454365] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-30T17:47:23.931853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:47:24.254572] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-30T17:47:24.756177] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T17:47:24.840807] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:47:25.054373] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-30T17:47:25.854362] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-30T17:47:26.635066] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:47:26.654324] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-30T17:47:26.902020] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:47:27.449073] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T17:47:27.454314] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-30T17:47:28.254368] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-30T17:47:28.429000] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T17:47:28.432403] [INFO ] [REMOTE ] BYM: Full fetch complete (18047 records). [2025-09-30T17:47:28.432501] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-30T17:47:28.824778] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-30T17:47:28.824867] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-30T17:47:28.825277] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-30T17:47:28.825321] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-30T17:47:28.826175] [DEBUG] [LOCAL ] BYM: Trimmed 18047 records to 12028 (keeping 200 days of data) [2025-09-30T17:47:28.907778] [DEBUG] [LOCAL ] BYM: Primary data saved (12028 records). [2025-09-30T17:47:28.907929] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-30T17:47:28.908018] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 20.2s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-09-30T17:47:29.064920] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-30T17:47:29.101492] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:29.101712] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-09-30T17:47:29.101776] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-09-30T17:47:29.101922] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-30T17:47:29.101972] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-30T17:47:29.102016] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-30T17:47:29.102107] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-30T17:47:29.274041] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T17:47:29.524270] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:29.854373] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-30T17:47:30.654375] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-30T17:47:30.948687] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T17:47:31.312861] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:47:31.454368] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-30T17:47:31.499462] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T17:47:32.254360] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-30T17:47:32.894549] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:47:33.054319] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-30T17:47:33.140134] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:47:33.854357] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-30T17:47:34.227566] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:47:34.654362] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-30T17:47:35.454331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-30T17:47:35.515207] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:47:35.749547] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:47:36.254376] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-30T17:47:36.519278] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:47:37.018718] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:47:37.054400] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-30T17:47:37.854358] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-30T17:47:37.921539] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T17:47:38.654321] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-30T17:47:39.078896] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:47:39.454370] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-30T17:47:39.483678] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T17:47:40.254418] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-30T17:47:40.750630] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:47:41.054391] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-30T17:47:41.854337] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-30T17:47:41.994770] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T17:47:42.489791] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T17:47:42.654387] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-30T17:47:42.994868] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T17:47:43.454350] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-30T17:47:44.199322] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:47:44.254399] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-30T17:47:45.054321] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-30T17:47:45.365564] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:47:45.602933] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-30T17:47:45.854373] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-30T17:47:45.988968] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:47:46.635690] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:47:46.654337] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-30T17:47:47.402795] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:47:47.454377] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-30T17:47:48.254393] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-30T17:47:48.863363] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T17:47:48.871434] [INFO ] [REMOTE ] BZH: Full fetch complete (46938 records). [2025-09-30T17:47:48.871568] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-30T17:47:49.055312] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-30T17:47:49.354003] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-30T17:47:49.359776] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-30T17:47:49.370591] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-30T17:47:49.371402] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-30T17:47:49.372185] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:47:49.378957] [INFO ] [REMOTE ] CAAP: Full fetch complete (27999 records). [2025-09-30T17:47:49.379316] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-30T17:47:49.415444] [DEBUG] [LOCAL ] BZH: Trimmed 46938 records to 32445 (keeping 200 days of data) [2025-09-30T17:47:49.867224] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-30T17:47:49.929391] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-30T17:47:49.929560] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-30T17:47:49.933763] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-30T17:47:49.971778] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-30T17:47:49.998033] [DEBUG] [LOCAL ] CAAP: Trimmed 27999 records to 19924 (keeping 200 days of data) [2025-09-30T17:47:50.100933] [DEBUG] [LOCAL ] BZH: Primary data saved (32445 records). [2025-09-30T17:47:50.104693] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-30T17:47:50.104853] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 38.2s. Estimated remaining: 4h 10m 19s. Rate: 8.0 symbols/min [2025-09-30T17:47:50.308108] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:50.309079] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-30T17:47:50.309211] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-30T17:47:50.310443] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-30T17:47:50.318208] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-30T17:47:50.327951] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-30T17:47:50.328864] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-30T17:47:50.332939] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T17:47:50.347105] [DEBUG] [LOCAL ] CAAP: Primary data saved (19924 records). [2025-09-30T17:47:50.362579] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-30T17:47:50.400936] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 31.3s. Estimated remaining: 4h 9m 34s. Rate: 8.0 symbols/min [2025-09-30T17:47:50.658144] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-30T17:47:50.706946] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:50.761722] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-09-30T17:47:50.767456] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-09-30T17:47:50.774960] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-30T17:47:50.803737] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-30T17:47:50.810979] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-30T17:47:50.823117] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-30T17:47:51.067440] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:51.338735] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:51.454331] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-30T17:47:51.530745] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:47:51.749512] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:47:52.254382] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-30T17:47:53.054332] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-30T17:47:53.193131] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:47:53.283339] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:47:53.854412] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-30T17:47:54.067617] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:47:54.072856] [INFO ] [REMOTE ] CABO: Full fetch complete (23109 records). [2025-09-30T17:47:54.073056] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-30T17:47:54.488385] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-30T17:47:54.488500] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-30T17:47:54.489074] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-30T17:47:54.489142] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-30T17:47:54.489922] [DEBUG] [LOCAL ] CABO: Trimmed 23109 records to 17138 (keeping 200 days of data) [2025-09-30T17:47:54.607929] [DEBUG] [LOCAL ] CABO: Primary data saved (17138 records). [2025-09-30T17:47:54.608183] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-30T17:47:54.608328] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 25.7s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-09-30T17:47:54.659696] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-30T17:47:54.803580] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:54.851054] [DEBUG] [LOCAL ] CAE: Loaded 38991 existing records from primary storage. [2025-09-30T17:47:54.851479] [INFO ] [MAIN ] CAE: Loaded 38991 existing records. [2025-09-30T17:47:55.036488] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:55.036838] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-30T17:47:55.036905] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-30T17:47:55.038144] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-30T17:47:55.038209] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-30T17:47:55.413059] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:55.454382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-30T17:47:55.805154] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:47:56.149134] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T17:47:56.254386] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-30T17:47:57.033979] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:47:57.054361] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-30T17:47:57.403105] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:47:57.854377] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-30T17:47:58.406739] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:47:58.654368] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-30T17:47:59.018850] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:47:59.454388] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-30T17:48:00.108505] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:48:00.254386] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-30T17:48:00.784296] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:48:01.054400] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-30T17:48:01.624757] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:48:01.854389] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-30T17:48:02.654393] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-30T17:48:02.731483] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:48:03.030190] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T17:48:03.454400] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-30T17:48:04.210950] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T17:48:04.254375] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-30T17:48:04.696507] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T17:48:05.054398] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-30T17:48:05.791006] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:48:05.854344] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-30T17:48:06.174813] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T17:48:06.654412] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-30T17:48:07.454418] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-30T17:48:07.744890] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T17:48:08.254369] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-30T17:48:08.324265] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:48:08.544319] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:48:09.054376] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-30T17:48:09.854385] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-30T17:48:10.397681] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T17:48:10.410437] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-09-30T17:48:10.410669] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-30T17:48:10.666073] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-30T17:48:10.864487] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-30T17:48:10.864731] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-30T17:48:10.865905] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-30T17:48:10.866006] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-30T17:48:10.897684] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 53741 (keeping 200 days of data) [2025-09-30T17:48:10.899003] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:48:11.162870] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T17:48:11.171131] [INFO ] [REMOTE ] CACI: Full fetch complete (39008 records). [2025-09-30T17:48:11.174122] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-30T17:48:11.456807] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-30T17:48:11.653501] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-30T17:48:11.663972] [INFO ] [MAIN ] C: Full history saved. [2025-09-30T17:48:11.664148] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 54.2s. Estimated remaining: 4h 9m 51s. Rate: 8.0 symbols/min [2025-09-30T17:48:11.833273] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-30T17:48:11.866324] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-30T17:48:11.888238] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-30T17:48:11.888851] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-30T17:48:11.950387] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:11.951624] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-09-30T17:48:11.951737] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-09-30T17:48:11.951895] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-30T17:48:11.951964] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-30T17:48:11.951505] [DEBUG] [LOCAL ] CACI: Trimmed 39008 records to 24598 (keeping 200 days of data) [2025-09-30T17:48:11.952128] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-09-30T17:48:11.952617] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-30T17:48:12.364023] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:48:12.429589] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-30T17:48:12.524717] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:12.567789] [DEBUG] [LOCAL ] CACI: Primary data saved (24598 records). [2025-09-30T17:48:12.567930] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-30T17:48:12.568011] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 22.5s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-09-30T17:48:12.762411] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:12.829012] [DEBUG] [LOCAL ] CAG: Loaded 53660 existing records from primary storage. [2025-09-30T17:48:12.829746] [INFO ] [MAIN ] CAG: Loaded 53660 existing records. [2025-09-30T17:48:13.032149] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:13.032484] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-30T17:48:13.032575] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-30T17:48:13.034096] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-30T17:48:13.034159] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-30T17:48:13.065293] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-30T17:48:13.405751] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:13.532280] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:48:13.854445] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-30T17:48:13.970440] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:48:14.269323] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:48:14.654366] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-30T17:48:15.287758] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:48:15.454415] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-30T17:48:15.939616] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:48:16.086454] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:48:16.254370] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-30T17:48:16.825078] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T17:48:17.054362] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-30T17:48:17.667271] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:48:17.854376] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-30T17:48:18.418786] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T17:48:18.654372] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-30T17:48:19.153717] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T17:48:19.454361] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-30T17:48:19.912509] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:48:20.254367] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-30T17:48:20.653610] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:48:21.054382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-30T17:48:21.854383] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-30T17:48:22.654362] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-30T17:48:22.709047] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:48:23.454353] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-30T17:48:23.575516] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:48:24.014727] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T17:48:24.154030] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:48:24.155524] [INFO ] [REMOTE ] CAF: Full fetch complete (5525 records). [2025-09-30T17:48:24.155599] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-30T17:48:24.156139] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:48:24.156282] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:48:24.156337] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:48:24.156417] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-30T17:48:24.156503] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-09-30T17:48:24.156543] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-09-30T17:48:24.156613] [DEBUG] [LOCAL ] CAF: No derivative data file found to delete. [2025-09-30T17:48:24.156748] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 12.5s. Estimated remaining: 4h 9m 22s. Rate: 8.0 symbols/min [2025-09-30T17:48:24.259474] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-30T17:48:24.352460] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:24.410694] [DEBUG] [LOCAL ] CAH: Loaded 51421 existing records from primary storage. [2025-09-30T17:48:24.411051] [INFO ] [MAIN ] CAH: Loaded 51421 existing records. [2025-09-30T17:48:24.606315] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:24.606549] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-30T17:48:24.606597] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-30T17:48:24.608065] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-30T17:48:24.608129] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-30T17:48:25.003835] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:25.054354] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-30T17:48:25.854382] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-30T17:48:26.112037] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T17:48:26.470784] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:48:26.654440] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-30T17:48:27.260921] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T17:48:27.272161] [INFO ] [REMOTE ] CADE: Full fetch complete (69817 records). [2025-09-30T17:48:27.272393] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-30T17:48:27.455887] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-30T17:48:27.723054] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-30T17:48:27.723165] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-30T17:48:27.724116] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-30T17:48:27.724195] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-30T17:48:27.726217] [DEBUG] [LOCAL ] CADE: Trimmed 69817 records to 48810 (keeping 200 days of data) [2025-09-30T17:48:28.046599] [DEBUG] [LOCAL ] CADE: Primary data saved (48810 records). [2025-09-30T17:48:28.046849] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-30T17:48:28.046975] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 37.6s. Estimated remaining: 4h 8m 56s. Rate: 8.0 symbols/min [2025-09-30T17:48:28.261866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-30T17:48:28.283247] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:28.283606] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-09-30T17:48:28.283693] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-09-30T17:48:28.283885] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-30T17:48:28.284054] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-30T17:48:28.284562] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-09-30T17:48:28.285022] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-30T17:48:28.292240] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:48:28.686103] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:29.049066] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:48:29.062891] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-30T17:48:29.854360] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-30T17:48:30.026530] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:48:30.654380] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-30T17:48:30.704447] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:48:31.353240] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:48:31.454353] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-30T17:48:32.254346] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-30T17:48:32.444116] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T17:48:33.054332] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-30T17:48:33.336311] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T17:48:33.708244] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:48:33.854346] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-30T17:48:34.374961] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:48:34.654395] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-30T17:48:35.454323] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-30T17:48:35.735060] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T17:48:36.122162] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:48:36.254361] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-30T17:48:37.025297] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:48:37.054315] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-30T17:48:37.854341] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-30T17:48:37.975226] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:48:38.524986] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:48:38.536353] [INFO ] [REMOTE ] CAE: Full fetch complete (55885 records). [2025-09-30T17:48:38.536586] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-30T17:48:38.659684] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-30T17:48:39.025736] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-30T17:48:39.025947] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-30T17:48:39.026664] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-30T17:48:39.026728] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-30T17:48:39.028199] [DEBUG] [LOCAL ] CAE: Trimmed 55885 records to 39024 (keeping 200 days of data) [2025-09-30T17:48:39.264916] [DEBUG] [LOCAL ] CAE: Primary data saved (39024 records). [2025-09-30T17:48:39.265073] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-30T17:48:39.265882] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 44.7s. Estimated remaining: 4h 9m 8s. Rate: 8.0 symbols/min [2025-09-30T17:48:39.449938] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:39.450154] [DEBUG] [LOCAL ] CALX: No existing data file found in primary storage. [2025-09-30T17:48:39.450224] [WARN ] [MAIN ] CALX: No existing data found, performing full refresh instead. [2025-09-30T17:48:39.450417] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-30T17:48:39.450509] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-30T17:48:39.450563] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-09-30T17:48:39.450597] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-30T17:48:39.488203] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-30T17:48:39.839344] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:40.003752] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-30T17:48:40.254385] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-30T17:48:41.054407] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-30T17:48:41.096373] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-30T17:48:41.470282] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T17:48:41.754056] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:48:41.854414] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-30T17:48:42.080895] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:48:42.654424] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-30T17:48:43.454354] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-30T17:48:43.691007] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T17:48:44.254367] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-30T17:48:44.827568] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:48:44.867144] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:48:44.878966] [INFO ] [REMOTE ] CAG: Full fetch complete (77651 records). [2025-09-30T17:48:44.879203] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-30T17:48:45.059925] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-30T17:48:45.332228] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-30T17:48:45.332326] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-30T17:48:45.333281] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-30T17:48:45.333351] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-30T17:48:45.335065] [DEBUG] [LOCAL ] CAG: Trimmed 77651 records to 53661 (keeping 200 days of data) [2025-09-30T17:48:45.674880] [DEBUG] [LOCAL ] CAG: Primary data saved (53661 records). [2025-09-30T17:48:45.675040] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-30T17:48:45.675128] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 33.1s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-09-30T17:48:45.877404] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:45.873699] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-30T17:48:45.905327] [DEBUG] [LOCAL ] CANG: Loaded 26896 existing records from primary storage. [2025-09-30T17:48:45.905623] [INFO ] [MAIN ] CANG: Loaded 26896 existing records. [2025-09-30T17:48:46.131088] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:46.131881] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-30T17:48:46.132018] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-30T17:48:46.144280] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-30T17:48:46.149517] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-30T17:48:46.234337] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:48:46.568199] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:46.654320] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-30T17:48:46.834921] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:48:46.905041] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:48:47.454361] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-30T17:48:48.254341] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-30T17:48:48.310469] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:48:49.025893] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:48:49.054329] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-30T17:48:49.854314] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-30T17:48:50.129083] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T17:48:50.186515] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:48:50.654359] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-30T17:48:51.060617] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:48:51.454396] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-30T17:48:51.942160] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:48:52.254388] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-30T17:48:53.028416] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:48:53.054359] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-30T17:48:53.854332] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-30T17:48:54.133059] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:48:54.544615] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:48:54.654342] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-30T17:48:55.454351] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-30T17:48:55.617726] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:48:56.252495] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:48:56.261001] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-30T17:48:56.266713] [INFO ] [REMOTE ] CAL: Full fetch complete (61507 records). [2025-09-30T17:48:56.266859] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-30T17:48:56.268068] [FATAL] [VALIDATOR ] CAL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:48:56.268205] [FATAL] [MAIN ] CAL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:48:56.268305] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:48:56.268386] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-30T17:48:56.268457] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-09-30T17:48:56.268510] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-09-30T17:48:56.268595] [DEBUG] [LOCAL ] CAL: No derivative data file found to delete. [2025-09-30T17:48:56.268727] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 28.2s. Estimated remaining: 4h 9m 2s. Rate: 8.0 symbols/min [2025-09-30T17:48:56.459722] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:56.459975] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-09-30T17:48:56.460098] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-09-30T17:48:56.460190] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-30T17:48:56.460229] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-30T17:48:56.460271] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-30T17:48:56.460304] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-30T17:48:56.868303] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:56.972189] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:48:56.984101] [INFO ] [REMOTE ] CAH: Full fetch complete (74610 records). [2025-09-30T17:48:56.984323] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-30T17:48:57.059461] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-30T17:48:57.433084] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-30T17:48:57.433188] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-30T17:48:57.434101] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-30T17:48:57.434170] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-30T17:48:57.435817] [DEBUG] [LOCAL ] CAH: Trimmed 74610 records to 51417 (keeping 200 days of data) [2025-09-30T17:48:57.821809] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T17:48:57.833432] [DEBUG] [LOCAL ] CAH: Primary data saved (51417 records). [2025-09-30T17:48:57.833943] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-30T17:48:57.834129] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 33.7s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-09-30T17:48:57.859447] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-30T17:48:58.038026] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:58.056950] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:48:58.119269] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-30T17:48:58.119745] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-09-30T17:48:58.314165] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:58.314456] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-30T17:48:58.314513] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-30T17:48:58.315632] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-30T17:48:58.315738] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-30T17:48:58.659513] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-30T17:48:58.730740] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:58.782691] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:48:59.454402] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-30T17:49:00.036633] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:49:00.185091] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T17:49:00.254374] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-30T17:49:00.724152] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:49:01.054377] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-30T17:49:01.854360] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-30T17:49:02.087808] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:49:02.654385] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-30T17:49:03.201939] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T17:49:03.454428] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-30T17:49:03.541500] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:49:04.254363] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-30T17:49:04.957049] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T17:49:05.034049] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:49:05.054316] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-30T17:49:05.854361] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T17:49:05.854444] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-30T17:49:06.654357] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-30T17:49:07.454361] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-30T17:49:07.683614] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:49:08.146852] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:49:08.254326] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-30T17:49:08.724686] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:49:09.054352] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-30T17:49:09.741590] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T17:49:09.749253] [INFO ] [REMOTE ] CALX: Full fetch complete (54105 records). [2025-09-30T17:49:09.749364] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-30T17:49:09.863104] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-30T17:49:09.927160] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:49:10.187019] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-30T17:49:10.187106] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-30T17:49:10.187756] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-30T17:49:10.187820] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-30T17:49:10.189026] [DEBUG] [LOCAL ] CALX: Trimmed 54105 records to 37984 (keeping 200 days of data) [2025-09-30T17:49:10.430201] [DEBUG] [LOCAL ] CALX: Primary data saved (37984 records). [2025-09-30T17:49:10.430366] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-30T17:49:10.430459] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 31.2s. Estimated remaining: 4h 8m 43s. Rate: 8.0 symbols/min [2025-09-30T17:49:10.615296] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:10.658146] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-30T17:49:10.660108] [DEBUG] [LOCAL ] CARS: Loaded 39894 existing records from primary storage. [2025-09-30T17:49:10.660530] [INFO ] [MAIN ] CARS: Loaded 39894 existing records. [2025-09-30T17:49:10.866788] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:10.867068] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-30T17:49:10.867137] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-30T17:49:10.867615] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-30T17:49:10.867787] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-30T17:49:11.175177] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:49:11.262112] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:11.454370] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-30T17:49:11.767954] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T17:49:12.179984] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T17:49:12.254348] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-30T17:49:12.824842] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T17:49:12.826814] [INFO ] [REMOTE ] CAPL: Full fetch complete (8858 records). [2025-09-30T17:49:12.826925] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-30T17:49:13.059543] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-30T17:49:13.227510] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-30T17:49:13.227604] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-30T17:49:13.227918] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-30T17:49:13.227993] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-30T17:49:13.228522] [DEBUG] [LOCAL ] CAPL: Trimmed 8858 records to 5788 (keeping 200 days of data) [2025-09-30T17:49:13.268965] [DEBUG] [LOCAL ] CAPL: Primary data saved (5788 records). [2025-09-30T17:49:13.269125] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-30T17:49:13.269211] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 17.0s. Estimated remaining: 4h 8m 11s. Rate: 8.0 symbols/min [2025-09-30T17:49:13.475171] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:13.541741] [DEBUG] [LOCAL ] CAT: Loaded 52915 existing records from primary storage. [2025-09-30T17:49:13.542158] [INFO ] [MAIN ] CAT: Loaded 52915 existing records. [2025-09-30T17:49:13.745699] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:13.745948] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-30T17:49:13.745999] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-30T17:49:13.747592] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-30T17:49:13.747683] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-30T17:49:13.859551] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-30T17:49:14.149538] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:14.517963] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T17:49:14.654364] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-30T17:49:15.335528] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:49:15.454374] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-30T17:49:16.254339] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-30T17:49:16.520510] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T17:49:16.678179] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:49:17.054387] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-30T17:49:17.696786] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:49:17.854416] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-30T17:49:18.654432] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-30T17:49:18.948963] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:49:19.259596] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T17:49:19.454427] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-30T17:49:19.642309] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:49:20.254396] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-30T17:49:21.054380] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-30T17:49:21.639155] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T17:49:21.828942] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T17:49:21.854320] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-30T17:49:22.654386] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-30T17:49:23.054177] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:49:23.092865] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:49:23.454432] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-30T17:49:24.168164] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:49:24.176541] [INFO ] [REMOTE ] CANG: Full fetch complete (40620 records). [2025-09-30T17:49:24.176732] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-30T17:49:24.259559] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-30T17:49:24.633557] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-30T17:49:24.633694] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-30T17:49:24.634378] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-30T17:49:24.634447] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-30T17:49:24.635688] [DEBUG] [LOCAL ] CANG: Trimmed 40620 records to 27013 (keeping 200 days of data) [2025-09-30T17:49:24.807546] [DEBUG] [LOCAL ] CANG: Primary data saved (27013 records). [2025-09-30T17:49:24.807720] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-30T17:49:24.807816] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CANG took 39.1s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-09-30T17:49:25.016625] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:25.027088] [DEBUG] [LOCAL ] CATO: Loaded 7098 existing records from primary storage. [2025-09-30T17:49:25.027335] [INFO ] [MAIN ] CATO: Loaded 7098 existing records. [2025-09-30T17:49:25.063086] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-30T17:49:25.229886] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:25.230282] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-30T17:49:25.230439] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-30T17:49:25.230864] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-30T17:49:25.230992] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-30T17:49:25.614084] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T17:49:25.701614] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:25.854358] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-30T17:49:26.002830] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:49:26.441748] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T17:49:26.654358] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-30T17:49:26.706179] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T17:49:27.454355] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-30T17:49:28.040024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T17:49:28.254357] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-30T17:49:29.054359] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-30T17:49:29.232373] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:49:29.854341] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-30T17:49:30.540428] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-30T17:49:30.575536] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:49:30.654377] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-30T17:49:31.221745] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:49:31.307388] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:49:31.454406] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-30T17:49:32.254401] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-30T17:49:32.992288] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:49:33.054333] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-30T17:49:33.854367] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-30T17:49:34.264334] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T17:49:34.599555] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:49:34.605782] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T17:49:34.617185] [INFO ] [REMOTE ] CARS: Full fetch complete (55372 records). [2025-09-30T17:49:34.617354] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-30T17:49:34.659520] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-30T17:49:35.072403] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-30T17:49:35.072606] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-30T17:49:35.073339] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-30T17:49:35.073443] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-30T17:49:35.074753] [DEBUG] [LOCAL ] CARS: Trimmed 55372 records to 39829 (keeping 200 days of data) [2025-09-30T17:49:35.319975] [DEBUG] [LOCAL ] CARS: Primary data saved (39829 records). [2025-09-30T17:49:35.320137] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-30T17:49:35.320871] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARS took 24.9s. Estimated remaining: 4h 8m 31s. Rate: 8.0 symbols/min [2025-09-30T17:49:35.457863] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-30T17:49:35.512500] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:35.538803] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T17:49:35.583842] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-30T17:49:35.584214] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-09-30T17:49:35.776757] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:35.777099] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-30T17:49:35.777158] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-30T17:49:35.778851] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-30T17:49:35.778913] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-30T17:49:36.158959] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:36.254343] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-30T17:49:37.054390] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-30T17:49:37.783184] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-30T17:49:37.854351] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-30T17:49:37.966333] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:49:38.280119] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T17:49:38.654383] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-30T17:49:39.256117] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T17:49:39.454361] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-30T17:49:39.839069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:49:40.254387] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-30T17:49:40.915632] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T17:49:41.054352] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-30T17:49:41.660976] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T17:49:41.854321] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-30T17:49:42.210087] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T17:49:42.541703] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T17:49:42.654393] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-30T17:49:43.214635] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:49:43.454404] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-30T17:49:44.254363] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-30T17:49:44.373692] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:49:44.376342] [INFO ] [REMOTE ] CATO: Full fetch complete (11609 records). [2025-09-30T17:49:44.376435] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-30T17:49:44.797515] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-30T17:49:44.797855] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-30T17:49:44.798209] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-30T17:49:44.798299] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-30T17:49:44.798824] [DEBUG] [LOCAL ] CATO: Trimmed 11609 records to 7042 (keeping 200 days of data) [2025-09-30T17:49:44.841606] [DEBUG] [LOCAL ] CATO: Primary data saved (7042 records). [2025-09-30T17:49:44.841779] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-30T17:49:44.841885] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CATO took 20.0s. Estimated remaining: 4h 8m 34s. Rate: 7.9 symbols/min [2025-09-30T17:49:45.032494] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:45.065576] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-30T17:49:45.088056] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-09-30T17:49:45.088468] [INFO ] [MAIN ] CB: Loaded 49973 existing records. [2025-09-30T17:49:45.288424] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:45.288696] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-30T17:49:45.288760] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-30T17:49:45.290236] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-30T17:49:45.290302] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-30T17:49:45.697243] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:45.854359] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-30T17:49:46.427256] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:49:46.443260] [INFO ] [REMOTE ] CARR: Full fetch complete (77606 records). [2025-09-30T17:49:46.443453] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-30T17:49:46.659466] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-30T17:49:46.880328] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-30T17:49:46.880522] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-30T17:49:46.881527] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-30T17:49:46.881599] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-30T17:49:46.883377] [DEBUG] [LOCAL ] CARR: Trimmed 77606 records to 53594 (keeping 200 days of data) [2025-09-30T17:49:47.226268] [DEBUG] [LOCAL ] CARR: Primary data saved (53594 records). [2025-09-30T17:49:47.226573] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-30T17:49:47.226739] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARR took 49.4s. Estimated remaining: 4h 8m 0s. Rate: 8.0 symbols/min [2025-09-30T17:49:47.446497] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-30T17:49:47.467388] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:47.468120] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-09-30T17:49:47.468183] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-09-30T17:49:47.468384] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-30T17:49:47.468818] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-30T17:49:47.468999] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-30T17:49:47.469111] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-09-30T17:49:47.469164] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-30T17:49:47.922862] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:47.955429] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:49:48.254333] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-30T17:49:48.368420] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:49:48.775832] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:49:49.054369] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-30T17:49:49.694146] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-30T17:49:49.854378] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-30T17:49:50.654375] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-30T17:49:50.942792] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:49:51.454365] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-30T17:49:51.597724] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:49:52.019863] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:49:52.032067] [INFO ] [REMOTE ] CAT: Full fetch complete (76664 records). [2025-09-30T17:49:52.032232] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-30T17:49:52.259523] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-30T17:49:52.454755] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-30T17:49:52.454852] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-30T17:49:52.455679] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-30T17:49:52.455744] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-30T17:49:52.459143] [DEBUG] [LOCAL ] CAT: Trimmed 76664 records to 52912 (keeping 200 days of data) [2025-09-30T17:49:52.803468] [DEBUG] [LOCAL ] CAT: Primary data saved (52912 records). [2025-09-30T17:49:52.803632] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-30T17:49:52.803759] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 39.5s. Estimated remaining: 4h 7m 43s. Rate: 8.0 symbols/min [2025-09-30T17:49:53.054328] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-30T17:49:53.518308] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:49:53.785789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:49:53.854360] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-30T17:49:53.867144] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:49:54.654352] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-30T17:49:55.454435] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-30T17:49:55.915226] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T17:49:56.254337] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-30T17:49:56.288786] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:49:56.441170] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:49:57.054352] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-30T17:49:57.854348] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-30T17:49:58.176962] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:49:58.651533] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:49:58.661978] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-30T17:49:58.769293] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:49:59.454364] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-30T17:50:00.202527] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:50:00.254354] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-30T17:50:01.062084] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-30T17:50:01.087138] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-30T17:50:01.224861] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:50:01.854368] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-30T17:50:02.654350] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-30T17:50:03.172911] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:50:03.330565] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T17:50:03.454359] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-30T17:50:03.824742] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:50:04.254368] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-30T17:50:05.054352] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-30T17:50:05.245169] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:50:05.808975] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:50:05.854378] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-30T17:50:06.389770] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-30T17:50:06.605589] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T17:50:06.608161] [INFO ] [REMOTE ] CBAN: Full fetch complete (16133 records). [2025-09-30T17:50:06.608271] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-30T17:50:06.659474] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-30T17:50:07.013661] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-30T17:50:07.013753] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-30T17:50:07.014124] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-30T17:50:07.014165] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-30T17:50:07.014809] [DEBUG] [LOCAL ] CBAN: Trimmed 16133 records to 10891 (keeping 200 days of data) [2025-09-30T17:50:07.083229] [DEBUG] [LOCAL ] CBAN: Primary data saved (10891 records). [2025-09-30T17:50:07.083371] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-30T17:50:07.083448] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 19.9s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min [2025-09-30T17:50:07.454360] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-30T17:50:08.422389] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:50:08.434222] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-30T17:50:09.724365] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T17:50:09.737008] [INFO ] [REMOTE ] CAVA: Full fetch complete (77287 records). [2025-09-30T17:50:09.737283] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-30T17:50:10.183745] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-30T17:50:10.183893] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-30T17:50:10.184990] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-30T17:50:10.185150] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-30T17:50:10.187191] [DEBUG] [LOCAL ] CAVA: Trimmed 77287 records to 53552 (keeping 200 days of data) [2025-09-30T17:50:10.459582] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T17:50:10.480189] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-30T17:50:10.597327] [DEBUG] [LOCAL ] CAVA: Primary data saved (53552 records). [2025-09-30T17:50:10.597526] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-30T17:50:10.598221] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 35.3s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-09-30T17:50:12.215433] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:50:12.226515] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-30T17:50:16.884726] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (4.66 seconds). [2025-09-30T17:50:16.896147] [INFO ] [REMOTE ] CB: Full fetch complete (72679 records). [2025-09-30T17:50:16.896381] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-30T17:50:17.334545] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-30T17:50:17.334638] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-30T17:50:17.335516] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-30T17:50:17.335565] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-30T17:50:17.337256] [DEBUG] [LOCAL ] CB: Trimmed 72679 records to 49964 (keeping 200 days of data) [2025-09-30T17:50:17.672181] [DEBUG] [LOCAL ] CB: Primary data saved (49964 records). [2025-09-30T17:50:17.672330] [INFO ] [MAIN ] CB: Full history saved. [2025-09-30T17:50:17.672417] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 32.8s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min [2025-09-30T17:50:18.333703] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.445392] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.503293] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.532304] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.535074] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-30T17:50:18.535165] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-30T17:50:18.535412] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-30T17:50:18.535578] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-30T17:50:18.538135] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-30T17:50:18.538396] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-30T17:50:18.538975] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-30T17:50:18.560840] [INFO ] [MAIN ] CBNA: Loaded 2901 existing records. [2025-09-30T17:50:18.746987] [DEBUG] [LOCAL ] CBL: Loaded 16397 existing records from primary storage. [2025-09-30T17:50:18.763499] [INFO ] [MAIN ] CBL: Loaded 16397 existing records. [2025-09-30T17:50:19.103986] [DEBUG] [LOCAL ] CBRE: Loaded 50596 existing records from primary storage. [2025-09-30T17:50:19.161666] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.167201] [INFO ] [MAIN ] CBRE: Loaded 50596 existing records. [2025-09-30T17:50:19.186673] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.263335] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-30T17:50:19.418765] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.438614] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-30T17:50:19.450216] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-30T17:50:19.466053] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.593140] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-30T17:50:19.739258] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-30T17:50:19.716461] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:19.766427] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-30T17:50:19.766494] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-30T17:50:19.773387] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.816501] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.821806] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-30T17:50:19.851170] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-30T17:50:19.881555] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-30T17:50:20.541339] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:20.626408] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-30T17:50:20.762754] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:50:20.827784] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:20.833876] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-30T17:50:20.833384] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-30T17:50:20.846963] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:50:20.851726] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-30T17:50:20.851845] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:50:20.851920] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-30T17:50:20.852297] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-30T17:50:20.852359] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-30T17:50:20.894708] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-30T17:50:20.916003] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 3.2s. Estimated remaining: 4h 7m 3s. Rate: 8.0 symbols/min [2025-09-30T17:50:20.939489] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:21.006502] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-30T17:50:21.125061] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:21.159452] [DEBUG] [LOCAL ] CBT: Loaded 30857 existing records from primary storage. [2025-09-30T17:50:21.159779] [INFO ] [MAIN ] CBT: Loaded 30857 existing records. [2025-09-30T17:50:21.341167] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:21.341402] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-30T17:50:21.341448] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-30T17:50:21.342329] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-30T17:50:21.342391] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-30T17:50:21.646538] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:50:21.654434] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-30T17:50:21.735975] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:21.736294] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-30T17:50:22.036087] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:50:22.041329] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-30T17:50:22.302796] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:50:22.304709] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-30T17:50:22.698204] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T17:50:22.699888] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-30T17:50:22.890398] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:50:22.912804] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-30T17:50:22.918192] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:50:22.929487] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-30T17:50:23.014961] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-30T17:50:23.016732] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-30T17:50:23.030087] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T17:50:23.034984] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-30T17:50:23.547021] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:50:23.548560] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-30T17:50:24.193425] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:50:24.198040] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-30T17:50:24.239279] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:50:24.252830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-30T17:50:24.255828] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:50:24.266229] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-30T17:50:24.356105] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:50:24.366956] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-30T17:50:24.845912] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:50:25.054374] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-30T17:50:25.203748] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:50:25.331733] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:50:25.501748] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T17:50:25.559606] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T17:50:25.854359] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-30T17:50:26.654382] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-30T17:50:26.901135] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:50:27.200484] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T17:50:27.454354] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-30T17:50:28.254379] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-30T17:50:28.783095] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:50:28.829632] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:50:28.830823] [INFO ] [REMOTE ] CBNA: Full fetch complete (4613 records). [2025-09-30T17:50:28.830896] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-30T17:50:28.831310] [FATAL] [VALIDATOR ] CBNA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:50:28.831415] [FATAL] [MAIN ] CBNA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:50:28.831492] [WARN ] [MAIN ] CBNA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:50:28.831567] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-30T17:50:28.831698] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-09-30T17:50:28.831753] [INFO ] [LOCAL ] CBNA: Starting deletion of derivative data. [2025-09-30T17:50:28.832087] [DEBUG] [LOCAL ] CBNA: Deleted derivative data file. [2025-09-30T17:50:28.832213] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 11.2s. Estimated remaining: 4h 6m 58s. Rate: 8.0 symbols/min [2025-09-30T17:50:29.017464] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:29.042332] [DEBUG] [LOCAL ] CBU: Loaded 22640 existing records from primary storage. [2025-09-30T17:50:29.042602] [INFO ] [MAIN ] CBU: Loaded 22640 existing records. [2025-09-30T17:50:29.063913] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-30T17:50:29.240880] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:29.241124] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-30T17:50:29.241173] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-30T17:50:29.241936] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-30T17:50:29.242032] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-30T17:50:29.617177] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:29.854374] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-30T17:50:30.115180] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:50:30.654344] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-30T17:50:30.979216] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:50:31.454387] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-30T17:50:32.254379] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-30T17:50:32.529750] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T17:50:32.568449] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T17:50:33.054327] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-30T17:50:33.116463] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:50:33.854391] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-30T17:50:34.055592] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:50:34.654347] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-30T17:50:34.801808] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:50:35.454405] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-30T17:50:35.820090] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:50:36.254352] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-30T17:50:36.397533] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:50:37.054399] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-30T17:50:37.854343] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-30T17:50:37.953194] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:50:37.956908] [INFO ] [REMOTE ] CBL: Full fetch complete (25506 records). [2025-09-30T17:50:37.956986] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-30T17:50:38.354736] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T17:50:38.412569] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-30T17:50:38.412687] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-30T17:50:38.413208] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-30T17:50:38.413290] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-30T17:50:38.414332] [DEBUG] [LOCAL ] CBL: Trimmed 25506 records to 16317 (keeping 200 days of data) [2025-09-30T17:50:38.518026] [DEBUG] [LOCAL ] CBL: Primary data saved (16317 records). [2025-09-30T17:50:38.518171] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-30T17:50:38.518306] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 20.8s. Estimated remaining: 4h 7m 1s. Rate: 8.0 symbols/min [2025-09-30T17:50:38.659490] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-30T17:50:38.719221] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:38.719703] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-30T17:50:38.719804] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-30T17:50:38.719956] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-30T17:50:38.720053] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-30T17:50:38.720123] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-30T17:50:38.720160] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-30T17:50:39.124114] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T17:50:39.147502] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:39.454405] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-30T17:50:39.658346] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:50:39.658666] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-30T17:50:39.658752] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:50:39.658800] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-30T17:50:39.658863] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:50:39.658938] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-30T17:50:39.659005] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-30T17:50:39.659043] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-30T17:50:39.659084] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-30T17:50:39.659132] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 1.1s. Estimated remaining: 4h 6m 22s. Rate: 8.0 symbols/min [2025-09-30T17:50:39.848303] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:39.883565] [DEBUG] [LOCAL ] CBZ: Loaded 33640 existing records from primary storage. [2025-09-30T17:50:39.883900] [INFO ] [MAIN ] CBZ: Loaded 33640 existing records. [2025-09-30T17:50:40.075760] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:40.076137] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-30T17:50:40.076229] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-30T17:50:40.077185] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-30T17:50:40.077250] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-30T17:50:40.270381] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-30T17:50:40.458805] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:50:40.510886] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:41.054357] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-30T17:50:41.262827] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:50:41.854353] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-30T17:50:42.121526] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T17:50:42.654392] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-30T17:50:43.274098] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:50:43.454413] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-30T17:50:44.254420] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-30T17:50:44.326852] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:50:44.477289] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:50:44.841053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:50:45.054404] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-30T17:50:45.854372] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-30T17:50:46.315126] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:50:46.654372] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-30T17:50:46.968402] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:50:47.454406] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-30T17:50:47.838531] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:50:48.254397] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-30T17:50:49.054347] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-30T17:50:49.237789] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:50:49.383278] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:50:49.854399] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-30T17:50:50.288200] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:50:50.654379] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-30T17:50:51.454361] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-30T17:50:51.539353] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:50:51.571504] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:50:52.254386] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-30T17:50:52.593302] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:50:52.600368] [INFO ] [REMOTE ] CBT: Full fetch complete (45779 records). [2025-09-30T17:50:52.600531] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-30T17:50:53.025857] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-30T17:50:53.025974] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-30T17:50:53.026694] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-30T17:50:53.026769] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-30T17:50:53.027968] [DEBUG] [LOCAL ] CBT: Trimmed 45779 records to 30830 (keeping 200 days of data) [2025-09-30T17:50:53.092348] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-30T17:50:53.236435] [DEBUG] [LOCAL ] CBT: Primary data saved (30830 records). [2025-09-30T17:50:53.236580] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-30T17:50:53.237217] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBT took 32.3s. Estimated remaining: 4h 6m 44s. Rate: 8.0 symbols/min [2025-09-30T17:50:53.425061] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:53.482565] [DEBUG] [LOCAL ] CC: Loaded 53007 existing records from primary storage. [2025-09-30T17:50:53.482942] [INFO ] [MAIN ] CC: Loaded 53007 existing records. [2025-09-30T17:50:53.747069] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:53.747441] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-30T17:50:53.747503] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-30T17:50:53.748882] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-30T17:50:53.748949] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-30T17:50:53.861960] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-30T17:50:54.157827] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:54.187880] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:50:54.199004] [INFO ] [REMOTE ] CBRE: Full fetch complete (73978 records). [2025-09-30T17:50:54.199154] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-30T17:50:54.655935] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-30T17:50:54.656345] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-30T17:50:54.657579] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-30T17:50:54.657707] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-30T17:50:54.656206] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-30T17:50:54.679633] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:50:54.687201] [DEBUG] [LOCAL ] CBRE: Trimmed 73978 records to 50590 (keeping 200 days of data) [2025-09-30T17:50:54.830123] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:50:55.039878] [DEBUG] [LOCAL ] CBRE: Primary data saved (50590 records). [2025-09-30T17:50:55.040066] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-30T17:50:55.040179] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 37.4s. Estimated remaining: 4h 6m 9s. Rate: 8.0 symbols/min [2025-09-30T17:50:55.224060] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:55.277047] [DEBUG] [LOCAL ] CCI: Loaded 53143 existing records from primary storage. [2025-09-30T17:50:55.277416] [INFO ] [MAIN ] CCI: Loaded 53143 existing records. [2025-09-30T17:50:55.463576] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-30T17:50:55.470609] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:55.471958] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-30T17:50:55.472012] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-30T17:50:55.473135] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-30T17:50:55.473203] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-30T17:50:55.897860] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:56.262287] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-30T17:50:56.282282] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:50:56.492705] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:50:57.054371] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-30T17:50:57.854355] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-30T17:50:57.982527] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:50:58.616993] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:50:58.654344] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-30T17:50:59.059336] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:50:59.065890] [INFO ] [REMOTE ] CBU: Full fetch complete (32259 records). [2025-09-30T17:50:59.066053] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-30T17:50:59.460372] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-30T17:50:59.462427] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-30T17:50:59.462559] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-30T17:50:59.464109] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-30T17:50:59.464180] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-30T17:50:59.465252] [DEBUG] [LOCAL ] CBU: Trimmed 32259 records to 22647 (keeping 200 days of data) [2025-09-30T17:50:59.610078] [DEBUG] [LOCAL ] CBU: Primary data saved (22647 records). [2025-09-30T17:50:59.610251] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-30T17:50:59.610339] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 30.8s. Estimated remaining: 4h 5m 47s. Rate: 8.0 symbols/min [2025-09-30T17:50:59.795450] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:59.795611] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-30T17:50:59.795679] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-30T17:50:59.795802] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-30T17:50:59.795845] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-30T17:50:59.795887] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-30T17:50:59.795920] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-30T17:51:00.191387] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:00.263020] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-30T17:51:00.284097] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:51:00.657865] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:51:01.054367] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-30T17:51:01.854366] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-30T17:51:02.227728] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:51:02.654396] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-30T17:51:02.856466] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:51:02.991635] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:51:03.454418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-30T17:51:04.254429] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-30T17:51:04.480334] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T17:51:04.706496] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T17:51:04.802376] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:51:05.054368] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-30T17:51:05.399901] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T17:51:05.854400] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-30T17:51:06.200064] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T17:51:06.654379] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-30T17:51:07.454367] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-30T17:51:07.786867] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T17:51:08.254353] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-30T17:51:08.609255] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:51:09.054364] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-30T17:51:09.725214] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T17:51:09.854352] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-30T17:51:10.267243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T17:51:10.654369] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-30T17:51:10.855156] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:51:11.454398] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-30T17:51:12.254361] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-30T17:51:12.706821] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-30T17:51:12.911958] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:51:12.925418] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:51:12.925260] [INFO ] [REMOTE ] CBZ: Full fetch complete (45296 records). [2025-09-30T17:51:12.925589] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-30T17:51:13.064594] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-30T17:51:13.366938] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-30T17:51:13.367055] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-30T17:51:13.367792] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-30T17:51:13.367874] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-30T17:51:13.372812] [DEBUG] [LOCAL ] CBZ: Trimmed 45296 records to 33660 (keeping 200 days of data) [2025-09-30T17:51:13.580520] [DEBUG] [LOCAL ] CBZ: Primary data saved (33660 records). [2025-09-30T17:51:13.580696] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-30T17:51:13.580860] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBZ took 33.9s. Estimated remaining: 4h 6m 11s. Rate: 8.0 symbols/min [2025-09-30T17:51:13.771756] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:13.792150] [DEBUG] [LOCAL ] CCIF: Loaded 15655 existing records from primary storage. [2025-09-30T17:51:13.792497] [INFO ] [MAIN ] CCIF: Loaded 15655 existing records. [2025-09-30T17:51:13.864242] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-30T17:51:14.013864] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:14.014197] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-30T17:51:14.014262] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-30T17:51:14.015047] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-30T17:51:14.015137] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-30T17:51:14.409105] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:14.654632] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-30T17:51:14.698594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:51:15.360891] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:51:15.454345] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-30T17:51:15.609759] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:51:16.254395] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-30T17:51:17.054391] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-30T17:51:17.264594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T17:51:17.486240] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T17:51:17.854379] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-30T17:51:18.202411] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T17:51:18.204547] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T17:51:18.654362] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-30T17:51:19.454354] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-30T17:51:20.254377] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-30T17:51:20.455842] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:51:20.524920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T17:51:20.600278] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T17:51:21.054356] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-30T17:51:21.854385] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-30T17:51:21.881628] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:51:22.415339] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T17:51:22.416776] [INFO ] [REMOTE ] CCIA: Full fetch complete (2056 records). [2025-09-30T17:51:22.416969] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-30T17:51:22.635369] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T17:51:22.635573] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:51:22.635670] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:51:22.635745] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-30T17:51:22.635815] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-30T17:51:22.635866] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-30T17:51:22.635951] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-30T17:51:22.636061] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCIA took 23.0s. Estimated remaining: 4h 6m 10s. Rate: 8.0 symbols/min [2025-09-30T17:51:22.659440] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-30T17:51:22.832035] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:22.892015] [DEBUG] [LOCAL ] CCJ: Loaded 53673 existing records from primary storage. [2025-09-30T17:51:22.892377] [INFO ] [MAIN ] CCJ: Loaded 53673 existing records. [2025-09-30T17:51:23.087535] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:23.087801] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-30T17:51:23.087852] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-30T17:51:23.089761] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-30T17:51:23.089841] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-30T17:51:23.483836] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-30T17:51:23.490054] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:24.254367] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-30T17:51:24.475301] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:51:24.641183] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:51:25.054355] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-30T17:51:25.854349] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-30T17:51:26.041159] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:51:26.063820] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T17:51:26.654410] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-30T17:51:27.454355] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-30T17:51:27.713909] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:51:27.819171] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:51:28.254365] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-30T17:51:29.054364] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-30T17:51:29.423572] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T17:51:29.435897] [INFO ] [REMOTE ] CC: Full fetch complete (75589 records). [2025-09-30T17:51:29.436067] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-30T17:51:29.866343] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-30T17:51:29.862483] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-30T17:51:29.866548] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-30T17:51:29.867550] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-30T17:51:29.868567] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-30T17:51:29.870982] [DEBUG] [LOCAL ] CC: Trimmed 75589 records to 53006 (keeping 200 days of data) [2025-09-30T17:51:30.012504] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:51:30.267879] [DEBUG] [LOCAL ] CC: Primary data saved (53006 records). [2025-09-30T17:51:30.268043] [INFO ] [MAIN ] CC: Full history saved. [2025-09-30T17:51:30.268904] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 37.0s. Estimated remaining: 4h 6m 3s. Rate: 8.0 symbols/min [2025-09-30T17:51:30.467022] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:30.522682] [DEBUG] [LOCAL ] CCK: Loaded 46287 existing records from primary storage. [2025-09-30T17:51:30.523074] [INFO ] [MAIN ] CCK: Loaded 46287 existing records. [2025-09-30T17:51:30.658805] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-30T17:51:30.741409] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:30.742289] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-30T17:51:30.742523] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-30T17:51:30.743523] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-30T17:51:30.743593] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-30T17:51:30.872007] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:51:31.006600] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T17:51:31.205728] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:31.454413] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-30T17:51:32.254376] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-30T17:51:32.575157] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:51:33.063531] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-30T17:51:33.070086] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:51:33.251344] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T17:51:33.854359] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-30T17:51:34.654357] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-30T17:51:34.674877] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:51:35.099791] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T17:51:35.454414] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-30T17:51:36.254321] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-30T17:51:36.509565] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:51:36.521398] [INFO ] [REMOTE ] CCI: Full fetch complete (76996 records). [2025-09-30T17:51:36.521597] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-30T17:51:36.686207] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:51:36.724727] [INFO ] [REMOTE ] CCIF: Full fetch complete (21864 records). [2025-09-30T17:51:36.737764] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-30T17:51:37.057696] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-30T17:51:37.326970] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-30T17:51:37.333424] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-30T17:51:37.334558] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-30T17:51:37.339819] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-30T17:51:37.388375] [DEBUG] [LOCAL ] CCI: Trimmed 76996 records to 53140 (keeping 200 days of data) [2025-09-30T17:51:37.545858] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-30T17:51:37.572492] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-30T17:51:37.575073] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-30T17:51:37.575426] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-30T17:51:37.584468] [DEBUG] [LOCAL ] CCIF: Trimmed 21864 records to 15713 (keeping 200 days of data) [2025-09-30T17:51:37.800260] [DEBUG] [LOCAL ] CCIF: Primary data saved (15713 records). [2025-09-30T17:51:37.802694] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-30T17:51:37.803099] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 24.2s. Estimated remaining: 4h 5m 56s. Rate: 8.0 symbols/min [2025-09-30T17:51:38.022186] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:38.087000] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T17:51:38.104991] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-30T17:51:38.219637] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-30T17:51:38.221705] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-30T17:51:38.438889] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:38.441143] [DEBUG] [LOCAL ] CCI: Primary data saved (53140 records). [2025-09-30T17:51:38.441456] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-30T17:51:38.441694] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-30T17:51:38.441590] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-30T17:51:38.441892] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCI took 43.4s. Estimated remaining: 4h 5m 16s. Rate: 8.0 symbols/min [2025-09-30T17:51:38.475501] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-30T17:51:38.516427] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-30T17:51:38.680440] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:39.084528] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:39.116235] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-30T17:51:39.119410] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-30T17:51:39.118073] [DEBUG] [LOCAL ] CCO: Loaded 47797 existing records from primary storage. [2025-09-30T17:51:39.130492] [INFO ] [MAIN ] CCO: Loaded 47797 existing records. [2025-09-30T17:51:39.320299] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:39.320572] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-30T17:51:39.320629] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-30T17:51:39.321464] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-30T17:51:39.321528] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-30T17:51:39.459466] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-30T17:51:39.710584] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:39.849171] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T17:51:40.254360] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-30T17:51:41.054332] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-30T17:51:41.092996] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:51:41.204407] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:51:41.854398] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-30T17:51:42.416536] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-30T17:51:42.659474] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-30T17:51:42.681976] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:51:43.380543] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:51:43.454381] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-30T17:51:44.254385] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-30T17:51:44.962284] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-30T17:51:45.054333] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-30T17:51:45.155951] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:51:45.854347] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-30T17:51:46.506351] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:51:46.593141] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-30T17:51:46.654353] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-30T17:51:47.227798] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T17:51:47.454407] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-30T17:51:48.254387] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-30T17:51:48.818209] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:51:48.877750] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T17:51:49.054356] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-30T17:51:49.854367] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-30T17:51:50.005178] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:51:50.654400] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-30T17:51:51.352836] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:51:51.454368] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-30T17:51:51.504009] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T17:51:51.515502] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-09-30T17:51:51.515725] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-30T17:51:51.954919] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-30T17:51:51.955026] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-30T17:51:51.955950] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-30T17:51:51.956021] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-30T17:51:51.960495] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53673 (keeping 200 days of data) [2025-09-30T17:51:52.271450] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-30T17:51:52.299728] [DEBUG] [LOCAL ] CCJ: Primary data saved (53673 records). [2025-09-30T17:51:52.299958] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-30T17:51:52.300085] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCJ took 29.7s. Estimated remaining: 4h 5m 38s. Rate: 8.0 symbols/min [2025-09-30T17:51:52.493725] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:52.505719] [DEBUG] [LOCAL ] CCRD: Loaded 9032 existing records from primary storage. [2025-09-30T17:51:52.506001] [INFO ] [MAIN ] CCRD: Loaded 9032 existing records. [2025-09-30T17:51:52.705416] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:52.705846] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-30T17:51:52.705997] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-30T17:51:52.706591] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-30T17:51:52.706688] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-30T17:51:53.110277] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-30T17:51:53.153713] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:53.164495] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-30T17:51:53.193684] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:51:53.854337] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-30T17:51:54.347341] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:51:54.517725] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:51:54.654352] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-30T17:51:55.445840] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:51:55.459404] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-30T17:51:55.476739] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T17:51:56.254369] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-30T17:51:56.972225] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:51:57.054376] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-30T17:51:57.854465] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-30T17:51:58.277473] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:51:58.654357] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-30T17:51:58.725841] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-30T17:51:58.801890] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:51:58.813007] [INFO ] [REMOTE ] CCK: Full fetch complete (67702 records). [2025-09-30T17:51:58.813215] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-30T17:51:59.180033] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T17:51:59.235984] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-30T17:51:59.236102] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-30T17:51:59.237248] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-30T17:51:59.237331] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-30T17:51:59.239431] [DEBUG] [LOCAL ] CCK: Trimmed 67702 records to 46241 (keeping 200 days of data) [2025-09-30T17:51:59.456034] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-30T17:51:59.603471] [DEBUG] [LOCAL ] CCK: Primary data saved (46241 records). [2025-09-30T17:51:59.603731] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-30T17:51:59.604616] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 29.3s. Estimated remaining: 4h 5m 30s. Rate: 8.0 symbols/min [2025-09-30T17:51:59.830223] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:59.870460] [DEBUG] [LOCAL ] CCS: Loaded 30622 existing records from primary storage. [2025-09-30T17:51:59.870898] [INFO ] [MAIN ] CCS: Loaded 30622 existing records. [2025-09-30T17:52:00.058883] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:00.059192] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-30T17:52:00.059315] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-30T17:52:00.060633] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-30T17:52:00.060725] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-30T17:52:00.262505] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-30T17:52:00.449705] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:01.056941] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-30T17:52:01.064228] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T17:52:01.854401] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-30T17:52:02.391159] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:52:02.571452] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-30T17:52:02.654394] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-30T17:52:03.171356] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T17:52:03.454403] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-30T17:52:04.100375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:52:04.102045] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:52:04.254382] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-30T17:52:05.026283] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:52:05.054325] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-30T17:52:05.854334] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-30T17:52:06.019391] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:52:06.654397] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-30T17:52:07.454436] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-30T17:52:07.785923] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:52:08.085496] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-30T17:52:08.254398] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-30T17:52:08.758412] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:52:09.054455] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-30T17:52:09.854427] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-30T17:52:10.404489] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:52:10.489052] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T17:52:10.654418] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-30T17:52:11.428711] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:52:11.454316] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-30T17:52:12.254470] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-30T17:52:13.056330] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-30T17:52:13.060093] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-30T17:52:13.103225] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:52:13.114160] [INFO ] [REMOTE ] CCO: Full fetch complete (66475 records). [2025-09-30T17:52:13.114334] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-30T17:52:13.538434] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-30T17:52:13.538537] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-30T17:52:13.539375] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-30T17:52:13.539446] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-30T17:52:13.541021] [DEBUG] [LOCAL ] CCO: Trimmed 66475 records to 47809 (keeping 200 days of data) [2025-09-30T17:52:13.854819] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-30T17:52:13.858287] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:52:13.873604] [DEBUG] [LOCAL ] CCO: Primary data saved (47809 records). [2025-09-30T17:52:13.873857] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-30T17:52:13.873988] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 35.4s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-09-30T17:52:14.007790] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:52:14.150963] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:14.178878] [DEBUG] [LOCAL ] CCU: Loaded 23240 existing records from primary storage. [2025-09-30T17:52:14.179208] [INFO ] [MAIN ] CCU: Loaded 23240 existing records. [2025-09-30T17:52:14.374321] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:14.374581] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-30T17:52:14.374635] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-30T17:52:14.375045] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-30T17:52:14.375106] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-30T17:52:14.663384] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-30T17:52:14.817618] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:15.454441] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-30T17:52:16.162165] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:52:16.259128] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-30T17:52:16.282172] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T17:52:16.305549] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-30T17:52:16.306769] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T17:52:16.306004] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-30T17:52:16.751066] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-30T17:52:16.751167] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-30T17:52:16.752149] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-30T17:52:16.752229] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-30T17:52:16.753861] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-30T17:52:17.069813] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-30T17:52:17.098698] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-30T17:52:17.098870] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-30T17:52:17.098964] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 39.3s. Estimated remaining: 4h 5m 26s. Rate: 8.0 symbols/min [2025-09-30T17:52:17.292978] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:17.293167] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-30T17:52:17.293226] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-30T17:52:17.293353] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-30T17:52:17.293398] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-30T17:52:17.293442] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-30T17:52:17.293478] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-30T17:52:17.740914] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:17.744405] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:52:17.854326] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-30T17:52:17.929017] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:52:17.931518] [INFO ] [REMOTE ] CCRD: Full fetch complete (11844 records). [2025-09-30T17:52:17.931611] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-30T17:52:18.437445] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-30T17:52:18.437534] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-30T17:52:18.437928] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-30T17:52:18.438009] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-30T17:52:18.438628] [DEBUG] [LOCAL ] CCRD: Trimmed 11844 records to 9062 (keeping 200 days of data) [2025-09-30T17:52:18.478301] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T17:52:18.514669] [DEBUG] [LOCAL ] CCRD: Primary data saved (9062 records). [2025-09-30T17:52:18.514834] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-30T17:52:18.514929] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 26.2s. Estimated remaining: 4h 4m 50s. Rate: 8.0 symbols/min [2025-09-30T17:52:18.659476] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-30T17:52:18.709418] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:18.768620] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-30T17:52:18.769094] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-30T17:52:18.945767] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-30T17:52:18.967470] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:18.968711] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-30T17:52:18.968771] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-30T17:52:18.970599] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-30T17:52:18.970690] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-30T17:52:19.369196] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:19.454390] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-30T17:52:19.675058] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-30T17:52:20.254358] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-30T17:52:21.054354] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-30T17:52:21.299190] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T17:52:21.707297] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T17:52:21.854355] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-30T17:52:22.654359] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-30T17:52:23.184057] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:52:23.454325] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-30T17:52:23.842812] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:52:24.254403] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-30T17:52:24.589912] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:52:25.054363] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-30T17:52:25.276638] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:52:25.279265] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-30T17:52:25.854361] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-30T17:52:26.080233] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:52:26.080561] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-30T17:52:26.080704] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:52:26.080817] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-30T17:52:26.080885] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:52:26.080960] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-30T17:52:26.081028] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-30T17:52:26.081067] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-30T17:52:26.081132] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-30T17:52:26.081205] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCZ took 9.0s. Estimated remaining: 4h 4m 42s. Rate: 8.0 symbols/min [2025-09-30T17:52:26.274408] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:26.286590] [DEBUG] [LOCAL ] CDLR: Loaded 9783 existing records from primary storage. [2025-09-30T17:52:26.287059] [INFO ] [MAIN ] CDLR: Loaded 9783 existing records. [2025-09-30T17:52:26.475825] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:26.476068] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-30T17:52:26.476116] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-30T17:52:26.476570] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-30T17:52:26.476632] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-30T17:52:26.659524] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-30T17:52:26.903256] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:27.454388] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-30T17:52:28.254398] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-30T17:52:28.622723] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:52:28.887006] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:52:28.967858] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:52:28.974561] [INFO ] [REMOTE ] CCS: Full fetch complete (45078 records). [2025-09-30T17:52:28.974706] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-30T17:52:29.059492] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-30T17:52:29.387830] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-30T17:52:29.387915] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-30T17:52:29.388550] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-30T17:52:29.388620] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-30T17:52:29.389731] [DEBUG] [LOCAL ] CCS: Trimmed 45078 records to 30574 (keeping 200 days of data) [2025-09-30T17:52:29.584151] [DEBUG] [LOCAL ] CCS: Primary data saved (30574 records). [2025-09-30T17:52:29.584289] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-30T17:52:29.584863] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 30.0s. Estimated remaining: 4h 4m 16s. Rate: 8.0 symbols/min [2025-09-30T17:52:29.768104] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:29.810919] [DEBUG] [LOCAL ] CDP: Loaded 42547 existing records from primary storage. [2025-09-30T17:52:29.811227] [INFO ] [MAIN ] CDP: Loaded 42547 existing records. [2025-09-30T17:52:29.861741] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-30T17:52:30.019960] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:30.020172] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-30T17:52:30.020327] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-30T17:52:30.021555] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-30T17:52:30.021618] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-30T17:52:30.358015] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:52:30.443181] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:30.654401] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-30T17:52:31.454407] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-30T17:52:31.570370] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:52:31.621831] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:52:32.254392] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-30T17:52:33.060012] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-30T17:52:33.065826] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:52:33.264802] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T17:52:33.854426] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-30T17:52:34.142049] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:52:34.654379] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-30T17:52:35.207879] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:52:35.245312] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:52:35.454395] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-30T17:52:36.254364] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-30T17:52:36.991768] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:52:37.054380] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-30T17:52:37.854394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-30T17:52:38.213535] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:52:38.512799] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T17:52:38.514587] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:52:38.654369] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-30T17:52:39.454389] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-30T17:52:40.255372] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-30T17:52:40.258283] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:52:40.376430] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T17:52:41.054378] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-30T17:52:41.854360] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-30T17:52:41.951840] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:52:42.124945] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:52:42.426535] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T17:52:42.654406] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-30T17:52:43.454333] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-30T17:52:43.609182] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:52:44.254397] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-30T17:52:45.054351] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-30T17:52:45.103306] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:52:45.480012] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T17:52:45.854356] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-30T17:52:46.350053] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:52:46.654342] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-30T17:52:46.932261] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:52:47.454366] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-30T17:52:48.254365] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-30T17:52:48.520001] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:52:48.701457] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T17:52:48.739627] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T17:52:49.054375] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-30T17:52:49.854407] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-30T17:52:50.654342] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-30T17:52:50.935904] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:52:51.106581] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T17:52:51.454356] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-30T17:52:52.083531] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:52:52.254346] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-30T17:52:52.393304] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:52:53.054396] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-30T17:52:53.854373] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-30T17:52:54.219140] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T17:52:54.584027] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:52:54.654385] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-30T17:52:54.800554] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T17:52:54.803284] [INFO ] [REMOTE ] CDLR: Full fetch complete (13226 records). [2025-09-30T17:52:54.803380] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-30T17:52:55.200915] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-30T17:52:55.201001] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-30T17:52:55.201370] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-30T17:52:55.201412] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-30T17:52:55.201994] [DEBUG] [LOCAL ] CDLR: Trimmed 13226 records to 9816 (keeping 200 days of data) [2025-09-30T17:52:55.259196] [DEBUG] [LOCAL ] CDLR: Primary data saved (9816 records). [2025-09-30T17:52:55.259346] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-30T17:52:55.259492] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDLR took 29.2s. Estimated remaining: 4h 5m 33s. Rate: 7.9 symbols/min [2025-09-30T17:52:55.445837] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:55.454411] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-30T17:52:55.473839] [DEBUG] [LOCAL ] CDRE: Loaded 25219 existing records from primary storage. [2025-09-30T17:52:55.474131] [INFO ] [MAIN ] CDRE: Loaded 25219 existing records. [2025-09-30T17:52:55.669494] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:55.669730] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-30T17:52:55.669787] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-30T17:52:55.670316] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-30T17:52:55.670378] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-30T17:52:56.056164] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:56.254340] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-30T17:52:57.010185] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:52:57.054383] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-30T17:52:57.164897] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:52:57.279923] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T17:52:57.292295] [INFO ] [REMOTE ] CDE: Full fetch complete (77581 records). [2025-09-30T17:52:57.292459] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-30T17:52:57.735808] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-30T17:52:57.735928] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-30T17:52:57.736848] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-30T17:52:57.736916] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-30T17:52:57.738584] [DEBUG] [LOCAL ] CDE: Trimmed 77581 records to 53641 (keeping 200 days of data) [2025-09-30T17:52:57.855715] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-30T17:52:58.060151] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-30T17:52:58.060287] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-30T17:52:58.060368] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDE took 39.5s. Estimated remaining: 4h 5m 4s. Rate: 8.0 symbols/min [2025-09-30T17:52:58.242895] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:58.294857] [DEBUG] [LOCAL ] CE: Loaded 51527 existing records from primary storage. [2025-09-30T17:52:58.295176] [INFO ] [MAIN ] CE: Loaded 51527 existing records. [2025-09-30T17:52:58.547417] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:58.547921] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-30T17:52:58.548053] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-30T17:52:58.557814] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-30T17:52:58.574879] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-30T17:52:58.629156] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:52:58.664162] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-30T17:52:58.681042] [INFO ] [REMOTE ] CDP: Full fetch complete (61796 records). [2025-09-30T17:52:58.707686] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-30T17:52:59.372597] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:52:59.411596] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:59.456541] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-30T17:52:59.499092] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-30T17:52:59.499185] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-30T17:52:59.499986] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-30T17:52:59.500054] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-30T17:52:59.501476] [DEBUG] [LOCAL ] CDP: Trimmed 61796 records to 42529 (keeping 200 days of data) [2025-09-30T17:52:59.776258] [DEBUG] [LOCAL ] CDP: Primary data saved (42529 records). [2025-09-30T17:52:59.776405] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-30T17:52:59.777079] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDP took 30.2s. Estimated remaining: 4h 4m 29s. Rate: 8.0 symbols/min [2025-09-30T17:52:59.977011] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:59.988913] [DEBUG] [LOCAL ] CEE: Loaded 6213 existing records from primary storage. [2025-09-30T17:52:59.989244] [INFO ] [MAIN ] CEE: Loaded 6213 existing records. [2025-09-30T17:53:00.209137] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:53:00.207849] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:00.216457] [INFO ] [REMOTE ] CCU: Full fetch complete (33034 records). [2025-09-30T17:53:00.216341] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-30T17:53:00.216785] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-30T17:53:00.216938] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-30T17:53:00.217447] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-30T17:53:00.217531] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-30T17:53:00.310248] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-30T17:53:01.089722] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-30T17:53:01.110786] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-30T17:53:01.116750] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-30T17:53:01.117036] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-30T17:53:01.178203] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:01.179041] [DEBUG] [LOCAL ] CCU: Trimmed 33034 records to 23218 (keeping 200 days of data) [2025-09-30T17:53:01.179692] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-30T17:53:01.305710] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:53:01.371151] [DEBUG] [LOCAL ] CCU: Primary data saved (23218 records). [2025-09-30T17:53:01.371328] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-30T17:53:01.371438] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CCU took 47.5s. Estimated remaining: 4h 3m 54s. Rate: 8.0 symbols/min [2025-09-30T17:53:01.499453] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T17:53:01.587927] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:01.620729] [DEBUG] [LOCAL ] CEPU: Loaded 25890 existing records from primary storage. [2025-09-30T17:53:01.620996] [INFO ] [MAIN ] CEPU: Loaded 25890 existing records. [2025-09-30T17:53:01.850744] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:01.851003] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-30T17:53:01.851108] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-30T17:53:01.851505] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-30T17:53:01.851564] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-30T17:53:01.859518] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-30T17:53:02.140494] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:53:02.274019] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:02.654400] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-30T17:53:03.454332] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-30T17:53:03.655124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:53:03.695435] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:53:04.254363] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-30T17:53:04.586388] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:53:04.844200] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:53:05.054368] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-30T17:53:05.854381] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-30T17:53:06.654396] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-30T17:53:06.769849] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:53:07.069366] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:53:07.454493] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-30T17:53:07.634773] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:53:08.254422] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-30T17:53:08.796484] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T17:53:09.054392] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-30T17:53:09.854345] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-30T17:53:09.959587] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T17:53:10.120251] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:53:10.654386] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-30T17:53:10.881422] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:53:11.284819] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:53:11.454358] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-30T17:53:12.254352] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-30T17:53:12.486683] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:53:12.764759] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T17:53:13.054367] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-30T17:53:13.854390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-30T17:53:13.908989] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T17:53:14.467280] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T17:53:14.654363] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-30T17:53:15.454375] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-30T17:53:15.862166] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:53:16.076848] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T17:53:16.254364] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-30T17:53:17.054373] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-30T17:53:17.472883] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:53:17.478514] [INFO ] [REMOTE ] CDRE: Full fetch complete (35288 records). [2025-09-30T17:53:17.478615] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-30T17:53:17.855989] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-30T17:53:17.891705] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-30T17:53:17.891788] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-30T17:53:17.892295] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-30T17:53:17.892359] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-30T17:53:17.893285] [DEBUG] [LOCAL ] CDRE: Trimmed 35288 records to 25130 (keeping 200 days of data) [2025-09-30T17:53:18.049544] [DEBUG] [LOCAL ] CDRE: Primary data saved (25130 records). [2025-09-30T17:53:18.049713] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-30T17:53:18.049810] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDRE took 22.8s. Estimated remaining: 4h 4m 29s. Rate: 8.0 symbols/min [2025-09-30T17:53:18.241129] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:18.304826] [DEBUG] [LOCAL ] CF: Loaded 52195 existing records from primary storage. [2025-09-30T17:53:18.305226] [INFO ] [MAIN ] CF: Loaded 52195 existing records. [2025-09-30T17:53:18.502890] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:18.503224] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-30T17:53:18.503314] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-30T17:53:18.505744] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-30T17:53:18.505809] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-30T17:53:18.622517] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:53:18.656454] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-30T17:53:18.920340] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:18.954418] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:53:19.455303] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-30T17:53:19.460674] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T17:53:20.254360] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-30T17:53:21.054338] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-30T17:53:21.230257] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:53:21.707371] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:53:21.707706] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T17:53:21.720878] [INFO ] [REMOTE ] CEE: Full fetch complete (10179 records). [2025-09-30T17:53:21.721161] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-30T17:53:21.859478] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-30T17:53:22.122404] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-30T17:53:22.122494] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-30T17:53:22.122827] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-30T17:53:22.122891] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-30T17:53:22.123349] [DEBUG] [LOCAL ] CEE: Trimmed 10179 records to 6103 (keeping 200 days of data) [2025-09-30T17:53:22.163819] [DEBUG] [LOCAL ] CEE: Primary data saved (6103 records). [2025-09-30T17:53:22.163962] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-30T17:53:22.164111] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEE took 22.4s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-09-30T17:53:22.345667] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:22.413845] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-30T17:53:22.414270] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-09-30T17:53:22.611819] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:22.612055] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-30T17:53:22.612105] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-30T17:53:22.614136] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-30T17:53:22.614202] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-30T17:53:22.659571] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-30T17:53:23.012769] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:23.087236] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T17:53:23.454434] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-30T17:53:24.254319] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-30T17:53:24.466169] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:53:24.657372] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T17:53:25.054363] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-30T17:53:25.540995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:53:25.854368] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-30T17:53:26.654454] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-30T17:53:26.769198] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:53:27.463623] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-30T17:53:27.469689] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:53:27.589963] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:53:28.254358] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-30T17:53:29.054379] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-30T17:53:29.213222] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:53:29.369469] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:53:29.854342] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-30T17:53:30.641239] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:53:30.654330] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-30T17:53:31.454367] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-30T17:53:31.693407] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T17:53:31.823329] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:53:32.254387] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-30T17:53:32.967513] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:53:32.993933] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T17:53:33.054345] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-30T17:53:33.854360] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-30T17:53:34.525079] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:53:34.532868] [INFO ] [REMOTE ] CEPU: Full fetch complete (39705 records). [2025-09-30T17:53:34.533079] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-30T17:53:34.659518] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-30T17:53:34.949051] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-30T17:53:34.949159] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-30T17:53:34.949792] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-30T17:53:34.949863] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-30T17:53:34.951148] [DEBUG] [LOCAL ] CEPU: Trimmed 39705 records to 25948 (keeping 200 days of data) [2025-09-30T17:53:35.118375] [DEBUG] [LOCAL ] CEPU: Primary data saved (25948 records). [2025-09-30T17:53:35.118513] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-30T17:53:35.118673] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEPU took 33.7s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-09-30T17:53:35.305723] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:35.306225] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-30T17:53:35.306406] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-30T17:53:35.306808] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-30T17:53:35.306911] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-30T17:53:35.307129] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-30T17:53:35.307221] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-30T17:53:35.461674] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-30T17:53:35.678141] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T17:53:35.777124] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:36.254372] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-30T17:53:36.476216] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T17:53:36.487983] [INFO ] [REMOTE ] CE: Full fetch complete (74857 records). [2025-09-30T17:53:36.488164] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-30T17:53:36.904035] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-30T17:53:36.904122] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-30T17:53:36.905001] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-30T17:53:36.905095] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-30T17:53:36.906736] [DEBUG] [LOCAL ] CE: Trimmed 74857 records to 51519 (keeping 200 days of data) [2025-09-30T17:53:37.095695] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-30T17:53:37.236151] [DEBUG] [LOCAL ] CE: Primary data saved (51519 records). [2025-09-30T17:53:37.236285] [INFO ] [MAIN ] CE: Full history saved. [2025-09-30T17:53:37.236391] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CE took 39.2s. Estimated remaining: 4h 3m 51s. Rate: 8.0 symbols/min [2025-09-30T17:53:37.345414] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:53:37.346044] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-30T17:53:37.346604] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:53:37.346774] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-30T17:53:37.362536] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:53:37.367802] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-30T17:53:37.430192] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:37.430386] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-30T17:53:37.431341] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-30T17:53:37.431457] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-30T17:53:37.431571] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 2.3s. Estimated remaining: 4h 3m 10s. Rate: 8.0 symbols/min [2025-09-30T17:53:37.660133] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:37.693741] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-30T17:53:37.707248] [DEBUG] [LOCAL ] CFR: Loaded 33412 existing records from primary storage. [2025-09-30T17:53:37.707762] [INFO ] [MAIN ] CFR: Loaded 33412 existing records. [2025-09-30T17:53:37.867951] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-30T17:53:37.926854] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:37.928737] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-30T17:53:37.929695] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-30T17:53:37.941588] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-30T17:53:37.968081] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-30T17:53:38.005185] [DEBUG] [LOCAL ] CGAU: Loaded 42672 existing records from primary storage. [2025-09-30T17:53:38.068395] [INFO ] [MAIN ] CGAU: Loaded 42672 existing records. [2025-09-30T17:53:38.086177] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T17:53:38.531586] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:38.545322] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-30T17:53:38.552589] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-30T17:53:38.568531] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-30T17:53:38.574417] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:38.574839] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-30T17:53:38.660515] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-30T17:53:38.967529] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:39.454366] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-30T17:53:39.669620] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:53:40.254332] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-30T17:53:40.475325] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:53:40.877696] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:53:41.054366] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-30T17:53:41.439878] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:53:41.854382] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-30T17:53:42.654314] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-30T17:53:42.856915] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:53:43.235081] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:53:43.454368] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-30T17:53:43.968736] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T17:53:44.254395] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-30T17:53:45.054337] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-30T17:53:45.152286] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:53:45.618177] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:53:45.854356] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-30T17:53:46.654386] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-30T17:53:46.881173] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T17:53:47.454464] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-30T17:53:47.676990] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:53:48.021058] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:53:48.254352] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-30T17:53:49.054328] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-30T17:53:49.259974] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:53:49.785282] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:53:49.854349] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-30T17:53:50.553534] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:53:50.565045] [INFO ] [REMOTE ] CF: Full fetch complete (75192 records). [2025-09-30T17:53:50.565233] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-30T17:53:50.659454] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-30T17:53:51.015319] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-30T17:53:51.015445] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-30T17:53:51.016828] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-30T17:53:51.016912] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-30T17:53:51.018595] [DEBUG] [LOCAL ] CF: Trimmed 75192 records to 52186 (keeping 200 days of data) [2025-09-30T17:53:51.355723] [DEBUG] [LOCAL ] CF: Primary data saved (52186 records). [2025-09-30T17:53:51.355873] [INFO ] [MAIN ] CF: Full history saved. [2025-09-30T17:53:51.355978] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 33.3s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-09-30T17:53:51.454765] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-30T17:53:51.550082] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:51.563257] [DEBUG] [LOCAL ] CGV: No existing data file found in primary storage. [2025-09-30T17:53:51.563807] [WARN ] [MAIN ] CGV: No existing data found, performing full refresh instead. [2025-09-30T17:53:51.564734] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:53:51.564925] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-30T17:53:51.573029] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-30T17:53:51.573458] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-30T17:53:51.573507] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-30T17:53:51.969212] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:52.254377] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-30T17:53:52.336739] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:53:52.998883] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:53:53.054337] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-30T17:53:53.460247] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:53:53.854384] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-30T17:53:54.350212] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T17:53:54.654356] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-30T17:53:54.714537] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:53:55.454391] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-30T17:53:55.980611] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T17:53:56.254371] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-30T17:53:56.682612] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T17:53:57.054334] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-30T17:53:57.167967] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:53:57.179783] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-30T17:53:57.179948] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-30T17:53:57.372830] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T17:53:57.607850] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-30T17:53:57.607988] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-30T17:53:57.609143] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-30T17:53:57.609225] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-30T17:53:57.610912] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-30T17:53:57.855099] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-30T17:53:57.962501] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-30T17:53:57.962673] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-30T17:53:57.963288] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 35.8s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-09-30T17:53:58.151582] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:58.180233] [DEBUG] [LOCAL ] CHCT: Loaded 23872 existing records from primary storage. [2025-09-30T17:53:58.180498] [INFO ] [MAIN ] CHCT: Loaded 23872 existing records. [2025-09-30T17:53:58.378083] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:58.378615] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-30T17:53:58.378716] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-30T17:53:58.379746] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-30T17:53:58.379808] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-30T17:53:58.659464] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-30T17:53:58.763596] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:58.998525] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:53:59.127512] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T17:53:59.454410] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-30T17:54:00.254406] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-30T17:54:00.991250] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T17:54:01.054335] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-30T17:54:01.712931] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:54:01.854327] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-30T17:54:02.019690] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T17:54:02.339772] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T17:54:02.654414] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-30T17:54:03.454416] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-30T17:54:04.199488] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:54:04.254368] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-30T17:54:04.749168] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T17:54:04.799255] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:54:05.054366] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-30T17:54:05.854387] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-30T17:54:06.107996] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:54:06.654394] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-30T17:54:06.995079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T17:54:07.454377] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-30T17:54:07.863985] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:54:07.891114] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T17:54:08.254401] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-30T17:54:08.679971] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T17:54:09.054378] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-30T17:54:09.854361] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-30T17:54:10.603981] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T17:54:10.654378] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-30T17:54:10.888419] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:54:11.454409] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-30T17:54:12.058031] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T17:54:12.254381] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-30T17:54:13.018886] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:54:13.054335] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-30T17:54:13.136857] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:54:13.854353] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-30T17:54:14.654358] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-30T17:54:14.772899] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:54:14.784102] [INFO ] [REMOTE ] CGAU: Full fetch complete (60805 records). [2025-09-30T17:54:14.784273] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-30T17:54:15.223068] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-30T17:54:15.223214] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-30T17:54:15.224279] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-30T17:54:15.224386] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-30T17:54:15.225991] [DEBUG] [LOCAL ] CGAU: Trimmed 60805 records to 42654 (keeping 200 days of data) [2025-09-30T17:54:15.337507] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:54:15.347102] [INFO ] [REMOTE ] CFR: Full fetch complete (48560 records). [2025-09-30T17:54:15.348061] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-30T17:54:15.459024] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-30T17:54:15.811410] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-30T17:54:15.811534] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-30T17:54:15.812469] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-30T17:54:15.868328] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-30T17:54:15.901455] [DEBUG] [LOCAL ] CFR: Trimmed 48560 records to 33291 (keeping 200 days of data) [2025-09-30T17:54:15.923890] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:54:16.031565] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T17:54:16.189473] [DEBUG] [LOCAL ] CGAU: Primary data saved (42654 records). [2025-09-30T17:54:16.194549] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-30T17:54:16.195671] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CGAU took 38.8s. Estimated remaining: 4h 4m 0s. Rate: 8.0 symbols/min [2025-09-30T17:54:16.256265] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-30T17:54:16.331251] [DEBUG] [LOCAL ] CFR: Primary data saved (33291 records). [2025-09-30T17:54:16.331763] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-30T17:54:16.337376] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CFR took 39.1s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-09-30T17:54:16.536895] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:16.620923] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:16.642515] [DEBUG] [LOCAL ] CHE: Loaded 14789 existing records from primary storage. [2025-09-30T17:54:16.642846] [INFO ] [MAIN ] CHE: Loaded 14789 existing records. [2025-09-30T17:54:16.846258] [DEBUG] [LOCAL ] CHD: Loaded 52043 existing records from primary storage. [2025-09-30T17:54:16.866215] [INFO ] [MAIN ] CHD: Loaded 52043 existing records. [2025-09-30T17:54:16.941834] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:16.971287] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-30T17:54:16.977566] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-30T17:54:16.995506] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-30T17:54:17.005005] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-30T17:54:17.055794] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-30T17:54:17.150044] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:54:17.183574] [INFO ] [REMOTE ] CGV: Full fetch complete (2289 records). [2025-09-30T17:54:17.219603] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:17.219918] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-30T17:54:17.225948] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-30T17:54:17.293162] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-30T17:54:17.330206] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-30T17:54:17.402343] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-30T17:54:18.051309] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:18.122030] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-30T17:54:18.535727] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-30T17:54:18.535341] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:18.535940] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-30T17:54:18.536296] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-30T17:54:18.536727] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-30T17:54:18.553136] [DEBUG] [LOCAL ] CGV: Trimmed 2289 records to 1411 (keeping 200 days of data) [2025-09-30T17:54:18.555003] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:54:18.563991] [DEBUG] [LOCAL ] CGV: Primary data saved (1411 records). [2025-09-30T17:54:18.569498] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-30T17:54:18.570112] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 27.2s. Estimated remaining: 4h 2m 48s. Rate: 8.0 symbols/min [2025-09-30T17:54:18.659498] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-30T17:54:18.758838] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:18.809931] [DEBUG] [LOCAL ] CHGG: Loaded 47693 existing records from primary storage. [2025-09-30T17:54:18.810296] [INFO ] [MAIN ] CHGG: Loaded 47693 existing records. [2025-09-30T17:54:19.005736] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:19.006012] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-30T17:54:19.006070] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-30T17:54:19.008549] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-30T17:54:19.008613] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-30T17:54:19.327194] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:54:19.416000] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:19.454346] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-30T17:54:19.874470] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:54:19.879723] [INFO ] [REMOTE ] CHCT: Full fetch complete (34922 records). [2025-09-30T17:54:19.879869] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-30T17:54:20.259518] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-30T17:54:20.308175] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-30T17:54:20.308294] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-30T17:54:20.308865] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-30T17:54:20.308931] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-30T17:54:20.309859] [DEBUG] [LOCAL ] CHCT: Trimmed 34922 records to 23849 (keeping 200 days of data) [2025-09-30T17:54:20.464492] [DEBUG] [LOCAL ] CHCT: Primary data saved (23849 records). [2025-09-30T17:54:20.464631] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-30T17:54:20.464759] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 22.5s. Estimated remaining: 4h 2m 16s. Rate: 8.0 symbols/min [2025-09-30T17:54:20.650333] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:20.688267] [DEBUG] [LOCAL ] CHH: Loaded 32071 existing records from primary storage. [2025-09-30T17:54:20.688580] [INFO ] [MAIN ] CHH: Loaded 32071 existing records. [2025-09-30T17:54:20.881301] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:20.881591] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-30T17:54:20.881664] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-30T17:54:20.882612] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-30T17:54:20.882704] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-30T17:54:21.064529] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-30T17:54:21.264091] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:54:21.337914] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:21.368218] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:54:21.854352] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-30T17:54:22.367117] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:54:22.654397] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-30T17:54:23.299697] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:54:23.454371] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-30T17:54:23.897844] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:54:24.254388] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-30T17:54:24.424085] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:54:25.054374] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-30T17:54:25.762298] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:54:25.854348] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-30T17:54:26.150545] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:54:26.654362] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-30T17:54:27.293039] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:54:27.347886] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:54:27.454391] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-30T17:54:28.254377] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-30T17:54:29.062114] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-30T17:54:29.068468] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T17:54:29.854338] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-30T17:54:30.051438] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:54:30.096971] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:54:30.654357] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-30T17:54:31.173508] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:54:31.454383] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-30T17:54:31.836515] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:54:32.254366] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-30T17:54:33.054351] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-30T17:54:33.105942] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:54:33.854386] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-30T17:54:34.158828] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T17:54:34.195617] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:54:34.654399] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-30T17:54:34.786121] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:54:35.454331] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-30T17:54:36.254324] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-30T17:54:36.347800] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:54:36.423205] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:54:37.054353] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-30T17:54:37.854360] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-30T17:54:37.995192] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:54:38.423112] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:54:38.654385] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-30T17:54:38.678894] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:54:39.454369] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-30T17:54:40.254319] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-30T17:54:40.439998] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:54:40.492794] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T17:54:41.054369] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-30T17:54:41.854419] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-30T17:54:42.073431] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:54:42.144521] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:54:42.654387] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-30T17:54:42.993598] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:54:42.997972] [INFO ] [REMOTE ] CHE: Full fetch complete (19886 records). [2025-09-30T17:54:42.998061] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-30T17:54:43.391773] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-30T17:54:43.391865] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-30T17:54:43.392299] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-30T17:54:43.392392] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-30T17:54:43.393277] [DEBUG] [LOCAL ] CHE: Trimmed 19886 records to 14939 (keeping 200 days of data) [2025-09-30T17:54:43.466932] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-30T17:54:43.500404] [DEBUG] [LOCAL ] CHE: Primary data saved (14939 records). [2025-09-30T17:54:43.500565] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-30T17:54:43.500679] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 27.2s. Estimated remaining: 4h 3m 17s. Rate: 8.0 symbols/min [2025-09-30T17:54:43.688253] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:43.712922] [DEBUG] [LOCAL ] CHMI: Loaded 21938 existing records from primary storage. [2025-09-30T17:54:43.713209] [INFO ] [MAIN ] CHMI: Loaded 21938 existing records. [2025-09-30T17:54:43.924200] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:43.924437] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-30T17:54:43.924488] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-30T17:54:43.925051] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-30T17:54:43.925115] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-30T17:54:44.259436] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-30T17:54:44.342352] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:44.560540] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T17:54:44.571401] [INFO ] [REMOTE ] CHGG: Full fetch complete (70514 records). [2025-09-30T17:54:44.571569] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-30T17:54:45.052303] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-30T17:54:45.052502] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-30T17:54:45.053373] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-30T17:54:45.053461] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-30T17:54:45.054460] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-30T17:54:45.056801] [DEBUG] [LOCAL ] CHGG: Trimmed 70514 records to 47636 (keeping 200 days of data) [2025-09-30T17:54:45.177792] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:54:45.331209] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T17:54:45.420101] [DEBUG] [LOCAL ] CHGG: Primary data saved (47636 records). [2025-09-30T17:54:45.420253] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-30T17:54:45.420355] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHGG took 26.8s. Estimated remaining: 4h 2m 45s. Rate: 8.0 symbols/min [2025-09-30T17:54:45.603561] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:45.611193] [DEBUG] [LOCAL ] CHN: Loaded 4812 existing records from primary storage. [2025-09-30T17:54:45.611409] [INFO ] [MAIN ] CHN: Loaded 4812 existing records. [2025-09-30T17:54:45.818082] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:45.818392] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-30T17:54:45.818447] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-30T17:54:45.818813] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-30T17:54:45.818877] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-30T17:54:45.859457] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-30T17:54:46.231160] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:46.356402] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:54:46.654375] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-30T17:54:47.352377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T17:54:47.454370] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-30T17:54:47.760184] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T17:54:48.254329] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-30T17:54:48.619096] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:54:48.876623] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:54:49.054358] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-30T17:54:49.854374] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-30T17:54:50.425937] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:54:50.654362] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-30T17:54:51.240257] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:54:51.436696] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:54:51.454331] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-30T17:54:52.254418] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-30T17:54:53.060012] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-30T17:54:53.082312] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:54:53.228447] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:54:53.421851] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:54:53.854393] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-30T17:54:54.449339] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:54:54.654399] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-30T17:54:55.454363] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-30T17:54:55.872183] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T17:54:56.254328] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-30T17:54:56.511191] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:54:56.523250] [INFO ] [REMOTE ] CHD: Full fetch complete (74383 records). [2025-09-30T17:54:56.523416] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-30T17:54:56.868091] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T17:54:56.976417] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-30T17:54:56.976524] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-30T17:54:56.978066] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-30T17:54:56.978219] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-30T17:54:56.979972] [DEBUG] [LOCAL ] CHD: Trimmed 74383 records to 52070 (keeping 200 days of data) [2025-09-30T17:54:57.079839] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-30T17:54:57.323306] [DEBUG] [LOCAL ] CHD: Primary data saved (52070 records). [2025-09-30T17:54:57.323440] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-30T17:54:57.323536] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 41.1s. Estimated remaining: 4h 2m 57s. Rate: 8.0 symbols/min [2025-09-30T17:54:57.854357] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-30T17:54:58.391691] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:54:58.654374] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-30T17:54:59.055044] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:54:59.237408] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T17:54:59.454412] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-30T17:55:00.013936] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:55:00.254392] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-30T17:55:01.054371] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-30T17:55:01.559011] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T17:55:01.570260] [INFO ] [REMOTE ] CHH: Full fetch complete (46531 records). [2025-09-30T17:55:01.570512] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-30T17:55:01.877929] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-30T17:55:02.067010] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-30T17:55:02.067361] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-30T17:55:02.068049] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-30T17:55:02.068117] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-30T17:55:02.069527] [DEBUG] [LOCAL ] CHH: Trimmed 46531 records to 32027 (keeping 200 days of data) [2025-09-30T17:55:02.297275] [DEBUG] [LOCAL ] CHH: Primary data saved (32027 records). [2025-09-30T17:55:02.297464] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-30T17:55:02.298266] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 41.8s. Estimated remaining: 4h 2m 38s. Rate: 8.0 symbols/min [2025-09-30T17:55:02.373245] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T17:55:02.654362] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-30T17:55:02.733338] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:55:02.735319] [INFO ] [REMOTE ] CHN: Full fetch complete (7430 records). [2025-09-30T17:55:02.735432] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-30T17:55:03.137276] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-30T17:55:03.137379] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-30T17:55:03.137618] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-30T17:55:03.137693] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-30T17:55:03.138251] [DEBUG] [LOCAL ] CHN: Trimmed 7430 records to 4833 (keeping 200 days of data) [2025-09-30T17:55:03.168131] [DEBUG] [LOCAL ] CHN: Primary data saved (4833 records). [2025-09-30T17:55:03.168361] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-30T17:55:03.168465] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 17.7s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min [2025-09-30T17:55:03.603781] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:55:03.608770] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-30T17:55:04.383932] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:55:04.389506] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-30T17:55:05.243151] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T17:55:05.248470] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-30T17:55:06.271668] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:55:06.276491] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-30T17:55:07.515434] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T17:55:07.520911] [INFO ] [REMOTE ] CHMI: Full fetch complete (31758 records). [2025-09-30T17:55:07.521052] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-30T17:55:07.958872] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-30T17:55:07.958979] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-30T17:55:07.959597] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-30T17:55:07.959722] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-30T17:55:07.961137] [DEBUG] [LOCAL ] CHMI: Trimmed 31758 records to 21961 (keeping 200 days of data) [2025-09-30T17:55:08.094893] [DEBUG] [LOCAL ] CHMI: Primary data saved (21961 records). [2025-09-30T17:55:08.095045] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-30T17:55:08.095146] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 24.6s. Estimated remaining: 4h 1m 42s. Rate: 8.0 symbols/min [2025-09-30T17:55:08.865796] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.846000] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.885156] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.923563] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.950437] [DEBUG] [LOCAL ] CHT: Loaded 19553 existing records from primary storage. [2025-09-30T17:55:08.950943] [INFO ] [MAIN ] CHT: Loaded 19553 existing records. [2025-09-30T17:55:09.243248] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-30T17:55:09.242516] [DEBUG] [LOCAL ] CI: Loaded 49743 existing records from primary storage. [2025-09-30T17:55:09.247187] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-30T17:55:09.258673] [INFO ] [MAIN ] CI: Loaded 49743 existing records. [2025-09-30T17:55:09.246596] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.279991] [DEBUG] [LOCAL ] CHPT: Loaded 48897 existing records from primary storage. [2025-09-30T17:55:09.319745] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-30T17:55:09.314492] [INFO ] [MAIN ] CHPT: Loaded 48897 existing records. [2025-09-30T17:55:09.340544] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-30T17:55:09.424527] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-30T17:55:09.491532] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-30T17:55:09.950950] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.959623] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.988307] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.047031] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:10.038193] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.037780] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-30T17:55:10.062763] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-30T17:55:10.073602] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-30T17:55:10.086783] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-30T17:55:10.092621] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-30T17:55:10.097996] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-30T17:55:10.073555] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.180072] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-30T17:55:10.384987] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-30T17:55:10.428532] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-30T17:55:10.937839] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.102097] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-30T17:55:11.451409] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.539378] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-30T17:55:11.545419] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.558865] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-30T17:55:11.657194] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.657624] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-30T17:55:12.544611] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:55:12.549101] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-30T17:55:13.490616] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:55:13.495220] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-30T17:55:13.554466] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T17:55:13.565437] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-30T17:55:13.605467] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:55:13.618388] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-30T17:55:13.809948] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T17:55:13.821141] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-30T17:55:14.274251] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:55:14.278788] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-30T17:55:15.107034] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:55:15.118701] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-30T17:55:15.258319] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:55:15.283911] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:55:15.454364] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-30T17:55:16.081889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T17:55:16.254400] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-30T17:55:16.788917] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:55:16.880257] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:55:17.054381] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-30T17:55:17.854316] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-30T17:55:18.340458] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-30T17:55:18.654399] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-30T17:55:18.880921] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:55:18.914726] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:55:19.454372] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-30T17:55:20.254418] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-30T17:55:20.470101] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:55:21.054361] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-30T17:55:21.292200] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:55:21.340822] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T17:55:21.854348] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-30T17:55:22.654365] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-30T17:55:22.949626] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:55:23.454430] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-30T17:55:23.923429] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-30T17:55:24.254381] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-30T17:55:24.962217] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-30T17:55:25.054365] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-30T17:55:25.213637] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:55:25.854386] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-30T17:55:26.186197] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-30T17:55:26.258824] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T17:55:26.654384] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-30T17:55:27.454369] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-30T17:55:27.859813] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:55:28.254403] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-30T17:55:28.326103] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:55:29.054345] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-30T17:55:29.364398] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:55:29.661735] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T17:55:29.854354] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-30T17:55:30.654388] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-30T17:55:30.879476] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T17:55:31.454412] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-30T17:55:32.214956] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-30T17:55:32.254334] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-30T17:55:32.835220] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-30T17:55:33.054349] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-30T17:55:33.093073] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:55:33.854381] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-30T17:55:34.540013] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T17:55:34.654349] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-30T17:55:34.730281] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T17:55:34.741532] [INFO ] [REMOTE ] CI: Full fetch complete (72410 records). [2025-09-30T17:55:34.741722] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-30T17:55:35.190951] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-30T17:55:35.191067] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-30T17:55:35.191983] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-30T17:55:35.192065] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-30T17:55:35.193867] [DEBUG] [LOCAL ] CI: Trimmed 72410 records to 49729 (keeping 200 days of data) [2025-09-30T17:55:35.454381] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-30T17:55:35.532508] [DEBUG] [LOCAL ] CI: Primary data saved (49729 records). [2025-09-30T17:55:35.532724] [INFO ] [MAIN ] CI: Full history saved. [2025-09-30T17:55:35.538902] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CI took 27.4s. Estimated remaining: 4h 3m 2s. Rate: 7.9 symbols/min [2025-09-30T17:55:35.737365] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:35.759106] [DEBUG] [LOCAL ] CIA: Loaded 16973 existing records from primary storage. [2025-09-30T17:55:35.759383] [INFO ] [MAIN ] CIA: Loaded 16973 existing records. [2025-09-30T17:55:35.974226] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:35.974717] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-30T17:55:35.974790] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-30T17:55:35.986395] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-30T17:55:36.006688] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-30T17:55:36.014376] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T17:55:36.262448] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-30T17:55:36.422237] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:36.628209] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T17:55:36.658378] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T17:55:37.054362] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-30T17:55:37.854371] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-30T17:55:38.044420] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:55:38.049106] [INFO ] [REMOTE ] CHT: Full fetch complete (27339 records). [2025-09-30T17:55:38.049278] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-30T17:55:38.488424] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-30T17:55:38.488628] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-30T17:55:38.489413] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-30T17:55:38.489491] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-30T17:55:38.490507] [DEBUG] [LOCAL ] CHT: Trimmed 27339 records to 19569 (keeping 200 days of data) [2025-09-30T17:55:38.637691] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T17:55:38.654735] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-30T17:55:38.661967] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-09-30T17:55:38.669435] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-30T17:55:38.778990] [DEBUG] [LOCAL ] CHT: Primary data saved (19569 records). [2025-09-30T17:55:38.790904] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-30T17:55:38.791444] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 30.7s. Estimated remaining: 4h 2m 36s. Rate: 8.0 symbols/min [2025-09-30T17:55:39.179064] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:39.344941] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-30T17:55:39.345241] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-30T17:55:39.346282] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-30T17:55:39.346500] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-30T17:55:39.357069] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-30T17:55:39.484193] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:55:39.507407] [DEBUG] [LOCAL ] CIB: Loaded 30906 existing records from primary storage. [2025-09-30T17:55:39.521522] [INFO ] [REMOTE ] CHPT: Full fetch complete (72869 records). [2025-09-30T17:55:39.525690] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:55:39.520811] [INFO ] [MAIN ] CIB: Loaded 30906 existing records. [2025-09-30T17:55:39.522777] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-30T17:55:39.552464] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-30T17:55:39.863542] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:39.887122] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-30T17:55:39.893223] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-30T17:55:39.926268] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-30T17:55:39.931198] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-30T17:55:40.585228] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-30T17:55:40.622793] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-30T17:55:40.626034] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-30T17:55:40.626598] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-30T17:55:40.731675] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:40.725158] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:55:40.733519] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-30T17:55:40.738217] [DEBUG] [LOCAL ] CHPT: Trimmed 72869 records to 48767 (keeping 200 days of data) [2025-09-30T17:55:41.061201] [DEBUG] [LOCAL ] CHWY: Primary data saved (53655 records). [2025-09-30T17:55:41.061394] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-30T17:55:41.062195] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHWY took 33.0s. Estimated remaining: 4h 2m 5s. Rate: 8.0 symbols/min [2025-09-30T17:55:41.058389] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-30T17:55:41.316994] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:41.318343] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-30T17:55:41.318416] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-30T17:55:41.324820] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-30T17:55:41.326517] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-30T17:55:41.329636] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-30T17:55:41.329777] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-30T17:55:41.420310] [DEBUG] [LOCAL ] CHPT: Primary data saved (48767 records). [2025-09-30T17:55:41.448764] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-30T17:55:41.455103] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 33.4s. Estimated remaining: 4h 1m 27s. Rate: 8.0 symbols/min [2025-09-30T17:55:41.869241] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:41.978905] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:41.980211] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T17:55:41.985778] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-30T17:55:42.029540] [DEBUG] [LOCAL ] CIEN: Loaded 52074 existing records from primary storage. [2025-09-30T17:55:42.039472] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:55:42.039182] [INFO ] [MAIN ] CIEN: Loaded 52074 existing records. [2025-09-30T17:55:42.237265] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:42.237539] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-30T17:55:42.237592] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-30T17:55:42.239130] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-30T17:55:42.239193] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-30T17:55:42.437891] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T17:55:42.645916] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:42.654375] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-30T17:55:43.454379] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-30T17:55:43.875442] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-30T17:55:44.018188] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:55:44.254392] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-30T17:55:44.698442] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:55:45.054389] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-30T17:55:45.403606] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:55:45.854430] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-30T17:55:46.654391] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-30T17:55:47.454339] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-30T17:55:47.716604] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:55:47.918698] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T17:55:48.064829] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:55:48.254398] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-30T17:55:49.054391] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-30T17:55:49.322291] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-30T17:55:49.617919] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:55:49.854401] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-30T17:55:50.262320] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T17:55:50.654398] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-30T17:55:50.941922] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-30T17:55:51.454399] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-30T17:55:52.254362] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-30T17:55:52.580810] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:55:52.787830] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T17:55:53.054361] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-30T17:55:53.854386] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-30T17:55:54.058962] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:55:54.654412] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-30T17:55:55.454352] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-30T17:55:55.473884] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:55:55.520034] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:55:56.254402] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-30T17:55:56.701081] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T17:55:56.701976] [INFO ] [REMOTE ] CICB: Full fetch complete (2093 records). [2025-09-30T17:55:56.702095] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-30T17:55:56.917418] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T17:55:56.917776] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:55:56.917871] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:55:56.918001] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-30T17:55:56.918263] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-30T17:55:56.918401] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-30T17:55:56.918601] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-30T17:55:56.918875] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CICB took 15.9s. Estimated remaining: 4h 1m 53s. Rate: 8.0 symbols/min [2025-09-30T17:55:57.071691] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-30T17:55:57.139670] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:57.142187] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T17:55:57.163199] [DEBUG] [LOCAL ] CIF: Loaded 4271 existing records from primary storage. [2025-09-30T17:55:57.163577] [INFO ] [MAIN ] CIF: Loaded 4271 existing records. [2025-09-30T17:55:57.360908] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:57.361094] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-30T17:55:57.361213] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-30T17:55:57.361608] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-30T17:55:57.361705] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-30T17:55:57.778520] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:57.854341] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-30T17:55:58.330763] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:55:58.541977] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T17:55:58.654383] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-30T17:55:59.221760] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:55:59.454387] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-30T17:56:00.254439] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-30T17:56:01.054449] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-30T17:56:01.318070] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:56:01.408830] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T17:56:01.859500] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-30T17:56:01.868979] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:56:02.654383] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-30T17:56:03.454324] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-30T17:56:03.586978] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:56:03.586632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T17:56:04.146888] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T17:56:04.254366] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-30T17:56:05.054369] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-30T17:56:05.138341] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T17:56:05.854433] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-30T17:56:06.359012] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:56:06.508564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T17:56:06.512149] [INFO ] [REMOTE ] CIA: Full fetch complete (23563 records). [2025-09-30T17:56:06.512230] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-30T17:56:06.659509] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-30T17:56:06.926063] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-30T17:56:06.926159] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-30T17:56:06.926631] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-30T17:56:06.926730] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-30T17:56:06.927627] [DEBUG] [LOCAL ] CIA: Trimmed 23563 records to 17030 (keeping 200 days of data) [2025-09-30T17:56:07.028154] [DEBUG] [LOCAL ] CIA: Primary data saved (17030 records). [2025-09-30T17:56:07.028345] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-30T17:56:07.028455] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIA took 31.5s. Estimated remaining: 4h 1m 57s. Rate: 8.0 symbols/min [2025-09-30T17:56:07.265479] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:07.321589] [DEBUG] [LOCAL ] CIG: Loaded 43863 existing records from primary storage. [2025-09-30T17:56:07.321958] [INFO ] [MAIN ] CIG: Loaded 43863 existing records. [2025-09-30T17:56:07.459550] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-30T17:56:07.528793] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:07.529616] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-30T17:56:07.529711] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-30T17:56:07.531068] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-30T17:56:07.531136] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-30T17:56:07.924627] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:07.984860] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:56:08.132730] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T17:56:08.254374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-30T17:56:09.054335] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-30T17:56:09.762797] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:56:09.854342] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-30T17:56:09.991128] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:56:10.568557] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T17:56:10.654362] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-30T17:56:11.454383] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-30T17:56:12.136003] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T17:56:12.254399] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-30T17:56:12.299637] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:56:12.637553] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T17:56:13.054393] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-30T17:56:13.854348] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-30T17:56:14.654365] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-30T17:56:14.980202] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:56:15.212748] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T17:56:15.219673] [INFO ] [REMOTE ] CIB: Full fetch complete (44402 records). [2025-09-30T17:56:15.219781] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-30T17:56:15.318155] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-30T17:56:15.460942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-30T17:56:15.644347] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-30T17:56:15.644493] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-30T17:56:15.645187] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-30T17:56:15.645321] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-30T17:56:15.646594] [DEBUG] [LOCAL ] CIB: Trimmed 44402 records to 30856 (keeping 200 days of data) [2025-09-30T17:56:15.840803] [DEBUG] [LOCAL ] CIB: Primary data saved (30856 records). [2025-09-30T17:56:15.841008] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-30T17:56:15.841136] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 37.0s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-09-30T17:56:16.024717] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:16.041468] [DEBUG] [LOCAL ] CII: Loaded 15286 existing records from primary storage. [2025-09-30T17:56:16.041828] [INFO ] [MAIN ] CII: Loaded 15286 existing records. [2025-09-30T17:56:16.226692] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:16.226987] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-30T17:56:16.227057] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-30T17:56:16.227773] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-30T17:56:16.227837] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-30T17:56:16.259558] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-30T17:56:16.602276] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:17.054406] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-30T17:56:17.122317] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:56:17.696791] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T17:56:17.698317] [INFO ] [REMOTE ] CIF: Full fetch complete (6613 records). [2025-09-30T17:56:17.698400] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-30T17:56:17.855766] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-30T17:56:17.897075] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:56:18.151766] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-30T17:56:18.151884] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-30T17:56:18.152082] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-30T17:56:18.152125] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-30T17:56:18.152545] [DEBUG] [LOCAL ] CIF: Trimmed 6613 records to 4251 (keeping 200 days of data) [2025-09-30T17:56:18.178124] [DEBUG] [LOCAL ] CIF: Primary data saved (4251 records). [2025-09-30T17:56:18.178337] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-30T17:56:18.178435] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 21.3s. Estimated remaining: 4h 1m 25s. Rate: 8.0 symbols/min [2025-09-30T17:56:18.369595] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:18.412166] [DEBUG] [LOCAL ] CIM: Loaded 37273 existing records from primary storage. [2025-09-30T17:56:18.412446] [INFO ] [MAIN ] CIM: Loaded 37273 existing records. [2025-09-30T17:56:18.614625] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:18.614859] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-30T17:56:18.614910] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-30T17:56:18.616415] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-30T17:56:18.616483] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-30T17:56:18.663970] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-30T17:56:19.035133] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:19.454386] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-30T17:56:19.559849] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:56:20.254409] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-30T17:56:20.318886] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:56:20.471019] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:56:21.054374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-30T17:56:21.854371] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-30T17:56:21.972898] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:56:22.174948] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:56:22.422939] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:56:22.654387] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-30T17:56:23.454374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-30T17:56:23.629202] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:56:24.254368] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-30T17:56:24.981086] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:56:25.054327] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-30T17:56:25.467580] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:56:25.854360] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-30T17:56:26.623858] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:56:26.654390] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-30T17:56:26.945490] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:56:27.454360] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-30T17:56:28.194733] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T17:56:28.254321] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-30T17:56:28.724074] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T17:56:28.741285] [INFO ] [REMOTE ] CIEN: Full fetch complete (75583 records). [2025-09-30T17:56:28.741506] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-30T17:56:29.059502] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-30T17:56:29.166740] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:56:29.217120] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-30T17:56:29.217222] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-30T17:56:29.218253] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-30T17:56:29.218327] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-30T17:56:29.220889] [DEBUG] [LOCAL ] CIEN: Trimmed 75583 records to 52073 (keeping 200 days of data) [2025-09-30T17:56:29.549412] [DEBUG] [LOCAL ] CIEN: Primary data saved (52073 records). [2025-09-30T17:56:29.549574] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-30T17:56:29.549694] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 48.1s. Estimated remaining: 4h 1m 34s. Rate: 8.0 symbols/min [2025-09-30T17:56:29.738822] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:29.743875] [DEBUG] [LOCAL ] CIMN: Loaded 2664 existing records from primary storage. [2025-09-30T17:56:29.744072] [INFO ] [MAIN ] CIMN: Loaded 2664 existing records. [2025-09-30T17:56:29.859475] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-30T17:56:29.943458] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:29.943708] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-30T17:56:29.943789] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-30T17:56:29.944040] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-30T17:56:29.944102] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-30T17:56:30.320297] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:30.654339] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-30T17:56:30.860496] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:56:30.883404] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:56:31.454399] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-30T17:56:31.969211] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:56:32.254347] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-30T17:56:32.417350] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:56:33.025077] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T17:56:33.054364] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-30T17:56:33.854359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-30T17:56:34.418753] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:56:34.442401] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:56:34.654365] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-30T17:56:35.454361] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-30T17:56:35.794340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T17:56:36.254312] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-30T17:56:36.255495] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T17:56:36.593703] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T17:56:37.054368] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-30T17:56:37.854344] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-30T17:56:38.560367] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:56:38.654376] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-30T17:56:39.328873] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:56:39.454357] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-30T17:56:40.254325] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-30T17:56:40.277869] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:56:40.281949] [INFO ] [REMOTE ] CII: Full fetch complete (23033 records). [2025-09-30T17:56:40.282032] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-30T17:56:40.490623] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T17:56:40.578716] [INFO ] [REMOTE ] CIG: Full fetch complete (61116 records). [2025-09-30T17:56:40.609458] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-30T17:56:40.912114] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T17:56:40.917576] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-30T17:56:40.940363] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-30T17:56:40.952207] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-30T17:56:40.956589] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-30T17:56:41.050227] [DEBUG] [LOCAL ] CII: Trimmed 23033 records to 15237 (keeping 200 days of data) [2025-09-30T17:56:41.066831] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-30T17:56:41.317700] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-30T17:56:41.319265] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-30T17:56:41.322229] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-30T17:56:41.322313] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-30T17:56:41.322414] [DEBUG] [LOCAL ] CII: Primary data saved (15237 records). [2025-09-30T17:56:41.322770] [INFO ] [MAIN ] CII: Full history saved. [2025-09-30T17:56:41.322891] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 25.5s. Estimated remaining: 4h 1m 45s. Rate: 7.9 symbols/min [2025-09-30T17:56:41.402629] [DEBUG] [LOCAL ] CIG: Trimmed 61116 records to 43817 (keeping 200 days of data) [2025-09-30T17:56:41.639376] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:41.643486] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-30T17:56:41.643861] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-30T17:56:41.645670] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-30T17:56:41.645790] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-30T17:56:41.646228] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-30T17:56:41.646304] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-30T17:56:41.758576] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:56:41.855523] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-30T17:56:42.113266] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:42.271907] [DEBUG] [LOCAL ] CIG: Primary data saved (43817 records). [2025-09-30T17:56:42.272110] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-30T17:56:42.272224] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIG took 35.2s. Estimated remaining: 4h 1m 9s. Rate: 8.0 symbols/min [2025-09-30T17:56:42.455218] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:42.455496] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-30T17:56:42.455554] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-30T17:56:42.455694] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-30T17:56:42.455749] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-30T17:56:42.455794] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-30T17:56:42.455828] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-30T17:56:42.663857] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-30T17:56:42.839576] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:43.454386] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-30T17:56:43.522339] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:56:43.650503] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:56:43.651004] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-30T17:56:43.651108] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:56:43.651172] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-30T17:56:43.651259] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:56:43.651364] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-30T17:56:43.651443] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-30T17:56:43.651482] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-30T17:56:43.651543] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-30T17:56:43.651616] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 1.4s. Estimated remaining: 4h 0m 35s. Rate: 8.0 symbols/min [2025-09-30T17:56:43.832737] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:43.854847] [DEBUG] [LOCAL ] CINT: Loaded 18619 existing records from primary storage. [2025-09-30T17:56:43.855274] [INFO ] [MAIN ] CINT: Loaded 18619 existing records. [2025-09-30T17:56:43.942515] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:56:44.085622] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:44.085985] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-30T17:56:44.086058] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-30T17:56:44.086639] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-30T17:56:44.086762] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-30T17:56:44.263897] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-30T17:56:44.507512] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:44.712212] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T17:56:45.054359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-30T17:56:45.595613] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-30T17:56:45.854351] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-30T17:56:46.288540] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T17:56:46.654401] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-30T17:56:47.454374] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-30T17:56:47.905704] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:56:47.933394] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:56:48.254368] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-30T17:56:48.794698] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T17:56:48.795831] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-09-30T17:56:48.795909] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-30T17:56:49.059515] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-30T17:56:49.178215] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-30T17:56:49.178330] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-30T17:56:49.178485] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-30T17:56:49.178526] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-30T17:56:49.178942] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2679 (keeping 200 days of data) [2025-09-30T17:56:49.196119] [DEBUG] [LOCAL ] CIMN: Primary data saved (2679 records). [2025-09-30T17:56:49.196205] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-30T17:56:49.196282] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMN took 19.6s. Estimated remaining: 4h 0m 19s. Rate: 8.0 symbols/min [2025-09-30T17:56:49.372784] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:49.393268] [DEBUG] [LOCAL ] CIO: Loaded 20139 existing records from primary storage. [2025-09-30T17:56:49.393571] [INFO ] [MAIN ] CIO: Loaded 20139 existing records. [2025-09-30T17:56:49.588628] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T17:56:49.595537] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:49.597778] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-30T17:56:49.597840] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-30T17:56:49.598537] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-30T17:56:49.598601] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-30T17:56:49.859488] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-30T17:56:49.986758] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:50.351671] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T17:56:50.654398] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-30T17:56:51.226585] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T17:56:51.454368] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-30T17:56:51.908512] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:56:52.254374] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-30T17:56:53.054397] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-30T17:56:53.308523] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-30T17:56:53.784841] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:56:53.854369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-30T17:56:54.654359] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-30T17:56:55.157011] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T17:56:55.293177] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:56:55.454363] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-30T17:56:56.254377] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-30T17:56:56.358315] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T17:56:57.054338] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-30T17:56:57.416968] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T17:56:57.687834] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:56:57.854378] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-30T17:56:58.654376] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-30T17:56:58.912990] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T17:56:59.454372] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-30T17:56:59.654382] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:57:00.254381] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-30T17:57:00.923142] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T17:57:00.981405] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T17:57:01.054372] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-30T17:57:01.854346] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-30T17:57:02.074528] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T17:57:02.605499] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:57:02.654392] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-30T17:57:03.454326] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-30T17:57:03.757678] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:57:04.254362] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-30T17:57:04.583109] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:57:05.054367] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-30T17:57:05.758978] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:57:05.759365] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T17:57:05.770244] [INFO ] [REMOTE ] CIMO: Full fetch complete (5274 records). [2025-09-30T17:57:05.770382] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-30T17:57:05.859484] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-30T17:57:05.969831] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T17:57:05.970087] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:57:05.970167] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:57:05.970238] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-30T17:57:05.970306] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-30T17:57:05.970342] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-30T17:57:05.970418] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-30T17:57:05.970530] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMO took 24.6s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-09-30T17:57:06.160232] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:06.191413] [DEBUG] [LOCAL ] CION: Loaded 29154 existing records from primary storage. [2025-09-30T17:57:06.191738] [INFO ] [MAIN ] CION: Loaded 29154 existing records. [2025-09-30T17:57:06.391144] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:06.391361] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-30T17:57:06.391409] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-30T17:57:06.392406] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-30T17:57:06.392470] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-30T17:57:06.657098] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-30T17:57:06.819950] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:06.956475] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:57:07.454383] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-30T17:57:07.789463] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:57:08.254331] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-30T17:57:08.484991] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:57:09.054315] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-30T17:57:09.218463] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:57:09.854375] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-30T17:57:10.654371] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-30T17:57:10.713685] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T17:57:10.722329] [INFO ] [REMOTE ] CIM: Full fetch complete (54798 records). [2025-09-30T17:57:10.722484] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-30T17:57:10.875966] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:57:11.156128] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-30T17:57:11.156237] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-30T17:57:11.157037] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-30T17:57:11.157107] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-30T17:57:11.158438] [DEBUG] [LOCAL ] CIM: Trimmed 54798 records to 37414 (keeping 200 days of data) [2025-09-30T17:57:11.396951] [DEBUG] [LOCAL ] CIM: Primary data saved (37414 records). [2025-09-30T17:57:11.397095] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-30T17:57:11.397184] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIM took 53.2s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-09-30T17:57:11.455596] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-30T17:57:11.526317] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:57:11.599481] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:11.652004] [DEBUG] [LOCAL ] CIVI: Loaded 52585 existing records from primary storage. [2025-09-30T17:57:11.652344] [INFO ] [MAIN ] CIVI: Loaded 52585 existing records. [2025-09-30T17:57:11.846285] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:11.846763] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-30T17:57:11.846818] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-30T17:57:11.849044] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-30T17:57:11.849111] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-30T17:57:12.226037] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:12.254323] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-30T17:57:12.667064] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:57:13.054380] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-30T17:57:13.854328] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-30T17:57:13.962922] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:57:14.137957] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:57:14.654376] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-30T17:57:14.982636] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:57:15.454417] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-30T17:57:16.254311] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-30T17:57:16.365720] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:57:16.647597] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:57:16.652803] [INFO ] [REMOTE ] CIO: Full fetch complete (29007 records). [2025-09-30T17:57:16.652906] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-30T17:57:17.059101] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-30T17:57:17.062480] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-30T17:57:17.062845] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-30T17:57:17.064512] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-30T17:57:17.064832] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-30T17:57:17.066433] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T17:57:17.072858] [DEBUG] [LOCAL ] CIO: Trimmed 29007 records to 20234 (keeping 200 days of data) [2025-09-30T17:57:17.193168] [DEBUG] [LOCAL ] CIO: Primary data saved (20234 records). [2025-09-30T17:57:17.193307] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-30T17:57:17.193391] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIO took 28.0s. Estimated remaining: 4h 0m 20s. Rate: 8.0 symbols/min [2025-09-30T17:57:17.379885] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:17.439243] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-30T17:57:17.439733] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-30T17:57:17.632290] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:17.632557] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-30T17:57:17.632625] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-30T17:57:17.634680] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-30T17:57:17.634747] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-30T17:57:17.859785] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-30T17:57:18.016977] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:18.654375] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-30T17:57:18.691849] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:57:19.263426] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:57:19.269155] [INFO ] [REMOTE ] CINT: Full fetch complete (26377 records). [2025-09-30T17:57:19.269262] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-30T17:57:19.462253] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-30T17:57:19.693229] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-30T17:57:19.693311] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-30T17:57:19.693799] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-30T17:57:19.693865] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-30T17:57:19.694799] [DEBUG] [LOCAL ] CINT: Trimmed 26377 records to 18629 (keeping 200 days of data) [2025-09-30T17:57:19.802938] [DEBUG] [LOCAL ] CINT: Primary data saved (18629 records). [2025-09-30T17:57:19.803094] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-30T17:57:19.803181] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CINT took 36.2s. Estimated remaining: 3h 59m 51s. Rate: 8.0 symbols/min [2025-09-30T17:57:19.994483] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:20.029773] [DEBUG] [LOCAL ] CLB: Loaded 32878 existing records from primary storage. [2025-09-30T17:57:20.030056] [INFO ] [MAIN ] CLB: Loaded 32878 existing records. [2025-09-30T17:57:20.235119] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:20.235390] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-30T17:57:20.235450] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-30T17:57:20.236425] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-30T17:57:20.236488] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-30T17:57:20.269670] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-30T17:57:20.683233] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T17:57:20.681300] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:21.054317] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-30T17:57:21.109729] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T17:57:21.397678] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:57:21.854355] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-30T17:57:22.312381] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:57:22.654370] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-30T17:57:23.454339] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-30T17:57:23.674876] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:57:23.876098] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:57:24.254349] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-30T17:57:24.281132] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:57:25.054361] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-30T17:57:25.854377] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-30T17:57:26.076808] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:57:26.654356] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-30T17:57:27.224613] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-30T17:57:27.303345] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:57:27.454379] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-30T17:57:28.254353] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-30T17:57:28.396326] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T17:57:28.765559] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:57:29.054367] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-30T17:57:29.460100] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:57:29.854367] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-30T17:57:30.654332] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-30T17:57:30.993739] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:57:31.464504] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-30T17:57:31.471548] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:57:31.689422] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:57:32.254417] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-30T17:57:32.896209] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:57:33.054384] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-30T17:57:33.854331] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-30T17:57:34.064051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:57:34.181392] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:57:34.654376] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-30T17:57:35.326108] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:57:35.454368] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-30T17:57:36.254326] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-30T17:57:36.293615] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:57:36.305135] [INFO ] [REMOTE ] CIVI: Full fetch complete (75644 records). [2025-09-30T17:57:36.305308] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-30T17:57:36.670226] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:57:36.780427] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-30T17:57:36.780551] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-30T17:57:36.781424] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-30T17:57:36.781488] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-30T17:57:36.783043] [DEBUG] [LOCAL ] CIVI: Trimmed 75644 records to 52589 (keeping 200 days of data) [2025-09-30T17:57:37.076545] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-30T17:57:37.128257] [DEBUG] [LOCAL ] CIVI: Primary data saved (52589 records). [2025-09-30T17:57:37.128438] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-30T17:57:37.128550] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIVI took 25.7s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-09-30T17:57:37.340865] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:37.355986] [DEBUG] [LOCAL ] CLCO: Loaded 12684 existing records from primary storage. [2025-09-30T17:57:37.356245] [INFO ] [MAIN ] CLCO: Loaded 12684 existing records. [2025-09-30T17:57:37.588768] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:37.589066] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-30T17:57:37.589115] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-30T17:57:37.589685] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-30T17:57:37.589750] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-30T17:57:37.865876] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-30T17:57:38.002217] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:38.039075] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:57:38.341503] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T17:57:38.654378] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-30T17:57:38.945882] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T17:57:39.454370] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-30T17:57:39.971791] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:57:40.254430] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-30T17:57:41.054327] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-30T17:57:41.251741] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:57:41.303102] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T17:57:41.854364] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-30T17:57:42.472187] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:57:42.654341] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-30T17:57:42.888176] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:57:43.454389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-30T17:57:43.915776] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:57:43.921667] [INFO ] [REMOTE ] CION: Full fetch complete (41099 records). [2025-09-30T17:57:43.921758] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-30T17:57:44.259480] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-30T17:57:44.331181] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-30T17:57:44.331272] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-30T17:57:44.331881] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-30T17:57:44.331945] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-30T17:57:44.332933] [DEBUG] [LOCAL ] CION: Trimmed 41099 records to 29029 (keeping 200 days of data) [2025-09-30T17:57:44.527784] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:57:44.543847] [DEBUG] [LOCAL ] CION: Primary data saved (29029 records). [2025-09-30T17:57:44.544005] [INFO ] [MAIN ] CION: Full history saved. [2025-09-30T17:57:44.545242] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CION took 38.6s. Estimated remaining: 4h 0m 17s. Rate: 8.0 symbols/min [2025-09-30T17:57:44.729927] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:44.756398] [DEBUG] [LOCAL ] CLDT: Loaded 25475 existing records from primary storage. [2025-09-30T17:57:44.756709] [INFO ] [MAIN ] CLDT: Loaded 25475 existing records. [2025-09-30T17:57:44.945348] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:44.945567] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-30T17:57:44.945616] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-30T17:57:44.946474] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-30T17:57:44.946537] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-30T17:57:45.059746] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-30T17:57:45.337377] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:45.854438] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-30T17:57:45.976255] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T17:57:46.654415] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-30T17:57:46.706473] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:57:47.209979] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T17:57:47.454365] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-30T17:57:47.724296] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:57:48.254368] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-30T17:57:48.513631] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T17:57:49.054363] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-30T17:57:49.774780] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:57:49.782306] [INFO ] [REMOTE ] CLB: Full fetch complete (46673 records). [2025-09-30T17:57:49.782450] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-30T17:57:49.862363] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-30T17:57:50.205350] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-30T17:57:50.205469] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-30T17:57:50.216013] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-30T17:57:50.225429] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-30T17:57:50.226903] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:57:50.233970] [DEBUG] [LOCAL ] CLB: Trimmed 46673 records to 33011 (keeping 200 days of data) [2025-09-30T17:57:50.452202] [DEBUG] [LOCAL ] CLB: Primary data saved (33011 records). [2025-09-30T17:57:50.452352] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-30T17:57:50.452562] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLB took 30.6s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-09-30T17:57:50.659588] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-30T17:57:50.675862] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:50.735726] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-30T17:57:50.736120] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-30T17:57:50.943541] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:50.943849] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-30T17:57:50.943940] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-30T17:57:50.945336] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-30T17:57:50.945418] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-30T17:57:51.358520] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:51.454344] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-30T17:57:51.816989] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:57:51.899522] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T17:57:52.224424] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:57:52.254309] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-30T17:57:52.873624] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T17:57:53.054358] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-30T17:57:53.854425] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-30T17:57:54.274978] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T17:57:54.654376] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-30T17:57:55.454367] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-30T17:57:55.770630] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:57:56.254319] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-30T17:57:56.387463] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T17:57:56.536579] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:57:57.054352] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-30T17:57:57.854333] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-30T17:57:57.885635] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:57:58.205887] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T17:57:58.654377] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-30T17:57:59.454349] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-30T17:57:59.469211] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:57:59.848255] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T17:57:59.859949] [INFO ] [REMOTE ] CL: Full fetch complete (77227 records). [2025-09-30T17:57:59.860177] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-30T17:57:59.861238] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:57:59.861340] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:57:59.861383] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:57:59.861456] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-30T17:57:59.861576] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-09-30T17:57:59.861672] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-09-30T17:57:59.862037] [DEBUG] [LOCAL ] CL: Deleted derivative data file. [2025-09-30T17:57:59.862204] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CL took 42.7s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-09-30T17:58:00.040171] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:00.072253] [DEBUG] [LOCAL ] CLH: Loaded 27795 existing records from primary storage. [2025-09-30T17:58:00.072547] [INFO ] [MAIN ] CLH: Loaded 27795 existing records. [2025-09-30T17:58:00.265001] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-30T17:58:00.272137] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:00.272447] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-30T17:58:00.272494] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-30T17:58:00.273386] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-30T17:58:00.273449] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-30T17:58:00.735171] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:01.054328] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-30T17:58:01.225907] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T17:58:01.340554] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:58:01.854394] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-30T17:58:02.188086] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:58:02.654362] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-30T17:58:02.966415] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:58:02.969587] [INFO ] [REMOTE ] CLCO: Full fetch complete (22832 records). [2025-09-30T17:58:02.969709] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-30T17:58:03.362316] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-30T17:58:03.362398] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-30T17:58:03.362831] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-30T17:58:03.362894] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-30T17:58:03.363546] [DEBUG] [LOCAL ] CLCO: Trimmed 22832 records to 12668 (keeping 200 days of data) [2025-09-30T17:58:03.443239] [DEBUG] [LOCAL ] CLCO: Primary data saved (12668 records). [2025-09-30T17:58:03.443427] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-30T17:58:03.443589] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 26.3s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-09-30T17:58:03.460526] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-30T17:58:03.637921] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:03.651295] [DEBUG] [LOCAL ] CLPR: Loaded 11464 existing records from primary storage. [2025-09-30T17:58:03.651534] [INFO ] [MAIN ] CLPR: Loaded 11464 existing records. [2025-09-30T17:58:03.841916] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:03.842141] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-30T17:58:03.842189] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-30T17:58:03.842471] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-30T17:58:03.842533] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-30T17:58:04.233778] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:04.254316] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-30T17:58:04.732201] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:58:04.773316] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:58:05.054399] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-30T17:58:05.346398] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:58:05.854424] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-30T17:58:06.655286] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-30T17:58:06.657816] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:58:07.426169] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-30T17:58:07.454334] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-30T17:58:07.765256] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:58:08.254406] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-30T17:58:09.054363] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-30T17:58:09.377816] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:58:09.555590] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:58:09.839678] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:58:09.854345] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-30T17:58:10.543946] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T17:58:10.654338] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-30T17:58:11.454334] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-30T17:58:11.487318] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T17:58:12.254356] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-30T17:58:12.522224] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:58:13.054356] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-30T17:58:13.854354] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-30T17:58:14.237445] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:58:14.307677] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:58:14.540698] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:58:14.654366] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-30T17:58:15.454330] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-30T17:58:15.596151] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T17:58:16.254394] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-30T17:58:17.054429] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-30T17:58:17.090943] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:58:17.712542] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-30T17:58:17.854366] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-30T17:58:18.442924] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:58:18.654375] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-30T17:58:19.454345] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-30T17:58:19.839927] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T17:58:19.898716] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T17:58:19.950872] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T17:58:20.254371] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-30T17:58:21.054330] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-30T17:58:21.248474] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:58:21.854382] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-30T17:58:22.172712] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:58:22.654354] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-30T17:58:23.454367] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-30T17:58:23.502827] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T17:58:23.504908] [INFO ] [REMOTE ] CLPR: Full fetch complete (17592 records). [2025-09-30T17:58:23.505008] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-30T17:58:23.956596] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-30T17:58:23.956742] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-30T17:58:23.957199] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-30T17:58:23.957313] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-30T17:58:23.958358] [DEBUG] [LOCAL ] CLPR: Trimmed 17592 records to 11437 (keeping 200 days of data) [2025-09-30T17:58:24.047960] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T17:58:24.077339] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-30T17:58:24.079753] [DEBUG] [LOCAL ] CLPR: Primary data saved (11437 records). [2025-09-30T17:58:24.079894] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-30T17:58:24.080245] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-30T17:58:24.080378] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLPR took 20.6s. Estimated remaining: 4h 0m 25s. Rate: 7.9 symbols/min [2025-09-30T17:58:24.255473] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-30T17:58:24.608971] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:24.832913] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:58:24.838566] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-30T17:58:24.856266] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-30T17:58:24.858147] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-30T17:58:24.858352] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-30T17:58:24.860127] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-30T17:58:24.940967] [DEBUG] [LOCAL ] CLS: Loaded 53629 existing records from primary storage. [2025-09-30T17:58:24.968748] [INFO ] [MAIN ] CLS: Loaded 53629 existing records. [2025-09-30T17:58:25.058161] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-30T17:58:25.198361] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:25.201326] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-30T17:58:25.202062] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-30T17:58:25.204189] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-30T17:58:25.205156] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-30T17:58:25.722480] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:25.745345] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T17:58:25.752660] [INFO ] [REMOTE ] CLDT: Full fetch complete (37028 records). [2025-09-30T17:58:25.753302] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-30T17:58:25.862629] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-30T17:58:26.265500] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-30T17:58:26.265760] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-30T17:58:26.266395] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-30T17:58:26.267362] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-30T17:58:26.291379] [DEBUG] [LOCAL ] CLDT: Trimmed 37028 records to 25444 (keeping 200 days of data) [2025-09-30T17:58:26.295128] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T17:58:26.421932] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-30T17:58:26.424741] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-30T17:58:26.424899] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLF took 36.0s. Estimated remaining: 3h 59m 56s. Rate: 7.9 symbols/min [2025-09-30T17:58:26.624405] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:26.657482] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-30T17:58:26.680291] [DEBUG] [LOCAL ] CLDT: Primary data saved (25444 records). [2025-09-30T17:58:26.680512] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-30T17:58:26.680721] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLDT took 42.1s. Estimated remaining: 3h 59m 19s. Rate: 8.0 symbols/min [2025-09-30T17:58:26.914787] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:26.917328] [DEBUG] [LOCAL ] CLVT: Loaded 51942 existing records from primary storage. [2025-09-30T17:58:26.917771] [INFO ] [MAIN ] CLVT: Loaded 51942 existing records. [2025-09-30T17:58:27.121161] [DEBUG] [LOCAL ] CLW: Loaded 21833 existing records from primary storage. [2025-09-30T17:58:27.149237] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:27.149464] [INFO ] [MAIN ] CLW: Loaded 21833 existing records. [2025-09-30T17:58:27.149702] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-30T17:58:27.182352] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-30T17:58:27.230720] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-30T17:58:27.257357] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-30T17:58:27.453227] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:27.465260] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-30T17:58:27.486495] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-30T17:58:27.527320] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-30T17:58:27.550257] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-30T17:58:27.968569] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:27.997224] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-30T17:58:28.161936] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:58:28.225175] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:28.238189] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-30T17:58:28.254310] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-30T17:58:29.054369] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-30T17:58:29.139997] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:58:29.146100] [INFO ] [REMOTE ] CLH: Full fetch complete (41831 records). [2025-09-30T17:58:29.146237] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-30T17:58:29.561008] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-30T17:58:29.561229] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-30T17:58:29.561890] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-30T17:58:29.561957] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-30T17:58:29.563167] [DEBUG] [LOCAL ] CLH: Trimmed 41831 records to 27833 (keeping 200 days of data) [2025-09-30T17:58:29.763317] [DEBUG] [LOCAL ] CLH: Primary data saved (27833 records). [2025-09-30T17:58:29.763522] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-30T17:58:29.763768] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 29.9s. Estimated remaining: 3h 58m 53s. Rate: 8.0 symbols/min [2025-09-30T17:58:29.863047] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-30T17:58:29.975291] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T17:58:29.996267] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:30.067850] [DEBUG] [LOCAL ] CLX: Loaded 51455 existing records from primary storage. [2025-09-30T17:58:30.068197] [INFO ] [MAIN ] CLX: Loaded 51455 existing records. [2025-09-30T17:58:30.353056] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:30.353333] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-30T17:58:30.353506] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-30T17:58:30.359992] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-30T17:58:30.370795] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-30T17:58:30.377322] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:58:30.664023] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-30T17:58:30.759997] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:31.454380] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-30T17:58:31.985105] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T17:58:32.105995] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-30T17:58:32.254403] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-30T17:58:33.054379] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-30T17:58:33.278858] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:58:33.854393] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-30T17:58:33.899451] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:58:34.278979] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:58:34.654352] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-30T17:58:35.454420] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-30T17:58:36.252800] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T17:58:36.262217] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-30T17:58:36.316943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-30T17:58:36.693507] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:58:37.054378] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-30T17:58:37.813947] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:58:37.854369] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-30T17:58:38.654428] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-30T17:58:39.202187] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:58:39.255457] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T17:58:39.454411] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-30T17:58:40.254359] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-30T17:58:40.468637] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:58:41.054484] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-30T17:58:41.129994] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:58:41.854400] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-30T17:58:42.425102] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:58:42.576683] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-30T17:58:42.654326] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-30T17:58:43.454346] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-30T17:58:43.605731] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T17:58:44.239111] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T17:58:44.254298] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-30T17:58:44.876477] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T17:58:44.999106] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T17:58:45.054342] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-30T17:58:45.854377] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-30T17:58:45.989271] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:58:46.654376] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-30T17:58:47.212274] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:58:47.454408] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-30T17:58:48.254335] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-30T17:58:48.741082] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T17:58:48.838888] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T17:58:49.054376] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-30T17:58:49.829699] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:58:49.854316] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-30T17:58:50.541940] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:58:50.654360] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-30T17:58:51.454336] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-30T17:58:51.618546] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:58:52.202371] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:58:52.254355] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-30T17:58:53.054369] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-30T17:58:53.493992] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:58:53.859550] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-30T17:58:53.874982] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T17:58:54.654396] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-30T17:58:54.818240] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:58:55.031227] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:58:55.036314] [INFO ] [REMOTE ] CLW: Full fetch complete (35133 records). [2025-09-30T17:58:55.036415] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-30T17:58:55.429985] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-30T17:58:55.430100] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-30T17:58:55.430795] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-30T17:58:55.430864] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-30T17:58:55.432065] [DEBUG] [LOCAL ] CLW: Trimmed 35133 records to 21778 (keeping 200 days of data) [2025-09-30T17:58:55.480947] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-30T17:58:55.569490] [DEBUG] [LOCAL ] CLW: Primary data saved (21778 records). [2025-09-30T17:58:55.569628] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-30T17:58:55.569749] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLW took 28.9s. Estimated remaining: 4h 0m 0s. Rate: 7.9 symbols/min [2025-09-30T17:58:55.749320] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:55.802965] [DEBUG] [LOCAL ] CM: Loaded 48571 existing records from primary storage. [2025-09-30T17:58:55.803396] [INFO ] [MAIN ] CM: Loaded 48571 existing records. [2025-09-30T17:58:55.990264] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:55.990507] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-30T17:58:55.990557] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-30T17:58:55.991101] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-30T17:58:55.991163] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-30T17:58:56.260790] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-30T17:58:56.379401] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:56.468454] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:58:57.054339] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-30T17:58:57.397581] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:58:57.854397] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-30T17:58:58.539001] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:58:58.550293] [INFO ] [REMOTE ] CLVT: Full fetch complete (75237 records). [2025-09-30T17:58:58.550503] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-30T17:58:58.659947] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-30T17:58:58.938093] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-30T17:58:59.041568] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-30T17:58:59.041678] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-30T17:58:59.042505] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-30T17:58:59.042549] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-30T17:58:59.044176] [DEBUG] [LOCAL ] CLVT: Trimmed 75237 records to 51954 (keeping 200 days of data) [2025-09-30T17:58:59.342459] [DEBUG] [LOCAL ] CLVT: Primary data saved (51954 records). [2025-09-30T17:58:59.342595] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-30T17:58:59.342702] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 32.9s. Estimated remaining: 3h 59m 37s. Rate: 7.9 symbols/min [2025-09-30T17:58:59.459477] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-30T17:58:59.530878] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:59.587925] [DEBUG] [LOCAL ] CMA: Loaded 49918 existing records from primary storage. [2025-09-30T17:58:59.588314] [INFO ] [MAIN ] CMA: Loaded 49918 existing records. [2025-09-30T17:58:59.795301] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:59.795777] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-30T17:58:59.795856] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-30T17:58:59.796484] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-30T17:58:59.796545] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-30T17:59:00.197118] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T17:59:00.272862] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:00.285891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-30T17:59:00.287543] [INFO ] [REMOTE ] CLX: Full fetch complete (73028 records). [2025-09-30T17:59:00.287853] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-30T17:59:00.556349] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T17:59:00.884720] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-30T17:59:00.884837] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-30T17:59:00.885791] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-30T17:59:00.885876] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-30T17:59:00.887864] [DEBUG] [LOCAL ] CLX: Trimmed 73028 records to 51484 (keeping 200 days of data) [2025-09-30T17:59:01.083075] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-30T17:59:01.242396] [DEBUG] [LOCAL ] CLX: Primary data saved (51484 records). [2025-09-30T17:59:01.242576] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-30T17:59:01.242700] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 31.5s. Estimated remaining: 3h 59m 7s. Rate: 8.0 symbols/min [2025-09-30T17:59:01.431939] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:01.455695] [DEBUG] [LOCAL ] CMBT: Loaded 22930 existing records from primary storage. [2025-09-30T17:59:01.456052] [INFO ] [MAIN ] CMBT: Loaded 22930 existing records. [2025-09-30T17:59:01.649870] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:01.650184] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-30T17:59:01.650243] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-30T17:59:01.650572] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-30T17:59:01.650637] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-30T17:59:02.055147] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:02.055898] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-30T17:59:02.094303] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T17:59:02.106805] [INFO ] [REMOTE ] CLS: Full fetch complete (77453 records). [2025-09-30T17:59:02.106991] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-30T17:59:02.550920] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-30T17:59:02.551128] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-30T17:59:02.552319] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-30T17:59:02.552453] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-30T17:59:02.586008] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T17:59:02.596931] [DEBUG] [LOCAL ] CLS: Trimmed 77453 records to 53623 (keeping 200 days of data) [2025-09-30T17:59:02.660721] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-30T17:59:02.866858] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T17:59:02.977135] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:59:03.001158] [DEBUG] [LOCAL ] CLS: Primary data saved (53623 records). [2025-09-30T17:59:03.001352] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-30T17:59:03.001492] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLS took 38.9s. Estimated remaining: 3h 58m 36s. Rate: 8.0 symbols/min [2025-09-30T17:59:03.197326] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:03.244544] [DEBUG] [LOCAL ] CMC: Loaded 45570 existing records from primary storage. [2025-09-30T17:59:03.244907] [INFO ] [MAIN ] CMC: Loaded 45570 existing records. [2025-09-30T17:59:03.450536] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:03.450784] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-30T17:59:03.450873] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-30T17:59:03.451352] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-30T17:59:03.451413] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-30T17:59:03.457757] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-30T17:59:03.856491] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:04.028230] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:59:04.254330] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-30T17:59:04.564253] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T17:59:05.054364] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-30T17:59:05.719834] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:59:05.854391] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-30T17:59:06.562309] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:59:06.654329] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-30T17:59:07.454334] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-30T17:59:07.562561] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:59:08.254372] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-30T17:59:08.331177] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:59:08.883305] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:59:09.054361] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-30T17:59:09.854347] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-30T17:59:09.900198] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T17:59:09.977687] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:59:10.654362] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-30T17:59:11.454365] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-30T17:59:11.755315] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:59:11.807554] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:59:12.254372] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-30T17:59:12.999596] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T17:59:13.054363] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-30T17:59:13.790869] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:59:13.854369] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-30T17:59:14.278384] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:59:14.654368] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-30T17:59:14.845142] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:59:15.454372] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-30T17:59:16.254342] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-30T17:59:16.290396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:59:17.054371] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-30T17:59:17.143594] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:59:17.190969] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T17:59:17.854364] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-30T17:59:18.659476] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-30T17:59:18.679988] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:59:19.451436] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:59:19.460567] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-30T17:59:19.807243] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:59:20.254374] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-30T17:59:21.054373] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-30T17:59:21.252733] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T17:59:21.854367] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-30T17:59:22.077546] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:59:22.577506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:59:22.654367] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-30T17:59:22.846938] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T17:59:23.454349] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-30T17:59:24.220063] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T17:59:24.254347] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-30T17:59:25.054370] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-30T17:59:25.123953] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:59:25.400992] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:59:25.854355] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-30T17:59:26.654367] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-30T17:59:26.714675] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:59:27.284299] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:59:27.454366] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-30T17:59:28.211223] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:59:28.254316] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-30T17:59:29.054318] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-30T17:59:29.242465] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:59:29.253001] [INFO ] [REMOTE ] CM: Full fetch complete (69347 records). [2025-09-30T17:59:29.253147] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-30T17:59:29.689446] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-30T17:59:29.689562] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-30T17:59:29.690415] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-30T17:59:29.690486] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-30T17:59:29.692143] [DEBUG] [LOCAL ] CM: Trimmed 69347 records to 48567 (keeping 200 days of data) [2025-09-30T17:59:29.883787] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-30T17:59:29.957039] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:59:29.970301] [INFO ] [REMOTE ] CMBT: Full fetch complete (30160 records). [2025-09-30T17:59:29.971523] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-30T17:59:30.447866] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-30T17:59:30.448344] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-30T17:59:30.451265] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-30T17:59:30.451386] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-30T17:59:30.470496] [DEBUG] [LOCAL ] CM: Primary data saved (48567 records). [2025-09-30T17:59:30.470845] [INFO ] [MAIN ] CM: Full history saved. [2025-09-30T17:59:30.471507] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 34.9s. Estimated remaining: 3h 59m 49s. Rate: 7.9 symbols/min [2025-09-30T17:59:30.483164] [DEBUG] [LOCAL ] CMBT: Trimmed 30160 records to 23214 (keeping 200 days of data) [2025-09-30T17:59:30.804410] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:30.841357] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:59:30.855393] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-09-30T17:59:30.856442] [INFO ] [MAIN ] CMCM: Loaded 4758 existing records. [2025-09-30T17:59:30.862543] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-30T17:59:31.057269] [DEBUG] [LOCAL ] CMBT: Primary data saved (23214 records). [2025-09-30T17:59:31.086563] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:31.081143] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-30T17:59:31.086794] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-30T17:59:31.086864] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-30T17:59:31.086981] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 29.8s. Estimated remaining: 3h 59m 13s. Rate: 7.9 symbols/min [2025-09-30T17:59:31.122051] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-30T17:59:31.157245] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-30T17:59:31.407916] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:31.428605] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-30T17:59:31.462033] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-30T17:59:31.521009] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-30T17:59:31.529791] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-30T17:59:31.551901] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-30T17:59:31.578580] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-30T17:59:31.754878] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:31.783342] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-30T17:59:32.110326] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:32.102817] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:59:32.122265] [INFO ] [REMOTE ] CMA: Full fetch complete (73162 records). [2025-09-30T17:59:32.122674] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-30T17:59:32.257530] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-30T17:59:32.482934] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:59:32.517479] [INFO ] [REMOTE ] CMC: Full fetch complete (67044 records). [2025-09-30T17:59:32.527926] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-30T17:59:32.587981] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:59:32.680318] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-30T17:59:32.689844] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:59:32.719739] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-30T17:59:32.719577] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:59:32.742771] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-30T17:59:32.762784] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-30T17:59:32.761573] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-30T17:59:32.768980] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:59:32.769149] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-30T17:59:32.774991] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-30T17:59:32.791590] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-30T17:59:32.797275] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-30T17:59:32.829472] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-30T17:59:32.899527] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMDB took 1.8s. Estimated remaining: 3h 58m 42s. Rate: 8.0 symbols/min [2025-09-30T17:59:32.885821] [DEBUG] [LOCAL ] CMA: Trimmed 73162 records to 49922 (keeping 200 days of data) [2025-09-30T17:59:33.086394] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-30T17:59:33.371713] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-30T17:59:33.378637] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-30T17:59:33.379972] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-30T17:59:33.380827] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-30T17:59:33.434223] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:33.444870] [DEBUG] [LOCAL ] CMC: Trimmed 67044 records to 45583 (keeping 200 days of data) [2025-09-30T17:59:33.638158] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:59:33.765525] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-30T17:59:33.768513] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-09-30T17:59:33.855787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-30T17:59:34.011737] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:34.065164] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-30T17:59:34.075017] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-30T17:59:34.105978] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-30T17:59:34.109123] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-30T17:59:34.231125] [DEBUG] [LOCAL ] CMA: Primary data saved (49922 records). [2025-09-30T17:59:34.244749] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-30T17:59:34.245230] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMA took 34.9s. Estimated remaining: 3h 58m 10s. Rate: 8.0 symbols/min [2025-09-30T17:59:34.682007] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:34.807809] [DEBUG] [LOCAL ] CMC: Primary data saved (45583 records). [2025-09-30T17:59:34.815223] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-30T17:59:34.814891] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:34.822761] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:59:34.825480] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-30T17:59:34.822330] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 31.8s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min [2025-09-30T17:59:34.992546] [DEBUG] [LOCAL ] CMI: Loaded 41746 existing records from primary storage. [2025-09-30T17:59:35.016371] [INFO ] [MAIN ] CMI: Loaded 41746 existing records. [2025-09-30T17:59:35.110741] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:35.253375] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:35.253699] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-30T17:59:35.253777] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-30T17:59:35.263568] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-30T17:59:35.263633] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-30T17:59:35.420405] [DEBUG] [LOCAL ] CMP: Loaded 36313 existing records from primary storage. [2025-09-30T17:59:35.442038] [INFO ] [MAIN ] CMP: Loaded 36313 existing records. [2025-09-30T17:59:35.498184] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-30T17:59:35.579962] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:59:35.897580] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:35.931985] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-30T17:59:35.935778] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:35.936039] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-30T17:59:35.936418] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-30T17:59:35.936500] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-30T17:59:36.262712] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-30T17:59:36.353530] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:36.771912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T17:59:37.054401] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-30T17:59:37.461829] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:59:37.818598] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-30T17:59:37.854436] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-30T17:59:38.456218] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:59:38.654402] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-30T17:59:39.454415] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-30T17:59:40.254388] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-30T17:59:41.048583] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:59:41.056908] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-30T17:59:41.167715] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-30T17:59:41.654693] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T17:59:41.723332] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T17:59:41.854430] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-30T17:59:42.654377] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-30T17:59:43.454375] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-30T17:59:43.792129] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:59:43.943195] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-30T17:59:43.970461] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T17:59:44.254367] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-30T17:59:45.054406] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-30T17:59:45.734633] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:59:45.854379] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-30T17:59:46.654358] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-30T17:59:46.870570] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:59:46.873047] [INFO ] [REMOTE ] CMCM: Full fetch complete (6993 records). [2025-09-30T17:59:46.873126] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-30T17:59:47.259783] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-30T17:59:47.260002] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-30T17:59:47.260210] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-30T17:59:47.260284] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-30T17:59:47.260929] [DEBUG] [LOCAL ] CMCM: Trimmed 6993 records to 4747 (keeping 200 days of data) [2025-09-30T17:59:47.288880] [DEBUG] [LOCAL ] CMCM: Primary data saved (4747 records). [2025-09-30T17:59:47.289006] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-30T17:59:47.289218] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMCM took 16.8s. Estimated remaining: 3h 57m 47s. Rate: 8.0 symbols/min [2025-09-30T17:59:47.431375] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-30T17:59:47.456243] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-30T17:59:47.539431] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:47.593945] [DEBUG] [LOCAL ] CMPO: Loaded 39383 existing records from primary storage. [2025-09-30T17:59:47.594355] [INFO ] [MAIN ] CMPO: Loaded 39383 existing records. [2025-09-30T17:59:47.817767] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:47.818159] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-30T17:59:47.818322] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-30T17:59:47.818693] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-30T17:59:47.818765] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-30T17:59:48.255206] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-30T17:59:48.268758] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:59:48.393958] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:49.054334] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-30T17:59:49.171147] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:59:49.854373] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-30T17:59:50.646933] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:59:50.655981] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-30T17:59:50.753175] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T17:59:51.260721] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:59:51.454412] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-30T17:59:52.116007] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:59:52.254343] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-30T17:59:53.021803] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:59:53.054330] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-30T17:59:53.841150] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:59:53.854318] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-30T17:59:54.654357] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-30T17:59:54.705913] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:59:55.454358] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-30T17:59:55.587498] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:59:56.023233] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:59:56.254364] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-30T17:59:56.598674] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:59:57.054364] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-30T17:59:57.644081] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:59:57.854361] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-30T17:59:58.269354] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:59:58.654362] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-30T17:59:59.330449] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:59:59.454358] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-30T18:00:00.254339] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-30T18:00:00.349234] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:00:00.766287] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:00:01.054374] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-30T18:00:01.854589] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-30T18:00:01.942339] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:00:02.654381] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-30T18:00:02.817427] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:00:03.454379] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-30T18:00:04.254400] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-30T18:00:04.481611] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:00:04.624750] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-30T18:00:05.054357] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-30T18:00:05.351773] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T18:00:05.854317] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-30T18:00:06.054503] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:00:06.427089] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T18:00:06.433710] [INFO ] [REMOTE ] CMP: Full fetch complete (52705 records). [2025-09-30T18:00:06.433909] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-30T18:00:06.659516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-30T18:00:06.852294] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-30T18:00:06.852392] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-30T18:00:06.853160] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-30T18:00:06.853247] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-30T18:00:06.854439] [DEBUG] [LOCAL ] CMP: Trimmed 52705 records to 36282 (keeping 200 days of data) [2025-09-30T18:00:07.096858] [DEBUG] [LOCAL ] CMP: Primary data saved (36282 records). [2025-09-30T18:00:07.097029] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-30T18:00:07.097215] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMP took 32.3s. Estimated remaining: 3h 58m 28s. Rate: 7.9 symbols/min [2025-09-30T18:00:07.454366] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-30T18:00:07.790277] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T18:00:08.254344] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-30T18:00:08.587606] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:00:08.597103] [INFO ] [REMOTE ] CMI: Full fetch complete (60005 records). [2025-09-30T18:00:08.597272] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-30T18:00:09.051138] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:00:09.101330] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-30T18:00:09.101767] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-30T18:00:09.102681] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-30T18:00:09.102904] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-30T18:00:09.103625] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-30T18:00:09.105837] [DEBUG] [LOCAL ] CMI: Trimmed 60005 records to 41730 (keeping 200 days of data) [2025-09-30T18:00:09.400317] [DEBUG] [LOCAL ] CMI: Primary data saved (41730 records). [2025-09-30T18:00:09.400465] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-30T18:00:09.400689] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 35.2s. Estimated remaining: 3h 57m 60s. Rate: 8.0 symbols/min [2025-09-30T18:00:10.325571] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T18:00:10.338542] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-30T18:00:10.830102] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:00:10.842269] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-30T18:00:12.759018] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T18:00:12.774437] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-30T18:00:14.412442] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (3.57 seconds). [2025-09-30T18:00:14.421414] [INFO ] [REMOTE ] CMPO: Full fetch complete (58678 records). [2025-09-30T18:00:14.421698] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-30T18:00:14.422600] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:00:14.422725] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:00:14.422806] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:00:14.422902] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-30T18:00:14.422993] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-30T18:00:14.423053] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-09-30T18:00:14.423377] [DEBUG] [LOCAL ] CMPO: Deleted derivative data file. [2025-09-30T18:00:14.424254] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 27.1s. Estimated remaining: 3h 57m 42s. Rate: 8.0 symbols/min [2025-09-30T18:00:15.372153] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-30T18:00:15.384927] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-30T18:00:15.385112] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-30T18:00:15.844598] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-30T18:00:15.844763] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-30T18:00:15.846122] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-30T18:00:15.846265] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-30T18:00:15.848416] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-09-30T18:00:16.211479] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-09-30T18:00:16.211639] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-30T18:00:16.211803] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 43.3s. Estimated remaining: 3h 57m 12s. Rate: 8.0 symbols/min [2025-09-30T18:00:17.024227] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.022677] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.059516] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-09-30T18:00:17.068536] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-09-30T18:00:17.081668] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-30T18:00:17.088886] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.089968] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-30T18:00:17.089803] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.090231] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-09-30T18:00:17.090341] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-30T18:00:17.173963] [DEBUG] [LOCAL ] CMSC: Loaded 5080 existing records from primary storage. [2025-09-30T18:00:17.195447] [INFO ] [MAIN ] CMSC: Loaded 5080 existing records. [2025-09-30T18:00:17.229845] [DEBUG] [LOCAL ] CMSA: Loaded 3414 existing records from primary storage. [2025-09-30T18:00:17.244357] [INFO ] [MAIN ] CMSA: Loaded 3414 existing records. [2025-09-30T18:00:17.503290] [DEBUG] [LOCAL ] CMRE: Loaded 35457 existing records from primary storage. [2025-09-30T18:00:17.602304] [INFO ] [MAIN ] CMRE: Loaded 35457 existing records. [2025-09-30T18:00:17.896314] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:17.943061] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-30T18:00:17.998233] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-30T18:00:17.998093] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:18.065592] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-30T18:00:18.065415] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-30T18:00:18.109338] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:18.102390] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-30T18:00:18.110207] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-30T18:00:18.109424] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-30T18:00:18.116720] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-30T18:00:18.173117] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-30T18:00:18.322967] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:18.388435] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-30T18:00:18.403537] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-30T18:00:18.422584] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-30T18:00:18.455083] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-30T18:00:19.235177] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.287257] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-30T18:00:19.406103] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.410435] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-30T18:00:19.498411] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.498835] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-30T18:00:19.973612] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:00:19.985162] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-30T18:00:20.017539] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T18:00:20.019418] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-30T18:00:20.031551] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:00:20.034054] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-30T18:00:20.526694] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:00:20.533855] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-30T18:00:20.606211] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T18:00:20.608492] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-30T18:00:21.074491] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:00:21.076206] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-30T18:00:21.369687] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:00:21.380578] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-30T18:00:21.407161] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T18:00:21.409104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-30T18:00:21.798109] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T18:00:21.854341] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-30T18:00:21.879309] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:00:21.984249] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:00:22.367908] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T18:00:22.654306] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-30T18:00:23.064598] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:00:23.133105] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T18:00:23.454425] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-30T18:00:24.254407] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-30T18:00:24.441318] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:00:24.827020] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T18:00:25.054405] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-30T18:00:25.648504] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T18:00:25.854366] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-30T18:00:26.654420] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-30T18:00:27.109439] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:00:27.373094] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:00:27.454410] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-30T18:00:28.020920] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:00:28.254374] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-30T18:00:28.758058] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T18:00:29.054374] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-30T18:00:29.537726] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:00:29.854402] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-30T18:00:30.453449] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:00:30.654412] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-30T18:00:31.454384] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-30T18:00:32.254341] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-30T18:00:32.272262] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T18:00:32.274095] [INFO ] [REMOTE ] CMSC: Full fetch complete (7185 records). [2025-09-30T18:00:32.274197] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-30T18:00:32.691294] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-30T18:00:32.691416] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-30T18:00:32.691814] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-30T18:00:32.691919] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-30T18:00:32.692749] [DEBUG] [LOCAL ] CMSC: Trimmed 7185 records to 5049 (keeping 200 days of data) [2025-09-30T18:00:32.806459] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-30T18:00:32.824026] [DEBUG] [LOCAL ] CMSC: Primary data saved (5049 records). [2025-09-30T18:00:32.824135] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-30T18:00:32.824213] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 16.6s. Estimated remaining: 3h 57m 40s. Rate: 8.0 symbols/min [2025-09-30T18:00:33.011477] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:33.023564] [DEBUG] [LOCAL ] CMSD: Loaded 8088 existing records from primary storage. [2025-09-30T18:00:33.023889] [INFO ] [MAIN ] CMSD: Loaded 8088 existing records. [2025-09-30T18:00:33.065473] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-30T18:00:33.227759] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:33.228080] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-30T18:00:33.228139] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-30T18:00:33.228451] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-30T18:00:33.228511] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-30T18:00:33.553334] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T18:00:33.626403] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:33.850574] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:00:33.858114] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-30T18:00:34.654366] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-30T18:00:35.454353] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-30T18:00:35.619678] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:00:35.800731] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:00:36.150319] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:00:36.254369] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-30T18:00:36.901690] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:00:36.903217] [INFO ] [REMOTE ] CMSA: Full fetch complete (5138 records). [2025-09-30T18:00:36.903292] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-30T18:00:37.059523] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-30T18:00:37.318472] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-30T18:00:37.318557] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-30T18:00:37.318798] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-30T18:00:37.318862] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-30T18:00:37.319326] [DEBUG] [LOCAL ] CMSA: Trimmed 5138 records to 3503 (keeping 200 days of data) [2025-09-30T18:00:37.342226] [DEBUG] [LOCAL ] CMSA: Primary data saved (3503 records). [2025-09-30T18:00:37.342348] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-30T18:00:37.342437] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 21.1s. Estimated remaining: 3h 57m 21s. Rate: 8.0 symbols/min [2025-09-30T18:00:37.528506] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:37.581533] [DEBUG] [LOCAL ] CMTG: Loaded 37127 existing records from primary storage. [2025-09-30T18:00:37.581863] [INFO ] [MAIN ] CMTG: Loaded 37127 existing records. [2025-09-30T18:00:37.770821] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:37.771029] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-30T18:00:37.771078] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-30T18:00:37.771461] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-30T18:00:37.771520] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-30T18:00:37.859481] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-30T18:00:38.171253] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:38.206329] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:00:38.654397] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-30T18:00:39.238283] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:00:39.253515] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:00:39.454396] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-30T18:00:40.146752] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:00:40.254444] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-30T18:00:41.054420] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-30T18:00:41.274350] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:00:41.601658] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T18:00:41.854421] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-30T18:00:42.654382] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-30T18:00:43.454334] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-30T18:00:43.574457] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:00:43.834601] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T18:00:43.944712] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:00:44.254383] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-30T18:00:45.054376] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-30T18:00:45.629691] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T18:00:45.854366] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-30T18:00:46.650584] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:00:46.661429] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-30T18:00:47.406724] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:00:47.454376] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-30T18:00:48.142098] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T18:00:48.254400] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-30T18:00:48.906400] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:00:49.054352] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-30T18:00:49.213122] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:00:49.786280] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:00:49.854361] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-30T18:00:50.654359] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-30T18:00:51.464476] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-30T18:00:51.470622] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:00:51.483082] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-09-30T18:00:51.483244] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-30T18:00:51.656213] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T18:00:51.935605] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-30T18:00:51.935734] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-30T18:00:51.936631] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-30T18:00:51.936764] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-30T18:00:51.939777] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 52610 (keeping 200 days of data) [2025-09-30T18:00:52.255097] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-30T18:00:52.278972] [DEBUG] [LOCAL ] CMS: Primary data saved (52610 records). [2025-09-30T18:00:52.279145] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-30T18:00:52.279234] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMS took 36.1s. Estimated remaining: 3h 57m 42s. Rate: 7.9 symbols/min [2025-09-30T18:00:52.488364] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:52.497633] [DEBUG] [LOCAL ] CMU: Loaded 7024 existing records from primary storage. [2025-09-30T18:00:52.497956] [INFO ] [MAIN ] CMU: Loaded 7024 existing records. [2025-09-30T18:00:52.697582] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:52.697857] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-30T18:00:52.697906] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-30T18:00:52.698088] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-30T18:00:52.698147] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-30T18:00:53.064607] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-30T18:00:53.092707] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:00:53.105522] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:00:53.149384] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:53.854401] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-30T18:00:54.654352] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-30T18:00:54.703309] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:00:54.705569] [INFO ] [REMOTE ] CMSD: Full fetch complete (12448 records). [2025-09-30T18:00:54.705677] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-30T18:00:54.940443] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:00:55.177233] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-30T18:00:55.177334] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-30T18:00:55.177709] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-30T18:00:55.177780] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-30T18:00:55.178599] [DEBUG] [LOCAL ] CMSD: Trimmed 12448 records to 8092 (keeping 200 days of data) [2025-09-30T18:00:55.232098] [DEBUG] [LOCAL ] CMSD: Primary data saved (8092 records). [2025-09-30T18:00:55.232252] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-30T18:00:55.232434] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 22.4s. Estimated remaining: 3h 57m 17s. Rate: 8.0 symbols/min [2025-09-30T18:00:55.349240] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T18:00:55.430921] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:55.461717] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-30T18:00:55.464447] [DEBUG] [LOCAL ] CNA: Loaded 32662 existing records from primary storage. [2025-09-30T18:00:55.464855] [INFO ] [MAIN ] CNA: Loaded 32662 existing records. [2025-09-30T18:00:55.663607] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:55.663842] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-30T18:00:55.663891] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-30T18:00:55.664158] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-30T18:00:55.664217] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-30T18:00:56.050999] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:56.254411] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-30T18:00:56.379664] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T18:00:57.054373] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-30T18:00:57.517699] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:00:57.628128] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:00:57.854406] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-30T18:00:58.654387] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-30T18:00:59.331242] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T18:00:59.454377] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-30T18:00:59.841587] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:01:00.254359] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-30T18:01:00.658192] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:01:01.054392] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-30T18:01:01.551791] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:01:01.558914] [INFO ] [REMOTE ] CMRE: Full fetch complete (49663 records). [2025-09-30T18:01:01.559038] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-30T18:01:01.559776] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:01:01.559896] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:01:01.559943] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:01:01.560035] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-30T18:01:01.560105] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-09-30T18:01:01.560144] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-09-30T18:01:01.560419] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-09-30T18:01:01.560517] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMRE took 45.3s. Estimated remaining: 3h 57m 5s. Rate: 8.0 symbols/min [2025-09-30T18:01:01.763715] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:01.827703] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-09-30T18:01:01.828176] [INFO ] [MAIN ] CNC: Loaded 53739 existing records. [2025-09-30T18:01:01.863247] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-30T18:01:02.003805] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:01:02.046692] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:02.046908] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-30T18:01:02.046958] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-30T18:01:02.047469] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-30T18:01:02.047739] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-30T18:01:02.432088] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:02.654378] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-30T18:01:03.362334] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:01:03.454362] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-30T18:01:03.541865] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T18:01:04.254381] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-30T18:01:04.796185] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T18:01:05.054359] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-30T18:01:05.854339] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-30T18:01:05.931637] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:01:06.375026] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:01:06.654333] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-30T18:01:06.785807] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T18:01:07.454378] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-30T18:01:08.254321] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-30T18:01:08.384011] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:01:08.867851] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:01:08.868632] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:01:09.054357] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-30T18:01:09.854360] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-30T18:01:10.654365] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-30T18:01:10.724823] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T18:01:10.732073] [INFO ] [REMOTE ] CMTG: Full fetch complete (53440 records). [2025-09-30T18:01:10.732198] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-30T18:01:11.145665] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-30T18:01:11.145783] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-30T18:01:11.146514] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-30T18:01:11.146579] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-30T18:01:11.147767] [DEBUG] [LOCAL ] CMTG: Trimmed 53440 records to 36969 (keeping 200 days of data) [2025-09-30T18:01:11.378844] [DEBUG] [LOCAL ] CMTG: Primary data saved (36969 records). [2025-09-30T18:01:11.379046] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-30T18:01:11.379774] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 34.0s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-09-30T18:01:11.459697] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-30T18:01:11.566061] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:11.580439] [DEBUG] [LOCAL ] CNF: Loaded 11068 existing records from primary storage. [2025-09-30T18:01:11.580712] [INFO ] [MAIN ] CNF: Loaded 11068 existing records. [2025-09-30T18:01:11.713323] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:01:11.840763] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:11.842933] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T18:01:11.852896] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-30T18:01:11.853513] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-30T18:01:11.854112] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-30T18:01:11.854174] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-30T18:01:12.230864] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:12.254363] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-30T18:01:12.899514] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:01:13.054365] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-30T18:01:13.854362] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-30T18:01:14.077846] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:01:14.363552] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:01:14.441347] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T18:01:14.654350] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-30T18:01:15.454390] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-30T18:01:16.086630] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T18:01:16.254379] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-30T18:01:17.054343] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-30T18:01:17.143856] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-30T18:01:17.854371] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-30T18:01:18.267887] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T18:01:18.297536] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T18:01:18.654403] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-30T18:01:19.076466] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-30T18:01:19.454385] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-30T18:01:20.254379] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-30T18:01:20.557188] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T18:01:20.559792] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:01:20.562537] [INFO ] [REMOTE ] CMU: Full fetch complete (9646 records). [2025-09-30T18:01:20.574939] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-30T18:01:20.989978] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-30T18:01:20.990063] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-30T18:01:20.990338] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-30T18:01:20.990382] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-30T18:01:20.990986] [DEBUG] [LOCAL ] CMU: Trimmed 9646 records to 6938 (keeping 200 days of data) [2025-09-30T18:01:21.034378] [DEBUG] [LOCAL ] CMU: Primary data saved (6938 records). [2025-09-30T18:01:21.034510] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-30T18:01:21.034593] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 28.8s. Estimated remaining: 3h 57m 6s. Rate: 7.9 symbols/min [2025-09-30T18:01:21.059482] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-30T18:01:21.229577] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:21.290392] [DEBUG] [LOCAL ] CNH: Loaded 53557 existing records from primary storage. [2025-09-30T18:01:21.290796] [INFO ] [MAIN ] CNH: Loaded 53557 existing records. [2025-09-30T18:01:21.487992] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:21.488268] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-30T18:01:21.488334] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-30T18:01:21.489038] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-30T18:01:21.489100] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-30T18:01:21.869176] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-30T18:01:21.914991] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:21.939958] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:01:22.654328] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-30T18:01:22.748150] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T18:01:22.847136] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:01:23.454399] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-30T18:01:24.055841] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T18:01:24.184958] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:01:24.254355] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-30T18:01:25.054358] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-30T18:01:25.761456] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:01:25.854364] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-30T18:01:26.654364] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-30T18:01:26.697731] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T18:01:26.991467] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-30T18:01:27.454409] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-30T18:01:27.947396] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:01:28.234255] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:01:28.254319] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-30T18:01:28.938730] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T18:01:29.054422] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-30T18:01:29.854394] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-30T18:01:30.654371] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-30T18:01:30.956129] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:01:31.454370] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-30T18:01:31.682819] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:01:31.686769] [INFO ] [REMOTE ] CNF: Full fetch complete (12963 records). [2025-09-30T18:01:31.686895] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-30T18:01:32.112434] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-30T18:01:32.112751] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-30T18:01:32.113144] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-30T18:01:32.113240] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-30T18:01:32.114305] [DEBUG] [LOCAL ] CNF: Trimmed 12963 records to 10899 (keeping 200 days of data) [2025-09-30T18:01:32.183874] [DEBUG] [LOCAL ] CNF: Primary data saved (10899 records). [2025-09-30T18:01:32.184058] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-30T18:01:32.184188] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 20.8s. Estimated remaining: 3h 57m 13s. Rate: 7.9 symbols/min [2025-09-30T18:01:32.259190] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-30T18:01:32.397208] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:32.446698] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-30T18:01:32.514499] [DEBUG] [LOCAL ] CNI: Loaded 51653 existing records from primary storage. [2025-09-30T18:01:32.514990] [INFO ] [MAIN ] CNI: Loaded 51653 existing records. [2025-09-30T18:01:32.786776] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:32.788419] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-30T18:01:32.788482] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-30T18:01:32.788953] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-30T18:01:32.789053] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-30T18:01:33.030892] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:01:33.059297] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-30T18:01:33.438304] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:33.784017] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:01:33.790865] [INFO ] [REMOTE ] CNA: Full fetch complete (45309 records). [2025-09-30T18:01:33.791000] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-30T18:01:33.791724] [FATAL] [VALIDATOR ] CNA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:01:33.791811] [FATAL] [MAIN ] CNA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:01:33.791855] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:01:33.791925] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-30T18:01:33.792014] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-09-30T18:01:33.792074] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-09-30T18:01:33.792293] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-09-30T18:01:33.792387] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 38.6s. Estimated remaining: 3h 56m 42s. Rate: 8.0 symbols/min [2025-09-30T18:01:33.862812] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-30T18:01:33.986282] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:34.050732] [DEBUG] [LOCAL ] CNK: Loaded 52880 existing records from primary storage. [2025-09-30T18:01:34.051128] [INFO ] [MAIN ] CNK: Loaded 52880 existing records. [2025-09-30T18:01:34.266407] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:34.266629] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-30T18:01:34.266726] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-30T18:01:34.267323] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-30T18:01:34.267386] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-30T18:01:34.658844] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-30T18:01:34.685019] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:35.402520] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T18:01:35.415532] [INFO ] [REMOTE ] CNC: Full fetch complete (77675 records). [2025-09-30T18:01:35.415937] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-30T18:01:35.464711] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-30T18:01:35.917990] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-30T18:01:35.918185] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-30T18:01:35.919264] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-30T18:01:35.919364] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-30T18:01:35.922889] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-30T18:01:35.936078] [DEBUG] [LOCAL ] CNC: Trimmed 77675 records to 53740 (keeping 200 days of data) [2025-09-30T18:01:36.258165] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-30T18:01:36.286424] [DEBUG] [LOCAL ] CNC: Primary data saved (53740 records). [2025-09-30T18:01:36.286957] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-30T18:01:36.287062] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 34.7s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-09-30T18:01:36.487579] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:36.545380] [DEBUG] [LOCAL ] CNM: Loaded 50973 existing records from primary storage. [2025-09-30T18:01:36.545871] [INFO ] [MAIN ] CNM: Loaded 50973 existing records. [2025-09-30T18:01:36.762870] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:36.763458] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-30T18:01:36.763560] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-30T18:01:36.764137] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-30T18:01:36.795004] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-30T18:01:36.862075] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-30T18:01:37.059442] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-30T18:01:37.228927] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:37.353510] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:01:37.854352] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-30T18:01:38.107349] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:01:38.654344] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-30T18:01:38.924205] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T18:01:39.454375] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-30T18:01:39.714216] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:01:40.254353] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-30T18:01:40.417827] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:01:41.054389] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-30T18:01:41.437666] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T18:01:41.854320] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-30T18:01:42.200899] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:01:42.404845] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:01:42.654379] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-30T18:01:43.378132] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:01:43.454408] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-30T18:01:44.231921] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:01:44.254337] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-30T18:01:45.054369] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-30T18:01:45.117511] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:01:45.575612] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:01:45.854371] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-30T18:01:46.659485] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-30T18:01:46.678509] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:01:47.454376] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-30T18:01:47.520997] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:01:48.254331] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-30T18:01:48.525917] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T18:01:49.054358] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-30T18:01:49.309946] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:01:49.854340] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-30T18:01:50.108810] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:01:50.655145] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:01:50.655226] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-30T18:01:51.454410] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-30T18:01:51.971742] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:01:52.263625] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-30T18:01:52.270699] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T18:01:53.054333] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-30T18:01:53.109721] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:01:53.854401] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-30T18:01:53.898549] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T18:01:54.599111] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:01:54.654371] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-30T18:01:55.454374] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-30T18:01:55.751956] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:01:56.254446] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-30T18:01:56.501956] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T18:01:56.816503] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:01:57.054428] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-30T18:01:57.854392] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-30T18:01:58.094930] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T18:01:58.654361] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-30T18:01:58.847836] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:01:59.454395] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-30T18:01:59.705534] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:01:59.718868] [INFO ] [REMOTE ] CNH: Full fetch complete (77533 records). [2025-09-30T18:01:59.719099] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-30T18:02:00.204824] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-30T18:02:00.205015] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-30T18:02:00.206279] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-30T18:02:00.206527] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-30T18:02:00.208501] [DEBUG] [LOCAL ] CNH: Trimmed 77533 records to 53555 (keeping 200 days of data) [2025-09-30T18:02:00.270486] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-30T18:02:00.401835] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T18:02:00.693542] [DEBUG] [LOCAL ] CNH: Primary data saved (53555 records). [2025-09-30T18:02:00.693723] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-30T18:02:00.693928] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNH took 39.7s. Estimated remaining: 3h 57m 12s. Rate: 7.9 symbols/min [2025-09-30T18:02:00.877295] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:00.877559] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-09-30T18:02:00.877616] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-09-30T18:02:00.877788] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-30T18:02:00.877852] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-30T18:02:00.877919] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-09-30T18:02:00.877976] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-30T18:02:01.056693] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-30T18:02:01.256191] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:01.293307] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:02:01.854361] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-30T18:02:02.089136] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:02:02.654455] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-30T18:02:02.964869] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:02:02.976708] [INFO ] [REMOTE ] CNK: Full fetch complete (75738 records). [2025-09-30T18:02:02.976876] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-30T18:02:03.405262] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-30T18:02:03.405347] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-30T18:02:03.406161] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-30T18:02:03.406227] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-30T18:02:03.407752] [DEBUG] [LOCAL ] CNK: Trimmed 75738 records to 52880 (keeping 200 days of data) [2025-09-30T18:02:03.492293] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-30T18:02:03.941151] [DEBUG] [LOCAL ] CNK: Primary data saved (52880 records). [2025-09-30T18:02:03.941329] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-30T18:02:03.941524] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNK took 30.1s. Estimated remaining: 3h 56m 48s. Rate: 7.9 symbols/min [2025-09-30T18:02:04.137614] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:04.205366] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-30T18:02:04.203572] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:02:04.228987] [INFO ] [REMOTE ] CNI: Full fetch complete (74657 records). [2025-09-30T18:02:04.229603] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-30T18:02:04.264964] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-30T18:02:04.417483] [DEBUG] [LOCAL ] CNNE: Loaded 36466 existing records from primary storage. [2025-09-30T18:02:04.429466] [INFO ] [MAIN ] CNNE: Loaded 36466 existing records. [2025-09-30T18:02:04.851978] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:04.873302] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-30T18:02:04.913857] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-30T18:02:04.918447] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-30T18:02:04.918584] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-30T18:02:04.918784] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-30T18:02:04.919065] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-30T18:02:04.933114] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-30T18:02:04.960467] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-30T18:02:05.050561] [DEBUG] [LOCAL ] CNI: Trimmed 74657 records to 51650 (keeping 200 days of data) [2025-09-30T18:02:05.115106] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:02:05.122446] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-30T18:02:05.478381] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:05.745781] [DEBUG] [LOCAL ] CNI: Primary data saved (51650 records). [2025-09-30T18:02:05.746037] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-30T18:02:05.747142] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNI took 33.6s. Estimated remaining: 3h 56m 19s. Rate: 7.9 symbols/min [2025-09-30T18:02:05.859482] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-30T18:02:05.945889] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:05.997614] [DEBUG] [LOCAL ] CNO: Loaded 41180 existing records from primary storage. [2025-09-30T18:02:05.997962] [INFO ] [MAIN ] CNO: Loaded 41180 existing records. [2025-09-30T18:02:06.218784] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:06.219077] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-30T18:02:06.219146] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-30T18:02:06.220182] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-30T18:02:06.220408] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-30T18:02:06.376404] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:02:06.446791] [INFO ] [REMOTE ] CNM: Full fetch complete (73630 records). [2025-09-30T18:02:06.492016] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-30T18:02:06.798047] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:06.819930] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-30T18:02:07.042293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:02:07.171867] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T18:02:07.170964] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-30T18:02:07.172000] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-30T18:02:07.178907] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-30T18:02:07.179056] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-30T18:02:07.180480] [DEBUG] [LOCAL ] CNM: Trimmed 73630 records to 50981 (keeping 200 days of data) [2025-09-30T18:02:07.463183] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-30T18:02:07.508250] [DEBUG] [LOCAL ] CNM: Primary data saved (50981 records). [2025-09-30T18:02:07.508411] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-30T18:02:07.508530] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 31.2s. Estimated remaining: 3h 55m 49s. Rate: 8.0 symbols/min [2025-09-30T18:02:07.705286] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:07.763803] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-30T18:02:07.764156] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-30T18:02:07.964854] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:07.965122] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-30T18:02:07.965186] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-30T18:02:07.965607] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-30T18:02:07.965726] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-30T18:02:08.258192] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-30T18:02:08.395853] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:08.597579] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:02:08.651503] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:02:09.054536] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-30T18:02:09.703838] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:02:09.854318] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-30T18:02:10.249842] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T18:02:10.654376] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-30T18:02:11.341871] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:02:11.454390] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-30T18:02:12.142573] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:02:12.254372] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-30T18:02:13.054331] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-30T18:02:13.319711] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:02:13.429348] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:02:13.854379] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-30T18:02:14.654335] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-30T18:02:14.908384] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:02:15.454360] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-30T18:02:15.661871] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:02:16.254434] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-30T18:02:16.403581] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:02:17.044980] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:02:17.054819] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-30T18:02:17.570353] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:02:17.854386] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-30T18:02:18.660639] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-30T18:02:18.681397] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:02:19.115774] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T18:02:19.454361] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-30T18:02:20.254388] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-30T18:02:20.388046] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:02:21.054422] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-30T18:02:21.223867] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:02:21.288797] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:02:21.854412] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-30T18:02:22.295140] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:02:22.654382] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-30T18:02:23.454338] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-30T18:02:23.867103] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T18:02:24.198869] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:02:24.254334] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-30T18:02:24.476687] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T18:02:25.054446] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-30T18:02:25.691865] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:02:25.854414] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-30T18:02:26.115037] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:02:26.654413] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-30T18:02:27.454409] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-30T18:02:27.686713] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:02:28.027121] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:02:28.254376] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-30T18:02:28.861955] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T18:02:28.868660] [INFO ] [REMOTE ] CNMD: Full fetch complete (47242 records). [2025-09-30T18:02:28.868781] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-30T18:02:29.061144] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-30T18:02:29.283675] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-30T18:02:29.283997] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-30T18:02:29.284674] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-30T18:02:29.284738] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-30T18:02:29.288626] [DEBUG] [LOCAL ] CNMD: Trimmed 47242 records to 32253 (keeping 200 days of data) [2025-09-30T18:02:29.496293] [DEBUG] [LOCAL ] CNMD: Primary data saved (32253 records). [2025-09-30T18:02:29.496439] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-30T18:02:29.496519] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 28.8s. Estimated remaining: 3h 56m 37s. Rate: 7.9 symbols/min [2025-09-30T18:02:29.683688] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:29.683996] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-09-30T18:02:29.684107] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-09-30T18:02:29.684292] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-30T18:02:29.684336] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-30T18:02:29.684383] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-30T18:02:29.684425] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-30T18:02:29.873077] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-30T18:02:30.103438] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:30.127601] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:02:30.654359] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-30T18:02:30.799907] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:02:31.454373] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-30T18:02:31.677933] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:02:32.146088] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:02:32.153724] [INFO ] [REMOTE ] CNNE: Full fetch complete (49390 records). [2025-09-30T18:02:32.153848] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-30T18:02:32.154440] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:02:32.154528] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:02:32.154571] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:02:32.154638] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-30T18:02:32.154768] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-09-30T18:02:32.154845] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-09-30T18:02:32.155281] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-09-30T18:02:32.155407] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 28.2s. Estimated remaining: 3h 56m 10s. Rate: 7.9 symbols/min [2025-09-30T18:02:32.259485] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-30T18:02:32.338796] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:32.338995] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-30T18:02:32.339034] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-30T18:02:32.339148] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-30T18:02:32.339188] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-30T18:02:32.339230] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-30T18:02:32.339262] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-30T18:02:32.741939] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:32.972394] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T18:02:33.054372] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-30T18:02:33.854358] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-30T18:02:34.057165] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:02:34.057498] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-30T18:02:34.057589] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:02:34.057665] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-30T18:02:34.057735] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:02:34.057815] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-30T18:02:34.057917] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-30T18:02:34.058006] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-30T18:02:34.058070] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-30T18:02:34.058124] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 1.9s. Estimated remaining: 3h 55m 42s. Rate: 8.0 symbols/min [2025-09-30T18:02:34.285181] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:34.336770] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:02:34.381219] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:02:34.410128] [DEBUG] [LOCAL ] CNS: Loaded 20650 existing records from primary storage. [2025-09-30T18:02:34.410499] [INFO ] [MAIN ] CNS: Loaded 20650 existing records. [2025-09-30T18:02:34.647880] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:34.648103] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-30T18:02:34.648151] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-30T18:02:34.648507] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-30T18:02:34.648568] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-30T18:02:34.660180] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-30T18:02:35.080340] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:35.454402] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-30T18:02:36.254408] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-30T18:02:36.345381] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T18:02:36.652670] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:02:37.054408] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-30T18:02:37.854351] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-30T18:02:38.021246] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T18:02:38.192297] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:02:38.201440] [INFO ] [REMOTE ] CNO: Full fetch complete (60321 records). [2025-09-30T18:02:38.201571] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-30T18:02:38.202526] [FATAL] [VALIDATOR ] CNO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:02:38.202624] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:02:38.202710] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:02:38.202784] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-30T18:02:38.202853] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-09-30T18:02:38.202940] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-09-30T18:02:38.203218] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-09-30T18:02:38.203794] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 32.5s. Estimated remaining: 3h 55m 21s. Rate: 8.0 symbols/min [2025-09-30T18:02:38.396769] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:38.457043] [DEBUG] [LOCAL ] CNX: Loaded 51375 existing records from primary storage. [2025-09-30T18:02:38.457398] [INFO ] [MAIN ] CNX: Loaded 51375 existing records. [2025-09-30T18:02:38.654205] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:38.654354] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-30T18:02:38.655489] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-30T18:02:38.655560] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-30T18:02:38.656009] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-30T18:02:38.656071] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-30T18:02:39.097887] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:02:39.105920] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:39.454373] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-30T18:02:40.254386] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-30T18:02:40.433605] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T18:02:41.054373] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-30T18:02:41.211292] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:02:41.854399] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-30T18:02:42.015454] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T18:02:42.654401] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-30T18:02:43.036522] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:02:43.048995] [INFO ] [REMOTE ] CNP: Full fetch complete (77369 records). [2025-09-30T18:02:43.049176] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-30T18:02:43.455573] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-30T18:02:43.507873] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-30T18:02:43.508251] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-30T18:02:43.509558] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-30T18:02:43.509914] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-30T18:02:43.541625] [DEBUG] [LOCAL ] CNP: Trimmed 77369 records to 53469 (keeping 200 days of data) [2025-09-30T18:02:43.545827] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:02:43.673099] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:02:43.934243] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-30T18:02:43.934399] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-30T18:02:43.934487] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 36.4s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-09-30T18:02:44.137367] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:44.186997] [DEBUG] [LOCAL ] CODI: Loaded 39820 existing records from primary storage. [2025-09-30T18:02:44.187358] [INFO ] [MAIN ] CODI: Loaded 39820 existing records. [2025-09-30T18:02:44.259441] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-30T18:02:44.411459] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:44.411743] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-30T18:02:44.411799] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-30T18:02:44.412205] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-30T18:02:44.412300] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-30T18:02:44.868720] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:45.054402] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-30T18:02:45.681434] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-30T18:02:45.854327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-30T18:02:45.962417] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:02:46.158119] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:02:46.654394] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-30T18:02:47.454416] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-30T18:02:47.609758] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:02:48.254353] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-30T18:02:48.357158] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:02:48.426711] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:02:49.054418] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-30T18:02:49.302881] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:02:49.854369] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-30T18:02:50.616364] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:02:50.654390] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-30T18:02:50.871917] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:02:51.454356] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-30T18:02:52.254495] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-30T18:02:52.304581] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:02:52.816890] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:02:53.054408] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-30T18:02:53.348578] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:02:53.854369] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-30T18:02:54.113118] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T18:02:54.654364] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-30T18:02:54.916087] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:02:55.454358] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-30T18:02:56.254435] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-30T18:02:56.564089] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:02:56.598313] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:02:57.054314] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-30T18:02:57.147903] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T18:02:57.854320] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-30T18:02:58.091128] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:02:58.654354] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-30T18:02:59.183553] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T18:02:59.454399] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-30T18:03:00.254352] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-30T18:03:00.450087] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:03:01.054589] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-30T18:03:01.279370] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:03:01.284740] [INFO ] [REMOTE ] CNS: Full fetch complete (30134 records). [2025-09-30T18:03:01.284890] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-30T18:03:01.726774] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-30T18:03:01.726885] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-30T18:03:01.727613] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-30T18:03:01.727757] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-30T18:03:01.728769] [DEBUG] [LOCAL ] CNS: Trimmed 30134 records to 20624 (keeping 200 days of data) [2025-09-30T18:03:01.857687] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-30T18:03:01.862583] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:03:01.910375] [DEBUG] [LOCAL ] CNS: Primary data saved (20624 records). [2025-09-30T18:03:01.910521] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-30T18:03:01.910609] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 27.9s. Estimated remaining: 3h 55m 38s. Rate: 7.9 symbols/min [2025-09-30T18:03:02.107443] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:02.171942] [DEBUG] [LOCAL ] COF: Loaded 53608 existing records from primary storage. [2025-09-30T18:03:02.172354] [INFO ] [MAIN ] COF: Loaded 53608 existing records. [2025-09-30T18:03:02.372160] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:02.372436] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-30T18:03:02.372496] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-30T18:03:02.372980] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-30T18:03:02.373042] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-30T18:03:02.654714] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-30T18:03:02.800412] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:02.861616] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T18:03:03.454357] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-30T18:03:03.946299] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T18:03:03.958707] [INFO ] [REMOTE ] CNQ: Full fetch complete (77553 records). [2025-09-30T18:03:03.958884] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-30T18:03:04.259494] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-30T18:03:04.450432] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-30T18:03:04.450809] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-30T18:03:04.451750] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-30T18:03:04.451930] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-30T18:03:04.468817] [DEBUG] [LOCAL ] CNQ: Trimmed 77553 records to 53581 (keeping 200 days of data) [2025-09-30T18:03:04.483535] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T18:03:04.844054] [DEBUG] [LOCAL ] CNQ: Primary data saved (53581 records). [2025-09-30T18:03:04.844236] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-30T18:03:04.844314] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNQ took 35.3s. Estimated remaining: 3h 55m 14s. Rate: 7.9 symbols/min [2025-09-30T18:03:05.036582] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:05.067270] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-30T18:03:05.090266] [DEBUG] [LOCAL ] COHR: Loaded 53363 existing records from primary storage. [2025-09-30T18:03:05.090637] [INFO ] [MAIN ] COHR: Loaded 53363 existing records. [2025-09-30T18:03:05.285783] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:05.286071] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-30T18:03:05.286224] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-30T18:03:05.286593] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-30T18:03:05.286703] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-30T18:03:05.586928] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-30T18:03:05.735695] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:05.854336] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-30T18:03:05.957222] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:03:06.654355] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-30T18:03:06.763484] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T18:03:07.454419] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-30T18:03:07.935532] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:03:08.254376] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-30T18:03:08.424130] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:08.657924] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:03:09.054373] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-30T18:03:09.870032] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-30T18:03:09.895205] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T18:03:10.654374] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-30T18:03:11.079690] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T18:03:11.338413] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:03:11.346444] [INFO ] [REMOTE ] CODI: Full fetch complete (50821 records). [2025-09-30T18:03:11.346582] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-30T18:03:11.459578] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-30T18:03:11.763797] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-30T18:03:11.763875] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-30T18:03:11.764479] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-30T18:03:11.764521] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-30T18:03:11.765567] [DEBUG] [LOCAL ] CODI: Trimmed 50821 records to 39921 (keeping 200 days of data) [2025-09-30T18:03:12.001777] [DEBUG] [LOCAL ] CODI: Primary data saved (39921 records). [2025-09-30T18:03:12.002024] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-30T18:03:12.002126] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 28.1s. Estimated remaining: 3h 55m 5s. Rate: 8.0 symbols/min [2025-09-30T18:03:12.191796] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:12.247518] [DEBUG] [LOCAL ] COLD: Loaded 52032 existing records from primary storage. [2025-09-30T18:03:12.247991] [INFO ] [MAIN ] COLD: Loaded 52032 existing records. [2025-09-30T18:03:12.259832] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-30T18:03:12.445169] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:12.445729] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-30T18:03:12.445866] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-30T18:03:12.446337] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-30T18:03:12.446402] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-30T18:03:12.674204] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T18:03:12.881545] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:13.054404] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-30T18:03:13.429884] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:03:13.854465] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-30T18:03:14.163550] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:03:14.654434] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-30T18:03:15.176600] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T18:03:15.416127] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:03:15.454397] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-30T18:03:16.254424] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-30T18:03:16.502395] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:03:16.513156] [INFO ] [REMOTE ] CNX: Full fetch complete (74392 records). [2025-09-30T18:03:16.513344] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-30T18:03:16.514286] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:16.514399] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:16.514443] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:16.514486] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-30T18:03:16.514561] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-09-30T18:03:16.514628] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-09-30T18:03:16.515001] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-09-30T18:03:16.515332] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 38.3s. Estimated remaining: 3h 54m 46s. Rate: 8.0 symbols/min [2025-09-30T18:03:16.701114] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:16.701288] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-09-30T18:03:16.701325] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-09-30T18:03:16.701441] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-30T18:03:16.701481] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-30T18:03:16.701521] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-30T18:03:16.701552] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-30T18:03:17.066987] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-30T18:03:17.104368] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:17.134248] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:03:17.854357] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-30T18:03:18.356553] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:03:18.654339] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-30T18:03:18.975359] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T18:03:19.097399] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T18:03:19.454426] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-30T18:03:20.254357] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-30T18:03:20.593263] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T18:03:21.054394] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-30T18:03:21.371978] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:03:21.742464] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T18:03:21.854378] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-30T18:03:22.654345] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-30T18:03:22.948058] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:03:23.454415] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-30T18:03:23.726844] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:03:24.254341] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-30T18:03:24.384637] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:03:25.054326] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-30T18:03:25.626440] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-30T18:03:25.826533] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:03:25.854319] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-30T18:03:26.654406] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-30T18:03:26.776841] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:03:27.454364] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-30T18:03:27.745097] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:03:28.254332] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-30T18:03:28.452282] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:03:29.054391] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-30T18:03:29.290661] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T18:03:29.854396] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-30T18:03:30.020990] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:30.654400] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-30T18:03:31.087921] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:03:31.099172] [INFO ] [REMOTE ] COF: Full fetch complete (77019 records). [2025-09-30T18:03:31.099341] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-30T18:03:31.100287] [FATAL] [VALIDATOR ] COF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:31.100386] [FATAL] [MAIN ] COF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:31.100429] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:31.100496] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-30T18:03:31.100595] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-09-30T18:03:31.100674] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-09-30T18:03:31.100863] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-09-30T18:03:31.100959] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 29.2s. Estimated remaining: 3h 55m 4s. Rate: 7.9 symbols/min [2025-09-30T18:03:31.293774] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:31.334702] [DEBUG] [LOCAL ] CON: Loaded 38727 existing records from primary storage. [2025-09-30T18:03:31.335037] [INFO ] [MAIN ] CON: Loaded 38727 existing records. [2025-09-30T18:03:31.456156] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-30T18:03:31.535790] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:31.536769] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-30T18:03:31.536981] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-30T18:03:31.537373] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-30T18:03:31.537443] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-30T18:03:31.926696] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:03:32.023257] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:32.254368] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-30T18:03:32.434096] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:03:33.054392] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-30T18:03:33.648273] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-30T18:03:33.854432] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-30T18:03:34.283298] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T18:03:34.654442] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-30T18:03:34.812114] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:03:35.454394] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-30T18:03:36.151605] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T18:03:36.254355] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-30T18:03:36.392191] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:03:37.054377] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-30T18:03:37.221897] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:03:37.802850] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:03:37.854319] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-30T18:03:38.654326] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-30T18:03:38.822401] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:39.410962] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:03:39.454336] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-30T18:03:40.254364] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-30T18:03:40.347815] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:03:40.863553] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:03:41.054368] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-30T18:03:41.854372] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-30T18:03:42.654371] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-30T18:03:42.742917] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-30T18:03:42.755220] [INFO ] [REMOTE ] COHR: Full fetch complete (77111 records). [2025-09-30T18:03:42.755399] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-30T18:03:43.096252] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T18:03:43.241893] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-30T18:03:43.241995] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-30T18:03:43.242898] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-30T18:03:43.242977] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-30T18:03:43.244519] [DEBUG] [LOCAL ] COHR: Trimmed 77111 records to 53362 (keeping 200 days of data) [2025-09-30T18:03:43.468271] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-30T18:03:43.594331] [DEBUG] [LOCAL ] COHR: Primary data saved (53362 records). [2025-09-30T18:03:43.595062] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-30T18:03:43.595398] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 38.8s. Estimated remaining: 3h 55m 15s. Rate: 7.9 symbols/min [2025-09-30T18:03:43.801381] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:43.839413] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:03:43.877155] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:03:43.904949] [DEBUG] [LOCAL ] COOK: Loaded 24365 existing records from primary storage. [2025-09-30T18:03:43.905262] [INFO ] [MAIN ] COOK: Loaded 24365 existing records. [2025-09-30T18:03:44.123273] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:44.123551] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-30T18:03:44.123607] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-30T18:03:44.124205] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-30T18:03:44.124290] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-30T18:03:44.259568] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-30T18:03:44.543243] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:45.054333] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-30T18:03:45.315775] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:03:45.328894] [INFO ] [REMOTE ] COMP: Full fetch complete (76737 records). [2025-09-30T18:03:45.329073] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-30T18:03:45.333520] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:45.333627] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:45.333714] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:45.333791] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-30T18:03:45.333886] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-30T18:03:45.333955] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-09-30T18:03:45.334027] [DEBUG] [LOCAL ] COMP: No derivative data file found to delete. [2025-09-30T18:03:45.334114] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COMP took 28.8s. Estimated remaining: 3h 54m 46s. Rate: 7.9 symbols/min [2025-09-30T18:03:45.529549] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:45.602466] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-30T18:03:45.602828] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-30T18:03:45.781248] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:03:45.827669] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:45.827843] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-30T18:03:45.827892] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-30T18:03:45.828579] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-30T18:03:45.828640] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-30T18:03:45.861490] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-30T18:03:46.222208] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:46.356815] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T18:03:46.654362] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-30T18:03:47.454391] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-30T18:03:47.677312] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:03:47.777451] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:03:47.793537] [INFO ] [REMOTE ] COLD: Full fetch complete (74208 records). [2025-09-30T18:03:47.793816] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-30T18:03:48.226743] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-30T18:03:48.226879] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-30T18:03:48.227756] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-30T18:03:48.227833] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-30T18:03:48.229531] [DEBUG] [LOCAL ] COLD: Trimmed 74208 records to 52066 (keeping 200 days of data) [2025-09-30T18:03:48.292826] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-30T18:03:48.567009] [DEBUG] [LOCAL ] COLD: Primary data saved (52066 records). [2025-09-30T18:03:48.567152] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-30T18:03:48.567258] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 36.6s. Estimated remaining: 3h 54m 23s. Rate: 8.0 symbols/min [2025-09-30T18:03:48.776664] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:48.847510] [DEBUG] [LOCAL ] COR: Loaded 47081 existing records from primary storage. [2025-09-30T18:03:48.847983] [INFO ] [MAIN ] COR: Loaded 47081 existing records. [2025-09-30T18:03:49.060574] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-30T18:03:49.087111] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:49.087610] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-30T18:03:49.087732] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-30T18:03:49.088285] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-30T18:03:49.088348] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-30T18:03:49.468517] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:49.585217] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-30T18:03:49.754595] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:03:49.813510] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:03:49.854357] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-30T18:03:50.654366] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-30T18:03:51.396897] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:03:51.454393] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-30T18:03:51.727450] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T18:03:52.254363] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-30T18:03:52.758261] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:03:53.054369] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-30T18:03:53.393308] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:03:53.854373] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-30T18:03:54.654369] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-30T18:03:55.035207] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:03:55.044890] [INFO ] [REMOTE ] CON: Full fetch complete (56908 records). [2025-09-30T18:03:55.045045] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-30T18:03:55.451220] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-30T18:03:55.451315] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-30T18:03:55.452071] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-30T18:03:55.452149] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-30T18:03:55.453840] [DEBUG] [LOCAL ] CON: Trimmed 56908 records to 38743 (keeping 200 days of data) [2025-09-30T18:03:55.454365] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-30T18:03:55.708090] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:03:55.753484] [DEBUG] [LOCAL ] CON: Primary data saved (38743 records). [2025-09-30T18:03:55.753681] [INFO ] [MAIN ] CON: Full history saved. [2025-09-30T18:03:55.753820] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 24.7s. Estimated remaining: 3h 54m 14s. Rate: 8.0 symbols/min [2025-09-30T18:03:55.936200] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:56.027680] [DEBUG] [LOCAL ] COTY: Loaded 53223 existing records from primary storage. [2025-09-30T18:03:56.037291] [INFO ] [MAIN ] COTY: Loaded 53223 existing records. [2025-09-30T18:03:56.043942] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:03:56.249597] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:56.249902] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-30T18:03:56.249951] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-30T18:03:56.250538] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-30T18:03:56.250600] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-30T18:03:56.262483] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-30T18:03:56.645527] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:03:56.691630] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:57.054383] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-30T18:03:57.854332] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-30T18:03:58.117407] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:03:58.654390] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-30T18:03:58.972176] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:03:59.032362] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:03:59.454369] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-30T18:04:00.263670] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-30T18:04:00.282330] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:04:01.054359] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-30T18:04:01.582848] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T18:04:01.854369] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-30T18:04:02.021566] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:04:02.659997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-30T18:04:02.662587] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:04:02.782821] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:04:03.454361] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-30T18:04:04.254342] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-30T18:04:04.338866] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:04:05.054362] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-30T18:04:05.122020] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:04:05.377434] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:04:05.854362] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-30T18:04:06.545756] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:04:06.654387] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-30T18:04:07.253549] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:04:07.259591] [INFO ] [REMOTE ] COOK: Full fetch complete (32718 records). [2025-09-30T18:04:07.259745] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-30T18:04:07.460973] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-30T18:04:07.703478] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-30T18:04:07.703624] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-30T18:04:07.704174] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-30T18:04:07.704221] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-30T18:04:07.705238] [DEBUG] [LOCAL ] COOK: Trimmed 32718 records to 24364 (keeping 200 days of data) [2025-09-30T18:04:07.847074] [DEBUG] [LOCAL ] COOK: Primary data saved (24364 records). [2025-09-30T18:04:07.847220] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-30T18:04:07.847303] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 24.3s. Estimated remaining: 3h 54m 23s. Rate: 7.9 symbols/min [2025-09-30T18:04:08.026795] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:08.027073] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-09-30T18:04:08.027128] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-09-30T18:04:08.027205] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-30T18:04:08.027242] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-30T18:04:08.027284] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-30T18:04:08.027318] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-30T18:04:08.265096] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-30T18:04:08.430996] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:08.464660] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:04:09.054339] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-30T18:04:09.293423] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:04:09.854372] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-30T18:04:10.425971] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T18:04:10.654378] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-30T18:04:10.876944] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:04:11.412035] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T18:04:11.454407] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-30T18:04:12.254413] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-30T18:04:12.772771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T18:04:12.850873] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:04:13.054377] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-30T18:04:13.854367] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-30T18:04:13.985928] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:04:14.654392] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-30T18:04:14.783457] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:04:15.425317] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:04:15.454310] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-30T18:04:16.254388] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-30T18:04:16.538009] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:04:17.054370] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-30T18:04:17.226259] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:04:17.854333] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-30T18:04:17.921013] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:04:18.531532] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T18:04:18.654389] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-30T18:04:19.454383] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-30T18:04:19.712578] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:04:20.254333] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-30T18:04:20.734739] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T18:04:21.054367] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-30T18:04:21.370748] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:04:21.380967] [INFO ] [REMOTE ] COR: Full fetch complete (68861 records). [2025-09-30T18:04:21.381130] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-30T18:04:21.819878] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-30T18:04:21.820034] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-30T18:04:21.821046] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-30T18:04:21.821114] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-30T18:04:21.822745] [DEBUG] [LOCAL ] COR: Trimmed 68861 records to 47089 (keeping 200 days of data) [2025-09-30T18:04:21.885730] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-30T18:04:22.136811] [DEBUG] [LOCAL ] COR: Primary data saved (47089 records). [2025-09-30T18:04:22.136945] [INFO ] [MAIN ] COR: Full history saved. [2025-09-30T18:04:22.137046] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COR took 33.6s. Estimated remaining: 3h 54m 40s. Rate: 7.9 symbols/min [2025-09-30T18:04:22.370781] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T18:04:22.391881] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:22.443541] [DEBUG] [LOCAL ] CP: Loaded 53268 existing records from primary storage. [2025-09-30T18:04:22.443899] [INFO ] [MAIN ] CP: Loaded 53268 existing records. [2025-09-30T18:04:22.635711] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:22.635924] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-30T18:04:22.635971] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-30T18:04:22.636265] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-30T18:04:22.636323] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-30T18:04:22.659614] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-30T18:04:23.012186] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:23.052358] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:04:23.454336] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-30T18:04:23.489681] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:04:24.254373] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-30T18:04:24.545131] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:04:24.556343] [INFO ] [REMOTE ] COTY: Full fetch complete (76682 records). [2025-09-30T18:04:24.556526] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-30T18:04:24.557530] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:04:24.557636] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:04:24.557730] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:04:24.557808] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-30T18:04:24.557877] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-30T18:04:24.557915] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-09-30T18:04:24.558261] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-09-30T18:04:24.558380] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COTY took 28.8s. Estimated remaining: 3h 54m 14s. Rate: 7.9 symbols/min [2025-09-30T18:04:24.761193] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:24.761391] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-09-30T18:04:24.761508] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-09-30T18:04:24.761595] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-30T18:04:24.761634] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-30T18:04:24.761719] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-30T18:04:24.761759] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-30T18:04:25.063072] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-30T18:04:25.230632] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:25.796426] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T18:04:25.810444] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-30T18:04:25.810696] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-30T18:04:25.861932] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-30T18:04:26.299034] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-30T18:04:26.299187] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-30T18:04:26.300131] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-30T18:04:26.300856] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-30T18:04:26.302122] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T18:04:26.314334] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-30T18:04:26.654552] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-30T18:04:26.667111] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-30T18:04:26.667259] [INFO ] [MAIN ] COP: Full history saved. [2025-09-30T18:04:26.668062] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COP took 41.3s. Estimated remaining: 3h 53m 46s. Rate: 8.0 symbols/min [2025-09-30T18:04:26.859010] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:26.859259] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-30T18:04:26.859328] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-30T18:04:26.859519] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-30T18:04:26.859563] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-30T18:04:26.859607] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-30T18:04:26.859674] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-30T18:04:27.437251] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-30T18:04:27.448148] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:27.462376] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-30T18:04:27.506140] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:04:27.850022] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:04:27.930941] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T18:04:28.254383] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-30T18:04:29.054371] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-30T18:04:29.854332] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-30T18:04:29.954790] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T18:04:30.240813] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:04:30.394840] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:04:30.654396] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-30T18:04:31.009173] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T18:04:31.454332] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-30T18:04:32.254403] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-30T18:04:32.595938] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:04:32.706219] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T18:04:33.054401] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-30T18:04:33.526792] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T18:04:33.854379] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-30T18:04:34.654362] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-30T18:04:35.454334] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-30T18:04:35.492477] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:04:36.254332] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-30T18:04:36.298419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:04:36.602842] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T18:04:36.821157] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:04:37.054402] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-30T18:04:37.337698] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-30T18:04:37.854371] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-30T18:04:38.456080] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:04:38.654419] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-30T18:04:39.454372] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-30T18:04:40.254331] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-30T18:04:40.629506] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T18:04:40.664866] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:04:40.674861] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:04:41.054422] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-30T18:04:41.854381] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-30T18:04:42.572590] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T18:04:42.573632] [INFO ] [REMOTE ] CPAC: Full fetch complete (1891 records). [2025-09-30T18:04:42.573732] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-30T18:04:42.656001] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-30T18:04:42.788573] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:04:42.789026] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:04:42.789245] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:04:42.789325] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-30T18:04:42.789403] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-30T18:04:42.789445] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-30T18:04:42.789485] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-30T18:04:42.789560] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CPAC took 16.1s. Estimated remaining: 3h 54m 10s. Rate: 7.9 symbols/min [2025-09-30T18:04:42.981286] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:43.017217] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:04:43.064419] [DEBUG] [LOCAL ] CPAY: Loaded 30608 existing records from primary storage. [2025-09-30T18:04:43.064775] [INFO ] [MAIN ] CPAY: Loaded 30608 existing records. [2025-09-30T18:04:43.260333] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:43.260571] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-30T18:04:43.260621] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-30T18:04:43.261005] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-30T18:04:43.261064] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-30T18:04:43.462026] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-30T18:04:43.649791] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:44.096988] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:04:44.254363] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-30T18:04:45.054338] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-30T18:04:45.369245] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:04:45.421039] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:04:45.854363] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-30T18:04:46.654360] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-30T18:04:47.120459] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T18:04:47.454359] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-30T18:04:47.547899] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:04:47.958848] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:04:48.254406] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-30T18:04:48.575619] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:04:49.054375] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-30T18:04:49.785835] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:04:49.854392] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-30T18:04:50.109302] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:04:50.654366] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-30T18:04:51.294501] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T18:04:51.454395] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-30T18:04:51.915539] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T18:04:52.254375] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-30T18:04:52.798550] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:04:52.804969] [INFO ] [REMOTE ] CPA: Full fetch complete (41859 records). [2025-09-30T18:04:52.805189] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-30T18:04:53.061889] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-30T18:04:53.214709] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-30T18:04:53.214805] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-30T18:04:53.215462] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-30T18:04:53.215525] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-30T18:04:53.216726] [DEBUG] [LOCAL ] CPA: Trimmed 41859 records to 28403 (keeping 200 days of data) [2025-09-30T18:04:53.412778] [DEBUG] [LOCAL ] CPA: Primary data saved (28403 records). [2025-09-30T18:04:53.412938] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-30T18:04:53.413025] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPA took 28.9s. Estimated remaining: 3h 54m 13s. Rate: 7.9 symbols/min [2025-09-30T18:04:53.603488] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:53.621873] [DEBUG] [LOCAL ] CPF: Loaded 15248 existing records from primary storage. [2025-09-30T18:04:53.622145] [INFO ] [MAIN ] CPF: Loaded 15248 existing records. [2025-09-30T18:04:53.828600] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:53.828968] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-30T18:04:53.829045] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-30T18:04:53.829374] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-30T18:04:53.829436] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-30T18:04:53.861621] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-30T18:04:54.235130] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:54.268540] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T18:04:54.281280] [INFO ] [REMOTE ] COUR: Full fetch complete (70876 records). [2025-09-30T18:04:54.281478] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-30T18:04:54.670717] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-30T18:04:54.728482] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-30T18:04:54.729594] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-30T18:04:54.731197] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-30T18:04:54.742977] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-30T18:04:54.766903] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T18:04:54.778167] [DEBUG] [LOCAL ] COUR: Trimmed 70876 records to 48912 (keeping 200 days of data) [2025-09-30T18:04:55.078016] [DEBUG] [LOCAL ] COUR: Primary data saved (48912 records). [2025-09-30T18:04:55.078167] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-30T18:04:55.078297] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. COUR took 47.2s. Estimated remaining: 3h 53m 44s. Rate: 7.9 symbols/min [2025-09-30T18:04:55.265003] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:55.282767] [DEBUG] [LOCAL ] CPK: Loaded 13437 existing records from primary storage. [2025-09-30T18:04:55.283019] [INFO ] [MAIN ] CPK: Loaded 13437 existing records. [2025-09-30T18:04:55.458523] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-30T18:04:55.484855] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:55.485075] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-30T18:04:55.485142] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-30T18:04:55.485388] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-30T18:04:55.485455] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-30T18:04:55.895493] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:04:55.893704] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:56.033778] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-30T18:04:56.254359] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-30T18:04:57.054350] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-30T18:04:57.442931] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:04:57.455543] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-09-30T18:04:57.468930] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-30T18:04:57.470326] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:04:57.859502] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-30T18:04:58.016804] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-30T18:04:58.016926] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-30T18:04:58.017859] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-30T18:04:58.017928] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-30T18:04:58.019541] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53267 (keeping 200 days of data) [2025-09-30T18:04:58.365967] [DEBUG] [LOCAL ] CP: Primary data saved (53267 records). [2025-09-30T18:04:58.366111] [INFO ] [MAIN ] CP: Full history saved. [2025-09-30T18:04:58.366195] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 36.2s. Estimated remaining: 3h 53m 22s. Rate: 7.9 symbols/min [2025-09-30T18:04:58.552351] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:58.582323] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T18:04:58.634526] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-30T18:04:58.634895] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-09-30T18:04:58.659557] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-30T18:04:58.828565] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:58.828791] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-30T18:04:58.828862] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-30T18:04:58.829326] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-30T18:04:58.829393] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-30T18:04:58.992007] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:04:59.222455] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:59.454341] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-30T18:04:59.675696] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:05:00.254366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-30T18:05:01.054361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-30T18:05:01.261383] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:05:01.675573] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-30T18:05:01.854378] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-30T18:05:02.434010] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:05:02.654397] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-30T18:05:03.454362] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-30T18:05:03.951077] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T18:05:04.052990] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T18:05:04.239109] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:05:04.254300] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-30T18:05:05.054334] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-30T18:05:05.092821] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T18:05:05.854318] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-30T18:05:05.932301] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T18:05:06.654371] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-30T18:05:07.454356] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-30T18:05:07.584181] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T18:05:07.767484] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-30T18:05:08.034590] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:05:08.254405] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-30T18:05:09.054389] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-30T18:05:09.423870] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:05:09.854334] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-30T18:05:10.019628] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:05:10.654346] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-30T18:05:10.836519] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:05:11.454403] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-30T18:05:12.254382] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-30T18:05:12.293669] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T18:05:12.818337] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:05:12.924744] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T18:05:13.054363] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-30T18:05:13.854361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-30T18:05:14.102580] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:05:14.654411] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-30T18:05:14.942159] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:05:15.454369] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-30T18:05:15.565462] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:05:16.254406] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-30T18:05:17.047991] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:05:17.051604] [INFO ] [REMOTE ] CPF: Full fetch complete (24056 records). [2025-09-30T18:05:17.051721] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-30T18:05:17.052805] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:05:17.052948] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:05:17.053015] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:05:17.053099] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-30T18:05:17.053204] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-09-30T18:05:17.053306] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-09-30T18:05:17.053855] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-09-30T18:05:17.053998] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 23.6s. Estimated remaining: 3h 53m 54s. Rate: 7.9 symbols/min [2025-09-30T18:05:17.054311] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-30T18:05:17.864190] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-30T18:05:17.887848] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-30T18:05:18.128251] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T18:05:18.654366] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-30T18:05:18.781428] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:05:19.454438] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-30T18:05:20.254361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-30T18:05:20.508458] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:05:20.512455] [INFO ] [REMOTE ] CPK: Full fetch complete (17799 records). [2025-09-30T18:05:20.512635] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-30T18:05:20.962995] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-30T18:05:20.963169] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-30T18:05:20.963736] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-30T18:05:20.963820] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-30T18:05:20.964954] [DEBUG] [LOCAL ] CPK: Trimmed 17799 records to 13455 (keeping 200 days of data) [2025-09-30T18:05:21.063169] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-30T18:05:21.076886] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-30T18:05:21.104554] [DEBUG] [LOCAL ] CPK: Primary data saved (13455 records). [2025-09-30T18:05:21.104737] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-30T18:05:21.104836] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 26.0s. Estimated remaining: 3h 53m 34s. Rate: 7.9 symbols/min [2025-09-30T18:05:21.571473] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:05:21.854403] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-30T18:05:23.197453] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-30T18:05:23.230795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-30T18:05:23.233744] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:05:23.243142] [INFO ] [REMOTE ] CPAY: Full fetch complete (45007 records). [2025-09-30T18:05:23.243286] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-30T18:05:23.642086] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-30T18:05:23.642170] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-30T18:05:23.642791] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-30T18:05:23.642860] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-30T18:05:23.643917] [DEBUG] [LOCAL ] CPAY: Trimmed 45007 records to 30567 (keeping 200 days of data) [2025-09-30T18:05:23.835268] [DEBUG] [LOCAL ] CPAY: Primary data saved (30567 records). [2025-09-30T18:05:23.835417] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-30T18:05:23.836558] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 41.0s. Estimated remaining: 3h 53m 9s. Rate: 7.9 symbols/min [2025-09-30T18:05:25.350932] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-30T18:05:25.363520] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-30T18:05:27.587683] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T18:05:27.599785] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-30T18:05:29.959277] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T18:05:29.970504] [INFO ] [REMOTE ] CPNG: Full fetch complete (77280 records). [2025-09-30T18:05:29.970693] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-30T18:05:29.971540] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:05:29.971638] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:05:29.971721] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:05:29.971783] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-30T18:05:29.971879] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-09-30T18:05:29.971947] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-09-30T18:05:29.972272] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-09-30T18:05:29.972371] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 31.6s. Estimated remaining: 3h 52m 56s. Rate: 7.9 symbols/min [2025-09-30T18:05:30.740323] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.781851] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.790379] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.789326] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.790525] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-09-30T18:05:30.791604] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-09-30T18:05:30.792165] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-09-30T18:05:30.792325] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-30T18:05:30.792403] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-30T18:05:30.792528] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-30T18:05:30.792607] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-30T18:05:30.791901] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-09-30T18:05:30.810533] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-30T18:05:30.817268] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-30T18:05:30.833675] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-30T18:05:30.863672] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-30T18:05:31.025505] [DEBUG] [LOCAL ] CQP: Loaded 19676 existing records from primary storage. [2025-09-30T18:05:31.113680] [INFO ] [MAIN ] CQP: Loaded 19676 existing records. [2025-09-30T18:05:31.308350] [DEBUG] [LOCAL ] CPT: Loaded 44317 existing records from primary storage. [2025-09-30T18:05:31.418857] [INFO ] [MAIN ] CPT: Loaded 44317 existing records. [2025-09-30T18:05:31.908056] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:32.010697] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-30T18:05:32.075596] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.064706] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-30T18:05:32.069423] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.103947] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:32.099803] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-30T18:05:32.105255] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-30T18:05:32.104970] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-30T18:05:32.105186] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-30T18:05:32.106857] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-30T18:05:32.108132] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-30T18:05:32.108074] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-30T18:05:32.108264] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-30T18:05:32.914037] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.921116] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.921968] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-30T18:05:32.921624] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-30T18:05:33.138094] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:05:33.144797] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-30T18:05:33.763819] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T18:05:33.768563] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-30T18:05:33.904468] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:05:33.915490] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-30T18:05:34.230559] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:05:34.235596] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-30T18:05:34.378403] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:05:34.386758] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-30T18:05:34.647596] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:05:34.654071] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-30T18:05:35.135708] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:05:35.141246] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-30T18:05:35.506494] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:05:35.512246] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-30T18:05:35.693261] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T18:05:35.704595] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-30T18:05:36.147006] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:05:36.156374] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-30T18:05:36.471461] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T18:05:36.476630] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-30T18:05:36.509611] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:05:37.054439] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-30T18:05:37.393422] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:05:37.433105] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:05:37.474055] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T18:05:37.854468] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-30T18:05:38.056713] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T18:05:38.654427] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-30T18:05:39.407283] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:05:39.454382] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-30T18:05:39.753360] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:05:40.254340] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-30T18:05:41.054354] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-30T18:05:41.091269] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:05:41.710115] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:05:41.854392] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-30T18:05:42.654378] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-30T18:05:42.849449] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:05:42.900145] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:05:43.454418] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-30T18:05:44.178543] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:05:44.254484] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-30T18:05:44.258601] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:05:45.054370] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-30T18:05:45.854373] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-30T18:05:46.284271] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T18:05:46.654351] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-30T18:05:46.731841] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:05:46.830791] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T18:05:46.834300] [INFO ] [REMOTE ] CQP: Full fetch complete (30709 records). [2025-09-30T18:05:46.834475] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-30T18:05:47.264426] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-30T18:05:47.264540] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-30T18:05:47.265195] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-30T18:05:47.265296] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-30T18:05:47.266337] [DEBUG] [LOCAL ] CQP: Trimmed 30709 records to 19633 (keeping 200 days of data) [2025-09-30T18:05:47.409839] [DEBUG] [LOCAL ] CQP: Primary data saved (19633 records). [2025-09-30T18:05:47.410160] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-30T18:05:47.410638] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 17.4s. Estimated remaining: 3h 53m 24s. Rate: 7.9 symbols/min [2025-09-30T18:05:47.460466] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-30T18:05:47.642900] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:47.643115] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-09-30T18:05:47.643234] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-09-30T18:05:47.643366] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-30T18:05:47.643405] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-30T18:05:47.643446] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-30T18:05:47.643496] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-30T18:05:48.060676] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:48.205002] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T18:05:48.254352] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-30T18:05:48.563401] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:05:49.054363] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-30T18:05:49.802342] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T18:05:49.845249] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T18:05:49.854305] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-30T18:05:50.654383] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-30T18:05:51.012889] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:05:51.454415] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-30T18:05:51.997967] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:05:52.254357] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-30T18:05:53.054335] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-30T18:05:53.089245] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:05:53.415243] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:05:53.854327] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-30T18:05:53.909388] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T18:05:54.654378] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-30T18:05:55.459453] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-30T18:05:55.474137] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T18:05:55.806442] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:05:56.254363] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-30T18:05:57.054391] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-30T18:05:57.333596] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:05:57.585894] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:05:57.591461] [INFO ] [REMOTE ] CPS: Full fetch complete (36216 records). [2025-09-30T18:05:57.591590] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-30T18:05:57.864690] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-30T18:05:58.009462] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-30T18:05:58.009555] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-30T18:05:58.010117] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-30T18:05:58.010181] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-30T18:05:58.011254] [DEBUG] [LOCAL ] CPS: Trimmed 36216 records to 25989 (keeping 200 days of data) [2025-09-30T18:05:58.171413] [DEBUG] [LOCAL ] CPS: Primary data saved (25989 records). [2025-09-30T18:05:58.171561] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-30T18:05:58.171680] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 28.2s. Estimated remaining: 3h 53m 28s. Rate: 7.9 symbols/min [2025-09-30T18:05:58.350330] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:58.362692] [DEBUG] [LOCAL ] CRBD: Loaded 9005 existing records from primary storage. [2025-09-30T18:05:58.362928] [INFO ] [MAIN ] CRBD: Loaded 9005 existing records. [2025-09-30T18:05:58.565496] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:58.565891] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-30T18:05:58.565963] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-30T18:05:58.566203] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-30T18:05:58.566262] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-30T18:05:58.661733] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-30T18:05:58.954628] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:58.987127] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:05:58.997595] [INFO ] [REMOTE ] CPT: Full fetch complete (63839 records). [2025-09-30T18:05:58.997789] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-30T18:05:59.374345] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:05:59.449773] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-30T18:05:59.449854] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-30T18:05:59.450577] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-30T18:05:59.450637] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-30T18:05:59.451977] [DEBUG] [LOCAL ] CPT: Trimmed 63839 records to 44325 (keeping 200 days of data) [2025-09-30T18:05:59.454326] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-30T18:05:59.751592] [DEBUG] [LOCAL ] CPT: Primary data saved (44325 records). [2025-09-30T18:05:59.751830] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-30T18:05:59.752001] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 29.8s. Estimated remaining: 3h 52m 59s. Rate: 7.9 symbols/min [2025-09-30T18:05:59.933091] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:59.991201] [DEBUG] [LOCAL ] CRBG: Loaded 52335 existing records from primary storage. [2025-09-30T18:05:59.991604] [INFO ] [MAIN ] CRBG: Loaded 52335 existing records. [2025-09-30T18:06:00.196149] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:00.196372] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-30T18:06:00.196421] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-30T18:06:00.196872] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-30T18:06:00.196943] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-30T18:06:00.256414] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-30T18:06:00.621178] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:00.654914] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T18:06:00.666948] [INFO ] [REMOTE ] CPRI: Full fetch complete (76154 records). [2025-09-30T18:06:00.667112] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-30T18:06:01.044608] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:06:01.055117] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-30T18:06:01.161472] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-30T18:06:01.161584] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-30T18:06:01.162684] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-30T18:06:01.162868] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-30T18:06:01.165243] [DEBUG] [LOCAL ] CPRI: Trimmed 76154 records to 52547 (keeping 200 days of data) [2025-09-30T18:06:01.301423] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:06:01.521173] [DEBUG] [LOCAL ] CPRI: Primary data saved (52547 records). [2025-09-30T18:06:01.521471] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-30T18:06:01.521586] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 31.5s. Estimated remaining: 3h 52m 31s. Rate: 7.9 symbols/min [2025-09-30T18:06:01.730174] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:01.773801] [DEBUG] [LOCAL ] CRC: Loaded 44146 existing records from primary storage. [2025-09-30T18:06:01.774107] [INFO ] [MAIN ] CRC: Loaded 44146 existing records. [2025-09-30T18:06:01.859472] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-30T18:06:01.974391] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:01.974628] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-30T18:06:01.974717] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-30T18:06:01.975156] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-30T18:06:01.975227] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-30T18:06:02.352753] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:02.654333] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-30T18:06:02.751636] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:06:03.140922] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:06:03.407501] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T18:06:03.454369] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-30T18:06:04.182691] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T18:06:04.254339] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-30T18:06:04.979562] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:06:05.054395] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-30T18:06:05.825143] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T18:06:05.854337] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-30T18:06:06.585956] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:06:06.654391] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-30T18:06:07.251863] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:06:07.454356] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-30T18:06:08.254409] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-30T18:06:09.060072] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-30T18:06:09.083561] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T18:06:09.337196] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:06:09.854404] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-30T18:06:10.522803] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:06:10.654394] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-30T18:06:11.264853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:06:11.454384] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-30T18:06:11.669269] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T18:06:12.254403] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-30T18:06:12.523722] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:06:13.054436] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-30T18:06:13.324850] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T18:06:13.854424] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-30T18:06:14.170853] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:06:14.654417] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-30T18:06:15.454365] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-30T18:06:15.529920] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:06:15.594806] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:06:16.254409] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-30T18:06:17.054329] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-30T18:06:17.137564] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:06:17.193202] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:06:17.854414] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-30T18:06:18.356383] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:06:18.362205] [INFO ] [REMOTE ] CR: Full fetch complete (34844 records). [2025-09-30T18:06:18.362354] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-30T18:06:18.475898] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:06:18.659554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-30T18:06:18.791797] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-30T18:06:18.791914] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-30T18:06:18.792481] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-30T18:06:18.792607] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-30T18:06:18.793737] [DEBUG] [LOCAL ] CR: Trimmed 34844 records to 24400 (keeping 200 days of data) [2025-09-30T18:06:18.963312] [DEBUG] [LOCAL ] CR: Primary data saved (24400 records). [2025-09-30T18:06:18.963470] [INFO ] [MAIN ] CR: Full history saved. [2025-09-30T18:06:18.963587] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 31.6s. Estimated remaining: 3h 52m 58s. Rate: 7.9 symbols/min [2025-09-30T18:06:19.156746] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:19.158108] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-30T18:06:19.158342] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-30T18:06:19.158496] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-30T18:06:19.158552] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-30T18:06:19.158598] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-30T18:06:19.158632] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-30T18:06:19.457235] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-30T18:06:19.543704] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:20.242915] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:06:20.254299] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-30T18:06:20.872755] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:06:21.054383] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-30T18:06:21.854343] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-30T18:06:22.011600] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:06:22.236537] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:06:22.236922] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-30T18:06:22.237036] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:06:22.237103] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-30T18:06:22.237168] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:06:22.237243] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-30T18:06:22.237313] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-30T18:06:22.237366] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-30T18:06:22.237437] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-30T18:06:22.237489] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 3.3s. Estimated remaining: 3h 52m 35s. Rate: 7.9 symbols/min [2025-09-30T18:06:22.434442] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:22.494620] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-09-30T18:06:22.495071] [INFO ] [MAIN ] CRGY: Loaded 52509 existing records. [2025-09-30T18:06:22.659533] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-30T18:06:22.709733] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:22.710049] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-30T18:06:22.710170] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-30T18:06:22.711139] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-30T18:06:22.711393] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-30T18:06:23.131697] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:23.149873] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T18:06:23.454328] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-30T18:06:23.567001] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:06:23.569309] [INFO ] [REMOTE ] CRBD: Full fetch complete (14917 records). [2025-09-30T18:06:23.569393] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-30T18:06:24.019261] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-30T18:06:24.019347] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-30T18:06:24.019785] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-30T18:06:24.019850] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-30T18:06:24.020519] [DEBUG] [LOCAL ] CRBD: Trimmed 14917 records to 8991 (keeping 200 days of data) [2025-09-30T18:06:24.083595] [DEBUG] [LOCAL ] CRBD: Primary data saved (8991 records). [2025-09-30T18:06:24.083757] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-30T18:06:24.083848] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 25.9s. Estimated remaining: 3h 52m 8s. Rate: 7.9 symbols/min [2025-09-30T18:06:24.259569] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-30T18:06:24.292063] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:24.367694] [DEBUG] [LOCAL ] CRH: Loaded 53463 existing records from primary storage. [2025-09-30T18:06:24.368122] [INFO ] [MAIN ] CRH: Loaded 53463 existing records. [2025-09-30T18:06:24.572494] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:24.572714] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-30T18:06:24.572771] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-30T18:06:24.573132] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-30T18:06:24.573192] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-30T18:06:25.003197] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:25.059455] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-30T18:06:25.075362] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:06:25.793288] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:06:25.854383] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-30T18:06:26.654374] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-30T18:06:26.956968] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:06:27.454372] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-30T18:06:27.752099] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:06:28.254372] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-30T18:06:28.411966] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:06:28.823807] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T18:06:29.054406] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-30T18:06:29.551305] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:06:29.854367] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-30T18:06:30.654383] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-30T18:06:31.014050] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:06:31.454387] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-30T18:06:31.737230] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:06:32.259462] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-30T18:06:32.280114] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:06:33.054342] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-30T18:06:33.112545] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T18:06:33.854408] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-30T18:06:34.088186] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:06:34.099681] [INFO ] [REMOTE ] CRBG: Full fetch complete (75686 records). [2025-09-30T18:06:34.099841] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-30T18:06:34.535421] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-30T18:06:34.535623] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-30T18:06:34.536583] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-30T18:06:34.536696] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-30T18:06:34.538891] [DEBUG] [LOCAL ] CRBG: Trimmed 75686 records to 52349 (keeping 200 days of data) [2025-09-30T18:06:34.660739] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-30T18:06:34.665158] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:06:34.926488] [DEBUG] [LOCAL ] CRBG: Primary data saved (52349 records). [2025-09-30T18:06:34.926685] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-30T18:06:34.927326] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 35.2s. Estimated remaining: 3h 52m 12s. Rate: 7.9 symbols/min [2025-09-30T18:06:35.110219] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:35.158955] [DEBUG] [LOCAL ] CRI: Loaded 49926 existing records from primary storage. [2025-09-30T18:06:35.159292] [INFO ] [MAIN ] CRI: Loaded 49926 existing records. [2025-09-30T18:06:35.359136] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:35.359384] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-30T18:06:35.359453] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-30T18:06:35.359902] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-30T18:06:35.359978] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-30T18:06:35.473093] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-30T18:06:35.807155] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:35.835907] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:06:35.845848] [INFO ] [REMOTE ] CRC: Full fetch complete (62367 records). [2025-09-30T18:06:35.845986] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-30T18:06:36.271112] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-30T18:06:36.275524] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-30T18:06:36.275608] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-30T18:06:36.276617] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-30T18:06:36.276962] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-30T18:06:36.310306] [DEBUG] [LOCAL ] CRC: Trimmed 62367 records to 44118 (keeping 200 days of data) [2025-09-30T18:06:36.312201] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:06:36.609410] [DEBUG] [LOCAL ] CRC: Primary data saved (44118 records). [2025-09-30T18:06:36.609561] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-30T18:06:36.609675] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRC took 35.1s. Estimated remaining: 3h 51m 44s. Rate: 7.9 symbols/min [2025-09-30T18:06:36.789694] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:36.840129] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-30T18:06:36.840488] [INFO ] [MAIN ] CRK: Loaded 52121 existing records. [2025-09-30T18:06:37.032422] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:37.032753] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-30T18:06:37.032814] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-30T18:06:37.033086] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-30T18:06:37.033143] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-30T18:06:37.064052] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-30T18:06:37.424192] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:37.464352] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:06:37.854336] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-30T18:06:37.990088] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:06:38.597770] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T18:06:38.654343] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-30T18:06:39.454355] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-30T18:06:39.940534] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:06:40.254376] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-30T18:06:40.308141] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:06:41.054382] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-30T18:06:41.121963] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:06:41.732232] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:06:41.854337] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-30T18:06:42.517309] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T18:06:42.654365] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-30T18:06:43.140945] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:06:43.454360] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-30T18:06:44.254349] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-30T18:06:44.447629] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:06:44.530397] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T18:06:45.054346] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-30T18:06:45.644735] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:06:45.854349] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-30T18:06:46.654331] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-30T18:06:46.985749] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T18:06:47.454328] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-30T18:06:47.503952] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:06:48.254354] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-30T18:06:48.671825] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T18:06:49.054333] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-30T18:06:49.201352] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T18:06:49.854350] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-30T18:06:49.983576] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:06:50.654331] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-30T18:06:50.741042] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:06:51.454393] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-30T18:06:51.616348] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:06:52.029088] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:06:52.254374] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-30T18:06:53.054337] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-30T18:06:53.466837] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T18:06:53.478270] [INFO ] [REMOTE ] CRH: Full fetch complete (77295 records). [2025-09-30T18:06:53.478436] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-30T18:06:53.860264] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-30T18:06:53.902420] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-30T18:06:53.902544] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-30T18:06:53.903564] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-30T18:06:53.903879] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-30T18:06:53.920841] [DEBUG] [LOCAL ] CRH: Trimmed 77295 records to 53463 (keeping 200 days of data) [2025-09-30T18:06:53.937711] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:06:54.300094] [DEBUG] [LOCAL ] CRH: Primary data saved (53463 records). [2025-09-30T18:06:54.300244] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-30T18:06:54.300328] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRH took 30.2s. Estimated remaining: 3h 52m 12s. Rate: 7.9 symbols/min [2025-09-30T18:06:54.487573] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:54.537624] [DEBUG] [LOCAL ] CRL: Loaded 43015 existing records from primary storage. [2025-09-30T18:06:54.538018] [INFO ] [MAIN ] CRL: Loaded 43015 existing records. [2025-09-30T18:06:54.662807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-30T18:06:54.736135] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:54.736698] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-30T18:06:54.736867] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-30T18:06:54.737219] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-30T18:06:54.737327] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-30T18:06:54.976472] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:06:55.189365] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:55.454363] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-30T18:06:55.537068] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:06:55.962433] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:06:56.254374] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-30T18:06:56.978460] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:06:57.054385] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-30T18:06:57.854334] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-30T18:06:58.025466] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:06:58.592262] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:06:58.654379] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-30T18:06:58.993545] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:06:59.454342] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-30T18:07:00.254344] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-30T18:07:00.347691] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:07:01.054404] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-30T18:07:01.181530] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:07:01.854396] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-30T18:07:02.061508] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:07:02.072762] [INFO ] [REMOTE ] CRGY: Full fetch complete (75577 records). [2025-09-30T18:07:02.072939] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-30T18:07:02.073848] [FATAL] [VALIDATOR ] CRGY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:07:02.073946] [FATAL] [MAIN ] CRGY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:07:02.073991] [WARN ] [MAIN ] CRGY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:07:02.074061] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-30T18:07:02.074128] [DEBUG] [LOCAL ] CRGY: No primary data file found to delete. [2025-09-30T18:07:02.074164] [INFO ] [LOCAL ] CRGY: Starting deletion of derivative data. [2025-09-30T18:07:02.074457] [DEBUG] [LOCAL ] CRGY: Deleted derivative data file. [2025-09-30T18:07:02.074558] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRGY took 39.8s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min [2025-09-30T18:07:02.268600] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:02.268874] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-09-30T18:07:02.268924] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-09-30T18:07:02.269045] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-30T18:07:02.269086] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-30T18:07:02.269126] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-30T18:07:02.269158] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-30T18:07:02.663310] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-30T18:07:02.685853] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:02.724487] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:07:03.454371] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-30T18:07:03.516575] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:07:04.254386] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-30T18:07:04.475011] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:07:04.485960] [INFO ] [REMOTE ] CRI: Full fetch complete (70969 records). [2025-09-30T18:07:04.486131] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-30T18:07:04.917858] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-30T18:07:04.917957] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-30T18:07:04.918898] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-30T18:07:04.918967] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-30T18:07:04.920572] [DEBUG] [LOCAL ] CRI: Trimmed 70969 records to 49913 (keeping 200 days of data) [2025-09-30T18:07:05.105478] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-30T18:07:05.262351] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:07:05.285166] [DEBUG] [LOCAL ] CRI: Primary data saved (49913 records). [2025-09-30T18:07:05.285321] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-30T18:07:05.285844] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 30.4s. Estimated remaining: 3h 51m 42s. Rate: 7.9 symbols/min [2025-09-30T18:07:05.466059] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:05.510219] [DEBUG] [LOCAL ] CRS: Loaded 43170 existing records from primary storage. [2025-09-30T18:07:05.510595] [INFO ] [MAIN ] CRS: Loaded 43170 existing records. [2025-09-30T18:07:05.701146] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:05.701397] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-30T18:07:05.701455] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-30T18:07:05.701728] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-30T18:07:05.701786] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-30T18:07:05.857909] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-30T18:07:06.089150] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:06.654352] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-30T18:07:06.743699] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:07:06.805838] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-30T18:07:07.454377] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-30T18:07:08.087218] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T18:07:08.099611] [INFO ] [REMOTE ] CRK: Full fetch complete (75597 records). [2025-09-30T18:07:08.099870] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-30T18:07:08.258972] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-30T18:07:08.496067] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:07:08.581590] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-30T18:07:08.581700] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-30T18:07:08.582596] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-30T18:07:08.582665] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-30T18:07:08.584225] [DEBUG] [LOCAL ] CRK: Trimmed 75597 records to 52148 (keeping 200 days of data) [2025-09-30T18:07:08.903236] [DEBUG] [LOCAL ] CRK: Primary data saved (52148 records). [2025-09-30T18:07:08.903387] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-30T18:07:08.903476] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRK took 32.3s. Estimated remaining: 3h 51m 21s. Rate: 7.9 symbols/min [2025-09-30T18:07:09.062481] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-30T18:07:09.093850] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:09.102144] [DEBUG] [LOCAL ] CRT: Loaded 4976 existing records from primary storage. [2025-09-30T18:07:09.102862] [INFO ] [MAIN ] CRT: Loaded 4976 existing records. [2025-09-30T18:07:09.300016] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:09.300385] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-30T18:07:09.300520] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-30T18:07:09.300778] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-30T18:07:09.300838] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-30T18:07:09.712136] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:09.751865] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-30T18:07:09.792973] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:07:09.854326] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-30T18:07:10.659555] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-30T18:07:10.673876] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T18:07:11.164382] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:07:11.454385] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-30T18:07:11.493038] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:07:12.254484] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-30T18:07:13.049373] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:07:13.058092] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-30T18:07:13.582472] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T18:07:13.836222] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:07:13.854334] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-30T18:07:14.476357] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:07:14.654398] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-30T18:07:15.292240] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T18:07:15.454400] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-30T18:07:16.065857] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:07:16.254373] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-30T18:07:17.054404] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-30T18:07:17.854394] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-30T18:07:18.009160] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:07:18.328816] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T18:07:18.654406] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-30T18:07:19.255621] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:07:19.359520] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-30T18:07:19.454370] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-30T18:07:19.903695] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:07:20.254385] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-30T18:07:21.054439] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-30T18:07:21.854368] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-30T18:07:21.986263] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:07:22.592201] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T18:07:22.654423] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-30T18:07:23.137117] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T18:07:23.454417] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-30T18:07:24.254329] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-30T18:07:24.294984] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:07:25.054344] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-30T18:07:25.200513] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:07:25.759680] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:07:25.854365] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-30T18:07:26.551785] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:07:26.654346] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-30T18:07:26.683881] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T18:07:26.685847] [INFO ] [REMOTE ] CRT: Full fetch complete (7598 records). [2025-09-30T18:07:26.685924] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-30T18:07:27.071897] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-30T18:07:27.071992] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-30T18:07:27.072261] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-30T18:07:27.072345] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-30T18:07:27.072864] [DEBUG] [LOCAL ] CRT: Trimmed 7598 records to 4979 (keeping 200 days of data) [2025-09-30T18:07:27.104221] [DEBUG] [LOCAL ] CRT: Primary data saved (4979 records). [2025-09-30T18:07:27.104333] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-30T18:07:27.104426] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRT took 18.2s. Estimated remaining: 3h 51m 50s. Rate: 7.9 symbols/min [2025-09-30T18:07:27.296982] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:27.347118] [DEBUG] [LOCAL ] CSAN: Loaded 42412 existing records from primary storage. [2025-09-30T18:07:27.347486] [INFO ] [MAIN ] CSAN: Loaded 42412 existing records. [2025-09-30T18:07:27.455117] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-30T18:07:27.542659] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:27.542935] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-30T18:07:27.542999] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-30T18:07:27.543320] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-30T18:07:27.543384] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-30T18:07:27.917623] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:28.254336] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-30T18:07:28.295741] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:07:28.978589] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:07:28.988155] [INFO ] [REMOTE ] CRL: Full fetch complete (62817 records). [2025-09-30T18:07:28.988332] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-30T18:07:29.059920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-30T18:07:29.428008] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-30T18:07:29.428137] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-30T18:07:29.429144] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-30T18:07:29.429226] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-30T18:07:29.430730] [DEBUG] [LOCAL ] CRL: Trimmed 62817 records to 42984 (keeping 200 days of data) [2025-09-30T18:07:29.710995] [DEBUG] [LOCAL ] CRL: Primary data saved (42984 records). [2025-09-30T18:07:29.711129] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-30T18:07:29.711305] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRL took 35.4s. Estimated remaining: 3h 51m 25s. Rate: 7.9 symbols/min [2025-09-30T18:07:29.865814] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-30T18:07:29.902698] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:29.940338] [DEBUG] [LOCAL ] CSL: Loaded 31556 existing records from primary storage. [2025-09-30T18:07:29.940686] [INFO ] [MAIN ] CSL: Loaded 31556 existing records. [2025-09-30T18:07:30.146113] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:30.146507] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-30T18:07:30.146567] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-30T18:07:30.147021] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-30T18:07:30.147113] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-30T18:07:30.604002] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:30.643085] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-30T18:07:30.654581] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-30T18:07:30.822272] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:07:31.454331] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-30T18:07:31.564329] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:07:32.071683] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:07:32.254379] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-30T18:07:33.054415] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-30T18:07:33.338597] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:07:33.348478] [INFO ] [REMOTE ] CRS: Full fetch complete (62680 records). [2025-09-30T18:07:33.348624] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-30T18:07:33.859243] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:07:33.862755] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-30T18:07:33.862877] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-30T18:07:33.869463] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-30T18:07:33.859357] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-30T18:07:33.871257] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-30T18:07:33.872840] [DEBUG] [LOCAL ] CRS: Trimmed 62680 records to 43193 (keeping 200 days of data) [2025-09-30T18:07:33.984559] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T18:07:34.180539] [DEBUG] [LOCAL ] CRS: Primary data saved (43193 records). [2025-09-30T18:07:34.180699] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-30T18:07:34.181888] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 28.9s. Estimated remaining: 3h 51m 7s. Rate: 7.9 symbols/min [2025-09-30T18:07:34.366222] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:34.383177] [DEBUG] [LOCAL ] CSR: Loaded 12759 existing records from primary storage. [2025-09-30T18:07:34.383413] [INFO ] [MAIN ] CSR: Loaded 12759 existing records. [2025-09-30T18:07:34.575115] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:34.575384] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-30T18:07:34.575463] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-30T18:07:34.575730] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-30T18:07:34.575793] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-30T18:07:34.660432] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-30T18:07:34.984023] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:35.454331] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-30T18:07:35.691552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T18:07:35.972825] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:07:36.254365] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-30T18:07:36.856686] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:07:37.054363] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-30T18:07:37.854373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-30T18:07:38.152563] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:07:38.654368] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-30T18:07:38.709995] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T18:07:39.248890] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:07:39.454376] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-30T18:07:39.896761] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T18:07:40.254364] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-30T18:07:41.054366] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-30T18:07:41.141510] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T18:07:41.854382] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-30T18:07:42.205512] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-30T18:07:42.638939] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:07:42.654365] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-30T18:07:42.691116] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T18:07:43.454375] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-30T18:07:44.079309] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:07:44.254401] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-30T18:07:45.054401] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-30T18:07:45.388473] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-30T18:07:45.400368] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-30T18:07:45.400594] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-30T18:07:45.572042] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T18:07:45.855346] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-30T18:07:45.876224] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-30T18:07:45.876317] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-30T18:07:45.877371] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-30T18:07:45.877436] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-30T18:07:45.879122] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-30T18:07:46.237163] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-30T18:07:46.237302] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-30T18:07:46.237380] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 44.2s. Estimated remaining: 3h 51m 15s. Rate: 7.9 symbols/min [2025-09-30T18:07:46.417844] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:46.469797] [DEBUG] [LOCAL ] CSTM: Loaded 47545 existing records from primary storage. [2025-09-30T18:07:46.470295] [INFO ] [MAIN ] CSTM: Loaded 47545 existing records. [2025-09-30T18:07:46.655802] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-30T18:07:46.661990] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:46.664587] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-30T18:07:46.664791] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-30T18:07:46.665310] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-30T18:07:46.665376] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-30T18:07:46.874604] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:07:46.874233] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:07:47.112171] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:47.454370] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-30T18:07:48.031808] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:07:48.064939] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:07:48.254397] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-30T18:07:49.054373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-30T18:07:49.860112] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-30T18:07:49.865444] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T18:07:50.295449] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:07:50.654393] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-30T18:07:50.670296] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T18:07:51.454361] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-30T18:07:51.926370] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T18:07:52.122576] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:07:52.254343] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-30T18:07:53.054366] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-30T18:07:53.764052] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T18:07:53.763588] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:07:53.854353] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-30T18:07:54.654362] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-30T18:07:55.420505] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T18:07:55.428838] [INFO ] [REMOTE ] CSL: Full fetch complete (45317 records). [2025-09-30T18:07:55.429184] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-30T18:07:55.461968] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-30T18:07:55.648148] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:07:55.874851] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-30T18:07:55.874956] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-30T18:07:55.875664] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-30T18:07:55.875746] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-30T18:07:55.876821] [DEBUG] [LOCAL ] CSL: Trimmed 45317 records to 31515 (keeping 200 days of data) [2025-09-30T18:07:56.086758] [DEBUG] [LOCAL ] CSL: Primary data saved (31515 records). [2025-09-30T18:07:56.086910] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-30T18:07:56.087000] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSL took 26.4s. Estimated remaining: 3h 51m 15s. Rate: 7.9 symbols/min [2025-09-30T18:07:56.256676] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-30T18:07:56.281955] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:56.283281] [DEBUG] [LOCAL ] CSV: No existing data file found in primary storage. [2025-09-30T18:07:56.283334] [WARN ] [MAIN ] CSV: No existing data found, performing full refresh instead. [2025-09-30T18:07:56.283546] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-30T18:07:56.283622] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-30T18:07:56.283754] [DEBUG] [LOCAL ] CSV: No primary data file found to delete. [2025-09-30T18:07:56.283836] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-30T18:07:56.670749] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:57.054326] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-30T18:07:57.245693] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:07:57.556678] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:07:57.691108] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T18:07:57.696681] [INFO ] [REMOTE ] CSR: Full fetch complete (17645 records). [2025-09-30T18:07:57.696837] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-30T18:07:57.859430] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-30T18:07:58.115867] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-30T18:07:58.115946] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-30T18:07:58.116366] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-30T18:07:58.116407] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-30T18:07:58.116995] [DEBUG] [LOCAL ] CSR: Trimmed 17645 records to 12774 (keeping 200 days of data) [2025-09-30T18:07:58.198506] [DEBUG] [LOCAL ] CSR: Primary data saved (12774 records). [2025-09-30T18:07:58.198667] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-30T18:07:58.198788] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 24.0s. Estimated remaining: 3h 50m 49s. Rate: 7.9 symbols/min [2025-09-30T18:07:58.377937] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:58.378164] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-30T18:07:58.378234] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-30T18:07:58.378356] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-30T18:07:58.378399] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-30T18:07:58.378442] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-30T18:07:58.378475] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-30T18:07:58.662143] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-30T18:07:58.759378] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:59.454363] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-30T18:07:59.509190] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:07:59.865396] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T18:08:00.254355] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-30T18:08:00.938951] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:08:01.054391] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-30T18:08:01.294706] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:08:01.854365] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-30T18:08:02.388933] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:08:02.398833] [INFO ] [REMOTE ] CSAN: Full fetch complete (60819 records). [2025-09-30T18:08:02.399008] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-30T18:08:02.659537] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-30T18:08:02.828449] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-30T18:08:02.829313] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:08:02.829407] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-30T18:08:02.833565] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-30T18:08:02.833949] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-30T18:08:02.836462] [DEBUG] [LOCAL ] CSAN: Trimmed 60819 records to 42417 (keeping 200 days of data) [2025-09-30T18:08:02.929098] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:02.930521] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-30T18:08:02.931196] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:02.931833] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-30T18:08:02.932205] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:02.932882] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-30T18:08:02.933546] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-30T18:08:02.934187] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-30T18:08:02.934939] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-30T18:08:02.935518] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 4.7s. Estimated remaining: 3h 50m 32s. Rate: 7.9 symbols/min [2025-09-30T18:08:03.136464] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:03.149714] [DEBUG] [LOCAL ] CTBB: Loaded 7077 existing records from primary storage. [2025-09-30T18:08:03.150237] [INFO ] [MAIN ] CTBB: Loaded 7077 existing records. [2025-09-30T18:08:03.357019] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:03.357800] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-30T18:08:03.358498] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-30T18:08:03.360156] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-30T18:08:03.360239] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-30T18:08:03.459438] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-30T18:08:03.860889] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:03.901201] [DEBUG] [LOCAL ] CSAN: Primary data saved (42417 records). [2025-09-30T18:08:03.901336] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-30T18:08:03.901420] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSAN took 36.8s. Estimated remaining: 3h 50m 2s. Rate: 8.0 symbols/min [2025-09-30T18:08:04.085067] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:04.094479] [DEBUG] [LOCAL ] CTDD: Loaded 5923 existing records from primary storage. [2025-09-30T18:08:04.094730] [INFO ] [MAIN ] CTDD: Loaded 5923 existing records. [2025-09-30T18:08:04.259457] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-30T18:08:04.294867] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:04.295821] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-30T18:08:04.295874] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-30T18:08:04.296050] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-30T18:08:04.296110] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-30T18:08:04.555558] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:08:04.708905] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:05.054364] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-30T18:08:05.790553] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:08:05.854321] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-30T18:08:05.964479] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:08:06.558257] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:08:06.654390] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-30T18:08:07.454349] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-30T18:08:07.691980] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T18:08:08.254405] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-30T18:08:08.837989] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:08:09.036413] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:08:09.054313] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-30T18:08:09.854403] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-30T18:08:10.493080] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:08:10.654396] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-30T18:08:10.706517] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:08:11.305437] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:08:11.454402] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-30T18:08:12.257128] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-30T18:08:12.258163] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:08:13.054357] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-30T18:08:13.338295] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:08:13.488760] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:08:13.854433] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-30T18:08:14.450567] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:08:14.654432] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-30T18:08:15.332510] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:08:15.454373] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-30T18:08:16.254386] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-30T18:08:16.289855] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:08:16.862472] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:08:17.054371] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-30T18:08:17.854391] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-30T18:08:18.654399] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-30T18:08:18.703156] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T18:08:18.734948] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:08:19.151932] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T18:08:19.454462] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-30T18:08:20.254409] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-30T18:08:20.637076] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T18:08:20.753633] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T18:08:21.054389] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-30T18:08:21.854412] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-30T18:08:22.348807] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:08:22.585779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:08:22.654351] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-30T18:08:23.454394] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-30T18:08:24.003791] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T18:08:24.167932] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T18:08:24.177937] [INFO ] [REMOTE ] CSTM: Full fetch complete (68863 records). [2025-09-30T18:08:24.178125] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-30T18:08:24.179097] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:08:24.179204] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:08:24.179249] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:08:24.179292] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-30T18:08:24.179354] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-09-30T18:08:24.179390] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-09-30T18:08:24.179804] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-09-30T18:08:24.179909] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 37.9s. Estimated remaining: 3h 50m 38s. Rate: 7.9 symbols/min [2025-09-30T18:08:24.259453] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-30T18:08:24.396075] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:24.396304] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-30T18:08:24.396362] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-30T18:08:24.396478] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-30T18:08:24.396521] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-30T18:08:24.396565] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-30T18:08:24.396598] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-30T18:08:24.787791] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:24.918396] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T18:08:25.054360] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-30T18:08:25.635958] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T18:08:25.854365] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-30T18:08:26.635898] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:08:26.654316] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-30T18:08:27.454392] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-30T18:08:27.468832] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:08:28.254354] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-30T18:08:28.372172] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T18:08:28.373984] [INFO ] [REMOTE ] CTDD: Full fetch complete (8501 records). [2025-09-30T18:08:28.374061] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-30T18:08:28.612781] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:28.648071] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-30T18:08:28.666445] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:28.678003] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-30T18:08:28.678084] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:28.678174] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-30T18:08:28.678316] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-30T18:08:28.678806] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-30T18:08:28.684308] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-30T18:08:28.694721] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 4.5s. Estimated remaining: 3h 50m 20s. Rate: 7.9 symbols/min [2025-09-30T18:08:28.886436] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-30T18:08:28.896899] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-30T18:08:28.907965] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-30T18:08:28.908107] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-30T18:08:28.940304] [DEBUG] [LOCAL ] CTDD: Trimmed 8501 records to 5892 (keeping 200 days of data) [2025-09-30T18:08:28.960944] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:28.961406] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-30T18:08:28.961454] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-30T18:08:28.961582] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-30T18:08:28.961681] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-30T18:08:28.962036] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-30T18:08:28.962123] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-30T18:08:29.056434] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-30T18:08:29.274254] [DEBUG] [LOCAL ] CTDD: Primary data saved (5892 records). [2025-09-30T18:08:29.288368] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-30T18:08:29.288518] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 25.4s. Estimated remaining: 3h 49m 49s. Rate: 7.9 symbols/min [2025-09-30T18:08:29.580103] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:29.599375] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:29.633273] [DEBUG] [LOCAL ] CTO: Loaded 27978 existing records from primary storage. [2025-09-30T18:08:29.633766] [INFO ] [MAIN ] CTO: Loaded 27978 existing records. [2025-09-30T18:08:29.822881] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:29.823197] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-30T18:08:29.823252] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-30T18:08:29.823857] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-30T18:08:29.824100] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-30T18:08:29.859506] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-30T18:08:30.075990] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:30.103950] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-30T18:08:30.122956] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:30.129218] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-30T18:08:30.128978] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:08:30.140292] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:30.157983] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-30T18:08:30.176605] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-30T18:08:30.181902] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-30T18:08:30.176474] [INFO ] [REMOTE ] CTBB: Full fetch complete (10878 records). [2025-09-30T18:08:30.205020] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-30T18:08:30.205182] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-30T18:08:30.205320] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTEV took 1.5s. Estimated remaining: 3h 49m 19s. Rate: 8.0 symbols/min [2025-09-30T18:08:30.228720] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:30.605710] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:30.659488] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-30T18:08:30.893854] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-30T18:08:30.894103] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-30T18:08:30.893997] [DEBUG] [LOCAL ] CTOS: Loaded 36520 existing records from primary storage. [2025-09-30T18:08:30.894630] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-30T18:08:30.894754] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-30T18:08:30.895699] [INFO ] [MAIN ] CTOS: Loaded 36520 existing records. [2025-09-30T18:08:30.895850] [DEBUG] [LOCAL ] CTBB: Trimmed 10878 records to 7058 (keeping 200 days of data) [2025-09-30T18:08:31.064472] [DEBUG] [LOCAL ] CTBB: Primary data saved (7058 records). [2025-09-30T18:08:31.074996] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-30T18:08:31.080280] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTBB took 28.1s. Estimated remaining: 3h 48m 49s. Rate: 8.0 symbols/min [2025-09-30T18:08:31.151683] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:31.208339] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-30T18:08:31.208439] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-30T18:08:31.221885] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-30T18:08:31.240463] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-30T18:08:31.457816] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-30T18:08:31.549114] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:31.785539] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:31.826009] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-09-30T18:08:31.826358] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-09-30T18:08:32.024187] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:32.024590] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-30T18:08:32.024699] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-30T18:08:32.032406] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-30T18:08:32.044506] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-30T18:08:32.109076] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T18:08:32.255777] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-30T18:08:32.470137] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:32.485588] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:08:33.054329] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-30T18:08:33.128747] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T18:08:33.854385] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-30T18:08:34.078010] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:08:34.654416] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-30T18:08:35.454386] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-30T18:08:35.651908] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:08:35.958568] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:08:36.046357] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:08:36.049913] [INFO ] [REMOTE ] CSV: Full fetch complete (19429 records). [2025-09-30T18:08:36.050030] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-30T18:08:36.259635] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-30T18:08:36.447480] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-30T18:08:36.447568] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-30T18:08:36.448037] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-30T18:08:36.448101] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-30T18:08:36.448795] [DEBUG] [LOCAL ] CSV: Trimmed 19429 records to 12824 (keeping 200 days of data) [2025-09-30T18:08:36.540988] [DEBUG] [LOCAL ] CSV: Primary data saved (12824 records). [2025-09-30T18:08:36.541142] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-30T18:08:36.541221] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CSV took 40.5s. Estimated remaining: 3h 48m 35s. Rate: 8.0 symbols/min [2025-09-30T18:08:36.732084] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:36.787911] [DEBUG] [LOCAL ] CTRE: Loaded 49220 existing records from primary storage. [2025-09-30T18:08:36.788275] [INFO ] [MAIN ] CTRE: Loaded 49220 existing records. [2025-09-30T18:08:36.975236] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:36.975568] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-30T18:08:36.975673] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-30T18:08:36.976122] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-30T18:08:36.976180] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-30T18:08:37.059521] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-30T18:08:37.371233] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:37.854403] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-30T18:08:37.917348] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:08:38.278582] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T18:08:38.654365] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-30T18:08:39.184110] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:08:39.454437] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-30T18:08:40.234859] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:08:40.254317] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-30T18:08:40.784479] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:08:41.054401] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-30T18:08:41.854333] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-30T18:08:41.919176] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:08:42.475909] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:08:42.627833] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:08:42.654351] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-30T18:08:43.454359] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-30T18:08:43.858033] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:08:44.254360] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-30T18:08:45.001726] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:08:45.054355] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-30T18:08:45.854345] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-30T18:08:45.962954] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:08:46.462868] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:08:46.654357] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-30T18:08:47.386813] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:08:47.454319] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-30T18:08:47.918403] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:08:48.254367] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-30T18:08:48.554246] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:08:49.054349] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-30T18:08:49.084990] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:08:49.854381] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-30T18:08:50.596348] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:08:50.654316] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-30T18:08:51.280032] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:08:51.454371] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-30T18:08:52.254377] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-30T18:08:52.401498] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T18:08:52.570181] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:08:53.054353] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-30T18:08:53.658605] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:08:53.854359] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-30T18:08:54.654332] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-30T18:08:54.715291] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:08:55.454333] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-30T18:08:55.683023] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:08:56.099551] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:08:56.254394] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-30T18:08:56.792963] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:08:57.054356] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-30T18:08:57.854331] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-30T18:08:57.967331] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:08:58.497052] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:08:58.505277] [INFO ] [REMOTE ] CTOS: Full fetch complete (53476 records). [2025-09-30T18:08:58.505436] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-30T18:08:58.661577] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-30T18:08:58.864441] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:08:58.948870] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-30T18:08:58.949000] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-30T18:08:58.949745] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-30T18:08:58.949852] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-30T18:08:58.951150] [DEBUG] [LOCAL ] CTOS: Trimmed 53476 records to 36496 (keeping 200 days of data) [2025-09-30T18:08:59.166044] [DEBUG] [LOCAL ] CTOS: Primary data saved (36496 records). [2025-09-30T18:08:59.166188] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-30T18:08:59.166275] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTOS took 28.9s. Estimated remaining: 3h 49m 18s. Rate: 8.0 symbols/min [2025-09-30T18:08:59.371405] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:59.410624] [DEBUG] [LOCAL ] CTRI: Loaded 38199 existing records from primary storage. [2025-09-30T18:08:59.410962] [INFO ] [MAIN ] CTRI: Loaded 38199 existing records. [2025-09-30T18:08:59.461909] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-30T18:08:59.623529] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:59.623801] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-30T18:08:59.623870] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-30T18:08:59.624200] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-30T18:08:59.624260] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-30T18:09:00.035965] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:00.254367] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-30T18:09:00.316265] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:09:01.054365] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-30T18:09:01.475334] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:09:01.513312] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:09:01.854373] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-30T18:09:02.654422] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-30T18:09:02.879265] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:09:03.454348] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-30T18:09:03.796459] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:09:03.808905] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-30T18:09:03.809182] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-30T18:09:03.889113] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T18:09:03.945679] [INFO ] [REMOTE ] CTO: Full fetch complete (41779 records). [2025-09-30T18:09:03.956378] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-30T18:09:04.269853] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-30T18:09:04.637622] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-30T18:09:04.641173] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-30T18:09:04.642104] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-30T18:09:04.642338] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-30T18:09:04.741520] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-30T18:09:04.741741] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 53648 (keeping 200 days of data) [2025-09-30T18:09:04.741816] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-30T18:09:04.742958] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-30T18:09:04.743455] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-30T18:09:04.833992] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:09:04.871485] [DEBUG] [LOCAL ] CTO: Trimmed 41779 records to 27915 (keeping 200 days of data) [2025-09-30T18:09:05.083464] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-30T18:09:05.211702] [DEBUG] [LOCAL ] CTO: Primary data saved (27915 records). [2025-09-30T18:09:05.213807] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-30T18:09:05.216612] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 35.9s. Estimated remaining: 3h 49m 5s. Rate: 8.0 symbols/min [2025-09-30T18:09:05.484242] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:05.500007] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-09-30T18:09:05.500166] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-30T18:09:05.500352] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 34.4s. Estimated remaining: 3h 48m 33s. Rate: 8.0 symbols/min [2025-09-30T18:09:05.626134] [DEBUG] [LOCAL ] CTS: Loaded 19346 existing records from primary storage. [2025-09-30T18:09:05.632195] [INFO ] [MAIN ] CTS: Loaded 19346 existing records. [2025-09-30T18:09:05.808882] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:05.912622] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:05.913091] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-30T18:09:05.913141] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-30T18:09:05.913338] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-30T18:09:05.913396] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-30T18:09:06.246160] [DEBUG] [LOCAL ] CTVA: Loaded 53232 existing records from primary storage. [2025-09-30T18:09:06.291143] [INFO ] [MAIN ] CTVA: Loaded 53232 existing records. [2025-09-30T18:09:06.452866] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:06.517766] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-30T18:09:06.604137] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:09:06.614858] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T18:09:06.655314] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-30T18:09:06.750241] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:06.751070] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-30T18:09:06.751137] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-30T18:09:06.751905] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-30T18:09:06.751974] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-30T18:09:07.354873] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:07.454443] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-30T18:09:07.640946] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:09:07.740542] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T18:09:08.254405] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-30T18:09:09.054375] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-30T18:09:09.138904] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:09:09.649071] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:09:09.854395] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-30T18:09:10.645574] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:09:10.656350] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-30T18:09:10.658295] [INFO ] [REMOTE ] CTRE: Full fetch complete (71128 records). [2025-09-30T18:09:10.658412] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-30T18:09:11.085627] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-30T18:09:11.085745] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-30T18:09:11.086566] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-30T18:09:11.086612] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-30T18:09:11.088093] [DEBUG] [LOCAL ] CTRE: Trimmed 71128 records to 49202 (keeping 200 days of data) [2025-09-30T18:09:11.399722] [DEBUG] [LOCAL ] CTRE: Primary data saved (49202 records). [2025-09-30T18:09:11.399885] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-30T18:09:11.399981] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 34.9s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-09-30T18:09:11.458708] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-30T18:09:11.592980] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:11.593445] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-30T18:09:11.593503] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-30T18:09:11.593677] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-30T18:09:11.593756] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-30T18:09:11.593842] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-30T18:09:11.593890] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-30T18:09:11.794520] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T18:09:12.039503] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:12.254335] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-30T18:09:12.698619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T18:09:12.901777] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:09:13.054354] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-30T18:09:13.854380] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-30T18:09:14.168762] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-30T18:09:14.402110] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:09:14.654390] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-30T18:09:15.454412] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-30T18:09:15.792854] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:09:16.254342] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-30T18:09:16.409711] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (5.75 seconds). [2025-09-30T18:09:16.630776] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:09:16.644533] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T18:09:17.054545] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-30T18:09:17.396710] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:09:17.854386] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-30T18:09:18.113145] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-30T18:09:18.654332] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-30T18:09:19.454390] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-30T18:09:20.061473] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T18:09:20.254376] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-30T18:09:20.332394] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T18:09:21.054360] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-30T18:09:21.854331] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-30T18:09:21.978346] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:09:21.989163] [INFO ] [REMOTE ] CTRI: Full fetch complete (51691 records). [2025-09-30T18:09:21.989318] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-30T18:09:22.394178] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-30T18:09:22.394273] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-30T18:09:22.395037] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-30T18:09:22.395109] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-30T18:09:22.396387] [DEBUG] [LOCAL ] CTRI: Trimmed 51691 records to 38422 (keeping 200 days of data) [2025-09-30T18:09:22.631318] [DEBUG] [LOCAL ] CTRI: Primary data saved (38422 records). [2025-09-30T18:09:22.631469] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-30T18:09:22.631557] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 23.5s. Estimated remaining: 3h 48m 25s. Rate: 8.0 symbols/min [2025-09-30T18:09:22.665594] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-30T18:09:22.821633] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:22.873127] [DEBUG] [LOCAL ] CUBE: Loaded 50626 existing records from primary storage. [2025-09-30T18:09:22.873466] [INFO ] [MAIN ] CUBE: Loaded 50626 existing records. [2025-09-30T18:09:23.023702] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:09:23.084912] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:23.091089] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-30T18:09:23.091159] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-30T18:09:23.091483] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-30T18:09:23.091548] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-30T18:09:23.175445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-30T18:09:23.241837] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T18:09:23.459501] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-30T18:09:23.530373] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:23.772434] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T18:09:24.254435] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-30T18:09:25.054377] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-30T18:09:25.422553] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-30T18:09:25.854350] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-30T18:09:26.108217] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:09:26.191357] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T18:09:26.654354] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-30T18:09:27.454400] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-30T18:09:28.254372] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-30T18:09:28.497907] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:09:28.724786] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:09:29.054330] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-30T18:09:29.077385] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T18:09:29.507417] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T18:09:29.508230] [INFO ] [REMOTE ] CUBB: Full fetch complete (929 records). [2025-09-30T18:09:29.508301] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-30T18:09:29.711724] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-30T18:09:29.711923] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:09:29.711995] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:09:29.712069] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-30T18:09:29.712137] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-30T18:09:29.712178] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-30T18:09:29.712238] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-30T18:09:29.712320] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CUBB took 18.3s. Estimated remaining: 3h 48m 16s. Rate: 8.0 symbols/min [2025-09-30T18:09:29.860614] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-30T18:09:29.920629] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:29.948368] [DEBUG] [LOCAL ] CUBI: Loaded 27225 existing records from primary storage. [2025-09-30T18:09:29.948673] [INFO ] [MAIN ] CUBI: Loaded 27225 existing records. [2025-09-30T18:09:30.145889] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:30.146371] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-30T18:09:30.146514] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-30T18:09:30.146777] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-30T18:09:30.146837] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-30T18:09:30.534861] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:30.654391] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-30T18:09:31.120477] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:09:31.454380] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-30T18:09:31.863304] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T18:09:32.254358] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-30T18:09:32.835295] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:09:33.054372] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-30T18:09:33.854334] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-30T18:09:33.911557] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T18:09:34.205252] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:09:34.583861] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:09:34.654324] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-30T18:09:35.454341] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-30T18:09:35.805941] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T18:09:36.254358] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-30T18:09:36.966572] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T18:09:37.054371] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-30T18:09:37.600184] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:09:37.850716] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:09:37.855377] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-30T18:09:38.654409] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-30T18:09:39.454351] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-30T18:09:39.497626] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:09:39.523619] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T18:09:40.254332] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-30T18:09:40.490117] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:09:40.494719] [INFO ] [REMOTE ] CTS: Full fetch complete (26709 records). [2025-09-30T18:09:40.494874] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-30T18:09:40.892928] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-30T18:09:40.893017] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-30T18:09:40.893576] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-30T18:09:40.893664] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-30T18:09:40.894466] [DEBUG] [LOCAL ] CTS: Trimmed 26709 records to 19345 (keeping 200 days of data) [2025-09-30T18:09:41.015513] [DEBUG] [LOCAL ] CTS: Primary data saved (19345 records). [2025-09-30T18:09:41.015687] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-30T18:09:41.015871] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTS took 35.8s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-09-30T18:09:41.062170] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-30T18:09:41.206208] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:41.264512] [DEBUG] [LOCAL ] CUK: Loaded 50998 existing records from primary storage. [2025-09-30T18:09:41.264986] [INFO ] [MAIN ] CUK: Loaded 50998 existing records. [2025-09-30T18:09:41.481799] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:41.482023] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-30T18:09:41.482074] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-30T18:09:41.482309] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-30T18:09:41.482369] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-30T18:09:41.855361] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-30T18:09:41.925009] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:41.963791] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:09:42.654318] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-30T18:09:42.876571] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:09:43.130632] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T18:09:43.454393] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-30T18:09:44.254370] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-30T18:09:44.375033] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:09:44.774844] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T18:09:45.054395] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-30T18:09:45.854342] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-30T18:09:46.084587] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:09:46.577408] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:09:46.654363] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-30T18:09:46.891285] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:09:47.454376] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-30T18:09:48.139004] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:09:48.254330] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-30T18:09:49.054373] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-30T18:09:49.217075] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:09:49.228791] [INFO ] [REMOTE ] CTVA: Full fetch complete (76975 records). [2025-09-30T18:09:49.229014] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-30T18:09:49.673545] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-30T18:09:49.673804] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-30T18:09:49.675097] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-30T18:09:49.675223] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-30T18:09:49.687754] [DEBUG] [LOCAL ] CTVA: Trimmed 76975 records to 53236 (keeping 200 days of data) [2025-09-30T18:09:49.709150] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:09:49.900117] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-30T18:09:50.056943] [DEBUG] [LOCAL ] CTVA: Primary data saved (53236 records). [2025-09-30T18:09:50.057091] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-30T18:09:50.057280] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 44.6s. Estimated remaining: 3h 48m 18s. Rate: 8.0 symbols/min [2025-09-30T18:09:50.247995] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:50.253853] [DEBUG] [LOCAL ] CULP: Loaded 2994 existing records from primary storage. [2025-09-30T18:09:50.254029] [INFO ] [MAIN ] CULP: Loaded 2994 existing records. [2025-09-30T18:09:50.449541] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:50.449806] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-30T18:09:50.449868] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-30T18:09:50.450035] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-30T18:09:50.450116] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-30T18:09:50.677176] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-30T18:09:50.843540] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:50.878130] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:09:51.454342] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-30T18:09:51.654394] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:09:51.806013] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:09:51.818254] [INFO ] [REMOTE ] CUBE: Full fetch complete (73008 records). [2025-09-30T18:09:51.818528] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-30T18:09:52.026611] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T18:09:52.262886] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-30T18:09:52.288047] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-30T18:09:52.288130] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-30T18:09:52.289124] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-30T18:09:52.289190] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-30T18:09:52.290823] [DEBUG] [LOCAL ] CUBE: Trimmed 73008 records to 50616 (keeping 200 days of data) [2025-09-30T18:09:52.612260] [DEBUG] [LOCAL ] CUBE: Primary data saved (50616 records). [2025-09-30T18:09:52.612409] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-30T18:09:52.612524] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 30.0s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min [2025-09-30T18:09:52.734438] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T18:09:52.815173] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:52.815401] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-09-30T18:09:52.815462] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-09-30T18:09:52.815624] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-30T18:09:52.815709] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-30T18:09:52.815765] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-09-30T18:09:52.815800] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-30T18:09:53.059563] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-30T18:09:53.214312] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:53.854392] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-30T18:09:54.654377] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-30T18:09:54.948895] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T18:09:55.212632] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:09:55.454362] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-30T18:09:56.000349] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:09:56.254354] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-30T18:09:56.639299] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T18:09:57.054335] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-30T18:09:57.381549] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:09:57.854353] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-30T18:09:58.356750] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:09:58.654373] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-30T18:09:59.454386] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-30T18:09:59.653325] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:09:59.698251] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:09:59.705466] [INFO ] [REMOTE ] CUBI: Full fetch complete (39346 records). [2025-09-30T18:09:59.705693] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-30T18:10:00.245004] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-30T18:10:00.245135] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-30T18:10:00.245945] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-30T18:10:00.246025] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-30T18:10:00.247394] [DEBUG] [LOCAL ] CUBI: Trimmed 39346 records to 27167 (keeping 200 days of data) [2025-09-30T18:10:00.254428] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-30T18:10:00.482856] [DEBUG] [LOCAL ] CUBI: Primary data saved (27167 records). [2025-09-30T18:10:00.483045] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-30T18:10:00.483177] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 30.8s. Estimated remaining: 3h 47m 48s. Rate: 8.0 symbols/min [2025-09-30T18:10:01.001513] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:10:01.054326] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-30T18:10:01.854409] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-30T18:10:02.439489] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:10:02.443315] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-30T18:10:02.522236] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:10:02.654375] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-30T18:10:03.273348] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:10:03.454398] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-30T18:10:04.254375] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-30T18:10:04.727561] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:10:04.770122] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T18:10:05.054366] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-30T18:10:05.854376] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-30T18:10:06.654366] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-30T18:10:06.972539] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:10:07.189459] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T18:10:07.396081] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:10:07.454406] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-30T18:10:08.254385] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-30T18:10:09.062103] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-30T18:10:09.083804] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:10:09.186177] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:10:09.647521] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:10:09.854386] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-30T18:10:10.654435] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-30T18:10:11.183708] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:10:11.454419] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-30T18:10:12.254356] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-30T18:10:12.439445] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:10:12.633889] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T18:10:12.641365] [INFO ] [REMOTE ] CURB: Full fetch complete (47204 records). [2025-09-30T18:10:12.641503] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-30T18:10:12.971796] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T18:10:13.054695] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-30T18:10:13.068017] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-30T18:10:13.068094] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-30T18:10:13.068902] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-30T18:10:13.068993] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-30T18:10:13.070255] [DEBUG] [LOCAL ] CURB: Trimmed 47204 records to 32587 (keeping 200 days of data) [2025-09-30T18:10:13.275069] [DEBUG] [LOCAL ] CURB: Primary data saved (32587 records). [2025-09-30T18:10:13.275253] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-30T18:10:13.275355] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CURB took 20.7s. Estimated remaining: 3h 47m 58s. Rate: 8.0 symbols/min [2025-09-30T18:10:13.854395] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-30T18:10:14.299152] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:10:14.654395] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-30T18:10:14.979578] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:10:15.383785] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T18:10:15.385384] [INFO ] [REMOTE ] CULP: Full fetch complete (4736 records). [2025-09-30T18:10:15.385503] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-30T18:10:15.460728] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-30T18:10:15.835074] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-30T18:10:15.835164] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-30T18:10:15.835317] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-30T18:10:15.835389] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-30T18:10:15.835893] [DEBUG] [LOCAL ] CULP: Trimmed 4736 records to 2957 (keeping 200 days of data) [2025-09-30T18:10:15.853077] [DEBUG] [LOCAL ] CULP: Primary data saved (2957 records). [2025-09-30T18:10:15.853202] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-30T18:10:15.853283] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 25.8s. Estimated remaining: 3h 47m 34s. Rate: 8.0 symbols/min [2025-09-30T18:10:19.717241] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (4.26 seconds). [2025-09-30T18:10:19.731840] [INFO ] [REMOTE ] CUK: Full fetch complete (73464 records). [2025-09-30T18:10:19.732074] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-30T18:10:19.733211] [FATAL] [VALIDATOR ] CUK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:10:19.733366] [FATAL] [MAIN ] CUK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:10:19.733414] [WARN ] [MAIN ] CUK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:10:19.733470] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-30T18:10:19.733558] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-09-30T18:10:19.733612] [INFO ] [LOCAL ] CUK: Starting deletion of derivative data. [2025-09-30T18:10:19.733923] [DEBUG] [LOCAL ] CUK: Deleted derivative data file. [2025-09-30T18:10:19.734062] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 38.7s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-09-30T18:10:20.442342] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.487092] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.494289] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.595918] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.598149] [DEBUG] [LOCAL ] CVEO: Loaded 15098 existing records from primary storage. [2025-09-30T18:10:20.599258] [INFO ] [MAIN ] CVEO: Loaded 15098 existing records. [2025-09-30T18:10:20.827776] [DEBUG] [LOCAL ] CURV: Loaded 26507 existing records from primary storage. [2025-09-30T18:10:20.886477] [DEBUG] [LOCAL ] CUZ: Loaded 49357 existing records from primary storage. [2025-09-30T18:10:20.892109] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:20.886702] [INFO ] [MAIN ] CURV: Loaded 26507 existing records. [2025-09-30T18:10:20.893511] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-30T18:10:20.893744] [INFO ] [MAIN ] CUZ: Loaded 49357 existing records. [2025-09-30T18:10:20.904728] [INFO ] [MAIN ] CVE: Loaded 53557 existing records. [2025-09-30T18:10:20.893981] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-30T18:10:20.923781] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-30T18:10:20.993868] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-30T18:10:21.082740] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-30T18:10:21.560577] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.596589] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.628543] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.633895] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-30T18:10:21.644025] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.649316] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-30T18:10:21.649530] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-30T18:10:21.649462] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-30T18:10:21.643747] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.747952] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-30T18:10:21.737487] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.758768] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-30T18:10:21.774977] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-30T18:10:21.871732] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-30T18:10:21.920723] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-30T18:10:22.620992] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:22.801733] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-30T18:10:23.083322] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.116019] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.121908] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-30T18:10:23.139721] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-30T18:10:23.197921] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.199940] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-30T18:10:23.885276] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:10:23.888380] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-30T18:10:24.525169] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:10:24.533417] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-30T18:10:24.652468] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T18:10:24.654841] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-30T18:10:25.032124] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:10:25.042141] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-30T18:10:25.322494] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-30T18:10:25.334991] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-30T18:10:25.345712] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:10:25.351107] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-30T18:10:25.371920] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T18:10:25.379485] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-30T18:10:26.334240] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:10:26.338689] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-30T18:10:26.419589] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:10:26.425122] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-30T18:10:26.666560] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:10:26.676462] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-30T18:10:27.083099] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T18:10:27.325004] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T18:10:27.454376] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-30T18:10:27.604507] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:10:27.884699] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T18:10:28.254386] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-30T18:10:28.899323] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:10:29.054345] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-30T18:10:29.343499] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:10:29.854374] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-30T18:10:30.636140] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:10:30.654340] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-30T18:10:30.970267] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T18:10:31.454333] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-30T18:10:31.619630] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:10:32.254412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-30T18:10:32.390768] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T18:10:33.054410] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-30T18:10:33.834086] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:10:33.854354] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-30T18:10:33.866319] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:10:34.654400] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-30T18:10:35.309154] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:10:35.454411] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-30T18:10:36.254444] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-30T18:10:36.440469] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:10:36.796408] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:10:37.054397] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-30T18:10:37.854379] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-30T18:10:37.905034] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:10:38.654403] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-30T18:10:38.917808] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:10:39.306432] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:10:39.454408] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-30T18:10:40.254456] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-30T18:10:40.291145] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:10:41.054416] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-30T18:10:41.291892] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T18:10:41.607410] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:10:41.854379] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-30T18:10:41.890771] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:10:42.654371] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-30T18:10:43.271996] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:10:43.280126] [INFO ] [REMOTE ] CURV: Full fetch complete (39027 records). [2025-09-30T18:10:43.280246] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-30T18:10:43.454339] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-30T18:10:43.687796] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-30T18:10:43.687911] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-30T18:10:43.688606] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-30T18:10:43.688700] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-30T18:10:43.689786] [DEBUG] [LOCAL ] CURV: Trimmed 39027 records to 26521 (keeping 200 days of data) [2025-09-30T18:10:43.849301] [DEBUG] [LOCAL ] CURV: Primary data saved (26521 records). [2025-09-30T18:10:43.849529] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-30T18:10:43.849685] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 24.1s. Estimated remaining: 3h 48m 1s. Rate: 7.9 symbols/min [2025-09-30T18:10:44.070502] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:44.105545] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:10:44.171394] [DEBUG] [LOCAL ] CVI: Loaded 46430 existing records from primary storage. [2025-09-30T18:10:44.171799] [INFO ] [MAIN ] CVI: Loaded 46430 existing records. [2025-09-30T18:10:44.259546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-30T18:10:44.370819] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:44.371024] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-30T18:10:44.371072] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-30T18:10:44.371420] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-30T18:10:44.371483] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-30T18:10:44.780934] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:45.054411] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-30T18:10:45.399104] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:10:45.854340] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-30T18:10:46.048479] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:10:46.485663] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T18:10:46.489237] [INFO ] [REMOTE ] CVEO: Full fetch complete (20148 records). [2025-09-30T18:10:46.489352] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-30T18:10:46.489937] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:10:46.490029] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:10:46.490074] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:10:46.490140] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-30T18:10:46.490207] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-30T18:10:46.490244] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-09-30T18:10:46.490467] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-09-30T18:10:46.490603] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 26.8s. Estimated remaining: 3h 47m 37s. Rate: 7.9 symbols/min [2025-09-30T18:10:46.659746] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-30T18:10:46.691332] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:46.726684] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:10:46.747743] [DEBUG] [LOCAL ] CVLG: Loaded 15540 existing records from primary storage. [2025-09-30T18:10:46.748010] [INFO ] [MAIN ] CVLG: Loaded 15540 existing records. [2025-09-30T18:10:46.949573] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:46.949992] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-30T18:10:46.950054] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-30T18:10:46.950708] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-30T18:10:46.950770] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-30T18:10:47.355895] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:47.454411] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-30T18:10:48.254433] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-30T18:10:48.431305] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:10:48.442791] [INFO ] [REMOTE ] CUZ: Full fetch complete (70862 records). [2025-09-30T18:10:48.442959] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-30T18:10:48.879063] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-30T18:10:48.879331] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-30T18:10:48.880416] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-30T18:10:48.880560] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-30T18:10:48.882401] [DEBUG] [LOCAL ] CUZ: Trimmed 70862 records to 49350 (keeping 200 days of data) [2025-09-30T18:10:49.032675] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:10:49.057243] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-30T18:10:49.262704] [DEBUG] [LOCAL ] CUZ: Primary data saved (49350 records). [2025-09-30T18:10:49.262864] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-30T18:10:49.262958] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 29.5s. Estimated remaining: 3h 47m 14s. Rate: 8.0 symbols/min [2025-09-30T18:10:49.452006] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:49.505041] [DEBUG] [LOCAL ] CVNA: Loaded 52985 existing records from primary storage. [2025-09-30T18:10:49.505372] [INFO ] [MAIN ] CVNA: Loaded 52985 existing records. [2025-09-30T18:10:49.702456] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:49.702702] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-30T18:10:49.702765] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-30T18:10:49.703009] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-30T18:10:49.703070] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-30T18:10:49.863276] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-30T18:10:49.915795] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:10:50.119942] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:50.153868] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:10:50.654357] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-30T18:10:51.454354] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-30T18:10:51.548132] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:10:52.254370] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-30T18:10:52.647369] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:10:53.054331] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-30T18:10:53.367796] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:10:53.384614] [INFO ] [REMOTE ] CVE: Full fetch complete (77554 records). [2025-09-30T18:10:53.384830] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-30T18:10:53.824211] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-30T18:10:53.824429] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-30T18:10:53.825393] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-30T18:10:53.825494] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-30T18:10:53.827407] [DEBUG] [LOCAL ] CVE: Trimmed 77554 records to 53556 (keeping 200 days of data) [2025-09-30T18:10:53.894843] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-30T18:10:53.960219] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:10:54.235156] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-09-30T18:10:54.235313] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-30T18:10:54.236355] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 34.5s. Estimated remaining: 3h 46m 59s. Rate: 8.0 symbols/min [2025-09-30T18:10:54.436122] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:54.498838] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-09-30T18:10:54.499170] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-09-30T18:10:54.660138] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-30T18:10:54.704971] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:54.705191] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-30T18:10:54.705240] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-30T18:10:54.705540] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-30T18:10:54.705601] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-30T18:10:55.115153] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:55.168321] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:10:55.176130] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T18:10:55.454380] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-30T18:10:56.231917] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T18:10:56.254365] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-30T18:10:56.566593] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:10:57.054372] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-30T18:10:57.854375] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-30T18:10:58.659360] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-30T18:10:58.666769] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-30T18:10:58.676089] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T18:10:59.000429] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T18:10:59.454389] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-30T18:11:00.232787] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:11:00.260843] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-30T18:11:00.266450] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:11:01.054411] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-30T18:11:01.854396] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-30T18:11:02.580846] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T18:11:02.654365] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-30T18:11:02.845621] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T18:11:03.177746] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T18:11:03.454374] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-30T18:11:04.254389] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-30T18:11:04.957477] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T18:11:05.054359] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-30T18:11:05.493546] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:11:05.615220] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-30T18:11:05.854409] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-30T18:11:06.654369] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-30T18:11:06.820837] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:11:06.903313] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:11:07.454349] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-30T18:11:08.254319] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-30T18:11:08.413342] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:11:08.636538] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T18:11:09.054385] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-30T18:11:09.578662] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:11:09.854374] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-30T18:11:10.654322] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-30T18:11:10.740970] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:11:11.196190] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:11:11.454413] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-30T18:11:12.243762] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:11:12.257525] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-30T18:11:13.054383] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-30T18:11:13.201561] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:11:13.205089] [INFO ] [REMOTE ] CVLG: Full fetch complete (20863 records). [2025-09-30T18:11:13.205197] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-30T18:11:13.629637] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T18:11:13.678231] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-30T18:11:13.678333] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-30T18:11:13.679088] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-30T18:11:13.679142] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-30T18:11:13.680281] [DEBUG] [LOCAL ] CVLG: Trimmed 20863 records to 15513 (keeping 200 days of data) [2025-09-30T18:11:13.781319] [DEBUG] [LOCAL ] CVLG: Primary data saved (15513 records). [2025-09-30T18:11:13.781469] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-30T18:11:13.781571] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 27.3s. Estimated remaining: 3h 47m 29s. Rate: 7.9 symbols/min [2025-09-30T18:11:13.861168] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-30T18:11:13.966068] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:14.028291] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-30T18:11:14.028784] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-30T18:11:14.217704] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:14.217981] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-30T18:11:14.218040] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-30T18:11:14.222105] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-30T18:11:14.222172] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-30T18:11:14.612034] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:14.654332] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-30T18:11:14.927402] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T18:11:14.938118] [INFO ] [REMOTE ] CVI: Full fetch complete (67322 records). [2025-09-30T18:11:14.938309] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-30T18:11:15.359406] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-30T18:11:15.359529] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-30T18:11:15.360488] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-30T18:11:15.360562] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-30T18:11:15.362170] [DEBUG] [LOCAL ] CVI: Trimmed 67322 records to 46463 (keeping 200 days of data) [2025-09-30T18:11:15.459036] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-30T18:11:15.664355] [DEBUG] [LOCAL ] CVI: Primary data saved (46463 records). [2025-09-30T18:11:15.664489] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-30T18:11:15.664571] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 31.8s. Estimated remaining: 3h 47m 4s. Rate: 7.9 symbols/min [2025-09-30T18:11:15.854305] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:15.891905] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T18:11:15.921385] [DEBUG] [LOCAL ] CW: Loaded 22246 existing records from primary storage. [2025-09-30T18:11:15.921707] [INFO ] [MAIN ] CW: Loaded 22246 existing records. [2025-09-30T18:11:16.121898] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:16.122156] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-30T18:11:16.122214] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-30T18:11:16.122500] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-30T18:11:16.122561] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-30T18:11:16.259609] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-30T18:11:16.536514] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:16.747500] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T18:11:17.054422] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-30T18:11:17.780369] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-30T18:11:17.854365] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-30T18:11:18.485048] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T18:11:18.654410] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-30T18:11:19.339931] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:11:19.454394] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-30T18:11:20.150606] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-30T18:11:20.254368] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-30T18:11:21.071385] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-30T18:11:21.075535] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T18:11:21.364126] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T18:11:21.702820] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T18:11:21.854427] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-30T18:11:22.654386] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-30T18:11:23.061986] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T18:11:23.093822] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:11:23.454384] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-30T18:11:24.254401] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-30T18:11:24.808068] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:11:24.819851] [INFO ] [REMOTE ] CVNA: Full fetch complete (76676 records). [2025-09-30T18:11:24.820037] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-30T18:11:25.075633] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-30T18:11:25.256029] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-30T18:11:25.256171] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-30T18:11:25.257248] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-30T18:11:25.257355] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-30T18:11:25.259394] [DEBUG] [LOCAL ] CVNA: Trimmed 76676 records to 52980 (keeping 200 days of data) [2025-09-30T18:11:25.371733] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T18:11:25.623001] [DEBUG] [LOCAL ] CVNA: Primary data saved (52980 records). [2025-09-30T18:11:25.623159] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-30T18:11:25.623251] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 36.4s. Estimated remaining: 3h 47m 4s. Rate: 7.9 symbols/min [2025-09-30T18:11:25.815606] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:25.851632] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-30T18:11:25.862505] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-30T18:11:25.915060] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-30T18:11:25.915424] [INFO ] [MAIN ] CWAN: Loaded 52393 existing records. [2025-09-30T18:11:26.108802] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:26.109010] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-30T18:11:26.109058] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-30T18:11:26.109347] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-30T18:11:26.109406] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-30T18:11:26.506611] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:26.654411] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-30T18:11:26.717192] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:11:26.908295] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:11:26.920328] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-30T18:11:26.920463] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-30T18:11:27.338509] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-30T18:11:27.338604] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-30T18:11:27.339601] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-30T18:11:27.339730] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-30T18:11:27.341456] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-09-30T18:11:27.458305] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-30T18:11:27.685761] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-09-30T18:11:27.685940] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-30T18:11:27.686609] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 33.5s. Estimated remaining: 3h 46m 39s. Rate: 8.0 symbols/min [2025-09-30T18:11:27.867398] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:27.912616] [DEBUG] [LOCAL ] CWEN: Loaded 44991 existing records from primary storage. [2025-09-30T18:11:27.912969] [INFO ] [MAIN ] CWEN: Loaded 44991 existing records. [2025-09-30T18:11:28.108403] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:28.108680] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-30T18:11:28.108789] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-30T18:11:28.109285] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-30T18:11:28.109348] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-30T18:11:28.261794] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-30T18:11:28.510015] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:28.540862] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:11:29.054365] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-30T18:11:29.470347] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:11:29.854356] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-30T18:11:29.911417] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T18:11:30.654351] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-30T18:11:30.823323] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T18:11:31.122727] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:11:31.454400] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-30T18:11:32.254401] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-30T18:11:32.946487] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:11:33.054388] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-30T18:11:33.279012] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-30T18:11:33.503065] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:11:33.854362] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-30T18:11:34.598972] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T18:11:34.654432] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-30T18:11:35.035219] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:11:35.454388] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-30T18:11:36.254399] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-30T18:11:37.054379] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-30T18:11:37.104011] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-30T18:11:37.854372] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-30T18:11:38.694493] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-30T18:11:38.700385] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-30T18:11:39.229005] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (3.77 seconds). [2025-09-30T18:11:39.454318] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-30T18:11:39.625364] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:11:39.714386] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:11:40.071991] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-30T18:11:40.254362] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-30T18:11:40.992286] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:11:41.054387] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-30T18:11:41.854330] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-30T18:11:41.887535] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:11:42.604357] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T18:11:42.654386] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-30T18:11:43.454381] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-30T18:11:44.101614] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:11:44.265876] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-30T18:11:44.272995] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T18:11:44.748843] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T18:11:44.753785] [INFO ] [REMOTE ] CW: Full fetch complete (33400 records). [2025-09-30T18:11:44.753943] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-30T18:11:45.059682] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-30T18:11:45.175543] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-30T18:11:45.175678] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-30T18:11:45.176425] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-30T18:11:45.176472] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-30T18:11:45.177775] [DEBUG] [LOCAL ] CW: Trimmed 33400 records to 22254 (keeping 200 days of data) [2025-09-30T18:11:45.330330] [DEBUG] [LOCAL ] CW: Primary data saved (22254 records). [2025-09-30T18:11:45.330540] [INFO ] [MAIN ] CW: Full history saved. [2025-09-30T18:11:45.330678] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 29.7s. Estimated remaining: 3h 47m 3s. Rate: 7.9 symbols/min [2025-09-30T18:11:45.525297] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:45.557040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:11:45.618861] [DEBUG] [LOCAL ] CWH: Loaded 51377 existing records from primary storage. [2025-09-30T18:11:45.619251] [INFO ] [MAIN ] CWH: Loaded 51377 existing records. [2025-09-30T18:11:45.819144] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:45.819388] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-30T18:11:45.819436] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-30T18:11:45.821093] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-30T18:11:45.821185] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-30T18:11:45.859527] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-30T18:11:46.252584] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:46.654403] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-30T18:11:47.454358] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-30T18:11:48.506094] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-30T18:11:48.517609] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-30T18:11:48.727805] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (3.67 seconds). [2025-09-30T18:11:49.054369] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-30T18:11:49.498835] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-30T18:11:49.854412] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-30T18:11:50.511605] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-09-30T18:11:50.654358] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-30T18:11:51.047212] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-30T18:11:51.414966] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T18:11:51.426885] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-30T18:11:51.427056] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-30T18:11:51.460811] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-30T18:11:51.870083] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-30T18:11:51.870323] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-30T18:11:51.871294] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-30T18:11:51.880535] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-30T18:11:51.900063] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-30T18:11:51.910773] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-30T18:11:52.254568] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-30T18:11:52.279610] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-30T18:11:52.279815] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-30T18:11:52.279909] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 38.5s. Estimated remaining: 3h 46m 54s. Rate: 7.9 symbols/min [2025-09-30T18:11:52.477477] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:52.533342] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:11:52.561525] [DEBUG] [LOCAL ] CWK: Loaded 49419 existing records from primary storage. [2025-09-30T18:11:52.561999] [INFO ] [MAIN ] CWK: Loaded 49419 existing records. [2025-09-30T18:11:52.783249] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:52.783617] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-30T18:11:52.783708] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-30T18:11:52.785396] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-30T18:11:52.785462] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-30T18:11:53.056736] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-30T18:11:53.190539] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:53.383792] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:11:53.756852] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:11:53.767205] [INFO ] [REMOTE ] CWEN: Full fetch complete (64518 records). [2025-09-30T18:11:53.767343] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-30T18:11:53.859630] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-30T18:11:54.196329] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-30T18:11:54.196507] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-30T18:11:54.197483] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-30T18:11:54.197613] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-30T18:11:54.199156] [DEBUG] [LOCAL ] CWEN: Trimmed 64518 records to 44975 (keeping 200 days of data) [2025-09-30T18:11:54.501501] [DEBUG] [LOCAL ] CWEN: Primary data saved (44975 records). [2025-09-30T18:11:54.501667] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-30T18:11:54.502768] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 26.8s. Estimated remaining: 3h 46m 30s. Rate: 7.9 symbols/min [2025-09-30T18:11:54.664858] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-30T18:11:54.704217] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:54.732505] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:11:54.767010] [DEBUG] [LOCAL ] CWT: Loaded 27821 existing records from primary storage. [2025-09-30T18:11:54.767364] [INFO ] [MAIN ] CWT: Loaded 27821 existing records. [2025-09-30T18:11:54.962285] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:54.962577] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-30T18:11:54.962627] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-30T18:11:54.963820] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-30T18:11:54.963882] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-30T18:11:55.349705] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:55.454368] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-30T18:11:55.775469] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:11:55.787215] [INFO ] [REMOTE ] CWAN: Full fetch complete (75114 records). [2025-09-30T18:11:55.787397] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-30T18:11:56.224795] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-30T18:11:56.224902] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-30T18:11:56.226193] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-30T18:11:56.226344] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-30T18:11:56.228428] [DEBUG] [LOCAL ] CWAN: Trimmed 75114 records to 52400 (keeping 200 days of data) [2025-09-30T18:11:56.278905] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-30T18:11:56.356184] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:11:56.622696] [DEBUG] [LOCAL ] CWAN: Primary data saved (52400 records). [2025-09-30T18:11:56.622873] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-30T18:11:56.623008] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 31.0s. Estimated remaining: 3h 46m 5s. Rate: 8.0 symbols/min [2025-09-30T18:11:56.854730] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:56.871752] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:11:56.927884] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-09-30T18:11:56.928243] [INFO ] [MAIN ] CX: Loaded 52822 existing records. [2025-09-30T18:11:57.059524] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-30T18:11:57.125730] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:57.125933] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-30T18:11:57.125983] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-30T18:11:57.127528] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-30T18:11:57.127604] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-30T18:11:57.506538] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:57.854378] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-30T18:11:58.035182] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T18:11:58.435492] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:11:58.654366] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-30T18:11:59.454392] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-30T18:11:59.547726] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:12:00.250638] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:12:00.259539] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-30T18:12:01.054378] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-30T18:12:01.211247] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:12:01.859497] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-30T18:12:01.883892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:12:02.611630] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:12:02.654391] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-30T18:12:03.454378] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-30T18:12:03.695124] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T18:12:04.260328] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-30T18:12:04.291516] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:12:05.054427] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-30T18:12:05.217101] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:12:05.604246] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:12:05.854367] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-30T18:12:06.352234] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:12:06.654407] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-30T18:12:07.253433] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:12:07.454367] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-30T18:12:08.183795] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:12:08.254341] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-30T18:12:09.054403] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-30T18:12:09.271804] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T18:12:09.800233] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:12:09.854379] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-30T18:12:10.666923] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-30T18:12:10.702136] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:12:10.820494] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:12:11.454394] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-30T18:12:12.254447] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-30T18:12:12.318173] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:12:13.054385] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-30T18:12:13.365747] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:12:13.386631] [INFO ] [REMOTE ] CWH: Full fetch complete (72930 records). [2025-09-30T18:12:13.387081] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-30T18:12:13.543513] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:12:13.867463] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-30T18:12:13.872818] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-30T18:12:13.872978] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-30T18:12:13.874240] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-30T18:12:13.874510] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-30T18:12:13.876765] [DEBUG] [LOCAL ] CWH: Trimmed 72930 records to 51357 (keeping 200 days of data) [2025-09-30T18:12:14.232224] [DEBUG] [LOCAL ] CWH: Primary data saved (51357 records). [2025-09-30T18:12:14.232459] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-30T18:12:14.232665] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 28.9s. Estimated remaining: 3h 46m 29s. Rate: 7.9 symbols/min [2025-09-30T18:12:14.412781] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:14.465273] [DEBUG] [LOCAL ] CXE: Loaded 6813 existing records from primary storage. [2025-09-30T18:12:14.468335] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:12:14.468873] [INFO ] [MAIN ] CXE: Loaded 6813 existing records. [2025-09-30T18:12:14.659580] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-30T18:12:14.664289] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:14.665722] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-30T18:12:14.665813] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-30T18:12:14.666258] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-30T18:12:14.666357] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-30T18:12:15.057274] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:15.145198] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T18:12:15.454438] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-30T18:12:16.254348] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-30T18:12:16.447841] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:12:16.669176] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:12:17.054634] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-30T18:12:17.777180] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:12:17.799476] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:12:17.854379] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-30T18:12:18.654476] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-30T18:12:19.445353] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:12:19.456011] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-30T18:12:19.531945] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:12:20.254376] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-30T18:12:20.752819] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:12:20.759193] [INFO ] [REMOTE ] CWT: Full fetch complete (40375 records). [2025-09-30T18:12:20.759339] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-30T18:12:21.057714] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-30T18:12:21.111412] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T18:12:21.191702] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-30T18:12:21.191802] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-30T18:12:21.192937] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-30T18:12:21.193015] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-30T18:12:21.194090] [DEBUG] [LOCAL ] CWT: Trimmed 40375 records to 27865 (keeping 200 days of data) [2025-09-30T18:12:21.365096] [DEBUG] [LOCAL ] CWT: Primary data saved (27865 records). [2025-09-30T18:12:21.365240] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-30T18:12:21.365339] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 26.9s. Estimated remaining: 3h 46m 20s. Rate: 7.9 symbols/min [2025-09-30T18:12:21.546865] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:21.554316] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-09-30T18:12:21.554667] [INFO ] [MAIN ] CXH: Loaded 4413 existing records. [2025-09-30T18:12:21.752977] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:21.753232] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-30T18:12:21.753303] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-30T18:12:21.753618] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-30T18:12:21.753750] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-30T18:12:21.862958] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-30T18:12:22.146254] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:22.654352] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-30T18:12:22.786546] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T18:12:22.829625] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:12:23.379615] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T18:12:23.454362] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-30T18:12:24.254397] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-30T18:12:24.718638] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T18:12:25.054423] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-30T18:12:25.254460] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T18:12:25.266315] [INFO ] [REMOTE ] CWK: Full fetch complete (70926 records). [2025-09-30T18:12:25.266475] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-30T18:12:25.667922] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-30T18:12:25.668021] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-30T18:12:25.669010] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-30T18:12:25.669080] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-30T18:12:25.670587] [DEBUG] [LOCAL ] CWK: Trimmed 70926 records to 49415 (keeping 200 days of data) [2025-09-30T18:12:25.874587] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-30T18:12:25.896705] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:12:25.980826] [DEBUG] [LOCAL ] CWK: Primary data saved (49415 records). [2025-09-30T18:12:25.981024] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-30T18:12:25.981234] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 33.7s. Estimated remaining: 3h 46m 3s. Rate: 7.9 symbols/min [2025-09-30T18:12:26.156434] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:26.207548] [DEBUG] [LOCAL ] CXM: Loaded 47791 existing records from primary storage. [2025-09-30T18:12:26.208032] [INFO ] [MAIN ] CXM: Loaded 47791 existing records. [2025-09-30T18:12:26.359389] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T18:12:26.399478] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:26.399819] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-30T18:12:26.399877] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-30T18:12:26.401309] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-30T18:12:26.401373] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-30T18:12:26.659679] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-30T18:12:26.771377] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:27.454397] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-30T18:12:27.890235] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T18:12:28.254387] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-30T18:12:28.422690] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:12:28.743155] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:12:29.054356] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-30T18:12:29.854370] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-30T18:12:30.501087] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:12:30.654382] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-30T18:12:30.814220] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:12:31.067108] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T18:12:31.454378] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-30T18:12:32.254390] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-30T18:12:32.862559] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:12:32.998756] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:12:33.054365] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-30T18:12:33.854384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-30T18:12:34.505274] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:12:34.654357] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-30T18:12:34.842388] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:12:35.385814] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:12:35.454363] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-30T18:12:36.254400] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-30T18:12:37.056854] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-30T18:12:37.063952] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T18:12:37.076488] [INFO ] [REMOTE ] CX: Full fetch complete (76388 records). [2025-09-30T18:12:37.076706] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-30T18:12:37.172186] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:12:37.506381] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-30T18:12:37.506497] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-30T18:12:37.507506] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-30T18:12:37.507610] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-30T18:12:37.509305] [DEBUG] [LOCAL ] CX: Trimmed 76388 records to 52828 (keeping 200 days of data) [2025-09-30T18:12:37.848080] [DEBUG] [LOCAL ] CX: Primary data saved (52828 records). [2025-09-30T18:12:37.848274] [INFO ] [MAIN ] CX: Full history saved. [2025-09-30T18:12:37.848400] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 41.2s. Estimated remaining: 3h 46m 9s. Rate: 7.9 symbols/min [2025-09-30T18:12:37.860695] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-30T18:12:38.043479] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:38.076244] [DEBUG] [LOCAL ] CXT: Loaded 31002 existing records from primary storage. [2025-09-30T18:12:38.076521] [INFO ] [MAIN ] CXT: Loaded 31002 existing records. [2025-09-30T18:12:38.280443] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:38.280858] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-30T18:12:38.280917] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-30T18:12:38.282232] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-30T18:12:38.282296] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-30T18:12:38.659208] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-30T18:12:38.714878] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:38.747753] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:12:38.796505] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:12:38.798983] [INFO ] [REMOTE ] CXE: Full fetch complete (11914 records). [2025-09-30T18:12:38.799057] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-30T18:12:39.237258] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-30T18:12:39.237351] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-30T18:12:39.237707] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-30T18:12:39.237771] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-30T18:12:39.238472] [DEBUG] [LOCAL ] CXE: Trimmed 11914 records to 6726 (keeping 200 days of data) [2025-09-30T18:12:39.280736] [DEBUG] [LOCAL ] CXE: Primary data saved (6726 records). [2025-09-30T18:12:39.280875] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-30T18:12:39.280962] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXE took 25.0s. Estimated remaining: 3h 45m 43s. Rate: 7.9 symbols/min [2025-09-30T18:12:39.459585] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-30T18:12:39.464196] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:39.516008] [DEBUG] [LOCAL ] CXW: Loaded 44141 existing records from primary storage. [2025-09-30T18:12:39.516366] [INFO ] [MAIN ] CXW: Loaded 44141 existing records. [2025-09-30T18:12:39.712960] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:39.720315] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-30T18:12:39.721432] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-30T18:12:39.721286] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:12:39.723752] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-30T18:12:39.724560] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-30T18:12:40.110347] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:40.254391] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-30T18:12:40.748612] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:12:40.914671] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-30T18:12:41.054393] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-30T18:12:41.734818] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:12:41.736465] [INFO ] [REMOTE ] CXH: Full fetch complete (5469 records). [2025-09-30T18:12:41.736546] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-30T18:12:41.859467] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-30T18:12:42.133523] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-30T18:12:42.133612] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-30T18:12:42.133798] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-30T18:12:42.133855] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-30T18:12:42.134255] [DEBUG] [LOCAL ] CXH: Trimmed 5469 records to 4412 (keeping 200 days of data) [2025-09-30T18:12:42.161457] [DEBUG] [LOCAL ] CXH: Primary data saved (4412 records). [2025-09-30T18:12:42.161596] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-30T18:12:42.161709] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 20.8s. Estimated remaining: 3h 45m 21s. Rate: 8.0 symbols/min [2025-09-30T18:12:42.351003] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:42.380204] [DEBUG] [LOCAL ] CYD: Loaded 26601 existing records from primary storage. [2025-09-30T18:12:42.380492] [INFO ] [MAIN ] CYD: Loaded 26601 existing records. [2025-09-30T18:12:42.577594] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:42.577860] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-30T18:12:42.577909] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-30T18:12:42.579666] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-30T18:12:42.579730] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-30T18:12:42.659481] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-30T18:12:42.968810] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:43.454337] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-30T18:12:43.681198] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:12:44.183659] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:12:44.254361] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-30T18:12:44.384315] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T18:12:45.054359] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-30T18:12:45.854339] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-30T18:12:45.937263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:12:46.394779] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:12:46.654361] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-30T18:12:47.258516] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:12:47.454376] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-30T18:12:47.564980] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T18:12:48.254357] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-30T18:12:48.996511] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:12:49.054329] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-30T18:12:49.096405] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:12:49.854367] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-30T18:12:50.407939] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T18:12:50.654350] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-30T18:12:51.454355] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-30T18:12:51.608512] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:12:51.717034] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:12:52.254381] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-30T18:12:52.976239] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:12:53.054368] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-30T18:12:53.540876] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:12:53.854364] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-30T18:12:54.463828] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T18:12:54.659480] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-30T18:12:54.674523] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T18:12:55.454425] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-30T18:12:56.254388] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-30T18:12:56.429577] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:12:56.473285] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:12:57.054423] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-30T18:12:57.812219] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T18:12:57.854583] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-30T18:12:58.545265] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:12:58.654390] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-30T18:12:59.223380] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:12:59.454448] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-30T18:13:00.254329] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-30T18:13:00.486615] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:13:01.049360] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:13:01.058962] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-30T18:13:01.606849] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:13:01.854374] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-30T18:13:02.642564] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:13:02.654312] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-30T18:13:03.244107] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:13:03.454370] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-30T18:13:04.254330] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-30T18:13:04.299263] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:13:04.947904] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T18:13:05.042462] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T18:13:05.054358] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-30T18:13:05.854377] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-30T18:13:06.654359] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-30T18:13:06.777925] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:13:06.788671] [INFO ] [REMOTE ] CXM: Full fetch complete (68834 records). [2025-09-30T18:13:06.788829] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-30T18:13:07.192329] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:13:07.241063] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-30T18:13:07.241166] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-30T18:13:07.242052] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-30T18:13:07.242121] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-30T18:13:07.244037] [DEBUG] [LOCAL ] CXM: Trimmed 68834 records to 47695 (keeping 200 days of data) [2025-09-30T18:13:07.454526] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-30T18:13:07.543537] [DEBUG] [LOCAL ] CXM: Primary data saved (47695 records). [2025-09-30T18:13:07.543757] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-30T18:13:07.543907] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 41.6s. Estimated remaining: 3h 46m 8s. Rate: 7.9 symbols/min [2025-09-30T18:13:07.755768] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:07.801741] [DEBUG] [LOCAL ] CYH: Loaded 47561 existing records from primary storage. [2025-09-30T18:13:07.802088] [INFO ] [MAIN ] CYH: Loaded 47561 existing records. [2025-09-30T18:13:08.016953] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:08.017198] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-30T18:13:08.017248] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-30T18:13:08.018590] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-30T18:13:08.018680] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-30T18:13:08.257915] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-30T18:13:08.387897] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:13:08.475106] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:08.653275] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:13:09.054353] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-30T18:13:09.524344] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:13:09.531793] [INFO ] [REMOTE ] CXT: Full fetch complete (45363 records). [2025-09-30T18:13:09.531923] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-30T18:13:09.859518] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-30T18:13:09.938972] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-30T18:13:09.939095] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-30T18:13:09.939848] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-30T18:13:09.939944] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-30T18:13:09.941435] [DEBUG] [LOCAL ] CXT: Trimmed 45363 records to 30998 (keeping 200 days of data) [2025-09-30T18:13:10.136160] [DEBUG] [LOCAL ] CXT: Primary data saved (30998 records). [2025-09-30T18:13:10.136313] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-30T18:13:10.136405] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 32.3s. Estimated remaining: 3h 45m 45s. Rate: 7.9 symbols/min [2025-09-30T18:13:10.318428] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:10.371667] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-09-30T18:13:10.372031] [INFO ] [MAIN ] D: Loaded 53646 existing records. [2025-09-30T18:13:10.567266] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:10.567488] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-30T18:13:10.567540] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-30T18:13:10.569193] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-30T18:13:10.569255] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-30T18:13:10.666871] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-30T18:13:11.018860] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:11.022443] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T18:13:11.173768] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:13:11.454372] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-30T18:13:12.254336] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-30T18:13:12.352518] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:13:12.474194] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:13:12.480931] [INFO ] [REMOTE ] CYD: Full fetch complete (32980 records). [2025-09-30T18:13:12.481033] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-30T18:13:12.879280] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-30T18:13:12.879386] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-30T18:13:12.879986] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-30T18:13:12.880052] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-30T18:13:12.881059] [DEBUG] [LOCAL ] CYD: Trimmed 32980 records to 26499 (keeping 200 days of data) [2025-09-30T18:13:13.046076] [DEBUG] [LOCAL ] CYD: Primary data saved (26499 records). [2025-09-30T18:13:13.046213] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-30T18:13:13.046296] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 30.9s. Estimated remaining: 3h 45m 23s. Rate: 7.9 symbols/min [2025-09-30T18:13:13.059613] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-30T18:13:13.221879] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:13.234977] [DEBUG] [LOCAL ] DAC: Loaded 12571 existing records from primary storage. [2025-09-30T18:13:13.235213] [INFO ] [MAIN ] DAC: Loaded 12571 existing records. [2025-09-30T18:13:13.420259] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:13.420537] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-30T18:13:13.420592] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-30T18:13:13.421122] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-30T18:13:13.421195] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-30T18:13:13.801999] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:13.832061] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:13:13.854334] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-30T18:13:14.654390] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-30T18:13:14.863065] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T18:13:14.877951] [INFO ] [REMOTE ] CXW: Full fetch complete (64879 records). [2025-09-30T18:13:14.878203] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-30T18:13:15.320773] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-30T18:13:15.320895] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-30T18:13:15.321977] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-30T18:13:15.322076] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-30T18:13:15.323778] [DEBUG] [LOCAL ] CXW: Trimmed 64879 records to 44024 (keeping 200 days of data) [2025-09-30T18:13:15.454719] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-30T18:13:15.458876] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:13:15.648799] [DEBUG] [LOCAL ] CXW: Primary data saved (44024 records). [2025-09-30T18:13:15.648946] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-30T18:13:15.649038] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 36.4s. Estimated remaining: 3h 45m 1s. Rate: 8.0 symbols/min [2025-09-30T18:13:15.827906] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:15.885076] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-30T18:13:15.885535] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-30T18:13:16.066743] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:16.067048] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-30T18:13:16.067099] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-30T18:13:16.069034] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-30T18:13:16.069103] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-30T18:13:16.283693] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-30T18:13:16.444397] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:16.488732] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:13:17.054370] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-30T18:13:17.537556] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-30T18:13:17.849886] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:13:17.859480] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-30T18:13:17.901089] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T18:13:18.654446] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-30T18:13:19.454417] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-30T18:13:20.058825] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T18:13:20.127499] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T18:13:20.254382] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-30T18:13:21.054364] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-30T18:13:21.346504] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:13:21.854335] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-30T18:13:22.039627] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:13:22.083481] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:13:22.654396] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-30T18:13:23.454425] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-30T18:13:23.499926] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:13:23.660704] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T18:13:24.254372] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-30T18:13:25.054327] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-30T18:13:25.240011] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T18:13:25.854357] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-30T18:13:26.033411] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T18:13:26.183905] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:13:26.654388] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-30T18:13:27.454338] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-30T18:13:27.540698] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T18:13:27.673290] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:13:28.254420] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-30T18:13:29.054433] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-30T18:13:29.619109] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:13:29.807402] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:13:29.854316] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-30T18:13:30.515833] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T18:13:30.654379] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-30T18:13:31.386536] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:13:31.454327] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-30T18:13:31.572229] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:13:32.254371] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-30T18:13:33.054360] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-30T18:13:33.215839] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:13:33.535012] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-30T18:13:33.854384] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-30T18:13:34.654367] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-30T18:13:34.909271] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:13:35.287392] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:13:35.454354] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-30T18:13:36.254366] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-30T18:13:36.867569] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T18:13:36.992014] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T18:13:37.001933] [INFO ] [REMOTE ] CYH: Full fetch complete (70065 records). [2025-09-30T18:13:37.002110] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-30T18:13:37.066476] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-30T18:13:37.428282] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-30T18:13:37.428387] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-30T18:13:37.429379] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-30T18:13:37.429461] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-30T18:13:37.431345] [DEBUG] [LOCAL ] CYH: Trimmed 70065 records to 47503 (keeping 200 days of data) [2025-09-30T18:13:37.713752] [DEBUG] [LOCAL ] CYH: Primary data saved (47503 records). [2025-09-30T18:13:37.713908] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-30T18:13:37.714002] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 30.2s. Estimated remaining: 3h 45m 38s. Rate: 7.9 symbols/min [2025-09-30T18:13:37.855214] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-30T18:13:37.936686] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:37.947538] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:13:37.983667] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:13:38.036823] [DEBUG] [LOCAL ] DAN: Loaded 48995 existing records from primary storage. [2025-09-30T18:13:38.037168] [INFO ] [MAIN ] DAN: Loaded 48995 existing records. [2025-09-30T18:13:38.227816] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:38.228043] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-30T18:13:38.228091] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-30T18:13:38.229441] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-30T18:13:38.229502] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-30T18:13:38.611264] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:38.654344] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-30T18:13:39.454387] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-30T18:13:39.826028] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T18:13:40.254378] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-30T18:13:40.377737] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:13:40.395749] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:13:40.398605] [INFO ] [REMOTE ] DAC: Full fetch complete (19532 records). [2025-09-30T18:13:40.398710] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-30T18:13:40.804451] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-30T18:13:40.804530] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-30T18:13:40.805046] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-30T18:13:40.805112] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-30T18:13:40.805776] [DEBUG] [LOCAL ] DAC: Trimmed 19532 records to 12536 (keeping 200 days of data) [2025-09-30T18:13:40.885284] [DEBUG] [LOCAL ] DAC: Primary data saved (12536 records). [2025-09-30T18:13:40.885425] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-30T18:13:40.885510] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 27.8s. Estimated remaining: 3h 45m 17s. Rate: 7.9 symbols/min [2025-09-30T18:13:41.058199] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-30T18:13:41.079568] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:41.101154] [DEBUG] [LOCAL ] DAO: Loaded 21017 existing records from primary storage. [2025-09-30T18:13:41.101431] [INFO ] [MAIN ] DAO: Loaded 21017 existing records. [2025-09-30T18:13:41.295309] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:41.295550] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-30T18:13:41.295604] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-30T18:13:41.296286] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-30T18:13:41.296355] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-30T18:13:41.696576] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:41.854362] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-30T18:13:42.189514] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:13:42.566453] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:13:42.654359] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-30T18:13:43.454353] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-30T18:13:43.651506] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:13:43.845096] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:13:44.254351] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-30T18:13:45.056612] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-30T18:13:45.061863] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:13:45.318752] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:13:45.854382] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-30T18:13:46.654371] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-30T18:13:46.872427] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:13:47.062175] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:13:47.454367] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-30T18:13:48.254364] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-30T18:13:48.521553] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T18:13:48.858965] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T18:13:49.054366] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-30T18:13:49.543466] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:13:49.854336] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-30T18:13:49.893265] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:13:50.654412] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-30T18:13:51.454363] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-30T18:13:51.809997] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T18:13:51.823984] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-30T18:13:51.824142] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-30T18:13:52.253950] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-30T18:13:52.254166] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-30T18:13:52.255352] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-30T18:13:52.254348] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-30T18:13:52.255606] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-30T18:13:52.258588] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-30T18:13:52.391784] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:13:52.651926] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-30T18:13:52.652114] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-30T18:13:52.652257] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAL took 37.0s. Estimated remaining: 3h 45m 22s. Rate: 7.9 symbols/min [2025-09-30T18:13:52.849599] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:52.898501] [DEBUG] [LOCAL ] DAR: Loaded 51851 existing records from primary storage. [2025-09-30T18:13:52.898883] [INFO ] [MAIN ] DAR: Loaded 51851 existing records. [2025-09-30T18:13:53.058916] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-30T18:13:53.101801] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:53.102340] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-30T18:13:53.102487] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-30T18:13:53.105089] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-30T18:13:53.105161] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-30T18:13:53.363366] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:13:53.409120] [INFO ] [REMOTE ] D: Full fetch complete (77655 records). [2025-09-30T18:13:53.474592] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-30T18:13:53.573582] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:13:53.740802] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:53.862518] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-30T18:13:54.058865] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-30T18:13:54.058958] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-30T18:13:54.059977] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-30T18:13:54.060066] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-30T18:13:54.061814] [DEBUG] [LOCAL ] D: Trimmed 77655 records to 53645 (keeping 200 days of data) [2025-09-30T18:13:54.439594] [DEBUG] [LOCAL ] D: Primary data saved (53645 records). [2025-09-30T18:13:54.439771] [INFO ] [MAIN ] D: Full history saved. [2025-09-30T18:13:54.439924] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. D took 44.3s. Estimated remaining: 3h 44m 57s. Rate: 7.9 symbols/min [2025-09-30T18:13:54.631392] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:54.655274] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-30T18:13:54.674250] [DEBUG] [LOCAL ] DAVA: Loaded 40816 existing records from primary storage. [2025-09-30T18:13:54.674596] [INFO ] [MAIN ] DAVA: Loaded 40816 existing records. [2025-09-30T18:13:54.874555] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:54.875258] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-30T18:13:54.875325] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-30T18:13:54.887144] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-30T18:13:54.903126] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-30T18:13:54.981908] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:13:55.333894] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:55.454416] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-30T18:13:55.643369] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T18:13:55.679615] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:13:56.254405] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-30T18:13:57.054331] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-30T18:13:57.106436] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:13:57.601235] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:13:57.854374] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-30T18:13:57.958032] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:13:58.654383] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-30T18:13:59.454403] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-30T18:13:59.572113] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:14:00.059705] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:14:00.254356] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-30T18:14:00.483322] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:14:01.054374] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-30T18:14:01.854389] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-30T18:14:02.077161] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:14:02.654391] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-30T18:14:02.940690] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:14:02.985988] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:14:02.991234] [INFO ] [REMOTE ] DAO: Full fetch complete (32765 records). [2025-09-30T18:14:02.991401] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-30T18:14:02.992158] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:14:02.992266] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:14:02.992318] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:14:02.992372] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-30T18:14:02.992468] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-09-30T18:14:02.992555] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-09-30T18:14:02.992983] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-09-30T18:14:02.993140] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 22.1s. Estimated remaining: 3h 44m 52s. Rate: 7.9 symbols/min [2025-09-30T18:14:03.182348] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:03.233607] [DEBUG] [LOCAL ] DAY: Loaded 49690 existing records from primary storage. [2025-09-30T18:14:03.233978] [INFO ] [MAIN ] DAY: Loaded 49690 existing records. [2025-09-30T18:14:03.433437] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:03.433710] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-30T18:14:03.433780] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-30T18:14:03.435254] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-30T18:14:03.435354] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-30T18:14:03.459544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-30T18:14:03.842504] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:04.254133] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:14:04.261191] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-30T18:14:05.054324] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-30T18:14:05.331807] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T18:14:05.342620] [INFO ] [REMOTE ] DAN: Full fetch complete (70813 records). [2025-09-30T18:14:05.342803] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-30T18:14:05.777333] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-30T18:14:05.777471] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-30T18:14:05.778429] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-30T18:14:05.778497] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-30T18:14:05.780027] [DEBUG] [LOCAL ] DAN: Trimmed 70813 records to 48978 (keeping 200 days of data) [2025-09-30T18:14:05.876242] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-30T18:14:06.156374] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:14:06.152934] [DEBUG] [LOCAL ] DAN: Primary data saved (48978 records). [2025-09-30T18:14:06.168763] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-30T18:14:06.169117] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 28.5s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-09-30T18:14:06.379588] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:14:06.385975] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:06.452067] [DEBUG] [LOCAL ] DB: Loaded 52583 existing records from primary storage. [2025-09-30T18:14:06.452561] [INFO ] [MAIN ] DB: Loaded 52583 existing records. [2025-09-30T18:14:06.648931] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:06.649181] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-30T18:14:06.649246] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-30T18:14:06.650793] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-30T18:14:06.650856] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-30T18:14:06.662386] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-30T18:14:07.050776] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:07.454417] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-30T18:14:07.543868] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:14:07.708832] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:14:08.254404] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-30T18:14:09.054324] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-30T18:14:09.225607] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:14:09.599313] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T18:14:09.854390] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-30T18:14:10.495029] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:14:10.654391] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-30T18:14:11.454362] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-30T18:14:11.519676] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:14:12.070343] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:14:12.254424] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-30T18:14:13.054366] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-30T18:14:13.232600] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:14:13.769585] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:14:13.854363] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-30T18:14:14.470347] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T18:14:14.654362] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-30T18:14:15.464312] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-30T18:14:15.469561] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:14:16.254387] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-30T18:14:16.479941] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:14:17.054368] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-30T18:14:17.193729] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:14:17.528982] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T18:14:17.854383] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-30T18:14:18.654344] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-30T18:14:18.693130] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:14:19.454378] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-30T18:14:19.498439] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:14:20.254418] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-30T18:14:20.409941] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:14:21.054348] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-30T18:14:21.161277] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:14:21.594591] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:14:21.854404] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-30T18:14:22.654403] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-30T18:14:22.877108] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:14:23.454391] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-30T18:14:23.826183] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T18:14:23.838035] [INFO ] [REMOTE ] DAR: Full fetch complete (74568 records). [2025-09-30T18:14:23.838282] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-30T18:14:24.269407] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-30T18:14:24.269530] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-30T18:14:24.269934] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-30T18:14:24.272048] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-30T18:14:24.272289] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-30T18:14:24.273955] [DEBUG] [LOCAL ] DAR: Trimmed 74568 records to 51847 (keeping 200 days of data) [2025-09-30T18:14:24.575439] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:14:24.624476] [INFO ] [REMOTE ] DAVA: Full fetch complete (55798 records). [2025-09-30T18:14:24.640280] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-30T18:14:24.963757] [DEBUG] [LOCAL ] DAR: Primary data saved (51847 records). [2025-09-30T18:14:24.977261] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-30T18:14:25.004788] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 32.4s. Estimated remaining: 3h 44m 58s. Rate: 7.9 symbols/min [2025-09-30T18:14:25.179892] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-30T18:14:25.202984] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-30T18:14:25.222465] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-30T18:14:25.222762] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-30T18:14:25.333877] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:25.337136] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:14:25.337360] [DEBUG] [LOCAL ] DAVA: Trimmed 55798 records to 40904 (keeping 200 days of data) [2025-09-30T18:14:25.335015] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-30T18:14:25.337511] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-30T18:14:25.338346] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-30T18:14:25.338697] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-30T18:14:25.338769] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-30T18:14:25.338804] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-30T18:14:25.535729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-30T18:14:25.921463] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:25.923998] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-30T18:14:26.061351] [DEBUG] [LOCAL ] DAVA: Primary data saved (40904 records). [2025-09-30T18:14:26.061481] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-30T18:14:26.061563] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 31.6s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-09-30T18:14:26.246326] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:26.246704] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-09-30T18:14:26.246801] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-09-30T18:14:26.246951] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-30T18:14:26.247014] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-30T18:14:26.247149] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-30T18:14:26.247205] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-30T18:14:26.646588] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:26.669327] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-30T18:14:26.666364] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-30T18:14:26.722511] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:14:26.884765] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:14:27.454338] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-30T18:14:28.254376] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-30T18:14:28.463985] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:14:29.054384] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-30T18:14:29.265111] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:14:29.854415] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-30T18:14:30.187728] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T18:14:30.248534] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:14:30.654399] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-30T18:14:31.454354] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-30T18:14:31.744300] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:14:31.754717] [INFO ] [REMOTE ] DAY: Full fetch complete (71619 records). [2025-09-30T18:14:31.754892] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-30T18:14:32.213141] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-30T18:14:32.213388] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-30T18:14:32.214349] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-30T18:14:32.214484] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-30T18:14:32.216285] [DEBUG] [LOCAL ] DAY: Trimmed 71619 records to 49614 (keeping 200 days of data) [2025-09-30T18:14:32.276954] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-30T18:14:32.338447] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:14:32.570053] [DEBUG] [LOCAL ] DAY: Primary data saved (49614 records). [2025-09-30T18:14:32.570199] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-30T18:14:32.571264] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 29.6s. Estimated remaining: 3h 44m 20s. Rate: 7.9 symbols/min [2025-09-30T18:14:32.764022] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:32.776902] [DEBUG] [LOCAL ] DBL: Loaded 9252 existing records from primary storage. [2025-09-30T18:14:32.777146] [INFO ] [MAIN ] DBL: Loaded 9252 existing records. [2025-09-30T18:14:32.981828] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:32.982373] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-30T18:14:32.982548] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-30T18:14:32.991246] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-30T18:14:32.991552] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:14:32.991699] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-30T18:14:33.070305] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-30T18:14:33.116022] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:14:33.431821] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:33.854369] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-30T18:14:34.638525] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T18:14:34.654317] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-30T18:14:34.855140] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:14:35.136443] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T18:14:35.454377] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-30T18:14:36.254361] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-30T18:14:37.046901] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T18:14:37.054301] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-30T18:14:37.116974] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:14:37.847398] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T18:14:37.854294] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-30T18:14:38.654369] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-30T18:14:38.915321] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T18:14:39.410083] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:14:39.454355] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-30T18:14:40.254378] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-30T18:14:40.877032] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:14:41.054374] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-30T18:14:41.287975] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:14:41.839227] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:14:41.854330] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-30T18:14:42.654360] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-30T18:14:42.891701] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:14:43.318879] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:14:43.454398] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-30T18:14:44.254365] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-30T18:14:45.055911] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-30T18:14:45.058897] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:14:45.391045] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T18:14:45.854331] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-30T18:14:46.123624] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:14:46.654362] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-30T18:14:47.458966] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-30T18:14:47.466036] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:14:47.554292] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:14:48.254395] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-30T18:14:48.286828] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:14:49.054384] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-30T18:14:49.854375] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-30T18:14:49.901319] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:14:49.962493] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:14:50.654401] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-30T18:14:51.454329] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-30T18:14:51.741001] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:14:51.916598] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T18:14:52.254368] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-30T18:14:52.304558] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:14:53.054352] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-30T18:14:53.246537] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T18:14:53.249148] [INFO ] [REMOTE ] DBL: Full fetch complete (12592 records). [2025-09-30T18:14:53.249266] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-30T18:14:53.646476] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-30T18:14:53.646562] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-30T18:14:53.646934] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-30T18:14:53.646999] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-30T18:14:53.647531] [DEBUG] [LOCAL ] DBL: Trimmed 12592 records to 9317 (keeping 200 days of data) [2025-09-30T18:14:53.708844] [DEBUG] [LOCAL ] DBL: Primary data saved (9317 records). [2025-09-30T18:14:53.708992] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-30T18:14:53.709078] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DBL took 21.1s. Estimated remaining: 3h 44m 53s. Rate: 7.9 symbols/min [2025-09-30T18:14:53.863513] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-30T18:14:53.901199] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:53.901535] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-09-30T18:14:53.901582] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-09-30T18:14:53.901771] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-30T18:14:53.901815] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-30T18:14:53.901898] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-30T18:14:53.901957] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-30T18:14:54.298093] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:54.585015] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:14:54.654407] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-30T18:14:55.454365] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-30T18:14:56.114887] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T18:14:56.126340] [INFO ] [REMOTE ] DB: Full fetch complete (74494 records). [2025-09-30T18:14:56.126504] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-30T18:14:56.255540] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-30T18:14:56.533432] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:14:56.619690] [INFO ] [REMOTE ] DBI: Full fetch complete (65971 records). [2025-09-30T18:14:56.623668] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-30T18:14:56.624014] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-30T18:14:56.624222] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-30T18:14:56.625268] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-30T18:14:56.659710] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-30T18:14:56.741705] [DEBUG] [LOCAL ] DB: Trimmed 74494 records to 52581 (keeping 200 days of data) [2025-09-30T18:14:57.167147] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-30T18:14:57.169492] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-30T18:14:57.170871] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-30T18:14:57.171323] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-30T18:14:57.181124] [DEBUG] [LOCAL ] DBI: Trimmed 65971 records to 44637 (keeping 200 days of data) [2025-09-30T18:14:57.440900] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:14:57.455752] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-30T18:14:57.453171] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:14:57.473792] [INFO ] [REMOTE ] DBD: Full fetch complete (30729 records). [2025-09-30T18:14:57.474978] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-30T18:14:57.478248] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:14:57.478861] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:14:57.479554] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:14:57.480955] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-30T18:14:57.481719] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-30T18:14:57.482948] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-30T18:14:57.484726] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-30T18:14:57.485136] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 32.5s. Estimated remaining: 3h 44m 34s. Rate: 7.9 symbols/min [2025-09-30T18:14:57.788826] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:57.789860] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-09-30T18:14:57.789940] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-09-30T18:14:57.824413] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-30T18:14:57.830586] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-30T18:14:57.849334] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-30T18:14:57.850355] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-30T18:14:58.291825] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:58.296603] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-30T18:14:58.300871] [DEBUG] [LOCAL ] DBI: Primary data saved (44637 records). [2025-09-30T18:14:58.301799] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-30T18:14:58.303121] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBI took 32.2s. Estimated remaining: 3h 44m 6s. Rate: 7.9 symbols/min [2025-09-30T18:14:58.420177] [DEBUG] [LOCAL ] DB: Primary data saved (52581 records). [2025-09-30T18:14:58.420418] [INFO ] [MAIN ] DB: Full history saved. [2025-09-30T18:14:58.420562] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DB took 52.3s. Estimated remaining: 3h 43m 36s. Rate: 7.9 symbols/min [2025-09-30T18:14:58.616846] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:58.707007] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:58.713771] [DEBUG] [LOCAL ] DCO: Loaded 13831 existing records from primary storage. [2025-09-30T18:14:58.714063] [INFO ] [MAIN ] DCO: Loaded 13831 existing records. [2025-09-30T18:14:58.957420] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:58.958008] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-30T18:14:58.958091] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-30T18:14:58.959415] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-30T18:14:58.959533] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-30T18:14:59.122403] [DEBUG] [LOCAL ] DD: Loaded 52829 existing records from primary storage. [2025-09-30T18:14:59.150256] [INFO ] [MAIN ] DD: Loaded 52829 existing records. [2025-09-30T18:14:59.758203] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:59.764827] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-30T18:14:59.767520] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-30T18:14:59.789275] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-30T18:14:59.823332] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-30T18:14:59.829302] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-30T18:14:59.835751] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-30T18:15:00.017835] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:00.037886] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-30T18:15:00.168235] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:15:00.265446] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-30T18:15:00.406035] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:00.982639] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:15:01.054357] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-30T18:15:01.497830] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:15:01.854373] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-30T18:15:01.930855] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:15:02.056714] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T18:15:02.654396] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-30T18:15:03.454385] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-30T18:15:03.569178] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T18:15:03.697136] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:15:04.097225] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:15:04.254423] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-30T18:15:05.054394] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-30T18:15:05.854403] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-30T18:15:05.880639] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:15:05.914540] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:15:06.654408] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-30T18:15:07.374704] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:15:07.454404] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-30T18:15:08.254365] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-30T18:15:08.762736] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T18:15:08.999605] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:15:09.054341] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-30T18:15:09.854361] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-30T18:15:10.089662] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:15:10.634381] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:15:10.654327] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-30T18:15:10.967088] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:15:11.454363] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-30T18:15:12.254391] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-30T18:15:12.538837] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:15:12.540192] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:15:13.054372] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-30T18:15:13.843002] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T18:15:13.854587] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-30T18:15:14.020859] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:15:14.654372] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-30T18:15:15.454369] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-30T18:15:15.487403] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:15:16.058336] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:15:16.254386] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-30T18:15:17.039778] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:15:17.054313] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-30T18:15:17.313086] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:15:17.854387] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-30T18:15:18.654362] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-30T18:15:18.826286] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:15:19.354373] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:15:19.454423] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-30T18:15:20.254387] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-30T18:15:20.717263] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T18:15:21.054338] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-30T18:15:21.322164] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T18:15:21.573115] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:15:21.854355] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-30T18:15:22.622707] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T18:15:22.654337] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-30T18:15:23.454408] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-30T18:15:24.157559] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:15:24.168389] [INFO ] [REMOTE ] DBRG: Full fetch complete (72265 records). [2025-09-30T18:15:24.168578] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-30T18:15:24.263839] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-30T18:15:24.676118] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-30T18:15:24.676244] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-30T18:15:24.677387] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-30T18:15:24.677515] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-30T18:15:24.702582] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-30T18:15:24.711194] [DEBUG] [LOCAL ] DBRG: Trimmed 72265 records to 49722 (keeping 200 days of data) [2025-09-30T18:15:24.712847] [INFO ] [REMOTE ] DCI: Full fetch complete (54012 records). [2025-09-30T18:15:24.712983] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-30T18:15:25.243313] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-30T18:15:25.243696] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-30T18:15:25.245133] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-30T18:15:25.245594] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-30T18:15:25.252075] [DEBUG] [LOCAL ] DCI: Trimmed 54012 records to 37357 (keeping 200 days of data) [2025-09-30T18:15:25.690355] [DEBUG] [LOCAL ] DCI: Primary data saved (37357 records). [2025-09-30T18:15:25.692867] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-30T18:15:25.693361] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DCI took 28.2s. Estimated remaining: 3h 44m 28s. Rate: 7.9 symbols/min [2025-09-30T18:15:25.801953] [DEBUG] [LOCAL ] DBRG: Primary data saved (49722 records). [2025-09-30T18:15:25.802171] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-30T18:15:25.812844] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 32.1s. Estimated remaining: 3h 43m 58s. Rate: 7.9 symbols/min [2025-09-30T18:15:25.857675] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:15:25.920707] [INFO ] [REMOTE ] DCO: Full fetch complete (19277 records). [2025-09-30T18:15:25.930078] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T18:15:25.948433] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-30T18:15:25.962580] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:25.989365] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-30T18:15:26.341472] [DEBUG] [LOCAL ] DDD: Loaded 50893 existing records from primary storage. [2025-09-30T18:15:26.364452] [INFO ] [MAIN ] DDD: Loaded 50893 existing records. [2025-09-30T18:15:26.538578] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-30T18:15:26.538848] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-30T18:15:26.539420] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-30T18:15:26.539862] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-30T18:15:26.556739] [DEBUG] [LOCAL ] DCO: Trimmed 19277 records to 13877 (keeping 200 days of data) [2025-09-30T18:15:26.724867] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:26.726299] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-30T18:15:26.727786] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-30T18:15:26.731508] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-30T18:15:26.731592] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-30T18:15:26.969006] [DEBUG] [LOCAL ] DCO: Primary data saved (13877 records). [2025-09-30T18:15:26.979630] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-30T18:15:27.013049] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 28.7s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-09-30T18:15:27.173884] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:27.174265] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-30T18:15:29.284369] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-30T18:15:29.295432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-30T18:15:29.420146] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (3.43 seconds). [2025-09-30T18:15:29.432299] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-30T18:15:31.218723] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:15:31.230287] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-30T18:15:31.417971] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:15:31.430074] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-30T18:15:32.832045] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:15:32.842193] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-30T18:15:33.916216] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-30T18:15:33.929461] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-30T18:15:34.839038] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T18:15:34.850594] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-30T18:15:35.965732] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:15:35.978030] [INFO ] [REMOTE ] DD: Full fetch complete (76303 records). [2025-09-30T18:15:35.978317] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-30T18:15:36.402436] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-30T18:15:36.402552] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-30T18:15:36.403686] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-30T18:15:36.403775] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-30T18:15:36.405532] [DEBUG] [LOCAL ] DD: Trimmed 76303 records to 52829 (keeping 200 days of data) [2025-09-30T18:15:36.667357] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:15:36.680710] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-30T18:15:36.794861] [DEBUG] [LOCAL ] DD: Primary data saved (52829 records). [2025-09-30T18:15:36.795013] [INFO ] [MAIN ] DD: Full history saved. [2025-09-30T18:15:36.795095] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 38.4s. Estimated remaining: 3h 43m 30s. Rate: 7.9 symbols/min [2025-09-30T18:15:38.603192] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:15:38.615461] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-30T18:15:40.529058] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T18:15:40.539882] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-30T18:15:43.190761] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-30T18:15:43.202811] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-30T18:15:45.111427] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T18:15:45.122996] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-30T18:15:47.219868] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:15:47.231366] [INFO ] [REMOTE ] DDD: Full fetch complete (73700 records). [2025-09-30T18:15:47.231540] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-30T18:15:47.648732] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-30T18:15:47.648829] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-30T18:15:47.649694] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-30T18:15:47.649801] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-30T18:15:47.651447] [DEBUG] [LOCAL ] DDD: Trimmed 73700 records to 50892 (keeping 200 days of data) [2025-09-30T18:15:47.960522] [DEBUG] [LOCAL ] DDD: Primary data saved (50892 records). [2025-09-30T18:15:47.960700] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-30T18:15:47.960804] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 22.3s. Estimated remaining: 3h 43m 33s. Rate: 7.9 symbols/min [2025-09-30T18:15:48.689078] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.708561] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.750860] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.752123] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.759376] [DEBUG] [LOCAL ] DDT: Loaded 2094 existing records from primary storage. [2025-09-30T18:15:48.759999] [INFO ] [MAIN ] DDT: Loaded 2094 existing records. [2025-09-30T18:15:48.868884] [DEBUG] [LOCAL ] DDS: Loaded 13100 existing records from primary storage. [2025-09-30T18:15:48.897015] [INFO ] [MAIN ] DDS: Loaded 13100 existing records. [2025-09-30T18:15:49.064752] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.081446] [DEBUG] [LOCAL ] DDL: Loaded 36597 existing records from primary storage. [2025-09-30T18:15:49.091364] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.108363] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-30T18:15:49.119016] [INFO ] [MAIN ] DDL: Loaded 36597 existing records. [2025-09-30T18:15:49.132401] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-30T18:15:49.197682] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-30T18:15:49.245702] [DEBUG] [LOCAL ] DE: Loaded 47576 existing records from primary storage. [2025-09-30T18:15:49.321405] [INFO ] [MAIN ] DE: Loaded 47576 existing records. [2025-09-30T18:15:49.439568] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.520364] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.599982] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-30T18:15:49.657247] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-30T18:15:49.685937] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.697138] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.691740] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-30T18:15:49.741462] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-30T18:15:49.894397] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-30T18:15:49.898671] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-30T18:15:49.953750] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.959163] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.968664] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-30T18:15:50.019210] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-30T18:15:50.092047] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-30T18:15:50.906277] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:50.939910] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-30T18:15:51.143056] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.232264] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-30T18:15:51.231953] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.288825] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-30T18:15:51.425732] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.426153] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-30T18:15:51.591229] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:15:51.592723] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-30T18:15:51.926320] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T18:15:51.927668] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-30T18:15:52.383834] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:15:52.386066] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-30T18:15:52.463170] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T18:15:52.467082] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-30T18:15:52.635535] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:15:52.645743] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-30T18:15:52.696995] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-30T18:15:52.698780] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-30T18:15:52.984040] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:15:52.999240] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-30T18:15:53.128976] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:15:53.131895] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-30T18:15:53.146110] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:15:53.153185] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-30T18:15:53.601596] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T18:15:53.603210] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-30T18:15:53.922559] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T18:15:53.929945] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-30T18:15:54.051479] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T18:15:54.052987] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-30T18:15:54.140425] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:15:54.143759] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-30T18:15:54.437865] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:15:54.451389] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-30T18:15:54.525687] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:15:54.527333] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-30T18:15:54.964368] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:15:54.965492] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-30T18:15:55.148904] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:15:55.153332] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-30T18:15:55.245181] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:15:55.253110] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-30T18:15:55.393277] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-30T18:15:55.394298] [INFO ] [REMOTE ] DDT: Full fetch complete (2907 records). [2025-09-30T18:15:55.394374] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-30T18:15:55.816380] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-30T18:15:55.816530] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-30T18:15:55.816783] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-30T18:15:55.816990] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-30T18:15:55.817510] [DEBUG] [LOCAL ] DDT: Trimmed 2907 records to 2083 (keeping 200 days of data) [2025-09-30T18:15:55.831581] [DEBUG] [LOCAL ] DDT: Primary data saved (2083 records). [2025-09-30T18:15:55.831703] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-30T18:15:55.831929] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 7.9s. Estimated remaining: 3h 43m 27s. Rate: 7.9 symbols/min [2025-09-30T18:15:55.957552] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T18:15:56.037042] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-30T18:15:56.041797] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:56.075624] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:15:56.085776] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-30T18:15:56.120572] [DEBUG] [LOCAL ] DEA: Loaded 40957 existing records from primary storage. [2025-09-30T18:15:56.120902] [INFO ] [MAIN ] DEA: Loaded 40957 existing records. [2025-09-30T18:15:56.314433] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:56.314744] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-30T18:15:56.314836] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-30T18:15:56.315460] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-30T18:15:56.315520] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-30T18:15:56.657077] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:15:56.751533] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-30T18:15:56.751137] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:56.752668] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-30T18:15:56.764449] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:15:57.054412] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-30T18:15:57.722839] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:15:57.854384] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-30T18:15:57.978536] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:15:58.187058] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:15:58.340167] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:15:58.407851] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:15:58.654386] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-30T18:15:59.454409] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-30T18:16:00.254385] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-30T18:16:00.460353] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:16:01.009639] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:16:01.054389] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-30T18:16:01.232320] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T18:16:01.854387] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-30T18:16:02.482596] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T18:16:02.654400] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-30T18:16:03.152799] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:16:03.454373] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-30T18:16:04.254407] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-30T18:16:04.440684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:16:04.831502] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:16:05.054367] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-30T18:16:05.377716] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:16:05.381021] [INFO ] [REMOTE ] DDS: Full fetch complete (19112 records). [2025-09-30T18:16:05.381107] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-30T18:16:05.790727] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-30T18:16:05.790888] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-30T18:16:05.791357] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-30T18:16:05.791438] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-30T18:16:05.792263] [DEBUG] [LOCAL ] DDS: Trimmed 19112 records to 13079 (keeping 200 days of data) [2025-09-30T18:16:05.854777] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-30T18:16:05.882456] [DEBUG] [LOCAL ] DDS: Primary data saved (13079 records). [2025-09-30T18:16:05.882706] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-30T18:16:05.882805] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 17.9s. Estimated remaining: 3h 43m 26s. Rate: 7.9 symbols/min [2025-09-30T18:16:06.075363] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:06.108917] [DEBUG] [LOCAL ] DEC: Loaded 30417 existing records from primary storage. [2025-09-30T18:16:06.109224] [INFO ] [MAIN ] DEC: Loaded 30417 existing records. [2025-09-30T18:16:06.307968] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:06.308244] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-30T18:16:06.308304] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-30T18:16:06.308765] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-30T18:16:06.308827] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-30T18:16:06.669967] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-30T18:16:06.717707] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:07.256753] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-30T18:16:07.454402] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-30T18:16:07.776122] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:16:08.008943] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:16:08.254377] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-30T18:16:08.308946] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:16:09.054426] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-30T18:16:09.854335] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-30T18:16:09.888963] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T18:16:09.898886] [INFO ] [REMOTE ] DDL: Full fetch complete (53288 records). [2025-09-30T18:16:09.899055] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-30T18:16:10.367886] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-30T18:16:10.368037] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-30T18:16:10.369382] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-30T18:16:10.370286] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-30T18:16:10.370203] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:16:10.377446] [DEBUG] [LOCAL ] DDL: Trimmed 53288 records to 36643 (keeping 200 days of data) [2025-09-30T18:16:10.592302] [DEBUG] [LOCAL ] DDL: Primary data saved (36643 records). [2025-09-30T18:16:10.592461] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-30T18:16:10.592585] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 22.6s. Estimated remaining: 3h 43m 10s. Rate: 7.9 symbols/min [2025-09-30T18:16:10.664355] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-30T18:16:10.795318] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:10.849530] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-09-30T18:16:10.849933] [INFO ] [MAIN ] DECK: Loaded 53297 existing records. [2025-09-30T18:16:11.047192] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:11.047452] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-30T18:16:11.047511] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-30T18:16:11.047828] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-30T18:16:11.047890] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-30T18:16:11.441783] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:11.454302] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-30T18:16:11.645531] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T18:16:12.254365] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-30T18:16:12.523552] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:16:12.955365] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:16:13.054367] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-30T18:16:13.610066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:16:13.854371] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-30T18:16:14.654415] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-30T18:16:14.942494] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:16:15.395546] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:16:15.454403] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-30T18:16:16.012087] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:16:16.254374] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-30T18:16:17.054371] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-30T18:16:17.347190] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:16:17.808797] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:16:17.854415] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-30T18:16:18.628230] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:16:18.654355] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-30T18:16:19.454412] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-30T18:16:19.619588] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:16:19.630808] [INFO ] [REMOTE ] DE: Full fetch complete (69549 records). [2025-09-30T18:16:19.630974] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-30T18:16:20.081048] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-30T18:16:20.081166] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-30T18:16:20.082062] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-30T18:16:20.082141] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-30T18:16:20.083880] [DEBUG] [LOCAL ] DE: Trimmed 69549 records to 47556 (keeping 200 days of data) [2025-09-30T18:16:20.207165] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T18:16:20.255210] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-30T18:16:20.432160] [DEBUG] [LOCAL ] DE: Primary data saved (47556 records). [2025-09-30T18:16:20.432435] [INFO ] [MAIN ] DE: Full history saved. [2025-09-30T18:16:20.432677] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 32.5s. Estimated remaining: 3h 43m 10s. Rate: 7.9 symbols/min [2025-09-30T18:16:20.625465] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:20.648829] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:16:20.702576] [DEBUG] [LOCAL ] DEI: Loaded 48386 existing records from primary storage. [2025-09-30T18:16:20.702962] [INFO ] [MAIN ] DEI: Loaded 48386 existing records. [2025-09-30T18:16:20.904879] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:20.905170] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-30T18:16:20.905228] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-30T18:16:20.905876] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-30T18:16:20.905939] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-30T18:16:21.059547] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-30T18:16:21.306963] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:21.854376] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-30T18:16:21.900257] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:16:22.654369] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-30T18:16:23.362944] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-30T18:16:23.454335] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-30T18:16:23.717192] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:16:24.254369] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-30T18:16:24.312460] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:16:24.321446] [INFO ] [REMOTE ] DEA: Full fetch complete (62631 records). [2025-09-30T18:16:24.321599] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-30T18:16:24.734295] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-30T18:16:24.734396] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-30T18:16:24.735243] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-30T18:16:24.735313] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-30T18:16:24.736862] [DEBUG] [LOCAL ] DEA: Trimmed 62631 records to 40928 (keeping 200 days of data) [2025-09-30T18:16:25.001315] [DEBUG] [LOCAL ] DEA: Primary data saved (40928 records). [2025-09-30T18:16:25.001525] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-30T18:16:25.001630] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 29.2s. Estimated remaining: 3h 42m 53s. Rate: 7.9 symbols/min [2025-09-30T18:16:25.061257] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-30T18:16:25.197537] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:25.252223] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-30T18:16:25.252568] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-09-30T18:16:25.477998] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:25.478974] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-30T18:16:25.479115] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-30T18:16:25.479796] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-30T18:16:25.479913] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-30T18:16:25.725337] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-30T18:16:25.865276] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-30T18:16:25.929312] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:16:26.003985] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:26.461282] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T18:16:26.654370] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-30T18:16:27.454387] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-30T18:16:27.674757] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:16:27.952854] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:16:28.254387] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-30T18:16:29.054374] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-30T18:16:29.625325] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:16:29.854398] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-30T18:16:29.963718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-30T18:16:30.654378] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-30T18:16:31.185930] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:16:31.260587] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T18:16:31.454357] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-30T18:16:32.254366] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-30T18:16:32.853624] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T18:16:33.038868] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:16:33.045097] [INFO ] [REMOTE ] DEC: Full fetch complete (42852 records). [2025-09-30T18:16:33.045203] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-30T18:16:33.047430] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:16:33.047555] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:16:33.047668] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:16:33.047765] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-30T18:16:33.047871] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-30T18:16:33.047925] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-09-30T18:16:33.048622] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-09-30T18:16:33.048750] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 27.2s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-09-30T18:16:33.061281] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-30T18:16:33.239193] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:33.239388] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-09-30T18:16:33.239434] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-09-30T18:16:33.239547] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-30T18:16:33.239589] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-30T18:16:33.239634] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-30T18:16:33.239709] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-30T18:16:33.636713] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:33.854350] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-30T18:16:33.890314] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:16:34.654362] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-30T18:16:35.386195] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-30T18:16:35.454340] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-30T18:16:35.497056] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:16:36.254316] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-30T18:16:36.374970] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:16:36.840219] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:16:37.054412] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-30T18:16:37.854389] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-30T18:16:38.576507] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T18:16:38.654355] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-30T18:16:38.898274] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:16:39.438016] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:16:39.454318] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-30T18:16:40.254363] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-30T18:16:41.054382] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-30T18:16:41.090471] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:16:41.148808] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-30T18:16:41.854361] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-30T18:16:42.434446] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T18:16:42.654375] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-30T18:16:42.748859] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:16:43.280878] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:16:43.454398] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-30T18:16:44.254350] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-30T18:16:44.363773] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T18:16:45.054380] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-30T18:16:45.222069] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:16:45.854437] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-30T18:16:46.208065] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:16:46.654425] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-30T18:16:46.990020] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:16:47.001484] [INFO ] [REMOTE ] DECK: Full fetch complete (76656 records). [2025-09-30T18:16:47.001720] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-30T18:16:47.456810] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-30T18:16:47.457081] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-30T18:16:47.458092] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-30T18:16:47.459085] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-30T18:16:47.459340] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-30T18:16:47.461359] [DEBUG] [LOCAL ] DECK: Trimmed 76656 records to 53295 (keeping 200 days of data) [2025-09-30T18:16:47.589340] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:16:47.842932] [DEBUG] [LOCAL ] DECK: Primary data saved (53295 records). [2025-09-30T18:16:47.843091] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-30T18:16:47.845048] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 37.3s. Estimated remaining: 3h 43m 0s. Rate: 7.9 symbols/min [2025-09-30T18:16:48.028526] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:48.066452] [DEBUG] [LOCAL ] DFH: Loaded 32389 existing records from primary storage. [2025-09-30T18:16:48.066809] [INFO ] [MAIN ] DFH: Loaded 32389 existing records. [2025-09-30T18:16:48.256286] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-30T18:16:48.270962] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:48.271484] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-30T18:16:48.271583] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-30T18:16:48.271940] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-30T18:16:48.272020] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-30T18:16:48.687162] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:48.725925] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-30T18:16:48.910939] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:16:49.054401] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-30T18:16:49.854336] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-30T18:16:49.962911] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:16:50.659437] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-30T18:16:50.676082] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T18:16:51.454394] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-30T18:16:52.034020] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T18:16:52.254371] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-30T18:16:52.302666] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:16:52.964818] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:16:53.054391] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-30T18:16:53.854342] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-30T18:16:54.036328] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:16:54.047246] [INFO ] [REMOTE ] DEI: Full fetch complete (69662 records). [2025-09-30T18:16:54.047415] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-30T18:16:54.410774] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:16:54.524687] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-30T18:16:54.524795] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-30T18:16:54.525737] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-30T18:16:54.525810] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-30T18:16:54.527697] [DEBUG] [LOCAL ] DEI: Trimmed 69662 records to 48388 (keeping 200 days of data) [2025-09-30T18:16:54.655127] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-30T18:16:54.845434] [DEBUG] [LOCAL ] DEI: Primary data saved (48388 records). [2025-09-30T18:16:54.845665] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-30T18:16:54.845816] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 34.4s. Estimated remaining: 3h 42m 51s. Rate: 7.9 symbols/min [2025-09-30T18:16:55.028463] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:55.052915] [DEBUG] [LOCAL ] DFIN: Loaded 23167 existing records from primary storage. [2025-09-30T18:16:55.053238] [INFO ] [MAIN ] DFIN: Loaded 23167 existing records. [2025-09-30T18:16:55.252344] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:55.252592] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-30T18:16:55.252667] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-30T18:16:55.253064] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-30T18:16:55.253136] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-30T18:16:55.485453] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-30T18:16:55.653001] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:56.049790] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:16:56.234276] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-30T18:16:56.254338] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-30T18:16:57.059525] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-30T18:16:57.077869] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:16:57.854395] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-30T18:16:58.518990] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:16:58.637197] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T18:16:58.650383] [INFO ] [REMOTE ] DELL: Full fetch complete (77430 records). [2025-09-30T18:16:58.650557] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-30T18:16:58.651484] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:16:58.651601] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:16:58.651704] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:16:58.651829] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-30T18:16:58.651940] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-30T18:16:58.651999] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-30T18:16:58.652276] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-09-30T18:16:58.652386] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 33.7s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-09-30T18:16:58.665969] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-30T18:16:58.846949] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:58.847146] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-09-30T18:16:58.847186] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-09-30T18:16:58.847369] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-30T18:16:58.847449] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-30T18:16:58.847522] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-30T18:16:58.847560] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-30T18:16:59.226199] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:59.454326] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-30T18:16:59.679335] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:16:59.884812] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T18:17:00.254353] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-30T18:17:00.944093] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:17:01.054407] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-30T18:17:01.506855] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:17:01.854404] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-30T18:17:02.654375] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-30T18:17:02.989908] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:17:03.072751] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:17:03.084333] [INFO ] [REMOTE ] DEO: Full fetch complete (71512 records). [2025-09-30T18:17:03.084521] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-30T18:17:03.462190] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-30T18:17:03.527900] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-30T18:17:03.528035] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-30T18:17:03.529126] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-30T18:17:03.529192] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-30T18:17:03.530767] [DEBUG] [LOCAL ] DEO: Trimmed 71512 records to 49007 (keeping 200 days of data) [2025-09-30T18:17:03.676149] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:17:03.865839] [DEBUG] [LOCAL ] DEO: Primary data saved (49007 records). [2025-09-30T18:17:03.866008] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-30T18:17:03.866132] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 30.8s. Estimated remaining: 3h 42m 18s. Rate: 7.9 symbols/min [2025-09-30T18:17:04.051480] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:04.109313] [DEBUG] [LOCAL ] DG: Loaded 53284 existing records from primary storage. [2025-09-30T18:17:04.109701] [INFO ] [MAIN ] DG: Loaded 53284 existing records. [2025-09-30T18:17:04.264528] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-30T18:17:04.312826] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:04.313134] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-30T18:17:04.313219] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-30T18:17:04.313673] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-30T18:17:04.313738] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-30T18:17:04.743425] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:04.763677] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T18:17:05.054384] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-30T18:17:05.075560] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:17:05.854383] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-30T18:17:06.290182] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:17:06.654421] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-30T18:17:07.424711] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:17:07.454349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-30T18:17:07.742343] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:17:08.254392] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-30T18:17:08.304138] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:17:09.054389] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-30T18:17:09.854344] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-30T18:17:09.866764] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:17:10.201810] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:17:10.654423] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-30T18:17:11.393515] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:17:11.454415] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-30T18:17:12.257141] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-30T18:17:12.262899] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:17:12.832507] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T18:17:13.054372] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-30T18:17:13.368242] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T18:17:13.854416] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-30T18:17:14.654446] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-30T18:17:15.109939] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T18:17:15.412734] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:17:15.454326] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-30T18:17:15.705130] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T18:17:16.254365] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-30T18:17:16.731373] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T18:17:17.054416] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-30T18:17:17.854400] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-30T18:17:18.153675] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T18:17:18.160257] [INFO ] [REMOTE ] DFH: Full fetch complete (48798 records). [2025-09-30T18:17:18.160405] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-30T18:17:18.614060] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-30T18:17:18.614226] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-30T18:17:18.614900] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-30T18:17:18.615011] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-30T18:17:18.616510] [DEBUG] [LOCAL ] DFH: Trimmed 48798 records to 32312 (keeping 200 days of data) [2025-09-30T18:17:18.677514] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-30T18:17:18.750707] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T18:17:18.871163] [DEBUG] [LOCAL ] DFH: Primary data saved (32312 records). [2025-09-30T18:17:18.871415] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-30T18:17:18.872106] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFH took 31.0s. Estimated remaining: 3h 42m 32s. Rate: 7.9 symbols/min [2025-09-30T18:17:19.042936] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:17:19.076855] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:19.123621] [DEBUG] [LOCAL ] DGX: Loaded 44954 existing records from primary storage. [2025-09-30T18:17:19.124000] [INFO ] [MAIN ] DGX: Loaded 44954 existing records. [2025-09-30T18:17:19.333803] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:19.334086] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-30T18:17:19.334140] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-30T18:17:19.334590] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-30T18:17:19.334686] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-30T18:17:19.462940] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-30T18:17:19.751396] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:19.764502] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T18:17:20.185418] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T18:17:20.254416] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-30T18:17:21.054366] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-30T18:17:21.854428] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-30T18:17:21.988709] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:17:22.202434] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:17:22.654361] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-30T18:17:22.736027] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:17:23.454380] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-30T18:17:24.254347] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-30T18:17:24.303279] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T18:17:24.449971] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:17:25.054321] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-30T18:17:25.222945] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:17:25.228041] [INFO ] [REMOTE ] DFIN: Full fetch complete (33635 records). [2025-09-30T18:17:25.228203] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-30T18:17:25.642853] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-30T18:17:25.642975] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-30T18:17:25.643563] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-30T18:17:25.643623] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-30T18:17:25.644554] [DEBUG] [LOCAL ] DFIN: Trimmed 33635 records to 23061 (keeping 200 days of data) [2025-09-30T18:17:25.742384] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:17:25.748831] [INFO ] [REMOTE ] DFP: Full fetch complete (16077 records). [2025-09-30T18:17:25.750788] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-30T18:17:25.755584] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:17:25.759958] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:17:25.762964] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:17:25.764173] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-30T18:17:25.764924] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-30T18:17:25.765808] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-30T18:17:25.766582] [DEBUG] [LOCAL ] DFP: No derivative data file found to delete. [2025-09-30T18:17:25.767326] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFP took 27.1s. Estimated remaining: 3h 42m 22s. Rate: 7.9 symbols/min [2025-09-30T18:17:25.859956] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-30T18:17:25.981816] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:26.016002] [DEBUG] [LOCAL ] DFIN: Primary data saved (23061 records). [2025-09-30T18:17:26.016165] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-30T18:17:26.016264] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 31.2s. Estimated remaining: 3h 41m 54s. Rate: 7.9 symbols/min [2025-09-30T18:17:26.124681] [DEBUG] [LOCAL ] DHF: Loaded 20678 existing records from primary storage. [2025-09-30T18:17:26.136452] [INFO ] [MAIN ] DHF: Loaded 20678 existing records. [2025-09-30T18:17:26.334229] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:26.427777] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:26.428059] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-30T18:17:26.428109] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-30T18:17:26.428563] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-30T18:17:26.428631] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-30T18:17:26.673627] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-30T18:17:26.704912] [DEBUG] [LOCAL ] DHI: Loaded 53361 existing records from primary storage. [2025-09-30T18:17:26.745806] [INFO ] [MAIN ] DHI: Loaded 53361 existing records. [2025-09-30T18:17:27.025468] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:27.093685] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:27.093946] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-30T18:17:27.093999] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-30T18:17:27.096019] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-30T18:17:27.096102] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-30T18:17:27.457337] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-30T18:17:27.498751] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:27.540906] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:17:28.254340] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-30T18:17:28.531210] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:17:28.683472] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:17:29.054368] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-30T18:17:29.727421] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T18:17:29.854368] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-30T18:17:30.654365] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-30T18:17:30.693482] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:17:31.454377] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-30T18:17:31.478281] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T18:17:31.733503] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T18:17:32.254391] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-30T18:17:33.054408] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-30T18:17:33.347540] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:17:33.854337] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-30T18:17:34.014828] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T18:17:34.331559] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T18:17:34.343382] [INFO ] [REMOTE ] DG: Full fetch complete (77215 records). [2025-09-30T18:17:34.343592] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-30T18:17:34.659435] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-30T18:17:34.849295] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-30T18:17:34.849429] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-30T18:17:34.850294] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-30T18:17:34.850360] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-30T18:17:34.851966] [DEBUG] [LOCAL ] DG: Trimmed 77215 records to 53284 (keeping 200 days of data) [2025-09-30T18:17:35.233838] [DEBUG] [LOCAL ] DG: Primary data saved (53284 records). [2025-09-30T18:17:35.234010] [INFO ] [MAIN ] DG: Full history saved. [2025-09-30T18:17:35.234117] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 31.4s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-09-30T18:17:35.425792] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:35.425998] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-30T18:17:35.426149] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-30T18:17:35.426332] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-30T18:17:35.426508] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-30T18:17:35.426665] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-30T18:17:35.426869] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-30T18:17:35.461332] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-30T18:17:35.760609] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-30T18:17:35.839367] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:17:35.908073] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:36.254375] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-30T18:17:36.867501] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:17:37.054366] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-30T18:17:37.854327] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-30T18:17:38.155673] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T18:17:38.268148] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:17:38.654397] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-30T18:17:39.414550] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:17:39.454386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-30T18:17:40.254331] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-30T18:17:40.535528] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:17:40.604836] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:17:41.054389] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-30T18:17:41.854361] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-30T18:17:42.393480] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:17:42.654337] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-30T18:17:42.868783] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T18:17:42.908629] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T18:17:43.454397] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-30T18:17:44.254355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-30T18:17:44.412269] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:17:45.054336] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-30T18:17:45.147379] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T18:17:45.182811] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:17:45.854403] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-30T18:17:46.654391] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-30T18:17:46.772428] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T18:17:46.977320] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:17:47.454407] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-30T18:17:48.254419] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-30T18:17:48.772692] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T18:17:48.924137] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:17:49.054338] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-30T18:17:49.370030] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:17:49.375199] [INFO ] [REMOTE ] DHF: Full fetch complete (29696 records). [2025-09-30T18:17:49.375281] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-30T18:17:49.784565] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-30T18:17:49.784662] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-30T18:17:49.785223] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-30T18:17:49.785284] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-30T18:17:49.786194] [DEBUG] [LOCAL ] DHF: Trimmed 29696 records to 20733 (keeping 200 days of data) [2025-09-30T18:17:49.874760] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-30T18:17:49.919463] [DEBUG] [LOCAL ] DHF: Primary data saved (20733 records). [2025-09-30T18:17:49.919600] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-30T18:17:49.919731] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 24.2s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-09-30T18:17:50.096529] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:50.145433] [DEBUG] [LOCAL ] DHT: Loaded 47882 existing records from primary storage. [2025-09-30T18:17:50.145794] [INFO ] [MAIN ] DHT: Loaded 47882 existing records. [2025-09-30T18:17:50.352363] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:50.352576] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-30T18:17:50.352626] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-30T18:17:50.353084] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-30T18:17:50.353145] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-30T18:17:50.655734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-30T18:17:50.760556] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:50.985744] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T18:17:51.454385] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-30T18:17:51.565184] [DEBUG] [REMOTE ] DHT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-30T18:17:51.565548] [WARN ] [REMOTE ] DHT: No data returned for month 2024-12 [2025-09-30T18:17:51.565677] [FATAL] [REMOTE ] DHT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:17:51.565758] [FATAL] [MAIN ] DHT: Failed to fetch primary data. [2025-09-30T18:17:51.565826] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:17:51.565901] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-30T18:17:51.565971] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-30T18:17:51.566011] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-30T18:17:51.566289] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-30T18:17:51.566391] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHT took 1.6s. Estimated remaining: 3h 41m 39s. Rate: 7.9 symbols/min [2025-09-30T18:17:51.764492] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:51.779537] [DEBUG] [LOCAL ] DHX: Loaded 13104 existing records from primary storage. [2025-09-30T18:17:51.779795] [INFO ] [MAIN ] DHX: Loaded 13104 existing records. [2025-09-30T18:17:51.922916] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T18:17:52.019213] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:52.019447] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-30T18:17:52.019497] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-30T18:17:52.019719] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-30T18:17:52.019807] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-30T18:17:52.259743] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-30T18:17:52.421017] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:52.600071] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:17:53.054394] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-30T18:17:53.854395] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-30T18:17:53.905262] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:17:54.654409] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-30T18:17:54.886472] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:17:55.446622] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:17:55.455738] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-30T18:17:55.597152] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:17:56.254373] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-30T18:17:57.054355] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-30T18:17:57.105828] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T18:17:57.144511] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:17:57.854483] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-30T18:17:58.645089] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:17:58.657445] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-30T18:17:58.660181] [INFO ] [REMOTE ] DGX: Full fetch complete (64747 records). [2025-09-30T18:17:58.660427] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-30T18:17:58.661630] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:17:58.661783] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:17:58.661862] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:17:58.661954] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-30T18:17:58.662043] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-30T18:17:58.662090] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-09-30T18:17:58.662404] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-09-30T18:17:58.662535] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DGX took 39.8s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min [2025-09-30T18:17:58.865986] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:58.866177] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-30T18:17:58.866216] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-30T18:17:58.866330] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-30T18:17:58.866373] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-30T18:17:58.866416] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-30T18:17:58.866449] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-30T18:17:59.247425] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:59.416142] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:17:59.454366] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-30T18:18:00.254359] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-30T18:18:00.681062] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T18:18:01.054436] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-30T18:18:01.389290] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:18:01.787055] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T18:18:01.854368] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-30T18:18:01.999800] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T18:18:02.654390] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-30T18:18:03.454347] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-30T18:18:03.593903] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:18:03.973022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T18:18:03.985051] [INFO ] [REMOTE ] DHI: Full fetch complete (77214 records). [2025-09-30T18:18:03.985254] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-30T18:18:04.259534] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-30T18:18:04.405823] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-30T18:18:04.405962] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-30T18:18:04.407320] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-30T18:18:04.407403] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-30T18:18:04.411631] [DEBUG] [LOCAL ] DHI: Trimmed 77214 records to 53349 (keeping 200 days of data) [2025-09-30T18:18:04.783074] [DEBUG] [LOCAL ] DHI: Primary data saved (53349 records). [2025-09-30T18:18:04.783278] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-30T18:18:04.783387] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 38.8s. Estimated remaining: 3h 41m 19s. Rate: 7.9 symbols/min [2025-09-30T18:18:04.956794] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:18:04.975421] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:05.024220] [DEBUG] [LOCAL ] DIN: Loaded 37181 existing records from primary storage. [2025-09-30T18:18:05.024627] [INFO ] [MAIN ] DIN: Loaded 37181 existing records. [2025-09-30T18:18:05.059510] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-30T18:18:05.233176] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:05.233668] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-30T18:18:05.233771] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-30T18:18:05.234408] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-30T18:18:05.234554] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-30T18:18:05.443896] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:18:05.670159] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:05.854401] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-30T18:18:06.204768] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T18:18:06.654479] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-30T18:18:07.133810] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:18:07.316129] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T18:18:07.454420] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-30T18:18:08.083083] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T18:18:08.254415] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-30T18:18:09.054400] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-30T18:18:09.792422] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:18:09.854354] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-30T18:18:09.900228] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T18:18:10.654370] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-30T18:18:11.436396] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T18:18:11.454314] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-30T18:18:12.123715] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T18:18:12.135369] [INFO ] [REMOTE ] DHR: Full fetch complete (77269 records). [2025-09-30T18:18:12.135546] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-30T18:18:12.259481] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-30T18:18:12.480107] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:18:12.607836] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-30T18:18:12.607957] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-30T18:18:12.609100] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-30T18:18:12.609220] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-30T18:18:12.611363] [DEBUG] [LOCAL ] DHR: Trimmed 77269 records to 53365 (keeping 200 days of data) [2025-09-30T18:18:12.973249] [DEBUG] [LOCAL ] DHR: Primary data saved (53365 records). [2025-09-30T18:18:12.973427] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-30T18:18:12.973520] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 37.7s. Estimated remaining: 3h 41m 13s. Rate: 7.9 symbols/min [2025-09-30T18:18:13.059518] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-30T18:18:13.165014] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:13.217249] [DEBUG] [LOCAL ] DINO: Loaded 52952 existing records from primary storage. [2025-09-30T18:18:13.217615] [INFO ] [MAIN ] DINO: Loaded 52952 existing records. [2025-09-30T18:18:13.426557] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:13.426960] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-30T18:18:13.427017] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-30T18:18:13.427435] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-30T18:18:13.427497] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-30T18:18:13.804057] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:13.819822] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:18:13.854322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-30T18:18:14.023011] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T18:18:14.654417] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-30T18:18:15.454420] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-30T18:18:16.063514] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T18:18:16.244212] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:18:16.254335] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-30T18:18:16.393052] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:18:17.054493] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-30T18:18:17.854372] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-30T18:18:17.993054] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T18:18:18.650792] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:18:18.654415] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-30T18:18:18.680993] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:18:19.454384] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-30T18:18:19.621263] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:18:20.145210] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:18:20.149586] [INFO ] [REMOTE ] DIAX: Full fetch complete (17397 records). [2025-09-30T18:18:20.149851] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-30T18:18:20.150554] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:20.150698] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:20.150754] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:20.150800] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-30T18:18:20.150868] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-30T18:18:20.150906] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-30T18:18:20.151173] [DEBUG] [LOCAL ] DIAX: No derivative data file found to delete. [2025-09-30T18:18:20.151527] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DIAX took 21.5s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min [2025-09-30T18:18:20.259705] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-30T18:18:20.352238] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:20.414664] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-30T18:18:20.415063] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-30T18:18:20.616173] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:20.616408] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-30T18:18:20.616457] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-30T18:18:20.618109] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-30T18:18:20.618281] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-30T18:18:21.003269] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:21.054371] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-30T18:18:21.812887] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T18:18:21.854384] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-30T18:18:22.654412] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-30T18:18:22.686968] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:18:23.454412] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-30T18:18:23.528047] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-30T18:18:24.074409] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:18:24.254394] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-30T18:18:24.873115] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T18:18:25.054401] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-30T18:18:25.114058] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T18:18:25.854374] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-30T18:18:26.654410] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-30T18:18:27.169866] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T18:18:27.173935] [INFO ] [REMOTE ] DHX: Full fetch complete (20816 records). [2025-09-30T18:18:27.174114] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-30T18:18:27.459474] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-30T18:18:27.625512] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-30T18:18:27.625701] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-30T18:18:27.626381] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-30T18:18:27.626894] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-30T18:18:27.628345] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-30T18:18:27.640843] [DEBUG] [LOCAL ] DHX: Trimmed 20816 records to 13063 (keeping 200 days of data) [2025-09-30T18:18:27.717527] [DEBUG] [LOCAL ] DHX: Primary data saved (13063 records). [2025-09-30T18:18:27.717742] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-30T18:18:27.717842] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHX took 36.2s. Estimated remaining: 3h 40m 56s. Rate: 7.9 symbols/min [2025-09-30T18:18:27.901235] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:27.901563] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-30T18:18:27.901622] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-30T18:18:27.901760] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-30T18:18:27.901803] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-30T18:18:27.901845] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-30T18:18:27.901878] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-30T18:18:28.257258] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-30T18:18:28.301535] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:28.322874] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:18:29.054381] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-30T18:18:29.434746] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T18:18:29.854352] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-30T18:18:30.487493] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:18:30.594639] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-30T18:18:30.654371] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-30T18:18:31.030535] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-30T18:18:31.454320] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-30T18:18:31.529563] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:18:32.254360] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-30T18:18:33.054380] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-30T18:18:33.354947] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-30T18:18:33.859367] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-30T18:18:33.876225] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-30T18:18:33.921041] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:18:34.221439] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:18:34.654363] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-30T18:18:35.082490] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T18:18:35.454352] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-30T18:18:35.887888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:18:36.254367] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-30T18:18:37.054408] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-30T18:18:37.854361] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-30T18:18:38.156005] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:18:38.548742] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:18:38.654404] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-30T18:18:39.454400] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-30T18:18:39.796664] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:18:40.262243] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-30T18:18:40.285021] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-30T18:18:40.385216] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T18:18:40.394000] [INFO ] [REMOTE ] DIN: Full fetch complete (55165 records). [2025-09-30T18:18:40.394146] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-30T18:18:40.703085] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T18:18:40.833080] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-30T18:18:40.833166] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-30T18:18:40.833897] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-30T18:18:40.833962] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-30T18:18:40.835217] [DEBUG] [LOCAL ] DIN: Trimmed 55165 records to 37165 (keeping 200 days of data) [2025-09-30T18:18:41.054467] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-30T18:18:41.076833] [DEBUG] [LOCAL ] DIN: Primary data saved (37165 records). [2025-09-30T18:18:41.077002] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-30T18:18:41.077094] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 36.3s. Estimated remaining: 3h 41m 5s. Rate: 7.9 symbols/min [2025-09-30T18:18:41.266815] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:41.318312] [DEBUG] [LOCAL ] DK: Loaded 49324 existing records from primary storage. [2025-09-30T18:18:41.318708] [INFO ] [MAIN ] DK: Loaded 49324 existing records. [2025-09-30T18:18:41.517699] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:41.517921] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-30T18:18:41.517970] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-30T18:18:41.519410] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-30T18:18:41.519474] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-30T18:18:41.859511] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-30T18:18:41.922849] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:42.487145] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T18:18:42.654372] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-30T18:18:42.824111] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:18:43.454417] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-30T18:18:44.254400] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-30T18:18:44.588158] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T18:18:45.054339] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-30T18:18:45.159350] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:18:45.254324] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-30T18:18:45.854385] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-30T18:18:46.654324] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-30T18:18:47.154430] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:18:47.166050] [INFO ] [REMOTE ] DINO: Full fetch complete (76301 records). [2025-09-30T18:18:47.166223] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-30T18:18:47.167139] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:47.167235] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:47.167279] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:47.167320] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-30T18:18:47.167379] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-09-30T18:18:47.167415] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-09-30T18:18:47.167771] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-09-30T18:18:47.167885] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 34.2s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-09-30T18:18:47.372913] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:47.390342] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:18:47.427838] [DEBUG] [LOCAL ] DKL: Loaded 18836 existing records from primary storage. [2025-09-30T18:18:47.428273] [INFO ] [MAIN ] DKL: Loaded 18836 existing records. [2025-09-30T18:18:47.459583] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-30T18:18:47.665164] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:47.665445] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-30T18:18:47.665528] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-30T18:18:47.666268] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-30T18:18:47.666334] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-30T18:18:48.127019] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T18:18:48.128680] [INFO ] [REMOTE ] DIVY: Full fetch complete (1711 records). [2025-09-30T18:18:48.128838] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-30T18:18:48.129438] [FATAL] [VALIDATOR ] DIVY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:48.149604] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:48.158603] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:48.158822] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-30T18:18:48.158926] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-30T18:18:48.158988] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-30T18:18:48.159058] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-30T18:18:48.159167] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 20.4s. Estimated remaining: 3h 40m 27s. Rate: 7.9 symbols/min [2025-09-30T18:18:48.280065] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-30T18:18:48.432118] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:48.584632] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:48.662087] [DEBUG] [LOCAL ] DKS: Loaded 49803 existing records from primary storage. [2025-09-30T18:18:48.662574] [INFO ] [MAIN ] DKS: Loaded 49803 existing records. [2025-09-30T18:18:48.909270] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:48.943092] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-30T18:18:48.947795] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-30T18:18:48.950337] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-30T18:18:48.950414] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-30T18:18:48.950602] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-30T18:18:49.059519] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-30T18:18:49.383042] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:49.854350] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-30T18:18:49.906493] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:18:50.346008] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:18:50.654361] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-30T18:18:51.250514] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:18:51.454414] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-30T18:18:51.692181] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:18:52.254400] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-30T18:18:53.054393] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-30T18:18:53.407191] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:18:53.737070] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T18:18:53.854380] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-30T18:18:54.274814] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T18:18:54.654372] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-30T18:18:55.454330] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-30T18:18:55.545790] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:18:56.254401] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-30T18:18:57.054354] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-30T18:18:57.192973] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:18:57.208955] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T18:18:57.406328] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:18:57.854368] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-30T18:18:58.354696] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:18:58.654376] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-30T18:18:59.454407] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-30T18:19:00.044536] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T18:19:00.057111] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-30T18:19:00.057342] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-30T18:19:00.257627] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-30T18:19:00.513921] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-30T18:19:00.514030] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-30T18:19:00.514966] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-30T18:19:00.515137] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-30T18:19:00.517095] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-30T18:19:00.646234] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:19:00.917361] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-30T18:19:00.917738] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-30T18:19:00.919937] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DIS took 40.8s. Estimated remaining: 3h 40m 34s. Rate: 7.9 symbols/min [2025-09-30T18:19:01.058575] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-30T18:19:01.112982] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:01.134615] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:19:01.174957] [DEBUG] [LOCAL ] DLB: Loaded 31993 existing records from primary storage. [2025-09-30T18:19:01.175255] [INFO ] [MAIN ] DLB: Loaded 31993 existing records. [2025-09-30T18:19:01.365602] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:01.365886] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-30T18:19:01.365942] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-30T18:19:01.367002] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-30T18:19:01.367078] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-30T18:19:01.775639] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:01.854362] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-30T18:19:02.149146] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T18:19:02.654377] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-30T18:19:03.074303] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:19:03.441864] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:19:03.454300] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-30T18:19:03.726256] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T18:19:04.254433] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-30T18:19:04.851847] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:19:05.054372] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-30T18:19:05.854342] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-30T18:19:06.299311] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-30T18:19:06.415201] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:19:06.654358] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-30T18:19:06.854411] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T18:19:07.454376] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-30T18:19:07.985815] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:19:08.254407] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-30T18:19:09.054418] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-30T18:19:09.259556] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:19:09.643061] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:19:09.854375] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-30T18:19:10.460951] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:19:10.654406] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-30T18:19:11.454395] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-30T18:19:11.600234] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T18:19:11.708937] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T18:19:12.059110] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:19:12.254362] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-30T18:19:13.054380] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-30T18:19:13.651620] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:19:13.854403] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-30T18:19:14.366399] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:19:14.654405] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-30T18:19:15.454369] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-30T18:19:15.705492] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:19:15.718916] [INFO ] [REMOTE ] DK: Full fetch complete (70760 records). [2025-09-30T18:19:15.719136] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-30T18:19:16.038070] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:19:16.206710] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-30T18:19:16.206821] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-30T18:19:16.208247] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-30T18:19:16.208329] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-30T18:19:16.210388] [DEBUG] [LOCAL ] DK: Trimmed 70760 records to 49340 (keeping 200 days of data) [2025-09-30T18:19:16.267965] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-30T18:19:16.522418] [DEBUG] [LOCAL ] DK: Primary data saved (49340 records). [2025-09-30T18:19:16.522565] [INFO ] [MAIN ] DK: Full history saved. [2025-09-30T18:19:16.522758] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 35.4s. Estimated remaining: 3h 40m 49s. Rate: 7.9 symbols/min [2025-09-30T18:19:16.731809] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:16.741188] [DEBUG] [LOCAL ] DLNG: Loaded 6117 existing records from primary storage. [2025-09-30T18:19:16.741489] [INFO ] [MAIN ] DLNG: Loaded 6117 existing records. [2025-09-30T18:19:16.932276] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:16.932731] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-30T18:19:16.933041] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-30T18:19:16.933391] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-30T18:19:16.933468] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-30T18:19:17.059464] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-30T18:19:17.332577] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:17.354531] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:19:17.392327] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:19:17.813926] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T18:19:17.854317] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-30T18:19:18.654365] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-30T18:19:19.313888] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:19:19.454343] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-30T18:19:19.534537] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:19:20.254357] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-30T18:19:20.361851] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:19:20.365148] [INFO ] [REMOTE ] DKL: Full fetch complete (28777 records). [2025-09-30T18:19:20.365291] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-30T18:19:20.365856] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:19:20.365974] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:19:20.366020] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:19:20.366091] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-30T18:19:20.366171] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-30T18:19:20.366241] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-30T18:19:20.366506] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-30T18:19:20.366624] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 33.2s. Estimated remaining: 3h 40m 31s. Rate: 7.9 symbols/min [2025-09-30T18:19:20.549277] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:20.625781] [DEBUG] [LOCAL ] DLR: Loaded 51011 existing records from primary storage. [2025-09-30T18:19:20.626175] [INFO ] [MAIN ] DLR: Loaded 51011 existing records. [2025-09-30T18:19:20.821851] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:20.822111] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-30T18:19:20.822170] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-30T18:19:20.824128] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-30T18:19:20.824192] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-30T18:19:21.054846] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-30T18:19:21.212225] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:21.277420] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:19:21.854359] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-30T18:19:22.304922] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T18:19:22.312427] [INFO ] [REMOTE ] DLB: Full fetch complete (46874 records). [2025-09-30T18:19:22.312558] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-30T18:19:22.492135] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:19:22.659508] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-30T18:19:22.761380] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-30T18:19:22.761490] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-30T18:19:22.762268] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-30T18:19:22.762357] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-30T18:19:22.763900] [DEBUG] [LOCAL ] DLB: Trimmed 46874 records to 31999 (keeping 200 days of data) [2025-09-30T18:19:22.974793] [DEBUG] [LOCAL ] DLB: Primary data saved (31999 records). [2025-09-30T18:19:22.974936] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-30T18:19:22.975596] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLB took 22.1s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-09-30T18:19:23.160240] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:23.194933] [DEBUG] [LOCAL ] DLX: Loaded 28625 existing records from primary storage. [2025-09-30T18:19:23.195210] [INFO ] [MAIN ] DLX: Loaded 28625 existing records. [2025-09-30T18:19:23.408905] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:23.409141] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-30T18:19:23.409211] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-30T18:19:23.410067] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-30T18:19:23.410129] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-30T18:19:23.459504] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-30T18:19:23.794170] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:24.167926] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:19:24.254368] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-30T18:19:24.341910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T18:19:25.054382] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-30T18:19:25.797834] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:19:25.854723] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-30T18:19:26.263567] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T18:19:26.654372] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-30T18:19:27.454406] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-30T18:19:27.625733] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T18:19:28.254311] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-30T18:19:28.410792] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:19:28.447300] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:19:28.458711] [INFO ] [REMOTE ] DKS: Full fetch complete (71603 records). [2025-09-30T18:19:28.458912] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-30T18:19:28.900785] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-30T18:19:28.900879] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-30T18:19:28.901794] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-30T18:19:28.901866] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-30T18:19:28.903403] [DEBUG] [LOCAL ] DKS: Trimmed 71603 records to 49778 (keeping 200 days of data) [2025-09-30T18:19:29.102113] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-30T18:19:29.243813] [DEBUG] [LOCAL ] DKS: Primary data saved (49778 records). [2025-09-30T18:19:29.243957] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-30T18:19:29.244084] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 41.1s. Estimated remaining: 3h 39m 58s. Rate: 7.9 symbols/min [2025-09-30T18:19:29.421666] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:29.444045] [DEBUG] [LOCAL ] DLY: Loaded 19652 existing records from primary storage. [2025-09-30T18:19:29.444387] [INFO ] [MAIN ] DLY: Loaded 19652 existing records. [2025-09-30T18:19:29.632538] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:29.632859] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-30T18:19:29.632914] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-30T18:19:29.633628] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-30T18:19:29.633729] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-30T18:19:29.861632] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-30T18:19:30.007572] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:30.074353] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:19:30.075039] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:19:30.654378] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-30T18:19:30.725906] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T18:19:31.454420] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-30T18:19:32.245797] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:19:32.256902] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-30T18:19:32.790852] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:19:33.054359] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-30T18:19:33.495762] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T18:19:33.854372] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-30T18:19:34.066199] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:19:34.654395] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-30T18:19:34.683300] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:19:35.454428] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-30T18:19:35.939088] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:19:36.055135] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:19:36.254353] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-30T18:19:37.054405] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-30T18:19:37.653186] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:19:37.784957] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:19:37.854369] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-30T18:19:38.561071] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T18:19:38.654373] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-30T18:19:39.271832] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:19:39.454414] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-30T18:19:40.230601] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:19:40.254312] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-30T18:19:40.904589] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:19:40.906721] [INFO ] [REMOTE ] DLNG: Full fetch complete (11957 records). [2025-09-30T18:19:40.906856] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-30T18:19:40.907545] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:19:40.907679] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:19:40.907753] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:19:40.907853] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-30T18:19:40.907978] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-30T18:19:40.908038] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-09-30T18:19:40.908325] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-09-30T18:19:40.908454] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLNG took 24.4s. Estimated remaining: 3h 40m 2s. Rate: 7.9 symbols/min [2025-09-30T18:19:41.059701] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-30T18:19:41.192731] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:41.203187] [DEBUG] [LOCAL ] DMA: Loaded 4526 existing records from primary storage. [2025-09-30T18:19:41.203537] [INFO ] [MAIN ] DMA: Loaded 4526 existing records. [2025-09-30T18:19:41.532743] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:41.533147] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-30T18:19:41.533229] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-30T18:19:41.533706] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-30T18:19:41.533786] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-30T18:19:41.859450] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-30T18:19:41.976952] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:42.369932] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:19:42.654321] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-30T18:19:43.051957] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:19:43.454384] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-30T18:19:43.947800] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:19:44.101677] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:19:44.254418] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-30T18:19:44.816536] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T18:19:45.054405] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-30T18:19:45.854366] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-30T18:19:46.079515] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:19:46.357546] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T18:19:46.654356] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-30T18:19:47.216010] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:19:47.454394] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-30T18:19:48.022591] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:19:48.254374] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-30T18:19:49.054400] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-30T18:19:49.266280] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:19:49.854401] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-30T18:19:50.654404] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-30T18:19:50.867693] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:19:50.911031] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:19:51.454374] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-30T18:19:51.476774] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:19:52.254728] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-30T18:19:53.054333] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-30T18:19:53.196456] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:19:53.451699] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:19:53.458009] [INFO ] [REMOTE ] DLX: Full fetch complete (41364 records). [2025-09-30T18:19:53.458156] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-30T18:19:53.760097] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:19:53.859511] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-30T18:19:53.907202] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-30T18:19:53.907336] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-30T18:19:53.908032] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-30T18:19:53.908100] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-30T18:19:53.914197] [DEBUG] [LOCAL ] DLX: Trimmed 41364 records to 28553 (keeping 200 days of data) [2025-09-30T18:19:54.106808] [DEBUG] [LOCAL ] DLX: Primary data saved (28553 records). [2025-09-30T18:19:54.106938] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-30T18:19:54.107468] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLX took 31.1s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-09-30T18:19:54.295712] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:54.309748] [DEBUG] [LOCAL ] DMB: Loaded 10202 existing records from primary storage. [2025-09-30T18:19:54.309992] [INFO ] [MAIN ] DMB: Loaded 10202 existing records. [2025-09-30T18:19:54.513209] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:54.513450] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-30T18:19:54.513500] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-30T18:19:54.514110] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-30T18:19:54.514175] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-30T18:19:54.659531] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-30T18:19:54.917556] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:55.339678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T18:19:55.454386] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-30T18:19:55.743104] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T18:19:56.032037] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T18:19:56.254377] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-30T18:19:57.054391] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-30T18:19:57.496410] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:19:57.854398] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-30T18:19:58.012560] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:19:58.546519] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:19:58.548511] [INFO ] [REMOTE ] DMA: Full fetch complete (6640 records). [2025-09-30T18:19:58.548601] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-30T18:19:58.654488] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-30T18:19:58.933412] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-30T18:19:58.933513] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-30T18:19:58.933794] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-30T18:19:58.933881] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-30T18:19:58.934372] [DEBUG] [LOCAL ] DMA: Trimmed 6640 records to 4549 (keeping 200 days of data) [2025-09-30T18:19:58.963695] [DEBUG] [LOCAL ] DMA: Primary data saved (4549 records). [2025-09-30T18:19:58.963860] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-30T18:19:58.963964] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMA took 18.1s. Estimated remaining: 3h 39m 55s. Rate: 7.9 symbols/min [2025-09-30T18:19:59.148943] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:59.149160] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-30T18:19:59.149205] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-30T18:19:59.149344] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-30T18:19:59.149386] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-30T18:19:59.149426] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-30T18:19:59.149459] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-30T18:19:59.458715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-30T18:19:59.530390] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:59.817314] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T18:20:00.254401] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-30T18:20:01.054376] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-30T18:20:01.172598] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:20:01.337895] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:20:01.354924] [INFO ] [REMOTE ] DLR: Full fetch complete (74110 records). [2025-09-30T18:20:01.355995] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-30T18:20:01.787181] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-30T18:20:01.787284] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-30T18:20:01.788267] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-30T18:20:01.788344] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-30T18:20:01.790206] [DEBUG] [LOCAL ] DLR: Trimmed 74110 records to 50973 (keeping 200 days of data) [2025-09-30T18:20:01.859014] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-30T18:20:02.155182] [DEBUG] [LOCAL ] DLR: Primary data saved (50973 records). [2025-09-30T18:20:02.155355] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-30T18:20:02.155444] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLR took 41.8s. Estimated remaining: 3h 39m 35s. Rate: 7.9 symbols/min [2025-09-30T18:20:02.376344] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:02.389325] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:20:02.398432] [INFO ] [REMOTE ] DLY: Full fetch complete (28198 records). [2025-09-30T18:20:02.398636] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-30T18:20:02.659265] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-30T18:20:02.755096] [DEBUG] [LOCAL ] DNA: Loaded 48248 existing records from primary storage. [2025-09-30T18:20:02.775906] [INFO ] [MAIN ] DNA: Loaded 48248 existing records. [2025-09-30T18:20:02.882247] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:20:03.023054] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-30T18:20:03.042843] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-30T18:20:03.043511] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-30T18:20:03.043920] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-30T18:20:03.137016] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:03.137255] [DEBUG] [LOCAL ] DLY: Trimmed 28198 records to 19680 (keeping 200 days of data) [2025-09-30T18:20:03.137883] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-30T18:20:03.137947] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-30T18:20:03.138972] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-30T18:20:03.139034] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-30T18:20:03.471796] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-30T18:20:03.482551] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T18:20:03.697433] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:03.714807] [DEBUG] [LOCAL ] DLY: Primary data saved (19680 records). [2025-09-30T18:20:03.714988] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-30T18:20:03.715159] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 34.5s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-09-30T18:20:03.898219] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:03.947764] [DEBUG] [LOCAL ] DNOW: Loaded 43639 existing records from primary storage. [2025-09-30T18:20:03.948096] [INFO ] [MAIN ] DNOW: Loaded 43639 existing records. [2025-09-30T18:20:04.159765] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:04.160023] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-30T18:20:04.160088] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-30T18:20:04.160595] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-30T18:20:04.160697] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-30T18:20:04.259422] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-30T18:20:04.369671] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:20:04.580332] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:05.054357] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-30T18:20:05.226074] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:20:05.854358] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-30T18:20:05.872082] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T18:20:06.654500] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-30T18:20:06.663455] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T18:20:07.454362] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-30T18:20:07.994804] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:20:08.254373] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-30T18:20:08.286153] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:20:09.054440] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-30T18:20:09.854325] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-30T18:20:10.122685] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:20:10.561527] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:20:10.651906] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:20:10.654361] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-30T18:20:11.434293] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:20:11.454326] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-30T18:20:12.254331] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-30T18:20:12.402554] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T18:20:13.054379] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-30T18:20:13.623677] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:20:13.854336] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-30T18:20:14.050277] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T18:20:14.439481] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:20:14.654403] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-30T18:20:15.454425] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-30T18:20:16.254378] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-30T18:20:16.555342] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:20:16.648718] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T18:20:16.992524] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T18:20:17.054357] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-30T18:20:17.832775] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:20:17.854333] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-30T18:20:18.654371] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-30T18:20:19.454382] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-30T18:20:19.582267] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:20:19.613867] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:20:20.254365] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-30T18:20:20.839522] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:20:21.054362] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-30T18:20:21.095979] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:20:21.771605] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T18:20:21.854363] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-30T18:20:22.654388] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-30T18:20:23.342438] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:20:23.454371] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-30T18:20:24.230893] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:20:24.254349] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-30T18:20:25.054327] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-30T18:20:25.461449] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T18:20:25.854354] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-30T18:20:25.957386] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:20:25.961404] [INFO ] [REMOTE ] DMB: Full fetch complete (14986 records). [2025-09-30T18:20:25.961609] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-30T18:20:25.976933] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:20:25.988815] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:20:25.990543] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T18:20:25.989333] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:20:26.000152] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-30T18:20:26.000413] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-09-30T18:20:26.000471] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-09-30T18:20:26.001090] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-09-30T18:20:26.001199] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 31.9s. Estimated remaining: 3h 39m 44s. Rate: 7.9 symbols/min [2025-09-30T18:20:26.201791] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:26.246786] [DEBUG] [LOCAL ] DNP: Loaded 33167 existing records from primary storage. [2025-09-30T18:20:26.247133] [INFO ] [MAIN ] DNP: Loaded 33167 existing records. [2025-09-30T18:20:26.457925] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:26.458146] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-30T18:20:26.458244] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-30T18:20:26.458799] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-30T18:20:26.458861] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-30T18:20:26.663574] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-30T18:20:26.895925] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:26.904295] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:20:26.907275] [INFO ] [REMOTE ] DMO: Full fetch complete (14642 records). [2025-09-30T18:20:26.907383] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-30T18:20:27.305151] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-30T18:20:27.305283] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-30T18:20:27.305682] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-30T18:20:27.305747] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-30T18:20:27.306924] [DEBUG] [LOCAL ] DMO: Trimmed 14642 records to 9860 (keeping 200 days of data) [2025-09-30T18:20:27.389907] [DEBUG] [LOCAL ] DMO: Primary data saved (9860 records). [2025-09-30T18:20:27.390093] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-30T18:20:27.390202] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 28.4s. Estimated remaining: 3h 39m 19s. Rate: 7.9 symbols/min [2025-09-30T18:20:27.459572] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-30T18:20:27.628945] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:27.699608] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-09-30T18:20:27.699992] [INFO ] [MAIN ] DOC: Loaded 53542 existing records. [2025-09-30T18:20:27.882884] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:27.883182] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-30T18:20:27.883239] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-30T18:20:27.884388] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-30T18:20:27.884477] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-30T18:20:28.274109] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:28.268047] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-30T18:20:28.304967] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:20:28.780688] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:20:29.054349] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-30T18:20:29.697376] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:20:29.854355] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-30T18:20:30.654379] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-30T18:20:31.020786] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T18:20:31.454398] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-30T18:20:31.579222] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:20:32.254355] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-30T18:20:32.643764] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:20:32.733894] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T18:20:33.054397] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-30T18:20:33.854397] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-30T18:20:34.353451] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:20:34.571818] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T18:20:34.654451] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-30T18:20:35.093214] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T18:20:35.454416] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-30T18:20:36.254351] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-30T18:20:36.354450] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:20:36.365084] [INFO ] [REMOTE ] DNA: Full fetch complete (70884 records). [2025-09-30T18:20:36.365358] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-30T18:20:36.826857] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-30T18:20:36.827077] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-30T18:20:36.828240] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-30T18:20:36.828387] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-30T18:20:36.830705] [DEBUG] [LOCAL ] DNA: Trimmed 70884 records to 48267 (keeping 200 days of data) [2025-09-30T18:20:36.951662] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:20:37.075687] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-30T18:20:37.167691] [DEBUG] [LOCAL ] DNA: Primary data saved (48267 records). [2025-09-30T18:20:37.167893] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-30T18:20:37.168011] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNA took 35.0s. Estimated remaining: 3h 39m 18s. Rate: 7.9 symbols/min [2025-09-30T18:20:37.676515] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:20:37.686763] [INFO ] [REMOTE ] DNOW: Full fetch complete (62805 records). [2025-09-30T18:20:37.686926] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-30T18:20:37.864876] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-30T18:20:38.136151] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-30T18:20:38.136237] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-30T18:20:38.137238] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-30T18:20:38.137307] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-30T18:20:38.138803] [DEBUG] [LOCAL ] DNOW: Trimmed 62805 records to 43657 (keeping 200 days of data) [2025-09-30T18:20:38.414344] [DEBUG] [LOCAL ] DNOW: Primary data saved (43657 records). [2025-09-30T18:20:38.414477] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-30T18:20:38.414561] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNOW took 34.7s. Estimated remaining: 3h 38m 53s. Rate: 7.9 symbols/min [2025-09-30T18:20:38.740347] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:20:38.753040] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-30T18:20:39.089559] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T18:20:39.454355] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-30T18:20:40.717161] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T18:20:40.729441] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-30T18:20:40.757590] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:20:41.054358] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-30T18:20:42.402759] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:20:42.416087] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T18:20:42.416555] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-30T18:20:42.654417] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-30T18:20:43.535921] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T18:20:43.545020] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-30T18:20:44.362714] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:20:44.374488] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-30T18:20:45.043548] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T18:20:45.054301] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-30T18:20:46.075747] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:20:46.087195] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-30T18:20:46.398278] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:20:46.654412] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-30T18:20:48.023012] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:20:48.056503] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-30T18:20:48.058932] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:20:48.066466] [INFO ] [REMOTE ] DNP: Full fetch complete (49359 records). [2025-09-30T18:20:48.066575] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-30T18:20:48.497621] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-30T18:20:48.497746] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-30T18:20:48.498498] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-30T18:20:48.498570] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-30T18:20:48.499941] [DEBUG] [LOCAL ] DNP: Trimmed 49359 records to 33200 (keeping 200 days of data) [2025-09-30T18:20:48.706254] [DEBUG] [LOCAL ] DNP: Primary data saved (33200 records). [2025-09-30T18:20:48.706447] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-30T18:20:48.707150] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNP took 22.7s. Estimated remaining: 3h 38m 53s. Rate: 7.9 symbols/min [2025-09-30T18:20:49.773948] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:20:49.786181] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-30T18:20:51.628721] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:20:51.640580] [INFO ] [REMOTE ] DOC: Full fetch complete (77389 records). [2025-09-30T18:20:51.640769] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-30T18:20:52.074791] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-30T18:20:52.074881] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-30T18:20:52.075820] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-30T18:20:52.075892] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-30T18:20:52.077403] [DEBUG] [LOCAL ] DOC: Trimmed 77389 records to 53542 (keeping 200 days of data) [2025-09-30T18:20:52.430078] [DEBUG] [LOCAL ] DOC: Primary data saved (53542 records). [2025-09-30T18:20:52.430230] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-30T18:20:52.430317] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 25.0s. Estimated remaining: 3h 38m 35s. Rate: 7.9 symbols/min [2025-09-30T18:20:53.074815] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.162378] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.246138] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.283210] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-09-30T18:20:53.298800] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-09-30T18:20:53.306529] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.308520] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-30T18:20:53.309133] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-30T18:20:53.309209] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-09-30T18:20:53.309249] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-30T18:20:53.554237] [DEBUG] [LOCAL ] DOLE: Loaded 38140 existing records from primary storage. [2025-09-30T18:20:53.621021] [DEBUG] [LOCAL ] DOCN: Loaded 50511 existing records from primary storage. [2025-09-30T18:20:53.619703] [DEBUG] [LOCAL ] DOUG: Loaded 34627 existing records from primary storage. [2025-09-30T18:20:53.626991] [INFO ] [MAIN ] DOLE: Loaded 38140 existing records. [2025-09-30T18:20:53.627269] [INFO ] [MAIN ] DOCN: Loaded 50511 existing records. [2025-09-30T18:20:53.670809] [INFO ] [MAIN ] DOUG: Loaded 34627 existing records. [2025-09-30T18:20:54.348022] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:54.442878] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.438570] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.443191] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.447101] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.411001] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-30T18:20:54.448552] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.448708] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-30T18:20:54.448490] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.448804] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-30T18:20:54.449004] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-30T18:20:54.449417] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-30T18:20:54.449507] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-30T18:20:54.449478] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-30T18:20:54.455007] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-30T18:20:54.461612] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-30T18:20:54.473864] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-30T18:20:55.541248] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.567090] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-30T18:20:55.689817] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.707467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-30T18:20:55.765845] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.766454] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-30T18:20:56.053884] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:20:56.064586] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-30T18:20:57.102503] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:20:57.111771] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-30T18:20:57.156687] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:20:57.164331] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-30T18:20:57.355565] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:20:57.366964] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-30T18:20:57.840083] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T18:20:57.849317] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-30T18:20:58.132545] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:20:58.140801] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-30T18:20:58.714526] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:20:58.724431] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-30T18:20:59.034448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T18:20:59.041331] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-30T18:20:59.225288] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:20:59.234007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-30T18:20:59.268728] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:20:59.454411] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-30T18:21:00.327470] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:21:00.336181] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-30T18:21:00.486790] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T18:21:00.662736] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T18:21:01.054396] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-30T18:21:01.471917] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T18:21:01.612494] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:21:01.854375] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-30T18:21:02.405710] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T18:21:02.654429] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-30T18:21:03.305145] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:21:03.454376] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-30T18:21:03.965801] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:21:04.254417] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-30T18:21:05.054369] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-30T18:21:05.093826] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:21:05.830176] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:21:05.854336] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-30T18:21:06.540218] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:21:06.654325] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-30T18:21:07.315448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:21:07.454396] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-30T18:21:08.254334] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-30T18:21:08.532730] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:21:09.054371] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-30T18:21:09.124555] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:21:09.728690] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T18:21:09.854385] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-30T18:21:10.654330] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-30T18:21:10.845602] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:21:11.259079] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:21:11.454364] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-30T18:21:12.169437] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T18:21:12.254352] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-30T18:21:13.054394] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-30T18:21:13.133405] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:21:13.854392] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-30T18:21:14.026611] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:21:14.036670] [INFO ] [REMOTE ] DOLE: Full fetch complete (53655 records). [2025-09-30T18:21:14.036836] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-30T18:21:14.472467] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-30T18:21:14.472576] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-30T18:21:14.473602] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-30T18:21:14.473701] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-30T18:21:14.475534] [DEBUG] [LOCAL ] DOLE: Trimmed 53655 records to 38292 (keeping 200 days of data) [2025-09-30T18:21:14.661404] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-30T18:21:14.740222] [DEBUG] [LOCAL ] DOLE: Primary data saved (38292 records). [2025-09-30T18:21:14.740978] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-30T18:21:14.742159] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 22.3s. Estimated remaining: 3h 39m 7s. Rate: 7.9 symbols/min [2025-09-30T18:21:14.995569] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:15.003373] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T18:21:15.064613] [DEBUG] [LOCAL ] DOV: Loaded 45536 existing records from primary storage. [2025-09-30T18:21:15.065023] [INFO ] [MAIN ] DOV: Loaded 45536 existing records. [2025-09-30T18:21:15.303990] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:15.304395] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-30T18:21:15.304453] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-30T18:21:15.305955] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-30T18:21:15.306018] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-30T18:21:15.468449] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-30T18:21:15.744408] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:15.780721] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:21:16.062958] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:21:16.254420] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-30T18:21:16.944144] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:21:16.955071] [INFO ] [REMOTE ] DOCS: Full fetch complete (73792 records). [2025-09-30T18:21:16.955268] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-30T18:21:16.956275] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:16.956368] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:16.956496] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:16.956574] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-30T18:21:16.956663] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-09-30T18:21:16.956724] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-09-30T18:21:16.956795] [DEBUG] [LOCAL ] DOCS: No derivative data file found to delete. [2025-09-30T18:21:16.956881] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOCS took 24.5s. Estimated remaining: 3h 38m 45s. Rate: 7.9 symbols/min [2025-09-30T18:21:17.059635] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-30T18:21:17.147794] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:17.148025] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-09-30T18:21:17.148069] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-09-30T18:21:17.148220] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-30T18:21:17.148274] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-30T18:21:17.148319] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-09-30T18:21:17.148352] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-30T18:21:17.576943] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:17.854337] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-30T18:21:17.962460] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T18:21:18.461300] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:21:18.654395] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-30T18:21:19.454427] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-30T18:21:19.944834] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T18:21:20.254357] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-30T18:21:20.576439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:21:21.054357] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-30T18:21:21.144564] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:21:21.802852] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:21:21.854338] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-30T18:21:22.408849] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T18:21:22.416586] [INFO ] [REMOTE ] DOUG: Full fetch complete (51269 records). [2025-09-30T18:21:22.416751] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-30T18:21:22.661316] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-30T18:21:22.841091] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-30T18:21:22.841254] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-30T18:21:22.842202] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-30T18:21:22.842271] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-30T18:21:22.843481] [DEBUG] [LOCAL ] DOUG: Trimmed 51269 records to 34546 (keeping 200 days of data) [2025-09-30T18:21:23.046144] [DEBUG] [LOCAL ] DOUG: Primary data saved (34546 records). [2025-09-30T18:21:23.046300] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-30T18:21:23.046392] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOUG took 30.6s. Estimated remaining: 3h 38m 33s. Rate: 7.9 symbols/min [2025-09-30T18:21:23.234217] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:23.250131] [DEBUG] [LOCAL ] DPG: Loaded 13524 existing records from primary storage. [2025-09-30T18:21:23.250374] [INFO ] [MAIN ] DPG: Loaded 13524 existing records. [2025-09-30T18:21:23.447835] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:23.448242] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-30T18:21:23.448380] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-30T18:21:23.449029] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-30T18:21:23.449089] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-30T18:21:23.460567] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-30T18:21:23.707518] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:21:23.925177] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:24.259511] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-30T18:21:24.284857] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:21:25.054334] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-30T18:21:25.218909] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:21:25.461796] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:21:25.854356] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-30T18:21:26.654391] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-30T18:21:27.211553] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:21:27.375506] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:21:27.454396] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-30T18:21:28.254474] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-30T18:21:28.586619] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:21:28.604167] [INFO ] [REMOTE ] DOCN: Full fetch complete (71601 records). [2025-09-30T18:21:28.604444] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-30T18:21:29.065529] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-30T18:21:29.120692] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-30T18:21:29.121085] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-30T18:21:29.134213] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-30T18:21:29.136106] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-30T18:21:29.135834] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:21:29.143168] [DEBUG] [LOCAL ] DOCN: Trimmed 71601 records to 50539 (keeping 200 days of data) [2025-09-30T18:21:29.266136] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:21:29.495694] [DEBUG] [LOCAL ] DOCN: Primary data saved (50539 records). [2025-09-30T18:21:29.495862] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-30T18:21:29.495990] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 37.1s. Estimated remaining: 3h 38m 22s. Rate: 7.9 symbols/min [2025-09-30T18:21:29.693069] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:29.693267] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-09-30T18:21:29.693307] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-09-30T18:21:29.693460] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-30T18:21:29.693502] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-30T18:21:29.693676] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-30T18:21:29.693732] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-30T18:21:29.865963] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-30T18:21:30.114258] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:30.634979] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:21:30.654335] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-30T18:21:31.394332] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-30T18:21:31.454377] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-30T18:21:31.500605] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:21:32.254368] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-30T18:21:33.054376] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-30T18:21:33.348271] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T18:21:33.854327] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-30T18:21:34.422720] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T18:21:34.462711] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T18:21:34.654426] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-30T18:21:35.128754] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:21:35.454406] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-30T18:21:35.847524] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:21:36.254407] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-30T18:21:36.529447] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T18:21:37.054382] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-30T18:21:37.854733] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-30T18:21:37.858679] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:21:38.654352] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-30T18:21:39.013765] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T18:21:39.314831] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:21:39.400941] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T18:21:39.454393] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-30T18:21:40.254409] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-30T18:21:41.054333] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-30T18:21:41.083744] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:21:41.854398] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-30T18:21:41.871274] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:21:41.976416] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:21:42.654405] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-30T18:21:43.454377] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-30T18:21:43.598500] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:21:43.952755] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T18:21:44.254399] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-30T18:21:45.054353] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-30T18:21:45.147907] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:21:45.370554] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:21:45.854394] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-30T18:21:46.654414] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-30T18:21:47.213220] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T18:21:47.454340] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-30T18:21:47.943870] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-30T18:21:48.073871] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:21:48.254351] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-30T18:21:48.484369] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:21:48.488699] [INFO ] [REMOTE ] DPG: Full fetch complete (18967 records). [2025-09-30T18:21:48.488909] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-30T18:21:48.489904] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:48.489996] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:48.490041] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:48.490091] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-30T18:21:48.490175] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-30T18:21:48.490236] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-30T18:21:48.490964] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-09-30T18:21:48.491121] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 25.4s. Estimated remaining: 3h 38m 45s. Rate: 7.9 symbols/min [2025-09-30T18:21:48.686582] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:48.729542] [DEBUG] [LOCAL ] DRD: Loaded 36927 existing records from primary storage. [2025-09-30T18:21:48.729932] [INFO ] [MAIN ] DRD: Loaded 36927 existing records. [2025-09-30T18:21:48.931177] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:48.931415] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-30T18:21:48.931493] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-30T18:21:48.932858] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-30T18:21:48.932933] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-30T18:21:49.055322] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-30T18:21:49.337803] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:49.854328] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-30T18:21:50.214357] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:21:50.409341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:21:50.422399] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-30T18:21:50.422593] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-30T18:21:50.664479] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-30T18:21:50.880567] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-30T18:21:50.880704] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-30T18:21:50.881923] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-30T18:21:50.882010] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-30T18:21:50.885748] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-30T18:21:51.147206] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:21:51.268339] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-30T18:21:51.268513] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-30T18:21:51.268677] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DOW took 34.3s. Estimated remaining: 3h 38m 25s. Rate: 7.9 symbols/min [2025-09-30T18:21:51.451360] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:51.454386] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-30T18:21:51.504713] [DEBUG] [LOCAL ] DRH: Loaded 50452 existing records from primary storage. [2025-09-30T18:21:51.505085] [INFO ] [MAIN ] DRH: Loaded 50452 existing records. [2025-09-30T18:21:51.718512] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:51.718839] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-30T18:21:51.718937] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-30T18:21:51.720363] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-30T18:21:51.720437] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-30T18:21:52.192062] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:52.254399] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-30T18:21:52.418302] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:21:52.429259] [INFO ] [REMOTE ] DOV: Full fetch complete (64861 records). [2025-09-30T18:21:52.429429] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-30T18:21:52.430226] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:52.430315] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:52.430359] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:52.430428] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-30T18:21:52.430507] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-30T18:21:52.430567] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-09-30T18:21:52.430901] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-09-30T18:21:52.432482] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOV took 37.7s. Estimated remaining: 3h 38m 0s. Rate: 7.9 symbols/min [2025-09-30T18:21:52.627013] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:52.627258] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-09-30T18:21:52.627302] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-09-30T18:21:52.627444] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-30T18:21:52.627521] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-30T18:21:52.627582] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-30T18:21:52.627617] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-30T18:21:53.055140] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-30T18:21:53.059384] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:53.275782] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:21:53.848741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:21:53.861691] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-30T18:21:54.364300] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:21:54.654380] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-30T18:21:55.454333] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-30T18:21:55.532531] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:21:55.972152] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:21:56.254368] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-30T18:21:56.952068] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:21:57.054378] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-30T18:21:57.696329] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:21:57.854372] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-30T18:21:58.231247] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:21:58.654371] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-30T18:21:59.454389] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-30T18:21:59.666826] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:21:59.680231] [INFO ] [REMOTE ] DQ: Full fetch complete (62993 records). [2025-09-30T18:21:59.680400] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-30T18:22:00.127211] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-30T18:22:00.127326] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-30T18:22:00.128285] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-30T18:22:00.128383] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-30T18:22:00.153855] [DEBUG] [LOCAL ] DQ: Trimmed 62993 records to 43336 (keeping 200 days of data) [2025-09-30T18:22:00.154749] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:22:00.254607] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-30T18:22:00.430919] [DEBUG] [LOCAL ] DQ: Primary data saved (43336 records). [2025-09-30T18:22:00.431170] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-30T18:22:00.431336] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 30.9s. Estimated remaining: 3h 37m 54s. Rate: 7.9 symbols/min [2025-09-30T18:22:00.610223] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:00.610451] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-09-30T18:22:00.610510] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-09-30T18:22:00.610669] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-30T18:22:00.610731] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-30T18:22:00.610820] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-30T18:22:00.610866] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-30T18:22:01.019002] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:01.054413] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-30T18:22:01.168776] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:22:01.707384] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:22:01.742241] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:22:01.854359] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-30T18:22:02.654397] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-30T18:22:03.367208] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:22:03.461008] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-30T18:22:03.464721] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:22:04.254381] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-30T18:22:04.768555] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:22:05.005488] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:22:05.054329] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-30T18:22:05.854404] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-30T18:22:06.263831] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T18:22:06.654361] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-30T18:22:07.305038] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:22:07.454367] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-30T18:22:08.254336] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-30T18:22:08.442745] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T18:22:08.546244] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:22:09.054406] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-30T18:22:09.675609] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:22:09.854400] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-30T18:22:10.654373] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-30T18:22:10.779741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:22:11.454401] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-30T18:22:11.667800] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:22:11.679622] [INFO ] [REMOTE ] DRD: Full fetch complete (49620 records). [2025-09-30T18:22:11.679852] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-30T18:22:12.235043] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:22:12.259348] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-30T18:22:12.300173] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-30T18:22:12.300311] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-30T18:22:12.301412] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-30T18:22:12.301833] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-30T18:22:12.303890] [DEBUG] [LOCAL ] DRD: Trimmed 49620 records to 36875 (keeping 200 days of data) [2025-09-30T18:22:12.447447] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:22:12.621902] [DEBUG] [LOCAL ] DRD: Primary data saved (36875 records). [2025-09-30T18:22:12.622117] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-30T18:22:12.622397] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 24.1s. Estimated remaining: 3h 37m 58s. Rate: 7.9 symbols/min [2025-09-30T18:22:12.820217] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:12.859122] [DEBUG] [LOCAL ] DSL: Loaded 28288 existing records from primary storage. [2025-09-30T18:22:12.859425] [INFO ] [MAIN ] DSL: Loaded 28288 existing records. [2025-09-30T18:22:13.076684] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:13.073445] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-30T18:22:13.079404] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-30T18:22:13.080605] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T18:22:13.080757] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-30T18:22:13.084897] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-30T18:22:13.084963] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-30T18:22:13.482035] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:13.854374] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-30T18:22:14.654361] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-30T18:22:14.688955] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:22:14.821765] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T18:22:15.454393] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-30T18:22:16.254370] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-30T18:22:16.444936] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:22:16.876107] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:22:17.054371] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-30T18:22:17.544167] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:22:17.854391] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-30T18:22:17.913448] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T18:22:18.654368] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-30T18:22:19.432444] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:22:19.454305] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-30T18:22:19.576627] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T18:22:20.254379] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-30T18:22:20.691623] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T18:22:20.694264] [INFO ] [REMOTE ] DRLL: Full fetch complete (15582 records). [2025-09-30T18:22:20.694569] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-30T18:22:21.059468] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-30T18:22:21.107348] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-30T18:22:21.107433] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-30T18:22:21.107857] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-30T18:22:21.107948] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-30T18:22:21.108581] [DEBUG] [LOCAL ] DRLL: Trimmed 15582 records to 9497 (keeping 200 days of data) [2025-09-30T18:22:21.171878] [DEBUG] [LOCAL ] DRLL: Primary data saved (9497 records). [2025-09-30T18:22:21.172012] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-30T18:22:21.172088] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRLL took 20.7s. Estimated remaining: 3h 37m 53s. Rate: 7.9 symbols/min [2025-09-30T18:22:21.361969] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:21.362193] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-30T18:22:21.362239] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-30T18:22:21.362371] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-30T18:22:21.362413] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-30T18:22:21.362455] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-30T18:22:21.362488] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-30T18:22:21.763570] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:21.798971] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:22:21.854367] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-30T18:22:22.656955] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-30T18:22:22.663112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:22:22.903661] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:22:23.454415] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-30T18:22:23.875431] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:22:24.182301] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:22:24.254414] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-30T18:22:25.054527] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-30T18:22:25.856911] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-30T18:22:25.862866] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T18:22:26.654405] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-30T18:22:26.741737] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:22:26.798301] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:22:27.454321] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-30T18:22:27.968114] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:22:28.254404] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-30T18:22:28.636620] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:22:29.054410] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-30T18:22:29.854390] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-30T18:22:30.239098] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:22:30.249942] [INFO ] [REMOTE ] DRI: Full fetch complete (69598 records). [2025-09-30T18:22:30.250117] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-30T18:22:30.678669] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-30T18:22:30.703027] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-30T18:22:30.704027] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-30T18:22:30.704882] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-30T18:22:30.705112] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-30T18:22:30.707011] [DEBUG] [LOCAL ] DRI: Trimmed 69598 records to 47780 (keeping 200 days of data) [2025-09-30T18:22:30.863667] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:22:31.086717] [DEBUG] [LOCAL ] DRI: Primary data saved (47780 records). [2025-09-30T18:22:31.086892] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-30T18:22:31.087078] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRI took 38.7s. Estimated remaining: 3h 37m 52s. Rate: 7.9 symbols/min [2025-09-30T18:22:31.163586] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:22:31.309409] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:31.314353] [DEBUG] [LOCAL ] DSMC: Loaded 1912 existing records from primary storage. [2025-09-30T18:22:31.314542] [INFO ] [MAIN ] DSMC: Loaded 1912 existing records. [2025-09-30T18:22:31.459563] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-30T18:22:31.542429] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:31.542725] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-30T18:22:31.542788] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-30T18:22:31.542982] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-30T18:22:31.543041] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-30T18:22:31.909560] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T18:22:31.979541] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:32.254371] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-30T18:22:32.883740] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T18:22:32.905411] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:22:33.054362] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-30T18:22:33.854368] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-30T18:22:34.121023] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T18:22:34.654408] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-30T18:22:35.454343] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-30T18:22:35.545687] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T18:22:35.557492] [INFO ] [REMOTE ] DRH: Full fetch complete (71856 records). [2025-09-30T18:22:35.557680] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-30T18:22:35.693568] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:22:35.995250] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:22:36.020857] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-30T18:22:36.020939] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-30T18:22:36.021995] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-30T18:22:36.022063] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-30T18:22:36.023560] [DEBUG] [LOCAL ] DRH: Trimmed 71856 records to 50465 (keeping 200 days of data) [2025-09-30T18:22:36.254438] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-30T18:22:36.339488] [DEBUG] [LOCAL ] DRH: Primary data saved (50465 records). [2025-09-30T18:22:36.339665] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-30T18:22:36.339789] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRH took 45.1s. Estimated remaining: 3h 37m 38s. Rate: 7.9 symbols/min [2025-09-30T18:22:36.542181] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:36.566344] [DEBUG] [LOCAL ] DSU: Loaded 22497 existing records from primary storage. [2025-09-30T18:22:36.566617] [INFO ] [MAIN ] DSU: Loaded 22497 existing records. [2025-09-30T18:22:36.767531] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:36.767801] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-30T18:22:36.767853] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-30T18:22:36.768671] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-30T18:22:36.768752] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-30T18:22:37.059505] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-30T18:22:37.161797] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:37.285232] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:22:37.369984] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:22:37.854382] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-30T18:22:38.338576] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T18:22:38.654384] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-30T18:22:39.030406] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-30T18:22:39.454410] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-30T18:22:40.254435] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-30T18:22:40.789885] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:22:41.054365] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-30T18:22:41.238332] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:22:41.860804] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-30T18:22:41.865028] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:22:42.300533] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:22:42.654365] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-30T18:22:43.113406] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T18:22:43.454375] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-30T18:22:43.742424] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-30T18:22:44.254405] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-30T18:22:45.054332] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-30T18:22:45.082310] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T18:22:45.854366] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-30T18:22:45.926695] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T18:22:46.654346] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-30T18:22:46.963529] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-30T18:22:47.225885] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:22:47.454368] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-30T18:22:48.254400] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-30T18:22:48.277975] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T18:22:48.841803] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:22:48.842896] [INFO ] [REMOTE ] DSMC: Full fetch complete (2881 records). [2025-09-30T18:22:48.842970] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-30T18:22:49.062540] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-30T18:22:49.254228] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-30T18:22:49.254348] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-30T18:22:49.254506] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-30T18:22:49.254554] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-30T18:22:49.255017] [DEBUG] [LOCAL ] DSMC: Trimmed 2881 records to 1896 (keeping 200 days of data) [2025-09-30T18:22:49.268260] [DEBUG] [LOCAL ] DSMC: Primary data saved (1896 records). [2025-09-30T18:22:49.268386] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-30T18:22:49.268491] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSMC took 18.2s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-09-30T18:22:49.458947] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:49.459128] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-09-30T18:22:49.459168] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-09-30T18:22:49.459315] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-30T18:22:49.459390] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-30T18:22:49.459453] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-09-30T18:22:49.459489] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-30T18:22:49.853858] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:49.854224] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-30T18:22:50.248933] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:22:50.654360] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-30T18:22:51.396790] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T18:22:51.454397] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-30T18:22:52.254385] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-30T18:22:53.054358] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-30T18:23:04.673322] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (13.22 seconds). [2025-09-30T18:23:04.678868] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-30T18:23:05.392312] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (14.74 seconds). [2025-09-30T18:23:05.395914] [INFO ] [REMOTE ] DSM: Full fetch complete (24581 records). [2025-09-30T18:23:05.396005] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-30T18:23:05.396531] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:05.396620] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:05.396705] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:05.396758] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-30T18:23:05.396841] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-30T18:23:05.396898] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-30T18:23:05.396944] [DEBUG] [LOCAL ] DSM: No derivative data file found to delete. [2025-09-30T18:23:05.397004] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSM took 44.2s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-09-30T18:23:05.591155] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:05.651394] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-09-30T18:23:05.651782] [INFO ] [MAIN ] DT: Loaded 52927 existing records. [2025-09-30T18:23:05.842179] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:05.842390] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-30T18:23:05.842439] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-30T18:23:05.843932] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-30T18:23:05.844013] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-30T18:23:06.243011] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:06.243341] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-30T18:23:06.512904] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T18:23:06.518963] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-30T18:23:07.840538] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:23:07.850174] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (14.80 seconds). [2025-09-30T18:23:07.862450] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-30T18:23:07.862780] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-30T18:23:08.561188] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (16.31 seconds). [2025-09-30T18:23:08.568109] [INFO ] [REMOTE ] DSL: Full fetch complete (41464 records). [2025-09-30T18:23:08.568264] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-30T18:23:09.031575] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-30T18:23:09.033439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:23:09.040695] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-30T18:23:09.039837] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-30T18:23:09.042507] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-30T18:23:09.042765] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-30T18:23:09.062524] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T18:23:09.062724] [DEBUG] [LOCAL ] DSL: Trimmed 41464 records to 28412 (keeping 200 days of data) [2025-09-30T18:23:09.070271] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-30T18:23:09.257799] [DEBUG] [LOCAL ] DSL: Primary data saved (28412 records). [2025-09-30T18:23:09.257981] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-30T18:23:09.258086] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSL took 56.6s. Estimated remaining: 3h 37m 42s. Rate: 7.9 symbols/min [2025-09-30T18:23:09.453921] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:09.461346] [DEBUG] [LOCAL ] DTB: Loaded 4788 existing records from primary storage. [2025-09-30T18:23:09.461532] [INFO ] [MAIN ] DTB: Loaded 4788 existing records. [2025-09-30T18:23:09.679340] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:09.679622] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-30T18:23:09.679706] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-30T18:23:09.680086] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-30T18:23:09.680150] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-30T18:23:10.137979] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:10.139117] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-30T18:23:10.155717] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T18:23:10.161569] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-30T18:23:10.228768] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:23:10.233097] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-30T18:23:10.705535] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (4.46 seconds). [2025-09-30T18:23:10.717113] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-30T18:23:10.796448] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:23:10.799810] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-30T18:23:11.327226] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:23:11.334375] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-30T18:23:11.383295] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:23:11.385035] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-30T18:23:11.854030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:23:11.855594] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-30T18:23:11.927590] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:23:11.933606] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-30T18:23:12.322822] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T18:23:12.334081] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-30T18:23:12.473617] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:23:12.475227] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-30T18:23:12.530904] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:23:12.537220] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-30T18:23:12.813101] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:23:12.819636] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-30T18:23:12.963539] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:23:12.966027] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-30T18:23:13.369486] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T18:23:13.370251] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:23:13.377454] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-30T18:23:13.378804] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-30T18:23:13.491542] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T18:23:13.497152] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-30T18:23:13.797237] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T18:23:13.799354] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-30T18:23:13.999958] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:23:14.011302] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-30T18:23:14.389133] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T18:23:14.606234] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:23:14.613168] [INFO ] [REMOTE ] DSU: Full fetch complete (32748 records). [2025-09-30T18:23:14.613289] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-30T18:23:14.662102] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-30T18:23:14.845189] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:23:14.941789] [INFO ] [REMOTE ] DSX: Full fetch complete (36733 records). [2025-09-30T18:23:14.961545] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-30T18:23:15.257132] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-30T18:23:15.274580] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-30T18:23:15.308064] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-30T18:23:15.343901] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-30T18:23:15.431895] [DEBUG] [LOCAL ] DSU: Trimmed 32748 records to 22526 (keeping 200 days of data) [2025-09-30T18:23:15.461090] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:23:15.551050] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-30T18:23:15.621581] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-30T18:23:15.621769] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-30T18:23:15.660150] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-30T18:23:15.661302] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-30T18:23:15.667213] [DEBUG] [LOCAL ] DSX: Trimmed 36733 records to 24002 (keeping 200 days of data) [2025-09-30T18:23:15.870075] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:23:15.896680] [DEBUG] [LOCAL ] DSX: Primary data saved (24002 records). [2025-09-30T18:23:15.898110] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-30T18:23:15.898889] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSX took 26.6s. Estimated remaining: 3h 37m 32s. Rate: 7.9 symbols/min [2025-09-30T18:23:16.117232] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:16.123116] [DEBUG] [LOCAL ] DSU: Primary data saved (22526 records). [2025-09-30T18:23:16.123336] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-30T18:23:16.123443] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSU took 39.8s. Estimated remaining: 3h 37m 5s. Rate: 7.9 symbols/min [2025-09-30T18:23:16.261785] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-30T18:23:16.341611] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:23:16.363881] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:16.366809] [INFO ] [REMOTE ] DTB: Full fetch complete (6767 records). [2025-09-30T18:23:16.366994] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-30T18:23:16.367243] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-30T18:23:16.367380] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-30T18:23:16.367565] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-30T18:23:16.368290] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:16.367839] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-30T18:23:16.369276] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-30T18:23:16.369105] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:16.369464] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-30T18:23:16.369768] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:16.375081] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-30T18:23:16.399179] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-30T18:23:16.451930] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-09-30T18:23:16.492912] [DEBUG] [LOCAL ] DTE: Loaded 47796 existing records from primary storage. [2025-09-30T18:23:16.504623] [INFO ] [MAIN ] DTE: Loaded 47796 existing records. [2025-09-30T18:23:16.510766] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-09-30T18:23:16.517969] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 7.3s. Estimated remaining: 3h 36m 38s. Rate: 7.9 symbols/min [2025-09-30T18:23:17.138636] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:17.131487] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:17.143638] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-30T18:23:17.144321] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-30T18:23:17.165736] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-30T18:23:17.165948] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-30T18:23:17.247558] [DEBUG] [LOCAL ] DTG: Loaded 5880 existing records from primary storage. [2025-09-30T18:23:17.265913] [INFO ] [MAIN ] DTG: Loaded 5880 existing records. [2025-09-30T18:23:17.357857] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:17.378669] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-30T18:23:17.797810] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:17.803943] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-30T18:23:17.819687] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-30T18:23:17.846845] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-30T18:23:17.888818] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:17.889104] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-30T18:23:17.890071] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-30T18:23:18.035278] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:23:18.350807] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:18.354333] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:23:18.654417] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-30T18:23:19.353384] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:23:19.454381] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-30T18:23:19.778850] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T18:23:20.254339] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-30T18:23:20.467175] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T18:23:21.054410] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-30T18:23:21.615620] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:23:21.854376] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-30T18:23:21.900674] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:23:22.212187] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:23:22.654415] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-30T18:23:23.454431] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-30T18:23:23.910471] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:23:24.254348] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-30T18:23:24.332882] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:23:25.054359] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-30T18:23:25.854443] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-30T18:23:25.958989] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:23:26.159298] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-30T18:23:26.339496] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:23:26.654402] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-30T18:23:27.255162] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:23:27.454373] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-30T18:23:28.028202] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:23:28.254407] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-30T18:23:29.054372] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-30T18:23:29.854450] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-30T18:23:30.093070] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:23:30.374928] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:23:30.654421] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-30T18:23:30.953578] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:23:31.454409] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-30T18:23:32.097966] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T18:23:32.254368] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-30T18:23:32.987669] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:23:33.054389] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-30T18:23:33.225618] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:23:33.418078] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T18:23:33.854420] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-30T18:23:34.135379] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-30T18:23:34.654395] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-30T18:23:35.454368] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-30T18:23:35.819847] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-30T18:23:36.253568] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:23:36.262678] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-30T18:23:37.054407] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-30T18:23:37.854374] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-30T18:23:38.280184] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:23:38.293379] [INFO ] [REMOTE ] DT: Full fetch complete (76663 records). [2025-09-30T18:23:38.293518] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-30T18:23:38.501355] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:23:38.658426] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-30T18:23:38.780449] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-30T18:23:38.780816] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-30T18:23:38.781858] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-30T18:23:38.782102] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-30T18:23:38.816119] [DEBUG] [LOCAL ] DT: Trimmed 76663 records to 52925 (keeping 200 days of data) [2025-09-30T18:23:38.818880] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:23:39.050332] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T18:23:39.172037] [DEBUG] [LOCAL ] DT: Primary data saved (52925 records). [2025-09-30T18:23:39.172229] [INFO ] [MAIN ] DT: Full history saved. [2025-09-30T18:23:39.172377] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 33.8s. Estimated remaining: 3h 37m 10s. Rate: 7.9 symbols/min [2025-09-30T18:23:39.366006] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:39.366181] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-30T18:23:39.366221] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-30T18:23:39.366364] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-30T18:23:39.366445] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-30T18:23:39.366510] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-30T18:23:39.366547] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-30T18:23:39.459453] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-30T18:23:39.776721] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:40.015804] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T18:23:40.016886] [INFO ] [REMOTE ] DTF: Full fetch complete (2108 records). [2025-09-30T18:23:40.016979] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-30T18:23:40.228029] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T18:23:40.228258] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:40.228336] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:40.228414] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-30T18:23:40.228488] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-30T18:23:40.228537] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-30T18:23:40.228635] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-30T18:23:40.228761] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTF took 24.1s. Estimated remaining: 3h 36m 45s. Rate: 7.9 symbols/min [2025-09-30T18:23:40.262547] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-30T18:23:40.429757] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:40.482004] [DEBUG] [LOCAL ] DTM: Loaded 44232 existing records from primary storage. [2025-09-30T18:23:40.482434] [INFO ] [MAIN ] DTM: Loaded 44232 existing records. [2025-09-30T18:23:40.685139] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:40.685398] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-30T18:23:40.685453] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-30T18:23:40.686040] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-30T18:23:40.686099] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-30T18:23:41.060896] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-30T18:23:41.075889] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:41.298967] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:23:41.299327] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-30T18:23:41.299436] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:23:41.299525] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-30T18:23:41.299666] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:23:41.299762] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-30T18:23:41.299866] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-30T18:23:41.299925] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-30T18:23:41.299986] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-30T18:23:41.300056] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 2.1s. Estimated remaining: 3h 36m 21s. Rate: 7.9 symbols/min [2025-09-30T18:23:41.481996] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:41.489999] [DEBUG] [LOCAL ] DTW: Loaded 4881 existing records from primary storage. [2025-09-30T18:23:41.490222] [INFO ] [MAIN ] DTW: Loaded 4881 existing records. [2025-09-30T18:23:41.691527] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:41.691815] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-30T18:23:41.691866] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-30T18:23:41.692091] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-30T18:23:41.692175] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-30T18:23:41.855337] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-30T18:23:42.097083] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:42.127835] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:23:42.654398] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-30T18:23:43.319547] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:23:43.454613] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-30T18:23:43.456718] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:23:44.254444] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-30T18:23:45.059542] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-30T18:23:45.074389] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:23:45.736366] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:23:45.854345] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-30T18:23:45.952366] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:23:45.962915] [INFO ] [REMOTE ] DTE: Full fetch complete (68750 records). [2025-09-30T18:23:45.963072] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-30T18:23:45.964072] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:45.964191] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:45.964267] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:45.964343] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-30T18:23:45.964431] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-30T18:23:45.964498] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-09-30T18:23:45.964834] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-09-30T18:23:45.967052] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 30.1s. Estimated remaining: 3h 36m 6s. Rate: 7.9 symbols/min [2025-09-30T18:23:46.156815] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:46.223414] [DEBUG] [LOCAL ] DUK: Loaded 53458 existing records from primary storage. [2025-09-30T18:23:46.223768] [INFO ] [MAIN ] DUK: Loaded 53458 existing records. [2025-09-30T18:23:46.431071] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:46.431269] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-30T18:23:46.431325] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-30T18:23:46.433022] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-30T18:23:46.433083] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-30T18:23:46.565397] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T18:23:46.662079] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-30T18:23:46.896791] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:47.287704] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T18:23:47.454396] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-30T18:23:48.033284] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:23:48.254363] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-30T18:23:48.822270] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:23:49.054367] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-30T18:23:49.854372] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-30T18:23:50.454740] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:23:50.663103] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-30T18:23:50.682859] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:23:51.182873] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:23:51.454374] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-30T18:23:52.080911] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T18:23:52.254344] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-30T18:23:53.039976] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:23:53.041902] [INFO ] [REMOTE ] DTG: Full fetch complete (8879 records). [2025-09-30T18:23:53.042027] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-30T18:23:53.042875] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:53.042973] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:53.043027] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:53.043108] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-30T18:23:53.043203] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-30T18:23:53.043277] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-30T18:23:53.043595] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-09-30T18:23:53.043771] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTG took 36.5s. Estimated remaining: 3h 35m 57s. Rate: 7.9 symbols/min [2025-09-30T18:23:53.054336] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-30T18:23:53.243302] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:53.254770] [DEBUG] [LOCAL ] DUKB: Loaded 6344 existing records from primary storage. [2025-09-30T18:23:53.255056] [INFO ] [MAIN ] DUKB: Loaded 6344 existing records. [2025-09-30T18:23:53.444222] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:53.444464] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-30T18:23:53.444519] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-30T18:23:53.444786] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-30T18:23:53.444856] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-30T18:23:53.867502] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-30T18:23:53.873914] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:54.654373] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-30T18:23:54.787470] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:23:55.454356] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-30T18:23:55.517413] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:23:55.785079] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:23:56.254364] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-30T18:23:57.015069] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T18:23:57.054345] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-30T18:23:57.149884] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:23:57.854397] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-30T18:23:57.898370] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T18:23:58.654369] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-30T18:23:59.070069] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:23:59.326085] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:23:59.454372] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-30T18:24:00.164813] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:24:00.254376] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-30T18:24:01.054378] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-30T18:24:01.854338] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-30T18:24:02.122348] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T18:24:02.267772] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T18:24:02.269432] [INFO ] [REMOTE ] DTW: Full fetch complete (7599 records). [2025-09-30T18:24:02.269507] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-30T18:24:02.270440] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:02.270526] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:02.270571] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:02.270611] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-30T18:24:02.270694] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-09-30T18:24:02.270784] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-09-30T18:24:02.270968] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-09-30T18:24:02.271088] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTW took 21.0s. Estimated remaining: 3h 35m 53s. Rate: 7.9 symbols/min [2025-09-30T18:24:02.453960] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:02.529232] [DEBUG] [LOCAL ] DV: Loaded 51263 existing records from primary storage. [2025-09-30T18:24:02.529584] [INFO ] [MAIN ] DV: Loaded 51263 existing records. [2025-09-30T18:24:02.659522] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-30T18:24:02.726615] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:02.726875] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-30T18:24:02.727001] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-30T18:24:02.728338] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-30T18:24:02.728401] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-30T18:24:03.127606] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:03.307453] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:24:03.454387] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-30T18:24:04.254373] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-30T18:24:04.383389] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T18:24:04.698859] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:24:04.874109] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:24:05.054357] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-30T18:24:05.669018] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T18:24:05.854371] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-30T18:24:06.359150] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T18:24:06.654380] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-30T18:24:07.373786] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:24:07.454385] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-30T18:24:08.110100] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T18:24:08.254382] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-30T18:24:09.054421] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-30T18:24:09.854382] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-30T18:24:10.022797] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:24:10.402455] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:24:10.654352] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-30T18:24:10.733724] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:24:11.454364] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-30T18:24:12.237550] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:24:12.254344] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-30T18:24:13.054390] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-30T18:24:13.558968] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T18:24:13.672634] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T18:24:13.721529] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:24:13.731809] [INFO ] [REMOTE ] DTM: Full fetch complete (64831 records). [2025-09-30T18:24:13.732006] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-30T18:24:13.859628] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-30T18:24:14.167146] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-30T18:24:14.167295] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-30T18:24:14.168379] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-30T18:24:14.168457] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-30T18:24:14.170204] [DEBUG] [LOCAL ] DTM: Trimmed 64831 records to 44156 (keeping 200 days of data) [2025-09-30T18:24:14.471443] [DEBUG] [LOCAL ] DTM: Primary data saved (44156 records). [2025-09-30T18:24:14.471634] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-30T18:24:14.471819] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTM took 34.2s. Estimated remaining: 3h 35m 58s. Rate: 7.9 symbols/min [2025-09-30T18:24:14.662675] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:14.659745] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-30T18:24:14.711145] [DEBUG] [LOCAL ] DVA: Loaded 41068 existing records from primary storage. [2025-09-30T18:24:14.711493] [INFO ] [MAIN ] DVA: Loaded 41068 existing records. [2025-09-30T18:24:14.906335] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:14.906599] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-30T18:24:14.906702] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-30T18:24:14.908148] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-30T18:24:14.908244] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-30T18:24:15.300907] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:15.454413] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-30T18:24:15.742947] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:24:15.985850] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T18:24:15.987767] [INFO ] [REMOTE ] DUKB: Full fetch complete (9549 records). [2025-09-30T18:24:15.987847] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-30T18:24:16.259449] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-30T18:24:16.415804] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-30T18:24:16.415975] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-30T18:24:16.416630] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-30T18:24:16.416760] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-30T18:24:16.449385] [DEBUG] [LOCAL ] DUKB: Trimmed 9549 records to 6380 (keeping 200 days of data) [2025-09-30T18:24:16.452493] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T18:24:16.508360] [DEBUG] [LOCAL ] DUKB: Primary data saved (6380 records). [2025-09-30T18:24:16.508820] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-30T18:24:16.508990] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 23.5s. Estimated remaining: 3h 35m 36s. Rate: 7.9 symbols/min [2025-09-30T18:24:16.723261] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:16.723579] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-09-30T18:24:16.723663] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-09-30T18:24:16.723803] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-30T18:24:16.723846] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-30T18:24:16.723914] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-30T18:24:16.723951] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-30T18:24:17.059786] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-30T18:24:17.165464] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:17.474965] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:24:17.854400] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-30T18:24:18.658788] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-30T18:24:18.664172] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:24:19.454361] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-30T18:24:20.157159] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T18:24:20.254395] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-30T18:24:20.550941] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T18:24:21.054393] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-30T18:24:21.111612] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:24:21.854419] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-30T18:24:22.296886] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T18:24:22.654386] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-30T18:24:22.881266] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:24:23.374706] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:24:23.454360] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-30T18:24:24.254363] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-30T18:24:24.575921] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:24:25.054376] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-30T18:24:25.116299] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:24:25.855091] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-30T18:24:26.044687] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:24:26.062042] [INFO ] [REMOTE ] DUK: Full fetch complete (77016 records). [2025-09-30T18:24:26.062292] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-30T18:24:26.069322] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:26.069588] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:26.069730] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:26.069867] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-30T18:24:26.069982] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-09-30T18:24:26.070072] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-09-30T18:24:26.070524] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-09-30T18:24:26.071441] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 40.1s. Estimated remaining: 3h 35m 33s. Rate: 7.9 symbols/min [2025-09-30T18:24:26.332379] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:26.399732] [DEBUG] [LOCAL ] DX: Loaded 52453 existing records from primary storage. [2025-09-30T18:24:26.400118] [INFO ] [MAIN ] DX: Loaded 52453 existing records. [2025-09-30T18:24:26.622828] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:26.623197] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-30T18:24:26.623272] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-30T18:24:26.624929] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-30T18:24:26.624996] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-30T18:24:26.663280] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-30T18:24:27.050987] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:27.253929] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T18:24:27.301674] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:24:27.454389] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-30T18:24:28.231403] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T18:24:28.254310] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-30T18:24:29.054377] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-30T18:24:29.444155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:24:29.854337] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-30T18:24:29.931172] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:24:30.654450] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-30T18:24:31.128015] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:24:31.454409] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-30T18:24:31.498761] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T18:24:31.980161] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T18:24:32.254387] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-30T18:24:33.054421] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-30T18:24:33.473311] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-30T18:24:33.854374] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-30T18:24:33.925624] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T18:24:34.654367] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-30T18:24:34.851504] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T18:24:35.141682] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T18:24:35.454366] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-30T18:24:36.254387] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-30T18:24:36.640163] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T18:24:36.753725] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:24:36.765684] [INFO ] [REMOTE ] DV: Full fetch complete (73025 records). [2025-09-30T18:24:36.765889] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-30T18:24:36.768276] [FATAL] [VALIDATOR ] DV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:36.768377] [FATAL] [MAIN ] DV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:36.768422] [WARN ] [MAIN ] DV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:36.768463] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-30T18:24:36.768544] [DEBUG] [LOCAL ] DV: No primary data file found to delete. [2025-09-30T18:24:36.768704] [INFO ] [LOCAL ] DV: Starting deletion of derivative data. [2025-09-30T18:24:36.769229] [DEBUG] [LOCAL ] DV: Deleted derivative data file. [2025-09-30T18:24:36.769345] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DV took 34.5s. Estimated remaining: 3h 35m 34s. Rate: 7.9 symbols/min [2025-09-30T18:24:36.949252] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:37.002355] [DEBUG] [LOCAL ] DXC: Loaded 49756 existing records from primary storage. [2025-09-30T18:24:37.002696] [INFO ] [MAIN ] DXC: Loaded 49756 existing records. [2025-09-30T18:24:37.061062] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-30T18:24:37.197954] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:37.198210] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-30T18:24:37.198270] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-30T18:24:37.200317] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-30T18:24:37.200382] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-30T18:24:37.640034] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:37.801879] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:24:37.854348] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-30T18:24:38.654326] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-30T18:24:39.005940] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T18:24:39.285128] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T18:24:39.454412] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-30T18:24:40.073191] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:24:40.254370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-30T18:24:41.054389] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-30T18:24:41.466661] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:24:41.505188] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:24:41.854366] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-30T18:24:42.654318] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-30T18:24:43.016422] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:24:43.060717] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T18:24:43.454371] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-30T18:24:44.254350] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-30T18:24:44.711007] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-30T18:24:45.054548] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-30T18:24:45.100608] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:24:45.854319] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-30T18:24:46.211290] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T18:24:46.654402] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-30T18:24:47.075017] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:24:47.087397] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-30T18:24:47.087567] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-30T18:24:47.460092] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-30T18:24:47.554964] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-30T18:24:47.555369] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-30T18:24:47.558674] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:24:47.556731] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-30T18:24:47.567172] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-30T18:24:47.569142] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-30T18:24:47.922552] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-30T18:24:47.922722] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-30T18:24:47.922811] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 31.4s. Estimated remaining: 3h 35m 35s. Rate: 7.9 symbols/min [2025-09-30T18:24:48.112787] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:48.152107] [DEBUG] [LOCAL ] DXYZ: Loaded 36627 existing records from primary storage. [2025-09-30T18:24:48.152418] [INFO ] [MAIN ] DXYZ: Loaded 36627 existing records. [2025-09-30T18:24:48.258996] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-30T18:24:48.351764] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:48.352314] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-30T18:24:48.352483] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-30T18:24:48.353853] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-30T18:24:48.353924] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-30T18:24:48.684991] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T18:24:48.822996] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:48.854168] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:24:49.054378] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-30T18:24:49.515574] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:24:49.854379] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-30T18:24:50.654377] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-30T18:24:50.892507] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:24:51.294505] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T18:24:51.454366] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-30T18:24:52.254370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-30T18:24:52.685500] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:24:53.054360] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-30T18:24:53.334386] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-30T18:24:53.592864] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:24:53.854353] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-30T18:24:54.654386] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-30T18:24:54.780148] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T18:24:54.789203] [INFO ] [REMOTE ] DVA: Full fetch complete (59677 records). [2025-09-30T18:24:54.789334] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-30T18:24:55.219131] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-30T18:24:55.219217] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-30T18:24:55.220024] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-30T18:24:55.220091] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-30T18:24:55.221360] [DEBUG] [LOCAL ] DVA: Trimmed 59677 records to 41035 (keeping 200 days of data) [2025-09-30T18:24:55.456449] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-30T18:24:55.503571] [DEBUG] [LOCAL ] DVA: Primary data saved (41035 records). [2025-09-30T18:24:55.503846] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-30T18:24:55.504183] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVA took 41.0s. Estimated remaining: 3h 35m 27s. Rate: 7.9 symbols/min [2025-09-30T18:24:55.743515] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:55.746779] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:24:55.787450] [DEBUG] [LOCAL ] DY: Loaded 29395 existing records from primary storage. [2025-09-30T18:24:55.787797] [INFO ] [MAIN ] DY: Loaded 29395 existing records. [2025-09-30T18:24:55.989840] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:55.990150] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-30T18:24:55.990231] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-30T18:24:55.991354] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-30T18:24:55.991427] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-30T18:24:56.261836] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-30T18:24:56.426851] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:56.430213] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:24:57.054356] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-30T18:24:57.637207] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-30T18:24:57.854356] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-30T18:24:58.467452] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T18:24:58.479088] [INFO ] [REMOTE ] DX: Full fetch complete (75417 records). [2025-09-30T18:24:58.479264] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-30T18:24:58.655589] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-30T18:24:58.958300] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-30T18:24:58.958433] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-30T18:24:58.958129] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:24:58.959591] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-30T18:24:58.959710] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-30T18:24:58.973058] [DEBUG] [LOCAL ] DX: Trimmed 75417 records to 52469 (keeping 200 days of data) [2025-09-30T18:24:59.303965] [DEBUG] [LOCAL ] DX: Primary data saved (52469 records). [2025-09-30T18:24:59.304107] [INFO ] [MAIN ] DX: Full history saved. [2025-09-30T18:24:59.304777] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 33.2s. Estimated remaining: 3h 35m 10s. Rate: 7.9 symbols/min [2025-09-30T18:24:59.466451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-30T18:24:59.501629] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:59.539596] [DEBUG] [LOCAL ] E: Loaded 33269 existing records from primary storage. [2025-09-30T18:24:59.539946] [INFO ] [MAIN ] E: Loaded 33269 existing records. [2025-09-30T18:24:59.781100] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:59.782373] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:24:59.791268] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-30T18:24:59.791406] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-30T18:24:59.792560] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-30T18:24:59.792625] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-30T18:25:00.187822] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:00.254365] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-30T18:25:00.290470] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:25:01.054369] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-30T18:25:01.301485] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:25:01.854370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-30T18:25:02.077536] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:25:02.244526] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:25:02.654364] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-30T18:25:03.454344] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-30T18:25:03.641948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:25:03.653433] [INFO ] [REMOTE ] DXC: Full fetch complete (69057 records). [2025-09-30T18:25:03.653576] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-30T18:25:04.092966] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-30T18:25:04.093125] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-30T18:25:04.094036] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-30T18:25:04.094121] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-30T18:25:04.095706] [DEBUG] [LOCAL ] DXC: Trimmed 69057 records to 49776 (keeping 200 days of data) [2025-09-30T18:25:04.234127] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:25:04.301747] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-30T18:25:04.470280] [DEBUG] [LOCAL ] DXC: Primary data saved (49776 records). [2025-09-30T18:25:04.470501] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-30T18:25:04.470598] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 27.7s. Estimated remaining: 3h 34m 56s. Rate: 7.9 symbols/min [2025-09-30T18:25:04.669352] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:04.669525] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-09-30T18:25:04.669564] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-09-30T18:25:04.669710] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-30T18:25:04.669764] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-30T18:25:04.669807] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-30T18:25:04.669841] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-30T18:25:05.066588] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-30T18:25:05.072574] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:05.677384] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-30T18:25:05.854372] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-30T18:25:05.974807] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:25:06.264680] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T18:25:06.654371] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-30T18:25:07.454357] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-30T18:25:07.765437] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:25:08.117928] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:25:08.254363] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-30T18:25:08.532512] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:25:09.054368] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-30T18:25:09.854370] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-30T18:25:10.207689] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T18:25:10.641029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:25:10.654315] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-30T18:25:11.150841] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:25:11.454377] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-30T18:25:12.235134] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:25:12.254309] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-30T18:25:12.775031] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:25:13.054397] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-30T18:25:13.522674] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:25:13.854360] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-30T18:25:14.654363] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-30T18:25:15.056364] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T18:25:15.134634] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:25:15.454373] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-30T18:25:16.097404] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T18:25:16.254353] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-30T18:25:16.960584] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T18:25:17.054413] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-30T18:25:17.425545] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:25:17.854348] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-30T18:25:18.293088] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T18:25:18.654688] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-30T18:25:19.454403] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-30T18:25:19.646221] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:25:19.699100] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:25:20.254406] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-30T18:25:20.757430] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:25:21.054400] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-30T18:25:21.854376] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-30T18:25:21.917546] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T18:25:22.506065] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:25:22.654410] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-30T18:25:23.454359] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-30T18:25:23.930397] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T18:25:24.167392] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:25:24.254410] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-30T18:25:24.845440] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T18:25:25.054405] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-30T18:25:25.854385] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-30T18:25:26.142236] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:25:26.150719] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57808 records). [2025-09-30T18:25:26.150855] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-30T18:25:26.569367] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-30T18:25:26.569526] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-30T18:25:26.570419] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-30T18:25:26.570597] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-30T18:25:26.572130] [DEBUG] [LOCAL ] DXYZ: Trimmed 57808 records to 36771 (keeping 200 days of data) [2025-09-30T18:25:26.661861] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-30T18:25:26.702738] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T18:25:26.712887] [INFO ] [REMOTE ] DY: Full fetch complete (44896 records). [2025-09-30T18:25:26.713881] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-30T18:25:27.221041] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T18:25:27.338154] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-30T18:25:27.338674] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-30T18:25:27.339330] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-30T18:25:27.339404] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-30T18:25:27.346110] [DEBUG] [LOCAL ] DY: Trimmed 44896 records to 29287 (keeping 200 days of data) [2025-09-30T18:25:27.412800] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36771 records). [2025-09-30T18:25:27.421584] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-30T18:25:27.422066] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 39.5s. Estimated remaining: 3h 35m 28s. Rate: 7.9 symbols/min [2025-09-30T18:25:27.461025] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-30T18:25:27.663387] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:27.673347] [DEBUG] [LOCAL ] EAI: Loaded 3960 existing records from primary storage. [2025-09-30T18:25:27.674436] [INFO ] [MAIN ] EAI: Loaded 3960 existing records. [2025-09-30T18:25:27.886477] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:27.887784] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-30T18:25:27.889465] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-30T18:25:27.890240] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-30T18:25:27.890871] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-30T18:25:28.387097] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:28.390343] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-30T18:25:28.396907] [DEBUG] [LOCAL ] DY: Primary data saved (29287 records). [2025-09-30T18:25:28.397178] [INFO ] [MAIN ] DY: Full history saved. [2025-09-30T18:25:28.397293] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DY took 32.9s. Estimated remaining: 3h 35m 3s. Rate: 7.9 symbols/min [2025-09-30T18:25:28.499908] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:25:28.631810] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:28.632060] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-09-30T18:25:28.632255] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-09-30T18:25:28.632483] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-30T18:25:28.632539] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-30T18:25:28.632717] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-30T18:25:28.632845] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-30T18:25:28.910575] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T18:25:28.966535] [INFO ] [REMOTE ] E: Full fetch complete (48304 records). [2025-09-30T18:25:28.969610] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-30T18:25:29.067332] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-30T18:25:29.182990] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:29.308093] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:25:29.523000] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-30T18:25:29.523093] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-30T18:25:29.523931] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-30T18:25:29.524009] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-30T18:25:29.525494] [DEBUG] [LOCAL ] E: Trimmed 48304 records to 33253 (keeping 200 days of data) [2025-09-30T18:25:29.748254] [DEBUG] [LOCAL ] E: Primary data saved (33253 records). [2025-09-30T18:25:29.748419] [INFO ] [MAIN ] E: Full history saved. [2025-09-30T18:25:29.749027] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. E took 30.4s. Estimated remaining: 3h 34m 40s. Rate: 7.9 symbols/min [2025-09-30T18:25:29.862022] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-30T18:25:29.949994] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:30.002506] [DEBUG] [LOCAL ] EAT: Loaded 49769 existing records from primary storage. [2025-09-30T18:25:30.002952] [INFO ] [MAIN ] EAT: Loaded 49769 existing records. [2025-09-30T18:25:30.213521] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:30.213773] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-30T18:25:30.213826] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-30T18:25:30.215128] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-30T18:25:30.215193] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-30T18:25:30.648101] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:30.654307] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-30T18:25:30.794002] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:25:31.174457] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T18:25:31.454384] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-30T18:25:32.086606] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:25:32.254401] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-30T18:25:32.901256] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:25:32.905924] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:25:33.054377] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-30T18:25:33.854416] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-30T18:25:34.414879] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T18:25:34.493115] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:25:34.654365] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-30T18:25:35.454401] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-30T18:25:36.034290] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:25:36.038133] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:25:36.254353] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-30T18:25:37.054373] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-30T18:25:37.649206] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T18:25:37.655983] [INFO ] [REMOTE ] EAF: Full fetch complete (64008 records). [2025-09-30T18:25:37.656129] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-30T18:25:37.779827] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T18:25:37.860590] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-30T18:25:38.106717] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-30T18:25:38.106851] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-30T18:25:38.107720] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-30T18:25:38.107790] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-30T18:25:38.109263] [DEBUG] [LOCAL ] EAF: Trimmed 64008 records to 43066 (keeping 200 days of data) [2025-09-30T18:25:38.376851] [DEBUG] [LOCAL ] EAF: Primary data saved (43066 records). [2025-09-30T18:25:38.377016] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-30T18:25:38.377170] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 33.9s. Estimated remaining: 3h 34m 35s. Rate: 7.9 symbols/min [2025-09-30T18:25:38.515155] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:25:38.587761] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:38.633745] [DEBUG] [LOCAL ] EB: Loaded 37261 existing records from primary storage. [2025-09-30T18:25:38.634113] [INFO ] [MAIN ] EB: Loaded 37261 existing records. [2025-09-30T18:25:38.659599] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-30T18:25:38.864232] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:38.864437] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-30T18:25:38.864486] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-30T18:25:38.865356] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-30T18:25:38.865417] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-30T18:25:39.272464] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:39.454380] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-30T18:25:40.254365] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-30T18:25:40.311139] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:25:40.343085] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:25:41.054391] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-30T18:25:41.854393] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-30T18:25:42.094584] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T18:25:42.605603] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:25:42.637245] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:25:42.654368] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-30T18:25:43.454400] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-30T18:25:43.789687] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:25:44.254361] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-30T18:25:45.054370] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-30T18:25:45.382360] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T18:25:45.401518] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:25:45.854386] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-30T18:25:45.969702] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:25:46.654362] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-30T18:25:47.454359] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-30T18:25:47.720268] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:25:48.100138] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:25:48.254361] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-30T18:25:48.821712] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:25:49.054349] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-30T18:25:49.117219] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:25:49.854362] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-30T18:25:50.664230] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-30T18:25:50.670837] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T18:25:50.832857] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:25:51.454413] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-30T18:25:51.525761] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:25:51.527314] [INFO ] [REMOTE ] EAI: Full fetch complete (6149 records). [2025-09-30T18:25:51.527424] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-30T18:25:51.977937] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-30T18:25:51.978050] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-30T18:25:51.978273] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-30T18:25:51.978342] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-30T18:25:51.978807] [DEBUG] [LOCAL ] EAI: Trimmed 6149 records to 3945 (keeping 200 days of data) [2025-09-30T18:25:52.005470] [DEBUG] [LOCAL ] EAI: Primary data saved (3945 records). [2025-09-30T18:25:52.005620] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-30T18:25:52.005771] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAI took 24.6s. Estimated remaining: 3h 34m 42s. Rate: 7.9 symbols/min [2025-09-30T18:25:52.254331] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-30T18:25:52.649114] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:25:53.054356] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-30T18:25:53.854408] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-30T18:25:54.002356] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T18:25:54.323089] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T18:25:54.654357] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-30T18:25:54.885769] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:25:54.891004] [INFO ] [REMOTE ] EARN: Full fetch complete (46042 records). [2025-09-30T18:25:54.891097] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-30T18:25:55.298262] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-30T18:25:55.298351] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-30T18:25:55.299071] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-30T18:25:55.299137] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-30T18:25:55.300166] [DEBUG] [LOCAL ] EARN: Trimmed 46042 records to 29751 (keeping 200 days of data) [2025-09-30T18:25:55.461312] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-30T18:25:55.479950] [DEBUG] [LOCAL ] EARN: Primary data saved (29751 records). [2025-09-30T18:25:55.480087] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-30T18:25:55.480162] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 27.1s. Estimated remaining: 3h 34m 25s. Rate: 7.9 symbols/min [2025-09-30T18:25:56.188016] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:25:56.254368] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-30T18:25:56.804535] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:25:57.054362] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-30T18:25:58.242329] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:25:58.253869] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-30T18:25:58.384485] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T18:25:58.654392] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-30T18:25:59.670309] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:25:59.690023] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-30T18:26:00.068768] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:26:00.254360] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-30T18:26:01.630829] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:26:01.641861] [INFO ] [REMOTE ] EAT: Full fetch complete (71517 records). [2025-09-30T18:26:01.642072] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-30T18:26:01.643152] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:26:01.643288] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:26:01.643373] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:26:01.643444] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-30T18:26:01.643606] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-30T18:26:01.643712] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-30T18:26:01.644140] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-09-30T18:26:01.644999] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 31.9s. Estimated remaining: 3h 34m 13s. Rate: 7.9 symbols/min [2025-09-30T18:26:01.716869] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:26:01.727571] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-30T18:26:03.308478] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:26:03.316612] [INFO ] [REMOTE ] EB: Full fetch complete (56293 records). [2025-09-30T18:26:03.316837] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-30T18:26:03.772724] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-30T18:26:03.772827] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-30T18:26:03.773616] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-30T18:26:03.773705] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-30T18:26:03.776065] [DEBUG] [LOCAL ] EB: Trimmed 56293 records to 37197 (keeping 200 days of data) [2025-09-30T18:26:04.007800] [DEBUG] [LOCAL ] EB: Primary data saved (37197 records). [2025-09-30T18:26:04.007965] [INFO ] [MAIN ] EB: Full history saved. [2025-09-30T18:26:04.008141] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 25.6s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-09-30T18:26:04.692326] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.781754] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.796470] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.831366] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.859409] [DEBUG] [LOCAL ] EBF: Loaded 19222 existing records from primary storage. [2025-09-30T18:26:04.859903] [INFO ] [MAIN ] EBF: Loaded 19222 existing records. [2025-09-30T18:26:05.094071] [DEBUG] [LOCAL ] EC: Loaded 49282 existing records from primary storage. [2025-09-30T18:26:05.149944] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.146491] [DEBUG] [LOCAL ] EBS: Loaded 46678 existing records from primary storage. [2025-09-30T18:26:05.150892] [DEBUG] [LOCAL ] EBR: Loaded 43035 existing records from primary storage. [2025-09-30T18:26:05.134137] [INFO ] [MAIN ] EC: Loaded 49282 existing records. [2025-09-30T18:26:05.163485] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-30T18:26:05.151386] [INFO ] [MAIN ] EBS: Loaded 46678 existing records. [2025-09-30T18:26:05.179324] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-30T18:26:05.200809] [INFO ] [MAIN ] EBR: Loaded 43035 existing records. [2025-09-30T18:26:05.365001] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-30T18:26:05.384945] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-30T18:26:05.953200] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.850468] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.963969] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.000076] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-30T18:26:05.967381] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.003762] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-30T18:26:05.973318] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:06.012026] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-30T18:26:06.011982] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-30T18:26:06.011916] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.044867] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-30T18:26:06.027350] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-30T18:26:06.044750] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-30T18:26:06.121733] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-30T18:26:06.233337] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-30T18:26:06.776486] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:06.848118] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-30T18:26:07.326040] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.381506] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-30T18:26:07.441356] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.471915] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.467948] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-30T18:26:07.473156] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-30T18:26:07.821169] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:26:07.825076] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-30T18:26:08.527045] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:26:08.530937] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-30T18:26:08.870101] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T18:26:08.880767] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-30T18:26:09.015769] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:26:09.026854] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-30T18:26:09.101154] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:26:09.111461] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-30T18:26:09.624342] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:26:09.629012] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-30T18:26:10.500748] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:26:10.511019] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-30T18:26:10.705054] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:26:10.716232] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-30T18:26:10.783914] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:26:10.808787] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:26:11.454365] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-30T18:26:11.671714] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T18:26:12.254350] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-30T18:26:12.408187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:26:12.597513] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:26:13.054419] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-30T18:26:13.748588] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:26:13.854381] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-30T18:26:14.565790] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:26:14.654398] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-30T18:26:15.454351] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-30T18:26:15.604403] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:26:16.207676] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:26:16.256068] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-30T18:26:16.261794] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T18:26:17.054435] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-30T18:26:17.854378] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-30T18:26:18.084034] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:26:18.124417] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:26:18.654402] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-30T18:26:19.454409] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-30T18:26:19.657376] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:26:20.254364] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-30T18:26:20.385806] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:26:20.929711] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:26:21.010149] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T18:26:21.054419] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-30T18:26:21.854377] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-30T18:26:22.598209] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:26:22.654375] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-30T18:26:22.826747] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T18:26:23.454373] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-30T18:26:24.264978] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-30T18:26:24.272110] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:26:25.036417] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:26:25.054331] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-30T18:26:25.091220] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T18:26:25.095086] [INFO ] [REMOTE ] EBF: Full fetch complete (27391 records). [2025-09-30T18:26:25.095207] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-30T18:26:25.484348] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-30T18:26:25.484431] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-30T18:26:25.485004] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-30T18:26:25.485068] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-30T18:26:25.485868] [DEBUG] [LOCAL ] EBF: Trimmed 27391 records to 19235 (keeping 200 days of data) [2025-09-30T18:26:25.614159] [DEBUG] [LOCAL ] EBF: Primary data saved (19235 records). [2025-09-30T18:26:25.614309] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-30T18:26:25.614397] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 21.6s. Estimated remaining: 3h 34m 20s. Rate: 7.9 symbols/min [2025-09-30T18:26:25.799592] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:25.799839] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-09-30T18:26:25.799897] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-09-30T18:26:25.800028] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-30T18:26:25.800092] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-30T18:26:25.800167] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-30T18:26:25.800207] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-30T18:26:25.859581] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-30T18:26:26.188692] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:26.654386] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-30T18:26:26.738865] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T18:26:27.467799] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-30T18:26:27.496045] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:26:27.915903] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:26:28.254441] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-30T18:26:28.955801] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:26:28.967572] [INFO ] [REMOTE ] EBS: Full fetch complete (67318 records). [2025-09-30T18:26:28.967830] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-30T18:26:29.059576] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-30T18:26:29.445258] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-30T18:26:29.445462] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-30T18:26:29.446413] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-30T18:26:29.446557] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-30T18:26:29.448453] [DEBUG] [LOCAL ] EBS: Trimmed 67318 records to 46630 (keeping 200 days of data) [2025-09-30T18:26:29.531465] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T18:26:29.757096] [DEBUG] [LOCAL ] EBS: Primary data saved (46630 records). [2025-09-30T18:26:29.757229] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-30T18:26:29.757338] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBS took 25.7s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-09-30T18:26:29.859550] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-30T18:26:29.942296] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:29.942506] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-09-30T18:26:29.942554] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-09-30T18:26:29.942712] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-30T18:26:29.942778] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-30T18:26:29.942821] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-30T18:26:29.942853] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-30T18:26:30.352947] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:30.371041] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:26:30.654407] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-30T18:26:31.454356] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-30T18:26:31.617329] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:26:31.991138] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:26:32.254378] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-30T18:26:33.054384] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-30T18:26:33.476285] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T18:26:33.833173] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:26:33.854361] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-30T18:26:34.387263] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:26:34.654363] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-30T18:26:35.454357] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-30T18:26:35.518966] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:26:35.528871] [INFO ] [REMOTE ] EBR: Full fetch complete (62714 records). [2025-09-30T18:26:35.529023] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-30T18:26:35.968801] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-30T18:26:35.968971] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-30T18:26:35.969884] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-30T18:26:35.969992] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-30T18:26:35.973689] [DEBUG] [LOCAL ] EBR: Trimmed 62714 records to 43075 (keeping 200 days of data) [2025-09-30T18:26:36.239530] [DEBUG] [LOCAL ] EBR: Primary data saved (43075 records). [2025-09-30T18:26:36.239668] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-30T18:26:36.239826] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 32.2s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-09-30T18:26:36.262594] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-30T18:26:36.436750] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:36.437115] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-30T18:26:36.437441] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-30T18:26:36.437812] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-30T18:26:36.437939] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-30T18:26:36.438177] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-30T18:26:36.438294] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-30T18:26:36.596753] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:26:36.698780] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:26:36.931869] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:37.054379] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-30T18:26:37.511714] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T18:26:37.808628] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:26:37.854361] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-30T18:26:38.654394] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-30T18:26:38.924059] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-30T18:26:39.301718] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:26:39.454380] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-30T18:26:40.254394] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-30T18:26:40.911906] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T18:26:41.054373] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-30T18:26:41.854380] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-30T18:26:42.083564] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:26:42.094177] [INFO ] [REMOTE ] EC: Full fetch complete (71926 records). [2025-09-30T18:26:42.094362] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-30T18:26:42.554859] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:26:42.553904] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-30T18:26:42.555028] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-30T18:26:42.562941] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-30T18:26:42.563412] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-30T18:26:42.567389] [DEBUG] [LOCAL ] EC: Trimmed 71926 records to 49276 (keeping 200 days of data) [2025-09-30T18:26:42.660583] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-30T18:26:42.921211] [DEBUG] [LOCAL ] EC: Primary data saved (49276 records). [2025-09-30T18:26:42.921396] [INFO ] [MAIN ] EC: Full history saved. [2025-09-30T18:26:42.921510] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EC took 38.9s. Estimated remaining: 3h 33m 43s. Rate: 7.9 symbols/min [2025-09-30T18:26:43.111743] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:43.112048] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-30T18:26:43.112110] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-30T18:26:43.112252] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-30T18:26:43.112296] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-30T18:26:43.112340] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-30T18:26:43.112373] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-30T18:26:43.485305] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-30T18:26:43.533061] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:26:43.588068] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:43.607613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T18:26:43.888189] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T18:26:44.254350] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-30T18:26:45.054327] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-30T18:26:45.387193] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T18:26:45.516413] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:26:45.854371] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-30T18:26:46.654385] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-30T18:26:47.192297] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T18:26:47.218890] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:26:47.454365] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-30T18:26:48.254354] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-30T18:26:48.833617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:26:49.054331] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-30T18:26:49.350611] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:26:49.594413] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T18:26:49.854374] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-30T18:26:50.282590] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:26:50.654377] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-30T18:26:51.454370] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-30T18:26:51.806793] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:26:52.254351] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-30T18:26:52.715837] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:26:53.054358] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-30T18:26:53.854358] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-30T18:26:53.892395] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:26:53.899898] [INFO ] [REMOTE ] ECAT: Full fetch complete (42793 records). [2025-09-30T18:26:53.900084] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-30T18:26:54.347676] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-30T18:26:54.347772] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-30T18:26:54.348444] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-30T18:26:54.348508] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-30T18:26:54.349797] [DEBUG] [LOCAL ] ECAT: Trimmed 42793 records to 29602 (keeping 200 days of data) [2025-09-30T18:26:54.471993] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T18:26:54.567934] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:26:54.589192] [DEBUG] [LOCAL ] ECAT: Primary data saved (29602 records). [2025-09-30T18:26:54.589333] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-30T18:26:54.589410] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 29.0s. Estimated remaining: 3h 33m 46s. Rate: 7.9 symbols/min [2025-09-30T18:26:54.659537] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-30T18:26:54.770890] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:54.771064] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-30T18:26:54.771105] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-30T18:26:54.771217] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-30T18:26:54.771258] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-30T18:26:54.771299] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-30T18:26:54.771331] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-30T18:26:55.160004] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:55.339958] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T18:26:55.454365] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-30T18:26:55.999576] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T18:26:56.254363] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-30T18:26:56.599310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T18:26:57.054401] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-30T18:26:57.466936] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T18:26:57.854367] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-30T18:26:58.197255] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T18:26:58.654381] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-30T18:26:58.981729] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:26:59.454361] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-30T18:26:59.804233] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:27:00.254359] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-30T18:27:00.732703] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:27:01.054355] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-30T18:27:01.510685] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-30T18:27:01.511472] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-30T18:27:01.511540] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-30T18:27:01.700593] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T18:27:01.700800] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:01.700853] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:01.700900] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-30T18:27:01.700961] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-30T18:27:01.701000] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-30T18:27:01.701062] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-30T18:27:01.701145] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCC took 25.5s. Estimated remaining: 3h 33m 37s. Rate: 7.9 symbols/min [2025-09-30T18:27:01.859491] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-30T18:27:01.893320] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:01.893515] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-30T18:27:01.893554] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-30T18:27:01.893708] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-30T18:27:01.893764] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-30T18:27:01.893808] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-30T18:27:01.893895] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-30T18:27:02.313711] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:02.654349] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-30T18:27:03.231843] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T18:27:03.454344] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-30T18:27:03.546453] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:27:03.796827] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:27:04.254367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-30T18:27:04.606751] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-30T18:27:05.054350] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-30T18:27:05.854368] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-30T18:27:06.205164] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T18:27:06.548271] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:27:06.654383] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-30T18:27:06.950984] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-30T18:27:07.454404] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-30T18:27:08.254384] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-30T18:27:08.639532] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T18:27:08.889715] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:27:08.899481] [INFO ] [REMOTE ] ECC: Full fetch complete (61024 records). [2025-09-30T18:27:08.899689] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-30T18:27:09.062218] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-30T18:27:09.346581] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-30T18:27:09.346688] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-30T18:27:09.347507] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-30T18:27:09.347571] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-30T18:27:09.348993] [DEBUG] [LOCAL ] ECC: Trimmed 61024 records to 43260 (keeping 200 days of data) [2025-09-30T18:27:09.444714] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T18:27:09.616861] [DEBUG] [LOCAL ] ECC: Primary data saved (43260 records). [2025-09-30T18:27:09.616993] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-30T18:27:09.617067] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECC took 39.9s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-09-30T18:27:09.803453] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:09.845263] [DEBUG] [LOCAL ] ECG: Loaded 33936 existing records from primary storage. [2025-09-30T18:27:09.845582] [INFO ] [MAIN ] ECG: Loaded 33936 existing records. [2025-09-30T18:27:09.859610] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-30T18:27:10.043933] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:10.044159] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-30T18:27:10.044234] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-30T18:27:10.044845] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-30T18:27:10.044908] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-30T18:27:10.385246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-30T18:27:10.441112] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:10.654378] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-30T18:27:11.454426] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-30T18:27:11.869394] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T18:27:12.137195] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T18:27:12.254369] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-30T18:27:12.592767] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:27:13.054389] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-30T18:27:13.854367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-30T18:27:14.130785] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:27:14.317992] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:27:14.654367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-30T18:27:15.022361] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-30T18:27:15.454390] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-30T18:27:16.254345] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-30T18:27:16.526749] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-30T18:27:16.976086] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:27:17.054409] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-30T18:27:17.854413] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-30T18:27:18.208926] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:27:18.512811] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:27:18.654380] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-30T18:27:19.165116] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-30T18:27:19.166065] [INFO ] [REMOTE ] ECCW: Full fetch complete (1418 records). [2025-09-30T18:27:19.166136] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-30T18:27:19.375909] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-30T18:27:19.376100] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:19.376150] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:19.376217] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-30T18:27:19.376287] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-30T18:27:19.376324] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-30T18:27:19.376365] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-30T18:27:19.376424] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 24.8s. Estimated remaining: 3h 33m 28s. Rate: 7.9 symbols/min [2025-09-30T18:27:19.459612] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-30T18:27:19.571246] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:19.626324] [DEBUG] [LOCAL ] ECL: Loaded 46782 existing records from primary storage. [2025-09-30T18:27:19.626688] [INFO ] [MAIN ] ECL: Loaded 46782 existing records. [2025-09-30T18:27:19.833820] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:19.834059] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-30T18:27:19.834131] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-30T18:27:19.834846] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-30T18:27:19.834935] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-30T18:27:20.254343] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:20.254437] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-30T18:27:20.390533] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:27:20.587922] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-30T18:27:21.054427] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-30T18:27:21.458394] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T18:27:21.854404] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-30T18:27:22.374088] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:27:22.375192] [INFO ] [REMOTE ] ECCU: Full fetch complete (4474 records). [2025-09-30T18:27:22.375288] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-30T18:27:22.587068] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-30T18:27:22.587264] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:22.587309] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:22.587373] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-30T18:27:22.587436] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-30T18:27:22.587471] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-30T18:27:22.587509] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-30T18:27:22.587564] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 39.7s. Estimated remaining: 3h 33m 10s. Rate: 7.9 symbols/min [2025-09-30T18:27:22.659456] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-30T18:27:22.778511] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:22.801542] [DEBUG] [LOCAL ] ECO: Loaded 18367 existing records from primary storage. [2025-09-30T18:27:22.801847] [INFO ] [MAIN ] ECO: Loaded 18367 existing records. [2025-09-30T18:27:22.989893] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:22.990102] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-30T18:27:22.990151] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-30T18:27:22.990487] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-30T18:27:22.990547] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-30T18:27:23.387022] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:23.454355] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-30T18:27:24.254411] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-30T18:27:24.388984] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:27:24.650142] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T18:27:25.054343] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-30T18:27:25.097735] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:27:25.854372] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-30T18:27:26.212391] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:27:26.654335] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-30T18:27:26.769003] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T18:27:27.454365] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-30T18:27:28.057487] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-30T18:27:28.058443] [INFO ] [REMOTE ] ECCX: Full fetch complete (1514 records). [2025-09-30T18:27:28.058514] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-30T18:27:28.251595] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T18:27:28.251951] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:28.252131] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:28.260492] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-30T18:27:28.260408] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-30T18:27:28.273116] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-30T18:27:28.276868] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-30T18:27:28.277048] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-30T18:27:28.277196] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 26.6s. Estimated remaining: 3h 32m 57s. Rate: 7.9 symbols/min [2025-09-30T18:27:28.301452] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:27:28.480381] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:28.534781] [DEBUG] [LOCAL ] ECVT: Loaded 42947 existing records from primary storage. [2025-09-30T18:27:28.535266] [INFO ] [MAIN ] ECVT: Loaded 42947 existing records. [2025-09-30T18:27:28.745953] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:28.746162] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-30T18:27:28.746208] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-30T18:27:28.746639] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-30T18:27:28.746733] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-30T18:27:29.059440] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-30T18:27:29.123244] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:29.335575] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:27:29.854360] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-30T18:27:30.654327] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-30T18:27:30.695490] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:27:30.967610] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:27:31.454401] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-30T18:27:32.211721] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:27:32.254325] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-30T18:27:33.054327] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-30T18:27:33.138440] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:27:33.461386] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:27:33.780762] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:27:33.854365] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-30T18:27:34.654380] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-30T18:27:35.073835] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:27:35.454412] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-30T18:27:36.254406] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-30T18:27:36.441343] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:27:36.672086] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:27:37.054379] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-30T18:27:37.333071] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:27:37.854370] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-30T18:27:38.654382] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-30T18:27:38.787182] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:27:39.455051] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-30T18:27:39.454957] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:27:39.812944] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T18:27:40.254372] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-30T18:27:41.054340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-30T18:27:41.143557] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:27:41.506391] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:27:41.854371] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-30T18:27:42.262634] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:27:42.654392] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-30T18:27:43.459488] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-30T18:27:43.475284] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:27:43.715052] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:27:44.254363] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-30T18:27:44.551015] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:27:45.054392] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-30T18:27:45.453912] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:27:45.460440] [INFO ] [REMOTE ] ECG: Full fetch complete (51389 records). [2025-09-30T18:27:45.460558] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-30T18:27:45.860165] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-30T18:27:45.861373] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-30T18:27:45.862310] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-30T18:27:45.863058] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-30T18:27:45.863235] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-30T18:27:45.864404] [DEBUG] [LOCAL ] ECG: Trimmed 51389 records to 33853 (keeping 200 days of data) [2025-09-30T18:27:46.084348] [DEBUG] [LOCAL ] ECG: Primary data saved (33853 records). [2025-09-30T18:27:46.084534] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-30T18:27:46.085511] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 36.5s. Estimated remaining: 3h 33m 14s. Rate: 7.9 symbols/min [2025-09-30T18:27:46.259148] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:27:46.300978] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:46.369571] [DEBUG] [LOCAL ] ED: Loaded 52759 existing records from primary storage. [2025-09-30T18:27:46.370019] [INFO ] [MAIN ] ED: Loaded 52759 existing records. [2025-09-30T18:27:46.574558] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:46.574828] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-30T18:27:46.574880] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-30T18:27:46.575507] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-30T18:27:46.575567] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-30T18:27:46.659500] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-30T18:27:46.959490] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:47.454355] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-30T18:27:47.830436] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T18:27:48.065074] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:27:48.254372] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-30T18:27:48.315184] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:27:48.319726] [INFO ] [REMOTE ] ECO: Full fetch complete (29215 records). [2025-09-30T18:27:48.319872] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-30T18:27:48.718076] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-30T18:27:48.718203] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-30T18:27:48.718819] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-30T18:27:48.718883] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-30T18:27:48.719900] [DEBUG] [LOCAL ] ECO: Trimmed 29215 records to 18384 (keeping 200 days of data) [2025-09-30T18:27:48.852896] [DEBUG] [LOCAL ] ECO: Primary data saved (18384 records). [2025-09-30T18:27:48.853158] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-30T18:27:48.853287] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 26.3s. Estimated remaining: 3h 32m 55s. Rate: 7.9 symbols/min [2025-09-30T18:27:49.045012] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:49.054393] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-30T18:27:49.078247] [DEBUG] [LOCAL ] EDD: Loaded 27095 existing records from primary storage. [2025-09-30T18:27:49.078678] [INFO ] [MAIN ] EDD: Loaded 27095 existing records. [2025-09-30T18:27:49.255737] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:49.256069] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-30T18:27:49.256123] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-30T18:27:49.256541] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-30T18:27:49.256603] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-30T18:27:49.668360] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:49.854352] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-30T18:27:50.149870] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:27:50.160863] [INFO ] [REMOTE ] ECL: Full fetch complete (67918 records). [2025-09-30T18:27:50.161009] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-30T18:27:50.574222] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-30T18:27:50.574312] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-30T18:27:50.575221] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-30T18:27:50.575293] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-30T18:27:50.576762] [DEBUG] [LOCAL ] ECL: Trimmed 67918 records to 46764 (keeping 200 days of data) [2025-09-30T18:27:50.674153] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-30T18:27:50.911262] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:27:50.949716] [DEBUG] [LOCAL ] ECL: Primary data saved (46764 records). [2025-09-30T18:27:50.949856] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-30T18:27:50.949942] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 31.6s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-09-30T18:27:51.199972] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:51.219549] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:27:51.237503] [DEBUG] [LOCAL ] EDF: Loaded 13397 existing records from primary storage. [2025-09-30T18:27:51.237787] [INFO ] [MAIN ] EDF: Loaded 13397 existing records. [2025-09-30T18:27:51.449061] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:51.449321] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-30T18:27:51.449382] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-30T18:27:51.449639] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-30T18:27:51.449729] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-30T18:27:51.461687] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-30T18:27:51.877899] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:52.254352] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-30T18:27:52.395862] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:27:52.447610] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T18:27:53.054381] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-30T18:27:53.854333] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-30T18:27:53.932810] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:27:53.969852] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:27:54.654367] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-30T18:27:55.020756] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:27:55.454396] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-30T18:27:55.624307] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:27:56.254359] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-30T18:27:57.054337] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-30T18:27:57.122973] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:27:57.150222] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T18:27:57.854327] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-30T18:27:58.019431] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:27:58.654364] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-30T18:27:58.978206] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:27:59.201340] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T18:27:59.454377] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-30T18:28:00.254363] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-30T18:28:00.426073] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:28:01.054358] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-30T18:28:01.853825] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T18:28:01.857677] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-30T18:28:02.605299] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:28:02.654373] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-30T18:28:03.204472] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T18:28:03.454407] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-30T18:28:04.233242] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:28:04.254324] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-30T18:28:04.269004] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T18:28:05.054380] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-30T18:28:05.854803] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-30T18:28:05.854728] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:28:06.547442] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:28:06.654328] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-30T18:28:06.780452] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:28:07.454375] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-30T18:28:08.210928] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T18:28:08.230323] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:28:08.254310] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-30T18:28:09.054364] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-30T18:28:09.199450] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T18:28:09.202705] [INFO ] [REMOTE ] EDF: Full fetch complete (20970 records). [2025-09-30T18:28:09.202791] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-30T18:28:09.605206] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-30T18:28:09.605300] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-30T18:28:09.605783] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-30T18:28:09.605883] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-30T18:28:09.606572] [DEBUG] [LOCAL ] EDF: Trimmed 20970 records to 13382 (keeping 200 days of data) [2025-09-30T18:28:09.687894] [DEBUG] [LOCAL ] EDF: Primary data saved (13382 records). [2025-09-30T18:28:09.688034] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-30T18:28:09.688132] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. EDF took 18.7s. Estimated remaining: 3h 32m 53s. Rate: 7.9 symbols/min [2025-09-30T18:28:09.875596] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-30T18:28:09.880727] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:09.904068] [DEBUG] [LOCAL ] EDN: Loaded 18073 existing records from primary storage. [2025-09-30T18:28:09.904333] [INFO ] [MAIN ] EDN: Loaded 18073 existing records. [2025-09-30T18:28:10.109422] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:10.109756] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-30T18:28:10.110071] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-30T18:28:10.110721] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-30T18:28:10.110794] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-30T18:28:10.258684] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T18:28:10.515698] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:10.654384] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-30T18:28:11.454359] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-30T18:28:11.499458] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:28:11.509789] [INFO ] [REMOTE ] ECVT: Full fetch complete (60025 records). [2025-09-30T18:28:11.509941] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-30T18:28:11.701703] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:28:11.975604] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-30T18:28:11.975731] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-30T18:28:11.976526] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-30T18:28:11.976594] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-30T18:28:11.978117] [DEBUG] [LOCAL ] ECVT: Trimmed 60025 records to 43021 (keeping 200 days of data) [2025-09-30T18:28:12.246198] [DEBUG] [LOCAL ] ECVT: Primary data saved (43021 records). [2025-09-30T18:28:12.246528] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-30T18:28:12.246895] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ECVT took 44.0s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-09-30T18:28:12.260631] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-30T18:28:12.441164] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:12.487744] [DEBUG] [LOCAL ] EDU: Loaded 44931 existing records from primary storage. [2025-09-30T18:28:12.488071] [INFO ] [MAIN ] EDU: Loaded 44931 existing records. [2025-09-30T18:28:12.680316] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:12.680544] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-30T18:28:12.680592] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-30T18:28:12.682043] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-30T18:28:12.682108] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-30T18:28:13.057983] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-30T18:28:13.156180] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:13.558026] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:28:13.771588] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:28:13.858732] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-30T18:28:13.862281] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:28:14.654408] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-30T18:28:15.255424] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:28:15.454390] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-30T18:28:16.021203] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:28:16.254329] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-30T18:28:16.625540] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:28:17.054404] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-30T18:28:17.854362] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-30T18:28:18.108190] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:28:18.165957] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T18:28:18.654367] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-30T18:28:19.454390] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-30T18:28:19.921706] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-30T18:28:20.254323] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-30T18:28:20.453015] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T18:28:20.974927] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:28:20.981615] [INFO ] [REMOTE ] EDD: Full fetch complete (38930 records). [2025-09-30T18:28:20.981846] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-30T18:28:21.062761] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-30T18:28:21.406579] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-30T18:28:21.406712] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-30T18:28:21.407549] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-30T18:28:21.407630] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-30T18:28:21.408936] [DEBUG] [LOCAL ] EDD: Trimmed 38930 records to 27088 (keeping 200 days of data) [2025-09-30T18:28:21.587878] [DEBUG] [LOCAL ] EDD: Primary data saved (27088 records). [2025-09-30T18:28:21.588097] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-30T18:28:21.588736] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDD took 32.7s. Estimated remaining: 3h 32m 30s. Rate: 7.9 symbols/min [2025-09-30T18:28:21.783702] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:21.828870] [DEBUG] [LOCAL ] EE: Loaded 32516 existing records from primary storage. [2025-09-30T18:28:21.829413] [INFO ] [MAIN ] EE: Loaded 32516 existing records. [2025-09-30T18:28:21.862849] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-30T18:28:22.037392] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:22.038094] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-30T18:28:22.082054] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-30T18:28:22.083916] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T18:28:22.087664] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-30T18:28:22.087943] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-30T18:28:22.122047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T18:28:22.510992] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:22.654399] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-30T18:28:23.454407] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-30T18:28:23.598053] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:28:23.657223] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:28:24.254399] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-30T18:28:25.054357] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-30T18:28:25.109069] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:28:25.394780] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:28:25.854406] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-30T18:28:26.576127] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-30T18:28:26.654380] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-30T18:28:26.855715] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:28:27.454363] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-30T18:28:28.254416] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-30T18:28:28.555585] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:28:28.586801] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T18:28:29.054373] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-30T18:28:29.599279] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T18:28:29.854385] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-30T18:28:30.654338] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-30T18:28:30.801482] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:28:30.812962] [INFO ] [REMOTE ] ED: Full fetch complete (76349 records). [2025-09-30T18:28:30.813123] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-30T18:28:31.265905] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-30T18:28:31.266076] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-30T18:28:31.267611] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-30T18:28:31.268765] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-30T18:28:31.268638] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:28:31.278709] [DEBUG] [LOCAL ] ED: Trimmed 76349 records to 52759 (keeping 200 days of data) [2025-09-30T18:28:31.474030] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-30T18:28:31.637637] [DEBUG] [LOCAL ] ED: Primary data saved (52759 records). [2025-09-30T18:28:31.637877] [INFO ] [MAIN ] ED: Full history saved. [2025-09-30T18:28:31.639784] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ED took 45.6s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-09-30T18:28:31.827581] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:31.827803] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-30T18:28:31.827863] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-30T18:28:31.827986] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-30T18:28:31.828040] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-30T18:28:31.828111] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-30T18:28:31.828148] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-30T18:28:32.205878] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:32.248412] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T18:28:32.256883] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-30T18:28:32.956841] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:28:32.976356] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T18:28:33.054363] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-30T18:28:33.527434] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T18:28:33.854367] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-30T18:28:34.654391] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-30T18:28:35.113117] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:28:35.207479] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:28:35.454361] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-30T18:28:36.254356] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-30T18:28:36.922179] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:28:37.054381] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-30T18:28:37.459159] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T18:28:37.861964] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-30T18:28:37.867554] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T18:28:38.654385] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-30T18:28:39.068799] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:28:39.454380] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-30T18:28:40.254412] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-30T18:28:40.496891] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:28:40.560808] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:28:41.054325] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-30T18:28:41.079483] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:28:41.854376] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-30T18:28:42.247917] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-30T18:28:42.277678] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T18:28:42.284126] [INFO ] [REMOTE ] EE: Full fetch complete (43414 records). [2025-09-30T18:28:42.284255] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-30T18:28:42.285039] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:28:42.285175] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:28:42.285241] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:28:42.285314] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-30T18:28:42.285381] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-30T18:28:42.285431] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-09-30T18:28:42.285839] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-09-30T18:28:42.285937] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EE took 20.7s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-09-30T18:28:42.485270] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:42.498897] [DEBUG] [LOCAL ] EEX: Loaded 11665 existing records from primary storage. [2025-09-30T18:28:42.499155] [INFO ] [MAIN ] EEX: Loaded 11665 existing records. [2025-09-30T18:28:42.659500] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-30T18:28:42.704298] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:42.704777] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-30T18:28:42.704874] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-30T18:28:42.705471] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-30T18:28:42.705577] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-30T18:28:43.129171] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:43.440904] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:28:43.454318] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-30T18:28:44.254366] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-30T18:28:44.895428] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:28:44.901255] [INFO ] [REMOTE ] EDN: Full fetch complete (30300 records). [2025-09-30T18:28:44.901370] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-30T18:28:45.059448] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-30T18:28:45.309198] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-30T18:28:45.309304] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-30T18:28:45.309880] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-30T18:28:45.309964] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-30T18:28:45.310823] [DEBUG] [LOCAL ] EDN: Trimmed 30300 records to 18137 (keeping 200 days of data) [2025-09-30T18:28:45.410245] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T18:28:45.447827] [DEBUG] [LOCAL ] EDN: Primary data saved (18137 records). [2025-09-30T18:28:45.447986] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-30T18:28:45.448074] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDN took 35.8s. Estimated remaining: 3h 32m 10s. Rate: 7.9 symbols/min [2025-09-30T18:28:45.683231] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:45.734317] [DEBUG] [LOCAL ] EFC: Loaded 46199 existing records from primary storage. [2025-09-30T18:28:45.734669] [INFO ] [MAIN ] EFC: Loaded 46199 existing records. [2025-09-30T18:28:45.854921] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:28:45.855193] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-30T18:28:45.935209] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:45.935523] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-30T18:28:45.935589] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-30T18:28:45.937376] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-30T18:28:45.937438] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-30T18:28:46.309067] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:46.654362] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-30T18:28:47.199883] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T18:28:47.233256] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:28:47.454377] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-30T18:28:48.254347] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-30T18:28:48.438368] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T18:28:48.814705] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T18:28:49.054361] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-30T18:28:49.538079] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:28:49.854361] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-30T18:28:50.654379] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-30T18:28:51.454377] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-30T18:28:51.579282] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:28:51.588992] [INFO ] [REMOTE ] EDU: Full fetch complete (66479 records). [2025-09-30T18:28:51.589156] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-30T18:28:52.049388] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-30T18:28:52.049609] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-30T18:28:52.050474] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-30T18:28:52.050557] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-30T18:28:52.052369] [DEBUG] [LOCAL ] EDU: Trimmed 66479 records to 44992 (keeping 200 days of data) [2025-09-30T18:28:52.170094] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:28:52.262102] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-30T18:28:52.364412] [DEBUG] [LOCAL ] EDU: Primary data saved (44992 records). [2025-09-30T18:28:52.364602] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-30T18:28:52.364727] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 40.1s. Estimated remaining: 3h 32m 1s. Rate: 7.9 symbols/min [2025-09-30T18:28:52.450803] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:28:52.565931] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:52.566114] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-30T18:28:52.566153] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-30T18:28:52.566265] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-30T18:28:52.566306] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-30T18:28:52.566345] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-30T18:28:52.566377] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-30T18:28:52.855520] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:28:52.883169] [INFO ] [REMOTE ] EEA: Full fetch complete (3915 records). [2025-09-30T18:28:52.886692] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-30T18:28:53.060546] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-30T18:28:53.088427] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:53.175551] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:28:53.175813] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:28:53.175886] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:28:53.175956] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-30T18:28:53.176019] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-30T18:28:53.176055] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-30T18:28:53.176095] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-30T18:28:53.176151] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 21.5s. Estimated remaining: 3h 31m 37s. Rate: 7.9 symbols/min [2025-09-30T18:28:53.354002] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:53.370421] [DEBUG] [LOCAL ] EFT: Loaded 12787 existing records from primary storage. [2025-09-30T18:28:53.370680] [INFO ] [MAIN ] EFT: Loaded 12787 existing records. [2025-09-30T18:28:53.580074] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:53.580337] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-30T18:28:53.580409] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-30T18:28:53.581422] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-30T18:28:53.581501] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-30T18:28:53.860015] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-30T18:28:53.996704] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:54.006442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:28:54.654371] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-30T18:28:55.454335] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-30T18:28:55.794038] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T18:28:55.879758] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T18:28:56.254337] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-30T18:28:56.467193] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:28:57.054367] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-30T18:28:57.834141] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:28:57.854322] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-30T18:28:57.960026] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:28:58.636389] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:28:58.654305] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-30T18:28:59.392841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T18:28:59.454325] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-30T18:29:00.150913] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T18:29:00.254369] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-30T18:29:00.916396] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:29:01.054391] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-30T18:29:01.854412] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-30T18:29:01.970849] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T18:29:02.465615] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T18:29:02.654373] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-30T18:29:03.454368] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-30T18:29:04.256845] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-30T18:29:04.279554] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:29:04.281305] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:29:05.054353] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-30T18:29:05.137783] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T18:29:05.854415] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-30T18:29:05.992579] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T18:29:06.654338] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-30T18:29:06.824620] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:29:07.454394] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-30T18:29:08.254369] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-30T18:29:08.378516] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:29:08.647781] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T18:29:08.972797] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:29:09.054402] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-30T18:29:09.854354] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-30T18:29:09.889126] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:29:10.654354] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-30T18:29:10.762027] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T18:29:11.454406] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-30T18:29:11.570639] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T18:29:12.163681] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T18:29:12.254338] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-30T18:29:13.054334] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-30T18:29:13.113080] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:29:13.115256] [INFO ] [REMOTE ] EEX: Full fetch complete (19511 records). [2025-09-30T18:29:13.115328] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-30T18:29:13.505874] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-30T18:29:13.505951] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-30T18:29:13.506356] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-30T18:29:13.506395] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-30T18:29:13.506970] [DEBUG] [LOCAL ] EEX: Trimmed 19511 records to 11608 (keeping 200 days of data) [2025-09-30T18:29:13.578142] [DEBUG] [LOCAL ] EEX: Primary data saved (11608 records). [2025-09-30T18:29:13.578331] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-30T18:29:13.578421] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEX took 31.3s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-09-30T18:29:13.761442] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:13.811285] [DEBUG] [LOCAL ] EFX: Loaded 44588 existing records from primary storage. [2025-09-30T18:29:13.811584] [INFO ] [MAIN ] EFX: Loaded 44588 existing records. [2025-09-30T18:29:13.859463] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-30T18:29:14.007877] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:14.008135] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-30T18:29:14.008215] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-30T18:29:14.008757] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-30T18:29:14.008816] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-30T18:29:14.178269] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:29:14.402956] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:14.654383] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-30T18:29:15.454331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-30T18:29:15.645506] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:29:15.666317] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:29:16.254356] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-30T18:29:16.516980] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T18:29:16.522891] [INFO ] [REMOTE ] EFR: Full fetch complete (18640 records). [2025-09-30T18:29:16.523043] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-30T18:29:16.523720] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:29:16.523829] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:29:16.523887] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:29:16.523948] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-30T18:29:16.524028] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-30T18:29:16.524104] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-30T18:29:16.524174] [DEBUG] [LOCAL ] EFR: No derivative data file found to delete. [2025-09-30T18:29:16.524279] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 24.2s. Estimated remaining: 3h 31m 41s. Rate: 7.9 symbols/min [2025-09-30T18:29:16.720399] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:16.750164] [DEBUG] [LOCAL ] EFXT: Loaded 29190 existing records from primary storage. [2025-09-30T18:29:16.750457] [INFO ] [MAIN ] EFXT: Loaded 29190 existing records. [2025-09-30T18:29:16.941500] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:16.941775] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-30T18:29:16.941829] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-30T18:29:16.942194] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-30T18:29:16.942255] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-30T18:29:17.059508] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-30T18:29:17.352855] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:17.854371] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-30T18:29:17.874694] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:29:17.903841] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:29:18.654420] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-30T18:29:19.390395] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:29:19.454389] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-30T18:29:20.088972] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:29:20.254408] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-30T18:29:21.054405] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-30T18:29:21.132162] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:29:21.688889] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:29:21.854371] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-30T18:29:22.270163] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:29:22.654367] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-30T18:29:23.454337] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-30T18:29:23.616378] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:29:23.784044] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:29:23.787755] [INFO ] [REMOTE ] EFT: Full fetch complete (17653 records). [2025-09-30T18:29:23.787898] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-30T18:29:24.174162] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-30T18:29:24.174241] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-30T18:29:24.174609] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-30T18:29:24.174671] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-30T18:29:24.175236] [DEBUG] [LOCAL ] EFT: Trimmed 17653 records to 12856 (keeping 200 days of data) [2025-09-30T18:29:24.256170] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-30T18:29:24.258884] [DEBUG] [LOCAL ] EFT: Primary data saved (12856 records). [2025-09-30T18:29:24.260213] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-30T18:29:24.260339] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFT took 31.1s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-09-30T18:29:24.452348] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:24.476484] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:29:24.511257] [DEBUG] [LOCAL ] EG: Loaded 28398 existing records from primary storage. [2025-09-30T18:29:24.511571] [INFO ] [MAIN ] EG: Loaded 28398 existing records. [2025-09-30T18:29:24.710754] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:24.710992] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-30T18:29:24.711040] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-30T18:29:24.711876] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-30T18:29:24.711939] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-30T18:29:25.062500] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-30T18:29:25.109451] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:25.854338] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-30T18:29:25.997892] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T18:29:26.009017] [INFO ] [REMOTE ] EFC: Full fetch complete (66402 records). [2025-09-30T18:29:26.009196] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-30T18:29:26.451781] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:29:26.451999] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-30T18:29:26.457967] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-30T18:29:26.459309] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-30T18:29:26.459850] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-30T18:29:26.461082] [DEBUG] [LOCAL ] EFC: Trimmed 66402 records to 46224 (keeping 200 days of data) [2025-09-30T18:29:26.679785] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-30T18:29:26.757076] [DEBUG] [LOCAL ] EFC: Primary data saved (46224 records). [2025-09-30T18:29:26.757216] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-30T18:29:26.757305] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 41.3s. Estimated remaining: 3h 31m 14s. Rate: 7.9 symbols/min [2025-09-30T18:29:26.945899] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:26.999280] [DEBUG] [LOCAL ] EGO: Loaded 51568 existing records from primary storage. [2025-09-30T18:29:26.999624] [INFO ] [MAIN ] EGO: Loaded 51568 existing records. [2025-09-30T18:29:27.193122] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:27.193350] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-30T18:29:27.193396] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-30T18:29:27.193938] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-30T18:29:27.193997] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-30T18:29:27.458764] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-30T18:29:27.604780] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:27.630321] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T18:29:27.940885] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:29:28.254364] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-30T18:29:28.486176] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:29:29.054416] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-30T18:29:29.854343] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-30T18:29:29.956330] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:29:30.160552] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:29:30.654368] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-30T18:29:31.157189] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T18:29:31.454367] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-30T18:29:31.962244] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:29:32.254315] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-30T18:29:32.335246] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T18:29:33.054361] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-30T18:29:33.554682] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:29:33.854358] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-30T18:29:34.104523] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:29:34.654404] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-30T18:29:35.463286] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-30T18:29:35.485453] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:29:36.263803] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-30T18:29:36.269936] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:29:36.852719] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:29:36.993085] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:29:37.054343] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-30T18:29:37.854386] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-30T18:29:38.654340] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-30T18:29:38.746416] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:29:39.060444] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T18:29:39.454360] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-30T18:29:40.254330] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-30T18:29:40.419624] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:29:40.986549] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:29:41.054356] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-30T18:29:41.854363] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-30T18:29:41.923816] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:29:42.490898] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:29:42.498129] [INFO ] [REMOTE ] EFXT: Full fetch complete (44125 records). [2025-09-30T18:29:42.498284] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-30T18:29:42.667890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-30T18:29:42.945188] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-30T18:29:42.945289] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-30T18:29:42.946191] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-30T18:29:42.946276] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-30T18:29:42.947581] [DEBUG] [LOCAL ] EFXT: Trimmed 44125 records to 29194 (keeping 200 days of data) [2025-09-30T18:29:43.053688] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T18:29:43.149685] [DEBUG] [LOCAL ] EFXT: Primary data saved (29194 records). [2025-09-30T18:29:43.149826] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-30T18:29:43.149909] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFXT took 26.6s. Estimated remaining: 3h 31m 27s. Rate: 7.9 symbols/min [2025-09-30T18:29:43.335536] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:43.373279] [DEBUG] [LOCAL ] EGP: Loaded 30961 existing records from primary storage. [2025-09-30T18:29:43.373588] [INFO ] [MAIN ] EGP: Loaded 30961 existing records. [2025-09-30T18:29:43.461680] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-30T18:29:43.590212] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:43.590435] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-30T18:29:43.590486] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-30T18:29:43.591034] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-30T18:29:43.591129] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-30T18:29:43.989854] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:44.254338] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-30T18:29:44.619541] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T18:29:45.054364] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-30T18:29:45.264142] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T18:29:45.347874] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T18:29:45.854372] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-30T18:29:46.444198] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:29:46.654364] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-30T18:29:47.454365] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-30T18:29:47.503380] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:29:47.565486] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:29:48.254363] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-30T18:29:49.054338] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-30T18:29:49.255881] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:29:49.854340] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-30T18:29:49.911272] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:29:49.922805] [INFO ] [REMOTE ] EFX: Full fetch complete (64400 records). [2025-09-30T18:29:49.922978] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-30T18:29:50.353136] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-30T18:29:50.353321] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-30T18:29:50.354228] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-30T18:29:50.354313] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-30T18:29:50.375137] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:29:50.381899] [DEBUG] [LOCAL ] EFX: Trimmed 64400 records to 44541 (keeping 200 days of data) [2025-09-30T18:29:50.659097] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-30T18:29:50.675854] [DEBUG] [LOCAL ] EFX: Primary data saved (44541 records). [2025-09-30T18:29:50.676008] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-30T18:29:50.676106] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 37.1s. Estimated remaining: 3h 31m 19s. Rate: 7.9 symbols/min [2025-09-30T18:29:50.869497] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:50.917160] [DEBUG] [LOCAL ] EGY: Loaded 42167 existing records from primary storage. [2025-09-30T18:29:50.917530] [INFO ] [MAIN ] EGY: Loaded 42167 existing records. [2025-09-30T18:29:51.135063] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:51.135416] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-30T18:29:51.135530] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-30T18:29:51.142228] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-30T18:29:51.152896] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-30T18:29:51.159401] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:29:51.459670] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-30T18:29:51.553039] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:51.786676] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:29:52.254321] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-30T18:29:52.641474] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T18:29:53.054354] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-30T18:29:53.744629] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:29:53.854366] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-30T18:29:54.654349] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-30T18:29:54.829685] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:29:55.454359] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-30T18:29:55.653288] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:29:56.143513] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:29:56.149778] [INFO ] [REMOTE ] EG: Full fetch complete (43587 records). [2025-09-30T18:29:56.149932] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-30T18:29:56.150735] [FATAL] [VALIDATOR ] EG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:29:56.150837] [FATAL] [MAIN ] EG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:29:56.150880] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:29:56.150955] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-30T18:29:56.151027] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-09-30T18:29:56.151063] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-09-30T18:29:56.151467] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-09-30T18:29:56.151590] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EG took 31.9s. Estimated remaining: 3h 31m 6s. Rate: 7.9 symbols/min [2025-09-30T18:29:56.259488] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-30T18:29:56.347613] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:56.347892] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-09-30T18:29:56.347951] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-09-30T18:29:56.348065] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-30T18:29:56.348209] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-30T18:29:56.348266] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-30T18:29:56.348303] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-30T18:29:56.728726] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:56.975160] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T18:29:57.054366] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-30T18:29:57.614952] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:29:57.854410] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-30T18:29:58.637789] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:29:58.654362] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-30T18:29:58.969774] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T18:29:59.454388] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-30T18:29:59.702121] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:30:00.254352] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-30T18:30:00.832361] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:30:01.054364] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-30T18:30:01.854392] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-30T18:30:02.059784] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:30:02.293094] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:30:02.654370] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-30T18:30:03.052263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:30:03.454412] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-30T18:30:03.841913] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:30:04.254374] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-30T18:30:05.056304] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-30T18:30:05.059537] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T18:30:05.441460] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:30:05.854402] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-30T18:30:06.654400] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-30T18:30:07.209552] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:30:07.221307] [INFO ] [REMOTE ] EGO: Full fetch complete (73274 records). [2025-09-30T18:30:07.221457] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-30T18:30:07.222531] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:07.222721] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:07.222888] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:07.223095] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-30T18:30:07.223212] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-30T18:30:07.223439] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-09-30T18:30:07.223780] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-09-30T18:30:07.223882] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGO took 40.5s. Estimated remaining: 3h 31m 7s. Rate: 7.9 symbols/min [2025-09-30T18:30:07.407876] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:07.430628] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:30:07.438289] [INFO ] [REMOTE ] EGP: Full fetch complete (45425 records). [2025-09-30T18:30:07.438478] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-30T18:30:07.461157] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-30T18:30:07.794409] [DEBUG] [LOCAL ] EHC: Loaded 41153 existing records from primary storage. [2025-09-30T18:30:07.806492] [INFO ] [MAIN ] EHC: Loaded 41153 existing records. [2025-09-30T18:30:08.030273] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-30T18:30:08.035540] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-30T18:30:08.041598] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-30T18:30:08.052212] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-30T18:30:08.111626] [DEBUG] [LOCAL ] EGP: Trimmed 45425 records to 30925 (keeping 200 days of data) [2025-09-30T18:30:08.114507] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:08.115044] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-30T18:30:08.115351] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-30T18:30:08.116111] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-30T18:30:08.116177] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-30T18:30:08.681866] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:08.690119] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T18:30:08.690628] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-30T18:30:08.777810] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:30:08.803597] [DEBUG] [LOCAL ] EGP: Primary data saved (30925 records). [2025-09-30T18:30:08.803769] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-30T18:30:08.803864] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGP took 25.7s. Estimated remaining: 3h 30m 45s. Rate: 7.9 symbols/min [2025-09-30T18:30:08.987366] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:08.999905] [DEBUG] [LOCAL ] EHI: Loaded 10420 existing records from primary storage. [2025-09-30T18:30:09.000151] [INFO ] [MAIN ] EHI: Loaded 10420 existing records. [2025-09-30T18:30:09.059497] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-30T18:30:09.196930] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:09.197145] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-30T18:30:09.197192] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-30T18:30:09.197510] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-30T18:30:09.197572] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-30T18:30:09.591681] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:09.854367] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-30T18:30:10.545532] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:30:10.654338] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-30T18:30:10.899038] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T18:30:10.977848] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:30:11.454373] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-30T18:30:11.684096] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T18:30:12.254342] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-30T18:30:13.019372] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:30:13.054337] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-30T18:30:13.748533] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:30:13.854532] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-30T18:30:14.582276] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:30:14.654387] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-30T18:30:15.310278] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:30:15.454364] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-30T18:30:16.170840] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T18:30:16.254402] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-30T18:30:17.054461] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-30T18:30:17.199067] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:30:17.682122] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:30:17.854410] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-30T18:30:18.654348] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-30T18:30:18.905188] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:30:18.914633] [INFO ] [REMOTE ] EGY: Full fetch complete (61506 records). [2025-09-30T18:30:18.914841] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-30T18:30:19.230144] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:30:19.394484] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-30T18:30:19.394571] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-30T18:30:19.395396] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-30T18:30:19.395550] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-30T18:30:19.396983] [DEBUG] [LOCAL ] EGY: Trimmed 61506 records to 42167 (keeping 200 days of data) [2025-09-30T18:30:19.455962] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-30T18:30:19.647182] [DEBUG] [LOCAL ] EGY: Primary data saved (42167 records). [2025-09-30T18:30:19.647320] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-30T18:30:19.647428] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 29.0s. Estimated remaining: 3h 30m 45s. Rate: 7.9 symbols/min [2025-09-30T18:30:19.837165] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:19.865314] [DEBUG] [LOCAL ] EIC: Loaded 23686 existing records from primary storage. [2025-09-30T18:30:19.865597] [INFO ] [MAIN ] EIC: Loaded 23686 existing records. [2025-09-30T18:30:20.071411] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:20.071759] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-30T18:30:20.071912] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-30T18:30:20.072324] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-30T18:30:20.072459] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-30T18:30:20.252325] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T18:30:20.257613] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-30T18:30:20.355581] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:30:20.532895] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:21.054416] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-30T18:30:21.668020] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T18:30:21.854436] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-30T18:30:22.381453] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:30:22.654361] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-30T18:30:23.351009] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:30:23.454378] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-30T18:30:23.575935] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T18:30:24.254363] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-30T18:30:24.716617] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T18:30:25.054371] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-30T18:30:25.394510] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T18:30:25.854417] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-30T18:30:25.880067] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:30:26.654367] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-30T18:30:26.951420] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T18:30:27.454391] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-30T18:30:28.254344] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-30T18:30:28.290152] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:30:28.751987] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T18:30:28.764941] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T18:30:29.054369] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-30T18:30:29.854381] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-30T18:30:30.430969] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:30:30.654407] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-30T18:30:31.454363] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-30T18:30:31.490786] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:30:31.543915] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:30:31.549715] [INFO ] [REMOTE ] EHAB: Full fetch complete (41002 records). [2025-09-30T18:30:31.549899] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-30T18:30:31.550685] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:31.550780] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:31.550825] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:31.550914] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-30T18:30:31.551032] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-30T18:30:31.551139] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-09-30T18:30:31.551243] [DEBUG] [LOCAL ] EHAB: No derivative data file found to delete. [2025-09-30T18:30:31.551348] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 35.4s. Estimated remaining: 3h 30m 47s. Rate: 7.9 symbols/min [2025-09-30T18:30:31.742145] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:31.742384] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-30T18:30:31.742442] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-30T18:30:31.742601] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-30T18:30:31.742680] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-30T18:30:31.742744] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-30T18:30:31.742789] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-30T18:30:32.135913] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:32.254358] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-30T18:30:32.412162] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:30:32.874980] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T18:30:33.054372] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-30T18:30:33.560898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T18:30:33.854355] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-30T18:30:34.654336] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-30T18:30:35.043489] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:30:35.454322] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-30T18:30:35.711238] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:30:36.254354] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-30T18:30:36.595013] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:30:36.756549] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:30:37.054371] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-30T18:30:37.745208] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-30T18:30:37.854357] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-30T18:30:38.654350] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-30T18:30:38.766204] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:30:38.990439] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:30:39.454387] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-30T18:30:40.254349] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-30T18:30:40.269912] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:30:40.585222] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T18:30:41.054329] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-30T18:30:41.854358] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-30T18:30:41.900230] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T18:30:42.197227] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:30:42.654366] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-30T18:30:43.454393] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-30T18:30:43.559883] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:30:43.562771] [INFO ] [REMOTE ] EHI: Full fetch complete (16156 records). [2025-09-30T18:30:43.562852] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-30T18:30:43.563306] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:43.563395] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:43.563438] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:43.563477] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-30T18:30:43.563541] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-30T18:30:43.563579] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-09-30T18:30:43.563864] [DEBUG] [LOCAL ] EHI: Deleted derivative data file. [2025-09-30T18:30:43.563988] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHI took 34.8s. Estimated remaining: 3h 30m 50s. Rate: 7.9 symbols/min [2025-09-30T18:30:43.781827] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:43.782074] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-30T18:30:43.782129] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-30T18:30:43.782259] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-30T18:30:43.782325] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-30T18:30:43.782397] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-30T18:30:43.782435] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-30T18:30:43.862056] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T18:30:44.186676] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:44.254370] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-30T18:30:44.599525] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:30:45.054389] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-30T18:30:45.554787] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T18:30:45.854368] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-30T18:30:46.654345] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-30T18:30:47.166182] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:30:47.184964] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-30T18:30:47.454365] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-30T18:30:48.254355] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-30T18:30:48.512146] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-30T18:30:48.597454] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T18:30:49.054362] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-30T18:30:49.854362] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-30T18:30:50.307826] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T18:30:50.598296] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T18:30:50.606205] [INFO ] [REMOTE ] EHC: Full fetch complete (58526 records). [2025-09-30T18:30:50.606371] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-30T18:30:50.607140] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:50.607231] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:50.607276] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:50.607316] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-30T18:30:50.607375] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-09-30T18:30:50.607411] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-09-30T18:30:50.607590] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-09-30T18:30:50.607743] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 43.4s. Estimated remaining: 3h 30m 41s. Rate: 7.9 symbols/min [2025-09-30T18:30:50.659525] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-30T18:30:50.805447] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:50.805681] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-30T18:30:50.805756] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-30T18:30:50.805881] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-30T18:30:50.805923] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-30T18:30:50.805964] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-30T18:30:50.805996] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-30T18:30:51.197509] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:51.454366] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-30T18:30:51.790990] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:30:51.795667] [INFO ] [REMOTE ] EIC: Full fetch complete (34915 records). [2025-09-30T18:30:51.795858] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-30T18:30:52.085705] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T18:30:52.229318] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-30T18:30:52.229413] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-30T18:30:52.230070] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-30T18:30:52.230139] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-30T18:30:52.231028] [DEBUG] [LOCAL ] EIC: Trimmed 34915 records to 23631 (keeping 200 days of data) [2025-09-30T18:30:52.292289] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-30T18:30:52.392123] [DEBUG] [LOCAL ] EIC: Primary data saved (23631 records). [2025-09-30T18:30:52.392262] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-30T18:30:52.392349] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 32.7s. Estimated remaining: 3h 30m 20s. Rate: 7.9 symbols/min [2025-09-30T18:30:52.584391] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:52.611713] [DEBUG] [LOCAL ] EIG: Loaded 20285 existing records from primary storage. [2025-09-30T18:30:52.611988] [INFO ] [MAIN ] EIG: Loaded 20285 existing records. [2025-09-30T18:30:52.717354] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:30:52.816745] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:52.817027] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-30T18:30:52.817083] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-30T18:30:52.817354] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-30T18:30:52.817414] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-30T18:30:53.059580] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-30T18:30:53.233814] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:53.724499] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:30:53.854380] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-30T18:30:54.306278] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T18:30:54.654365] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-30T18:30:55.029633] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-30T18:30:55.454427] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-30T18:30:55.913136] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:30:56.254342] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-30T18:30:56.606256] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:30:57.054364] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-30T18:30:57.517865] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-30T18:30:57.518833] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-09-30T18:30:57.518909] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-30T18:30:57.713964] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-30T18:30:57.714180] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:57.714249] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:57.714318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-30T18:30:57.714383] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-30T18:30:57.714419] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-30T18:30:57.714458] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-30T18:30:57.714535] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICA took 26.2s. Estimated remaining: 3h 30m 7s. Rate: 7.9 symbols/min [2025-09-30T18:30:57.859595] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-30T18:30:57.909399] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:57.909622] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-09-30T18:30:57.909710] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-09-30T18:30:57.909860] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-30T18:30:57.909915] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-30T18:30:57.909960] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-30T18:30:57.909992] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-30T18:30:58.297505] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:58.654341] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-30T18:30:58.731711] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T18:30:59.316134] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T18:30:59.454381] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-30T18:31:00.176397] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T18:31:00.254346] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-30T18:31:00.879399] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T18:31:01.054400] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-30T18:31:01.854356] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-30T18:31:02.019529] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:31:02.297090] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:31:02.654364] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-30T18:31:03.454403] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-30T18:31:03.862178] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T18:31:04.254347] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-30T18:31:04.476278] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:31:04.824883] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:31:05.054382] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-30T18:31:05.854365] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-30T18:31:06.087273] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:31:06.338939] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:31:06.654394] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-30T18:31:07.426545] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T18:31:07.454406] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-30T18:31:08.231688] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T18:31:08.233982] [INFO ] [REMOTE ] EICC: Full fetch complete (8129 records). [2025-09-30T18:31:08.234069] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-30T18:31:08.234524] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:31:08.234620] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:08.234702] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:08.234802] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-30T18:31:08.234886] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-30T18:31:08.234936] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-30T18:31:08.235020] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-30T18:31:08.235099] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICC took 17.6s. Estimated remaining: 3h 30m 6s. Rate: 7.9 symbols/min [2025-09-30T18:31:08.254353] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-30T18:31:09.054417] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-30T18:31:09.854417] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-30T18:31:10.171321] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:31:10.319191] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T18:31:10.374057] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T18:31:10.654408] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-30T18:31:11.454469] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-30T18:31:11.733445] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:31:12.254369] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-30T18:31:13.010253] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T18:31:13.012058] [INFO ] [REMOTE ] EICB: Full fetch complete (2700 records). [2025-09-30T18:31:13.012215] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-30T18:31:13.057158] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-30T18:31:13.180816] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:31:13.268998] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T18:31:13.269197] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:13.269271] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:13.269351] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-30T18:31:13.269420] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-30T18:31:13.269459] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-30T18:31:13.269503] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-30T18:31:13.269569] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICB took 29.7s. Estimated remaining: 3h 29m 52s. Rate: 7.9 symbols/min [2025-09-30T18:31:13.854352] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-30T18:31:14.077119] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T18:31:14.654374] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-30T18:31:15.809470] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:31:15.815122] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-30T18:31:15.867069] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T18:31:16.254383] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-30T18:31:16.943083] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:31:17.054404] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-30T18:31:17.851606] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:31:17.863335] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-30T18:31:18.138017] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T18:31:18.143158] [INFO ] [REMOTE ] EIG: Full fetch complete (27040 records). [2025-09-30T18:31:18.143284] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-30T18:31:18.551736] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-30T18:31:18.551853] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-30T18:31:18.552351] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-30T18:31:18.552404] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-30T18:31:18.553201] [DEBUG] [LOCAL ] EIG: Trimmed 27040 records to 20286 (keeping 200 days of data) [2025-09-30T18:31:18.684236] [DEBUG] [LOCAL ] EIG: Primary data saved (20286 records). [2025-09-30T18:31:18.684370] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-30T18:31:18.684453] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 26.3s. Estimated remaining: 3h 29m 40s. Rate: 7.9 symbols/min [2025-09-30T18:31:19.732234] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:31:19.744191] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-30T18:31:21.551469] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:31:21.562636] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-30T18:31:23.232828] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:31:23.244982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-30T18:31:25.153227] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T18:31:25.165091] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-30T18:31:27.355474] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T18:31:27.367369] [INFO ] [REMOTE ] EIX: Full fetch complete (76596 records). [2025-09-30T18:31:27.367539] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-30T18:31:27.370758] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:31:27.370886] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:27.370932] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:27.370976] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-30T18:31:27.371043] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-30T18:31:27.371086] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-30T18:31:27.371128] [DEBUG] [LOCAL ] EIX: No derivative data file found to delete. [2025-09-30T18:31:27.371191] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 29.7s. Estimated remaining: 3h 29m 35s. Rate: 7.9 symbols/min [2025-09-30T18:31:28.158326] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.156360] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.157324] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.227387] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.231467] [DEBUG] [LOCAL ] ELC: Loaded 3481 existing records from primary storage. [2025-09-30T18:31:28.232575] [INFO ] [MAIN ] ELC: Loaded 3481 existing records. [2025-09-30T18:31:28.501986] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:28.522342] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-30T18:31:28.522617] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-30T18:31:28.537342] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-30T18:31:28.539978] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-30T18:31:28.554883] [DEBUG] [LOCAL ] ELF: Loaded 52235 existing records from primary storage. [2025-09-30T18:31:28.592872] [DEBUG] [LOCAL ] ELAN: Loaded 53226 existing records from primary storage. [2025-09-30T18:31:28.591898] [INFO ] [MAIN ] ELF: Loaded 52235 existing records. [2025-09-30T18:31:28.593342] [INFO ] [MAIN ] ELAN: Loaded 53226 existing records. [2025-09-30T18:31:28.708485] [DEBUG] [LOCAL ] EL: Loaded 53397 existing records from primary storage. [2025-09-30T18:31:28.777986] [INFO ] [MAIN ] EL: Loaded 53397 existing records. [2025-09-30T18:31:29.339920] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.326837] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.361903] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.362032] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-30T18:31:29.374034] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.396374] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-30T18:31:29.401717] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-30T18:31:29.407684] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-30T18:31:29.407588] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-30T18:31:29.494804] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-30T18:31:29.644153] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.742331] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.839734] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:29.845044] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-30T18:31:29.905904] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-30T18:31:30.029059] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-30T18:31:30.075100] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-30T18:31:30.445620] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.492980] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-30T18:31:30.569178] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.585048] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-30T18:31:30.831066] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.831521] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-30T18:31:30.837621] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:31:30.839605] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-30T18:31:31.479999] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T18:31:31.481553] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-30T18:31:31.825831] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:31:31.827147] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-30T18:31:32.366764] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:31:32.378561] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-30T18:31:32.385050] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:31:32.387972] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-30T18:31:32.559989] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T18:31:32.571583] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-30T18:31:32.886101] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T18:31:32.887714] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-30T18:31:32.933183] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T18:31:32.944632] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-30T18:31:33.441802] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T18:31:33.443402] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-30T18:31:33.689997] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:31:33.707385] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-30T18:31:33.925062] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T18:31:33.926749] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-30T18:31:34.162669] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:31:34.173948] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-30T18:31:34.497513] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:31:34.654334] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-30T18:31:34.787847] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:31:35.069462] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:31:35.284613] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:31:35.454405] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-30T18:31:36.111912] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T18:31:36.254377] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-30T18:31:37.054379] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-30T18:31:37.188909] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:31:37.854424] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-30T18:31:37.893611] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T18:31:37.895083] [INFO ] [REMOTE ] ELC: Full fetch complete (5094 records). [2025-09-30T18:31:37.895161] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-30T18:31:38.130854] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T18:31:38.342246] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-30T18:31:38.342351] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-30T18:31:38.342536] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-30T18:31:38.342579] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-30T18:31:38.343043] [DEBUG] [LOCAL ] ELC: Trimmed 5094 records to 3479 (keeping 200 days of data) [2025-09-30T18:31:38.364667] [DEBUG] [LOCAL ] ELC: Primary data saved (3479 records). [2025-09-30T18:31:38.364799] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-30T18:31:38.364912] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 11.0s. Estimated remaining: 3h 29m 35s. Rate: 7.9 symbols/min [2025-09-30T18:31:38.551533] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:38.614624] [DEBUG] [LOCAL ] ELME: Loaded 39202 existing records from primary storage. [2025-09-30T18:31:38.615102] [INFO ] [MAIN ] ELME: Loaded 39202 existing records. [2025-09-30T18:31:38.666813] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-30T18:31:38.854985] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:38.855237] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-30T18:31:38.855287] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-30T18:31:38.856092] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-30T18:31:38.856153] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-30T18:31:39.259007] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:39.454360] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-30T18:31:40.073685] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-30T18:31:40.254398] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-30T18:31:40.498619] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:31:41.054332] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-30T18:31:41.343803] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:31:41.854370] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-30T18:31:42.064127] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T18:31:42.634139] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:31:42.654328] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-30T18:31:43.454365] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-30T18:31:44.142603] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T18:31:44.254369] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-30T18:31:44.354909] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:31:44.407879] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T18:31:45.054357] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-30T18:31:45.854351] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-30T18:31:46.348382] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:31:46.654360] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-30T18:31:46.991828] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:31:47.318335] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T18:31:47.454361] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-30T18:31:48.254359] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-30T18:31:48.920210] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-30T18:31:49.043157] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:31:49.054348] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-30T18:31:49.678702] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:31:49.854374] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-30T18:31:50.654344] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-30T18:31:50.765853] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:31:51.454331] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-30T18:31:51.960261] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T18:31:52.221516] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T18:31:52.233871] [INFO ] [REMOTE ] ELAN: Full fetch complete (76864 records). [2025-09-30T18:31:52.234046] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-30T18:31:52.259544] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-30T18:31:52.718241] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-30T18:31:52.718365] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-30T18:31:52.719304] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-30T18:31:52.719371] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-30T18:31:52.722355] [DEBUG] [LOCAL ] ELAN: Trimmed 76864 records to 53230 (keeping 200 days of data) [2025-09-30T18:31:53.056461] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-30T18:31:53.080363] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T18:31:53.097551] [DEBUG] [LOCAL ] ELAN: Primary data saved (53230 records). [2025-09-30T18:31:53.098131] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-30T18:31:53.098270] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 25.7s. Estimated remaining: 3h 29m 43s. Rate: 7.9 symbols/min [2025-09-30T18:31:53.282808] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:53.313179] [DEBUG] [LOCAL ] ELP: Loaded 25746 existing records from primary storage. [2025-09-30T18:31:53.313494] [INFO ] [MAIN ] ELP: Loaded 25746 existing records. [2025-09-30T18:31:53.509320] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:53.509567] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-30T18:31:53.509616] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-30T18:31:53.509949] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-30T18:31:53.510015] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-30T18:31:53.862284] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-30T18:31:53.911196] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:54.190575] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-30T18:31:54.654316] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-30T18:31:55.148801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T18:31:55.270303] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:31:55.454398] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-30T18:31:56.254403] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-30T18:31:56.663949] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:31:56.987373] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:31:57.054575] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-30T18:31:57.133376] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:31:57.854427] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-30T18:31:58.276679] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:31:58.654376] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-30T18:31:59.454420] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-30T18:31:59.738444] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:31:59.856339] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:32:00.254411] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-30T18:32:01.054395] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-30T18:32:01.424561] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T18:32:01.854398] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-30T18:32:01.894127] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T18:32:02.160926] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:32:02.170787] [INFO ] [REMOTE ] ELME: Full fetch complete (55945 records). [2025-09-30T18:32:02.170998] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-30T18:32:02.637785] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-30T18:32:02.637871] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-30T18:32:02.638696] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-30T18:32:02.638843] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-30T18:32:02.640118] [DEBUG] [LOCAL ] ELME: Trimmed 55945 records to 39204 (keeping 200 days of data) [2025-09-30T18:32:02.695461] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-30T18:32:02.916271] [DEBUG] [LOCAL ] ELME: Primary data saved (39204 records). [2025-09-30T18:32:02.916442] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-30T18:32:02.916541] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELME took 24.6s. Estimated remaining: 3h 29m 41s. Rate: 7.9 symbols/min [2025-09-30T18:32:03.100690] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:03.100896] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-30T18:32:03.100943] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-30T18:32:03.101057] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-30T18:32:03.101100] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-30T18:32:03.101144] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-30T18:32:03.101176] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-30T18:32:03.463072] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-30T18:32:03.499939] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:03.662978] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:32:03.674274] [INFO ] [REMOTE ] EL: Full fetch complete (76937 records). [2025-09-30T18:32:03.674433] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-30T18:32:03.675387] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:03.675481] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:03.675530] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:03.675600] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-30T18:32:03.675700] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-09-30T18:32:03.675756] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-09-30T18:32:03.676034] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-09-30T18:32:03.676136] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 36.3s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min [2025-09-30T18:32:03.870303] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:03.931452] [DEBUG] [LOCAL ] ELS: Loaded 49379 existing records from primary storage. [2025-09-30T18:32:03.931862] [INFO ] [MAIN ] ELS: Loaded 49379 existing records. [2025-09-30T18:32:04.118776] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:04.119033] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-30T18:32:04.119093] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-30T18:32:04.119779] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-30T18:32:04.119840] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-30T18:32:04.266521] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-30T18:32:04.512129] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:04.688083] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T18:32:04.720482] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T18:32:04.799040] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T18:32:05.054612] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-30T18:32:05.854370] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-30T18:32:06.654363] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-30T18:32:06.736832] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:32:07.454409] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-30T18:32:07.776916] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T18:32:07.882715] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:32:07.893904] [INFO ] [REMOTE ] ELF: Full fetch complete (75342 records). [2025-09-30T18:32:07.894057] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-30T18:32:08.205848] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:32:08.260243] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-30T18:32:08.387198] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-30T18:32:08.387302] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-30T18:32:08.388305] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-30T18:32:08.388374] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-30T18:32:08.389998] [DEBUG] [LOCAL ] ELF: Trimmed 75342 records to 52207 (keeping 200 days of data) [2025-09-30T18:32:08.727686] [DEBUG] [LOCAL ] ELF: Primary data saved (52207 records). [2025-09-30T18:32:08.727842] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-30T18:32:08.728855] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 41.4s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-09-30T18:32:08.917440] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:08.917623] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-30T18:32:08.917708] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-30T18:32:08.917838] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-30T18:32:08.917897] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-30T18:32:08.917983] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-30T18:32:08.918038] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-30T18:32:09.059547] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-30T18:32:09.312440] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:09.854352] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-30T18:32:10.169023] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T18:32:10.207193] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:32:10.654361] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-30T18:32:11.454414] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-30T18:32:11.783834] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T18:32:12.009602] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:32:12.254388] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-30T18:32:12.346705] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:32:13.054402] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-30T18:32:13.849968] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:32:13.860453] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-30T18:32:14.214673] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T18:32:14.654326] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-30T18:32:14.776945] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T18:32:15.454399] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-30T18:32:16.003329] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:32:16.254387] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-30T18:32:17.054433] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-30T18:32:17.268952] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T18:32:17.318719] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:32:17.396274] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:32:17.854364] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-30T18:32:18.654346] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-30T18:32:19.241272] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T18:32:19.246733] [INFO ] [REMOTE ] ELP: Full fetch complete (37343 records). [2025-09-30T18:32:19.246855] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-30T18:32:19.459685] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-30T18:32:19.671487] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-30T18:32:19.671634] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-30T18:32:19.672283] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-30T18:32:19.672329] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-30T18:32:19.673445] [DEBUG] [LOCAL ] ELP: Trimmed 37343 records to 25714 (keeping 200 days of data) [2025-09-30T18:32:19.831424] [DEBUG] [LOCAL ] ELP: Primary data saved (25714 records). [2025-09-30T18:32:19.832216] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-30T18:32:19.832314] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 26.7s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-09-30T18:32:20.022807] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:32:20.027106] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:20.029047] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-30T18:32:20.029093] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-30T18:32:20.029206] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-30T18:32:20.029247] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-30T18:32:20.029288] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-30T18:32:20.029320] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-30T18:32:20.256742] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-30T18:32:20.423676] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:20.456577] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:32:21.054424] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-30T18:32:21.256168] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:32:21.256510] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-30T18:32:21.256622] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:32:21.256718] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-30T18:32:21.256784] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:32:21.256858] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-30T18:32:21.256955] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-30T18:32:21.257010] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-30T18:32:21.257074] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-30T18:32:21.257150] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 1.4s. Estimated remaining: 3h 28m 43s. Rate: 7.9 symbols/min [2025-09-30T18:32:21.453142] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:21.476951] [DEBUG] [LOCAL ] EMD: Loaded 21085 existing records from primary storage. [2025-09-30T18:32:21.477239] [INFO ] [MAIN ] EMD: Loaded 21085 existing records. [2025-09-30T18:32:21.668133] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:21.668536] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-30T18:32:21.668600] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-30T18:32:21.668963] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-30T18:32:21.669023] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-30T18:32:21.860613] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-30T18:32:22.075135] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:22.105722] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:32:22.245776] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T18:32:22.654362] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-30T18:32:23.454371] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-30T18:32:24.254416] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-30T18:32:24.556099] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:32:24.603503] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-30T18:32:25.054355] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-30T18:32:25.244440] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:32:25.854389] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-30T18:32:26.654389] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-30T18:32:26.944546] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T18:32:27.454366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-30T18:32:27.711848] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-30T18:32:28.070156] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:32:28.092588] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T18:32:28.254380] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-30T18:32:28.614406] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:32:29.054370] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-30T18:32:29.854376] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-30T18:32:30.143710] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:32:30.654382] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-30T18:32:31.418335] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:32:31.454310] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-30T18:32:31.779932] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:32:32.254403] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-30T18:32:32.780465] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T18:32:32.781410] [INFO ] [REMOTE ] ELPC: Full fetch complete (1456 records). [2025-09-30T18:32:32.781486] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-30T18:32:32.781924] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:32.782028] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:32.782103] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:32.782198] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-30T18:32:32.782296] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-30T18:32:32.782344] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-30T18:32:32.782422] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-30T18:32:32.782498] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELPC took 29.9s. Estimated remaining: 3h 28m 44s. Rate: 7.9 symbols/min [2025-09-30T18:32:33.036289] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:32:33.056751] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-30T18:32:33.059621] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:33.061376] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-09-30T18:32:33.061467] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-09-30T18:32:33.061699] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-30T18:32:33.061858] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-30T18:32:33.061929] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-30T18:32:33.061966] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-30T18:32:33.545154] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:33.854394] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-30T18:32:34.654350] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-30T18:32:34.852784] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:32:35.005071] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:32:35.454386] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-30T18:32:35.832227] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:32:36.254365] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-30T18:32:37.054417] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-30T18:32:37.592432] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:32:37.827322] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-30T18:32:37.854343] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-30T18:32:38.654357] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-30T18:32:38.968120] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:32:38.979145] [INFO ] [REMOTE ] ELS: Full fetch complete (70340 records). [2025-09-30T18:32:38.979360] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-30T18:32:38.980310] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:38.980418] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:38.980479] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:38.980555] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-30T18:32:38.980637] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-30T18:32:38.980721] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-30T18:32:38.981006] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-30T18:32:38.981116] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 35.3s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-09-30T18:32:39.173193] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:39.180690] [DEBUG] [LOCAL ] EMF: Loaded 3445 existing records from primary storage. [2025-09-30T18:32:39.180919] [INFO ] [MAIN ] EMF: Loaded 3445 existing records. [2025-09-30T18:32:39.409448] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:39.409884] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-30T18:32:39.409956] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-30T18:32:39.410393] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-30T18:32:39.410466] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-30T18:32:39.462531] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-30T18:32:39.807757] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:39.855527] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:32:39.856798] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:32:40.254361] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-30T18:32:41.054366] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-30T18:32:41.592436] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-30T18:32:41.854365] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-30T18:32:42.083891] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:32:42.481568] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T18:32:42.492416] [INFO ] [REMOTE ] ELV: Full fetch complete (72803 records). [2025-09-30T18:32:42.492575] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-30T18:32:42.493429] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:42.493520] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:42.493564] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:42.493603] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-30T18:32:42.493688] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-30T18:32:42.493743] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-30T18:32:42.493786] [DEBUG] [LOCAL ] ELV: No derivative data file found to delete. [2025-09-30T18:32:42.493844] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 33.8s. Estimated remaining: 3h 28m 16s. Rate: 7.9 symbols/min [2025-09-30T18:32:42.660376] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-30T18:32:42.691366] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:42.753185] [DEBUG] [LOCAL ] EMN: Loaded 50422 existing records from primary storage. [2025-09-30T18:32:42.753529] [INFO ] [MAIN ] EMN: Loaded 50422 existing records. [2025-09-30T18:32:42.948636] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:42.948917] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-30T18:32:42.948965] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-30T18:32:42.949704] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-30T18:32:42.949766] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-30T18:32:43.344599] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:43.454385] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-30T18:32:43.664590] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T18:32:44.254362] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-30T18:32:45.054323] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-30T18:32:45.223885] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-30T18:32:45.854356] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-30T18:32:45.885974] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:32:45.966041] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:32:46.639466] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-30T18:32:46.654376] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-30T18:32:47.067936] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:32:47.454395] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-30T18:32:48.254339] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-30T18:32:48.414093] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:32:48.761600] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T18:32:49.054390] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-30T18:32:49.295554] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:32:49.854367] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-30T18:32:50.258402] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:32:50.263109] [INFO ] [REMOTE ] EMD: Full fetch complete (32097 records). [2025-09-30T18:32:50.263222] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-30T18:32:50.263817] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:50.263910] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:50.263990] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:50.264072] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-30T18:32:50.264163] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-30T18:32:50.264233] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-09-30T18:32:50.264505] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-09-30T18:32:50.264701] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 29.0s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:32:50.449436] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:50.449757] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-09-30T18:32:50.449877] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-09-30T18:32:50.450039] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-30T18:32:50.450136] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-30T18:32:50.450368] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-30T18:32:50.455429] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-30T18:32:50.455630] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:32:50.658018] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-30T18:32:50.857858] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:51.454404] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-30T18:32:52.254332] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-30T18:32:52.365884] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:32:52.489755] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:32:53.054403] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-30T18:32:53.166243] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:32:53.854436] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-30T18:32:54.419726] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:32:54.654393] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-30T18:32:54.680219] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:32:55.454379] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-30T18:32:56.045555] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:32:56.254372] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-30T18:32:56.837070] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:32:57.031075] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:32:57.054341] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-30T18:32:57.854373] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-30T18:32:57.936220] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:32:58.419170] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:32:58.654380] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-30T18:32:59.454379] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-30T18:33:00.254350] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-30T18:33:00.436278] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:33:00.894508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T18:33:01.054351] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-30T18:33:01.226329] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:33:01.235251] [INFO ] [REMOTE ] EME: Full fetch complete (46667 records). [2025-09-30T18:33:01.235445] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-30T18:33:01.239256] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:01.239374] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:01.239420] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:01.239493] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-30T18:33:01.239605] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-30T18:33:01.239686] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-09-30T18:33:01.239764] [DEBUG] [LOCAL ] EME: No derivative data file found to delete. [2025-09-30T18:33:01.239849] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 28.5s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:33:01.422770] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:01.422963] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-09-30T18:33:01.423035] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-09-30T18:33:01.423154] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-30T18:33:01.423247] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-30T18:33:01.423308] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-30T18:33:01.423346] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-30T18:33:01.742327] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-30T18:33:01.859434] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:01.859526] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-30T18:33:02.607142] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:33:02.654386] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-30T18:33:03.454393] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-30T18:33:03.481471] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:33:04.104753] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:33:04.254368] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-30T18:33:05.054400] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-30T18:33:05.721898] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T18:33:05.854334] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-30T18:33:06.027164] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:33:06.492427] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T18:33:06.654363] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-30T18:33:07.241219] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T18:33:07.454406] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-30T18:33:08.157192] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:33:08.158518] [INFO ] [REMOTE ] EMF: Full fetch complete (7161 records). [2025-09-30T18:33:08.158626] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-30T18:33:08.261994] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-30T18:33:08.550494] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-30T18:33:08.550603] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-30T18:33:08.550852] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-30T18:33:08.550927] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-30T18:33:08.551529] [DEBUG] [LOCAL ] EMF: Trimmed 7161 records to 3427 (keeping 200 days of data) [2025-09-30T18:33:08.573511] [DEBUG] [LOCAL ] EMF: Primary data saved (3427 records). [2025-09-30T18:33:08.573592] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-30T18:33:08.573730] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMF took 29.6s. Estimated remaining: 3h 28m 0s. Rate: 7.9 symbols/min [2025-09-30T18:33:08.770454] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:08.815957] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T18:33:08.841371] [DEBUG] [LOCAL ] EMR: Loaded 53249 existing records from primary storage. [2025-09-30T18:33:08.841790] [INFO ] [MAIN ] EMR: Loaded 53249 existing records. [2025-09-30T18:33:09.034184] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:09.034417] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-30T18:33:09.034464] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-30T18:33:09.036396] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-30T18:33:09.036482] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-30T18:33:09.059521] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-30T18:33:09.411741] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:09.854379] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-30T18:33:10.382480] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T18:33:10.654403] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-30T18:33:11.375160] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-30T18:33:11.454379] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-30T18:33:12.047952] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T18:33:12.254351] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-30T18:33:12.610899] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:33:13.054325] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-30T18:33:13.223198] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:33:13.715437] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:33:13.854367] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-30T18:33:14.654374] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-30T18:33:15.217865] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T18:33:15.454409] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-30T18:33:15.696678] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:33:16.254341] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-30T18:33:16.392892] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T18:33:17.054369] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-30T18:33:17.216214] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:33:17.854359] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-30T18:33:17.885585] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:33:18.654425] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-30T18:33:19.454405] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-30T18:33:19.684602] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:33:20.025365] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:33:20.254366] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-30T18:33:20.474985] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:33:21.054346] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-30T18:33:21.148775] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:33:21.854357] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-30T18:33:22.654349] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-30T18:33:23.156756] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T18:33:23.454336] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-30T18:33:23.614401] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T18:33:23.618616] [INFO ] [REMOTE ] EMO: Full fetch complete (17024 records). [2025-09-30T18:33:23.618762] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-30T18:33:23.619380] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:23.619467] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:23.619512] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:23.619584] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-30T18:33:23.619722] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-30T18:33:23.619784] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-30T18:33:23.619894] [DEBUG] [LOCAL ] EMO: No derivative data file found to delete. [2025-09-30T18:33:23.619977] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 33.4s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:33:23.890514] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:23.930425] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T18:33:23.944219] [INFO ] [REMOTE ] EMN: Full fetch complete (72018 records). [2025-09-30T18:33:23.944396] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-30T18:33:24.255862] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-30T18:33:24.372917] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-09-30T18:33:24.383314] [INFO ] [MAIN ] ENB: Loaded 53513 existing records. [2025-09-30T18:33:24.524282] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-30T18:33:24.536363] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-30T18:33:24.548188] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-30T18:33:24.558690] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-30T18:33:24.636613] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:24.636834] [DEBUG] [LOCAL ] EMN: Trimmed 72018 records to 50415 (keeping 200 days of data) [2025-09-30T18:33:24.637132] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-30T18:33:24.637226] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-30T18:33:24.638857] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-30T18:33:24.639072] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-30T18:33:24.825304] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T18:33:25.054948] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-30T18:33:25.175341] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:25.228201] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:33:25.445028] [DEBUG] [LOCAL ] EMN: Primary data saved (50415 records). [2025-09-30T18:33:25.445193] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-30T18:33:25.446050] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 43.0s. Estimated remaining: 3h 27m 49s. Rate: 7.9 symbols/min [2025-09-30T18:33:25.628427] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:25.636639] [DEBUG] [LOCAL ] ENFY: Loaded 3090 existing records from primary storage. [2025-09-30T18:33:25.636902] [INFO ] [MAIN ] ENFY: Loaded 3090 existing records. [2025-09-30T18:33:25.837668] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:25.838004] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-30T18:33:25.838064] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-30T18:33:25.838268] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-30T18:33:25.838327] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-30T18:33:25.860018] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-30T18:33:25.967083] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:33:25.997750] [INFO ] [REMOTE ] EMP: Full fetch complete (4242 records). [2025-09-30T18:33:26.005863] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-30T18:33:26.021508] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:26.067319] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:26.112000] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:26.136619] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-30T18:33:26.139585] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-30T18:33:26.139977] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-30T18:33:26.140055] [DEBUG] [LOCAL ] EMP: No derivative data file found to delete. [2025-09-30T18:33:26.140165] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMP took 24.9s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-09-30T18:33:26.334862] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:26.410594] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:26.460261] [DEBUG] [LOCAL ] ENIC: Loaded 36314 existing records from primary storage. [2025-09-30T18:33:26.460558] [INFO ] [MAIN ] ENIC: Loaded 36314 existing records. [2025-09-30T18:33:26.651793] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:26.651996] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-30T18:33:26.652046] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-30T18:33:26.652809] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-30T18:33:26.652869] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-30T18:33:26.664237] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-30T18:33:27.031320] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:27.454383] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-30T18:33:27.843340] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T18:33:28.055873] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T18:33:28.254323] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-30T18:33:28.638029] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T18:33:29.054362] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-30T18:33:29.780406] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:33:29.854359] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-30T18:33:30.081679] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:33:30.654361] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-30T18:33:31.327278] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T18:33:31.454359] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-30T18:33:32.254350] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-30T18:33:32.340215] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:33:33.054342] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-30T18:33:33.538444] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T18:33:33.574376] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:33:33.854363] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-30T18:33:34.644853] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:33:34.655765] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-30T18:33:35.090431] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T18:33:35.454359] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-30T18:33:36.254327] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-30T18:33:36.301779] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:33:36.532842] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T18:33:36.947819] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:33:37.054389] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-30T18:33:37.516121] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:33:37.854357] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-30T18:33:38.654368] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-30T18:33:39.443906] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:33:39.455036] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-30T18:33:40.191502] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:33:40.254335] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-30T18:33:40.613337] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T18:33:41.054366] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-30T18:33:41.487283] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T18:33:41.854373] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-30T18:33:42.654366] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-30T18:33:42.966940] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:33:43.458396] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-30T18:33:43.464219] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:33:44.254335] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-30T18:33:44.616580] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:33:44.772284] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:33:45.054393] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-30T18:33:45.631582] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-30T18:33:45.647394] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:33:45.854378] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-30T18:33:46.397193] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T18:33:46.654364] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-30T18:33:47.250554] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T18:33:47.454422] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-30T18:33:48.042436] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:33:48.043851] [INFO ] [REMOTE ] ENFY: Full fetch complete (5610 records). [2025-09-30T18:33:48.043943] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-30T18:33:48.263199] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-30T18:33:48.454129] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-30T18:33:48.454208] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-30T18:33:48.454408] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-30T18:33:48.454475] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-30T18:33:48.455003] [DEBUG] [LOCAL ] ENFY: Trimmed 5610 records to 3099 (keeping 200 days of data) [2025-09-30T18:33:48.473612] [DEBUG] [LOCAL ] ENFY: Primary data saved (3099 records). [2025-09-30T18:33:48.473738] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-30T18:33:48.473846] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENFY took 23.0s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-09-30T18:33:48.656611] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:48.661414] [DEBUG] [LOCAL ] ENO: Loaded 1914 existing records from primary storage. [2025-09-30T18:33:48.661627] [INFO ] [MAIN ] ENO: Loaded 1914 existing records. [2025-09-30T18:33:48.861935] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:48.862240] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-30T18:33:48.862302] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-30T18:33:48.862512] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-30T18:33:48.862581] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-30T18:33:49.068692] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-30T18:33:49.279237] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:49.854373] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-30T18:33:50.485696] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T18:33:50.501013] [INFO ] [REMOTE ] EMR: Full fetch complete (76721 records). [2025-09-30T18:33:50.501176] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-30T18:33:50.502073] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:50.502202] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:50.502261] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:50.502333] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-30T18:33:50.502400] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-09-30T18:33:50.502435] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-09-30T18:33:50.502795] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-09-30T18:33:50.502907] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 41.9s. Estimated remaining: 3h 27m 31s. Rate: 7.9 symbols/min [2025-09-30T18:33:50.658078] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-30T18:33:50.694232] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:50.752167] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:33:50.755874] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T18:33:50.782295] [DEBUG] [LOCAL ] ENOV: Loaded 45017 existing records from primary storage. [2025-09-30T18:33:50.782625] [INFO ] [MAIN ] ENOV: Loaded 45017 existing records. [2025-09-30T18:33:50.990081] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:50.990320] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-30T18:33:50.990374] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-30T18:33:50.990891] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-30T18:33:50.990954] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-30T18:33:51.403568] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:51.454335] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-30T18:33:52.103061] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:33:52.254351] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-30T18:33:52.330911] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:33:53.054358] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-30T18:33:53.663320] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:33:53.854371] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-30T18:33:54.654397] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-30T18:33:54.855635] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:33:54.991399] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:33:55.239915] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T18:33:55.454397] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-30T18:33:56.254369] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-30T18:33:56.723320] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:33:57.054319] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-30T18:33:57.483788] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:33:57.495759] [INFO ] [REMOTE ] ENB: Full fetch complete (77490 records). [2025-09-30T18:33:57.495906] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-30T18:33:57.619343] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:33:57.859535] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-30T18:33:57.943269] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-30T18:33:57.943369] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-30T18:33:57.944378] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-30T18:33:57.944448] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-30T18:33:57.946154] [DEBUG] [LOCAL ] ENB: Trimmed 77490 records to 53511 (keeping 200 days of data) [2025-09-30T18:33:58.290206] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-09-30T18:33:58.290340] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-30T18:33:58.290424] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENB took 34.7s. Estimated remaining: 3h 27m 24s. Rate: 7.9 symbols/min [2025-09-30T18:33:58.476697] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:58.476945] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-30T18:33:58.476992] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-30T18:33:58.477104] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-30T18:33:58.477147] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-30T18:33:58.477191] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-30T18:33:58.477227] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-30T18:33:58.648526] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T18:33:58.660093] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-30T18:33:58.885399] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:59.454375] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-30T18:34:00.254316] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-30T18:34:00.718815] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T18:34:00.726763] [INFO ] [REMOTE ] ENIC: Full fetch complete (51082 records). [2025-09-30T18:34:00.726958] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-30T18:34:00.727859] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:00.727965] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:00.728011] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:00.728065] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-30T18:34:00.728406] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-30T18:34:00.728493] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-09-30T18:34:00.728854] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-09-30T18:34:00.728959] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENIC took 34.6s. Estimated remaining: 3h 27m 5s. Rate: 7.9 symbols/min [2025-09-30T18:34:00.927157] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:00.927337] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-09-30T18:34:00.927376] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-09-30T18:34:00.927502] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-30T18:34:00.927546] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-30T18:34:00.927588] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-30T18:34:00.927621] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-30T18:34:01.059463] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-30T18:34:01.139714] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:34:01.325937] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:01.416919] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:34:01.854371] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-30T18:34:02.343483] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T18:34:02.654372] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-30T18:34:03.206014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T18:34:03.454464] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-30T18:34:04.254431] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-30T18:34:04.289770] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:34:04.624015] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:34:05.054382] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-30T18:34:05.714083] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T18:34:05.854357] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-30T18:34:06.468321] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:34:06.654364] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-30T18:34:07.420065] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:34:07.454321] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-30T18:34:07.813882] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:34:08.254373] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-30T18:34:08.696741] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:34:09.025778] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:34:09.054316] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-30T18:34:09.854403] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-30T18:34:10.432484] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T18:34:10.433517] [INFO ] [REMOTE ] ENO: Full fetch complete (3102 records). [2025-09-30T18:34:10.433591] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-30T18:34:10.434004] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:10.434084] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:10.434154] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:10.434228] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-30T18:34:10.434294] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-09-30T18:34:10.434331] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-09-30T18:34:10.434514] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-09-30T18:34:10.434607] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 22.0s. Estimated remaining: 3h 27m 2s. Rate: 7.9 symbols/min [2025-09-30T18:34:10.647060] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:10.647436] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-30T18:34:10.647503] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-30T18:34:10.647813] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-30T18:34:10.647962] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-30T18:34:10.648029] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-30T18:34:10.648065] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-30T18:34:10.659763] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-30T18:34:11.066097] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T18:34:11.087486] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:11.454398] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-30T18:34:12.182134] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:34:12.254388] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-30T18:34:12.879871] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:34:13.054424] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-30T18:34:13.582235] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T18:34:13.854411] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-30T18:34:14.551439] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:34:14.654393] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-30T18:34:15.454362] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-30T18:34:15.590296] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T18:34:16.090262] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:34:16.254404] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-30T18:34:17.013863] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:34:17.054364] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-30T18:34:17.456157] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:34:17.854417] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-30T18:34:18.337048] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:34:18.654449] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-30T18:34:19.454363] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-30T18:34:19.523473] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:34:19.617565] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T18:34:20.254398] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-30T18:34:20.700247] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T18:34:21.054415] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-30T18:34:21.556039] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:34:21.854423] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-30T18:34:22.505041] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:34:22.654420] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-30T18:34:23.329942] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T18:34:23.454386] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-30T18:34:24.058372] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:34:24.254400] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-30T18:34:24.476870] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:34:25.054399] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-30T18:34:25.854458] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-30T18:34:26.265845] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:34:26.451952] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:34:26.654385] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-30T18:34:26.826520] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:34:27.454395] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-30T18:34:28.254439] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-30T18:34:28.396528] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:34:28.450502] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:34:29.054399] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-30T18:34:29.718572] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T18:34:29.727631] [INFO ] [REMOTE ] ENR: Full fetch complete (58208 records). [2025-09-30T18:34:29.727838] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-30T18:34:29.728776] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:29.728876] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:29.728922] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:29.728965] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-30T18:34:29.729026] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-30T18:34:29.729063] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-30T18:34:29.729123] [DEBUG] [LOCAL ] ENR: No derivative data file found to delete. [2025-09-30T18:34:29.729207] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 31.4s. Estimated remaining: 3h 27m 20s. Rate: 7.9 symbols/min [2025-09-30T18:34:29.859487] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-30T18:34:29.910513] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:29.927588] [DEBUG] [LOCAL ] EOD: Loaded 14134 existing records from primary storage. [2025-09-30T18:34:29.927932] [INFO ] [MAIN ] EOD: Loaded 14134 existing records. [2025-09-30T18:34:30.117436] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:30.117706] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-30T18:34:30.117765] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-30T18:34:30.118110] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-30T18:34:30.118188] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-30T18:34:30.504560] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:30.519214] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:34:30.654423] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-30T18:34:31.454450] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-30T18:34:31.796016] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:34:31.802962] [INFO ] [REMOTE ] ENS: Full fetch complete (42065 records). [2025-09-30T18:34:31.803101] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-30T18:34:32.237354] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-30T18:34:32.237514] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-30T18:34:32.238365] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-30T18:34:32.239086] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-30T18:34:32.240400] [DEBUG] [LOCAL ] ENS: Trimmed 42065 records to 29303 (keeping 200 days of data) [2025-09-30T18:34:32.304117] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-30T18:34:32.376714] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:34:32.487616] [DEBUG] [LOCAL ] ENS: Primary data saved (29303 records). [2025-09-30T18:34:32.487828] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-30T18:34:32.487920] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENS took 31.8s. Estimated remaining: 3h 27m 1s. Rate: 7.9 symbols/min [2025-09-30T18:34:32.684442] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:32.709874] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T18:34:32.778297] [DEBUG] [LOCAL ] EOG: Loaded 53342 existing records from primary storage. [2025-09-30T18:34:32.778737] [INFO ] [MAIN ] EOG: Loaded 53342 existing records. [2025-09-30T18:34:32.971912] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:32.972183] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-30T18:34:32.972239] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-30T18:34:32.972936] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-30T18:34:32.972999] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-30T18:34:33.059571] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-30T18:34:33.287610] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T18:34:33.370431] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:33.854424] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-30T18:34:34.348975] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:34:34.654369] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-30T18:34:35.427200] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:34:35.454326] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-30T18:34:35.695411] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:34:36.254355] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-30T18:34:36.788373] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:34:36.803788] [INFO ] [REMOTE ] ENOV: Full fetch complete (63141 records). [2025-09-30T18:34:36.803987] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-30T18:34:37.059586] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-30T18:34:37.248311] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-30T18:34:37.248444] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-30T18:34:37.249605] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-30T18:34:37.249725] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-30T18:34:37.251600] [DEBUG] [LOCAL ] ENOV: Trimmed 63141 records to 44995 (keeping 200 days of data) [2025-09-30T18:34:37.553166] [DEBUG] [LOCAL ] ENOV: Primary data saved (44995 records). [2025-09-30T18:34:37.553405] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-30T18:34:37.553539] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENOV took 47.1s. Estimated remaining: 3h 26m 48s. Rate: 7.9 symbols/min [2025-09-30T18:34:37.736836] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:37.757184] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:34:37.766770] [INFO ] [REMOTE ] ENVA: Full fetch complete (36746 records). [2025-09-30T18:34:37.766954] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-30T18:34:37.854468] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-30T18:34:37.885269] [DEBUG] [LOCAL ] EOI: Loaded 10661 existing records from primary storage. [2025-09-30T18:34:37.885870] [INFO ] [MAIN ] EOI: Loaded 10661 existing records. [2025-09-30T18:34:38.322734] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:38.333315] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-30T18:34:38.338549] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-30T18:34:38.364092] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-30T18:34:38.381821] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-30T18:34:38.437743] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-30T18:34:38.462216] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-30T18:34:38.478372] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-30T18:34:38.513628] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-30T18:34:38.565316] [DEBUG] [LOCAL ] ENVA: Trimmed 36746 records to 25406 (keeping 200 days of data) [2025-09-30T18:34:38.789992] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:34:38.820824] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-30T18:34:39.031886] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:39.130155] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T18:34:39.128078] [DEBUG] [LOCAL ] ENVA: Primary data saved (25406 records). [2025-09-30T18:34:39.144088] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-30T18:34:39.144441] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 28.7s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-09-30T18:34:39.330627] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:39.347617] [DEBUG] [LOCAL ] EOS: Loaded 15244 existing records from primary storage. [2025-09-30T18:34:39.347971] [INFO ] [MAIN ] EOS: Loaded 15244 existing records. [2025-09-30T18:34:39.460261] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-30T18:34:39.545585] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:39.545814] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-30T18:34:39.545863] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-30T18:34:39.546456] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-30T18:34:39.546521] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-30T18:34:39.911153] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T18:34:39.947768] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:40.254371] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-30T18:34:40.431727] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:34:41.054382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-30T18:34:41.674045] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:34:41.854368] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-30T18:34:42.654350] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-30T18:34:42.678715] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T18:34:42.837030] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T18:34:43.454425] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-30T18:34:43.638984] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T18:34:44.254428] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-30T18:34:45.054389] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-30T18:34:45.226700] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:34:45.858528] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-30T18:34:45.881280] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-30T18:34:45.932543] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T18:34:46.654422] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-30T18:34:47.029519] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:34:47.454383] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-30T18:34:48.254362] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-30T18:34:48.378924] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:34:48.531720] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:34:48.932085] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T18:34:49.054404] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-30T18:34:49.854420] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-30T18:34:50.654422] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-30T18:34:50.756833] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:34:50.918209] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:34:51.454342] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-30T18:34:51.526085] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T18:34:52.254378] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-30T18:34:53.029813] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:34:53.054326] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-30T18:34:53.361097] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T18:34:53.854425] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-30T18:34:54.654423] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-30T18:34:54.782621] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:34:54.997342] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:34:55.454385] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-30T18:34:55.551951] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:34:56.254382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-30T18:34:56.347622] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:34:57.054378] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-30T18:34:57.854359] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-30T18:34:58.046778] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:34:58.144316] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:34:58.654370] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-30T18:34:58.834516] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T18:34:58.838402] [INFO ] [REMOTE ] EOD: Full fetch complete (20182 records). [2025-09-30T18:34:58.838516] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-30T18:34:59.243605] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-30T18:34:59.243717] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-30T18:34:59.244201] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-30T18:34:59.244245] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-30T18:34:59.245696] [DEBUG] [LOCAL ] EOD: Trimmed 20182 records to 14203 (keeping 200 days of data) [2025-09-30T18:34:59.332844] [DEBUG] [LOCAL ] EOD: Primary data saved (14203 records). [2025-09-30T18:34:59.332992] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-30T18:34:59.333082] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 29.6s. Estimated remaining: 3h 26m 47s. Rate: 7.9 symbols/min [2025-09-30T18:34:59.459457] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-30T18:34:59.529554] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:59.538775] [DEBUG] [LOCAL ] EOT: Loaded 6885 existing records from primary storage. [2025-09-30T18:34:59.538967] [INFO ] [MAIN ] EOT: Loaded 6885 existing records. [2025-09-30T18:34:59.735283] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:59.735529] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-30T18:34:59.735588] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-30T18:34:59.735866] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-30T18:34:59.735928] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-30T18:35:00.111984] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:00.254332] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-30T18:35:00.324859] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T18:35:00.423178] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:35:00.434981] [INFO ] [REMOTE ] EOG: Full fetch complete (77274 records). [2025-09-30T18:35:00.435158] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-30T18:35:00.884750] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-30T18:35:00.884900] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-30T18:35:00.886342] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-30T18:35:00.886432] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-30T18:35:00.888948] [DEBUG] [LOCAL ] EOG: Trimmed 77274 records to 53343 (keeping 200 days of data) [2025-09-30T18:35:01.088028] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-30T18:35:01.142886] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:35:01.275060] [DEBUG] [LOCAL ] EOG: Primary data saved (53343 records). [2025-09-30T18:35:01.275226] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-30T18:35:01.275350] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOG took 28.8s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-09-30T18:35:01.476038] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:01.476271] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-09-30T18:35:01.476312] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-09-30T18:35:01.476431] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-30T18:35:01.476473] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-30T18:35:01.476515] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-30T18:35:01.476549] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-30T18:35:01.859536] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-30T18:35:01.933550] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:02.060597] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:35:02.654405] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-30T18:35:02.921363] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T18:35:03.454347] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-30T18:35:03.506928] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:35:03.510572] [INFO ] [REMOTE ] EOS: Full fetch complete (23215 records). [2025-09-30T18:35:03.510677] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-30T18:35:03.917441] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-30T18:35:03.917659] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-30T18:35:03.918235] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-30T18:35:03.918297] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-30T18:35:03.919007] [DEBUG] [LOCAL ] EOS: Trimmed 23215 records to 15187 (keeping 200 days of data) [2025-09-30T18:35:04.024262] [DEBUG] [LOCAL ] EOS: Primary data saved (15187 records). [2025-09-30T18:35:04.024380] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-30T18:35:04.024500] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOS took 24.9s. Estimated remaining: 3h 26m 9s. Rate: 7.9 symbols/min [2025-09-30T18:35:04.204606] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:04.252338] [DEBUG] [LOCAL ] EPAM: Loaded 39831 existing records from primary storage. [2025-09-30T18:35:04.252678] [INFO ] [MAIN ] EPAM: Loaded 39831 existing records. [2025-09-30T18:35:04.264682] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-30T18:35:04.447155] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:04.447409] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-30T18:35:04.447459] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-30T18:35:04.448272] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-30T18:35:04.448334] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-30T18:35:04.846183] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:05.043379] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:35:05.054297] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-30T18:35:05.112298] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T18:35:05.854307] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-30T18:35:06.106863] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T18:35:06.654406] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-30T18:35:07.132322] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T18:35:07.454408] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-30T18:35:08.193504] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-30T18:35:08.254379] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-30T18:35:08.359457] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:35:09.054403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-30T18:35:09.497338] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:35:09.854379] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-30T18:35:09.962795] [DEBUG] [REMOTE ] EOT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-30T18:35:09.963205] [WARN ] [REMOTE ] EOT: No data returned for month 2025-01 [2025-09-30T18:35:09.963334] [FATAL] [REMOTE ] EOT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:35:09.963567] [FATAL] [MAIN ] EOT: Failed to fetch primary data. [2025-09-30T18:35:09.963695] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:35:09.963774] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-30T18:35:09.963864] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-09-30T18:35:09.963952] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-09-30T18:35:09.964277] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-09-30T18:35:09.964524] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 10.6s. Estimated remaining: 3h 25m 57s. Rate: 7.9 symbols/min [2025-09-30T18:35:10.172502] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:10.225403] [DEBUG] [LOCAL ] EPC: Loaded 39719 existing records from primary storage. [2025-09-30T18:35:10.225785] [INFO ] [MAIN ] EPC: Loaded 39719 existing records. [2025-09-30T18:35:10.376399] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:35:10.450998] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:10.451256] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-30T18:35:10.451306] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-30T18:35:10.451762] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-30T18:35:10.451824] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-30T18:35:10.659546] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-30T18:35:10.835934] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:11.454322] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-30T18:35:11.919366] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T18:35:12.254411] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-30T18:35:13.015221] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:35:13.054344] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-30T18:35:13.319191] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:35:13.667542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T18:35:13.854399] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-30T18:35:14.654358] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-30T18:35:14.673111] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T18:35:15.454408] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-30T18:35:16.097304] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:35:16.254373] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-30T18:35:16.474757] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:35:16.477798] [INFO ] [REMOTE ] EOI: Full fetch complete (16167 records). [2025-09-30T18:35:16.477958] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-30T18:35:16.905835] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-30T18:35:16.905929] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-30T18:35:16.906344] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-30T18:35:16.906411] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-30T18:35:16.907185] [DEBUG] [LOCAL ] EOI: Trimmed 16167 records to 10647 (keeping 200 days of data) [2025-09-30T18:35:16.976149] [DEBUG] [LOCAL ] EOI: Primary data saved (10647 records). [2025-09-30T18:35:16.976296] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-30T18:35:16.976463] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOI took 39.4s. Estimated remaining: 3h 25m 49s. Rate: 7.9 symbols/min [2025-09-30T18:35:17.059473] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-30T18:35:17.173547] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:17.235234] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-09-30T18:35:17.235573] [INFO ] [MAIN ] EPD: Loaded 53610 existing records. [2025-09-30T18:35:17.439005] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:17.439230] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-30T18:35:17.439280] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-30T18:35:17.439838] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-30T18:35:17.439979] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-30T18:35:17.603988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:35:17.862459] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-30T18:35:17.912478] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:18.548974] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:35:18.654386] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-30T18:35:19.454365] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-30T18:35:19.664434] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:35:19.740698] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:35:20.254394] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-30T18:35:20.888944] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:35:21.054382] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-30T18:35:21.566942] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:35:21.854378] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-30T18:35:22.654363] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-30T18:35:22.717306] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:35:23.320234] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:35:23.454384] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-30T18:35:23.951041] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:35:24.254439] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-30T18:35:24.800431] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T18:35:25.054379] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-30T18:35:25.648822] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T18:35:25.854371] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-30T18:35:26.456618] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:35:26.463381] [INFO ] [REMOTE ] EPAC: Full fetch complete (39074 records). [2025-09-30T18:35:26.463502] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-30T18:35:26.664853] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-30T18:35:26.892558] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-30T18:35:26.892697] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-30T18:35:26.893419] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-30T18:35:26.893491] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-30T18:35:26.894519] [DEBUG] [LOCAL ] EPAC: Trimmed 39074 records to 26979 (keeping 200 days of data) [2025-09-30T18:35:27.071301] [DEBUG] [LOCAL ] EPAC: Primary data saved (26979 records). [2025-09-30T18:35:27.071446] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-30T18:35:27.071551] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 25.8s. Estimated remaining: 3h 25m 46s. Rate: 7.9 symbols/min [2025-09-30T18:35:27.261796] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:27.308526] [DEBUG] [LOCAL ] EPR: Loaded 43933 existing records from primary storage. [2025-09-30T18:35:27.308892] [INFO ] [MAIN ] EPR: Loaded 43933 existing records. [2025-09-30T18:35:27.458187] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-30T18:35:27.534929] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:35:27.545383] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:27.558343] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-30T18:35:27.558445] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-30T18:35:27.558946] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-30T18:35:27.559013] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-30T18:35:27.971401] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:28.254348] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-30T18:35:28.625970] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:35:28.680184] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T18:35:29.054357] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-30T18:35:29.861299] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-30T18:35:29.875747] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:35:30.654388] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-30T18:35:30.879463] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:35:31.358175] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T18:35:31.454355] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-30T18:35:32.254370] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-30T18:35:32.396473] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:35:33.056272] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-30T18:35:33.060136] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T18:35:33.800360] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:35:33.854377] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-30T18:35:34.564628] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:35:34.654354] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-30T18:35:35.454341] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-30T18:35:35.522765] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:35:36.204870] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:35:36.254350] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-30T18:35:37.054366] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-30T18:35:37.295524] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:35:37.304062] [INFO ] [REMOTE ] EPC: Full fetch complete (56512 records). [2025-09-30T18:35:37.304232] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-30T18:35:37.305321] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:35:37.305462] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:35:37.305517] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:35:37.305596] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-30T18:35:37.305714] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-30T18:35:37.305782] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-09-30T18:35:37.306144] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-09-30T18:35:37.306279] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 27.3s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min [2025-09-30T18:35:37.505439] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:37.553604] [DEBUG] [LOCAL ] EPRT: Loaded 48483 existing records from primary storage. [2025-09-30T18:35:37.553972] [INFO ] [MAIN ] EPRT: Loaded 48483 existing records. [2025-09-30T18:35:37.763556] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:37.764121] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-30T18:35:37.764277] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-30T18:35:37.764610] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-30T18:35:37.764758] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-30T18:35:37.866862] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-30T18:35:38.086163] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:35:38.140442] [INFO ] [REMOTE ] EPAM: Full fetch complete (56138 records). [2025-09-30T18:35:38.146263] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-30T18:35:38.267146] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:38.659566] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-30T18:35:38.713721] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-30T18:35:38.713854] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-30T18:35:38.714850] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-30T18:35:38.714967] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-30T18:35:38.716884] [DEBUG] [LOCAL ] EPAM: Trimmed 56138 records to 39781 (keeping 200 days of data) [2025-09-30T18:35:38.865840] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:35:39.044536] [DEBUG] [LOCAL ] EPAM: Primary data saved (39781 records). [2025-09-30T18:35:39.044759] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-30T18:35:39.045812] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAM took 35.0s. Estimated remaining: 3h 25m 24s. Rate: 7.9 symbols/min [2025-09-30T18:35:39.246772] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:39.276304] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:35:39.295990] [DEBUG] [LOCAL ] EQBK: Loaded 10915 existing records from primary storage. [2025-09-30T18:35:39.296249] [INFO ] [MAIN ] EQBK: Loaded 10915 existing records. [2025-09-30T18:35:39.463287] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-30T18:35:39.487804] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:39.489068] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-30T18:35:39.489123] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-30T18:35:39.489393] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-30T18:35:39.489470] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-30T18:35:39.952707] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:40.254317] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-30T18:35:40.362992] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:35:41.054400] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-30T18:35:41.084990] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:35:41.659289] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T18:35:41.854382] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-30T18:35:42.503929] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:35:42.654360] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-30T18:35:42.800188] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:35:43.411429] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:35:43.454340] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-30T18:35:44.254396] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-30T18:35:45.036466] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:35:45.054335] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-30T18:35:45.087944] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T18:35:45.854373] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-30T18:35:46.602070] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T18:35:46.654368] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-30T18:35:46.988464] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:35:47.454360] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-30T18:35:47.943223] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T18:35:48.254404] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-30T18:35:49.054477] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-30T18:35:49.478596] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T18:35:49.805164] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:35:49.854419] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-30T18:35:50.654353] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-30T18:35:50.707197] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:35:51.394955] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:35:51.454323] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-30T18:35:51.896007] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T18:35:52.254415] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-30T18:35:53.015153] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:35:53.017158] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T18:35:53.054331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-30T18:35:53.851677] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T18:35:53.855056] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-30T18:35:54.654455] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-30T18:35:55.454378] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-30T18:35:55.503213] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T18:35:55.600085] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T18:35:56.254370] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-30T18:35:57.054412] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-30T18:35:57.357946] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:35:57.370762] [INFO ] [REMOTE ] EPD: Full fetch complete (77640 records). [2025-09-30T18:35:57.370933] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-30T18:35:57.811944] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-30T18:35:57.812292] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-30T18:35:57.813355] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-30T18:35:57.813480] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-30T18:35:57.815209] [DEBUG] [LOCAL ] EPD: Trimmed 77640 records to 53610 (keeping 200 days of data) [2025-09-30T18:35:57.874114] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-30T18:35:57.931254] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:35:58.093180] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:35:58.105503] [INFO ] [REMOTE ] EPR: Full fetch complete (62919 records). [2025-09-30T18:35:58.106765] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-30T18:35:58.649560] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-30T18:35:58.649698] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-30T18:35:58.650671] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-30T18:35:58.650765] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-30T18:35:58.686135] [DEBUG] [LOCAL ] EPR: Trimmed 62919 records to 43924 (keeping 200 days of data) [2025-09-30T18:35:58.686264] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-30T18:35:58.835931] [DEBUG] [LOCAL ] EPD: Primary data saved (53610 records). [2025-09-30T18:35:58.837679] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-30T18:35:58.838086] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 41.9s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-09-30T18:35:59.036981] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:59.038476] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-09-30T18:35:59.039136] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-09-30T18:35:59.039866] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-30T18:35:59.040168] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-30T18:35:59.041093] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-30T18:35:59.041938] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-30T18:35:59.459930] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:59.460401] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-30T18:35:59.588379] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:35:59.660918] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:35:59.665683] [INFO ] [REMOTE ] EQBK: Full fetch complete (15417 records). [2025-09-30T18:35:59.666044] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-30T18:35:59.785789] [DEBUG] [LOCAL ] EPR: Primary data saved (43924 records). [2025-09-30T18:35:59.791766] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-30T18:35:59.791924] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 32.7s. Estimated remaining: 3h 25m 21s. Rate: 7.9 symbols/min [2025-09-30T18:36:00.218312] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:00.259471] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-30T18:36:00.302802] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-30T18:36:00.302894] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-30T18:36:00.303323] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-30T18:36:00.303389] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-30T18:36:00.304740] [DEBUG] [LOCAL ] EQBK: Trimmed 15417 records to 10919 (keeping 200 days of data) [2025-09-30T18:36:00.407289] [DEBUG] [LOCAL ] EQNR: Loaded 53027 existing records from primary storage. [2025-09-30T18:36:00.408484] [INFO ] [MAIN ] EQNR: Loaded 53027 existing records. [2025-09-30T18:36:00.530112] [DEBUG] [LOCAL ] EQBK: Primary data saved (10919 records). [2025-09-30T18:36:00.534216] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-30T18:36:00.534757] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 21.5s. Estimated remaining: 3h 24m 58s. Rate: 7.9 symbols/min [2025-09-30T18:36:00.747201] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:00.757809] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-30T18:36:00.768224] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-30T18:36:00.773810] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-30T18:36:00.773884] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-30T18:36:00.864235] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:01.202075] [DEBUG] [LOCAL ] EQR: Loaded 51469 existing records from primary storage. [2025-09-30T18:36:01.218082] [INFO ] [MAIN ] EQR: Loaded 51469 existing records. [2025-09-30T18:36:01.330517] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:01.346526] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-30T18:36:01.534761] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:01.537626] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:36:01.535684] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-30T18:36:01.549221] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-30T18:36:01.549577] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-30T18:36:01.549638] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-30T18:36:01.859459] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-30T18:36:01.939223] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:02.280150] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:36:02.654411] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-30T18:36:03.326624] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T18:36:03.392070] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T18:36:03.454345] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-30T18:36:04.254389] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-30T18:36:04.372312] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:36:05.054351] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-30T18:36:05.171715] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:36:05.761132] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:36:05.854373] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-30T18:36:06.594884] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:36:06.654387] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-30T18:36:07.454351] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-30T18:36:07.576804] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:36:08.224738] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:36:08.254362] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-30T18:36:09.054403] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-30T18:36:09.123441] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:36:09.854375] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-30T18:36:09.941147] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:36:10.529410] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:36:10.654414] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-30T18:36:11.175113] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:36:11.454380] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-30T18:36:12.203517] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:36:12.254329] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-30T18:36:13.054366] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-30T18:36:13.151886] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:36:13.854383] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-30T18:36:14.252304] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T18:36:14.263230] [INFO ] [REMOTE ] EPRT: Full fetch complete (68708 records). [2025-09-30T18:36:14.263425] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-30T18:36:14.656591] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-30T18:36:14.721244] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-30T18:36:14.721500] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-30T18:36:14.722618] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-30T18:36:14.723056] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-30T18:36:14.725405] [DEBUG] [LOCAL ] EPRT: Trimmed 68708 records to 48479 (keeping 200 days of data) [2025-09-30T18:36:14.903633] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:36:15.133629] [DEBUG] [LOCAL ] EPRT: Primary data saved (48479 records). [2025-09-30T18:36:15.133822] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-30T18:36:15.133932] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 37.8s. Estimated remaining: 3h 25m 5s. Rate: 7.9 symbols/min [2025-09-30T18:36:15.454411] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-30T18:36:15.667890] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:36:16.254415] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-30T18:36:16.510567] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:36:17.054345] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-30T18:36:17.111785] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:36:17.854417] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-30T18:36:18.051680] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:36:18.440325] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:36:18.654378] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-30T18:36:19.316602] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:36:19.454395] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-30T18:36:20.254464] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-30T18:36:20.447847] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:36:21.054380] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-30T18:36:21.220178] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:36:21.854369] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-30T18:36:22.029009] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:36:22.492587] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:36:22.654388] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-30T18:36:23.239894] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T18:36:23.454408] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-30T18:36:24.254382] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-30T18:36:24.336116] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T18:36:25.054339] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-30T18:36:25.541284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T18:36:25.854346] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-30T18:36:26.086053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:36:26.099110] [INFO ] [REMOTE ] EQH: Full fetch complete (76360 records). [2025-09-30T18:36:26.099306] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-30T18:36:26.514685] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-30T18:36:26.514784] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-30T18:36:26.515840] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-30T18:36:26.515911] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-30T18:36:26.518514] [DEBUG] [LOCAL ] EQH: Trimmed 76360 records to 52651 (keeping 200 days of data) [2025-09-30T18:36:26.874328] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T18:36:26.888974] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-30T18:36:26.900262] [DEBUG] [LOCAL ] EQH: Primary data saved (52651 records). [2025-09-30T18:36:26.900411] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-30T18:36:26.900492] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 28.1s. Estimated remaining: 3h 25m 7s. Rate: 7.9 symbols/min [2025-09-30T18:36:27.319251] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:36:27.454376] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-30T18:36:28.711115] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:36:28.723592] [INFO ] [REMOTE ] EQR: Full fetch complete (73944 records). [2025-09-30T18:36:28.723885] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-30T18:36:29.160149] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-30T18:36:29.160365] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-30T18:36:29.161554] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-30T18:36:29.161640] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-30T18:36:29.163437] [DEBUG] [LOCAL ] EQR: Trimmed 73944 records to 51489 (keeping 200 days of data) [2025-09-30T18:36:29.437341] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:36:29.451796] [INFO ] [REMOTE ] EQNR: Full fetch complete (76797 records). [2025-09-30T18:36:29.454142] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-30T18:36:29.927008] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-30T18:36:29.927626] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-30T18:36:29.928771] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-30T18:36:29.929254] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-30T18:36:29.977947] [DEBUG] [LOCAL ] EQNR: Trimmed 76797 records to 53023 (keeping 200 days of data) [2025-09-30T18:36:30.129273] [DEBUG] [LOCAL ] EQR: Primary data saved (51489 records). [2025-09-30T18:36:30.130216] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-30T18:36:30.130600] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQR took 29.6s. Estimated remaining: 3h 24m 50s. Rate: 7.9 symbols/min [2025-09-30T18:36:30.377708] [DEBUG] [LOCAL ] EQNR: Primary data saved (53023 records). [2025-09-30T18:36:30.377867] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-30T18:36:30.377974] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQNR took 30.6s. Estimated remaining: 3h 24m 26s. Rate: 7.9 symbols/min [2025-09-30T18:36:31.057198] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.164402] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.180331] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.199338] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-30T18:36:31.199493] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-30T18:36:31.200792] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-30T18:36:31.201143] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-30T18:36:31.200698] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.201316] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-30T18:36:31.201627] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-30T18:36:31.293208] [DEBUG] [LOCAL ] EQV: Loaded 2742 existing records from primary storage. [2025-09-30T18:36:31.325752] [INFO ] [MAIN ] EQV: Loaded 2742 existing records. [2025-09-30T18:36:31.692074] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-30T18:36:31.750608] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-30T18:36:31.877268] [DEBUG] [LOCAL ] ERJ: Loaded 50678 existing records from primary storage. [2025-09-30T18:36:31.947742] [INFO ] [MAIN ] ERJ: Loaded 50678 existing records. [2025-09-30T18:36:31.990849] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:31.996421] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-30T18:36:31.987624] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.040200] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.059459] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-30T18:36:32.133037] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-30T18:36:32.192253] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-30T18:36:32.241021] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.294808] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.339218] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-30T18:36:32.398753] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.426064] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-30T18:36:32.433846] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.437721] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-30T18:36:32.437933] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-30T18:36:32.507874] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-30T18:36:32.637704] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-30T18:36:32.814833] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T18:36:32.942010] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-30T18:36:33.108388] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.149115] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-30T18:36:33.501025] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.529969] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-30T18:36:33.529714] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T18:36:33.622059] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-30T18:36:33.620944] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.623246] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-30T18:36:33.955820] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:36:33.956968] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-30T18:36:34.162874] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:36:34.164923] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-30T18:36:34.296095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:36:34.654343] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-30T18:36:34.941057] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:36:34.981186] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T18:36:35.151915] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:36:35.454375] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-30T18:36:35.686536] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-30T18:36:36.254353] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-30T18:36:36.772464] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:36:37.054401] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-30T18:36:37.474253] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:36:37.854335] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-30T18:36:38.008488] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:36:38.390478] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-30T18:36:38.654390] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-30T18:36:39.454398] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-30T18:36:39.921754] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T18:36:40.100354] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:36:40.254408] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-30T18:36:40.602977] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T18:36:41.054404] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-30T18:36:41.542973] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:36:41.854485] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-30T18:36:42.217345] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-30T18:36:42.654388] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-30T18:36:43.454407] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-30T18:36:44.254314] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-30T18:36:44.594597] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T18:36:44.925878] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:36:45.054332] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-30T18:36:45.255865] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:36:45.854384] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-30T18:36:46.332983] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:36:46.654358] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-30T18:36:47.020055] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T18:36:47.205167] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T18:36:47.454369] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-30T18:36:48.254379] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-30T18:36:48.821355] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T18:36:48.822604] [INFO ] [REMOTE ] EQV: Full fetch complete (5775 records). [2025-09-30T18:36:48.822711] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-30T18:36:49.061145] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-30T18:36:49.242752] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-30T18:36:49.243059] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-30T18:36:49.243363] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-30T18:36:49.243467] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-30T18:36:49.244830] [DEBUG] [LOCAL ] EQV: Trimmed 5775 records to 2737 (keeping 200 days of data) [2025-09-30T18:36:49.288125] [DEBUG] [LOCAL ] EQV: Primary data saved (2737 records). [2025-09-30T18:36:49.304379] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-30T18:36:49.304588] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 18.9s. Estimated remaining: 3h 24m 43s. Rate: 7.9 symbols/min [2025-09-30T18:36:49.343444] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T18:36:49.523313] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:49.565505] [DEBUG] [LOCAL ] ERO: Loaded 41225 existing records from primary storage. [2025-09-30T18:36:49.565880] [INFO ] [MAIN ] ERO: Loaded 41225 existing records. [2025-09-30T18:36:49.753629] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:49.753830] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-30T18:36:49.753878] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-30T18:36:49.754284] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-30T18:36:49.754344] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-30T18:36:49.862185] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-30T18:36:50.135768] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:50.654375] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-30T18:36:51.061409] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-30T18:36:51.177399] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:36:51.305410] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:36:51.454391] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-30T18:36:51.848983] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T18:36:52.254375] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-30T18:36:53.054358] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-30T18:36:53.603690] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:36:53.854347] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-30T18:36:54.654441] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-30T18:36:54.766069] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T18:36:55.331921] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:36:55.333432] [INFO ] [REMOTE ] EQS: Full fetch complete (2536 records). [2025-09-30T18:36:55.333521] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-30T18:36:55.459538] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-30T18:36:55.536754] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-30T18:36:55.537861] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:36:55.538072] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:36:55.538262] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-30T18:36:55.538348] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-30T18:36:55.538389] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-30T18:36:55.538446] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-30T18:36:55.538550] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQS took 25.2s. Estimated remaining: 3h 24m 32s. Rate: 7.9 symbols/min [2025-09-30T18:36:55.733530] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:55.768472] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:36:55.835541] [DEBUG] [LOCAL ] ES: Loaded 52538 existing records from primary storage. [2025-09-30T18:36:55.836025] [INFO ] [MAIN ] ES: Loaded 52538 existing records. [2025-09-30T18:36:56.035194] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:56.035452] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-30T18:36:56.035505] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-30T18:36:56.036074] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-30T18:36:56.036137] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-30T18:36:56.263567] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-30T18:36:56.438990] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:57.054376] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-30T18:36:57.478103] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T18:36:57.513093] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:36:57.854370] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-30T18:36:58.654371] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-30T18:36:58.739736] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:36:59.454375] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-30T18:36:59.810337] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:37:00.156434] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:37:00.254400] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-30T18:37:01.054400] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-30T18:37:01.350348] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T18:37:01.854336] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-30T18:37:01.962910] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T18:37:02.654363] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-30T18:37:02.977492] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:37:02.987773] [INFO ] [REMOTE ] ERJ: Full fetch complete (71955 records). [2025-09-30T18:37:02.987919] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-30T18:37:02.989258] [FATAL] [VALIDATOR ] ERJ: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:37:02.989390] [FATAL] [MAIN ] ERJ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:37:02.989462] [WARN ] [MAIN ] ERJ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:37:02.989538] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-30T18:37:02.989621] [DEBUG] [LOCAL ] ERJ: No primary data file found to delete. [2025-09-30T18:37:02.989704] [INFO ] [LOCAL ] ERJ: Starting deletion of derivative data. [2025-09-30T18:37:02.989961] [DEBUG] [LOCAL ] ERJ: Deleted derivative data file. [2025-09-30T18:37:02.990071] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 32.6s. Estimated remaining: 3h 24m 24s. Rate: 7.9 symbols/min [2025-09-30T18:37:03.183572] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:03.212930] [DEBUG] [LOCAL ] ESAB: Loaded 26158 existing records from primary storage. [2025-09-30T18:37:03.213215] [INFO ] [MAIN ] ESAB: Loaded 26158 existing records. [2025-09-30T18:37:03.416935] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:03.417160] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-30T18:37:03.417209] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-30T18:37:03.417469] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-30T18:37:03.417530] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-30T18:37:03.461452] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-30T18:37:03.839089] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:03.882832] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T18:37:04.184681] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T18:37:04.254353] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-30T18:37:05.054387] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-30T18:37:05.189153] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:37:05.854356] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-30T18:37:05.967504] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:37:06.194951] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:37:06.654406] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-30T18:37:07.454392] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-30T18:37:07.717751] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:37:08.128031] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:37:08.150096] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:37:08.254380] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-30T18:37:09.054339] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-30T18:37:09.100492] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:37:09.854373] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-30T18:37:10.654376] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-30T18:37:10.935622] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:37:11.250102] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:37:11.454370] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-30T18:37:12.254416] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-30T18:37:12.641027] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:37:13.054346] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-30T18:37:13.210534] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:37:13.854381] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-30T18:37:14.032165] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T18:37:14.654331] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-30T18:37:14.803625] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:37:15.201662] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:37:15.213506] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-30T18:37:15.213693] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-30T18:37:15.461495] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-30T18:37:15.653869] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-30T18:37:15.653970] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-30T18:37:15.654998] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-30T18:37:15.655068] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-30T18:37:15.656809] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-30T18:37:16.003812] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:37:16.033594] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-30T18:37:16.033759] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-30T18:37:16.033897] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 45.7s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-09-30T18:37:16.217133] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:16.237924] [DEBUG] [LOCAL ] ESE: Loaded 16687 existing records from primary storage. [2025-09-30T18:37:16.238226] [INFO ] [MAIN ] ESE: Loaded 16687 existing records. [2025-09-30T18:37:16.261270] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-30T18:37:16.443701] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:16.443932] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-30T18:37:16.443980] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-30T18:37:16.444232] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-30T18:37:16.444292] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-30T18:37:16.825203] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:17.054329] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-30T18:37:17.508144] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T18:37:17.854390] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-30T18:37:18.244780] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:37:18.255089] [INFO ] [REMOTE ] ERO: Full fetch complete (59475 records). [2025-09-30T18:37:18.255230] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-30T18:37:18.648883] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:37:18.676577] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-30T18:37:18.708556] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-30T18:37:18.709507] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-30T18:37:18.710342] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-30T18:37:18.710470] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-30T18:37:18.711907] [DEBUG] [LOCAL ] ERO: Trimmed 59475 records to 41233 (keeping 200 days of data) [2025-09-30T18:37:18.977119] [DEBUG] [LOCAL ] ERO: Primary data saved (41233 records). [2025-09-30T18:37:18.977484] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-30T18:37:18.979071] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERO took 29.7s. Estimated remaining: 3h 24m 10s. Rate: 7.9 symbols/min [2025-09-30T18:37:19.172313] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:19.238018] [DEBUG] [LOCAL ] ESI: Loaded 50777 existing records from primary storage. [2025-09-30T18:37:19.238461] [INFO ] [MAIN ] ESI: Loaded 50777 existing records. [2025-09-30T18:37:19.436512] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:19.436914] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-30T18:37:19.437013] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-30T18:37:19.437748] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-30T18:37:19.437971] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-30T18:37:19.461361] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-30T18:37:19.772719] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T18:37:19.775128] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:37:19.947770] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:20.254356] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-30T18:37:20.700420] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:37:21.054366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-30T18:37:21.854375] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-30T18:37:22.096453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:37:22.150892] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T18:37:22.654361] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-30T18:37:22.753360] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:37:23.454357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-30T18:37:24.255974] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-30T18:37:24.259063] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:37:24.488671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:37:25.054362] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-30T18:37:25.854408] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-30T18:37:26.152435] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:37:26.166433] [INFO ] [REMOTE ] ES: Full fetch complete (76180 records). [2025-09-30T18:37:26.166599] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-30T18:37:26.323879] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:37:26.591941] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-30T18:37:26.592029] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-30T18:37:26.592947] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-30T18:37:26.593012] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-30T18:37:26.594555] [DEBUG] [LOCAL ] ES: Trimmed 76180 records to 52556 (keeping 200 days of data) [2025-09-30T18:37:26.659912] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-30T18:37:26.951860] [DEBUG] [LOCAL ] ES: Primary data saved (52556 records). [2025-09-30T18:37:26.952007] [INFO ] [MAIN ] ES: Full history saved. [2025-09-30T18:37:26.952093] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 31.4s. Estimated remaining: 3h 24m 4s. Rate: 7.9 symbols/min [2025-09-30T18:37:27.150607] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:27.185044] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:37:27.230438] [DEBUG] [LOCAL ] ESNT: Loaded 38376 existing records from primary storage. [2025-09-30T18:37:27.230803] [INFO ] [MAIN ] ESNT: Loaded 38376 existing records. [2025-09-30T18:37:27.433667] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:27.433873] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-30T18:37:27.433944] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-30T18:37:27.434240] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-30T18:37:27.434299] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-30T18:37:27.459497] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-30T18:37:27.780605] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:37:27.860199] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:28.254374] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-30T18:37:28.621604] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:37:29.054390] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-30T18:37:29.607560] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T18:37:29.798379] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T18:37:29.854357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-30T18:37:30.613772] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T18:37:30.654382] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-30T18:37:31.454366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-30T18:37:32.160187] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:37:32.254347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-30T18:37:32.434421] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T18:37:33.054372] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-30T18:37:33.734457] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:37:33.854363] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-30T18:37:34.083317] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T18:37:34.654365] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-30T18:37:35.255262] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:37:35.454348] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-30T18:37:35.658487] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T18:37:36.254397] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-30T18:37:37.054357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-30T18:37:37.344334] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:37:37.575430] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:37:37.806002] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T18:37:37.810620] [INFO ] [REMOTE ] ESE: Full fetch complete (22286 records). [2025-09-30T18:37:37.810815] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-30T18:37:37.859597] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-30T18:37:38.248065] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-30T18:37:38.248256] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-30T18:37:38.248833] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-30T18:37:38.248899] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-30T18:37:38.249699] [DEBUG] [LOCAL ] ESE: Trimmed 22286 records to 16678 (keeping 200 days of data) [2025-09-30T18:37:38.362145] [DEBUG] [LOCAL ] ESE: Primary data saved (16678 records). [2025-09-30T18:37:38.362296] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-30T18:37:38.362434] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 22.3s. Estimated remaining: 3h 24m 4s. Rate: 7.9 symbols/min [2025-09-30T18:37:38.554578] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:38.604494] [DEBUG] [LOCAL ] ESRT: Loaded 46398 existing records from primary storage. [2025-09-30T18:37:38.604905] [INFO ] [MAIN ] ESRT: Loaded 46398 existing records. [2025-09-30T18:37:38.664153] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-30T18:37:38.810285] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:38.810559] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-30T18:37:38.810619] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-30T18:37:38.811001] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-30T18:37:38.811080] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-30T18:37:39.217538] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:39.454341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-30T18:37:39.492053] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:37:40.254325] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-30T18:37:40.367150] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T18:37:41.034214] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:37:41.054310] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-30T18:37:41.455610] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:37:41.854364] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-30T18:37:42.570694] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:37:42.654399] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-30T18:37:43.337448] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:37:43.344330] [INFO ] [REMOTE ] ESAB: Full fetch complete (35780 records). [2025-09-30T18:37:43.344457] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-30T18:37:43.459445] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-30T18:37:43.769520] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-30T18:37:43.769709] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-30T18:37:43.770447] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-30T18:37:43.770536] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-30T18:37:43.795636] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:37:43.804215] [DEBUG] [LOCAL ] ESAB: Trimmed 35780 records to 26186 (keeping 200 days of data) [2025-09-30T18:37:43.987790] [DEBUG] [LOCAL ] ESAB: Primary data saved (26186 records). [2025-09-30T18:37:43.987942] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-30T18:37:43.988055] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 41.0s. Estimated remaining: 3h 23m 52s. Rate: 7.9 symbols/min [2025-09-30T18:37:44.166730] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:44.200292] [DEBUG] [LOCAL ] ESS: Loaded 30019 existing records from primary storage. [2025-09-30T18:37:44.200590] [INFO ] [MAIN ] ESS: Loaded 30019 existing records. [2025-09-30T18:37:44.265733] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-30T18:37:44.393874] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:44.394133] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-30T18:37:44.394207] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-30T18:37:44.394468] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-30T18:37:44.394528] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-30T18:37:44.774828] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:44.925000] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:37:45.054374] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-30T18:37:45.694149] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:37:45.854365] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-30T18:37:46.641398] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:37:46.654311] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-30T18:37:47.379696] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:37:47.454376] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-30T18:37:47.839833] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:37:48.254403] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-30T18:37:48.930385] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:37:49.054379] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-30T18:37:49.797620] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:37:49.854366] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-30T18:37:50.420015] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:37:50.654402] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-30T18:37:51.270759] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T18:37:51.454420] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-30T18:37:52.254447] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-30T18:37:52.384454] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:37:53.054395] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-30T18:37:53.104512] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:37:53.744588] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:37:53.752962] [INFO ] [REMOTE ] ESNT: Full fetch complete (57108 records). [2025-09-30T18:37:53.753158] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-30T18:37:53.859554] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-30T18:37:54.178683] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-30T18:37:54.178836] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-30T18:37:54.179592] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-30T18:37:54.179673] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-30T18:37:54.180995] [DEBUG] [LOCAL ] ESNT: Trimmed 57108 records to 38357 (keeping 200 days of data) [2025-09-30T18:37:54.433437] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:37:54.460787] [DEBUG] [LOCAL ] ESNT: Primary data saved (38357 records). [2025-09-30T18:37:54.460956] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-30T18:37:54.461051] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESNT took 27.5s. Estimated remaining: 3h 23m 50s. Rate: 7.9 symbols/min [2025-09-30T18:37:54.647263] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:54.654359] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-30T18:37:54.696000] [DEBUG] [LOCAL ] ESTC: Loaded 49961 existing records from primary storage. [2025-09-30T18:37:54.696506] [INFO ] [MAIN ] ESTC: Loaded 49961 existing records. [2025-09-30T18:37:54.881847] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:54.882116] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-30T18:37:54.882173] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-30T18:37:54.882605] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-30T18:37:54.882720] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-30T18:37:55.270887] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:55.454353] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-30T18:37:55.686901] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:37:56.187418] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:37:56.254351] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-30T18:37:57.054356] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-30T18:37:57.326203] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:37:57.627010] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:37:57.854394] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-30T18:37:58.654390] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-30T18:37:58.878179] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:37:58.890495] [INFO ] [REMOTE ] ESRT: Full fetch complete (66500 records). [2025-09-30T18:37:58.890714] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-30T18:37:59.330476] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-30T18:37:59.330668] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-30T18:37:59.331727] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-30T18:37:59.331867] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-30T18:37:59.333738] [DEBUG] [LOCAL ] ESRT: Trimmed 66500 records to 46441 (keeping 200 days of data) [2025-09-30T18:37:59.455333] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-30T18:37:59.624511] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:37:59.706265] [DEBUG] [LOCAL ] ESRT: Primary data saved (46441 records). [2025-09-30T18:37:59.706414] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-30T18:37:59.706516] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 21.3s. Estimated remaining: 3h 23m 38s. Rate: 7.9 symbols/min [2025-09-30T18:37:59.899445] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:59.957504] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-30T18:37:59.957865] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-30T18:38:00.151615] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:00.151957] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-30T18:38:00.157997] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-30T18:38:00.169433] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:38:00.175568] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-30T18:38:00.176280] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-30T18:38:00.259447] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-30T18:38:00.579397] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:00.860789] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:38:01.054378] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-30T18:38:01.854432] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-30T18:38:01.986774] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:38:02.654327] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-30T18:38:02.918343] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T18:38:02.929589] [INFO ] [REMOTE ] ESI: Full fetch complete (72574 records). [2025-09-30T18:38:02.929769] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-30T18:38:03.345217] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-30T18:38:03.345341] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-30T18:38:03.346461] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-30T18:38:03.346540] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-30T18:38:03.348586] [DEBUG] [LOCAL ] ESI: Trimmed 72574 records to 50750 (keeping 200 days of data) [2025-09-30T18:38:03.454714] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-30T18:38:03.633293] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:38:03.735948] [DEBUG] [LOCAL ] ESI: Primary data saved (50750 records). [2025-09-30T18:38:03.736155] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-30T18:38:03.736859] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESI took 44.8s. Estimated remaining: 3h 23m 23s. Rate: 7.9 symbols/min [2025-09-30T18:38:03.922908] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:03.940933] [DEBUG] [LOCAL ] ETB: Loaded 12084 existing records from primary storage. [2025-09-30T18:38:03.941188] [INFO ] [MAIN ] ETB: Loaded 12084 existing records. [2025-09-30T18:38:04.133033] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:04.133458] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-30T18:38:04.133557] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-30T18:38:04.134115] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-30T18:38:04.134235] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-30T18:38:04.257552] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-30T18:38:04.305031] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-30T18:38:04.599966] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:05.051765] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:38:05.060434] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-30T18:38:05.236795] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:38:05.854368] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-30T18:38:06.654415] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-30T18:38:07.290600] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T18:38:07.454325] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-30T18:38:07.581539] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:38:07.806581] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T18:38:08.254411] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-30T18:38:09.054415] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-30T18:38:09.802388] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-30T18:38:09.854344] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-30T18:38:09.966369] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:38:10.157206] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:38:10.654399] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-30T18:38:11.454320] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-30T18:38:12.006294] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T18:38:12.222405] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:38:12.254323] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-30T18:38:12.514860] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:38:13.054425] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-30T18:38:13.460780] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:38:13.854398] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-30T18:38:14.654384] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-30T18:38:14.871903] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:38:15.183352] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T18:38:15.454408] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-30T18:38:16.254333] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-30T18:38:16.349702] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:38:16.409215] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:38:17.054410] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-30T18:38:17.854360] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-30T18:38:18.132342] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T18:38:18.546730] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-30T18:38:18.654373] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-30T18:38:19.190069] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:38:19.196175] [INFO ] [REMOTE ] ESS: Full fetch complete (43194 records). [2025-09-30T18:38:19.196275] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-30T18:38:19.197076] [FATAL] [VALIDATOR ] ESS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:38:19.197190] [FATAL] [MAIN ] ESS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:38:19.197265] [WARN ] [MAIN ] ESS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:38:19.197361] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-30T18:38:19.197467] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-09-30T18:38:19.197544] [INFO ] [LOCAL ] ESS: Starting deletion of derivative data. [2025-09-30T18:38:19.197912] [DEBUG] [LOCAL ] ESS: Deleted derivative data file. [2025-09-30T18:38:19.198046] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESS took 35.2s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min [2025-09-30T18:38:19.385483] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:19.413954] [DEBUG] [LOCAL ] ETD: Loaded 27396 existing records from primary storage. [2025-09-30T18:38:19.414265] [INFO ] [MAIN ] ETD: Loaded 27396 existing records. [2025-09-30T18:38:19.460837] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-30T18:38:19.617888] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:19.618091] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-30T18:38:19.618139] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-30T18:38:19.618411] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-30T18:38:19.618474] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-30T18:38:20.002798] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:20.254377] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-30T18:38:20.897067] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T18:38:21.054326] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-30T18:38:21.452903] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:38:21.471591] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:38:21.854371] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-30T18:38:22.654622] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-30T18:38:22.656359] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:38:23.454325] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-30T18:38:23.523763] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-30T18:38:23.557265] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:38:24.238097] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:38:24.254312] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-30T18:38:24.914215] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T18:38:25.054364] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-30T18:38:25.854383] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-30T18:38:26.654365] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-30T18:38:26.764139] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:38:26.856634] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:38:27.454364] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-30T18:38:28.254330] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-30T18:38:28.371136] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:38:28.641175] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:38:29.054322] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-30T18:38:29.407514] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:38:29.854365] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-30T18:38:30.654329] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-30T18:38:30.721523] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:38:30.724753] [INFO ] [REMOTE ] ETB: Full fetch complete (18036 records). [2025-09-30T18:38:30.724852] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-30T18:38:31.117595] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-30T18:38:31.127615] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-30T18:38:31.147822] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-30T18:38:31.148101] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-30T18:38:31.150322] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:38:31.162988] [DEBUG] [LOCAL ] ETB: Trimmed 18036 records to 12062 (keeping 200 days of data) [2025-09-30T18:38:31.163253] [INFO ] [REMOTE ] ESTC: Full fetch complete (71985 records). [2025-09-30T18:38:31.163702] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-30T18:38:31.461681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-30T18:38:31.686848] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-30T18:38:31.687470] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-30T18:38:31.689396] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-30T18:38:31.689751] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-30T18:38:31.693307] [DEBUG] [LOCAL ] ESTC: Trimmed 71985 records to 49963 (keeping 200 days of data) [2025-09-30T18:38:31.699431] [DEBUG] [LOCAL ] ETB: Primary data saved (12062 records). [2025-09-30T18:38:31.699591] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-30T18:38:31.699726] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 28.0s. Estimated remaining: 3h 23m 34s. Rate: 7.9 symbols/min [2025-09-30T18:38:32.001973] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:32.029188] [DEBUG] [LOCAL ] ETG: Loaded 16477 existing records from primary storage. [2025-09-30T18:38:32.032331] [INFO ] [MAIN ] ETG: Loaded 16477 existing records. [2025-09-30T18:38:32.322465] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:32.331585] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-30T18:38:32.331703] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-30T18:38:32.333461] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-30T18:38:32.334506] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-30T18:38:32.869478] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:32.870932] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-30T18:38:32.918437] [DEBUG] [LOCAL ] ESTC: Primary data saved (49963 records). [2025-09-30T18:38:32.918689] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-30T18:38:32.921019] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T18:38:32.919672] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ESTC took 38.5s. Estimated remaining: 3h 23m 13s. Rate: 7.9 symbols/min [2025-09-30T18:38:32.975822] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-30T18:38:33.034983] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-30T18:38:33.208781] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:33.226270] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:38:33.282219] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-30T18:38:33.481980] [DEBUG] [LOCAL ] ETJ: Loaded 16684 existing records from primary storage. [2025-09-30T18:38:33.522804] [INFO ] [MAIN ] ETJ: Loaded 16684 existing records. [2025-09-30T18:38:33.816727] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-30T18:38:33.837857] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-30T18:38:33.866152] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:33.867824] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-30T18:38:33.867930] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-30T18:38:33.868057] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-30T18:38:33.868318] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-30T18:38:33.868542] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-30T18:38:33.868602] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-30T18:38:33.985227] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-09-30T18:38:34.314839] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:38:34.363730] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-30T18:38:34.399855] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:34.655180] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T18:38:34.655298] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-30T18:38:34.691094] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-30T18:38:34.691293] [INFO ] [MAIN ] ET: Full history saved. [2025-09-30T18:38:34.691389] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 35.0s. Estimated remaining: 3h 22m 53s. Rate: 7.9 symbols/min [2025-09-30T18:38:34.878805] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:34.932499] [DEBUG] [LOCAL ] ETN: Loaded 52799 existing records from primary storage. [2025-09-30T18:38:34.932880] [INFO ] [MAIN ] ETN: Loaded 52799 existing records. [2025-09-30T18:38:35.133351] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:35.133859] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-30T18:38:35.134184] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-30T18:38:35.135861] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-30T18:38:35.135938] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-30T18:38:35.305514] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:38:35.462736] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-30T18:38:35.593252] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:35.773875] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:38:36.254318] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-30T18:38:36.425116] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:38:37.054373] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-30T18:38:37.854325] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-30T18:38:38.045080] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:38:38.264794] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T18:38:38.654418] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-30T18:38:38.841259] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:38:39.454390] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-30T18:38:40.254391] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-30T18:38:40.450595] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T18:38:40.726264] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T18:38:41.054375] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-30T18:38:41.417074] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:38:41.854373] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-30T18:38:42.085807] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:38:42.654385] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-30T18:38:43.454444] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-30T18:38:43.715959] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:38:43.758904] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:38:44.254429] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-30T18:38:44.542518] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T18:38:44.552082] [INFO ] [REMOTE ] ETD: Full fetch complete (38269 records). [2025-09-30T18:38:44.552263] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-30T18:38:45.000565] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-30T18:38:45.000687] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-30T18:38:45.001304] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-30T18:38:45.001351] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-30T18:38:45.002357] [DEBUG] [LOCAL ] ETD: Trimmed 38269 records to 27384 (keeping 200 days of data) [2025-09-30T18:38:45.059620] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-30T18:38:45.190018] [DEBUG] [LOCAL ] ETD: Primary data saved (27384 records). [2025-09-30T18:38:45.190189] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-30T18:38:45.190339] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETD took 26.0s. Estimated remaining: 3h 22m 51s. Rate: 7.9 symbols/min [2025-09-30T18:38:45.386196] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:45.400483] [DEBUG] [LOCAL ] ETO: Loaded 6496 existing records from primary storage. [2025-09-30T18:38:45.400798] [INFO ] [MAIN ] ETO: Loaded 6496 existing records. [2025-09-30T18:38:45.608057] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:45.608407] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-30T18:38:45.608483] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-30T18:38:45.608742] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-30T18:38:45.608836] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-30T18:38:45.880342] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-30T18:38:46.024231] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:46.295622] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T18:38:46.323978] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T18:38:46.654409] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-30T18:38:47.160770] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:38:47.454354] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-30T18:38:48.254350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-30T18:38:48.455461] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:38:48.598534] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:38:48.981002] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T18:38:49.054387] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-30T18:38:49.686628] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T18:38:49.854395] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-30T18:38:50.654397] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-30T18:38:50.851100] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:38:51.454363] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-30T18:38:51.511818] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T18:38:52.254373] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-30T18:38:53.054366] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-30T18:38:53.116293] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:38:53.303527] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:38:53.654590] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:38:53.854373] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-30T18:38:54.581760] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:38:54.654359] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-30T18:38:55.345496] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T18:38:55.454380] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-30T18:38:56.254375] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-30T18:38:56.283393] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:38:56.925834] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T18:38:57.054359] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-30T18:38:57.854375] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-30T18:38:58.434110] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T18:38:58.654355] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-30T18:38:58.881085] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:38:59.454392] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-30T18:39:00.254382] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-30T18:39:00.559554] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T18:39:00.609602] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T18:39:00.614332] [INFO ] [REMOTE ] ETJ: Full fetch complete (25308 records). [2025-09-30T18:39:00.614467] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-30T18:39:01.054476] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-30T18:39:01.070300] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-30T18:39:01.070410] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-30T18:39:01.082938] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-30T18:39:01.083029] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-30T18:39:01.085670] [DEBUG] [LOCAL ] ETJ: Trimmed 25308 records to 16740 (keeping 200 days of data) [2025-09-30T18:39:01.084872] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:39:01.197881] [DEBUG] [LOCAL ] ETJ: Primary data saved (16740 records). [2025-09-30T18:39:01.198039] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-30T18:39:01.198129] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETJ took 28.3s. Estimated remaining: 3h 23m 1s. Rate: 7.9 symbols/min [2025-09-30T18:39:01.382380] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:01.434055] [DEBUG] [LOCAL ] ETR: Loaded 53220 existing records from primary storage. [2025-09-30T18:39:01.434407] [INFO ] [MAIN ] ETR: Loaded 53220 existing records. [2025-09-30T18:39:01.628957] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:01.629230] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-30T18:39:01.629316] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-30T18:39:01.629975] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-30T18:39:01.630067] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-30T18:39:01.859574] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-30T18:39:02.065509] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:02.654370] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-30T18:39:02.851370] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:39:03.215142] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-30T18:39:03.362464] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T18:39:03.454370] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-30T18:39:04.254402] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-30T18:39:05.054332] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-30T18:39:05.344015] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:39:05.364618] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:39:05.368468] [INFO ] [REMOTE ] ETG: Full fetch complete (24770 records). [2025-09-30T18:39:05.368596] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-30T18:39:05.765944] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-30T18:39:05.766038] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-30T18:39:05.766587] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-30T18:39:05.766630] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-30T18:39:05.767447] [DEBUG] [LOCAL ] ETG: Trimmed 24770 records to 16446 (keeping 200 days of data) [2025-09-30T18:39:05.824619] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T18:39:05.854502] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-30T18:39:05.888308] [DEBUG] [LOCAL ] ETG: Primary data saved (16446 records). [2025-09-30T18:39:05.888493] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-30T18:39:05.888679] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 34.2s. Estimated remaining: 3h 22m 47s. Rate: 7.9 symbols/min [2025-09-30T18:39:06.067208] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:06.091930] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-30T18:39:06.092211] [INFO ] [MAIN ] ETV: Loaded 21450 existing records. [2025-09-30T18:39:06.283518] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:06.283790] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-30T18:39:06.283848] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-30T18:39:06.284115] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-30T18:39:06.284174] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-30T18:39:06.661141] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-30T18:39:06.687261] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:07.454354] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-30T18:39:07.608561] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:39:08.060874] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:39:08.254357] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-30T18:39:08.790551] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T18:39:09.054401] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-30T18:39:09.654684] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:39:09.757140] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:39:09.759028] [INFO ] [REMOTE ] ETO: Full fetch complete (9330 records). [2025-09-30T18:39:09.759101] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-30T18:39:09.863564] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-30T18:39:10.148740] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-30T18:39:10.148830] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-30T18:39:10.149087] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-30T18:39:10.149138] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-30T18:39:10.149722] [DEBUG] [LOCAL ] ETO: Trimmed 9330 records to 6485 (keeping 200 days of data) [2025-09-30T18:39:10.191955] [DEBUG] [LOCAL ] ETO: Primary data saved (6485 records). [2025-09-30T18:39:10.192113] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-30T18:39:10.192207] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 25.0s. Estimated remaining: 3h 22m 33s. Rate: 7.9 symbols/min [2025-09-30T18:39:10.380448] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:10.405604] [DEBUG] [LOCAL ] ETW: Loaded 25073 existing records from primary storage. [2025-09-30T18:39:10.405945] [INFO ] [MAIN ] ETW: Loaded 25073 existing records. [2025-09-30T18:39:10.603544] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:10.603844] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-30T18:39:10.603905] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-30T18:39:10.604204] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-30T18:39:10.604279] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-30T18:39:10.661832] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-30T18:39:10.983199] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:11.454425] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-30T18:39:11.925384] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T18:39:12.087816] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:39:12.254421] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-30T18:39:12.596235] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:39:13.054393] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-30T18:39:13.854432] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-30T18:39:14.215346] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:39:14.654349] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-30T18:39:14.775976] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-30T18:39:14.787563] [INFO ] [REMOTE ] ETN: Full fetch complete (76578 records). [2025-09-30T18:39:14.787785] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-30T18:39:15.207780] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-30T18:39:15.207870] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-30T18:39:15.208860] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-30T18:39:15.208927] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-30T18:39:15.210470] [DEBUG] [LOCAL ] ETN: Trimmed 76578 records to 52783 (keeping 200 days of data) [2025-09-30T18:39:15.454549] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-30T18:39:15.587538] [DEBUG] [LOCAL ] ETN: Primary data saved (52783 records). [2025-09-30T18:39:15.587748] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-30T18:39:15.587912] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 40.9s. Estimated remaining: 3h 22m 21s. Rate: 7.9 symbols/min [2025-09-30T18:39:15.791345] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:15.811992] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:39:15.822235] [DEBUG] [LOCAL ] ETX: Loaded 5023 existing records from primary storage. [2025-09-30T18:39:15.822679] [INFO ] [MAIN ] ETX: Loaded 5023 existing records. [2025-09-30T18:39:15.990134] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:39:16.088390] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:16.088697] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-30T18:39:16.088760] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-30T18:39:16.089016] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-30T18:39:16.089077] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-30T18:39:16.259735] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-30T18:39:16.489604] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:16.620741] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:39:17.054388] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-30T18:39:17.804612] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:39:17.854337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-30T18:39:17.998057] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:39:18.654360] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-30T18:39:19.454373] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-30T18:39:19.456578] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:39:19.797246] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:39:20.254331] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-30T18:39:20.337121] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T18:39:21.054331] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-30T18:39:21.289549] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:39:21.854341] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-30T18:39:22.244578] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:39:22.654339] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-30T18:39:22.787942] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:39:23.454374] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-30T18:39:24.012482] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:39:24.254323] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-30T18:39:24.474158] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T18:39:25.054373] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-30T18:39:25.854340] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-30T18:39:26.164135] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T18:39:26.216969] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T18:39:26.427877] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T18:39:26.654376] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-30T18:39:27.454359] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-30T18:39:27.849814] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:39:28.254354] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-30T18:39:28.644551] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T18:39:29.054368] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-30T18:39:29.198252] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:39:29.554225] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T18:39:29.854331] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-30T18:39:30.654402] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-30T18:39:31.227748] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:39:31.454324] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-30T18:39:31.698631] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:39:31.712387] [INFO ] [REMOTE ] ETR: Full fetch complete (77041 records). [2025-09-30T18:39:31.712592] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-30T18:39:32.061429] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T18:39:32.175611] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-30T18:39:32.175744] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-30T18:39:32.176662] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-30T18:39:32.176775] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-30T18:39:32.178605] [DEBUG] [LOCAL ] ETR: Trimmed 77041 records to 53225 (keeping 200 days of data) [2025-09-30T18:39:32.273101] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-30T18:39:32.549393] [DEBUG] [LOCAL ] ETR: Primary data saved (53225 records). [2025-09-30T18:39:32.549582] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-30T18:39:32.549807] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 31.4s. Estimated remaining: 3h 22m 32s. Rate: 7.9 symbols/min [2025-09-30T18:39:32.759335] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:32.787263] [DEBUG] [LOCAL ] ETY: Loaded 22661 existing records from primary storage. [2025-09-30T18:39:32.787614] [INFO ] [MAIN ] ETY: Loaded 22661 existing records. [2025-09-30T18:39:33.040163] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:33.040790] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-30T18:39:33.040848] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-30T18:39:33.041070] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-30T18:39:33.041130] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-30T18:39:33.059486] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-30T18:39:33.162771] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:39:33.478596] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:33.854371] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-30T18:39:34.271634] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:39:34.654320] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-30T18:39:35.034242] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:39:35.229188] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:39:35.454352] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-30T18:39:35.906962] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T18:39:36.254425] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-30T18:39:37.054459] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-30T18:39:37.305632] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:39:37.702800] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:39:37.704605] [INFO ] [REMOTE ] ETX: Full fetch complete (7049 records). [2025-09-30T18:39:37.704749] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-30T18:39:37.859990] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-30T18:39:38.105024] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-30T18:39:38.105117] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-30T18:39:38.105331] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-30T18:39:38.105412] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-30T18:39:38.105893] [DEBUG] [LOCAL ] ETX: Trimmed 7049 records to 5053 (keeping 200 days of data) [2025-09-30T18:39:38.139727] [DEBUG] [LOCAL ] ETX: Primary data saved (5053 records). [2025-09-30T18:39:38.139870] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-30T18:39:38.140090] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETX took 22.6s. Estimated remaining: 3h 22m 20s. Rate: 7.9 symbols/min [2025-09-30T18:39:38.334419] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:38.334697] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-09-30T18:39:38.334752] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-09-30T18:39:38.334869] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-30T18:39:38.334914] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-30T18:39:38.334957] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-30T18:39:38.335016] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-30T18:39:38.654887] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-30T18:39:38.746303] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:39.456462] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-30T18:39:39.468975] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T18:39:39.853090] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:39:39.858445] [INFO ] [REMOTE ] ETV: Full fetch complete (31875 records). [2025-09-30T18:39:39.858582] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-30T18:39:40.261272] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-30T18:39:40.263444] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-30T18:39:40.264325] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-30T18:39:40.265072] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-30T18:39:40.265139] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-30T18:39:40.266143] [DEBUG] [LOCAL ] ETV: Trimmed 31875 records to 21445 (keeping 200 days of data) [2025-09-30T18:39:40.406790] [DEBUG] [LOCAL ] ETV: Primary data saved (21445 records). [2025-09-30T18:39:40.406937] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-30T18:39:40.407043] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETV took 34.5s. Estimated remaining: 3h 22m 2s. Rate: 7.9 symbols/min [2025-09-30T18:39:40.654524] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:40.654801] [DEBUG] [LOCAL ] EVEX: No existing data file found in primary storage. [2025-09-30T18:39:40.654859] [WARN ] [MAIN ] EVEX: No existing data found, performing full refresh instead. [2025-09-30T18:39:40.654982] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-30T18:39:40.655026] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-30T18:39:40.655071] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-30T18:39:40.655105] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-30T18:39:41.071573] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:41.071668] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-30T18:39:41.090845] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:39:41.482951] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:39:41.854319] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-30T18:39:42.217628] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T18:39:42.654369] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-30T18:39:43.295861] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:39:43.448921] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T18:39:43.454533] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-30T18:39:44.254351] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-30T18:39:44.492136] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:39:45.054330] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-30T18:39:45.082986] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T18:39:45.854385] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-30T18:39:46.187896] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:39:46.654326] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-30T18:39:47.116306] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T18:39:47.454404] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-30T18:39:48.072584] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:39:48.081516] [INFO ] [REMOTE ] ETW: Full fetch complete (36380 records). [2025-09-30T18:39:48.081764] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-30T18:39:48.260390] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-30T18:39:48.437848] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T18:39:48.550588] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-30T18:39:48.550727] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-30T18:39:48.551467] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-30T18:39:48.551615] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-30T18:39:48.552553] [DEBUG] [LOCAL ] ETW: Trimmed 36380 records to 25073 (keeping 200 days of data) [2025-09-30T18:39:48.738131] [DEBUG] [LOCAL ] ETW: Primary data saved (25073 records). [2025-09-30T18:39:48.738312] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-30T18:39:48.738421] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 38.5s. Estimated remaining: 3h 21m 55s. Rate: 7.9 symbols/min [2025-09-30T18:39:48.929103] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:48.944055] [DEBUG] [LOCAL ] EVF: Loaded 9377 existing records from primary storage. [2025-09-30T18:39:48.944301] [INFO ] [MAIN ] EVF: Loaded 9377 existing records. [2025-09-30T18:39:49.059195] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-30T18:39:49.147462] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:49.147708] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-30T18:39:49.147776] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-30T18:39:49.147976] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-30T18:39:49.148035] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-30T18:39:49.576501] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:49.570181] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:39:49.854329] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-30T18:39:50.155504] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:39:50.654341] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-30T18:39:50.764357] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T18:39:51.454325] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-30T18:39:51.688074] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:39:52.254314] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-30T18:39:52.652180] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:39:53.054388] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-30T18:39:53.385955] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T18:39:53.538295] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T18:39:53.854369] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-30T18:39:54.654364] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-30T18:39:54.906804] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T18:39:55.454336] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-30T18:39:55.776171] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:39:56.254381] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-30T18:39:56.401606] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T18:39:57.015458] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:39:57.054357] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-30T18:39:57.854386] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-30T18:39:58.142346] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:39:58.654414] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-30T18:39:59.241815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:39:59.303714] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:39:59.454374] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-30T18:40:00.254399] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-30T18:40:00.513575] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:40:01.054398] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-30T18:40:01.480975] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:40:01.854380] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-30T18:40:02.471551] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:40:02.656669] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-30T18:40:02.659431] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T18:40:03.454357] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-30T18:40:04.254329] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-30T18:40:04.394792] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:40:04.602672] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:40:04.612935] [INFO ] [REMOTE ] EVEX: Full fetch complete (41843 records). [2025-09-30T18:40:04.613074] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-30T18:40:05.027283] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-30T18:40:05.027454] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-30T18:40:05.028515] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-30T18:40:05.028671] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-30T18:40:05.042890] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:40:05.043521] [DEBUG] [LOCAL ] EVEX: Trimmed 41843 records to 30362 (keeping 200 days of data) [2025-09-30T18:40:05.048534] [INFO ] [REMOTE ] EVC: Full fetch complete (30484 records). [2025-09-30T18:40:05.049027] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-30T18:40:05.061461] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-30T18:40:05.587224] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-30T18:40:05.587919] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-30T18:40:05.588880] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-30T18:40:05.588969] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-30T18:40:05.592618] [DEBUG] [LOCAL ] EVC: Trimmed 30484 records to 18717 (keeping 200 days of data) [2025-09-30T18:40:05.765039] [DEBUG] [LOCAL ] EVEX: Primary data saved (30362 records). [2025-09-30T18:40:05.766283] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-30T18:40:05.766847] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVEX took 25.4s. Estimated remaining: 3h 22m 7s. Rate: 7.8 symbols/min [2025-09-30T18:40:05.856525] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-30T18:40:05.981051] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:05.982483] [DEBUG] [LOCAL ] EVG: No existing data file found in primary storage. [2025-09-30T18:40:05.983381] [WARN ] [MAIN ] EVG: No existing data found, performing full refresh instead. [2025-09-30T18:40:05.984334] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-30T18:40:05.985171] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-30T18:40:05.986783] [DEBUG] [LOCAL ] EVG: No primary data file found to delete. [2025-09-30T18:40:05.987534] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-30T18:40:06.116531] [DEBUG] [LOCAL ] EVC: Primary data saved (18717 records). [2025-09-30T18:40:06.132347] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-30T18:40:06.132494] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 28.0s. Estimated remaining: 3h 21m 44s. Rate: 7.9 symbols/min [2025-09-30T18:40:06.337588] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:40:06.607666] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:06.631233] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:06.664304] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-30T18:40:06.687200] [DEBUG] [LOCAL ] EVH: Loaded 49370 existing records from primary storage. [2025-09-30T18:40:06.687631] [INFO ] [MAIN ] EVH: Loaded 49370 existing records. [2025-09-30T18:40:06.907611] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:06.907914] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-30T18:40:06.907975] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-30T18:40:06.910149] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-30T18:40:06.910212] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-30T18:40:07.285086] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:40:07.378251] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:07.451119] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T18:40:07.454310] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-30T18:40:08.157176] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:40:08.254391] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-30T18:40:09.054398] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-30T18:40:09.640807] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:40:09.854413] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-30T18:40:10.172722] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T18:40:10.344772] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:40:10.654370] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-30T18:40:11.454390] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-30T18:40:11.721576] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T18:40:12.067845] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T18:40:12.254424] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-30T18:40:12.957198] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T18:40:13.054368] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-30T18:40:13.731523] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:40:13.854365] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-30T18:40:14.654372] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-30T18:40:14.783300] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:40:14.788302] [INFO ] [REMOTE ] ETY: Full fetch complete (34172 records). [2025-09-30T18:40:14.788453] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-30T18:40:15.200880] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-30T18:40:15.200969] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-30T18:40:15.201596] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-30T18:40:15.201664] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-30T18:40:15.202613] [DEBUG] [LOCAL ] ETY: Trimmed 34172 records to 22683 (keeping 200 days of data) [2025-09-30T18:40:15.373596] [DEBUG] [LOCAL ] ETY: Primary data saved (22683 records). [2025-09-30T18:40:15.373810] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-30T18:40:15.373932] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. ETY took 42.8s. Estimated remaining: 3h 21m 40s. Rate: 7.9 symbols/min [2025-09-30T18:40:15.454672] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-30T18:40:15.571695] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:15.578680] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:40:15.592555] [DEBUG] [LOCAL ] EVN: Loaded 11135 existing records from primary storage. [2025-09-30T18:40:15.592844] [INFO ] [MAIN ] EVN: Loaded 11135 existing records. [2025-09-30T18:40:15.788473] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:15.788731] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-30T18:40:15.788785] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-30T18:40:15.789516] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-30T18:40:15.789578] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-30T18:40:16.171879] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:16.254365] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-30T18:40:16.929928] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T18:40:17.054362] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-30T18:40:17.107944] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T18:40:17.748095] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T18:40:17.854382] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-30T18:40:18.654374] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-30T18:40:18.709369] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T18:40:19.163830] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T18:40:19.454396] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-30T18:40:20.230256] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T18:40:20.232908] [INFO ] [REMOTE ] EVG: Full fetch complete (8109 records). [2025-09-30T18:40:20.233009] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-30T18:40:20.263850] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-30T18:40:20.660913] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-30T18:40:20.661013] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-30T18:40:20.661242] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-30T18:40:20.661303] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-30T18:40:20.661814] [DEBUG] [LOCAL ] EVG: Trimmed 8109 records to 5828 (keeping 200 days of data) [2025-09-30T18:40:20.701075] [DEBUG] [LOCAL ] EVG: Primary data saved (5828 records). [2025-09-30T18:40:20.701232] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-30T18:40:20.701317] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 14.9s. Estimated remaining: 3h 21m 28s. Rate: 7.9 symbols/min [2025-09-30T18:40:20.895218] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:20.943504] [DEBUG] [LOCAL ] EVR: Loaded 35058 existing records from primary storage. [2025-09-30T18:40:20.943822] [INFO ] [MAIN ] EVR: Loaded 35058 existing records. [2025-09-30T18:40:21.057829] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-30T18:40:21.149799] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:21.150034] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-30T18:40:21.150085] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-30T18:40:21.151218] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-30T18:40:21.151282] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-30T18:40:21.504209] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T18:40:21.587271] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:21.742876] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T18:40:21.854391] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-30T18:40:22.654349] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-30T18:40:23.385159] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:40:23.454343] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-30T18:40:24.254351] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-30T18:40:24.354540] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:40:24.357689] [INFO ] [REMOTE ] EVF: Full fetch complete (12158 records). [2025-09-30T18:40:24.357799] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-30T18:40:24.494104] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T18:40:24.787947] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-30T18:40:24.788065] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-30T18:40:24.788403] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-30T18:40:24.788463] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-30T18:40:24.789038] [DEBUG] [LOCAL ] EVF: Trimmed 12158 records to 9402 (keeping 200 days of data) [2025-09-30T18:40:24.848815] [DEBUG] [LOCAL ] EVF: Primary data saved (9402 records). [2025-09-30T18:40:24.848955] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-30T18:40:24.849040] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVF took 36.1s. Estimated remaining: 3h 21m 13s. Rate: 7.9 symbols/min [2025-09-30T18:40:25.043123] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:25.055192] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T18:40:25.054556] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-30T18:40:25.077331] [DEBUG] [LOCAL ] EVT: Loaded 16958 existing records from primary storage. [2025-09-30T18:40:25.077583] [INFO ] [MAIN ] EVT: Loaded 16958 existing records. [2025-09-30T18:40:25.275675] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:25.275912] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-30T18:40:25.275963] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-30T18:40:25.276627] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-30T18:40:25.276724] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-30T18:40:25.644431] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:25.854365] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-30T18:40:26.654506] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-30T18:40:26.716311] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:40:26.762185] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:40:27.454362] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-30T18:40:27.684770] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T18:40:28.254368] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-30T18:40:28.947667] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:40:29.054422] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-30T18:40:29.273067] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:40:29.854359] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-30T18:40:29.921323] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T18:40:30.659203] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-30T18:40:30.661434] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:40:31.454363] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-30T18:40:32.254402] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-30T18:40:32.305034] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:40:32.448041] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T18:40:33.054447] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-30T18:40:33.864733] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-30T18:40:33.870943] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:40:34.613922] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:40:34.654338] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-30T18:40:34.756524] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:40:35.149496] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:40:35.454411] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-30T18:40:36.254379] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-30T18:40:36.457986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:40:37.054386] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-30T18:40:37.854346] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-30T18:40:37.894190] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:40:38.516752] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T18:40:38.640936] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:40:38.654345] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-30T18:40:39.454402] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-30T18:40:40.254345] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-30T18:40:40.339693] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:40:40.810802] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T18:40:41.054328] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-30T18:40:41.096075] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:40:41.854380] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-30T18:40:42.576417] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:40:42.654411] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-30T18:40:43.454375] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-30T18:40:43.603536] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:40:43.616373] [INFO ] [REMOTE ] EVH: Full fetch complete (71796 records). [2025-09-30T18:40:43.616530] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-30T18:40:43.771492] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:40:44.095737] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-30T18:40:44.095836] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-30T18:40:44.096832] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-30T18:40:44.096904] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-30T18:40:44.098807] [DEBUG] [LOCAL ] EVH: Trimmed 71796 records to 49371 (keeping 200 days of data) [2025-09-30T18:40:44.300952] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-30T18:40:44.447478] [DEBUG] [LOCAL ] EVH: Primary data saved (49371 records). [2025-09-30T18:40:44.447623] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-30T18:40:44.447762] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVH took 38.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-09-30T18:40:44.643437] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:44.672161] [DEBUG] [LOCAL ] EVTC: Loaded 26254 existing records from primary storage. [2025-09-30T18:40:44.672712] [INFO ] [MAIN ] EVTC: Loaded 26254 existing records. [2025-09-30T18:40:44.863410] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:40:44.895831] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:44.896046] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-30T18:40:44.896096] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-30T18:40:44.896366] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-30T18:40:44.896438] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-30T18:40:45.068436] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-30T18:40:45.310264] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:45.529414] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:40:45.854407] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-30T18:40:46.654377] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-30T18:40:46.758028] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:40:46.938119] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T18:40:46.941732] [INFO ] [REMOTE ] EVN: Full fetch complete (17565 records). [2025-09-30T18:40:46.941849] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-30T18:40:46.942365] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:40:46.942452] [FATAL] [MAIN ] EVN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:40:46.942502] [WARN ] [MAIN ] EVN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:40:46.942574] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-30T18:40:46.942668] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-30T18:40:46.942734] [INFO ] [LOCAL ] EVN: Starting deletion of derivative data. [2025-09-30T18:40:46.943009] [DEBUG] [LOCAL ] EVN: Deleted derivative data file. [2025-09-30T18:40:46.943106] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVN took 31.6s. Estimated remaining: 3h 21m 11s. Rate: 7.9 symbols/min [2025-09-30T18:40:47.135709] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:47.179461] [DEBUG] [LOCAL ] EVTL: Loaded 37802 existing records from primary storage. [2025-09-30T18:40:47.179848] [INFO ] [MAIN ] EVTL: Loaded 37802 existing records. [2025-09-30T18:40:47.381004] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:47.381217] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-30T18:40:47.381265] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-30T18:40:47.382350] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-30T18:40:47.382415] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-30T18:40:47.459494] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-30T18:40:47.827975] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:47.851320] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:40:48.254424] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-30T18:40:49.044243] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:40:49.054311] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-30T18:40:49.204921] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T18:40:49.854369] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-30T18:40:50.131110] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:40:50.654362] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-30T18:40:51.190588] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:40:51.454396] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-30T18:40:51.795812] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:40:52.220864] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T18:40:52.254319] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-30T18:40:52.982479] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:40:53.054405] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-30T18:40:53.854365] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-30T18:40:54.543566] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:40:54.550574] [INFO ] [REMOTE ] EVR: Full fetch complete (50768 records). [2025-09-30T18:40:54.550746] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-30T18:40:54.661750] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-30T18:40:54.765613] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:40:55.002831] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-30T18:40:55.002929] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-30T18:40:55.003683] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-30T18:40:55.003765] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-30T18:40:55.005166] [DEBUG] [LOCAL ] EVR: Trimmed 50768 records to 35004 (keeping 200 days of data) [2025-09-30T18:40:55.238964] [DEBUG] [LOCAL ] EVR: Primary data saved (35004 records). [2025-09-30T18:40:55.239109] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-30T18:40:55.240385] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 34.5s. Estimated remaining: 3h 21m 5s. Rate: 7.9 symbols/min [2025-09-30T18:40:55.454564] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:55.454731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-30T18:40:55.484612] [DEBUG] [LOCAL ] EVTR: Loaded 23510 existing records from primary storage. [2025-09-30T18:40:55.484961] [INFO ] [MAIN ] EVTR: Loaded 23510 existing records. [2025-09-30T18:40:55.689881] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:55.690220] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-30T18:40:55.690298] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-30T18:40:55.696531] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-30T18:40:55.696627] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-30T18:40:55.756988] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:40:56.105262] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:56.254395] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-30T18:40:57.054390] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-30T18:40:57.179692] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:40:57.221131] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:40:57.854360] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-30T18:40:57.922230] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:40:57.925819] [INFO ] [REMOTE ] EVT: Full fetch complete (25190 records). [2025-09-30T18:40:57.925897] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-30T18:40:57.926337] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:40:57.926470] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:40:57.926540] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:40:57.926612] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-30T18:40:57.926718] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-30T18:40:57.926806] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-09-30T18:40:57.927046] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-09-30T18:40:57.927155] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 33.1s. Estimated remaining: 3h 20m 48s. Rate: 7.9 symbols/min [2025-09-30T18:40:58.124086] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:58.182991] [DEBUG] [LOCAL ] EW: Loaded 53397 existing records from primary storage. [2025-09-30T18:40:58.183454] [INFO ] [MAIN ] EW: Loaded 53397 existing records. [2025-09-30T18:40:58.382317] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:58.382606] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-30T18:40:58.382693] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-30T18:40:58.384111] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-30T18:40:58.384175] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-30T18:40:58.659448] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-30T18:40:58.777567] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:59.034560] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T18:40:59.454358] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-30T18:40:59.887050] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T18:41:00.254402] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-30T18:41:00.899452] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:41:01.054407] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-30T18:41:01.854330] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-30T18:41:02.097093] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:41:02.136799] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:41:02.654382] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-30T18:41:03.321150] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:41:03.454354] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-30T18:41:03.715622] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:41:04.254360] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-30T18:41:04.726804] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:41:05.054343] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-30T18:41:05.270607] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:41:05.854368] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-30T18:41:06.475686] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T18:41:06.654373] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-30T18:41:07.077875] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T18:41:07.454351] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-30T18:41:07.764415] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:41:08.254338] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-30T18:41:08.502314] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:41:09.054389] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-30T18:41:09.347852] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:41:09.854356] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-30T18:41:10.193979] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T18:41:10.654359] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-30T18:41:11.197592] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:41:11.454352] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-30T18:41:11.726777] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:41:12.254394] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-30T18:41:13.054378] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-30T18:41:13.319122] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:41:13.854434] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-30T18:41:14.291757] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:41:14.290796] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:41:14.306907] [INFO ] [REMOTE ] EVTC: Full fetch complete (37870 records). [2025-09-30T18:41:14.307510] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-30T18:41:14.661463] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-30T18:41:14.703546] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-30T18:41:14.703633] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-30T18:41:14.704384] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-30T18:41:14.704453] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-30T18:41:14.705548] [DEBUG] [LOCAL ] EVTC: Trimmed 37870 records to 26224 (keeping 200 days of data) [2025-09-30T18:41:14.874577] [DEBUG] [LOCAL ] EVTC: Primary data saved (26224 records). [2025-09-30T18:41:14.874776] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-30T18:41:14.874910] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 30.4s. Estimated remaining: 3h 20m 58s. Rate: 7.8 symbols/min [2025-09-30T18:41:15.067140] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:15.107573] [DEBUG] [LOCAL ] EXG: Loaded 34119 existing records from primary storage. [2025-09-30T18:41:15.107920] [INFO ] [MAIN ] EXG: Loaded 34119 existing records. [2025-09-30T18:41:15.313629] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:15.313939] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-30T18:41:15.314069] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-30T18:41:15.325385] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-30T18:41:15.345257] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-30T18:41:15.393272] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:41:15.471136] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-30T18:41:15.764243] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:15.955269] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:41:16.254401] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-30T18:41:17.012397] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:41:17.054347] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-30T18:41:17.854398] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-30T18:41:18.064335] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:41:18.654336] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-30T18:41:18.743678] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:41:18.910042] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:41:19.454382] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-30T18:41:20.254388] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-30T18:41:20.463910] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:41:20.525225] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:41:20.532282] [INFO ] [REMOTE ] EVTR: Full fetch complete (32102 records). [2025-09-30T18:41:20.532399] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-30T18:41:20.533056] [FATAL] [VALIDATOR ] EVTR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:41:20.533146] [FATAL] [MAIN ] EVTR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:41:20.533190] [WARN ] [MAIN ] EVTR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:41:20.533232] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-30T18:41:20.533293] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-09-30T18:41:20.533331] [INFO ] [LOCAL ] EVTR: Starting deletion of derivative data. [2025-09-30T18:41:20.533522] [DEBUG] [LOCAL ] EVTR: Deleted derivative data file. [2025-09-30T18:41:20.533632] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTR took 25.3s. Estimated remaining: 3h 20m 47s. Rate: 7.8 symbols/min [2025-09-30T18:41:20.737174] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:20.804829] [DEBUG] [LOCAL ] EXK: Loaded 53126 existing records from primary storage. [2025-09-30T18:41:20.805236] [INFO ] [MAIN ] EXK: Loaded 53126 existing records. [2025-09-30T18:41:21.024450] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:21.024713] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-30T18:41:21.024771] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-30T18:41:21.026155] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-30T18:41:21.026226] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-30T18:41:21.062006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-30T18:41:21.434520] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:21.661515] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:41:21.854362] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-30T18:41:22.654378] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-30T18:41:22.832389] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:41:23.166834] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:41:23.454364] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-30T18:41:24.156063] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:41:24.254371] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-30T18:41:25.054356] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-30T18:41:25.265563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:41:25.309163] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T18:41:25.854347] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-30T18:41:26.654332] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-30T18:41:26.706149] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:41:27.374888] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T18:41:27.454403] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-30T18:41:28.254383] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-30T18:41:28.613142] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:41:28.760767] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:41:28.771974] [INFO ] [REMOTE ] EVTL: Full fetch complete (51536 records). [2025-09-30T18:41:28.772206] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-30T18:41:29.059619] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-30T18:41:29.192294] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-30T18:41:29.192375] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-30T18:41:29.193091] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-30T18:41:29.193156] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-30T18:41:29.194386] [DEBUG] [LOCAL ] EVTL: Trimmed 51536 records to 38020 (keeping 200 days of data) [2025-09-30T18:41:29.424494] [DEBUG] [LOCAL ] EVTL: Primary data saved (38020 records). [2025-09-30T18:41:29.424671] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-30T18:41:29.424780] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTL took 42.5s. Estimated remaining: 3h 20m 42s. Rate: 7.8 symbols/min [2025-09-30T18:41:29.617112] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:29.651340] [DEBUG] [LOCAL ] EXP: Loaded 29703 existing records from primary storage. [2025-09-30T18:41:29.651666] [INFO ] [MAIN ] EXP: Loaded 29703 existing records. [2025-09-30T18:41:29.851519] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:29.852028] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-30T18:41:29.852105] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-30T18:41:29.853260] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-30T18:41:29.853328] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-30T18:41:29.886799] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-30T18:41:30.262874] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:41:30.302877] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:30.593422] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:41:30.654369] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-30T18:41:31.454409] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-30T18:41:31.671000] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T18:41:32.006014] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:41:32.254371] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-30T18:41:32.913709] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T18:41:32.925449] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-09-30T18:41:32.925630] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-30T18:41:33.059487] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-30T18:41:33.372180] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-30T18:41:33.372264] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-30T18:41:33.373173] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-30T18:41:33.373239] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-30T18:41:33.374915] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 53400 (keeping 200 days of data) [2025-09-30T18:41:33.617601] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:41:33.768494] [DEBUG] [LOCAL ] EW: Primary data saved (53400 records). [2025-09-30T18:41:33.768676] [INFO ] [MAIN ] EW: Full history saved. [2025-09-30T18:41:33.768800] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 35.8s. Estimated remaining: 3h 20m 28s. Rate: 7.9 symbols/min [2025-09-30T18:41:33.854379] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-30T18:41:34.625995] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:41:34.654380] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-30T18:41:35.123205] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:41:35.454404] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-30T18:41:36.254385] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-30T18:41:36.463349] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:41:36.672375] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T18:41:37.054422] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-30T18:41:37.488702] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:41:37.854448] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-30T18:41:38.654446] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-30T18:41:38.849084] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:41:38.902587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:41:39.454365] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-30T18:41:39.762530] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:41:39.769984] [INFO ] [REMOTE ] EXG: Full fetch complete (49947 records). [2025-09-30T18:41:39.770132] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-30T18:41:40.198611] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-30T18:41:40.198733] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-30T18:41:40.199520] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-30T18:41:40.199666] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-30T18:41:40.200979] [DEBUG] [LOCAL ] EXG: Trimmed 49947 records to 34116 (keeping 200 days of data) [2025-09-30T18:41:40.255876] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-30T18:41:40.424597] [DEBUG] [LOCAL ] EXG: Primary data saved (34116 records). [2025-09-30T18:41:40.424782] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-30T18:41:40.424874] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 25.5s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-09-30T18:41:40.945336] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:41:41.054352] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-30T18:41:41.706018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:41:41.854407] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-30T18:41:42.750670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:41:42.761582] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-30T18:41:43.114973] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:41:43.454415] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-30T18:41:44.558190] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T18:41:44.569984] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-30T18:41:44.641526] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T18:41:45.054431] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-30T18:41:46.217141] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:41:46.228952] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-30T18:41:46.410197] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:41:46.654387] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-30T18:41:47.962203] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:41:47.968941] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-30T18:41:48.287790] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T18:41:48.299576] [INFO ] [REMOTE ] EXK: Full fetch complete (76513 records). [2025-09-30T18:41:48.299774] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-30T18:41:48.724262] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-30T18:41:48.724358] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-30T18:41:48.725380] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-30T18:41:48.725466] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-30T18:41:48.727275] [DEBUG] [LOCAL ] EXK: Trimmed 76513 records to 53127 (keeping 200 days of data) [2025-09-30T18:41:49.059376] [DEBUG] [LOCAL ] EXK: Primary data saved (53127 records). [2025-09-30T18:41:49.059515] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-30T18:41:49.061053] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXK took 28.5s. Estimated remaining: 3h 20m 12s. Rate: 7.9 symbols/min [2025-09-30T18:41:49.300849] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:41:49.306911] [INFO ] [REMOTE ] EXP: Full fetch complete (42914 records). [2025-09-30T18:41:49.307008] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-30T18:41:49.724985] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-30T18:41:49.725112] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-30T18:41:49.725838] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-30T18:41:49.725911] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-30T18:41:49.727555] [DEBUG] [LOCAL ] EXP: Trimmed 42914 records to 29652 (keeping 200 days of data) [2025-09-30T18:41:49.926282] [DEBUG] [LOCAL ] EXP: Primary data saved (29652 records). [2025-09-30T18:41:49.926436] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-30T18:41:49.926608] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXP took 20.5s. Estimated remaining: 3h 19m 51s. Rate: 7.9 symbols/min [2025-09-30T18:41:50.564940] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.737887] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.741459] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.763103] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.845131] [DEBUG] [LOCAL ] EXR: Loaded 45310 existing records from primary storage. [2025-09-30T18:41:50.858210] [INFO ] [MAIN ] EXR: Loaded 45310 existing records. [2025-09-30T18:41:50.917423] [DEBUG] [LOCAL ] FAF: Loaded 41799 existing records from primary storage. [2025-09-30T18:41:50.987605] [INFO ] [MAIN ] FAF: Loaded 41799 existing records. [2025-09-30T18:41:51.019410] [DEBUG] [LOCAL ] EXPD: Loaded 48037 existing records from primary storage. [2025-09-30T18:41:51.055910] [INFO ] [MAIN ] EXPD: Loaded 48037 existing records. [2025-09-30T18:41:51.167789] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-30T18:41:51.204450] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-30T18:41:51.462339] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.504904] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.577732] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.571728] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-30T18:41:51.588339] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.642147] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-30T18:41:51.621871] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-30T18:41:51.676054] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-30T18:41:51.679461] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.679821] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.690700] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-30T18:41:51.695986] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-30T18:41:51.713873] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-30T18:41:51.724165] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-30T18:41:51.778747] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-30T18:41:52.002022] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:52.044889] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-30T18:41:52.088197] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-30T18:41:52.152115] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-30T18:41:52.218094] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-30T18:41:53.092712] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.170832] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-30T18:41:53.300514] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.342218] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-30T18:41:53.389771] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.415756] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-30T18:41:53.523151] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.523568] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-30T18:41:54.947467] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:41:54.958267] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-30T18:41:54.983345] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:41:55.005619] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-30T18:41:55.017455] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:41:55.026852] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-30T18:41:56.079753] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-30T18:41:56.091668] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-30T18:41:56.330194] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:41:56.337599] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-30T18:41:56.562139] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:41:56.572385] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-30T18:41:56.648067] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:41:56.658123] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-30T18:41:57.757114] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T18:41:57.764505] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-30T18:41:57.849845] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T18:41:57.858617] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-30T18:41:58.250825] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-30T18:41:58.290638] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:41:58.654368] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-30T18:41:59.171517] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:41:59.454377] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-30T18:41:59.525628] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:42:00.200904] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:42:00.254368] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-30T18:42:01.054406] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-30T18:42:01.854402] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-30T18:42:01.931358] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-30T18:42:01.973557] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:42:02.654352] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-30T18:42:02.822999] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:42:03.454330] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-30T18:42:03.642042] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:42:04.254394] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-30T18:42:04.957322] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T18:42:05.054339] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-30T18:42:05.095054] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-30T18:42:05.854351] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-30T18:42:05.913097] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:42:06.654419] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-30T18:42:06.810330] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:42:07.454374] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-30T18:42:07.965502] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:42:08.254397] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-30T18:42:08.304097] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T18:42:08.653811] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T18:42:09.054394] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-30T18:42:09.854335] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-30T18:42:09.949136] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:42:10.654371] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-30T18:42:11.172502] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:42:11.454356] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-30T18:42:11.590232] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-30T18:42:12.060170] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:42:12.254362] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-30T18:42:13.054347] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-30T18:42:13.092549] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:42:13.718183] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:42:13.854384] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-30T18:42:14.654371] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-30T18:42:15.113546] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T18:42:15.122992] [INFO ] [REMOTE ] FAF: Full fetch complete (57596 records). [2025-09-30T18:42:15.123143] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-30T18:42:15.459726] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-30T18:42:15.490797] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-30T18:42:15.603118] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-30T18:42:15.603230] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-30T18:42:15.604167] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-30T18:42:15.604241] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-30T18:42:15.607441] [DEBUG] [LOCAL ] FAF: Trimmed 57596 records to 41733 (keeping 200 days of data) [2025-09-30T18:42:15.881424] [DEBUG] [LOCAL ] FAF: Primary data saved (41733 records). [2025-09-30T18:42:15.881589] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-30T18:42:15.881786] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 25.9s. Estimated remaining: 3h 20m 20s. Rate: 7.8 symbols/min [2025-09-30T18:42:16.066711] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:16.115907] [DEBUG] [LOCAL ] FBIN: Loaded 50319 existing records from primary storage. [2025-09-30T18:42:16.116265] [INFO ] [MAIN ] FBIN: Loaded 50319 existing records. [2025-09-30T18:42:16.267519] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-30T18:42:16.312814] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:16.314151] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-30T18:42:16.314320] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-30T18:42:16.316791] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-30T18:42:16.316897] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-30T18:42:16.519397] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:42:16.775819] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:16.804397] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:42:17.054361] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-30T18:42:17.854372] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-30T18:42:18.654452] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-30T18:42:19.006385] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:42:19.018686] [INFO ] [REMOTE ] EXPD: Full fetch complete (69287 records). [2025-09-30T18:42:19.018834] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-30T18:42:19.204798] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-30T18:42:19.461073] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-30T18:42:19.523808] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-30T18:42:19.523909] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-30T18:42:19.524800] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-30T18:42:19.524884] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-30T18:42:19.528831] [DEBUG] [LOCAL ] EXPD: Trimmed 69287 records to 47976 (keeping 200 days of data) [2025-09-30T18:42:19.688684] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:42:19.701183] [INFO ] [REMOTE ] EXR: Full fetch complete (65916 records). [2025-09-30T18:42:19.701841] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-30T18:42:20.238912] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-30T18:42:20.239276] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-30T18:42:20.240851] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-30T18:42:20.241519] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-30T18:42:20.247817] [DEBUG] [LOCAL ] EXR: Trimmed 65916 records to 45275 (keeping 200 days of data) [2025-09-30T18:42:20.386759] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:42:20.399263] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-30T18:42:20.486697] [DEBUG] [LOCAL ] EXPD: Primary data saved (47976 records). [2025-09-30T18:42:20.487624] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-30T18:42:20.490078] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXPD took 30.6s. Estimated remaining: 3h 20m 6s. Rate: 7.8 symbols/min [2025-09-30T18:42:20.687391] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:20.688433] [DEBUG] [LOCAL ] FBK: No existing data file found in primary storage. [2025-09-30T18:42:20.688509] [WARN ] [MAIN ] FBK: No existing data found, performing full refresh instead. [2025-09-30T18:42:20.692705] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-30T18:42:20.695155] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-30T18:42:20.695272] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-30T18:42:20.695310] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-30T18:42:21.261805] [DEBUG] [LOCAL ] EXR: Primary data saved (45275 records). [2025-09-30T18:42:21.266223] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-30T18:42:21.265971] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:21.266742] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-30T18:42:21.266425] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXR took 31.3s. Estimated remaining: 3h 19m 45s. Rate: 7.8 symbols/min [2025-09-30T18:42:21.458025] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:21.458260] [DEBUG] [LOCAL ] FBP: No existing data file found in primary storage. [2025-09-30T18:42:21.458314] [WARN ] [MAIN ] FBP: No existing data found, performing full refresh instead. [2025-09-30T18:42:21.458486] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-30T18:42:21.458530] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-30T18:42:21.458572] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-30T18:42:21.458605] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-30T18:42:21.858407] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:21.858835] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-30T18:42:21.968125] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T18:42:22.074443] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-30T18:42:22.405263] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:42:22.654365] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-30T18:42:23.370282] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T18:42:23.454314] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-30T18:42:23.634394] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:42:24.069818] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:42:24.254357] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-30T18:42:25.054363] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-30T18:42:25.854380] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-30T18:42:25.936007] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:42:26.654377] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-30T18:42:27.274842] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T18:42:27.454359] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-30T18:42:27.854765] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-09-30T18:42:27.867145] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-30T18:42:27.867324] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-30T18:42:28.273309] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-30T18:42:28.319316] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-30T18:42:28.319626] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-30T18:42:28.321256] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-30T18:42:28.321411] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-30T18:42:28.323828] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-30T18:42:28.459334] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:42:28.508991] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:42:28.760721] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-30T18:42:28.760900] [INFO ] [MAIN ] F: Full history saved. [2025-09-30T18:42:28.761474] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 38.8s. Estimated remaining: 3h 19m 37s. Rate: 7.9 symbols/min [2025-09-30T18:42:28.935572] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:28.973182] [DEBUG] [LOCAL ] FBRT: Loaded 34454 existing records from primary storage. [2025-09-30T18:42:28.973515] [INFO ] [MAIN ] FBRT: Loaded 34454 existing records. [2025-09-30T18:42:29.055250] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-30T18:42:29.160487] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:29.160887] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-30T18:42:29.160941] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-30T18:42:29.161721] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-30T18:42:29.161791] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-30T18:42:29.519146] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T18:42:29.564059] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:29.854387] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-30T18:42:30.576733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T18:42:30.654437] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-30T18:42:31.147746] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T18:42:31.454394] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-30T18:42:31.944922] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:42:32.254414] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-30T18:42:33.054364] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-30T18:42:33.446724] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:42:33.539663] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T18:42:33.854385] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-30T18:42:34.587498] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:42:34.654369] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-30T18:42:34.893728] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:42:35.454372] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-30T18:42:36.254329] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-30T18:42:36.358010] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:42:36.682777] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T18:42:37.054401] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-30T18:42:37.230480] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:42:37.854360] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-30T18:42:38.654407] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-30T18:42:38.873746] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:42:38.932810] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T18:42:39.454373] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-30T18:42:39.883961] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T18:42:40.254369] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-30T18:42:41.054410] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-30T18:42:41.163414] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T18:42:41.695172] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:42:41.700857] [INFO ] [REMOTE ] FBK: Full fetch complete (33422 records). [2025-09-30T18:42:41.700985] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-30T18:42:41.859507] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-30T18:42:42.093777] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-30T18:42:42.093934] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-30T18:42:42.094686] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-30T18:42:42.094851] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-30T18:42:42.095971] [DEBUG] [LOCAL ] FBK: Trimmed 33422 records to 25945 (keeping 200 days of data) [2025-09-30T18:42:42.240278] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:42:42.316705] [DEBUG] [LOCAL ] FBK: Primary data saved (25945 records). [2025-09-30T18:42:42.316861] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-30T18:42:42.316963] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBK took 21.8s. Estimated remaining: 3h 19m 41s. Rate: 7.8 symbols/min [2025-09-30T18:42:42.494541] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:42.511154] [DEBUG] [LOCAL ] FC: Loaded 15423 existing records from primary storage. [2025-09-30T18:42:42.511406] [INFO ] [MAIN ] FC: Loaded 15423 existing records. [2025-09-30T18:42:42.659478] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-30T18:42:42.746515] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:42.746931] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-30T18:42:42.746987] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-30T18:42:42.747563] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-30T18:42:42.747626] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-30T18:42:43.138343] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:43.383225] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:42:43.454338] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-30T18:42:43.899003] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T18:42:44.137896] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T18:42:44.254397] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-30T18:42:45.054417] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-30T18:42:45.758372] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:42:45.854381] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-30T18:42:46.525157] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:42:46.654362] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-30T18:42:47.246326] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T18:42:47.454425] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-30T18:42:48.254388] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-30T18:42:48.418480] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:42:48.430128] [INFO ] [REMOTE ] FBIN: Full fetch complete (72572 records). [2025-09-30T18:42:48.430308] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-30T18:42:48.883359] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-30T18:42:48.883558] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-30T18:42:48.884619] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-30T18:42:48.884818] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-30T18:42:48.906521] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:42:48.916116] [DEBUG] [LOCAL ] FBIN: Trimmed 72572 records to 50325 (keeping 200 days of data) [2025-09-30T18:42:49.028458] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:42:49.054436] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-30T18:42:49.275926] [DEBUG] [LOCAL ] FBIN: Primary data saved (50325 records). [2025-09-30T18:42:49.276088] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-30T18:42:49.276202] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 33.4s. Estimated remaining: 3h 19m 32s. Rate: 7.8 symbols/min [2025-09-30T18:42:49.473210] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:49.515324] [DEBUG] [LOCAL ] FCF: Loaded 39462 existing records from primary storage. [2025-09-30T18:42:49.515666] [INFO ] [MAIN ] FCF: Loaded 39462 existing records. [2025-09-30T18:42:49.709993] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:49.710203] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-30T18:42:49.710252] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-30T18:42:49.711483] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-30T18:42:49.711546] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-30T18:42:49.857228] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-30T18:42:50.058604] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:42:50.135259] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:50.654436] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-30T18:42:51.454382] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-30T18:42:51.638824] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:42:52.041910] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T18:42:52.254399] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-30T18:42:52.297844] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:42:53.054390] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-30T18:42:53.624230] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T18:42:53.854426] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-30T18:42:54.587780] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:42:54.663006] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-30T18:42:54.665617] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:42:55.454382] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-30T18:42:56.151788] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:42:56.254402] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-30T18:42:57.041812] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:42:57.052031] [INFO ] [REMOTE ] FBP: Full fetch complete (66378 records). [2025-09-30T18:42:57.052301] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-30T18:42:57.065020] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-30T18:42:57.503792] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-30T18:42:57.503903] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-30T18:42:57.505071] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-30T18:42:57.505150] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-30T18:42:57.507897] [DEBUG] [LOCAL ] FBP: Trimmed 66378 records to 46045 (keeping 200 days of data) [2025-09-30T18:42:57.778214] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:42:57.793466] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:42:57.857689] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-30T18:42:57.871841] [DEBUG] [LOCAL ] FBP: Primary data saved (46045 records). [2025-09-30T18:42:57.872025] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-30T18:42:57.872134] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 36.6s. Estimated remaining: 3h 19m 26s. Rate: 7.8 symbols/min [2025-09-30T18:42:58.100920] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:58.101161] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-09-30T18:42:58.101215] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-09-30T18:42:58.101361] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-30T18:42:58.101420] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-30T18:42:58.101467] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-30T18:42:58.101507] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-30T18:42:58.510429] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:58.654407] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-30T18:42:58.969496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:42:58.977189] [INFO ] [REMOTE ] FBRT: Full fetch complete (48751 records). [2025-09-30T18:42:58.977359] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-30T18:42:59.418881] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-30T18:42:59.419004] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-30T18:42:59.419735] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-30T18:42:59.419798] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-30T18:42:59.421040] [DEBUG] [LOCAL ] FBRT: Trimmed 48751 records to 34527 (keeping 200 days of data) [2025-09-30T18:42:59.484487] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-30T18:42:59.543750] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:42:59.672722] [DEBUG] [LOCAL ] FBRT: Primary data saved (34527 records). [2025-09-30T18:42:59.672898] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-30T18:42:59.673904] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 30.9s. Estimated remaining: 3h 19m 7s. Rate: 7.8 symbols/min [2025-09-30T18:42:59.854398] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:59.893684] [DEBUG] [LOCAL ] FCPT: Loaded 37247 existing records from primary storage. [2025-09-30T18:42:59.894027] [INFO ] [MAIN ] FCPT: Loaded 37247 existing records. [2025-09-30T18:43:00.086347] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:00.086590] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-30T18:43:00.086687] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-30T18:43:00.087803] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-30T18:43:00.087866] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-30T18:43:00.273506] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-30T18:43:00.464049] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:00.817527] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:43:01.054385] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-30T18:43:01.407236] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T18:43:01.854393] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-30T18:43:02.507575] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:43:02.654344] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-30T18:43:02.806487] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T18:43:03.454371] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-30T18:43:04.237246] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:43:04.254326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-30T18:43:04.502372] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:43:04.505961] [INFO ] [REMOTE ] FC: Full fetch complete (21644 records). [2025-09-30T18:43:04.506039] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-30T18:43:04.907013] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-30T18:43:04.907093] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-30T18:43:04.907628] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-30T18:43:04.907713] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-30T18:43:04.908367] [DEBUG] [LOCAL ] FC: Trimmed 21644 records to 15429 (keeping 200 days of data) [2025-09-30T18:43:05.005058] [DEBUG] [LOCAL ] FC: Primary data saved (15429 records). [2025-09-30T18:43:05.005212] [INFO ] [MAIN ] FC: Full history saved. [2025-09-30T18:43:05.005301] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 22.7s. Estimated remaining: 3h 18m 55s. Rate: 7.9 symbols/min [2025-09-30T18:43:05.061023] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-30T18:43:05.218779] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:05.218989] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-30T18:43:05.219066] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-30T18:43:05.219192] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-30T18:43:05.219235] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-30T18:43:05.219278] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-30T18:43:05.219312] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-30T18:43:05.611067] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:05.850422] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:43:05.859857] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-30T18:43:06.238832] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:43:06.530273] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T18:43:06.654382] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-30T18:43:07.454387] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-30T18:43:07.895307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T18:43:08.119412] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:43:08.254362] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-30T18:43:09.054377] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-30T18:43:09.562196] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:43:09.854407] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-30T18:43:10.049088] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:43:10.654347] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-30T18:43:11.146411] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T18:43:11.320011] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:43:11.454351] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-30T18:43:12.254372] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-30T18:43:12.638399] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T18:43:13.054375] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-30T18:43:13.651988] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:43:13.854384] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-30T18:43:14.495568] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:43:14.654355] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-30T18:43:15.198882] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:43:15.454354] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-30T18:43:15.680618] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:43:15.879276] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:43:16.254357] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-30T18:43:16.600345] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:43:17.054355] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-30T18:43:17.370627] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-30T18:43:17.854359] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-30T18:43:18.252625] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:43:18.654358] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-30T18:43:19.454373] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-30T18:43:20.113394] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T18:43:20.254356] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-30T18:43:20.655438] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-30T18:43:21.054360] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-30T18:43:21.266944] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:43:21.275303] [INFO ] [REMOTE ] FCF: Full fetch complete (58074 records). [2025-09-30T18:43:21.275424] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-30T18:43:21.495316] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T18:43:21.715768] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-30T18:43:21.715890] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-30T18:43:21.716775] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-30T18:43:21.716882] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-30T18:43:21.718553] [DEBUG] [LOCAL ] FCF: Trimmed 58074 records to 39428 (keeping 200 days of data) [2025-09-30T18:43:21.898770] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-30T18:43:21.971679] [DEBUG] [LOCAL ] FCF: Primary data saved (39428 records). [2025-09-30T18:43:21.971831] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-30T18:43:21.971935] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 32.7s. Estimated remaining: 3h 19m 5s. Rate: 7.8 symbols/min [2025-09-30T18:43:22.164880] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:22.182772] [DEBUG] [LOCAL ] FCT: Loaded 14519 existing records from primary storage. [2025-09-30T18:43:22.183017] [INFO ] [MAIN ] FCT: Loaded 14519 existing records. [2025-09-30T18:43:22.301464] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T18:43:22.379248] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:22.379491] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-30T18:43:22.379545] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-30T18:43:22.379851] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-30T18:43:22.379913] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-30T18:43:22.659508] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-30T18:43:22.772876] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:23.454380] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-30T18:43:23.962429] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:43:23.994478] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T18:43:23.995724] [INFO ] [REMOTE ] FCRX: Full fetch complete (1677 records). [2025-09-30T18:43:23.995828] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-30T18:43:23.996331] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:43:23.996435] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:43:23.996544] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:43:23.996628] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-30T18:43:23.996757] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-30T18:43:23.996813] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-30T18:43:23.996857] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-30T18:43:23.996923] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCRX took 19.0s. Estimated remaining: 3h 18m 47s. Rate: 7.8 symbols/min [2025-09-30T18:43:24.215954] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:24.254415] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-30T18:43:24.281950] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-30T18:43:24.282412] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-30T18:43:24.507365] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:24.507630] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-30T18:43:24.507723] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-30T18:43:24.509814] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-30T18:43:24.509892] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-30T18:43:24.895289] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:25.054318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-30T18:43:25.115744] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:43:25.854383] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-30T18:43:26.645584] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T18:43:26.654317] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-30T18:43:27.097512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T18:43:27.454365] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-30T18:43:27.918793] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T18:43:28.254360] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-30T18:43:29.054370] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-30T18:43:29.082787] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:43:29.392095] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T18:43:29.854368] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-30T18:43:30.654330] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-30T18:43:31.081376] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T18:43:31.428612] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:43:31.454327] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-30T18:43:31.956265] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:43:31.961688] [INFO ] [REMOTE ] FCN: Full fetch complete (35656 records). [2025-09-30T18:43:31.961816] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-30T18:43:32.259501] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-30T18:43:32.383662] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-30T18:43:32.383760] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-30T18:43:32.384468] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-30T18:43:32.384539] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-30T18:43:32.385637] [DEBUG] [LOCAL ] FCN: Trimmed 35656 records to 26000 (keeping 200 days of data) [2025-09-30T18:43:32.561542] [DEBUG] [LOCAL ] FCN: Primary data saved (26000 records). [2025-09-30T18:43:32.561741] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-30T18:43:32.561848] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCN took 34.7s. Estimated remaining: 3h 18m 41s. Rate: 7.8 symbols/min [2025-09-30T18:43:32.749842] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:32.783154] [DEBUG] [LOCAL ] FDP: Loaded 30255 existing records from primary storage. [2025-09-30T18:43:32.783505] [INFO ] [MAIN ] FDP: Loaded 30255 existing records. [2025-09-30T18:43:33.007979] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:33.009015] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-30T18:43:33.009097] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-30T18:43:33.010272] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:43:33.017861] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-30T18:43:33.018369] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-30T18:43:33.063817] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-30T18:43:33.398413] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:33.854404] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-30T18:43:34.228917] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:43:34.459775] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:43:34.654376] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-30T18:43:35.072893] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:43:35.454383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-30T18:43:36.254397] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-30T18:43:36.788697] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:43:36.893331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-30T18:43:37.054362] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-30T18:43:37.114711] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T18:43:37.854342] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-30T18:43:38.046148] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:43:38.654332] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-30T18:43:38.819872] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:43:39.454415] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-30T18:43:40.254414] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-30T18:43:40.610777] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T18:43:40.722892] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:43:41.054367] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-30T18:43:41.795906] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:43:41.854395] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-30T18:43:41.976692] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T18:43:42.654377] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-30T18:43:42.964407] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T18:43:43.226294] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:43:43.454370] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-30T18:43:44.254363] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-30T18:43:45.054378] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-30T18:43:45.096388] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:43:45.105370] [INFO ] [REMOTE ] FCPT: Full fetch complete (53593 records). [2025-09-30T18:43:45.105494] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-30T18:43:45.514016] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-30T18:43:45.514112] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-30T18:43:45.515037] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-30T18:43:45.515112] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-30T18:43:45.516397] [DEBUG] [LOCAL ] FCPT: Trimmed 53593 records to 37298 (keeping 200 days of data) [2025-09-30T18:43:45.788406] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:43:45.817958] [DEBUG] [LOCAL ] FCPT: Primary data saved (37298 records). [2025-09-30T18:43:45.818125] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-30T18:43:45.818748] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 46.1s. Estimated remaining: 3h 18m 44s. Rate: 7.8 symbols/min [2025-09-30T18:43:45.859548] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-30T18:43:46.013733] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:46.042857] [DEBUG] [LOCAL ] FDS: Loaded 26449 existing records from primary storage. [2025-09-30T18:43:46.043166] [INFO ] [MAIN ] FDS: Loaded 26449 existing records. [2025-09-30T18:43:46.290186] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:46.290530] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-30T18:43:46.290732] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-30T18:43:46.291574] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-30T18:43:46.291637] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-30T18:43:46.620793] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:43:46.659444] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-30T18:43:46.720235] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:47.454333] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-30T18:43:47.529830] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:43:47.564727] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:43:48.254370] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-30T18:43:48.730207] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:43:49.054338] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-30T18:43:49.188788] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:43:49.854375] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-30T18:43:50.538228] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:43:50.654433] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-30T18:43:51.106848] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:43:51.454372] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-30T18:43:52.254329] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-30T18:43:52.300701] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:43:52.699314] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T18:43:53.054388] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-30T18:43:53.180190] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:43:53.854349] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-30T18:43:54.244240] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:43:54.654350] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-30T18:43:54.882789] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:43:54.886787] [INFO ] [REMOTE ] FCT: Full fetch complete (21043 records). [2025-09-30T18:43:54.886901] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-30T18:43:55.284085] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-30T18:43:55.284192] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-30T18:43:55.284692] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-30T18:43:55.284755] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-30T18:43:55.285832] [DEBUG] [LOCAL ] FCT: Trimmed 21043 records to 14501 (keeping 200 days of data) [2025-09-30T18:43:55.378874] [DEBUG] [LOCAL ] FCT: Primary data saved (14501 records). [2025-09-30T18:43:55.379051] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-30T18:43:55.379184] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 33.4s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-09-30T18:43:55.462218] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-30T18:43:55.577078] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:55.577309] [DEBUG] [LOCAL ] FDX: No existing data file found in primary storage. [2025-09-30T18:43:55.577368] [WARN ] [MAIN ] FDX: No existing data found, performing full refresh instead. [2025-09-30T18:43:55.577481] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-30T18:43:55.577523] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-30T18:43:55.577567] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-09-30T18:43:55.577600] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-30T18:43:55.984231] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:56.002485] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:43:56.254375] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-30T18:43:56.635729] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:43:57.054352] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-30T18:43:57.225298] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T18:43:57.854334] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-30T18:43:57.896021] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T18:43:58.654387] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-30T18:43:58.710785] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T18:43:59.454367] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-30T18:44:00.254361] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-30T18:44:00.732987] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:44:00.831051] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:44:00.837404] [INFO ] [REMOTE ] FDP: Full fetch complete (42776 records). [2025-09-30T18:44:00.837498] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-30T18:44:01.062750] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-30T18:44:01.257540] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-30T18:44:01.257691] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-30T18:44:01.258484] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-30T18:44:01.258550] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-30T18:44:01.259772] [DEBUG] [LOCAL ] FDP: Trimmed 42776 records to 30158 (keeping 200 days of data) [2025-09-30T18:44:01.473637] [DEBUG] [LOCAL ] FDP: Primary data saved (30158 records). [2025-09-30T18:44:01.473836] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-30T18:44:01.474465] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 28.9s. Estimated remaining: 3h 18m 29s. Rate: 7.8 symbols/min [2025-09-30T18:44:01.665637] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:01.726221] [DEBUG] [LOCAL ] FE: Loaded 53427 existing records from primary storage. [2025-09-30T18:44:01.726705] [INFO ] [MAIN ] FE: Loaded 53427 existing records. [2025-09-30T18:44:01.859449] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-30T18:44:01.935517] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:01.935876] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-30T18:44:01.936151] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-30T18:44:01.936755] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-30T18:44:01.936819] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-30T18:44:02.337606] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T18:44:02.372094] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:02.540021] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:44:02.654387] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-30T18:44:03.288877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:44:03.454370] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-30T18:44:04.254350] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-30T18:44:04.433424] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:44:04.499504] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:44:05.054358] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-30T18:44:05.854375] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-30T18:44:06.417595] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T18:44:06.661626] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-30T18:44:06.668022] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-30T18:44:06.679919] [INFO ] [REMOTE ] FCX: Full fetch complete (77350 records). [2025-09-30T18:44:06.680087] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-30T18:44:06.680990] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:44:06.681086] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:44:06.681138] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:44:06.681216] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-30T18:44:06.681310] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-09-30T18:44:06.681369] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-09-30T18:44:06.681740] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-09-30T18:44:06.681844] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 42.7s. Estimated remaining: 3h 18m 17s. Rate: 7.8 symbols/min [2025-09-30T18:44:06.865754] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:06.865956] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-30T18:44:06.865996] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-30T18:44:06.866110] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-30T18:44:06.866152] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-30T18:44:06.866195] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-30T18:44:06.866226] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-30T18:44:07.263856] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:07.442994] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:44:07.454308] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-30T18:44:07.974454] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T18:44:07.983063] [INFO ] [REMOTE ] FDS: Full fetch complete (37439 records). [2025-09-30T18:44:07.983208] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-30T18:44:08.259547] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-30T18:44:08.383397] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-30T18:44:08.383486] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-30T18:44:08.384104] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-30T18:44:08.384176] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-30T18:44:08.385373] [DEBUG] [LOCAL ] FDS: Trimmed 37439 records to 26508 (keeping 200 days of data) [2025-09-30T18:44:08.556356] [DEBUG] [LOCAL ] FDS: Primary data saved (26508 records). [2025-09-30T18:44:08.556495] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-30T18:44:08.556681] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 22.7s. Estimated remaining: 3h 17m 58s. Rate: 7.8 symbols/min [2025-09-30T18:44:08.731029] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:08.734311] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T18:44:08.795153] [DEBUG] [LOCAL ] FERG: Loaded 48889 existing records from primary storage. [2025-09-30T18:44:08.795602] [INFO ] [MAIN ] FERG: Loaded 48889 existing records. [2025-09-30T18:44:08.992059] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:08.992348] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-30T18:44:08.992531] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-30T18:44:08.993206] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-30T18:44:08.993270] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-30T18:44:09.059486] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-30T18:44:09.421306] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:09.423832] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:44:09.564424] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T18:44:09.854362] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-30T18:44:10.259864] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T18:44:10.654377] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-30T18:44:11.454354] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-30T18:44:11.967750] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T18:44:12.254368] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-30T18:44:12.400852] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:44:13.054377] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-30T18:44:13.789028] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:44:13.854318] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-30T18:44:14.654363] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-30T18:44:14.812002] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:44:14.997121] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T18:44:15.454358] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-30T18:44:15.935072] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T18:44:16.023334] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T18:44:16.254417] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-30T18:44:16.598990] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T18:44:17.054386] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-30T18:44:17.854354] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-30T18:44:18.654379] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-30T18:44:18.896552] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T18:44:19.130348] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:44:19.454325] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-30T18:44:19.570110] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:44:20.254385] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-30T18:44:21.054334] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-30T18:44:21.418784] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:44:21.854400] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-30T18:44:22.120030] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:44:22.654339] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-30T18:44:22.703554] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:44:23.454502] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-30T18:44:23.818258] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:44:23.821348] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T18:44:24.254335] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-30T18:44:24.369521] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:44:25.026054] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T18:44:25.027275] [INFO ] [REMOTE ] FENG: Full fetch complete (2254 records). [2025-09-30T18:44:25.027411] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-30T18:44:25.060571] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-30T18:44:25.232017] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:44:25.232227] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:44:25.232308] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:44:25.232393] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-30T18:44:25.232487] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-30T18:44:25.232561] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-30T18:44:25.232658] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-30T18:44:25.232806] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 18.6s. Estimated remaining: 3h 18m 8s. Rate: 7.8 symbols/min [2025-09-30T18:44:25.423982] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:25.443763] [DEBUG] [LOCAL ] FET: Loaded 12877 existing records from primary storage. [2025-09-30T18:44:25.444033] [INFO ] [MAIN ] FET: Loaded 12877 existing records. [2025-09-30T18:44:25.636389] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:25.636608] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-30T18:44:25.636683] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-30T18:44:25.637201] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-30T18:44:25.637276] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-30T18:44:25.859783] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-30T18:44:26.016632] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:26.654407] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-30T18:44:27.407667] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-30T18:44:27.452974] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:44:27.464095] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-30T18:44:28.254374] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-30T18:44:28.600280] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T18:44:29.054427] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-30T18:44:29.596008] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T18:44:29.854348] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-30T18:44:30.167448] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:44:30.277351] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:44:30.654360] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-30T18:44:31.454351] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-30T18:44:32.178378] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T18:44:32.254332] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-30T18:44:32.449042] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:44:33.054397] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-30T18:44:33.133855] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:44:33.854331] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-30T18:44:34.028741] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:44:34.042341] [INFO ] [REMOTE ] FE: Full fetch complete (77250 records). [2025-09-30T18:44:34.042548] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-30T18:44:34.209535] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:44:34.599973] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-30T18:44:34.600074] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-30T18:44:34.601136] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-30T18:44:34.601230] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-30T18:44:34.603033] [DEBUG] [LOCAL ] FE: Trimmed 77250 records to 53429 (keeping 200 days of data) [2025-09-30T18:44:34.661893] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-30T18:44:34.968607] [DEBUG] [LOCAL ] FE: Primary data saved (53429 records). [2025-09-30T18:44:34.968793] [INFO ] [MAIN ] FE: Full history saved. [2025-09-30T18:44:34.968893] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FE took 33.5s. Estimated remaining: 3h 18m 4s. Rate: 7.8 symbols/min [2025-09-30T18:44:35.152603] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:35.179474] [DEBUG] [LOCAL ] FF: Loaded 25233 existing records from primary storage. [2025-09-30T18:44:35.179816] [INFO ] [MAIN ] FF: Loaded 25233 existing records. [2025-09-30T18:44:35.374614] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:35.374899] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-30T18:44:35.375036] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-30T18:44:35.376886] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-30T18:44:35.376957] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-30T18:44:35.459504] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-30T18:44:35.810629] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:35.838468] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T18:44:36.256837] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-30T18:44:36.262381] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T18:44:36.607002] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:44:36.620053] [INFO ] [REMOTE ] FDX: Full fetch complete (74472 records). [2025-09-30T18:44:36.620209] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-30T18:44:37.046534] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-30T18:44:37.046637] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-30T18:44:37.047830] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-30T18:44:37.047909] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-30T18:44:37.049393] [DEBUG] [LOCAL ] FDX: Trimmed 74472 records to 51595 (keeping 200 days of data) [2025-09-30T18:44:37.108274] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-30T18:44:37.389513] [DEBUG] [LOCAL ] FDX: Primary data saved (51595 records). [2025-09-30T18:44:37.389742] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-30T18:44:37.389828] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 42.0s. Estimated remaining: 3h 17m 47s. Rate: 7.8 symbols/min [2025-09-30T18:44:37.597210] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:37.599909] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:44:37.600081] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-09-30T18:44:37.600293] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-09-30T18:44:37.606783] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-30T18:44:37.606867] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-30T18:44:37.606937] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-30T18:44:37.606978] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-30T18:44:37.859549] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-30T18:44:38.007815] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:38.118843] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:44:38.654351] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-30T18:44:38.803071] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:44:39.359942] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T18:44:39.454375] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-30T18:44:40.254389] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-30T18:44:40.288232] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:44:41.054358] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-30T18:44:41.345288] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:44:41.656107] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:44:41.854360] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-30T18:44:42.653284] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:44:42.655063] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-30T18:44:43.454370] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-30T18:44:43.680678] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:44:44.254413] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-30T18:44:44.426624] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:44:45.054367] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-30T18:44:45.820901] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T18:44:45.854311] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-30T18:44:46.184716] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T18:44:46.654376] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-30T18:44:46.672881] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:44:47.454339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-30T18:44:48.227934] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:44:48.254308] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-30T18:44:48.501003] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:44:49.054331] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-30T18:44:49.332788] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:44:49.854396] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-30T18:44:50.654327] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-30T18:44:50.688209] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T18:44:50.756920] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:44:51.454375] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-30T18:44:51.807104] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T18:44:52.131987] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:44:52.254381] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-30T18:44:53.054360] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-30T18:44:53.854333] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-30T18:44:53.959434] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T18:44:53.975831] [INFO ] [REMOTE ] FERG: Full fetch complete (70974 records). [2025-09-30T18:44:53.976073] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-30T18:44:54.099030] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:44:54.414008] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-30T18:44:54.414099] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-30T18:44:54.415079] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-30T18:44:54.415186] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-30T18:44:54.416717] [DEBUG] [LOCAL ] FERG: Trimmed 70974 records to 48873 (keeping 200 days of data) [2025-09-30T18:44:54.655057] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-30T18:44:54.743814] [DEBUG] [LOCAL ] FERG: Primary data saved (48873 records). [2025-09-30T18:44:54.743951] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-30T18:44:54.744840] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 46.2s. Estimated remaining: 3h 17m 57s. Rate: 7.8 symbols/min [2025-09-30T18:44:54.921132] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:54.940978] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-09-30T18:44:54.941248] [INFO ] [MAIN ] FFC: Loaded 16759 existing records. [2025-09-30T18:44:55.146421] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:55.140715] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:44:55.151594] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-30T18:44:55.151691] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-30T18:44:55.152559] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-30T18:44:55.152623] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-30T18:44:55.459482] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-30T18:44:55.539333] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:55.832288] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T18:44:55.836440] [INFO ] [REMOTE ] FET: Full fetch complete (18281 records). [2025-09-30T18:44:55.836532] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-30T18:44:55.962120] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:44:56.240559] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-30T18:44:56.240636] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-30T18:44:56.241096] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-30T18:44:56.241163] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-30T18:44:56.241783] [DEBUG] [LOCAL ] FET: Trimmed 18281 records to 12840 (keeping 200 days of data) [2025-09-30T18:44:56.279225] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-30T18:44:56.329511] [DEBUG] [LOCAL ] FET: Primary data saved (12840 records). [2025-09-30T18:44:56.329671] [INFO ] [MAIN ] FET: Full history saved. [2025-09-30T18:44:56.329804] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FET took 31.1s. Estimated remaining: 3h 17m 38s. Rate: 7.8 symbols/min [2025-09-30T18:44:56.506266] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:56.549688] [DEBUG] [LOCAL ] FFWM: Loaded 35823 existing records from primary storage. [2025-09-30T18:44:56.550177] [INFO ] [MAIN ] FFWM: Loaded 35823 existing records. [2025-09-30T18:44:56.743191] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:56.743490] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-30T18:44:56.743544] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-30T18:44:56.744498] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-30T18:44:56.744561] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-30T18:44:57.059536] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-30T18:44:57.135148] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:57.241048] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:44:57.726478] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T18:44:57.854359] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-30T18:44:58.654381] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-30T18:44:59.232525] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T18:44:59.454380] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-30T18:44:59.694493] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:45:00.063403] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:45:00.254381] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-30T18:45:01.054383] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-30T18:45:01.106136] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:45:01.113554] [INFO ] [REMOTE ] FFA: Full fetch complete (8347 records). [2025-09-30T18:45:01.113960] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-30T18:45:01.114534] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:01.114877] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:01.114926] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:01.115010] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-30T18:45:01.115110] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-30T18:45:01.115176] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-09-30T18:45:01.115254] [DEBUG] [LOCAL ] FFA: No derivative data file found to delete. [2025-09-30T18:45:01.115345] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 23.7s. Estimated remaining: 3h 17m 25s. Rate: 7.8 symbols/min [2025-09-30T18:45:01.335918] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:01.336175] [DEBUG] [LOCAL ] FG: No existing data file found in primary storage. [2025-09-30T18:45:01.336232] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-09-30T18:45:01.336371] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-30T18:45:01.336427] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-30T18:45:01.336487] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-09-30T18:45:01.336536] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-30T18:45:01.745612] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:01.854352] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-30T18:45:02.554906] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:45:02.654398] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-30T18:45:02.686135] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:45:03.454363] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-30T18:45:03.567020] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:45:04.254397] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-30T18:45:04.655321] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T18:45:05.006561] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T18:45:05.054398] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-30T18:45:05.854377] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-30T18:45:06.481728] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:45:06.654395] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-30T18:45:06.776423] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T18:45:07.454359] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-30T18:45:07.649715] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T18:45:08.254399] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-30T18:45:08.828957] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:45:09.054414] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-30T18:45:09.073461] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T18:45:09.854373] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-30T18:45:10.429697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:45:10.434358] [INFO ] [REMOTE ] FF: Full fetch complete (36673 records). [2025-09-30T18:45:10.434480] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-30T18:45:10.435123] [FATAL] [VALIDATOR ] FF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:10.435211] [FATAL] [MAIN ] FF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:10.435256] [WARN ] [MAIN ] FF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:10.435323] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-30T18:45:10.435387] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-09-30T18:45:10.435425] [INFO ] [LOCAL ] FF: Starting deletion of derivative data. [2025-09-30T18:45:10.435733] [DEBUG] [LOCAL ] FF: Deleted derivative data file. [2025-09-30T18:45:10.435873] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FF took 35.5s. Estimated remaining: 3h 17m 21s. Rate: 7.8 symbols/min [2025-09-30T18:45:10.620048] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:10.626864] [DEBUG] [LOCAL ] FGN: Loaded 3865 existing records from primary storage. [2025-09-30T18:45:10.627103] [INFO ] [MAIN ] FGN: Loaded 3865 existing records. [2025-09-30T18:45:10.664690] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-30T18:45:10.830704] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:10.831485] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-30T18:45:10.831576] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-30T18:45:10.831941] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-30T18:45:10.832008] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-30T18:45:11.261582] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:11.264557] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T18:45:11.454366] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-30T18:45:11.689418] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T18:45:12.254381] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-30T18:45:12.789176] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T18:45:13.054404] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-30T18:45:13.310913] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:45:13.854351] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-30T18:45:14.518592] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T18:45:14.654337] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-30T18:45:14.700457] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:45:15.454363] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-30T18:45:15.679621] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:45:16.254361] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-30T18:45:16.516290] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T18:45:17.054402] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-30T18:45:17.684484] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:45:17.691854] [INFO ] [REMOTE ] FFWM: Full fetch complete (51656 records). [2025-09-30T18:45:17.691994] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-30T18:45:17.861915] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-30T18:45:18.136863] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-30T18:45:18.136969] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-30T18:45:18.137776] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-30T18:45:18.137844] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-30T18:45:18.139109] [DEBUG] [LOCAL ] FFWM: Trimmed 51656 records to 35772 (keeping 200 days of data) [2025-09-30T18:45:18.238933] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T18:45:18.373966] [DEBUG] [LOCAL ] FFWM: Primary data saved (35772 records). [2025-09-30T18:45:18.374126] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-30T18:45:18.374220] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFWM took 22.0s. Estimated remaining: 3h 17m 14s. Rate: 7.8 symbols/min [2025-09-30T18:45:18.561952] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:18.563264] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-30T18:45:18.563320] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-30T18:45:18.563531] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-30T18:45:18.563586] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-30T18:45:18.563630] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-30T18:45:18.563701] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-30T18:45:18.663535] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-30T18:45:18.961858] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:19.029064] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:45:19.454374] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-30T18:45:19.664520] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:45:19.664917] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-30T18:45:19.665030] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:45:19.665101] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-30T18:45:19.665246] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:45:19.665322] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-30T18:45:19.665393] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-30T18:45:19.665441] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-30T18:45:19.665491] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-30T18:45:19.665544] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 1.3s. Estimated remaining: 3h 16m 54s. Rate: 7.8 symbols/min [2025-09-30T18:45:19.815808] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:45:19.872862] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:19.873045] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-09-30T18:45:19.873085] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-09-30T18:45:19.873197] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-30T18:45:19.873250] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-30T18:45:19.873339] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-09-30T18:45:19.873394] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-30T18:45:20.255368] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-30T18:45:20.284897] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:21.054334] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-30T18:45:21.366192] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:45:21.370394] [INFO ] [REMOTE ] FFC: Full fetch complete (24628 records). [2025-09-30T18:45:21.370545] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-30T18:45:21.371105] [FATAL] [VALIDATOR ] FFC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:21.371187] [FATAL] [MAIN ] FFC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:21.371256] [WARN ] [MAIN ] FFC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:21.371329] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-30T18:45:21.371398] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-09-30T18:45:21.371437] [INFO ] [LOCAL ] FFC: Starting deletion of derivative data. [2025-09-30T18:45:21.371827] [DEBUG] [LOCAL ] FFC: Deleted derivative data file. [2025-09-30T18:45:21.371922] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFC took 26.6s. Estimated remaining: 3h 16m 35s. Rate: 7.9 symbols/min [2025-09-30T18:45:21.566713] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:21.633988] [DEBUG] [LOCAL ] FHN: Loaded 53366 existing records from primary storage. [2025-09-30T18:45:21.634380] [INFO ] [MAIN ] FHN: Loaded 53366 existing records. [2025-09-30T18:45:21.840449] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:21.840764] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-30T18:45:21.840817] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-30T18:45:21.842829] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-30T18:45:21.842891] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-30T18:45:21.859541] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-30T18:45:22.269770] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:22.444317] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:45:22.654394] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-30T18:45:23.254208] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:45:23.454397] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-30T18:45:23.735770] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:45:23.816863] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:45:24.254405] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-30T18:45:25.054401] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-30T18:45:25.460963] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:45:25.854434] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-30T18:45:26.388464] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T18:45:26.654421] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-30T18:45:27.403040] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:45:27.454391] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-30T18:45:27.662933] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:45:28.254371] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-30T18:45:29.054341] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-30T18:45:29.198839] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T18:45:29.361257] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:45:29.797145] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T18:45:29.854348] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-30T18:45:30.654423] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-30T18:45:31.454386] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-30T18:45:31.512174] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:45:32.235176] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:45:32.254306] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-30T18:45:32.290028] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:45:33.054359] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-30T18:45:33.854354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-30T18:45:34.040874] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:45:34.428589] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:45:34.504206] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T18:45:34.654414] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-30T18:45:35.454410] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-30T18:45:36.167958] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T18:45:36.254380] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-30T18:45:36.385823] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:45:36.390489] [INFO ] [REMOTE ] FG: Full fetch complete (27517 records). [2025-09-30T18:45:36.390577] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-30T18:45:36.701484] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T18:45:36.798245] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-30T18:45:36.798340] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-30T18:45:36.799005] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-30T18:45:36.799074] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-30T18:45:36.800103] [DEBUG] [LOCAL ] FG: Trimmed 27517 records to 22827 (keeping 200 days of data) [2025-09-30T18:45:36.964168] [DEBUG] [LOCAL ] FG: Primary data saved (22827 records). [2025-09-30T18:45:36.964320] [INFO ] [MAIN ] FG: Full history saved. [2025-09-30T18:45:36.964435] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FG took 35.8s. Estimated remaining: 3h 16m 42s. Rate: 7.8 symbols/min [2025-09-30T18:45:37.059540] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-30T18:45:37.161387] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:37.217735] [DEBUG] [LOCAL ] FI: Loaded 53497 existing records from primary storage. [2025-09-30T18:45:37.218099] [INFO ] [MAIN ] FI: Loaded 53497 existing records. [2025-09-30T18:45:37.446824] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:37.447088] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-30T18:45:37.447137] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-30T18:45:37.448637] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-30T18:45:37.448729] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-30T18:45:37.711769] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:45:37.839086] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:37.854336] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-30T18:45:38.654367] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-30T18:45:39.454398] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-30T18:45:39.680366] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:45:40.046816] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:45:40.179034] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T18:45:40.254360] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-30T18:45:41.054423] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-30T18:45:41.525543] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:45:41.854372] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-30T18:45:42.001375] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:45:42.390230] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T18:45:42.654364] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-30T18:45:43.454341] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-30T18:45:44.254378] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-30T18:45:44.346299] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:45:44.965136] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T18:45:44.989764] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T18:45:44.990970] [INFO ] [REMOTE ] FGN: Full fetch complete (5733 records). [2025-09-30T18:45:44.991044] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-30T18:45:44.991477] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:44.991582] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:44.991631] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:44.991729] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-30T18:45:44.991839] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-09-30T18:45:44.991880] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-09-30T18:45:44.992089] [DEBUG] [LOCAL ] FGN: Deleted derivative data file. [2025-09-30T18:45:44.992193] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGN took 34.6s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-09-30T18:45:45.059550] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-30T18:45:45.180054] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:45.208107] [DEBUG] [LOCAL ] FICO: Loaded 20330 existing records from primary storage. [2025-09-30T18:45:45.208407] [INFO ] [MAIN ] FICO: Loaded 20330 existing records. [2025-09-30T18:45:45.396222] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:45.396450] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-30T18:45:45.396497] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-30T18:45:45.397135] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-30T18:45:45.397195] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-30T18:45:45.787918] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:45.854319] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-30T18:45:46.654331] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-30T18:45:46.759405] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:45:46.941964] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T18:45:47.454412] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-30T18:45:48.259583] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-30T18:45:48.280436] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:45:49.054388] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-30T18:45:49.239151] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:45:49.415815] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:45:49.854358] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-30T18:45:50.275357] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:45:50.654393] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-30T18:45:50.862208] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T18:45:51.454403] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-30T18:45:52.052435] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T18:45:52.254387] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-30T18:45:53.054367] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-30T18:45:53.567902] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T18:45:53.754723] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:45:53.854373] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-30T18:45:53.894321] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:45:54.654405] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-30T18:45:55.459486] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-30T18:45:55.480638] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:45:56.254391] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-30T18:45:56.527700] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T18:45:56.642534] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T18:45:57.054364] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-30T18:45:57.854390] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-30T18:45:58.079769] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:45:58.654336] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-30T18:45:58.681442] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T18:45:58.690848] [INFO ] [REMOTE ] FHI: Full fetch complete (57737 records). [2025-09-30T18:45:58.691018] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-30T18:45:59.145914] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-30T18:45:59.146082] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-30T18:45:59.147037] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-30T18:45:59.147170] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-30T18:45:59.148667] [DEBUG] [LOCAL ] FHI: Trimmed 57737 records to 40285 (keeping 200 days of data) [2025-09-30T18:45:59.287256] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T18:45:59.437454] [DEBUG] [LOCAL ] FHI: Primary data saved (40285 records). [2025-09-30T18:45:59.437588] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-30T18:45:59.437693] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 39.8s. Estimated remaining: 3h 16m 40s. Rate: 7.8 symbols/min [2025-09-30T18:45:59.459538] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-30T18:45:59.635997] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:59.636213] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-30T18:45:59.636264] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-30T18:45:59.636392] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-30T18:45:59.636437] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-30T18:45:59.636482] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-30T18:45:59.636519] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-30T18:46:00.009531] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:00.254371] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-30T18:46:00.546309] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:46:00.644183] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-30T18:46:01.054386] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-30T18:46:01.243536] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-30T18:46:01.306287] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-30T18:46:01.854370] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-30T18:46:02.654377] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-30T18:46:03.454400] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-30T18:46:03.662051] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:46:03.676062] [INFO ] [REMOTE ] FHN: Full fetch complete (77280 records). [2025-09-30T18:46:03.676213] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-30T18:46:03.759720] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:46:04.122638] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-30T18:46:04.122867] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-30T18:46:04.123955] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-30T18:46:04.124092] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-30T18:46:04.143823] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T18:46:04.144026] [DEBUG] [LOCAL ] FHN: Trimmed 77280 records to 53366 (keeping 200 days of data) [2025-09-30T18:46:04.260886] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-30T18:46:04.542822] [DEBUG] [LOCAL ] FHN: Primary data saved (53366 records). [2025-09-30T18:46:04.543007] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-30T18:46:04.543758] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FHN took 43.2s. Estimated remaining: 3h 16m 28s. Rate: 7.8 symbols/min [2025-09-30T18:46:04.781801] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:04.835877] [DEBUG] [LOCAL ] FIGS: Loaded 48861 existing records from primary storage. [2025-09-30T18:46:04.836219] [INFO ] [MAIN ] FIGS: Loaded 48861 existing records. [2025-09-30T18:46:05.028007] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:05.028281] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-30T18:46:05.028344] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-30T18:46:05.029459] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-30T18:46:05.029523] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-30T18:46:05.060926] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-30T18:46:05.469168] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:05.854348] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-30T18:46:05.911955] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:46:06.323789] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:46:06.347681] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:46:06.654348] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-30T18:46:07.454370] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-30T18:46:07.796661] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T18:46:08.254342] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-30T18:46:08.830430] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-30T18:46:08.842706] [INFO ] [REMOTE ] FI: Full fetch complete (77169 records). [2025-09-30T18:46:08.842890] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-30T18:46:09.059569] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-30T18:46:09.269942] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-30T18:46:09.270043] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-30T18:46:09.271041] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-30T18:46:09.271112] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-30T18:46:09.272783] [DEBUG] [LOCAL ] FI: Trimmed 77169 records to 53499 (keeping 200 days of data) [2025-09-30T18:46:09.496032] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:46:09.625073] [DEBUG] [LOCAL ] FI: Primary data saved (53499 records). [2025-09-30T18:46:09.625231] [INFO ] [MAIN ] FI: Full history saved. [2025-09-30T18:46:09.625346] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 32.7s. Estimated remaining: 3h 16m 16s. Rate: 7.8 symbols/min [2025-09-30T18:46:09.809435] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:09.848325] [DEBUG] [LOCAL ] FIHL: Loaded 39998 existing records from primary storage. [2025-09-30T18:46:09.848628] [INFO ] [MAIN ] FIHL: Loaded 39998 existing records. [2025-09-30T18:46:09.859918] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-30T18:46:10.047544] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:10.047937] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-30T18:46:10.048028] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-30T18:46:10.058531] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-30T18:46:10.066003] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-30T18:46:10.150854] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:46:10.494728] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:10.654380] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-30T18:46:11.001885] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:46:11.006415] [INFO ] [REMOTE ] FICO: Full fetch complete (28409 records). [2025-09-30T18:46:11.006534] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-30T18:46:11.425679] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-30T18:46:11.425783] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-30T18:46:11.426455] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-30T18:46:11.426518] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-30T18:46:11.427632] [DEBUG] [LOCAL ] FICO: Trimmed 28409 records to 20420 (keeping 200 days of data) [2025-09-30T18:46:11.488474] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-30T18:46:11.574183] [DEBUG] [LOCAL ] FICO: Primary data saved (20420 records). [2025-09-30T18:46:11.574328] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-30T18:46:11.574415] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FICO took 26.6s. Estimated remaining: 3h 15m 57s. Rate: 7.8 symbols/min [2025-09-30T18:46:11.778575] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:11.801509] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:46:11.815686] [DEBUG] [LOCAL ] FINS: Loaded 8262 existing records from primary storage. [2025-09-30T18:46:11.815930] [INFO ] [MAIN ] FINS: Loaded 8262 existing records. [2025-09-30T18:46:12.024516] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:12.024796] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-30T18:46:12.024848] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-30T18:46:12.025096] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-30T18:46:12.025156] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-30T18:46:12.259768] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-30T18:46:12.423216] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:12.571569] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:46:12.571982] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-30T18:46:12.572097] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:46:12.572199] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-30T18:46:12.572283] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:46:12.572376] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-30T18:46:12.572460] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-30T18:46:12.572527] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-30T18:46:12.572618] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-30T18:46:12.572735] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 13.1s. Estimated remaining: 3h 15m 38s. Rate: 7.9 symbols/min [2025-09-30T18:46:12.777682] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:12.826912] [DEBUG] [LOCAL ] FINV: Loaded 45191 existing records from primary storage. [2025-09-30T18:46:12.827605] [INFO ] [MAIN ] FINV: Loaded 45191 existing records. [2025-09-30T18:46:13.061382] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:13.057889] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-30T18:46:13.062594] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-30T18:46:13.062779] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-30T18:46:13.063310] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-30T18:46:13.063422] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-30T18:46:13.378490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:46:13.560849] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:13.854348] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-30T18:46:13.977532] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:46:14.654371] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-30T18:46:15.084391] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T18:46:15.454359] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-30T18:46:16.064200] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:46:16.254413] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-30T18:46:16.516522] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:46:17.054389] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-30T18:46:17.420958] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:46:17.854598] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-30T18:46:18.518989] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:46:18.575312] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:46:18.654433] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-30T18:46:19.454395] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-30T18:46:20.068074] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T18:46:20.254353] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-30T18:46:20.424533] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:46:20.847915] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T18:46:21.054406] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-30T18:46:21.854400] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-30T18:46:22.353638] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:46:22.600347] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T18:46:22.654374] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-30T18:46:23.410801] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:46:23.454382] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-30T18:46:24.254411] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-30T18:46:24.774600] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:46:25.054380] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-30T18:46:25.542954] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T18:46:25.699172] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:46:25.854398] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-30T18:46:26.654412] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-30T18:46:27.461016] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-30T18:46:27.466791] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T18:46:28.153114] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:46:28.189049] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:46:28.254310] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-30T18:46:29.054421] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-30T18:46:29.854383] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-30T18:46:29.982868] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:46:30.477354] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:46:30.654358] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-30T18:46:30.834081] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:46:31.454426] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-30T18:46:32.254324] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-30T18:46:32.372230] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:46:32.712621] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:46:33.054387] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-30T18:46:33.836337] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:46:33.854348] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-30T18:46:34.351349] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:46:34.362143] [INFO ] [REMOTE ] FINV: Full fetch complete (63519 records). [2025-09-30T18:46:34.362308] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-30T18:46:34.659603] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-30T18:46:34.785739] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-30T18:46:34.785845] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-30T18:46:34.786808] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-30T18:46:34.786886] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-30T18:46:34.788343] [DEBUG] [LOCAL ] FINV: Trimmed 63519 records to 45240 (keeping 200 days of data) [2025-09-30T18:46:35.065120] [DEBUG] [LOCAL ] FINV: Primary data saved (45240 records). [2025-09-30T18:46:35.065277] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-30T18:46:35.065400] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FINV took 22.5s. Estimated remaining: 3h 15m 57s. Rate: 7.8 symbols/min [2025-09-30T18:46:35.265140] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:35.327420] [DEBUG] [LOCAL ] FIS: Loaded 53364 existing records from primary storage. [2025-09-30T18:46:35.327898] [INFO ] [MAIN ] FIS: Loaded 53364 existing records. [2025-09-30T18:46:35.461289] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-30T18:46:35.536994] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:35.545173] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-30T18:46:35.544946] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:46:35.545504] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-30T18:46:35.576959] [INFO ] [REMOTE ] FINS: Full fetch complete (12395 records). [2025-09-30T18:46:35.577258] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-30T18:46:35.577517] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-30T18:46:35.606690] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-30T18:46:35.614228] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:46:36.265301] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-30T18:46:36.417562] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-30T18:46:36.424867] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-30T18:46:36.439124] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-30T18:46:36.492459] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:36.492930] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-30T18:46:36.494462] [DEBUG] [LOCAL ] FINS: Trimmed 12395 records to 8282 (keeping 200 days of data) [2025-09-30T18:46:36.553818] [DEBUG] [LOCAL ] FINS: Primary data saved (8282 records). [2025-09-30T18:46:36.553976] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-30T18:46:36.554109] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 25.0s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-09-30T18:46:36.740670] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:36.797693] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:46:36.796527] [DEBUG] [LOCAL ] FIX: Loaded 30013 existing records from primary storage. [2025-09-30T18:46:36.806128] [INFO ] [MAIN ] FIX: Loaded 30013 existing records. [2025-09-30T18:46:37.003250] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:37.003539] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-30T18:46:37.003609] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-30T18:46:37.003920] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-30T18:46:37.004002] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-30T18:46:37.059476] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-30T18:46:37.478582] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:37.854372] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-30T18:46:37.991490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:46:38.654389] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-30T18:46:38.865544] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T18:46:38.894121] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T18:46:39.454378] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-30T18:46:40.262230] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-30T18:46:40.264250] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T18:46:40.951619] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:46:41.054369] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-30T18:46:41.854379] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-30T18:46:42.113160] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T18:46:42.610419] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:46:42.654346] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-30T18:46:43.395041] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T18:46:43.454365] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-30T18:46:44.007155] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:46:44.254403] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-30T18:46:44.938465] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:46:44.947322] [INFO ] [REMOTE ] FIHL: Full fetch complete (55755 records). [2025-09-30T18:46:44.947454] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-30T18:46:45.057010] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-30T18:46:45.377265] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-30T18:46:45.377435] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-30T18:46:45.379817] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-30T18:46:45.379903] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-30T18:46:45.382071] [DEBUG] [LOCAL ] FIHL: Trimmed 55755 records to 39905 (keeping 200 days of data) [2025-09-30T18:46:45.655298] [DEBUG] [LOCAL ] FIHL: Primary data saved (39905 records). [2025-09-30T18:46:45.655508] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-30T18:46:45.655701] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 36.0s. Estimated remaining: 3h 15m 33s. Rate: 7.8 symbols/min [2025-09-30T18:46:45.854435] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-30T18:46:45.956618] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T18:46:46.662521] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-30T18:46:46.693389] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:46:47.214339] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:46:47.454390] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-30T18:46:48.088449] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:46:48.099883] [INFO ] [REMOTE ] FIGS: Full fetch complete (71056 records). [2025-09-30T18:46:48.100102] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-30T18:46:48.268861] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-30T18:46:48.547350] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-30T18:46:48.547440] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-30T18:46:48.548446] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-30T18:46:48.548518] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-30T18:46:48.550125] [DEBUG] [LOCAL ] FIGS: Trimmed 71056 records to 48853 (keeping 200 days of data) [2025-09-30T18:46:48.821556] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:46:48.907494] [DEBUG] [LOCAL ] FIGS: Primary data saved (48853 records). [2025-09-30T18:46:48.907708] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-30T18:46:48.908702] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIGS took 44.4s. Estimated remaining: 3h 15m 18s. Rate: 7.8 symbols/min [2025-09-30T18:46:49.054377] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-30T18:46:49.730124] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T18:46:49.854394] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-30T18:46:50.891955] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T18:46:50.906405] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-30T18:46:51.373219] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:46:51.454351] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-30T18:46:52.631404] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:46:52.637576] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-30T18:46:52.813587] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:46:53.054370] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-30T18:46:53.990154] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:46:53.996907] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-30T18:46:54.540981] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:46:54.654405] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-30T18:46:55.324049] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:46:55.454384] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-30T18:46:56.108208] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:46:56.254361] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-30T18:46:56.902993] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T18:46:56.909483] [INFO ] [REMOTE ] FIX: Full fetch complete (45552 records). [2025-09-30T18:46:56.909679] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-30T18:46:57.316057] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-30T18:46:57.316158] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-30T18:46:57.316895] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-30T18:46:57.316960] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-30T18:46:57.318033] [DEBUG] [LOCAL ] FIX: Trimmed 45552 records to 29896 (keeping 200 days of data) [2025-09-30T18:46:57.533706] [DEBUG] [LOCAL ] FIX: Primary data saved (29896 records). [2025-09-30T18:46:57.533862] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-30T18:46:57.533994] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 21.0s. Estimated remaining: 3h 15m 12s. Rate: 7.8 symbols/min [2025-09-30T18:46:58.110674] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:46:58.125173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-30T18:46:59.961705] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:46:59.973383] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-30T18:47:02.065942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T18:47:02.078366] [INFO ] [REMOTE ] FIS: Full fetch complete (77175 records). [2025-09-30T18:47:02.078550] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-30T18:47:02.518946] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-30T18:47:02.519086] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-30T18:47:02.520119] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-30T18:47:02.520200] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-30T18:47:02.522024] [DEBUG] [LOCAL ] FIS: Trimmed 77175 records to 53363 (keeping 200 days of data) [2025-09-30T18:47:02.885087] [DEBUG] [LOCAL ] FIS: Primary data saved (53363 records). [2025-09-30T18:47:02.885263] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-30T18:47:02.885404] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIS took 27.8s. Estimated remaining: 3h 14m 60s. Rate: 7.9 symbols/min [2025-09-30T18:47:03.482820] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.560415] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-30T18:47:03.560742] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-30T18:47:03.606412] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-30T18:47:03.619836] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-30T18:47:03.632753] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.647348] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-30T18:47:03.668164] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-30T18:47:03.677481] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.745013] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.891606] [DEBUG] [LOCAL ] FLC: Loaded 5476 existing records from primary storage. [2025-09-30T18:47:03.926979] [INFO ] [MAIN ] FLC: Loaded 5476 existing records. [2025-09-30T18:47:04.031601] [DEBUG] [LOCAL ] FLNG: Loaded 33774 existing records from primary storage. [2025-09-30T18:47:04.049047] [INFO ] [MAIN ] FLNG: Loaded 33774 existing records. [2025-09-30T18:47:04.402403] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-09-30T18:47:04.451003] [INFO ] [MAIN ] FLG: Loaded 53325 existing records. [2025-09-30T18:47:04.445468] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:04.451236] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-30T18:47:04.493278] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-30T18:47:04.637091] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-30T18:47:04.664167] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:04.679423] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-30T18:47:04.687139] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-30T18:47:04.745720] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-30T18:47:04.765566] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:04.827875] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-30T18:47:04.828070] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-30T18:47:04.845069] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-30T18:47:05.022120] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:05.131992] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:47:05.108681] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-30T18:47:05.168023] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-30T18:47:05.179161] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-30T18:47:05.193818] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:47:05.256526] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-30T18:47:05.261918] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-30T18:47:05.246144] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-30T18:47:05.315903] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:47:05.416277] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-30T18:47:05.515716] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-30T18:47:05.531381] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-30T18:47:05.651713] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-30T18:47:05.716201] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 14m 44s. Rate: 7.9 symbols/min [2025-09-30T18:47:05.716001] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:05.774736] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-30T18:47:06.037487] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.059696] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-30T18:47:06.230750] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:06.318030] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.318530] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-30T18:47:06.369690] [DEBUG] [LOCAL ] FLO: Loaded 51900 existing records from primary storage. [2025-09-30T18:47:06.370028] [INFO ] [MAIN ] FLO: Loaded 51900 existing records. [2025-09-30T18:47:06.567997] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:06.568390] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-30T18:47:06.568448] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-30T18:47:06.568991] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-30T18:47:06.569117] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-30T18:47:06.700414] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:47:06.740297] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-30T18:47:06.992107] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.992453] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-30T18:47:07.437325] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:47:07.440121] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-30T18:47:07.607279] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:47:07.616044] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-30T18:47:07.777446] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:47:07.779103] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-30T18:47:08.180762] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:47:08.192820] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-30T18:47:08.339315] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:47:08.341289] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-30T18:47:08.698040] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:47:08.705791] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-30T18:47:08.742017] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:47:08.752824] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-30T18:47:08.799177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T18:47:09.054357] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-30T18:47:09.805853] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:47:09.859486] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-30T18:47:09.878874] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:47:10.170807] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T18:47:10.330424] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:47:10.534106] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:47:10.654421] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-30T18:47:11.454381] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-30T18:47:12.053910] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:47:12.227287] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:47:12.254331] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-30T18:47:13.054409] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-30T18:47:13.779569] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T18:47:13.813285] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:47:13.854367] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-30T18:47:14.654426] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-30T18:47:14.742001] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:47:14.743854] [INFO ] [REMOTE ] FLC: Full fetch complete (7981 records). [2025-09-30T18:47:14.744003] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-30T18:47:15.144100] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-30T18:47:15.144216] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-30T18:47:15.144549] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-30T18:47:15.144614] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-30T18:47:15.145116] [DEBUG] [LOCAL ] FLC: Trimmed 7981 records to 5462 (keeping 200 days of data) [2025-09-30T18:47:15.182725] [DEBUG] [LOCAL ] FLC: Primary data saved (5462 records). [2025-09-30T18:47:15.182883] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-30T18:47:15.183034] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 12.3s. Estimated remaining: 3h 14m 39s. Rate: 7.9 symbols/min [2025-09-30T18:47:15.392077] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:15.392328] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-30T18:47:15.392381] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-30T18:47:15.392501] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-30T18:47:15.392544] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-30T18:47:15.392587] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-30T18:47:15.392620] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-30T18:47:15.459610] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-30T18:47:15.816785] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:16.254361] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-30T18:47:16.324068] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:47:17.054355] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-30T18:47:17.107481] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:47:17.235113] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:47:17.854394] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-30T18:47:18.063944] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:47:18.064274] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-30T18:47:18.064384] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:47:18.064447] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-30T18:47:18.064558] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:47:18.064637] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-30T18:47:18.064745] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-30T18:47:18.064786] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-30T18:47:18.064827] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-30T18:47:18.064878] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 2.9s. Estimated remaining: 3h 14m 23s. Rate: 7.9 symbols/min [2025-09-30T18:47:18.260585] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:18.324154] [DEBUG] [LOCAL ] FLR: Loaded 53111 existing records from primary storage. [2025-09-30T18:47:18.324582] [INFO ] [MAIN ] FLR: Loaded 53111 existing records. [2025-09-30T18:47:18.522861] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:18.523850] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-30T18:47:18.523910] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-30T18:47:18.524820] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-30T18:47:18.524882] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-30T18:47:18.659502] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-30T18:47:18.920747] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:18.962352] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:47:19.454387] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-30T18:47:20.254325] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-30T18:47:20.343529] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:47:21.054399] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-30T18:47:21.326010] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:47:21.620930] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:47:21.854386] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-30T18:47:22.654354] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-30T18:47:22.697139] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:47:22.759885] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T18:47:23.454353] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-30T18:47:24.254348] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-30T18:47:24.372763] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:47:24.816353] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:47:25.054404] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-30T18:47:25.772968] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:47:25.854387] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-30T18:47:26.527632] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:47:26.654368] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-30T18:47:27.454383] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-30T18:47:27.624572] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:47:28.254369] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-30T18:47:28.465054] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:47:28.943520] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:47:29.054388] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-30T18:47:29.683098] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:47:29.854380] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-30T18:47:30.408303] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:47:30.654395] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-30T18:47:31.454354] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-30T18:47:31.815270] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:47:31.922276] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:47:31.931120] [INFO ] [REMOTE ] FLNG: Full fetch complete (50703 records). [2025-09-30T18:47:31.931292] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-30T18:47:32.259564] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-30T18:47:32.386736] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-30T18:47:32.386840] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-30T18:47:32.387780] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-30T18:47:32.387896] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-30T18:47:32.389216] [DEBUG] [LOCAL ] FLNG: Trimmed 50703 records to 33756 (keeping 200 days of data) [2025-09-30T18:47:32.610483] [DEBUG] [LOCAL ] FLNG: Primary data saved (33756 records). [2025-09-30T18:47:32.610738] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-30T18:47:32.610894] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 29.7s. Estimated remaining: 3h 14m 28s. Rate: 7.9 symbols/min [2025-09-30T18:47:32.794673] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:32.844896] [DEBUG] [LOCAL ] FLS: Loaded 50154 existing records from primary storage. [2025-09-30T18:47:32.845223] [INFO ] [MAIN ] FLS: Loaded 50154 existing records. [2025-09-30T18:47:33.045619] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:33.045872] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-30T18:47:33.045919] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-30T18:47:33.046478] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-30T18:47:33.046536] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-30T18:47:33.069525] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-30T18:47:33.453720] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:33.484189] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T18:47:33.854339] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-30T18:47:34.130132] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:47:34.654387] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-30T18:47:34.819825] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:47:34.834565] [INFO ] [REMOTE ] FLG: Full fetch complete (77297 records). [2025-09-30T18:47:34.834807] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-30T18:47:35.311359] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-30T18:47:35.311616] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-30T18:47:35.312627] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-30T18:47:35.312738] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-30T18:47:35.315038] [DEBUG] [LOCAL ] FLG: Trimmed 77297 records to 53321 (keeping 200 days of data) [2025-09-30T18:47:35.451210] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:47:35.461571] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-30T18:47:35.752336] [DEBUG] [LOCAL ] FLG: Primary data saved (53321 records). [2025-09-30T18:47:35.752538] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-30T18:47:35.752875] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLG took 32.9s. Estimated remaining: 3h 14m 12s. Rate: 7.9 symbols/min [2025-09-30T18:47:35.976886] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:36.032030] [DEBUG] [LOCAL ] FLUT: Loaded 50763 existing records from primary storage. [2025-09-30T18:47:36.032440] [INFO ] [MAIN ] FLUT: Loaded 50763 existing records. [2025-09-30T18:47:36.240095] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:36.240329] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-30T18:47:36.240381] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-30T18:47:36.240778] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-30T18:47:36.240839] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-30T18:47:36.286373] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-30T18:47:36.626193] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:36.698475] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:47:36.711475] [INFO ] [REMOTE ] FLO: Full fetch complete (74633 records). [2025-09-30T18:47:36.711715] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-30T18:47:36.712892] [FATAL] [VALIDATOR ] FLO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:47:36.713002] [FATAL] [MAIN ] FLO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:47:36.713056] [WARN ] [MAIN ] FLO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:47:36.713111] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-30T18:47:36.713185] [DEBUG] [LOCAL ] FLO: No primary data file found to delete. [2025-09-30T18:47:36.713230] [INFO ] [LOCAL ] FLO: Starting deletion of derivative data. [2025-09-30T18:47:36.713589] [DEBUG] [LOCAL ] FLO: Deleted derivative data file. [2025-09-30T18:47:36.713753] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 31.0s. Estimated remaining: 3h 13m 52s. Rate: 7.9 symbols/min [2025-09-30T18:47:36.922625] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:36.959062] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T18:47:36.985675] [DEBUG] [LOCAL ] FLXR: Loaded 20158 existing records from primary storage. [2025-09-30T18:47:36.985982] [INFO ] [MAIN ] FLXR: Loaded 20158 existing records. [2025-09-30T18:47:37.059479] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-30T18:47:37.188285] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:37.188519] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-30T18:47:37.188568] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-30T18:47:37.188822] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-30T18:47:37.188882] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-30T18:47:37.573015] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:37.603389] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:47:37.854372] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-30T18:47:38.654363] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-30T18:47:38.861294] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:47:39.423883] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:47:39.453624] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:47:39.454516] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-30T18:47:40.254353] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-30T18:47:41.054331] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-30T18:47:41.272348] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:47:41.794697] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T18:47:41.854344] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-30T18:47:42.207354] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:47:42.654368] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-30T18:47:43.454415] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-30T18:47:43.531829] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:47:44.254398] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-30T18:47:44.398956] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:47:44.813864] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:47:45.041928] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T18:47:45.054334] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-30T18:47:45.854388] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-30T18:47:46.038334] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:47:46.654364] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-30T18:47:47.454358] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-30T18:47:47.601563] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:47:48.242802] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:47:48.254682] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-30T18:47:49.054332] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-30T18:47:49.126293] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T18:47:49.215880] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:47:49.854355] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-30T18:47:50.654360] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-30T18:47:50.855104] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:47:51.063568] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:47:51.454357] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-30T18:47:52.217168] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:47:52.254348] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-30T18:47:52.561889] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T18:47:53.054374] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-30T18:47:53.854348] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-30T18:47:54.102820] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:47:54.654373] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-30T18:47:54.782729] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:47:55.418688] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:47:55.430828] [INFO ] [REMOTE ] FLR: Full fetch complete (76385 records). [2025-09-30T18:47:55.431002] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-30T18:47:55.465693] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-30T18:47:55.854334] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:47:55.882816] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-30T18:47:55.883201] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-30T18:47:55.884234] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-30T18:47:55.884313] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-30T18:47:55.885793] [DEBUG] [LOCAL ] FLR: Trimmed 76385 records to 53116 (keeping 200 days of data) [2025-09-30T18:47:56.223052] [DEBUG] [LOCAL ] FLR: Primary data saved (53116 records). [2025-09-30T18:47:56.223210] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-30T18:47:56.223888] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 38.2s. Estimated remaining: 3h 14m 6s. Rate: 7.9 symbols/min [2025-09-30T18:47:56.259468] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-30T18:47:56.411450] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:56.462101] [DEBUG] [LOCAL ] FMC: Loaded 51780 existing records from primary storage. [2025-09-30T18:47:56.462413] [INFO ] [MAIN ] FMC: Loaded 51780 existing records. [2025-09-30T18:47:56.653896] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:56.654126] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-30T18:47:56.654172] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-30T18:47:56.654551] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-30T18:47:56.654611] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-30T18:47:57.050716] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:57.064940] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-30T18:47:57.088055] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:47:57.854372] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-30T18:47:58.182484] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:47:58.654372] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-30T18:47:59.104219] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T18:47:59.209350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:47:59.454351] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-30T18:48:00.254347] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-30T18:48:00.476849] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:48:01.054512] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-30T18:48:01.090510] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:48:01.102055] [INFO ] [REMOTE ] FLS: Full fetch complete (71525 records). [2025-09-30T18:48:01.102222] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-30T18:48:01.301251] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:48:01.548513] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-30T18:48:01.548608] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-30T18:48:01.549557] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-30T18:48:01.549622] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-30T18:48:01.551271] [DEBUG] [LOCAL ] FLS: Trimmed 71525 records to 50162 (keeping 200 days of data) [2025-09-30T18:48:01.854589] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-30T18:48:01.870147] [DEBUG] [LOCAL ] FLS: Primary data saved (50162 records). [2025-09-30T18:48:01.870289] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-30T18:48:01.870373] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 29.3s. Estimated remaining: 3h 13m 55s. Rate: 7.9 symbols/min [2025-09-30T18:48:02.060865] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:02.069412] [DEBUG] [LOCAL ] FMN: Loaded 5776 existing records from primary storage. [2025-09-30T18:48:02.069629] [INFO ] [MAIN ] FMN: Loaded 5776 existing records. [2025-09-30T18:48:02.266750] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:02.266980] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-30T18:48:02.267076] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-30T18:48:02.267318] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-30T18:48:02.267391] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-30T18:48:02.654631] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-30T18:48:02.678387] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:02.866875] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:48:03.199199] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:48:03.206282] [INFO ] [REMOTE ] FLXR: Full fetch complete (25415 records). [2025-09-30T18:48:03.206453] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-30T18:48:03.459681] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-30T18:48:03.840363] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-30T18:48:03.840547] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-30T18:48:03.841707] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-30T18:48:03.841795] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-30T18:48:03.843283] [DEBUG] [LOCAL ] FLXR: Trimmed 25415 records to 20265 (keeping 200 days of data) [2025-09-30T18:48:04.046959] [DEBUG] [LOCAL ] FLXR: Primary data saved (20265 records). [2025-09-30T18:48:04.047246] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-30T18:48:04.047476] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 27.3s. Estimated remaining: 3h 13m 37s. Rate: 7.9 symbols/min [2025-09-30T18:48:04.260955] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-30T18:48:04.275327] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:04.314931] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:48:04.348464] [DEBUG] [LOCAL ] FMS: Loaded 30196 existing records from primary storage. [2025-09-30T18:48:04.348778] [INFO ] [MAIN ] FMS: Loaded 30196 existing records. [2025-09-30T18:48:04.544244] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:04.544482] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-30T18:48:04.544530] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-30T18:48:04.544871] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-30T18:48:04.544930] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-30T18:48:04.929712] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:05.036790] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T18:48:05.054335] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-30T18:48:05.303640] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:48:05.837413] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:48:05.854300] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-30T18:48:06.605981] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:48:06.654359] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-30T18:48:07.444834] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T18:48:07.454302] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-30T18:48:07.971424] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T18:48:08.254413] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-30T18:48:09.054376] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-30T18:48:09.471067] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:48:09.854384] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-30T18:48:10.658582] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-30T18:48:10.665474] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:48:11.454324] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-30T18:48:11.573376] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T18:48:11.623982] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:48:11.791963] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:48:12.254379] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-30T18:48:13.054453] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-30T18:48:13.854369] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-30T18:48:14.015546] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T18:48:14.624733] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T18:48:14.654362] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-30T18:48:14.954245] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:48:14.965439] [INFO ] [REMOTE ] FLUT: Full fetch complete (72794 records). [2025-09-30T18:48:14.965741] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-30T18:48:15.403151] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-30T18:48:15.403356] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-30T18:48:15.404332] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-30T18:48:15.404401] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-30T18:48:15.406064] [DEBUG] [LOCAL ] FLUT: Trimmed 72794 records to 50769 (keeping 200 days of data) [2025-09-30T18:48:15.461130] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-30T18:48:15.783225] [DEBUG] [LOCAL ] FLUT: Primary data saved (50769 records). [2025-09-30T18:48:15.783384] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-30T18:48:15.783512] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 40.0s. Estimated remaining: 3h 13m 37s. Rate: 7.9 symbols/min [2025-09-30T18:48:15.961785] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:48:16.000828] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:16.044149] [DEBUG] [LOCAL ] FMX: Loaded 40666 existing records from primary storage. [2025-09-30T18:48:16.044469] [INFO ] [MAIN ] FMX: Loaded 40666 existing records. [2025-09-30T18:48:16.164328] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T18:48:16.257577] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-30T18:48:16.261165] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:16.262527] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-30T18:48:16.262585] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-30T18:48:16.263093] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-30T18:48:16.263173] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-30T18:48:16.661130] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:16.999884] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T18:48:17.054397] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-30T18:48:17.854378] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-30T18:48:17.872668] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T18:48:17.874337] [INFO ] [REMOTE ] FMN: Full fetch complete (10022 records). [2025-09-30T18:48:17.874412] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-30T18:48:18.307017] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-30T18:48:18.307100] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-30T18:48:18.307359] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-30T18:48:18.307399] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-30T18:48:18.308026] [DEBUG] [LOCAL ] FMN: Trimmed 10022 records to 5711 (keeping 200 days of data) [2025-09-30T18:48:18.344743] [DEBUG] [LOCAL ] FMN: Primary data saved (5711 records). [2025-09-30T18:48:18.344878] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-30T18:48:18.344967] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 16.5s. Estimated remaining: 3h 13m 20s. Rate: 7.9 symbols/min [2025-09-30T18:48:18.528786] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:18.533141] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-30T18:48:18.533347] [INFO ] [MAIN ] FMY: Loaded 1400 existing records. [2025-09-30T18:48:18.659467] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-30T18:48:18.737579] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:18.737991] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-30T18:48:18.738111] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-30T18:48:18.738412] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-30T18:48:18.738489] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-30T18:48:19.168045] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:19.454351] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-30T18:48:19.601814] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:48:19.721828] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-30T18:48:20.161309] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:48:20.254444] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-30T18:48:21.054400] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-30T18:48:21.413360] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-30T18:48:21.854368] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-30T18:48:22.122869] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:48:22.654423] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-30T18:48:22.924969] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T18:48:23.454359] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-30T18:48:24.036568] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:48:24.254403] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-30T18:48:24.719798] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:48:24.946906] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:48:25.054384] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-30T18:48:25.854385] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-30T18:48:26.230059] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T18:48:26.229929] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:48:26.654410] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-30T18:48:27.085633] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:48:27.454408] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-30T18:48:28.254327] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-30T18:48:28.561421] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:48:28.626660] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T18:48:29.054412] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-30T18:48:29.854360] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-30T18:48:30.493503] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:48:30.654412] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-30T18:48:31.454376] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-30T18:48:31.596980] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:48:31.818744] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-30T18:48:31.911344] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:48:32.254370] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-30T18:48:33.054393] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-30T18:48:33.505706] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:48:33.854418] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-30T18:48:34.047200] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:48:34.654377] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-30T18:48:35.404061] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:48:35.454374] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-30T18:48:36.254376] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-30T18:48:36.393342] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:48:36.623385] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:48:37.054393] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-30T18:48:37.413248] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:48:37.502497] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T18:48:37.854378] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-30T18:48:38.654384] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-30T18:48:39.131247] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T18:48:39.132566] [INFO ] [REMOTE ] FMY: Full fetch complete (1979 records). [2025-09-30T18:48:39.151094] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-30T18:48:39.193382] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:48:39.459587] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-30T18:48:39.560141] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-30T18:48:39.560243] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-30T18:48:39.560377] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-30T18:48:39.560481] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-30T18:48:39.560884] [DEBUG] [LOCAL ] FMY: Trimmed 1979 records to 1401 (keeping 200 days of data) [2025-09-30T18:48:39.571713] [DEBUG] [LOCAL ] FMY: Primary data saved (1401 records). [2025-09-30T18:48:39.571794] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-30T18:48:39.571974] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMY took 21.2s. Estimated remaining: 3h 13m 37s. Rate: 7.8 symbols/min [2025-09-30T18:48:39.752187] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:39.807086] [DEBUG] [LOCAL ] FN: Loaded 38886 existing records from primary storage. [2025-09-30T18:48:39.807391] [INFO ] [MAIN ] FN: Loaded 38886 existing records. [2025-09-30T18:48:40.002923] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:40.003202] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-30T18:48:40.003278] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-30T18:48:40.003671] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-30T18:48:40.003750] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-30T18:48:40.259512] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-30T18:48:40.384439] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:41.054358] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-30T18:48:41.503063] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:48:41.515244] [INFO ] [REMOTE ] FMC: Full fetch complete (75078 records). [2025-09-30T18:48:41.515440] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-30T18:48:41.860564] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-30T18:48:41.982824] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:48:42.012525] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-30T18:48:42.012986] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-30T18:48:42.014370] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-30T18:48:42.014463] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-30T18:48:42.016377] [DEBUG] [LOCAL ] FMC: Trimmed 75078 records to 51779 (keeping 200 days of data) [2025-09-30T18:48:42.372869] [DEBUG] [LOCAL ] FMC: Primary data saved (51779 records). [2025-09-30T18:48:42.373077] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-30T18:48:42.374278] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMC took 46.2s. Estimated remaining: 3h 13m 21s. Rate: 7.9 symbols/min [2025-09-30T18:48:42.576685] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:42.630586] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:48:42.637961] [INFO ] [REMOTE ] FMS: Full fetch complete (42396 records). [2025-09-30T18:48:42.638088] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-30T18:48:42.660967] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-30T18:48:42.788245] [DEBUG] [LOCAL ] FNB: Loaded 52447 existing records from primary storage. [2025-09-30T18:48:42.809819] [INFO ] [MAIN ] FNB: Loaded 52447 existing records. [2025-09-30T18:48:43.315346] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:43.342943] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-30T18:48:43.343126] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-30T18:48:43.379390] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-30T18:48:43.371511] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-30T18:48:43.386948] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-30T18:48:43.387029] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-30T18:48:43.401507] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-30T18:48:43.407501] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-30T18:48:43.409099] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:48:43.482052] [DEBUG] [LOCAL ] FMS: Trimmed 42396 records to 30147 (keeping 200 days of data) [2025-09-30T18:48:43.476425] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-30T18:48:43.920933] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:44.010235] [DEBUG] [LOCAL ] FMS: Primary data saved (30147 records). [2025-09-30T18:48:44.010439] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-30T18:48:44.010576] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMS took 40.0s. Estimated remaining: 3h 13m 3s. Rate: 7.9 symbols/min [2025-09-30T18:48:44.211067] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:44.265255] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-30T18:48:44.286686] [DEBUG] [LOCAL ] FND: Loaded 52098 existing records from primary storage. [2025-09-30T18:48:44.302296] [INFO ] [MAIN ] FND: Loaded 52098 existing records. [2025-09-30T18:48:44.310176] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:48:44.537132] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:44.537396] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-30T18:48:44.537465] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-30T18:48:44.537880] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-30T18:48:44.537940] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-30T18:48:44.942633] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:44.964525] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:48:45.054388] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-30T18:48:45.854359] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-30T18:48:46.013199] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:48:46.238321] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:48:46.654386] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-30T18:48:47.454366] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-30T18:48:47.504745] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:48:48.180862] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:48:48.254360] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-30T18:48:49.054387] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-30T18:48:49.271620] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:48:49.854386] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-30T18:48:49.897389] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:48:50.654339] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-30T18:48:50.846217] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T18:48:51.203925] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T18:48:51.454371] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-30T18:48:52.254327] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-30T18:48:52.357611] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:48:52.367437] [INFO ] [REMOTE ] FMX: Full fetch complete (57726 records). [2025-09-30T18:48:52.367605] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-30T18:48:52.812308] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-30T18:48:52.812417] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-30T18:48:52.813750] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-30T18:48:52.813828] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-30T18:48:52.815135] [DEBUG] [LOCAL ] FMX: Trimmed 57726 records to 40706 (keeping 200 days of data) [2025-09-30T18:48:53.055794] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-30T18:48:53.087246] [DEBUG] [LOCAL ] FMX: Primary data saved (40706 records). [2025-09-30T18:48:53.087386] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-30T18:48:53.087494] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMX took 37.3s. Estimated remaining: 3h 12m 57s. Rate: 7.9 symbols/min [2025-09-30T18:48:53.277287] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:53.311932] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T18:48:53.370815] [DEBUG] [LOCAL ] FNF: Loaded 49115 existing records from primary storage. [2025-09-30T18:48:53.371191] [INFO ] [MAIN ] FNF: Loaded 49115 existing records. [2025-09-30T18:48:53.578782] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:53.579057] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-30T18:48:53.579304] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-30T18:48:53.579885] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-30T18:48:53.579947] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-30T18:48:53.876945] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-30T18:48:53.991318] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:54.030419] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T18:48:54.654354] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-30T18:48:54.687465] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:48:55.410270] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:48:55.454345] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-30T18:48:56.212002] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:48:56.254360] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-30T18:48:57.054361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-30T18:48:57.206020] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:48:57.760801] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:48:57.854374] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-30T18:48:58.654367] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-30T18:48:58.769327] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:48:59.454366] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-30T18:48:59.643789] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:49:00.254336] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-30T18:49:00.442687] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T18:49:01.054386] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-30T18:49:01.311541] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:49:01.767045] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T18:49:01.854372] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-30T18:49:01.989541] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:49:02.654353] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-30T18:49:03.454359] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-30T18:49:03.663736] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:49:04.266891] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-30T18:49:04.273495] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:49:04.834481] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:49:05.054408] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-30T18:49:05.854357] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-30T18:49:05.930920] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:49:06.654331] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-30T18:49:06.858342] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:49:07.129932] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T18:49:07.454361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-30T18:49:08.254336] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-30T18:49:08.350891] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:49:09.054349] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-30T18:49:09.182900] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:49:09.854356] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-30T18:49:09.904700] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:49:10.661797] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-30T18:49:10.669097] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T18:49:11.454360] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-30T18:49:11.670588] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:49:11.682132] [INFO ] [REMOTE ] FNB: Full fetch complete (75813 records). [2025-09-30T18:49:11.682314] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-30T18:49:12.114837] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-30T18:49:12.114996] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-30T18:49:12.116129] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-30T18:49:12.116308] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-30T18:49:12.118042] [DEBUG] [LOCAL ] FNB: Trimmed 75813 records to 52455 (keeping 200 days of data) [2025-09-30T18:49:12.254471] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-30T18:49:12.399328] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:49:12.520304] [DEBUG] [LOCAL ] FNB: Primary data saved (52455 records). [2025-09-30T18:49:12.520465] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-30T18:49:12.521618] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FNB took 30.1s. Estimated remaining: 3h 13m 11s. Rate: 7.8 symbols/min [2025-09-30T18:49:12.697392] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:12.748021] [DEBUG] [LOCAL ] FNV: Loaded 46253 existing records from primary storage. [2025-09-30T18:49:12.748403] [INFO ] [MAIN ] FNV: Loaded 46253 existing records. [2025-09-30T18:49:12.953414] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:12.953950] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-30T18:49:12.954020] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-30T18:49:12.954714] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-30T18:49:12.954786] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-30T18:49:13.063413] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-30T18:49:13.354950] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:13.396215] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:49:13.854366] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-30T18:49:14.016422] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:49:14.024703] [INFO ] [REMOTE ] FN: Full fetch complete (56375 records). [2025-09-30T18:49:14.024834] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-30T18:49:14.535866] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-30T18:49:14.536046] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-30T18:49:14.537045] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-30T18:49:14.537115] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-30T18:49:14.538474] [DEBUG] [LOCAL ] FN: Trimmed 56375 records to 38754 (keeping 200 days of data) [2025-09-30T18:49:14.654518] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-30T18:49:14.803925] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:49:14.842610] [DEBUG] [LOCAL ] FN: Primary data saved (38754 records). [2025-09-30T18:49:14.842777] [INFO ] [MAIN ] FN: Full history saved. [2025-09-30T18:49:14.842879] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FN took 35.3s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-09-30T18:49:15.021267] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:15.037759] [DEBUG] [LOCAL ] FOA: Loaded 13128 existing records from primary storage. [2025-09-30T18:49:15.037997] [INFO ] [MAIN ] FOA: Loaded 13128 existing records. [2025-09-30T18:49:15.238336] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:15.238594] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-30T18:49:15.238661] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-30T18:49:15.239342] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-30T18:49:15.239402] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-30T18:49:15.457765] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-30T18:49:15.640614] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:15.661591] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:49:16.180795] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:49:16.254442] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-30T18:49:17.054365] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-30T18:49:17.484185] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:49:17.495769] [INFO ] [REMOTE ] FND: Full fetch complete (74485 records). [2025-09-30T18:49:17.495964] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-30T18:49:17.855085] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-30T18:49:17.861883] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T18:49:17.967227] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-30T18:49:17.967365] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-30T18:49:17.968409] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-30T18:49:17.968495] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-30T18:49:17.971278] [DEBUG] [LOCAL ] FND: Trimmed 74485 records to 52101 (keeping 200 days of data) [2025-09-30T18:49:18.293302] [DEBUG] [LOCAL ] FND: Primary data saved (52101 records). [2025-09-30T18:49:18.293450] [INFO ] [MAIN ] FND: Full history saved. [2025-09-30T18:49:18.293632] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FND took 34.3s. Estimated remaining: 3h 12m 39s. Rate: 7.9 symbols/min [2025-09-30T18:49:18.475377] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:18.486734] [DEBUG] [LOCAL ] FOF: Loaded 8434 existing records from primary storage. [2025-09-30T18:49:18.486922] [INFO ] [MAIN ] FOF: Loaded 8434 existing records. [2025-09-30T18:49:18.656264] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-30T18:49:18.690083] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:18.690582] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-30T18:49:18.690685] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-30T18:49:18.690889] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-30T18:49:18.690950] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-30T18:49:18.885269] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:49:19.115479] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:19.293118] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:49:19.306162] [INFO ] [REMOTE ] FNF: Full fetch complete (69611 records). [2025-09-30T18:49:19.306319] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-30T18:49:19.465611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-30T18:49:19.745633] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:49:19.843375] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-30T18:49:19.843474] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-30T18:49:19.844432] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-30T18:49:19.844504] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-30T18:49:19.846128] [DEBUG] [LOCAL ] FNF: Trimmed 69611 records to 49101 (keeping 200 days of data) [2025-09-30T18:49:20.160625] [DEBUG] [LOCAL ] FNF: Primary data saved (49101 records). [2025-09-30T18:49:20.160812] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-30T18:49:20.160932] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 27.1s. Estimated remaining: 3h 12m 21s. Rate: 7.9 symbols/min [2025-09-30T18:49:20.260985] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-30T18:49:20.338250] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:20.362630] [DEBUG] [LOCAL ] FOR: Loaded 19910 existing records from primary storage. [2025-09-30T18:49:20.362944] [INFO ] [MAIN ] FOR: Loaded 19910 existing records. [2025-09-30T18:49:20.549621] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:20.549900] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-30T18:49:20.549948] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-30T18:49:20.550208] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-30T18:49:20.550265] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-30T18:49:20.967070] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:21.054367] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-30T18:49:21.155373] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:49:21.232223] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:49:21.751468] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:49:21.854346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-30T18:49:22.581246] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:49:22.654341] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-30T18:49:23.413437] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T18:49:23.454404] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-30T18:49:24.203936] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:49:24.254351] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-30T18:49:25.054424] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-30T18:49:25.746770] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T18:49:25.835104] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:49:25.854322] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-30T18:49:26.654369] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-30T18:49:27.454326] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-30T18:49:27.498003] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:49:27.500815] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:49:28.254365] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-30T18:49:28.704459] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:49:29.054377] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-30T18:49:29.819236] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:49:29.854315] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-30T18:49:30.090548] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:49:30.654378] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-30T18:49:31.250742] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T18:49:31.288868] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:49:31.454375] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-30T18:49:32.254420] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-30T18:49:33.054333] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-30T18:49:33.091601] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:49:33.206037] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:49:33.804544] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T18:49:33.854367] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-30T18:49:34.583291] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:49:34.654337] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-30T18:49:35.454416] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-30T18:49:36.121987] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T18:49:36.254400] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-30T18:49:36.623358] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:49:37.054384] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-30T18:49:37.854329] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-30T18:49:38.031867] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:49:38.041528] [INFO ] [REMOTE ] FNV: Full fetch complete (66175 records). [2025-09-30T18:49:38.041720] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-30T18:49:38.220808] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T18:49:38.497113] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-30T18:49:38.497209] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-30T18:49:38.498103] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-30T18:49:38.498200] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-30T18:49:38.499688] [DEBUG] [LOCAL ] FNV: Trimmed 66175 records to 46188 (keeping 200 days of data) [2025-09-30T18:49:38.690586] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-30T18:49:38.814322] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T18:49:38.831048] [DEBUG] [LOCAL ] FNV: Primary data saved (46188 records). [2025-09-30T18:49:38.831186] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-30T18:49:38.831838] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 26.3s. Estimated remaining: 3h 12m 33s. Rate: 7.8 symbols/min [2025-09-30T18:49:39.022915] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:39.079168] [DEBUG] [LOCAL ] FOUR: Loaded 49547 existing records from primary storage. [2025-09-30T18:49:39.079508] [INFO ] [MAIN ] FOUR: Loaded 49547 existing records. [2025-09-30T18:49:39.275213] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:39.275492] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-30T18:49:39.275552] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-30T18:49:39.275930] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-30T18:49:39.275991] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-30T18:49:39.461613] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-30T18:49:39.659126] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:39.678373] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T18:49:40.254384] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-30T18:49:40.428875] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:49:40.433146] [INFO ] [REMOTE ] FOA: Full fetch complete (22507 records). [2025-09-30T18:49:40.433352] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-30T18:49:40.826115] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-30T18:49:40.826201] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-30T18:49:40.826769] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-30T18:49:40.826839] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-30T18:49:40.827457] [DEBUG] [LOCAL ] FOA: Trimmed 22507 records to 13156 (keeping 200 days of data) [2025-09-30T18:49:40.907968] [DEBUG] [LOCAL ] FOA: Primary data saved (13156 records). [2025-09-30T18:49:40.908111] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-30T18:49:40.908255] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOA took 26.1s. Estimated remaining: 3h 12m 15s. Rate: 7.9 symbols/min [2025-09-30T18:49:41.059570] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-30T18:49:41.087363] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:41.108046] [DEBUG] [LOCAL ] FPF: Loaded 17885 existing records from primary storage. [2025-09-30T18:49:41.108325] [INFO ] [MAIN ] FPF: Loaded 17885 existing records. [2025-09-30T18:49:41.300558] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:41.300829] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-30T18:49:41.300886] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-30T18:49:41.301164] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-30T18:49:41.301225] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-30T18:49:41.695907] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:41.854346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-30T18:49:41.874590] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:49:41.921387] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:49:42.556431] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T18:49:42.654355] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-30T18:49:43.454352] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-30T18:49:43.485712] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:49:44.254379] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-30T18:49:44.445045] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T18:49:45.054340] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-30T18:49:45.202337] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T18:49:45.854381] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-30T18:49:46.654402] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-30T18:49:46.693401] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T18:49:46.726834] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:49:47.454367] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-30T18:49:47.659499] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T18:49:48.254363] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-30T18:49:49.047395] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:49:49.057257] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-30T18:49:49.372000] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:49:49.376408] [INFO ] [REMOTE ] FOR: Full fetch complete (29955 records). [2025-09-30T18:49:49.376515] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-30T18:49:49.809083] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-30T18:49:49.809216] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-30T18:49:49.809793] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-30T18:49:49.809864] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-30T18:49:49.810692] [DEBUG] [LOCAL ] FOR: Trimmed 29955 records to 19856 (keeping 200 days of data) [2025-09-30T18:49:49.865356] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-30T18:49:49.942988] [DEBUG] [LOCAL ] FOR: Primary data saved (19856 records). [2025-09-30T18:49:49.943151] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-30T18:49:49.943244] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 29.8s. Estimated remaining: 3h 12m 10s. Rate: 7.9 symbols/min [2025-09-30T18:49:50.075398] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:49:50.156697] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:50.176740] [DEBUG] [LOCAL ] FPH: Loaded 19569 existing records from primary storage. [2025-09-30T18:49:50.177002] [INFO ] [MAIN ] FPH: Loaded 19569 existing records. [2025-09-30T18:49:50.370075] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:50.370295] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-30T18:49:50.370345] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-30T18:49:50.370560] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-30T18:49:50.370619] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-30T18:49:50.659525] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-30T18:49:50.770262] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:51.454344] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-30T18:49:51.479019] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:49:51.821722] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T18:49:52.254333] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-30T18:49:52.388892] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T18:49:52.780166] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T18:49:53.054358] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-30T18:49:53.788941] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T18:49:53.854344] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-30T18:49:54.654340] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-30T18:49:54.733817] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T18:49:54.736581] [INFO ] [REMOTE ] FOF: Full fetch complete (11871 records). [2025-09-30T18:49:54.736696] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-30T18:49:55.133120] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-30T18:49:55.133215] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-30T18:49:55.133564] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-30T18:49:55.133626] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-30T18:49:55.134183] [DEBUG] [LOCAL ] FOF: Trimmed 11871 records to 8432 (keeping 200 days of data) [2025-09-30T18:49:55.192849] [DEBUG] [LOCAL ] FOF: Primary data saved (8432 records). [2025-09-30T18:49:55.193020] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-30T18:49:55.193126] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOF took 36.9s. Estimated remaining: 3h 11m 58s. Rate: 7.9 symbols/min [2025-09-30T18:49:55.395593] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:55.437771] [DEBUG] [LOCAL ] FPI: Loaded 31022 existing records from primary storage. [2025-09-30T18:49:55.438062] [INFO ] [MAIN ] FPI: Loaded 31022 existing records. [2025-09-30T18:49:55.459708] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-30T18:49:55.635771] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:55.635982] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-30T18:49:55.636028] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-30T18:49:55.636596] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-30T18:49:55.636689] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-30T18:49:56.033277] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:56.081231] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T18:49:56.254332] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-30T18:49:56.569093] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:49:57.054361] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-30T18:49:57.854347] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-30T18:49:57.956601] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:49:57.978253] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:49:58.654356] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-30T18:49:59.218482] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:49:59.454356] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-30T18:50:00.254328] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-30T18:50:00.296261] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:50:00.505579] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:50:01.054781] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-30T18:50:01.057025] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T18:50:01.854355] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-30T18:50:02.641088] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:50:02.654331] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-30T18:50:03.202265] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:50:03.454333] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-30T18:50:03.824202] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:50:04.254387] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-30T18:50:04.801626] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:50:05.054359] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-30T18:50:05.403912] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:50:05.854362] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-30T18:50:06.654401] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-30T18:50:06.984486] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T18:50:07.047673] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:50:07.454366] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-30T18:50:07.709752] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T18:50:08.254421] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-30T18:50:08.609449] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T18:50:09.054416] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-30T18:50:09.854321] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-30T18:50:10.184205] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T18:50:10.223422] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T18:50:10.234735] [INFO ] [REMOTE ] FOUR: Full fetch complete (71980 records). [2025-09-30T18:50:10.234905] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-30T18:50:10.664552] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-30T18:50:10.671618] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-30T18:50:10.671722] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-30T18:50:10.672698] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-30T18:50:10.672860] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-30T18:50:10.674599] [DEBUG] [LOCAL ] FOUR: Trimmed 71980 records to 49547 (keeping 200 days of data) [2025-09-30T18:50:10.934259] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:50:11.024001] [DEBUG] [LOCAL ] FOUR: Primary data saved (49547 records). [2025-09-30T18:50:11.024155] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-30T18:50:11.024844] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FOUR took 32.2s. Estimated remaining: 3h 12m 5s. Rate: 7.8 symbols/min [2025-09-30T18:50:11.210434] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:11.260013] [DEBUG] [LOCAL ] FR: Loaded 46393 existing records from primary storage. [2025-09-30T18:50:11.260355] [INFO ] [MAIN ] FR: Loaded 46393 existing records. [2025-09-30T18:50:11.460258] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:11.460379] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-30T18:50:11.461865] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-30T18:50:11.462075] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-30T18:50:11.462617] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-30T18:50:11.462760] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-30T18:50:11.807160] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:50:11.897720] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:12.254331] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-30T18:50:12.397883] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T18:50:12.971008] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T18:50:13.054382] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-30T18:50:13.854380] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-30T18:50:14.122604] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:50:14.127243] [INFO ] [REMOTE ] FPF: Full fetch complete (26579 records). [2025-09-30T18:50:14.127384] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-30T18:50:14.540844] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-30T18:50:14.540971] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-30T18:50:14.541789] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-30T18:50:14.541874] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-30T18:50:14.553602] [DEBUG] [LOCAL ] FPF: Trimmed 26579 records to 18101 (keeping 200 days of data) [2025-09-30T18:50:14.553465] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T18:50:14.661312] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-30T18:50:14.678089] [DEBUG] [LOCAL ] FPF: Primary data saved (18101 records). [2025-09-30T18:50:14.678279] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-30T18:50:14.678384] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 33.8s. Estimated remaining: 3h 11m 50s. Rate: 7.9 symbols/min [2025-09-30T18:50:14.871437] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:14.890040] [DEBUG] [LOCAL ] FRA: Loaded 14517 existing records from primary storage. [2025-09-30T18:50:14.890285] [INFO ] [MAIN ] FRA: Loaded 14517 existing records. [2025-09-30T18:50:15.104065] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:15.104320] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-30T18:50:15.104381] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-30T18:50:15.104701] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-30T18:50:15.104762] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-30T18:50:15.459533] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-30T18:50:15.524439] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:16.236051] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T18:50:16.254311] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-30T18:50:16.625688] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:50:17.054401] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-30T18:50:17.692695] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:50:17.854378] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-30T18:50:18.340155] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:50:18.654363] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-30T18:50:19.227204] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:50:19.454402] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-30T18:50:20.254318] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-30T18:50:20.287611] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:50:20.525996] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:50:20.533364] [INFO ] [REMOTE ] FPH: Full fetch complete (31407 records). [2025-09-30T18:50:20.533526] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-30T18:50:21.002223] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-30T18:50:21.002303] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-30T18:50:21.002920] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-30T18:50:21.002984] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-30T18:50:21.003811] [DEBUG] [LOCAL ] FPH: Trimmed 31407 records to 19466 (keeping 200 days of data) [2025-09-30T18:50:21.057102] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-30T18:50:21.119388] [DEBUG] [LOCAL ] FPH: Primary data saved (19466 records). [2025-09-30T18:50:21.119545] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-30T18:50:21.119629] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPH took 31.2s. Estimated remaining: 3h 11m 40s. Rate: 7.9 symbols/min [2025-09-30T18:50:21.316071] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:21.325017] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:50:21.351347] [DEBUG] [LOCAL ] FRGE: Loaded 17953 existing records from primary storage. [2025-09-30T18:50:21.351668] [INFO ] [MAIN ] FRGE: Loaded 17953 existing records. [2025-09-30T18:50:21.552472] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:21.552729] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-30T18:50:21.552788] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-30T18:50:21.553059] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-30T18:50:21.553121] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-30T18:50:21.860049] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-30T18:50:22.015453] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:22.424195] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:50:22.654403] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-30T18:50:23.067888] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:50:23.454366] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-30T18:50:24.254402] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-30T18:50:24.323926] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:50:24.966346] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:50:25.054370] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-30T18:50:25.227043] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:50:25.854384] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-30T18:50:26.654365] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-30T18:50:26.706615] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:50:27.020511] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:50:27.454371] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-30T18:50:27.621008] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:50:28.254410] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-30T18:50:28.661574] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:50:29.054387] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-30T18:50:29.656627] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:50:29.854362] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-30T18:50:29.921608] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T18:50:30.654401] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-30T18:50:31.225032] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:50:31.454403] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-30T18:50:31.484243] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T18:50:32.254372] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-30T18:50:33.023602] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:50:33.054317] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-30T18:50:33.336444] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T18:50:33.854397] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-30T18:50:34.633537] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:50:34.654330] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-30T18:50:35.379392] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:50:35.388310] [INFO ] [REMOTE ] FPI: Full fetch complete (44233 records). [2025-09-30T18:50:35.388541] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-30T18:50:35.464309] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-30T18:50:35.869025] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-30T18:50:35.869161] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-30T18:50:35.869876] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-30T18:50:35.869940] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-30T18:50:35.871098] [DEBUG] [LOCAL ] FPI: Trimmed 44233 records to 31004 (keeping 200 days of data) [2025-09-30T18:50:36.070995] [DEBUG] [LOCAL ] FPI: Primary data saved (31004 records). [2025-09-30T18:50:36.071137] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-30T18:50:36.071249] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 40.9s. Estimated remaining: 3h 11m 45s. Rate: 7.8 symbols/min [2025-09-30T18:50:36.255914] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-30T18:50:36.259968] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:36.318165] [DEBUG] [LOCAL ] FRO: Loaded 51814 existing records from primary storage. [2025-09-30T18:50:36.318616] [INFO ] [MAIN ] FRO: Loaded 51814 existing records. [2025-09-30T18:50:36.545459] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:36.556864] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:50:36.558716] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-30T18:50:36.559523] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-30T18:50:36.565462] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:50:36.576775] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-30T18:50:36.577517] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-30T18:50:36.998925] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:37.054341] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-30T18:50:37.518337] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T18:50:37.854377] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-30T18:50:38.519419] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T18:50:38.654409] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-30T18:50:39.454346] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-30T18:50:39.886338] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T18:50:40.254892] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-30T18:50:40.274403] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:50:40.285629] [INFO ] [REMOTE ] FR: Full fetch complete (66615 records). [2025-09-30T18:50:40.285825] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-30T18:50:40.431619] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:50:40.728789] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-30T18:50:40.728883] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-30T18:50:40.729780] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-30T18:50:40.729853] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-30T18:50:40.731317] [DEBUG] [LOCAL ] FR: Trimmed 66615 records to 46417 (keeping 200 days of data) [2025-09-30T18:50:41.048035] [DEBUG] [LOCAL ] FR: Primary data saved (46417 records). [2025-09-30T18:50:41.048240] [INFO ] [MAIN ] FR: Full history saved. [2025-09-30T18:50:41.049625] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 30.0s. Estimated remaining: 3h 11m 33s. Rate: 7.8 symbols/min [2025-09-30T18:50:41.055031] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-30T18:50:41.181872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:50:41.255332] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:41.303469] [DEBUG] [LOCAL ] FRT: Loaded 42096 existing records from primary storage. [2025-09-30T18:50:41.303813] [INFO ] [MAIN ] FRT: Loaded 42096 existing records. [2025-09-30T18:50:41.504275] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:41.504487] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-30T18:50:41.504552] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-30T18:50:41.505013] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-30T18:50:41.505079] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-30T18:50:41.868420] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-30T18:50:41.914005] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:42.654393] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-30T18:50:42.788535] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T18:50:42.792261] [INFO ] [REMOTE ] FRA: Full fetch complete (24117 records). [2025-09-30T18:50:42.792368] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-30T18:50:43.202867] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-30T18:50:43.202955] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-30T18:50:43.203523] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-30T18:50:43.203588] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-30T18:50:43.204414] [DEBUG] [LOCAL ] FRA: Trimmed 24117 records to 14539 (keeping 200 days of data) [2025-09-30T18:50:43.316722] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T18:50:43.360025] [DEBUG] [LOCAL ] FRA: Primary data saved (14539 records). [2025-09-30T18:50:43.360182] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-30T18:50:43.360269] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRA took 28.7s. Estimated remaining: 3h 11m 16s. Rate: 7.9 symbols/min [2025-09-30T18:50:43.459550] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-30T18:50:43.560321] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:43.603994] [DEBUG] [LOCAL ] FSCO: Loaded 37264 existing records from primary storage. [2025-09-30T18:50:43.604385] [INFO ] [MAIN ] FSCO: Loaded 37264 existing records. [2025-09-30T18:50:43.808932] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:43.809164] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-30T18:50:43.809213] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-30T18:50:43.809573] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-30T18:50:43.809629] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-30T18:50:44.229501] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:44.251945] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:50:44.259462] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-30T18:50:45.054367] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-30T18:50:45.140081] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:50:45.703328] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:50:45.854372] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-30T18:50:45.882957] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:50:46.654379] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-30T18:50:47.302481] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:50:47.454385] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-30T18:50:47.720074] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T18:50:48.254370] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-30T18:50:48.581722] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:50:49.054405] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-30T18:50:49.854328] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-30T18:50:49.998768] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:50:50.002121] [INFO ] [REMOTE ] FRGE: Full fetch complete (32973 records). [2025-09-30T18:50:50.002220] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-30T18:50:50.451506] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-30T18:50:50.451743] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-30T18:50:50.452613] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-30T18:50:50.452784] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-30T18:50:50.487960] [DEBUG] [LOCAL ] FRGE: Trimmed 32973 records to 17802 (keeping 200 days of data) [2025-09-30T18:50:50.491121] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T18:50:50.651507] [DEBUG] [LOCAL ] FRGE: Primary data saved (17802 records). [2025-09-30T18:50:50.651678] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-30T18:50:50.651893] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 29.5s. Estimated remaining: 3h 11m 8s. Rate: 7.9 symbols/min [2025-09-30T18:50:50.659430] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-30T18:50:50.836379] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:50.890346] [DEBUG] [LOCAL ] FSK: Loaded 49406 existing records from primary storage. [2025-09-30T18:50:50.890746] [INFO ] [MAIN ] FSK: Loaded 49406 existing records. [2025-09-30T18:50:51.084158] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:51.084513] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-30T18:50:51.084735] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-30T18:50:51.085227] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-30T18:50:51.085344] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-30T18:50:51.223587] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T18:50:51.464021] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-30T18:50:51.510907] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:52.254353] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-30T18:50:52.600117] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T18:50:53.014474] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:50:53.054376] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-30T18:50:53.854478] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-30T18:50:54.108011] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:50:54.444584] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:50:54.654366] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-30T18:50:54.880934] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:50:55.454378] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-30T18:50:56.254369] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-30T18:50:56.310041] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:50:56.388408] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T18:50:57.054369] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-30T18:50:57.854380] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-30T18:50:58.062166] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:50:58.654361] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-30T18:50:58.728596] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:50:59.463117] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-30T18:50:59.483502] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:50:59.661891] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T18:51:00.254362] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-30T18:51:01.054446] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-30T18:51:01.469542] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:51:01.854436] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-30T18:51:01.941482] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:51:02.595733] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:51:02.654394] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-30T18:51:03.454338] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-30T18:51:03.651990] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:51:04.254395] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-30T18:51:04.346143] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:51:04.570813] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T18:51:05.054409] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-30T18:51:05.854336] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-30T18:51:06.162216] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:51:06.174372] [INFO ] [REMOTE ] FRO: Full fetch complete (75313 records). [2025-09-30T18:51:06.174629] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-30T18:51:06.659337] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-30T18:51:06.715069] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-30T18:51:06.715347] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-30T18:51:06.716555] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-30T18:51:06.716968] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-30T18:51:06.718748] [DEBUG] [LOCAL ] FRO: Trimmed 75313 records to 51794 (keeping 200 days of data) [2025-09-30T18:51:06.974132] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:51:07.047323] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:51:07.136736] [DEBUG] [LOCAL ] FRO: Primary data saved (51794 records). [2025-09-30T18:51:07.136910] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-30T18:51:07.137091] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 31.1s. Estimated remaining: 3h 11m 16s. Rate: 7.8 symbols/min [2025-09-30T18:51:07.315625] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:07.374723] [DEBUG] [LOCAL ] FSLY: Loaded 51193 existing records from primary storage. [2025-09-30T18:51:07.375084] [INFO ] [MAIN ] FSLY: Loaded 51193 existing records. [2025-09-30T18:51:07.459551] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-30T18:51:07.571079] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:07.571319] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-30T18:51:07.571369] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-30T18:51:07.571804] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-30T18:51:07.571887] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-30T18:51:07.965658] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:08.122915] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:51:08.254358] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-30T18:51:09.054394] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-30T18:51:09.379915] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:51:09.854360] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-30T18:51:09.886709] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:51:10.150568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T18:51:10.654389] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-30T18:51:11.454331] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-30T18:51:11.738714] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:51:12.173021] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T18:51:12.254407] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-30T18:51:12.722304] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:51:12.731524] [INFO ] [REMOTE ] FSCO: Full fetch complete (54231 records). [2025-09-30T18:51:12.731716] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-30T18:51:13.054869] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-30T18:51:13.154876] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-30T18:51:13.154972] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-30T18:51:13.155835] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-30T18:51:13.155924] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-30T18:51:13.158543] [DEBUG] [LOCAL ] FSCO: Trimmed 54231 records to 37393 (keeping 200 days of data) [2025-09-30T18:51:13.409371] [DEBUG] [LOCAL ] FSCO: Primary data saved (37393 records). [2025-09-30T18:51:13.409506] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-30T18:51:13.409613] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FSCO took 30.0s. Estimated remaining: 3h 11m 6s. Rate: 7.8 symbols/min [2025-09-30T18:51:13.653196] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:13.713934] [DEBUG] [LOCAL ] FSM: Loaded 53287 existing records from primary storage. [2025-09-30T18:51:13.714249] [INFO ] [MAIN ] FSM: Loaded 53287 existing records. [2025-09-30T18:51:13.864595] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-30T18:51:13.923619] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:13.924077] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-30T18:51:13.924192] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-30T18:51:13.924728] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-30T18:51:13.924793] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-30T18:51:14.136383] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:51:14.235835] [INFO ] [REMOTE ] FRT: Full fetch complete (60247 records). [2025-09-30T18:51:14.253557] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-30T18:51:14.477744] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:14.660539] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-30T18:51:14.826969] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-30T18:51:14.827090] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-30T18:51:14.828621] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-30T18:51:14.828773] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-30T18:51:14.857425] [DEBUG] [LOCAL ] FRT: Trimmed 60247 records to 42039 (keeping 200 days of data) [2025-09-30T18:51:14.858505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:51:15.160000] [DEBUG] [LOCAL ] FRT: Primary data saved (42039 records). [2025-09-30T18:51:15.160162] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-30T18:51:15.160276] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRT took 34.1s. Estimated remaining: 3h 10m 48s. Rate: 7.9 symbols/min [2025-09-30T18:51:15.374440] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:15.417131] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:51:15.459588] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-30T18:51:15.462449] [DEBUG] [LOCAL ] FSS: Loaded 34208 existing records from primary storage. [2025-09-30T18:51:15.462941] [INFO ] [MAIN ] FSS: Loaded 34208 existing records. [2025-09-30T18:51:15.670822] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:15.671140] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-30T18:51:15.671194] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-30T18:51:15.671749] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-30T18:51:15.671810] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-30T18:51:16.081205] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:16.254416] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-30T18:51:16.492880] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:51:17.054384] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-30T18:51:17.160688] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:51:17.321885] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:51:17.854403] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-30T18:51:18.549086] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:51:18.654376] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-30T18:51:19.420560] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:51:19.454340] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-30T18:51:20.132608] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:51:20.254348] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-30T18:51:20.582961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:51:21.054369] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-30T18:51:21.854348] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-30T18:51:21.950101] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:51:22.500723] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:51:22.654374] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-30T18:51:23.454362] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-30T18:51:23.668108] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:51:24.074411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T18:51:24.254399] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-30T18:51:25.054383] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-30T18:51:25.247054] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:51:25.590598] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:51:25.854366] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-30T18:51:26.565335] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:51:26.654383] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-30T18:51:27.381601] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:51:27.454385] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-30T18:51:28.032688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:51:28.254398] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-30T18:51:29.062821] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-30T18:51:29.089242] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:51:29.224116] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:51:29.854403] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-30T18:51:30.654335] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-30T18:51:30.908408] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:51:30.920424] [INFO ] [REMOTE ] FSK: Full fetch complete (71467 records). [2025-09-30T18:51:30.920759] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-30T18:51:31.362513] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-30T18:51:31.362622] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-30T18:51:31.363698] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-30T18:51:31.363802] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-30T18:51:31.365426] [DEBUG] [LOCAL ] FSK: Trimmed 71467 records to 49397 (keeping 200 days of data) [2025-09-30T18:51:31.459852] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-30T18:51:31.719060] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:51:31.745560] [DEBUG] [LOCAL ] FSK: Primary data saved (49397 records). [2025-09-30T18:51:31.745716] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-30T18:51:31.745821] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 41.1s. Estimated remaining: 3h 10m 56s. Rate: 7.8 symbols/min [2025-09-30T18:51:31.952764] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:31.963305] [DEBUG] [LOCAL ] FT: Loaded 6436 existing records from primary storage. [2025-09-30T18:51:31.963542] [INFO ] [MAIN ] FT: Loaded 6436 existing records. [2025-09-30T18:51:32.172911] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:32.173314] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-30T18:51:32.173434] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-30T18:51:32.173819] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-30T18:51:32.174008] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-30T18:51:32.259470] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-30T18:51:32.516697] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:51:32.705070] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:32.728848] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T18:51:33.054414] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-30T18:51:33.736941] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T18:51:33.854337] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-30T18:51:34.060462] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:51:34.654403] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-30T18:51:35.160412] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:51:35.454361] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-30T18:51:36.078752] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:51:36.254408] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-30T18:51:36.873392] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T18:51:37.054361] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-30T18:51:37.213086] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:51:37.854390] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-30T18:51:38.654320] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-30T18:51:38.931491] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:51:38.942952] [INFO ] [REMOTE ] FSLY: Full fetch complete (74886 records). [2025-09-30T18:51:38.943119] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-30T18:51:39.402309] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-30T18:51:39.402483] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-30T18:51:39.403721] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-30T18:51:39.403943] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-30T18:51:39.425271] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:51:39.431598] [DEBUG] [LOCAL ] FSLY: Trimmed 74886 records to 51207 (keeping 200 days of data) [2025-09-30T18:51:39.431481] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:51:39.439226] [INFO ] [REMOTE ] FSS: Full fetch complete (48345 records). [2025-09-30T18:51:39.439323] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-30T18:51:39.461221] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-30T18:51:40.072051] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-30T18:51:40.072159] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-30T18:51:40.073721] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-30T18:51:40.074073] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-30T18:51:40.084543] [DEBUG] [LOCAL ] FSS: Trimmed 48345 records to 34149 (keeping 200 days of data) [2025-09-30T18:51:40.263200] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-30T18:51:40.302259] [DEBUG] [LOCAL ] FSLY: Primary data saved (51207 records). [2025-09-30T18:51:40.302716] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-30T18:51:40.302824] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 33.2s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-09-30T18:51:40.568968] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:40.605638] [DEBUG] [LOCAL ] FTHY: Loaded 11823 existing records from primary storage. [2025-09-30T18:51:40.607276] [INFO ] [MAIN ] FTHY: Loaded 11823 existing records. [2025-09-30T18:51:40.715588] [DEBUG] [LOCAL ] FSS: Primary data saved (34149 records). [2025-09-30T18:51:40.728504] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-30T18:51:40.729274] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 25.6s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-09-30T18:51:40.911228] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T18:51:40.924100] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:40.960335] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-30T18:51:40.974432] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-30T18:51:40.975185] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-30T18:51:40.985759] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-30T18:51:41.076398] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-30T18:51:41.129536] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:41.499228] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:41.560042] [DEBUG] [LOCAL ] FTI: Loaded 53297 existing records from primary storage. [2025-09-30T18:51:41.561031] [INFO ] [MAIN ] FTI: Loaded 53297 existing records. [2025-09-30T18:51:41.562994] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-30T18:51:41.772048] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:41.772555] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-30T18:51:41.772620] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-30T18:51:41.773403] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-30T18:51:41.773466] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-30T18:51:41.859516] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-30T18:51:42.122889] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:51:42.190248] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:42.654357] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-30T18:51:43.454331] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-30T18:51:43.779876] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:51:44.254372] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-30T18:51:44.399662] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:51:44.411955] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:51:45.054379] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-30T18:51:45.854398] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-30T18:51:46.080102] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:51:46.110116] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:51:46.556491] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T18:51:46.654365] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-30T18:51:47.411202] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:51:47.454338] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-30T18:51:48.167538] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T18:51:48.254357] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-30T18:51:49.054377] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-30T18:51:49.645609] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:51:49.854404] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-30T18:51:49.983092] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:51:50.654391] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-30T18:51:51.405025] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:51:51.454353] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-30T18:51:51.635685] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:51:51.649946] [INFO ] [REMOTE ] FSM: Full fetch complete (76737 records). [2025-09-30T18:51:51.650135] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-30T18:51:52.088297] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-30T18:51:52.088498] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-30T18:51:52.090151] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-30T18:51:52.090221] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-30T18:51:52.092283] [DEBUG] [LOCAL ] FSM: Trimmed 76737 records to 53286 (keeping 200 days of data) [2025-09-30T18:51:52.276991] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-30T18:51:52.326309] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T18:51:52.459330] [DEBUG] [LOCAL ] FSM: Primary data saved (53286 records). [2025-09-30T18:51:52.459576] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-30T18:51:52.459735] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 39.0s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-09-30T18:51:53.054371] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-30T18:51:53.854714] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-30T18:51:53.916489] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:51:53.938250] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T18:51:53.941173] [INFO ] [REMOTE ] FT: Full fetch complete (9126 records). [2025-09-30T18:51:53.941307] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-30T18:51:54.469821] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-30T18:51:54.469992] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-30T18:51:54.470300] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-30T18:51:54.470342] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-30T18:51:54.471038] [DEBUG] [LOCAL ] FT: Trimmed 9126 records to 6495 (keeping 200 days of data) [2025-09-30T18:51:54.516481] [DEBUG] [LOCAL ] FT: Primary data saved (6495 records). [2025-09-30T18:51:54.516638] [INFO ] [MAIN ] FT: Full history saved. [2025-09-30T18:51:54.516775] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FT took 22.8s. Estimated remaining: 3h 10m 12s. Rate: 7.8 symbols/min [2025-09-30T18:51:54.654356] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-30T18:51:54.836137] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T18:51:55.454371] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-30T18:51:56.115899] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:51:56.255614] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-30T18:51:56.257343] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:51:57.054405] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-30T18:51:57.640283] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:51:57.854399] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-30T18:51:58.024703] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:51:58.654342] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-30T18:51:58.736758] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:51:59.454403] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-30T18:52:00.238461] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:52:00.254312] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-30T18:52:00.349874] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:52:00.969575] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T18:52:00.972615] [INFO ] [REMOTE ] FTHY: Full fetch complete (17530 records). [2025-09-30T18:52:00.972721] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-30T18:52:01.069596] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-30T18:52:01.379495] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-30T18:52:01.379592] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-30T18:52:01.380016] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-30T18:52:01.380079] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-30T18:52:01.380897] [DEBUG] [LOCAL ] FTHY: Trimmed 17530 records to 11914 (keeping 200 days of data) [2025-09-30T18:52:01.459787] [DEBUG] [LOCAL ] FTHY: Primary data saved (11914 records). [2025-09-30T18:52:01.459971] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-30T18:52:01.460077] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 21.2s. Estimated remaining: 3h 10m 3s. Rate: 7.9 symbols/min [2025-09-30T18:52:02.838040] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:52:02.849554] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-30T18:52:04.625247] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:52:04.637231] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-30T18:52:06.374556] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:52:06.386172] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-30T18:52:08.376552] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T18:52:08.388580] [INFO ] [REMOTE ] FTI: Full fetch complete (77128 records). [2025-09-30T18:52:08.388783] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-30T18:52:08.839371] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-30T18:52:08.839463] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-30T18:52:08.840503] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-30T18:52:08.840573] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-30T18:52:08.842381] [DEBUG] [LOCAL ] FTI: Trimmed 77128 records to 53297 (keeping 200 days of data) [2025-09-30T18:52:09.212322] [DEBUG] [LOCAL ] FTI: Primary data saved (53297 records). [2025-09-30T18:52:09.212475] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-30T18:52:09.213216] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 28.5s. Estimated remaining: 3h 9m 55s. Rate: 7.9 symbols/min [2025-09-30T18:52:10.007767] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.057458] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.116166] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.115319] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.123737] [DEBUG] [LOCAL ] FTWO: Loaded 1795 existing records from primary storage. [2025-09-30T18:52:10.124213] [INFO ] [MAIN ] FTWO: Loaded 1795 existing records. [2025-09-30T18:52:10.377783] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:10.392302] [DEBUG] [LOCAL ] FTK: Loaded 32226 existing records from primary storage. [2025-09-30T18:52:10.401171] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-30T18:52:10.402955] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-30T18:52:10.403166] [INFO ] [MAIN ] FTK: Loaded 32226 existing records. [2025-09-30T18:52:10.404166] [DEBUG] [LOCAL ] FTV: Loaded 52922 existing records from primary storage. [2025-09-30T18:52:10.404216] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-30T18:52:10.416000] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-30T18:52:10.421398] [INFO ] [MAIN ] FTV: Loaded 52922 existing records. [2025-09-30T18:52:10.628635] [DEBUG] [LOCAL ] FTS: Loaded 42097 existing records from primary storage. [2025-09-30T18:52:10.686310] [INFO ] [MAIN ] FTS: Loaded 42097 existing records. [2025-09-30T18:52:11.111618] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.241469] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.242622] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-30T18:52:11.247385] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.326479] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-30T18:52:11.354769] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-30T18:52:11.382679] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.457776] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-30T18:52:11.461394] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.499522] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-30T18:52:11.505189] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-30T18:52:11.499803] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.600831] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-30T18:52:11.615221] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:11.687939] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-30T18:52:11.688302] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-30T18:52:11.688474] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-30T18:52:12.566622] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:52:12.596324] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-30T18:52:12.627243] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.672217] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.678954] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-30T18:52:12.686008] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-30T18:52:12.766680] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.767265] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-30T18:52:13.241884] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:52:13.243634] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-30T18:52:13.749724] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T18:52:13.751436] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-30T18:52:13.767162] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T18:52:13.773129] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-30T18:52:14.188485] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T18:52:14.189790] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-30T18:52:14.219479] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:52:14.228335] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-30T18:52:14.453913] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:52:14.465164] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-30T18:52:14.470323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-30T18:52:14.471817] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-30T18:52:14.866888] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:52:14.868229] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-30T18:52:14.887798] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T18:52:14.898390] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-30T18:52:15.370740] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:52:15.395406] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:52:15.454411] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-30T18:52:15.789747] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:52:15.977209] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T18:52:15.991443] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:52:16.254410] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-30T18:52:17.054412] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-30T18:52:17.727205] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:52:17.854333] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-30T18:52:18.022566] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:52:18.654383] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-30T18:52:19.290399] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:52:19.454382] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-30T18:52:20.254388] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-30T18:52:20.332863] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:52:20.545059] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:52:21.054361] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-30T18:52:21.560598] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T18:52:21.863823] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-30T18:52:21.869830] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T18:52:22.410328] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T18:52:22.411404] [INFO ] [REMOTE ] FTWO: Full fetch complete (3449 records). [2025-09-30T18:52:22.411477] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-30T18:52:22.663720] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-30T18:52:22.790661] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-30T18:52:22.790752] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-30T18:52:22.790883] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-30T18:52:22.790926] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-30T18:52:22.791281] [DEBUG] [LOCAL ] FTWO: Trimmed 3449 records to 1807 (keeping 200 days of data) [2025-09-30T18:52:22.804521] [DEBUG] [LOCAL ] FTWO: Primary data saved (1807 records). [2025-09-30T18:52:22.804606] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-30T18:52:22.804708] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 13.6s. Estimated remaining: 3h 9m 58s. Rate: 7.8 symbols/min [2025-09-30T18:52:22.981394] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:23.035451] [DEBUG] [LOCAL ] FUBO: Loaded 53695 existing records from primary storage. [2025-09-30T18:52:23.035901] [INFO ] [MAIN ] FUBO: Loaded 53695 existing records. [2025-09-30T18:52:23.229994] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:23.230301] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-30T18:52:23.230356] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-30T18:52:23.230743] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-30T18:52:23.230802] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-30T18:52:23.464148] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-30T18:52:23.619994] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:23.917416] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:52:24.254400] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-30T18:52:25.054366] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-30T18:52:25.278204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:52:25.854336] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-30T18:52:26.036476] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:52:26.654356] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-30T18:52:26.741562] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:52:27.360724] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:52:27.454364] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-30T18:52:28.254373] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-30T18:52:28.894823] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:52:29.054420] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-30T18:52:29.092827] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-30T18:52:29.854341] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-30T18:52:29.969449] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:52:30.580919] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:52:30.654359] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-30T18:52:30.956601] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:52:31.454377] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-30T18:52:32.254324] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-30T18:52:32.445169] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:52:33.054358] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-30T18:52:33.327549] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T18:52:33.575135] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:52:33.854360] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-30T18:52:34.654339] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-30T18:52:34.783561] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:52:35.454364] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-30T18:52:36.062994] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-30T18:52:36.132441] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:52:36.254363] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-30T18:52:36.621013] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T18:52:36.628237] [INFO ] [REMOTE ] FTK: Full fetch complete (42845 records). [2025-09-30T18:52:36.628356] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-30T18:52:37.027000] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-30T18:52:37.027102] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-30T18:52:37.027833] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-30T18:52:37.027899] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-30T18:52:37.028991] [DEBUG] [LOCAL ] FTK: Trimmed 42845 records to 32180 (keeping 200 days of data) [2025-09-30T18:52:37.079026] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-30T18:52:37.225089] [DEBUG] [LOCAL ] FTK: Primary data saved (32180 records). [2025-09-30T18:52:37.225227] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-30T18:52:37.225309] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 28.0s. Estimated remaining: 3h 10m 2s. Rate: 7.8 symbols/min [2025-09-30T18:52:37.411078] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:37.444629] [DEBUG] [LOCAL ] FUL: Loaded 33014 existing records from primary storage. [2025-09-30T18:52:37.444984] [INFO ] [MAIN ] FUL: Loaded 33014 existing records. [2025-09-30T18:52:37.648672] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:37.649005] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-30T18:52:37.649059] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-30T18:52:37.649329] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-30T18:52:37.649389] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-30T18:52:37.866784] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-30T18:52:38.092446] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:38.193231] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:52:38.654394] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-30T18:52:38.780167] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:52:38.789407] [INFO ] [REMOTE ] FTS: Full fetch complete (60173 records). [2025-09-30T18:52:38.789532] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-30T18:52:39.220046] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-30T18:52:39.220139] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-30T18:52:39.221074] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-30T18:52:39.221141] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-30T18:52:39.223635] [DEBUG] [LOCAL ] FTS: Trimmed 60173 records to 42106 (keeping 200 days of data) [2025-09-30T18:52:39.454479] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-30T18:52:39.512670] [DEBUG] [LOCAL ] FTS: Primary data saved (42106 records). [2025-09-30T18:52:39.512847] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-30T18:52:39.512953] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 30.3s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-09-30T18:52:39.713005] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:39.767340] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T18:52:39.791964] [DEBUG] [LOCAL ] FUN: Loaded 51585 existing records from primary storage. [2025-09-30T18:52:39.792456] [INFO ] [MAIN ] FUN: Loaded 51585 existing records. [2025-09-30T18:52:40.010017] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:40.010295] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-30T18:52:40.010369] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-30T18:52:40.010915] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-30T18:52:40.010999] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-30T18:52:40.229283] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-30T18:52:40.266473] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-30T18:52:40.470745] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:41.054363] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-30T18:52:41.293224] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:52:41.351742] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:52:41.854376] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-30T18:52:42.566504] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:52:42.654368] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-30T18:52:43.382308] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:52:43.394500] [INFO ] [REMOTE ] FTV: Full fetch complete (76296 records). [2025-09-30T18:52:43.394782] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-30T18:52:43.465311] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-30T18:52:43.829904] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-30T18:52:43.829989] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-30T18:52:43.830991] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-30T18:52:43.831061] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-30T18:52:43.832704] [DEBUG] [LOCAL ] FTV: Trimmed 76296 records to 52927 (keeping 200 days of data) [2025-09-30T18:52:44.189470] [DEBUG] [LOCAL ] FTV: Primary data saved (52927 records). [2025-09-30T18:52:44.189682] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-30T18:52:44.189816] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 35.0s. Estimated remaining: 3h 9m 32s. Rate: 7.8 symbols/min [2025-09-30T18:52:44.259412] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-30T18:52:44.385332] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:44.406041] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:52:44.432291] [DEBUG] [LOCAL ] FVR: Loaded 21881 existing records from primary storage. [2025-09-30T18:52:44.432548] [INFO ] [MAIN ] FVR: Loaded 21881 existing records. [2025-09-30T18:52:44.647415] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:44.647622] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-30T18:52:44.647707] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-30T18:52:44.648072] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-30T18:52:44.648170] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-30T18:52:45.078174] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-30T18:52:45.085408] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:45.096336] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-30T18:52:45.550379] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:52:45.854348] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-30T18:52:46.543909] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T18:52:46.654400] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-30T18:52:46.931390] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:52:47.454372] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-30T18:52:48.254355] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-30T18:52:48.455751] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:52:48.736581] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T18:52:49.054361] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-30T18:52:49.398069] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:52:49.854374] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-30T18:52:49.986617] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T18:52:50.654355] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-30T18:52:51.454222] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:52:51.454427] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-30T18:52:52.254368] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-30T18:52:52.957338] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:52:53.008768] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T18:52:53.056602] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-30T18:52:53.063129] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-30T18:52:53.854333] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-30T18:52:54.085370] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T18:52:54.654358] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-30T18:52:55.454361] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-30T18:52:55.777344] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:52:55.910532] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:52:56.254375] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-30T18:52:56.654854] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:52:57.037099] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:52:57.054310] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-30T18:52:57.854360] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-30T18:52:58.654389] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-30T18:52:58.719846] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:52:59.014749] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:52:59.454367] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-30T18:53:00.254379] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-30T18:53:01.054341] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-30T18:53:01.226152] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-30T18:53:01.238535] [INFO ] [REMOTE ] FUBO: Full fetch complete (77764 records). [2025-09-30T18:53:01.238703] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-30T18:53:01.384383] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:53:01.698485] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T18:53:01.723376] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-30T18:53:01.733792] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-30T18:53:01.734951] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-30T18:53:01.735364] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-30T18:53:01.737885] [DEBUG] [LOCAL ] FUBO: Trimmed 77764 records to 53697 (keeping 200 days of data) [2025-09-30T18:53:01.854690] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-30T18:53:02.095822] [DEBUG] [LOCAL ] FUBO: Primary data saved (53697 records). [2025-09-30T18:53:02.096511] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-30T18:53:02.099290] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 39.3s. Estimated remaining: 3h 9m 42s. Rate: 7.8 symbols/min [2025-09-30T18:53:02.097084] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:53:02.291534] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:02.339544] [DEBUG] [LOCAL ] FVRR: Loaded 40008 existing records from primary storage. [2025-09-30T18:53:02.339955] [INFO ] [MAIN ] FVRR: Loaded 40008 existing records. [2025-09-30T18:53:02.538023] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:02.538310] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-30T18:53:02.538360] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-30T18:53:02.538887] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-30T18:53:02.538948] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-30T18:53:02.659491] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-30T18:53:02.929027] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:03.454817] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-30T18:53:03.614315] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:53:03.777738] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:53:04.254413] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-30T18:53:05.054380] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-30T18:53:05.103830] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:53:05.341198] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T18:53:05.345706] [INFO ] [REMOTE ] FVR: Full fetch complete (30267 records). [2025-09-30T18:53:05.345826] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-30T18:53:05.759165] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-30T18:53:05.759254] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-30T18:53:05.759891] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-30T18:53:05.759958] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-30T18:53:05.760975] [DEBUG] [LOCAL ] FVR: Trimmed 30267 records to 21794 (keeping 200 days of data) [2025-09-30T18:53:05.858154] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-30T18:53:05.903283] [DEBUG] [LOCAL ] FVR: Primary data saved (21794 records). [2025-09-30T18:53:05.903423] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-30T18:53:05.903506] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FVR took 21.7s. Estimated remaining: 3h 9m 28s. Rate: 7.8 symbols/min [2025-09-30T18:53:06.091152] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:06.094313] [DEBUG] [LOCAL ] FXED: Loaded 1240 existing records from primary storage. [2025-09-30T18:53:06.094489] [INFO ] [MAIN ] FXED: Loaded 1240 existing records. [2025-09-30T18:53:06.318394] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:06.318889] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-30T18:53:06.318958] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-30T18:53:06.319197] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-30T18:53:06.319257] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-30T18:53:06.655761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-30T18:53:06.739147] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:06.776098] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:53:07.455718] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:53:07.454691] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-30T18:53:07.811059] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T18:53:07.997595] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:53:08.254428] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-30T18:53:09.054407] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-30T18:53:09.624335] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:53:09.854379] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-30T18:53:10.131348] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-30T18:53:10.554843] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:53:10.564544] [INFO ] [REMOTE ] FUL: Full fetch complete (47446 records). [2025-09-30T18:53:10.564759] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-30T18:53:10.659482] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-30T18:53:10.997828] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-30T18:53:10.997932] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-30T18:53:10.998737] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-30T18:53:10.998804] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-30T18:53:11.002059] [DEBUG] [LOCAL ] FUL: Trimmed 47446 records to 33034 (keeping 200 days of data) [2025-09-30T18:53:11.074464] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T18:53:11.223085] [DEBUG] [LOCAL ] FUL: Primary data saved (33034 records). [2025-09-30T18:53:11.223244] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-30T18:53:11.223414] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUL took 34.0s. Estimated remaining: 3h 9m 16s. Rate: 7.8 symbols/min [2025-09-30T18:53:11.405996] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:11.452636] [DEBUG] [LOCAL ] G: Loaded 49797 existing records from primary storage. [2025-09-30T18:53:11.452987] [INFO ] [MAIN ] G: Loaded 49797 existing records. [2025-09-30T18:53:11.463744] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-30T18:53:11.646839] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:11.647050] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-30T18:53:11.647099] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-30T18:53:11.647462] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-30T18:53:11.647521] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-30T18:53:12.034451] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:12.254435] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-30T18:53:12.602376] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:53:12.855133] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:53:13.054372] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-30T18:53:13.854447] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-30T18:53:14.275613] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:53:14.654377] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-30T18:53:15.069756] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:53:15.454367] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-30T18:53:16.197804] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:53:16.254331] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-30T18:53:16.842111] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T18:53:16.879287] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:53:17.054386] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-30T18:53:17.854403] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-30T18:53:18.643010] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:53:18.654262] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-30T18:53:18.949595] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T18:53:19.454409] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-30T18:53:20.254359] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-30T18:53:20.422971] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:53:20.434361] [INFO ] [REMOTE ] FUN: Full fetch complete (72811 records). [2025-09-30T18:53:20.434582] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-30T18:53:20.852661] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-30T18:53:20.852765] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-30T18:53:20.853814] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-30T18:53:20.853885] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-30T18:53:20.855442] [DEBUG] [LOCAL ] FUN: Trimmed 72811 records to 51596 (keeping 200 days of data) [2025-09-30T18:53:21.063837] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-30T18:53:21.173978] [DEBUG] [LOCAL ] FUN: Primary data saved (51596 records). [2025-09-30T18:53:21.174120] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-30T18:53:21.174312] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 41.7s. Estimated remaining: 3h 9m 12s. Rate: 7.8 symbols/min [2025-09-30T18:53:21.357744] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:21.387562] [DEBUG] [LOCAL ] GAB: Loaded 28038 existing records from primary storage. [2025-09-30T18:53:21.387918] [INFO ] [MAIN ] GAB: Loaded 28038 existing records. [2025-09-30T18:53:21.439870] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-30T18:53:21.674547] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:21.677860] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-30T18:53:21.678096] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-30T18:53:21.679415] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:53:21.679459] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-30T18:53:21.682388] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-30T18:53:21.860078] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-30T18:53:22.105051] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:22.171495] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T18:53:22.654416] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-30T18:53:23.090766] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T18:53:23.162256] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-30T18:53:23.454361] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-30T18:53:23.745201] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-30T18:53:24.254396] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-30T18:53:25.054343] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-30T18:53:25.256491] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:53:25.854379] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-30T18:53:26.217559] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T18:53:26.390523] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T18:53:26.391484] [INFO ] [REMOTE ] FXED: Full fetch complete (1793 records). [2025-09-30T18:53:26.391558] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-30T18:53:26.662364] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-30T18:53:26.826055] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-30T18:53:26.826140] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-30T18:53:26.826241] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-30T18:53:26.826282] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-30T18:53:26.826681] [DEBUG] [LOCAL ] FXED: Trimmed 1793 records to 1236 (keeping 200 days of data) [2025-09-30T18:53:26.836481] [DEBUG] [LOCAL ] FXED: Primary data saved (1236 records). [2025-09-30T18:53:26.836564] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-30T18:53:26.836684] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 20.9s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-09-30T18:53:27.022333] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:27.032088] [DEBUG] [LOCAL ] GAM: Loaded 4065 existing records from primary storage. [2025-09-30T18:53:27.032299] [INFO ] [MAIN ] GAM: Loaded 4065 existing records. [2025-09-30T18:53:27.228349] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:27.228674] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-30T18:53:27.228796] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-30T18:53:27.229020] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-30T18:53:27.229083] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-30T18:53:27.460251] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-30T18:53:27.654428] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:27.940711] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T18:53:28.254391] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-30T18:53:29.051170] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:53:29.059704] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-30T18:53:29.346041] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:53:29.854329] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-30T18:53:30.193249] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:53:30.654325] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-30T18:53:31.454324] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-30T18:53:31.504036] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:53:31.527472] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T18:53:32.254330] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-30T18:53:32.925631] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:53:33.054318] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-30T18:53:33.650566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:53:33.854375] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-30T18:53:34.336216] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T18:53:34.654413] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-30T18:53:35.454395] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-30T18:53:35.620313] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:53:35.633490] [INFO ] [REMOTE ] G: Full fetch complete (71607 records). [2025-09-30T18:53:35.633662] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-30T18:53:36.067722] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-30T18:53:36.067916] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-30T18:53:36.080263] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-30T18:53:36.097537] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-30T18:53:36.100033] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:53:36.110569] [DEBUG] [LOCAL ] G: Trimmed 71607 records to 49805 (keeping 200 days of data) [2025-09-30T18:53:36.301228] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-30T18:53:36.442058] [DEBUG] [LOCAL ] G: Primary data saved (49805 records). [2025-09-30T18:53:36.442202] [INFO ] [MAIN ] G: Full history saved. [2025-09-30T18:53:36.442290] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. G took 25.2s. Estimated remaining: 3h 8m 57s. Rate: 7.8 symbols/min [2025-09-30T18:53:36.632538] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:36.691677] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-30T18:53:36.692041] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-30T18:53:36.848572] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T18:53:36.915412] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:36.915713] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-30T18:53:36.915776] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-30T18:53:36.916235] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-30T18:53:36.916295] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-30T18:53:37.067427] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-30T18:53:37.313073] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:37.685794] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T18:53:37.854360] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-30T18:53:38.624258] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:53:38.654399] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-30T18:53:39.322849] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T18:53:39.454329] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-30T18:53:39.694245] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T18:53:39.703308] [INFO ] [REMOTE ] FVRR: Full fetch complete (58851 records). [2025-09-30T18:53:39.703459] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-30T18:53:40.116137] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-30T18:53:40.116245] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-30T18:53:40.117108] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-30T18:53:40.117186] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-30T18:53:40.118527] [DEBUG] [LOCAL ] FVRR: Trimmed 58851 records to 40051 (keeping 200 days of data) [2025-09-30T18:53:40.291955] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-30T18:53:40.371712] [DEBUG] [LOCAL ] FVRR: Primary data saved (40051 records). [2025-09-30T18:53:40.371846] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-30T18:53:40.372556] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. FVRR took 38.3s. Estimated remaining: 3h 8m 43s. Rate: 7.8 symbols/min [2025-09-30T18:53:40.553337] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:40.576617] [DEBUG] [LOCAL ] GATX: Loaded 18170 existing records from primary storage. [2025-09-30T18:53:40.576896] [INFO ] [MAIN ] GATX: Loaded 18170 existing records. [2025-09-30T18:53:40.768153] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:40.768423] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-30T18:53:40.768471] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-30T18:53:40.768875] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-30T18:53:40.768935] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-30T18:53:41.064853] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-30T18:53:41.180953] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:41.213153] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:53:41.481376] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:53:41.543351] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T18:53:41.854365] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-30T18:53:42.654366] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-30T18:53:42.861287] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:53:43.454381] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-30T18:53:43.880917] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:53:44.254363] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-30T18:53:45.054356] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-30T18:53:45.314681] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:53:45.544548] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:53:45.854330] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-30T18:53:46.156028] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-30T18:53:46.654379] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-30T18:53:46.932496] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T18:53:47.454336] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-30T18:53:47.597275] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:53:48.254364] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-30T18:53:48.957924] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:53:49.054355] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-30T18:53:49.632884] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:53:49.633074] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T18:53:49.643421] [INFO ] [REMOTE ] GAB: Full fetch complete (39791 records). [2025-09-30T18:53:49.643606] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-30T18:53:49.859480] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-30T18:53:50.046561] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-30T18:53:50.046663] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-30T18:53:50.047397] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-30T18:53:50.047453] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-30T18:53:50.048560] [DEBUG] [LOCAL ] GAB: Trimmed 39791 records to 28043 (keeping 200 days of data) [2025-09-30T18:53:50.211908] [DEBUG] [LOCAL ] GAB: Primary data saved (28043 records). [2025-09-30T18:53:50.212107] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-30T18:53:50.212206] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAB took 29.0s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-09-30T18:53:50.405714] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:50.421742] [DEBUG] [LOCAL ] GBAB: Loaded 13065 existing records from primary storage. [2025-09-30T18:53:50.421983] [INFO ] [MAIN ] GBAB: Loaded 13065 existing records. [2025-09-30T18:53:50.616769] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:50.617034] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-30T18:53:50.617091] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-30T18:53:50.617404] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-30T18:53:50.617464] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-30T18:53:50.661524] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-30T18:53:50.992466] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:51.287925] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T18:53:51.454368] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-30T18:53:51.872441] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T18:53:52.254354] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-30T18:53:52.464256] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:53:52.599584] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:53:53.054352] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-30T18:53:53.854323] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-30T18:53:54.010847] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:53:54.654371] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-30T18:53:54.956979] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T18:53:55.265083] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:53:55.454386] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-30T18:53:56.254415] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-30T18:53:56.353796] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:53:56.355918] [INFO ] [REMOTE ] GAM: Full fetch complete (6780 records). [2025-09-30T18:53:56.356050] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-30T18:53:56.975980] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-30T18:53:56.976065] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-30T18:53:56.976266] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-30T18:53:56.976312] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-30T18:53:56.976863] [DEBUG] [LOCAL ] GAM: Trimmed 6780 records to 4066 (keeping 200 days of data) [2025-09-30T18:53:57.005454] [DEBUG] [LOCAL ] GAM: Primary data saved (4066 records). [2025-09-30T18:53:57.005617] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-30T18:53:57.005761] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAM took 30.2s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-09-30T18:53:57.061389] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-30T18:53:57.242729] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:57.303082] [DEBUG] [LOCAL ] GBCI: Loaded 40061 existing records from primary storage. [2025-09-30T18:53:57.303434] [INFO ] [MAIN ] GBCI: Loaded 40061 existing records. [2025-09-30T18:53:57.495298] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:57.495581] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-30T18:53:57.495631] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-30T18:53:57.496112] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-30T18:53:57.496185] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-30T18:53:57.859558] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-30T18:53:57.929074] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:58.149437] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:53:58.329034] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:53:58.654395] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-30T18:53:58.861899] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:53:59.454362] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-30T18:54:00.254345] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-30T18:54:00.747837] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T18:54:00.761822] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:54:00.904908] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T18:54:01.054381] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-30T18:54:01.854404] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-30T18:54:02.654362] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-30T18:54:02.800130] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T18:54:03.095105] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T18:54:03.454722] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-30T18:54:03.457055] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:54:04.254375] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-30T18:54:05.054362] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-30T18:54:05.184194] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T18:54:05.363049] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:54:05.854368] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-30T18:54:05.984592] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:54:06.654387] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-30T18:54:07.172317] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:54:07.421458] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T18:54:07.454382] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-30T18:54:08.254348] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-30T18:54:08.641343] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T18:54:08.646444] [INFO ] [REMOTE ] GATX: Full fetch complete (25306 records). [2025-09-30T18:54:08.646555] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-30T18:54:09.056005] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-30T18:54:09.070107] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-30T18:54:09.071549] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-30T18:54:09.072198] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-30T18:54:09.072280] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-30T18:54:09.073345] [DEBUG] [LOCAL ] GATX: Trimmed 25306 records to 18178 (keeping 200 days of data) [2025-09-30T18:54:09.202102] [DEBUG] [LOCAL ] GATX: Primary data saved (18178 records). [2025-09-30T18:54:09.202253] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-30T18:54:09.202337] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GATX took 28.8s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-09-30T18:54:09.399472] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:09.399785] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-30T18:54:09.406798] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-30T18:54:09.413014] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:54:09.412458] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-30T18:54:09.418541] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-30T18:54:09.418718] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-30T18:54:09.418794] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-30T18:54:09.860616] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-30T18:54:09.866552] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:10.654416] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-30T18:54:10.701567] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T18:54:11.130711] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T18:54:11.454370] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-30T18:54:11.801501] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T18:54:12.254396] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-30T18:54:12.413940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T18:54:13.054366] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-30T18:54:13.701518] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:54:13.854329] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-30T18:54:14.015335] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:54:14.654368] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-30T18:54:15.447166] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T18:54:15.454313] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-30T18:54:15.672346] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:54:15.684435] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-30T18:54:15.684598] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-30T18:54:16.120914] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-30T18:54:16.121029] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-30T18:54:16.122076] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-30T18:54:16.122177] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-30T18:54:16.123800] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-30T18:54:16.223385] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T18:54:16.230845] [INFO ] [REMOTE ] GBAB: Full fetch complete (19890 records). [2025-09-30T18:54:16.231806] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-30T18:54:16.261934] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-30T18:54:16.784443] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-30T18:54:16.784848] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-30T18:54:16.785931] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-30T18:54:16.786252] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-30T18:54:16.789533] [DEBUG] [LOCAL ] GBAB: Trimmed 19890 records to 13066 (keeping 200 days of data) [2025-09-30T18:54:16.948884] [DEBUG] [LOCAL ] GBAB: Primary data saved (13066 records). [2025-09-30T18:54:16.967356] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-30T18:54:16.968676] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBAB took 26.8s. Estimated remaining: 3h 8m 22s. Rate: 7.8 symbols/min [2025-09-30T18:54:17.059774] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-30T18:54:17.182498] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:17.215358] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-30T18:54:17.215671] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-30T18:54:17.215812] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GAP took 40.8s. Estimated remaining: 3h 8m 2s. Rate: 7.8 symbols/min [2025-09-30T18:54:17.345506] [DEBUG] [LOCAL ] GBTG: Loaded 40026 existing records from primary storage. [2025-09-30T18:54:17.367120] [INFO ] [MAIN ] GBTG: Loaded 40026 existing records. [2025-09-30T18:54:17.369830] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:54:17.528046] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:17.646575] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:17.647018] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-30T18:54:17.647076] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-30T18:54:17.647604] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-30T18:54:17.647790] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-30T18:54:17.836568] [DEBUG] [LOCAL ] GBX: Loaded 29132 existing records from primary storage. [2025-09-30T18:54:17.854947] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-30T18:54:17.872914] [INFO ] [MAIN ] GBX: Loaded 29132 existing records. [2025-09-30T18:54:18.327605] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:54:18.327430] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:18.334864] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:18.338939] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T18:54:18.347788] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-30T18:54:18.348033] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-30T18:54:18.348841] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-30T18:54:18.348903] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-30T18:54:18.655728] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-30T18:54:18.738631] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:19.106414] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T18:54:19.454375] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-30T18:54:20.254350] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-30T18:54:20.626059] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T18:54:21.054384] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-30T18:54:21.421148] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:54:21.854401] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-30T18:54:22.240991] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T18:54:22.636215] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:54:22.654352] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-30T18:54:23.454380] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-30T18:54:23.725388] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-30T18:54:23.907444] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:54:24.254420] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-30T18:54:25.054314] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-30T18:54:25.290517] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-30T18:54:25.520399] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T18:54:25.854354] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-30T18:54:26.654375] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-30T18:54:26.987798] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T18:54:27.454390] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-30T18:54:27.882925] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T18:54:28.109356] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:54:28.254413] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-30T18:54:29.054366] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-30T18:54:29.573771] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:54:29.854369] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-30T18:54:30.502636] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:54:30.654364] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-30T18:54:31.084675] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-30T18:54:31.085579] [INFO ] [REMOTE ] GBLI: Full fetch complete (1319 records). [2025-09-30T18:54:31.085676] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-30T18:54:31.305249] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-30T18:54:31.307095] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:54:31.305922] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:54:31.313803] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:54:31.314175] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-30T18:54:31.314243] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-30T18:54:31.314281] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-30T18:54:31.314321] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-30T18:54:31.314385] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBLI took 22.1s. Estimated remaining: 3h 8m 5s. Rate: 7.8 symbols/min [2025-09-30T18:54:31.459468] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-30T18:54:31.505473] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:31.546227] [DEBUG] [LOCAL ] GCI: Loaded 44152 existing records from primary storage. [2025-09-30T18:54:31.546533] [INFO ] [MAIN ] GCI: Loaded 44152 existing records. [2025-09-30T18:54:31.731696] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:31.731932] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-30T18:54:31.731981] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-30T18:54:31.732236] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-30T18:54:31.732298] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-30T18:54:32.113785] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:32.254353] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-30T18:54:32.840454] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:54:33.054397] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-30T18:54:33.650614] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:54:33.854369] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-30T18:54:34.654326] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-30T18:54:34.757118] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:54:35.332867] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:54:35.454397] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-30T18:54:36.214314] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T18:54:36.254354] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-30T18:54:36.978765] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:54:37.054397] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-30T18:54:37.406251] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:54:37.854381] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-30T18:54:38.182967] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:54:38.654427] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-30T18:54:39.089013] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:54:39.454335] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-30T18:54:39.699071] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:54:40.254377] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-30T18:54:40.683872] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:54:41.054362] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-30T18:54:41.638041] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T18:54:41.854389] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-30T18:54:42.532346] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:54:42.654377] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-30T18:54:43.091722] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:54:43.454368] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-30T18:54:44.219181] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:54:44.228431] [INFO ] [REMOTE ] GBCI: Full fetch complete (58126 records). [2025-09-30T18:54:44.228581] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-30T18:54:44.263092] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-30T18:54:44.658241] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-30T18:54:44.658378] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-30T18:54:44.664591] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-30T18:54:44.664715] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-30T18:54:44.676878] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:54:44.684301] [DEBUG] [LOCAL ] GBCI: Trimmed 58126 records to 40042 (keeping 200 days of data) [2025-09-30T18:54:44.944450] [DEBUG] [LOCAL ] GBCI: Primary data saved (40042 records). [2025-09-30T18:54:44.944589] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-30T18:54:44.944698] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBCI took 47.9s. Estimated remaining: 3h 8m 8s. Rate: 7.8 symbols/min [2025-09-30T18:54:45.059513] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-30T18:54:45.137634] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:45.163936] [DEBUG] [LOCAL ] GCO: Loaded 24869 existing records from primary storage. [2025-09-30T18:54:45.164212] [INFO ] [MAIN ] GCO: Loaded 24869 existing records. [2025-09-30T18:54:45.392495] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:45.392779] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-30T18:54:45.392834] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-30T18:54:45.393244] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-30T18:54:45.393311] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-30T18:54:45.778964] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:45.811400] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:54:45.854344] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-30T18:54:46.619181] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:54:46.654307] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-30T18:54:46.789238] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:54:46.794610] [INFO ] [REMOTE ] GBX: Full fetch complete (42786 records). [2025-09-30T18:54:46.794735] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-30T18:54:47.216377] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-30T18:54:47.216486] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-30T18:54:47.217325] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-30T18:54:47.217394] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-30T18:54:47.218508] [DEBUG] [LOCAL ] GBX: Trimmed 42786 records to 29176 (keeping 200 days of data) [2025-09-30T18:54:47.410050] [DEBUG] [LOCAL ] GBX: Primary data saved (29176 records). [2025-09-30T18:54:47.410194] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-30T18:54:47.410279] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 30.2s. Estimated remaining: 3h 7m 51s. Rate: 7.8 symbols/min [2025-09-30T18:54:47.459690] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-30T18:54:47.608989] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:47.632368] [DEBUG] [LOCAL ] GCTS: Loaded 19896 existing records from primary storage. [2025-09-30T18:54:47.632703] [INFO ] [MAIN ] GCTS: Loaded 19896 existing records. [2025-09-30T18:54:47.832439] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:47.832832] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-30T18:54:47.832898] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-30T18:54:47.833376] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-30T18:54:47.833443] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-30T18:54:47.943169] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:54:48.259737] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-30T18:54:48.305029] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:48.734803] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:54:49.054377] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-30T18:54:49.817258] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:54:49.826499] [INFO ] [REMOTE ] GBTG: Full fetch complete (56654 records). [2025-09-30T18:54:49.826637] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-30T18:54:49.865129] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-30T18:54:50.258192] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-30T18:54:50.258314] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-30T18:54:50.259180] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-30T18:54:50.259246] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-30T18:54:50.276356] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:54:50.281399] [DEBUG] [LOCAL ] GBTG: Trimmed 56654 records to 40050 (keeping 200 days of data) [2025-09-30T18:54:50.515749] [DEBUG] [LOCAL ] GBTG: Primary data saved (40050 records). [2025-09-30T18:54:50.515877] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-30T18:54:50.515956] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBTG took 33.5s. Estimated remaining: 3h 7m 36s. Rate: 7.8 symbols/min [2025-09-30T18:54:50.660853] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-30T18:54:50.696631] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:50.707487] [DEBUG] [LOCAL ] GCV: Loaded 7301 existing records from primary storage. [2025-09-30T18:54:50.707883] [INFO ] [MAIN ] GCV: Loaded 7301 existing records. [2025-09-30T18:54:50.899813] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:50.900025] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-30T18:54:50.900072] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-30T18:54:50.900275] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-30T18:54:50.900333] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-30T18:54:51.282110] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:51.454425] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-30T18:54:51.506568] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:54:51.714843] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:54:51.963304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T18:54:52.254400] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-30T18:54:53.058366] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-30T18:54:53.060383] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T18:54:53.854392] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-30T18:54:54.449903] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:54:54.654372] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-30T18:54:55.236420] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:54:55.454384] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-30T18:54:55.492755] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:54:56.254345] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-30T18:54:56.324239] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T18:54:57.054364] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-30T18:54:57.555833] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:54:57.624667] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:54:57.854379] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-30T18:54:58.654427] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-30T18:54:59.410001] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:54:59.454324] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-30T18:54:59.581319] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T18:55:00.254356] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-30T18:55:01.054334] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-30T18:55:01.129282] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T18:55:01.278379] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T18:55:01.684400] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T18:55:01.854352] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-30T18:55:02.654342] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-30T18:55:02.881247] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T18:55:03.454384] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-30T18:55:03.788824] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T18:55:04.254386] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-30T18:55:05.054341] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-30T18:55:05.201431] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:55:05.210906] [INFO ] [REMOTE ] GCI: Full fetch complete (63157 records). [2025-09-30T18:55:05.211071] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-30T18:55:05.646336] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T18:55:05.693943] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-30T18:55:05.694160] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-30T18:55:05.695252] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-30T18:55:05.695752] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-30T18:55:05.697763] [DEBUG] [LOCAL ] GCI: Trimmed 63157 records to 44090 (keeping 200 days of data) [2025-09-30T18:55:05.790525] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T18:55:05.874293] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-30T18:55:05.972627] [DEBUG] [LOCAL ] GCI: Primary data saved (44090 records). [2025-09-30T18:55:05.972818] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-30T18:55:05.973701] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 34.7s. Estimated remaining: 3h 7m 41s. Rate: 7.8 symbols/min [2025-09-30T18:55:06.162624] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:06.211083] [DEBUG] [LOCAL ] GD: Loaded 47179 existing records from primary storage. [2025-09-30T18:55:06.211435] [INFO ] [MAIN ] GD: Loaded 47179 existing records. [2025-09-30T18:55:06.395219] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:06.395478] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-30T18:55:06.395539] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-30T18:55:06.395949] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-30T18:55:06.396017] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-30T18:55:06.659552] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-30T18:55:06.790382] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:06.912674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T18:55:07.454378] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-30T18:55:07.747671] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T18:55:08.254401] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-30T18:55:09.059492] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-30T18:55:09.075130] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:55:09.502028] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T18:55:09.564568] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T18:55:09.854362] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-30T18:55:10.654364] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-30T18:55:10.987086] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:55:10.992207] [INFO ] [REMOTE ] GCO: Full fetch complete (35526 records). [2025-09-30T18:55:10.992307] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-30T18:55:11.401360] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-30T18:55:11.401438] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-30T18:55:11.402100] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-30T18:55:11.402165] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-30T18:55:11.403089] [DEBUG] [LOCAL ] GCO: Trimmed 35526 records to 24721 (keeping 200 days of data) [2025-09-30T18:55:11.455328] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-30T18:55:11.569412] [DEBUG] [LOCAL ] GCO: Primary data saved (24721 records). [2025-09-30T18:55:11.569685] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-30T18:55:11.569847] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 26.6s. Estimated remaining: 3h 7m 30s. Rate: 7.8 symbols/min [2025-09-30T18:55:11.767968] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:11.824811] [DEBUG] [LOCAL ] GDDY: Loaded 49651 existing records from primary storage. [2025-09-30T18:55:11.825385] [INFO ] [MAIN ] GDDY: Loaded 49651 existing records. [2025-09-30T18:55:11.977558] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:55:12.047328] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:12.047615] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-30T18:55:12.047701] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-30T18:55:12.048174] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-30T18:55:12.048234] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-30T18:55:12.259557] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-30T18:55:12.431714] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:13.035030] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:55:13.054350] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-30T18:55:13.317853] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T18:55:13.494102] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:55:13.854397] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-30T18:55:14.654380] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-30T18:55:15.214704] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:55:15.454375] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-30T18:55:16.254350] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-30T18:55:16.322408] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:55:16.325167] [INFO ] [REMOTE ] GCV: Full fetch complete (9325 records). [2025-09-30T18:55:16.325262] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-30T18:55:16.696792] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T18:55:16.799963] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-30T18:55:16.800055] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-30T18:55:16.800300] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-30T18:55:16.800340] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-30T18:55:16.800878] [DEBUG] [LOCAL ] GCV: Trimmed 9325 records to 7318 (keeping 200 days of data) [2025-09-30T18:55:16.846795] [DEBUG] [LOCAL ] GCV: Primary data saved (7318 records). [2025-09-30T18:55:16.846944] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-30T18:55:16.847034] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 26.3s. Estimated remaining: 3h 7m 19s. Rate: 7.8 symbols/min [2025-09-30T18:55:17.038732] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:17.046020] [DEBUG] [LOCAL ] GDIV: Loaded 3642 existing records from primary storage. [2025-09-30T18:55:17.046327] [INFO ] [MAIN ] GDIV: Loaded 3642 existing records. [2025-09-30T18:55:17.059879] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-30T18:55:17.257447] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:17.257765] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-30T18:55:17.257819] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-30T18:55:17.258043] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-30T18:55:17.258128] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-30T18:55:17.589422] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T18:55:17.682344] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:17.854394] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-30T18:55:18.220771] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-30T18:55:18.646300] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:55:18.657236] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-30T18:55:19.454419] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-30T18:55:20.109351] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T18:55:20.254344] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-30T18:55:20.444951] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:55:21.054386] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-30T18:55:21.854356] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-30T18:55:22.075754] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:55:22.538275] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:55:22.654380] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-30T18:55:23.084075] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T18:55:23.091486] [INFO ] [REMOTE ] GCTS: Full fetch complete (26879 records). [2025-09-30T18:55:23.091687] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-30T18:55:23.459484] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-30T18:55:23.521180] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-30T18:55:23.521284] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-30T18:55:23.521964] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-30T18:55:23.522043] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-30T18:55:23.523128] [DEBUG] [LOCAL ] GCTS: Trimmed 26879 records to 19897 (keeping 200 days of data) [2025-09-30T18:55:23.663039] [DEBUG] [LOCAL ] GCTS: Primary data saved (19897 records). [2025-09-30T18:55:23.663207] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-30T18:55:23.663298] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 36.3s. Estimated remaining: 3h 7m 10s. Rate: 7.8 symbols/min [2025-09-30T18:55:23.867280] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:23.867506] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-30T18:55:23.867563] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-30T18:55:23.867731] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-30T18:55:23.867799] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-30T18:55:23.867858] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-30T18:55:23.867897] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-30T18:55:24.174256] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:55:24.258831] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-30T18:55:24.304031] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:24.373681] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:55:25.054369] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-30T18:55:25.635004] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T18:55:25.854380] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-30T18:55:26.078913] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:55:26.411951] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:55:26.654448] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-30T18:55:27.239262] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T18:55:27.454409] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-30T18:55:28.254397] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-30T18:55:29.054386] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-30T18:55:29.214955] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:55:29.466006] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T18:55:29.630301] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:55:29.854424] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-30T18:55:30.226704] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T18:55:30.654398] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-30T18:55:31.454442] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-30T18:55:31.939477] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T18:55:32.254389] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-30T18:55:32.300285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:55:32.553388] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-30T18:55:33.054372] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-30T18:55:33.854364] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-30T18:55:34.465912] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:55:34.654373] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-30T18:55:34.787801] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:55:35.111919] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:55:35.454369] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-30T18:55:36.254374] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-30T18:55:36.805408] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:55:37.054378] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-30T18:55:37.100229] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:55:37.537930] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:55:37.854340] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-30T18:55:38.422840] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T18:55:38.424179] [INFO ] [REMOTE ] GDIV: Full fetch complete (5476 records). [2025-09-30T18:55:38.424254] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-30T18:55:38.664436] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-30T18:55:38.846795] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-30T18:55:38.846886] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-30T18:55:38.847069] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-30T18:55:38.847161] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-30T18:55:38.847985] [DEBUG] [LOCAL ] GDIV: Trimmed 5476 records to 3635 (keeping 200 days of data) [2025-09-30T18:55:38.871846] [DEBUG] [LOCAL ] GDIV: Primary data saved (3635 records). [2025-09-30T18:55:38.871948] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-30T18:55:38.872097] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDIV took 22.0s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-09-30T18:55:39.055060] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:39.066144] [DEBUG] [LOCAL ] GDO: Loaded 5949 existing records from primary storage. [2025-09-30T18:55:39.066382] [INFO ] [MAIN ] GDO: Loaded 5949 existing records. [2025-09-30T18:55:39.281424] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:39.281803] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-30T18:55:39.281880] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-30T18:55:39.282142] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-30T18:55:39.282229] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-30T18:55:39.459512] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-30T18:55:39.690388] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:40.019075] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:55:40.254368] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-30T18:55:40.639061] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T18:55:41.054531] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-30T18:55:41.854331] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-30T18:55:42.045678] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:55:42.055863] [INFO ] [REMOTE ] GD: Full fetch complete (70415 records). [2025-09-30T18:55:42.056043] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-30T18:55:42.351889] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T18:55:42.555759] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-30T18:55:42.555887] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-30T18:55:42.556923] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-30T18:55:42.557027] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-30T18:55:42.559453] [DEBUG] [LOCAL ] GD: Trimmed 70415 records to 47170 (keeping 200 days of data) [2025-09-30T18:55:42.657288] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-30T18:55:42.689740] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:55:42.915689] [DEBUG] [LOCAL ] GD: Primary data saved (47170 records). [2025-09-30T18:55:42.915842] [INFO ] [MAIN ] GD: Full history saved. [2025-09-30T18:55:42.917155] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 36.9s. Estimated remaining: 3h 7m 1s. Rate: 7.8 symbols/min [2025-09-30T18:55:43.102454] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:43.145522] [DEBUG] [LOCAL ] GDOT: Loaded 38421 existing records from primary storage. [2025-09-30T18:55:43.145894] [INFO ] [MAIN ] GDOT: Loaded 38421 existing records. [2025-09-30T18:55:43.332437] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:43.332687] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-30T18:55:43.332747] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-30T18:55:43.333129] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-30T18:55:43.333190] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-30T18:55:43.457295] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-30T18:55:43.737709] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:43.739074] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:55:43.980394] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T18:55:44.254365] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-30T18:55:44.939542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T18:55:45.054410] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-30T18:55:45.854355] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-30T18:55:46.326945] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:55:46.373767] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:55:46.654392] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-30T18:55:47.454394] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-30T18:55:47.868263] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:55:48.254390] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-30T18:55:49.054335] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-30T18:55:49.261039] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:55:49.383156] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:55:49.431195] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:55:49.854435] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-30T18:55:50.654372] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-30T18:55:51.181011] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T18:55:51.187817] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:55:51.454370] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-30T18:55:52.254363] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-30T18:55:52.832434] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:55:53.054339] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-30T18:55:53.157218] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T18:55:53.452732] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T18:55:53.854374] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-30T18:55:54.503252] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:55:54.504569] [INFO ] [REMOTE ] GDL: Full fetch complete (3645 records). [2025-09-30T18:55:54.504660] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-30T18:55:54.671464] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-30T18:55:54.931569] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-30T18:55:54.931714] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-30T18:55:54.931876] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-30T18:55:54.931941] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-30T18:55:54.932340] [DEBUG] [LOCAL ] GDL: Trimmed 3645 records to 2563 (keeping 200 days of data) [2025-09-30T18:55:54.948734] [DEBUG] [LOCAL ] GDL: Primary data saved (2563 records). [2025-09-30T18:55:54.948852] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-30T18:55:54.948927] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 31.3s. Estimated remaining: 3h 7m 0s. Rate: 7.8 symbols/min [2025-09-30T18:55:55.154193] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:55.185317] [DEBUG] [LOCAL ] GDV: Loaded 19569 existing records from primary storage. [2025-09-30T18:55:55.185610] [INFO ] [MAIN ] GDV: Loaded 19569 existing records. [2025-09-30T18:55:55.424158] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:55.424433] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-30T18:55:55.424503] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-30T18:55:55.424769] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-30T18:55:55.424872] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-30T18:55:55.467163] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-30T18:55:55.867569] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:56.193319] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:55:56.204823] [INFO ] [REMOTE ] GDDY: Full fetch complete (71325 records). [2025-09-30T18:55:56.204995] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-30T18:55:56.265233] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-30T18:55:56.641708] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-30T18:55:56.641851] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-30T18:55:56.642895] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-30T18:55:56.643016] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-30T18:55:56.644711] [DEBUG] [LOCAL ] GDDY: Trimmed 71325 records to 49657 (keeping 200 days of data) [2025-09-30T18:55:56.934610] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:55:57.019585] [DEBUG] [LOCAL ] GDDY: Primary data saved (49657 records). [2025-09-30T18:55:57.019829] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-30T18:55:57.020214] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 45.5s. Estimated remaining: 3h 6m 44s. Rate: 7.8 symbols/min [2025-09-30T18:55:57.059451] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-30T18:55:57.222950] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:57.284423] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-30T18:55:57.284800] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-30T18:55:57.479875] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:57.480156] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-30T18:55:57.480210] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-30T18:55:57.480842] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-30T18:55:57.480905] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-30T18:55:57.699920] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:55:57.869204] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-30T18:55:57.921484] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:58.546851] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:55:58.654361] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-30T18:55:58.672619] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T18:55:59.245010] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T18:55:59.454397] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-30T18:55:59.948127] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T18:56:00.254400] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-30T18:56:01.054388] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-30T18:56:01.152466] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:56:01.671816] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T18:56:01.854372] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-30T18:56:02.654392] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-30T18:56:03.454397] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-30T18:56:03.670218] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:56:04.027156] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T18:56:04.254385] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-30T18:56:04.561190] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T18:56:05.054336] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-30T18:56:05.175870] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T18:56:05.764696] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T18:56:05.854402] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-30T18:56:06.654359] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-30T18:56:07.454340] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-30T18:56:07.696551] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:56:07.845679] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T18:56:08.254390] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-30T18:56:08.624841] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:56:08.958466] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:56:08.961547] [INFO ] [REMOTE ] GDO: Full fetch complete (9278 records). [2025-09-30T18:56:08.961725] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-30T18:56:09.059586] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-30T18:56:09.380460] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-30T18:56:09.380586] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-30T18:56:09.380989] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-30T18:56:09.381088] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-30T18:56:09.381800] [DEBUG] [LOCAL ] GDO: Trimmed 9278 records to 5980 (keeping 200 days of data) [2025-09-30T18:56:09.432595] [DEBUG] [LOCAL ] GDO: Primary data saved (5980 records). [2025-09-30T18:56:09.432799] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-30T18:56:09.432959] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 30.6s. Estimated remaining: 3h 6m 44s. Rate: 7.8 symbols/min [2025-09-30T18:56:09.636856] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:09.664924] [DEBUG] [LOCAL ] GEF: Loaded 20543 existing records from primary storage. [2025-09-30T18:56:09.665218] [INFO ] [MAIN ] GEF: Loaded 20543 existing records. [2025-09-30T18:56:09.854698] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-30T18:56:09.858905] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:09.861092] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-30T18:56:09.861153] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-30T18:56:09.861426] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-30T18:56:09.861500] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-30T18:56:10.260019] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:10.588825] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:56:10.654398] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-30T18:56:10.959568] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T18:56:11.454412] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-30T18:56:12.254334] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-30T18:56:12.552178] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T18:56:12.585886] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:56:13.054326] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-30T18:56:13.379302] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:56:13.854364] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-30T18:56:14.610447] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:56:14.620051] [INFO ] [REMOTE ] GDOT: Full fetch complete (52950 records). [2025-09-30T18:56:14.620211] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-30T18:56:14.659557] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-30T18:56:15.060282] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-30T18:56:15.060375] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-30T18:56:15.061264] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-30T18:56:15.061356] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-30T18:56:15.062718] [DEBUG] [LOCAL ] GDOT: Trimmed 52950 records to 38364 (keeping 200 days of data) [2025-09-30T18:56:15.310216] [DEBUG] [LOCAL ] GDOT: Primary data saved (38364 records). [2025-09-30T18:56:15.310365] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-30T18:56:15.311298] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 32.4s. Estimated remaining: 3h 6m 33s. Rate: 7.8 symbols/min [2025-09-30T18:56:15.459455] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-30T18:56:15.515808] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:15.567671] [DEBUG] [LOCAL ] GEL: Loaded 33432 existing records from primary storage. [2025-09-30T18:56:15.567975] [INFO ] [MAIN ] GEL: Loaded 33432 existing records. [2025-09-30T18:56:15.782895] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:15.794312] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:56:15.793872] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-30T18:56:15.799636] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-30T18:56:15.800753] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-30T18:56:15.800835] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-30T18:56:15.993314] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T18:56:16.268342] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-30T18:56:16.275629] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:16.534159] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T18:56:17.054367] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-30T18:56:17.268826] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T18:56:17.274430] [INFO ] [REMOTE ] GDV: Full fetch complete (28604 records). [2025-09-30T18:56:17.274570] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-30T18:56:17.696925] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-30T18:56:17.697009] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-30T18:56:17.697610] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-30T18:56:17.697681] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-30T18:56:17.698512] [DEBUG] [LOCAL ] GDV: Trimmed 28604 records to 19538 (keeping 200 days of data) [2025-09-30T18:56:17.833780] [DEBUG] [LOCAL ] GDV: Primary data saved (19538 records). [2025-09-30T18:56:17.833964] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-30T18:56:17.834104] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDV took 22.9s. Estimated remaining: 3h 6m 17s. Rate: 7.8 symbols/min [2025-09-30T18:56:17.859510] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-30T18:56:18.037602] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:18.101864] [DEBUG] [LOCAL ] GENI: Loaded 52916 existing records from primary storage. [2025-09-30T18:56:18.102221] [INFO ] [MAIN ] GENI: Loaded 52916 existing records. [2025-09-30T18:56:18.310417] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:18.321367] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-30T18:56:18.322181] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-30T18:56:18.322081] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T18:56:18.327703] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-30T18:56:18.328462] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-30T18:56:18.659507] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-30T18:56:18.719072] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:19.454383] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-30T18:56:19.963457] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:56:20.070479] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:56:20.254394] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-30T18:56:20.978519] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:56:21.054395] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-30T18:56:21.555493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:56:21.854407] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-30T18:56:22.654349] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-30T18:56:22.844546] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:56:23.056852] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T18:56:23.454357] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-30T18:56:24.171844] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:56:24.254393] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-30T18:56:25.054409] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-30T18:56:25.445400] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T18:56:25.855814] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-30T18:56:25.858909] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:56:26.465054] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:56:26.546722] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T18:56:26.654402] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-30T18:56:27.454395] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-30T18:56:27.737855] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:56:28.254366] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-30T18:56:29.029916] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:56:29.054307] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-30T18:56:29.190568] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T18:56:29.854361] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-30T18:56:30.654400] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-30T18:56:30.830045] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T18:56:31.211047] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:56:31.454363] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-30T18:56:31.743083] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:56:32.254348] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-30T18:56:32.803629] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:56:33.054375] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-30T18:56:33.854330] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-30T18:56:33.908289] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:56:33.978352] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:56:34.654364] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-30T18:56:34.979103] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:56:34.984987] [INFO ] [REMOTE ] GEL: Full fetch complete (48583 records). [2025-09-30T18:56:34.985094] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-30T18:56:35.397330] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-30T18:56:35.397413] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-30T18:56:35.398152] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-30T18:56:35.398217] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-30T18:56:35.399278] [DEBUG] [LOCAL ] GEL: Trimmed 48583 records to 33317 (keeping 200 days of data) [2025-09-30T18:56:35.455252] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-30T18:56:35.612012] [DEBUG] [LOCAL ] GEL: Primary data saved (33317 records). [2025-09-30T18:56:35.612158] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-30T18:56:35.612995] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEL took 20.3s. Estimated remaining: 3h 6m 26s. Rate: 7.8 symbols/min [2025-09-30T18:56:35.804423] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:35.861798] [DEBUG] [LOCAL ] GEO: Loaded 51992 existing records from primary storage. [2025-09-30T18:56:35.862144] [INFO ] [MAIN ] GEO: Loaded 51992 existing records. [2025-09-30T18:56:36.057092] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:36.057346] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-30T18:56:36.057400] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-30T18:56:36.058252] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-30T18:56:36.058314] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-30T18:56:36.260564] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-30T18:56:36.490879] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:36.942840] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:56:37.054341] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-30T18:56:37.284155] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:56:37.480303] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T18:56:37.854367] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-30T18:56:38.654358] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-30T18:56:39.024344] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:56:39.298540] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-30T18:56:39.454364] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-30T18:56:40.254327] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-30T18:56:40.442181] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T18:56:40.549359] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:56:41.054366] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-30T18:56:41.854357] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-30T18:56:42.531136] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-30T18:56:42.550220] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-30T18:56:42.550389] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-30T18:56:42.660605] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-30T18:56:43.006790] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-30T18:56:43.006970] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-30T18:56:43.008040] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-30T18:56:43.008150] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-30T18:56:43.010299] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-30T18:56:43.135947] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-30T18:56:43.325802] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:56:43.450488] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-30T18:56:43.450627] [INFO ] [MAIN ] GE: Full history saved. [2025-09-30T18:56:43.450850] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 46.4s. Estimated remaining: 3h 6m 18s. Rate: 7.8 symbols/min [2025-09-30T18:56:43.463116] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-30T18:56:43.637812] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:43.653436] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T18:56:43.659242] [INFO ] [REMOTE ] GEF: Full fetch complete (29355 records). [2025-09-30T18:56:43.659402] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-30T18:56:43.985947] [DEBUG] [LOCAL ] GES: Loaded 39554 existing records from primary storage. [2025-09-30T18:56:44.004236] [INFO ] [MAIN ] GES: Loaded 39554 existing records. [2025-09-30T18:56:44.272246] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-30T18:56:44.322903] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-30T18:56:44.326349] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:44.327325] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-30T18:56:44.327485] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-30T18:56:44.328175] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-30T18:56:44.328514] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-30T18:56:44.328454] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-30T18:56:44.329394] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-30T18:56:44.329459] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-30T18:56:44.341158] [DEBUG] [LOCAL ] GEF: Trimmed 29355 records to 20508 (keeping 200 days of data) [2025-09-30T18:56:44.836161] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:44.867194] [DEBUG] [LOCAL ] GEF: Primary data saved (20508 records). [2025-09-30T18:56:44.867356] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-30T18:56:44.867591] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEF took 35.4s. Estimated remaining: 3h 6m 1s. Rate: 7.8 symbols/min [2025-09-30T18:56:45.057320] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:45.057538] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-30T18:56:45.095483] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:56:45.144289] [DEBUG] [LOCAL ] GETY: Loaded 35719 existing records from primary storage. [2025-09-30T18:56:45.144634] [INFO ] [MAIN ] GETY: Loaded 35719 existing records. [2025-09-30T18:56:45.329933] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:45.330161] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-30T18:56:45.330210] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-30T18:56:45.331319] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-30T18:56:45.331382] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-30T18:56:45.731824] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:45.854324] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-30T18:56:46.132455] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T18:56:46.342636] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:56:46.654403] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-30T18:56:47.205919] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:56:47.454352] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-30T18:56:48.026679] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:56:48.254362] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-30T18:56:49.054386] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-30T18:56:49.339038] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:56:49.350412] [INFO ] [REMOTE ] GENI: Full fetch complete (75466 records). [2025-09-30T18:56:49.350552] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-30T18:56:49.775834] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-30T18:56:49.775987] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-30T18:56:49.776927] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-30T18:56:49.777088] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-30T18:56:49.793474] [DEBUG] [LOCAL ] GENI: Trimmed 75466 records to 52925 (keeping 200 days of data) [2025-09-30T18:56:49.805258] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:56:49.861445] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-30T18:56:50.137840] [DEBUG] [LOCAL ] GENI: Primary data saved (52925 records). [2025-09-30T18:56:50.137997] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-30T18:56:50.138086] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 32.3s. Estimated remaining: 3h 5m 49s. Rate: 7.8 symbols/min [2025-09-30T18:56:50.334714] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:50.403260] [DEBUG] [LOCAL ] GEV: Loaded 53076 existing records from primary storage. [2025-09-30T18:56:50.403729] [INFO ] [MAIN ] GEV: Loaded 53076 existing records. [2025-09-30T18:56:50.661999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-30T18:56:50.672639] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:50.674409] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-30T18:56:50.674534] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-30T18:56:50.677438] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-30T18:56:50.677633] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-30T18:56:51.213382] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-30T18:56:51.305579] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:51.342895] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:56:51.454415] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-30T18:56:52.157586] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:56:52.254390] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-30T18:56:53.054381] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-30T18:56:53.662861] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T18:56:53.706346] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T18:56:53.854382] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-30T18:56:54.584512] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:56:54.654387] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-30T18:56:55.454411] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-30T18:56:56.106747] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-30T18:56:56.248176] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:56:56.256963] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-30T18:56:56.901968] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:56:57.054387] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-30T18:56:57.854347] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-30T18:56:58.054743] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:56:58.556019] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:56:58.654365] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-30T18:56:59.454371] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-30T18:56:59.499349] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:56:59.995413] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:57:00.254361] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-30T18:57:00.980250] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:57:01.054341] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-30T18:57:01.629360] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:57:01.854404] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-30T18:57:01.978898] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:57:02.654397] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-30T18:57:03.283353] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:57:03.454372] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-30T18:57:03.970549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:57:04.254361] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-30T18:57:05.054332] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-30T18:57:05.125081] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:57:05.561602] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:57:05.854372] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-30T18:57:06.482494] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:57:06.654372] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-30T18:57:07.249750] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:57:07.454392] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-30T18:57:08.073599] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:57:08.081687] [INFO ] [REMOTE ] GES: Full fetch complete (59579 records). [2025-09-30T18:57:08.081861] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-30T18:57:08.259622] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-30T18:57:08.539293] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-30T18:57:08.539403] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-30T18:57:08.540272] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-30T18:57:08.540390] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-30T18:57:08.541776] [DEBUG] [LOCAL ] GES: Trimmed 59579 records to 39447 (keeping 200 days of data) [2025-09-30T18:57:08.789835] [DEBUG] [LOCAL ] GES: Primary data saved (39447 records). [2025-09-30T18:57:08.789983] [INFO ] [MAIN ] GES: Full history saved. [2025-09-30T18:57:08.790105] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GES took 25.3s. Estimated remaining: 3h 5m 59s. Rate: 7.8 symbols/min [2025-09-30T18:57:08.972333] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:08.978487] [DEBUG] [LOCAL ] GF: Loaded 3023 existing records from primary storage. [2025-09-30T18:57:08.978696] [INFO ] [MAIN ] GF: Loaded 3023 existing records. [2025-09-30T18:57:09.059623] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-30T18:57:09.174664] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:09.175011] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-30T18:57:09.175078] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-30T18:57:09.175413] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-30T18:57:09.175474] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-30T18:57:09.574234] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:09.786461] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-30T18:57:09.856560] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-30T18:57:09.859804] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:57:10.102590] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:57:10.110011] [INFO ] [REMOTE ] GETY: Full fetch complete (55526 records). [2025-09-30T18:57:10.110145] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-30T18:57:10.517806] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-30T18:57:10.517912] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-30T18:57:10.518828] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-30T18:57:10.518898] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-30T18:57:10.520387] [DEBUG] [LOCAL ] GETY: Trimmed 55526 records to 35567 (keeping 200 days of data) [2025-09-30T18:57:10.670686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-30T18:57:10.728186] [DEBUG] [LOCAL ] GETY: Primary data saved (35567 records). [2025-09-30T18:57:10.728342] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-30T18:57:10.728434] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GETY took 25.9s. Estimated remaining: 3h 5m 42s. Rate: 7.8 symbols/min [2025-09-30T18:57:11.454409] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-30T18:57:12.109204] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:57:12.234576] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-30T18:57:12.254311] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-30T18:57:12.447133] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T18:57:13.054381] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-30T18:57:13.854411] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-30T18:57:14.196605] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T18:57:14.331987] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T18:57:14.654356] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-30T18:57:14.940262] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:57:14.950919] [INFO ] [REMOTE ] GEO: Full fetch complete (75431 records). [2025-09-30T18:57:14.951064] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-30T18:57:15.306201] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T18:57:15.391434] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-30T18:57:15.391600] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-30T18:57:15.392765] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-30T18:57:15.392838] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-30T18:57:15.397703] [DEBUG] [LOCAL ] GEO: Trimmed 75431 records to 51949 (keeping 200 days of data) [2025-09-30T18:57:15.462856] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-30T18:57:15.727177] [DEBUG] [LOCAL ] GEO: Primary data saved (51949 records). [2025-09-30T18:57:15.727313] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-30T18:57:15.727397] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GEO took 40.1s. Estimated remaining: 3h 5m 30s. Rate: 7.8 symbols/min [2025-09-30T18:57:16.254382] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-30T18:57:17.223287] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:57:17.225501] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-30T18:57:17.757748] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-30T18:57:17.796037] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:57:17.854328] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-30T18:57:18.254222] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:57:18.654373] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-30T18:57:19.177113] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T18:57:19.454547] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-30T18:57:19.902519] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:57:20.254348] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-30T18:57:20.720622] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T18:57:21.054405] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-30T18:57:21.721036] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T18:57:21.722324] [INFO ] [REMOTE ] GF: Full fetch complete (5225 records). [2025-09-30T18:57:21.722500] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-30T18:57:21.859802] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-30T18:57:22.125879] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-30T18:57:22.125970] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-30T18:57:22.126181] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-30T18:57:22.126297] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-30T18:57:22.126799] [DEBUG] [LOCAL ] GF: Trimmed 5225 records to 2999 (keeping 200 days of data) [2025-09-30T18:57:22.146330] [DEBUG] [LOCAL ] GF: Primary data saved (2999 records). [2025-09-30T18:57:22.146420] [INFO ] [MAIN ] GF: Full history saved. [2025-09-30T18:57:22.146574] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 13.4s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min [2025-09-30T18:57:24.144960] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:57:24.158328] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-30T18:57:26.571583] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-30T18:57:26.582997] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-30T18:57:29.010856] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T18:57:29.025119] [INFO ] [REMOTE ] GEV: Full fetch complete (76926 records). [2025-09-30T18:57:29.025289] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-30T18:57:29.477231] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-30T18:57:29.477338] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-30T18:57:29.478402] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-30T18:57:29.478473] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-30T18:57:29.482034] [DEBUG] [LOCAL ] GEV: Trimmed 76926 records to 53059 (keeping 200 days of data) [2025-09-30T18:57:29.895411] [DEBUG] [LOCAL ] GEV: Primary data saved (53059 records). [2025-09-30T18:57:29.895552] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-30T18:57:29.895682] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 39.8s. Estimated remaining: 3h 5m 13s. Rate: 7.8 symbols/min [2025-09-30T18:57:30.524264] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.576076] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.668299] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.701132] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.710953] [DEBUG] [LOCAL ] GFR: Loaded 8377 existing records from primary storage. [2025-09-30T18:57:30.711313] [INFO ] [MAIN ] GFR: Loaded 8377 existing records. [2025-09-30T18:57:30.933011] [DEBUG] [LOCAL ] GFF: Loaded 30447 existing records from primary storage. [2025-09-30T18:57:30.957326] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:30.983536] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-30T18:57:30.983680] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-30T18:57:30.983332] [INFO ] [MAIN ] GFF: Loaded 30447 existing records. [2025-09-30T18:57:30.996053] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-30T18:57:31.024252] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-30T18:57:31.169776] [DEBUG] [LOCAL ] GFI: Loaded 53108 existing records from primary storage. [2025-09-30T18:57:31.226457] [INFO ] [MAIN ] GFI: Loaded 53108 existing records. [2025-09-30T18:57:31.243113] [DEBUG] [LOCAL ] GFL: Loaded 47965 existing records from primary storage. [2025-09-30T18:57:31.285467] [INFO ] [MAIN ] GFL: Loaded 47965 existing records. [2025-09-30T18:57:31.391060] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:31.502294] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-30T18:57:31.502457] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-30T18:57:31.651830] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-30T18:57:31.689987] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-30T18:57:31.959028] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:32.078246] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-30T18:57:32.133680] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:32.133821] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-30T18:57:32.172027] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-30T18:57:32.187686] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-30T18:57:32.236791] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-30T18:57:32.259128] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:32.265337] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-30T18:57:32.264427] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-30T18:57:32.252479] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-30T18:57:32.275510] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-30T18:57:32.831204] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:32.861368] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-30T18:57:33.267533] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:33.261171] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:57:33.277535] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-30T18:57:33.298832] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-30T18:57:33.363152] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:33.363525] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-30T18:57:33.821286] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:57:33.823950] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-30T18:57:34.251695] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:57:34.258034] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-30T18:57:34.297234] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:57:34.299837] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-30T18:57:34.797125] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:57:34.806046] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-30T18:57:35.036316] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T18:57:35.039717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-30T18:57:35.179417] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:57:35.190182] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-30T18:57:35.255280] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:57:35.261663] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-30T18:57:35.650044] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:57:35.653842] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-30T18:57:36.043480] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:57:36.054754] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-30T18:57:36.302685] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:57:36.316170] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:57:36.316849] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-30T18:57:36.320708] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-30T18:57:36.712496] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T18:57:37.054353] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-30T18:57:37.127433] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T18:57:37.332581] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:57:37.655249] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T18:57:37.663332] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T18:57:37.854361] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-30T18:57:38.654361] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-30T18:57:39.079952] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T18:57:39.454352] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-30T18:57:40.026984] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T18:57:40.254356] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-30T18:57:40.369231] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:57:40.775444] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:57:40.777590] [INFO ] [REMOTE ] GFR: Full fetch complete (12616 records). [2025-09-30T18:57:40.777703] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-30T18:57:41.059492] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-30T18:57:41.162418] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-30T18:57:41.162511] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-30T18:57:41.162889] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-30T18:57:41.162999] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-30T18:57:41.163635] [DEBUG] [LOCAL ] GFR: Trimmed 12616 records to 8366 (keeping 200 days of data) [2025-09-30T18:57:41.210873] [DEBUG] [LOCAL ] GFR: Primary data saved (8366 records). [2025-09-30T18:57:41.211012] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-30T18:57:41.211113] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 11.3s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min [2025-09-30T18:57:41.390038] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:41.438278] [DEBUG] [LOCAL ] GGB: Loaded 51072 existing records from primary storage. [2025-09-30T18:57:41.438629] [INFO ] [MAIN ] GGB: Loaded 51072 existing records. [2025-09-30T18:57:41.660678] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:41.661196] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-30T18:57:41.661287] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-30T18:57:41.663469] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-30T18:57:41.663549] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-30T18:57:41.856669] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-30T18:57:42.052979] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:42.614717] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T18:57:42.654433] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-30T18:57:43.237486] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:57:43.454433] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-30T18:57:44.254418] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-30T18:57:44.317859] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T18:57:45.054355] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-30T18:57:45.199128] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:57:45.514369] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:57:45.854383] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-30T18:57:46.508536] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:57:46.654369] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-30T18:57:47.454331] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-30T18:57:47.917793] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:57:48.033473] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T18:57:48.254399] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-30T18:57:48.834512] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:57:49.054429] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-30T18:57:49.854386] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-30T18:57:50.021245] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T18:57:50.133800] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T18:57:50.654395] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-30T18:57:51.454386] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-30T18:57:51.497607] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:57:51.976058] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:57:52.254396] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-30T18:57:53.054334] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-30T18:57:53.377244] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T18:57:53.494009] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:57:53.854410] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-30T18:57:54.149039] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:57:54.654371] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-30T18:57:55.139492] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T18:57:55.145351] [INFO ] [REMOTE ] GFF: Full fetch complete (44093 records). [2025-09-30T18:57:55.145483] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-30T18:57:55.459455] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-30T18:57:55.544885] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-30T18:57:55.544983] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-30T18:57:55.545907] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-30T18:57:55.545993] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-30T18:57:55.547474] [DEBUG] [LOCAL ] GFF: Trimmed 44093 records to 30408 (keeping 200 days of data) [2025-09-30T18:57:55.745526] [DEBUG] [LOCAL ] GFF: Primary data saved (30408 records). [2025-09-30T18:57:55.745686] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-30T18:57:55.745803] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 25.8s. Estimated remaining: 3h 5m 14s. Rate: 7.8 symbols/min [2025-09-30T18:57:55.935865] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:55.968992] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:57:56.017241] [DEBUG] [LOCAL ] GGG: Loaded 40907 existing records from primary storage. [2025-09-30T18:57:56.017589] [INFO ] [MAIN ] GGG: Loaded 40907 existing records. [2025-09-30T18:57:56.206475] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:56.206771] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-30T18:57:56.206823] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-30T18:57:56.208126] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-30T18:57:56.208208] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-30T18:57:56.259492] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-30T18:57:56.592392] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:57.054354] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-30T18:57:57.238178] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:57:57.508667] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:57:57.854373] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-30T18:57:58.496475] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:57:58.654380] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-30T18:57:59.454402] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-30T18:57:59.538368] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:58:00.254331] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-30T18:58:00.292707] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:58:01.051778] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:58:01.060081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-30T18:58:01.657722] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:58:01.854366] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-30T18:58:02.252525] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:58:02.654380] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-30T18:58:03.454379] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-30T18:58:04.100382] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T18:58:04.116430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:58:04.254379] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-30T18:58:04.980196] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:58:05.054430] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-30T18:58:05.854408] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-30T18:58:06.509918] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:58:06.538947] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-30T18:58:06.551998] [INFO ] [REMOTE ] GFI: Full fetch complete (76383 records). [2025-09-30T18:58:06.552158] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-30T18:58:06.663426] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-30T18:58:07.000891] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-30T18:58:07.000982] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-30T18:58:07.002011] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-30T18:58:07.002082] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-30T18:58:07.003725] [DEBUG] [LOCAL ] GFI: Trimmed 76383 records to 53102 (keeping 200 days of data) [2025-09-30T18:58:07.387223] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:58:07.402495] [INFO ] [REMOTE ] GFL: Full fetch complete (68991 records). [2025-09-30T18:58:07.403325] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-30T18:58:07.454835] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-30T18:58:07.694523] [DEBUG] [LOCAL ] GFI: Primary data saved (53102 records). [2025-09-30T18:58:07.730636] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-30T18:58:07.759561] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFI took 37.8s. Estimated remaining: 3h 5m 14s. Rate: 7.8 symbols/min [2025-09-30T18:58:08.040278] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-30T18:58:08.076928] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-30T18:58:08.109474] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:08.109920] [DEBUG] [LOCAL ] GGT: No existing data file found in primary storage. [2025-09-30T18:58:08.111002] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-30T18:58:08.110058] [WARN ] [MAIN ] GGT: No existing data found, performing full refresh instead. [2025-09-30T18:58:08.111104] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-30T18:58:08.111445] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-30T18:58:08.111505] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-30T18:58:08.111555] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-09-30T18:58:08.111590] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-30T18:58:08.217574] [DEBUG] [LOCAL ] GFL: Trimmed 68991 records to 47943 (keeping 200 days of data) [2025-09-30T18:58:08.631948] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:08.633954] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-30T18:58:08.679669] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:58:08.711466] [INFO ] [REMOTE ] GGB: Full fetch complete (74046 records). [2025-09-30T18:58:08.715339] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-30T18:58:08.903114] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:58:09.057572] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-30T18:58:09.328708] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-30T18:58:09.329210] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-30T18:58:09.330736] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-30T18:58:09.330828] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-30T18:58:09.334991] [DEBUG] [LOCAL ] GGB: Trimmed 74046 records to 51085 (keeping 200 days of data) [2025-09-30T18:58:09.492377] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:58:09.620666] [DEBUG] [LOCAL ] GFL: Primary data saved (47943 records). [2025-09-30T18:58:09.621216] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-30T18:58:09.621706] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFL took 39.7s. Estimated remaining: 3h 4m 57s. Rate: 7.8 symbols/min [2025-09-30T18:58:09.825337] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:09.833053] [DEBUG] [LOCAL ] GGZ: Loaded 2412 existing records from primary storage. [2025-09-30T18:58:09.833816] [INFO ] [MAIN ] GGZ: Loaded 2412 existing records. [2025-09-30T18:58:09.859787] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-30T18:58:10.051743] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:10.051979] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-30T18:58:10.052028] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-30T18:58:10.052347] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-30T18:58:10.052426] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-30T18:58:10.524721] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:10.539346] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:58:10.563526] [DEBUG] [LOCAL ] GGB: Primary data saved (51085 records). [2025-09-30T18:58:10.572207] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-30T18:58:10.573429] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:58:10.573613] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 29.4s. Estimated remaining: 3h 4m 39s. Rate: 7.8 symbols/min [2025-09-30T18:58:10.660606] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-30T18:58:10.812731] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:10.817702] [DEBUG] [LOCAL ] GHC: Loaded 2660 existing records from primary storage. [2025-09-30T18:58:10.817960] [INFO ] [MAIN ] GHC: Loaded 2660 existing records. [2025-09-30T18:58:11.012118] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:11.012325] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-30T18:58:11.012373] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-30T18:58:11.012691] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-30T18:58:11.012752] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-30T18:58:11.459914] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-30T18:58:11.459810] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:11.475601] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T18:58:12.254372] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-30T18:58:12.671998] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T18:58:12.876977] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T18:58:13.054422] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-30T18:58:13.718027] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:58:13.854397] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-30T18:58:14.413999] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T18:58:14.654390] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-30T18:58:15.454367] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-30T18:58:15.459184] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:58:16.044388] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:58:16.254407] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-30T18:58:17.054339] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-30T18:58:17.063209] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:58:17.593902] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:58:17.854359] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-30T18:58:18.654413] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-30T18:58:19.001815] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:58:19.069609] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:58:19.454367] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-30T18:58:20.022102] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T18:58:20.254399] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-30T18:58:21.054353] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-30T18:58:21.227379] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:58:21.401217] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:58:21.854365] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-30T18:58:22.654401] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-30T18:58:23.393330] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:58:23.454363] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-30T18:58:23.637269] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:58:24.254402] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-30T18:58:24.658187] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:58:24.794578] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-30T18:58:25.054374] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-30T18:58:25.476425] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T18:58:25.854417] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-30T18:58:26.654365] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-30T18:58:27.281062] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T18:58:27.283472] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:58:27.294315] [INFO ] [REMOTE ] GGG: Full fetch complete (59289 records). [2025-09-30T18:58:27.294426] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-30T18:58:27.459447] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-30T18:58:27.792707] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-30T18:58:27.792797] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-30T18:58:27.793574] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-30T18:58:27.793637] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-30T18:58:27.796485] [DEBUG] [LOCAL ] GGG: Trimmed 59289 records to 40945 (keeping 200 days of data) [2025-09-30T18:58:28.060598] [DEBUG] [LOCAL ] GGG: Primary data saved (40945 records). [2025-09-30T18:58:28.060763] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-30T18:58:28.060855] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGG took 32.3s. Estimated remaining: 3h 4m 46s. Rate: 7.8 symbols/min [2025-09-30T18:58:28.248196] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:28.253447] [DEBUG] [LOCAL ] GHG: Loaded 3192 existing records from primary storage. [2025-09-30T18:58:28.253742] [INFO ] [MAIN ] GHG: Loaded 3192 existing records. [2025-09-30T18:58:28.259638] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-30T18:58:28.396548] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T18:58:28.474907] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:28.475148] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-30T18:58:28.475201] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-30T18:58:28.475456] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-30T18:58:28.475520] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-30T18:58:28.895930] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:28.909799] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:58:29.054378] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-30T18:58:29.854344] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-30T18:58:30.071311] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:58:30.075147] [INFO ] [REMOTE ] GGT: Full fetch complete (18749 records). [2025-09-30T18:58:30.075227] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-30T18:58:30.416445] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:58:30.479345] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-30T18:58:30.479429] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-30T18:58:30.479959] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-30T18:58:30.480023] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-30T18:58:30.480676] [DEBUG] [LOCAL ] GGT: Trimmed 18749 records to 14105 (keeping 200 days of data) [2025-09-30T18:58:30.574175] [DEBUG] [LOCAL ] GGT: Primary data saved (14105 records). [2025-09-30T18:58:30.574313] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-30T18:58:30.574389] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 22.8s. Estimated remaining: 3h 4m 31s. Rate: 7.8 symbols/min [2025-09-30T18:58:30.661711] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-30T18:58:30.766517] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:30.779311] [DEBUG] [LOCAL ] GHI: Loaded 6929 existing records from primary storage. [2025-09-30T18:58:30.779557] [INFO ] [MAIN ] GHI: Loaded 6929 existing records. [2025-09-30T18:58:30.980074] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:30.980312] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-30T18:58:30.980362] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-30T18:58:30.980639] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-30T18:58:30.980757] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-30T18:58:31.295014] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T18:58:31.379994] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:31.454314] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-30T18:58:32.254349] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-30T18:58:32.394315] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:58:32.682036] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T18:58:33.054339] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-30T18:58:33.516337] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T18:58:33.854365] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-30T18:58:34.275502] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:58:34.654360] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-30T18:58:35.230573] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T18:58:35.232232] [INFO ] [REMOTE ] GGZ: Full fetch complete (4161 records). [2025-09-30T18:58:35.232334] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-30T18:58:35.462765] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-30T18:58:35.787444] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-30T18:58:35.787569] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-30T18:58:35.787879] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-30T18:58:35.787963] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-30T18:58:35.788841] [DEBUG] [LOCAL ] GGZ: Trimmed 4161 records to 2407 (keeping 200 days of data) [2025-09-30T18:58:35.817470] [DEBUG] [LOCAL ] GGZ: Primary data saved (2407 records). [2025-09-30T18:58:35.817692] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-30T18:58:35.817839] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 26.2s. Estimated remaining: 3h 4m 19s. Rate: 7.8 symbols/min [2025-09-30T18:58:35.979590] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T18:58:36.083909] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:36.092528] [DEBUG] [LOCAL ] GHLD: Loaded 4162 existing records from primary storage. [2025-09-30T18:58:36.092812] [INFO ] [MAIN ] GHLD: Loaded 4162 existing records. [2025-09-30T18:58:36.259620] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-30T18:58:36.342380] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:36.342687] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-30T18:58:36.342749] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-30T18:58:36.343087] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-30T18:58:36.343150] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-30T18:58:36.736695] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:36.919424] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:58:37.054367] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-30T18:58:37.404028] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T18:58:37.854350] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-30T18:58:38.525795] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T18:58:38.654364] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-30T18:58:39.379388] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:58:39.454362] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-30T18:58:40.149229] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T18:58:40.254326] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-30T18:58:40.933117] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:58:41.054401] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-30T18:58:41.366917] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-30T18:58:41.854362] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-30T18:58:42.615658] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T18:58:42.654345] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-30T18:58:43.406414] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:58:43.454366] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-30T18:58:43.943101] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T18:58:44.254390] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-30T18:58:45.054379] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-30T18:58:45.080589] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T18:58:45.520002] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:58:45.854399] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-30T18:58:46.297740] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-30T18:58:46.654365] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-30T18:58:47.177865] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:58:47.179146] [INFO ] [REMOTE ] GHC: Full fetch complete (3303 records). [2025-09-30T18:58:47.179225] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-30T18:58:47.459537] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-30T18:58:47.575600] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-30T18:58:47.575718] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-30T18:58:47.575875] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-30T18:58:47.575947] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-30T18:58:47.576478] [DEBUG] [LOCAL ] GHC: Trimmed 3303 records to 2667 (keeping 200 days of data) [2025-09-30T18:58:47.594766] [DEBUG] [LOCAL ] GHC: Primary data saved (2667 records). [2025-09-30T18:58:47.594853] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-30T18:58:47.594933] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 37.0s. Estimated remaining: 3h 4m 18s. Rate: 7.8 symbols/min [2025-09-30T18:58:47.783558] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:47.798161] [DEBUG] [LOCAL ] GHM: Loaded 13966 existing records from primary storage. [2025-09-30T18:58:47.798406] [INFO ] [MAIN ] GHM: Loaded 13966 existing records. [2025-09-30T18:58:47.881694] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:58:48.004927] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:48.005166] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-30T18:58:48.005216] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-30T18:58:48.005837] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-30T18:58:48.005899] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-30T18:58:48.264090] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-30T18:58:48.393129] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:48.940013] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T18:58:49.054392] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-30T18:58:49.854385] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-30T18:58:50.052243] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:58:50.510964] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T18:58:50.654373] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-30T18:58:51.228840] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:58:51.454396] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-30T18:58:52.251761] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T18:58:52.253986] [INFO ] [REMOTE ] GHI: Full fetch complete (11717 records). [2025-09-30T18:58:52.254064] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-30T18:58:52.259515] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-30T18:58:52.657712] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-30T18:58:52.657804] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-30T18:58:52.658135] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-30T18:58:52.658198] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-30T18:58:52.658688] [DEBUG] [LOCAL ] GHI: Trimmed 11717 records to 7001 (keeping 200 days of data) [2025-09-30T18:58:52.710369] [DEBUG] [LOCAL ] GHI: Primary data saved (7001 records). [2025-09-30T18:58:52.710543] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-30T18:58:52.710668] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 22.1s. Estimated remaining: 3h 4m 6s. Rate: 7.8 symbols/min [2025-09-30T18:58:52.827397] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T18:58:52.904259] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:52.926240] [DEBUG] [LOCAL ] GHY: Loaded 20963 existing records from primary storage. [2025-09-30T18:58:52.926503] [INFO ] [MAIN ] GHY: Loaded 20963 existing records. [2025-09-30T18:58:53.059481] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-30T18:58:53.123908] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:53.124151] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-30T18:58:53.124206] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-30T18:58:53.124950] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-30T18:58:53.125013] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-30T18:58:53.502519] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:53.854373] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-30T18:58:53.957502] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:58:54.654385] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-30T18:58:54.826366] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:58:55.110372] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T18:58:55.454387] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-30T18:58:56.254345] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-30T18:58:56.512832] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:58:57.054369] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-30T18:58:57.489407] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T18:58:57.547400] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:58:57.854382] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-30T18:58:58.654323] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-30T18:58:58.888747] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:58:58.956779] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-30T18:58:59.454371] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-30T18:59:00.254793] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-30T18:59:00.255550] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T18:59:00.859695] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:59:01.054370] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-30T18:59:01.760932] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:59:01.854398] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-30T18:59:02.379688] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-30T18:59:02.654405] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-30T18:59:03.409250] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T18:59:03.454388] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-30T18:59:04.194425] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T18:59:04.254393] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-30T18:59:04.742971] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T18:59:05.054364] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-30T18:59:05.781694] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:59:05.854351] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-30T18:59:06.447211] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T18:59:06.654376] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-30T18:59:07.332865] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:59:07.334275] [INFO ] [REMOTE ] GHG: Full fetch complete (4016 records). [2025-09-30T18:59:07.334382] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-30T18:59:07.459447] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-30T18:59:07.724738] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-30T18:59:07.724821] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-30T18:59:07.724948] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-30T18:59:07.724986] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-30T18:59:07.725347] [DEBUG] [LOCAL ] GHG: Trimmed 4016 records to 3182 (keeping 200 days of data) [2025-09-30T18:59:07.744064] [DEBUG] [LOCAL ] GHG: Primary data saved (3182 records). [2025-09-30T18:59:07.744175] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-30T18:59:07.744256] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHG took 39.7s. Estimated remaining: 3h 4m 10s. Rate: 7.8 symbols/min [2025-09-30T18:59:07.929454] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:07.965148] [DEBUG] [LOCAL ] GIB: Loaded 32054 existing records from primary storage. [2025-09-30T18:59:07.965450] [INFO ] [MAIN ] GIB: Loaded 32054 existing records. [2025-09-30T18:59:08.153423] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:08.153633] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-30T18:59:08.153739] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-30T18:59:08.154404] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-30T18:59:08.154466] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-30T18:59:08.259103] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-30T18:59:08.496707] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T18:59:08.568941] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:08.879537] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T18:59:09.054370] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-30T18:59:09.854350] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-30T18:59:10.158986] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T18:59:10.477477] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:59:10.654359] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-30T18:59:11.454324] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-30T18:59:11.502708] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T18:59:12.254374] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-30T18:59:12.701712] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T18:59:13.054374] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-30T18:59:13.216897] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:59:13.734832] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:59:13.736373] [INFO ] [REMOTE ] GHLD: Full fetch complete (4753 records). [2025-09-30T18:59:13.736442] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-30T18:59:13.859460] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-30T18:59:14.134462] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-30T18:59:14.134546] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-30T18:59:14.134725] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-30T18:59:14.134788] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-30T18:59:14.135243] [DEBUG] [LOCAL ] GHLD: Trimmed 4753 records to 4166 (keeping 200 days of data) [2025-09-30T18:59:14.162592] [DEBUG] [LOCAL ] GHLD: Primary data saved (4166 records). [2025-09-30T18:59:14.162759] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-30T18:59:14.162850] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 38.3s. Estimated remaining: 3h 4m 0s. Rate: 7.8 symbols/min [2025-09-30T18:59:14.343017] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:14.359260] [DEBUG] [LOCAL ] GIC: Loaded 13539 existing records from primary storage. [2025-09-30T18:59:14.359526] [INFO ] [MAIN ] GIC: Loaded 13539 existing records. [2025-09-30T18:59:14.551149] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:14.551366] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-30T18:59:14.551417] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-30T18:59:14.551612] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-30T18:59:14.551715] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-30T18:59:14.663392] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-30T18:59:14.971919] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:15.067997] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T18:59:15.454400] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-30T18:59:15.932230] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:59:16.242451] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T18:59:16.254323] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-30T18:59:17.054394] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-30T18:59:17.570169] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:59:17.799142] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:59:17.854383] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-30T18:59:18.654341] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-30T18:59:18.891359] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:59:19.411553] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T18:59:19.418141] [INFO ] [REMOTE ] GHY: Full fetch complete (32176 records). [2025-09-30T18:59:19.418331] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-30T18:59:19.459531] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-30T18:59:19.846809] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-30T18:59:19.846928] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-30T18:59:19.847617] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-30T18:59:19.847706] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-30T18:59:19.848563] [DEBUG] [LOCAL ] GHY: Trimmed 32176 records to 20887 (keeping 200 days of data) [2025-09-30T18:59:19.986396] [DEBUG] [LOCAL ] GHY: Primary data saved (20887 records). [2025-09-30T18:59:19.986583] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-30T18:59:19.986712] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHY took 27.3s. Estimated remaining: 3h 3m 50s. Rate: 7.8 symbols/min [2025-09-30T18:59:20.168923] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:20.214018] [DEBUG] [LOCAL ] GIL: Loaded 43252 existing records from primary storage. [2025-09-30T18:59:20.214324] [INFO ] [MAIN ] GIL: Loaded 43252 existing records. [2025-09-30T18:59:20.259479] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-30T18:59:20.402089] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:20.402437] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-30T18:59:20.402587] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-30T18:59:20.403564] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-30T18:59:20.403626] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-30T18:59:20.547785] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:59:20.798476] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:21.054381] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-30T18:59:21.565951] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:59:21.854400] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-30T18:59:21.957607] [DEBUG] [REMOTE ] GIC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-30T18:59:21.957964] [WARN ] [REMOTE ] GIC: No data returned for month 2025-03 [2025-09-30T18:59:21.958086] [FATAL] [REMOTE ] GIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:59:21.958218] [FATAL] [MAIN ] GIC: Failed to fetch primary data. [2025-09-30T18:59:21.958284] [WARN ] [MAIN ] GIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:59:21.958354] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-30T18:59:21.958431] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-09-30T18:59:21.958487] [INFO ] [LOCAL ] GIC: Starting deletion of derivative data. [2025-09-30T18:59:21.958894] [DEBUG] [LOCAL ] GIC: Deleted derivative data file. [2025-09-30T18:59:21.958984] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIC took 7.8s. Estimated remaining: 3h 3m 33s. Rate: 7.8 symbols/min [2025-09-30T18:59:22.151184] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:22.192723] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:59:22.196887] [INFO ] [REMOTE ] GHM: Full fetch complete (21710 records). [2025-09-30T18:59:22.197031] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-30T18:59:22.335196] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-09-30T18:59:22.376392] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-09-30T18:59:22.659477] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-30T18:59:22.777669] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:22.793261] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-30T18:59:22.808213] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-30T18:59:22.821581] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-30T18:59:22.836846] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-30T18:59:22.916512] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-30T18:59:22.933351] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-30T18:59:22.945753] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-30T18:59:22.945856] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-30T18:59:22.971906] [DEBUG] [LOCAL ] GHM: Trimmed 21710 records to 14041 (keeping 200 days of data) [2025-09-30T18:59:23.326707] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:23.344945] [DEBUG] [LOCAL ] GHM: Primary data saved (14041 records). [2025-09-30T18:59:23.345100] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-30T18:59:23.345193] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GHM took 35.8s. Estimated remaining: 3h 3m 16s. Rate: 7.8 symbols/min [2025-09-30T18:59:23.459391] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-30T18:59:23.567157] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:23.604768] [DEBUG] [LOCAL ] GKOS: Loaded 42728 existing records from primary storage. [2025-09-30T18:59:23.605090] [INFO ] [MAIN ] GKOS: Loaded 42728 existing records. [2025-09-30T18:59:23.792775] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:23.792991] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-30T18:59:23.793039] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-30T18:59:23.794186] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-30T18:59:23.794252] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-30T18:59:24.179778] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:24.254327] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-30T18:59:24.289479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:59:25.054440] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-30T18:59:25.094358] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:59:25.195152] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:59:25.854363] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-30T18:59:26.654357] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-30T18:59:26.887437] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:59:27.190478] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T18:59:27.454329] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-30T18:59:28.030442] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:59:28.255768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-30T18:59:28.780499] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:59:29.054433] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-30T18:59:29.854386] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-30T18:59:30.023639] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T18:59:30.161629] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:59:30.654331] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-30T18:59:30.816138] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:59:31.454361] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-30T18:59:31.944491] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:59:32.254359] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-30T18:59:33.059459] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-30T18:59:33.084008] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:59:33.830297] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:59:33.854344] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-30T18:59:33.977355] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T18:59:34.654383] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-30T18:59:35.454371] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-30T18:59:35.676478] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:59:36.047458] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:59:36.254352] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-30T18:59:36.424709] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T18:59:37.054360] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-30T18:59:37.662418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:59:37.854357] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-30T18:59:38.587022] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:59:38.594624] [INFO ] [REMOTE ] GIB: Full fetch complete (45554 records). [2025-09-30T18:59:38.594787] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-30T18:59:38.664198] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-30T18:59:39.010939] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-30T18:59:39.011079] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-30T18:59:39.012022] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-30T18:59:39.012101] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-30T18:59:39.013331] [DEBUG] [LOCAL ] GIB: Trimmed 45554 records to 32041 (keeping 200 days of data) [2025-09-30T18:59:39.223294] [DEBUG] [LOCAL ] GIB: Primary data saved (32041 records). [2025-09-30T18:59:39.223671] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-30T18:59:39.223828] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIB took 31.5s. Estimated remaining: 3h 3m 21s. Rate: 7.8 symbols/min [2025-09-30T18:59:39.421437] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:39.455212] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-30T18:59:39.463572] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T18:59:39.507805] [DEBUG] [LOCAL ] GL: Loaded 37753 existing records from primary storage. [2025-09-30T18:59:39.508257] [INFO ] [MAIN ] GL: Loaded 37753 existing records. [2025-09-30T18:59:39.704391] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:39.704685] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-30T18:59:39.704758] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-30T18:59:39.705746] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-30T18:59:39.705832] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-30T18:59:40.133192] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:40.254341] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-30T18:59:40.320591] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:59:40.814414] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:59:41.054377] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-30T18:59:41.854366] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-30T18:59:42.185461] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:59:42.497442] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:59:42.654376] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-30T18:59:43.386694] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:59:43.454395] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-30T18:59:44.217725] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:59:44.254323] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-30T18:59:44.622046] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:59:45.054387] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-30T18:59:45.685769] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:59:45.854373] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-30T18:59:46.564072] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:59:46.654373] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-30T18:59:47.006237] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:59:47.454369] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-30T18:59:47.848466] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:59:48.254373] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-30T18:59:49.054406] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-30T18:59:49.369597] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:59:49.766933] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:59:49.854372] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-30T18:59:50.249043] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T18:59:50.258133] [INFO ] [REMOTE ] GKOS: Full fetch complete (59929 records). [2025-09-30T18:59:50.258271] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-30T18:59:50.660825] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-30T18:59:50.684029] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-30T18:59:50.684108] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-30T18:59:50.685013] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-30T18:59:50.685090] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-30T18:59:50.686614] [DEBUG] [LOCAL ] GKOS: Trimmed 59929 records to 42680 (keeping 200 days of data) [2025-09-30T18:59:50.960719] [DEBUG] [LOCAL ] GKOS: Primary data saved (42680 records). [2025-09-30T18:59:50.960945] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-30T18:59:50.961115] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 27.6s. Estimated remaining: 3h 3m 20s. Rate: 7.8 symbols/min [2025-09-30T18:59:51.146325] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:51.197907] [DEBUG] [LOCAL ] GLOB: Loaded 47508 existing records from primary storage. [2025-09-30T18:59:51.198386] [INFO ] [MAIN ] GLOB: Loaded 47508 existing records. [2025-09-30T18:59:51.401072] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:51.401445] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-30T18:59:51.401732] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-30T18:59:51.409603] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-30T18:59:51.422660] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-30T18:59:51.430021] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:59:51.459578] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-30T18:59:51.828207] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:52.254327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-30T18:59:52.624932] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:59:52.724065] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T18:59:53.054362] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-30T18:59:53.620830] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:59:53.854372] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-30T18:59:54.654352] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-30T18:59:55.165085] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:59:55.176763] [INFO ] [REMOTE ] GIS: Full fetch complete (77651 records). [2025-09-30T18:59:55.176936] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-30T18:59:55.454432] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-30T18:59:55.609837] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-30T18:59:55.609981] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-30T18:59:55.611228] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-30T18:59:55.611315] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-30T18:59:55.644011] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:59:55.653942] [DEBUG] [LOCAL ] GIS: Trimmed 77651 records to 53672 (keeping 200 days of data) [2025-09-30T18:59:55.655622] [INFO ] [REMOTE ] GIL: Full fetch complete (61456 records). [2025-09-30T18:59:55.655814] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-30T18:59:56.206328] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-30T18:59:56.209573] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-30T18:59:56.215545] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-30T18:59:56.216785] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-30T18:59:56.275069] [DEBUG] [LOCAL ] GIL: Trimmed 61456 records to 43330 (keeping 200 days of data) [2025-09-30T18:59:56.413776] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:59:56.450789] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-30T18:59:56.703550] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-09-30T18:59:56.704534] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-30T18:59:56.704935] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 34.7s. Estimated remaining: 3h 3m 9s. Rate: 7.8 symbols/min [2025-09-30T18:59:56.894271] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:56.908065] [DEBUG] [LOCAL ] GLP: Loaded 9348 existing records from primary storage. [2025-09-30T18:59:56.908710] [INFO ] [MAIN ] GLP: Loaded 9348 existing records. [2025-09-30T18:59:57.132788] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:57.134095] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-30T18:59:57.137060] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-30T18:59:57.139042] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-30T18:59:57.139859] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-30T18:59:57.163868] [DEBUG] [LOCAL ] GIL: Primary data saved (43330 records). [2025-09-30T18:59:57.175000] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-30T18:59:57.175968] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIL took 37.2s. Estimated remaining: 3h 2m 50s. Rate: 7.8 symbols/min [2025-09-30T18:59:57.422581] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T18:59:57.568983] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-30T18:59:57.552232] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:57.719103] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T18:59:57.829335] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:57.866418] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-30T18:59:57.869684] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-30T18:59:57.870087] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-30T18:59:58.051266] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:58.051497] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-30T18:59:58.051544] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-30T18:59:58.052714] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-30T18:59:58.052787] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-30T18:59:58.441886] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:58.654327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-30T18:59:58.665560] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:59:59.225077] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:59:59.454361] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-30T19:00:00.254354] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-30T19:00:00.344873] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:00:00.627390] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T19:00:01.054392] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-30T19:00:01.623458] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:00:01.854419] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-30T19:00:02.182198] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T19:00:02.442619] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:00:02.654401] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-30T19:00:03.454426] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-30T19:00:04.254379] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-30T19:00:04.348256] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:00:05.054386] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-30T19:00:05.071713] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T19:00:05.427826] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T19:00:05.854367] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-30T19:00:06.441807] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:00:06.654365] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-30T19:00:07.438292] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T19:00:07.454316] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-30T19:00:07.643317] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T19:00:08.192424] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:00:08.254382] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-30T19:00:09.054421] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-30T19:00:09.782185] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:00:09.854386] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-30T19:00:10.654379] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-30T19:00:10.681937] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:00:10.952420] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:00:11.454374] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-30T19:00:12.168089] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T19:00:12.254335] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-30T19:00:12.520313] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:00:13.054339] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-30T19:00:13.124823] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T19:00:13.854392] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-30T19:00:14.654360] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-30T19:00:14.833569] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:00:15.454424] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-30T19:00:15.512431] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:00:15.631537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T19:00:15.634821] [INFO ] [REMOTE ] GLP: Full fetch complete (14331 records). [2025-09-30T19:00:15.634925] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-30T19:00:16.034666] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-30T19:00:16.034800] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-30T19:00:16.035259] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-30T19:00:16.035333] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-30T19:00:16.036009] [DEBUG] [LOCAL ] GLP: Trimmed 14331 records to 9370 (keeping 200 days of data) [2025-09-30T19:00:16.095754] [DEBUG] [LOCAL ] GLP: Primary data saved (9370 records). [2025-09-30T19:00:16.095934] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-30T19:00:16.096075] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GLP took 19.4s. Estimated remaining: 3h 2m 60s. Rate: 7.8 symbols/min [2025-09-30T19:00:16.283377] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-30T19:00:16.287068] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:16.345771] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-30T19:00:16.346142] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-30T19:00:16.550937] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:16.551206] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-30T19:00:16.551269] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-30T19:00:16.552939] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-30T19:00:16.553003] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-30T19:00:16.948598] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:17.054372] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-30T19:00:17.400694] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T19:00:17.727132] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:00:17.854369] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-30T19:00:18.654317] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-30T19:00:18.997111] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T19:00:19.454381] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-30T19:00:19.756142] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:00:20.264158] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-30T19:00:20.270137] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:00:21.054399] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-30T19:00:21.654552] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T19:00:21.731692] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:00:21.854357] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-30T19:00:22.654375] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-30T19:00:23.061322] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T19:00:23.072452] [INFO ] [REMOTE ] GLOB: Full fetch complete (63952 records). [2025-09-30T19:00:23.072668] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-30T19:00:23.459601] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-30T19:00:23.545983] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-30T19:00:23.546067] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-30T19:00:23.546873] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-30T19:00:23.546938] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-30T19:00:23.548341] [DEBUG] [LOCAL ] GLOB: Trimmed 63952 records to 47516 (keeping 200 days of data) [2025-09-30T19:00:23.856713] [DEBUG] [LOCAL ] GLOB: Primary data saved (47516 records). [2025-09-30T19:00:23.856853] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-30T19:00:23.856939] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLOB took 32.9s. Estimated remaining: 3h 2m 52s. Rate: 7.8 symbols/min [2025-09-30T19:00:24.052040] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:24.109183] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-30T19:00:24.159345] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:00:24.181621] [INFO ] [REMOTE ] GL: Full fetch complete (55395 records). [2025-09-30T19:00:24.181863] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-30T19:00:24.257037] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-30T19:00:24.331030] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-30T19:00:24.342967] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-09-30T19:00:24.822816] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:24.838722] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-30T19:00:24.852337] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-30T19:00:24.863596] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-30T19:00:24.874786] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-30T19:00:24.988836] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-30T19:00:25.030821] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-30T19:00:25.035493] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-30T19:00:25.036105] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-30T19:00:25.140851] [DEBUG] [LOCAL ] GL: Trimmed 55395 records to 37779 (keeping 200 days of data) [2025-09-30T19:00:25.460394] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:25.462290] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-30T19:00:25.657610] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-30T19:00:25.688489] [DEBUG] [LOCAL ] GL: Primary data saved (37779 records). [2025-09-30T19:00:25.688754] [INFO ] [MAIN ] GL: Full history saved. [2025-09-30T19:00:25.688897] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GL took 46.5s. Estimated remaining: 3h 2m 36s. Rate: 7.8 symbols/min [2025-09-30T19:00:25.859601] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-30T19:00:25.880889] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:25.938173] [DEBUG] [LOCAL ] GMED: Loaded 48347 existing records from primary storage. [2025-09-30T19:00:25.938676] [INFO ] [MAIN ] GMED: Loaded 48347 existing records. [2025-09-30T19:00:26.137723] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:26.138008] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-30T19:00:26.138069] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-30T19:00:26.139281] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-30T19:00:26.139353] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-30T19:00:26.538863] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:26.574360] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T19:00:26.654362] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-30T19:00:27.454455] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-30T19:00:27.688218] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:00:28.026122] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:00:28.136535] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-30T19:00:28.254399] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-30T19:00:29.054407] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-30T19:00:29.246479] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:00:29.854363] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-30T19:00:30.615181] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:00:30.654353] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-30T19:00:30.754825] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-30T19:00:31.454428] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-30T19:00:32.093025] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-30T19:00:32.104854] [INFO ] [REMOTE ] GLW: Full fetch complete (77617 records). [2025-09-30T19:00:32.105018] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-30T19:00:32.263677] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-30T19:00:32.567968] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-30T19:00:32.568292] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-30T19:00:32.570063] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-30T19:00:32.570215] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-30T19:00:32.572812] [DEBUG] [LOCAL ] GLW: Trimmed 77617 records to 53635 (keeping 200 days of data) [2025-09-30T19:00:32.699940] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T19:00:32.868315] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:00:32.998761] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-30T19:00:32.998930] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-30T19:00:32.999729] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 35.8s. Estimated remaining: 3h 2m 28s. Rate: 7.8 symbols/min [2025-09-30T19:00:33.059545] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-30T19:00:33.192427] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:33.230516] [DEBUG] [LOCAL ] GMRE: Loaded 37551 existing records from primary storage. [2025-09-30T19:00:33.230830] [INFO ] [MAIN ] GMRE: Loaded 37551 existing records. [2025-09-30T19:00:33.417181] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:33.417475] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-30T19:00:33.417550] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-30T19:00:33.417955] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-30T19:00:33.418035] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-30T19:00:33.801719] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:33.854302] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-30T19:00:34.401297] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-30T19:00:34.654369] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-30T19:00:34.690447] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:00:34.807514] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T19:00:35.454358] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-30T19:00:36.254386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-30T19:00:36.425175] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:00:36.781621] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:00:37.054356] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-30T19:00:37.735087] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:00:37.854440] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-30T19:00:38.654420] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-30T19:00:39.052226] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T19:00:39.104610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:00:39.454357] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-30T19:00:39.924309] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:00:40.254408] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-30T19:00:40.922166] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:00:41.054404] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-30T19:00:41.854365] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-30T19:00:42.293081] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:00:42.654390] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-30T19:00:43.229991] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:00:43.311926] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:00:43.454370] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-30T19:00:43.534283] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:00:44.254391] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-30T19:00:45.054381] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-30T19:00:45.854364] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-30T19:00:45.944545] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:00:46.033132] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-30T19:00:46.147054] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:00:46.654388] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-30T19:00:47.454360] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-30T19:00:48.259525] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-30T19:00:48.281025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T19:00:48.294856] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-30T19:00:48.295022] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-30T19:00:48.739211] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-30T19:00:48.739308] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-30T19:00:48.740315] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-30T19:00:48.740388] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-30T19:00:48.742088] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-30T19:00:49.093571] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-30T19:00:49.093748] [INFO ] [MAIN ] GM: Full history saved. [2025-09-30T19:00:49.093853] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 33.0s. Estimated remaining: 3h 2m 33s. Rate: 7.8 symbols/min [2025-09-30T19:00:49.290725] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:49.327318] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-30T19:00:49.383205] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-30T19:00:49.386285] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:00:49.405031] [DEBUG] [LOCAL ] GNE: Loaded 17740 existing records from primary storage. [2025-09-30T19:00:49.405874] [INFO ] [REMOTE ] GMED: Full fetch complete (69539 records). [2025-09-30T19:00:49.406024] [INFO ] [MAIN ] GNE: Loaded 17740 existing records. [2025-09-30T19:00:49.406179] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-30T19:00:49.532862] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:00:49.793947] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:49.820742] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-30T19:00:49.832157] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-30T19:00:49.867821] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-30T19:00:49.873238] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-30T19:00:49.873158] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-30T19:00:50.274348] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-30T19:00:50.284265] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-30T19:00:50.293496] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-30T19:00:50.304260] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-30T19:00:50.422413] [DEBUG] [LOCAL ] GMED: Trimmed 69539 records to 48335 (keeping 200 days of data) [2025-09-30T19:00:50.599926] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:50.686214] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-30T19:00:50.815083] [DEBUG] [LOCAL ] GMED: Primary data saved (48335 records). [2025-09-30T19:00:50.815237] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-30T19:00:50.815330] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 25.1s. Estimated remaining: 3h 2m 16s. Rate: 7.8 symbols/min [2025-09-30T19:00:51.020057] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:51.061663] [DEBUG] [LOCAL ] GNK: Loaded 40282 existing records from primary storage. [2025-09-30T19:00:51.061996] [INFO ] [MAIN ] GNK: Loaded 40282 existing records. [2025-09-30T19:00:51.265084] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:51.265383] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-30T19:00:51.265440] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-30T19:00:51.265905] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-30T19:00:51.265968] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-30T19:00:51.623880] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T19:00:51.667369] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-30T19:00:51.717861] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:51.746504] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:00:51.971092] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-30T19:00:52.254401] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-30T19:00:52.295958] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T19:00:53.054367] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-30T19:00:53.854343] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-30T19:00:54.654356] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-30T19:00:54.716374] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:00:54.914785] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-30T19:00:55.277173] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:00:55.293639] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T19:00:55.454378] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-30T19:00:56.254386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-30T19:00:56.296230] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T19:00:57.054369] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-30T19:00:57.528514] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:00:57.854398] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-30T19:00:58.654435] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-30T19:00:58.978476] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T19:00:59.334299] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:00:59.440702] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:00:59.454384] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-30T19:01:00.254450] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-30T19:01:00.458690] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:01:01.054397] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-30T19:01:01.619406] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T19:01:01.854368] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-30T19:01:02.654350] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-30T19:01:02.891735] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T19:01:03.078838] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T19:01:03.086769] [INFO ] [REMOTE ] GMRE: Full fetch complete (53491 records). [2025-09-30T19:01:03.086912] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-30T19:01:03.459465] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-30T19:01:03.537795] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-30T19:01:03.537888] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-30T19:01:03.538834] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-30T19:01:03.538904] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-30T19:01:03.540297] [DEBUG] [LOCAL ] GMRE: Trimmed 53491 records to 37497 (keeping 200 days of data) [2025-09-30T19:01:03.780570] [DEBUG] [LOCAL ] GMRE: Primary data saved (37497 records). [2025-09-30T19:01:03.781170] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-30T19:01:03.781776] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMRE took 30.8s. Estimated remaining: 3h 2m 16s. Rate: 7.8 symbols/min [2025-09-30T19:01:03.965979] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:04.010308] [DEBUG] [LOCAL ] GNL: Loaded 46945 existing records from primary storage. [2025-09-30T19:01:04.010618] [INFO ] [MAIN ] GNL: Loaded 46945 existing records. [2025-09-30T19:01:04.209035] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:04.209406] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-30T19:01:04.209481] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-30T19:01:04.209912] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-30T19:01:04.209975] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-30T19:01:04.254860] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-30T19:01:04.553018] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:01:04.680202] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:05.054409] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-30T19:01:05.638905] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:01:05.854343] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-30T19:01:06.273508] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-30T19:01:06.291884] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-30T19:01:06.292092] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-30T19:01:06.657491] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-30T19:01:06.680754] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:01:06.807535] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-30T19:01:06.807678] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-30T19:01:06.808907] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-30T19:01:06.808980] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-30T19:01:06.810950] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53762 (keeping 200 days of data) [2025-09-30T19:01:07.047106] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:01:07.173518] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-09-30T19:01:07.173696] [INFO ] [MAIN ] GME: Full history saved. [2025-09-30T19:01:07.173796] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 43.3s. Estimated remaining: 3h 2m 2s. Rate: 7.8 symbols/min [2025-09-30T19:01:07.365798] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:07.412055] [DEBUG] [LOCAL ] GNRC: Loaded 45182 existing records from primary storage. [2025-09-30T19:01:07.412413] [INFO ] [MAIN ] GNRC: Loaded 45182 existing records. [2025-09-30T19:01:07.459742] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-30T19:01:07.633031] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:07.633260] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-30T19:01:07.633312] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-30T19:01:07.633578] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-30T19:01:07.633678] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-30T19:01:08.096765] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:08.254377] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-30T19:01:08.328261] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:01:08.650089] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:01:08.654932] [INFO ] [REMOTE ] GNE: Full fetch complete (22379 records). [2025-09-30T19:01:08.655289] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-30T19:01:09.058819] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-30T19:01:09.096013] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-30T19:01:09.096099] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-30T19:01:09.096685] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-30T19:01:09.096752] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-30T19:01:09.097451] [DEBUG] [LOCAL ] GNE: Trimmed 22379 records to 17787 (keeping 200 days of data) [2025-09-30T19:01:09.215859] [DEBUG] [LOCAL ] GNE: Primary data saved (17787 records). [2025-09-30T19:01:09.216023] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-30T19:01:09.216162] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 20.1s. Estimated remaining: 3h 1m 46s. Rate: 7.8 symbols/min [2025-09-30T19:01:09.411109] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:09.438931] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T19:01:09.455704] [DEBUG] [LOCAL ] GNT: Loaded 8083 existing records from primary storage. [2025-09-30T19:01:09.455965] [INFO ] [MAIN ] GNT: Loaded 8083 existing records. [2025-09-30T19:01:09.652509] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:09.652820] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-30T19:01:09.652882] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-30T19:01:09.653125] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-30T19:01:09.653187] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-30T19:01:09.864959] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-30T19:01:10.037510] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:10.654319] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-30T19:01:10.772347] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T19:01:11.335961] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T19:01:11.428354] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:01:11.454369] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-30T19:01:12.090439] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:01:12.254397] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-30T19:01:12.675797] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T19:01:13.054391] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-30T19:01:13.854354] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-30T19:01:14.573234] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:01:14.654368] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-30T19:01:15.089015] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:01:15.454373] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-30T19:01:16.072089] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T19:01:16.143271] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:01:16.254371] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-30T19:01:17.020229] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T19:01:17.054387] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-30T19:01:17.854395] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-30T19:01:18.593166] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:01:18.654379] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-30T19:01:19.282091] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:01:19.454365] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-30T19:01:20.254374] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-30T19:01:20.294232] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T19:01:20.325053] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:01:21.054396] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-30T19:01:21.603423] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:01:21.854413] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-30T19:01:21.891958] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:01:22.654372] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-30T19:01:23.304767] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:01:23.454381] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-30T19:01:24.210851] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:01:24.245274] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:01:24.254495] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-30T19:01:24.900007] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:01:25.054364] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-30T19:01:25.854351] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-30T19:01:26.659332] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-30T19:01:26.664876] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:01:27.234485] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:01:27.454367] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-30T19:01:28.203810] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T19:01:28.254355] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-30T19:01:29.054354] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-30T19:01:29.091497] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:01:29.788794] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:01:29.797436] [INFO ] [REMOTE ] GNK: Full fetch complete (57057 records). [2025-09-30T19:01:29.797617] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-30T19:01:29.862074] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-30T19:01:30.021417] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:01:30.095542] [INFO ] [REMOTE ] GNT: Full fetch complete (10740 records). [2025-09-30T19:01:30.132248] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-30T19:01:30.426568] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-30T19:01:30.457201] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-30T19:01:30.480615] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-30T19:01:30.507622] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-30T19:01:30.640386] [DEBUG] [LOCAL ] GNK: Trimmed 57057 records to 40237 (keeping 200 days of data) [2025-09-30T19:01:30.754782] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-30T19:01:31.021808] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-30T19:01:31.022947] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-30T19:01:31.023489] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-30T19:01:31.023592] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-30T19:01:31.027249] [DEBUG] [LOCAL ] GNT: Trimmed 10740 records to 8082 (keeping 200 days of data) [2025-09-30T19:01:31.197396] [DEBUG] [LOCAL ] GNT: Primary data saved (8082 records). [2025-09-30T19:01:31.208069] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-30T19:01:31.243333] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNT took 22.0s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min [2025-09-30T19:01:31.523404] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:31.561104] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:01:31.579214] [DEBUG] [LOCAL ] GNTY: Loaded 7288 existing records from primary storage. [2025-09-30T19:01:31.580020] [INFO ] [MAIN ] GNTY: Loaded 7288 existing records. [2025-09-30T19:01:31.580376] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-30T19:01:31.779931] [DEBUG] [LOCAL ] GNK: Primary data saved (40237 records). [2025-09-30T19:01:31.813421] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-30T19:01:31.822296] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 41.0s. Estimated remaining: 3h 1m 42s. Rate: 7.8 symbols/min [2025-09-30T19:01:31.846119] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:31.890138] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-30T19:01:31.936903] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-30T19:01:31.968254] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-30T19:01:31.980624] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-30T19:01:32.141995] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:32.530239] [DEBUG] [LOCAL ] GNW: Loaded 51334 existing records from primary storage. [2025-09-30T19:01:32.559721] [INFO ] [MAIN ] GNW: Loaded 51334 existing records. [2025-09-30T19:01:32.566528] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:32.579516] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-30T19:01:32.593369] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:01:32.791177] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:32.791443] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-30T19:01:32.791496] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-30T19:01:32.791897] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-30T19:01:32.791961] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-30T19:01:33.059439] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-30T19:01:33.234967] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:33.267695] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:01:33.381759] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T19:01:33.854359] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-30T19:01:34.657976] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-30T19:01:34.666229] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T19:01:35.454353] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-30T19:01:35.526546] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T19:01:35.563228] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:01:36.254397] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-30T19:01:37.054402] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-30T19:01:37.100360] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:01:37.109618] [INFO ] [REMOTE ] GNL: Full fetch complete (68295 records). [2025-09-30T19:01:37.109810] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-30T19:01:37.533178] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-30T19:01:37.533280] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-30T19:01:37.534350] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-30T19:01:37.534420] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-30T19:01:37.536087] [DEBUG] [LOCAL ] GNL: Trimmed 68295 records to 46875 (keeping 200 days of data) [2025-09-30T19:01:37.793773] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:01:37.860686] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-30T19:01:37.876437] [DEBUG] [LOCAL ] GNL: Primary data saved (46875 records). [2025-09-30T19:01:37.876600] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-30T19:01:37.877833] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNL took 34.1s. Estimated remaining: 3h 1m 32s. Rate: 7.8 symbols/min [2025-09-30T19:01:38.061437] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:38.125634] [DEBUG] [LOCAL ] GOF: Loaded 42678 existing records from primary storage. [2025-09-30T19:01:38.126071] [INFO ] [MAIN ] GOF: Loaded 42678 existing records. [2025-09-30T19:01:38.321091] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:38.321346] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-30T19:01:38.321397] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-30T19:01:38.321759] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-30T19:01:38.321841] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-30T19:01:38.657194] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-30T19:01:38.741691] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:38.857377] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:01:38.868181] [INFO ] [REMOTE ] GNRC: Full fetch complete (65313 records). [2025-09-30T19:01:38.868386] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-30T19:01:39.325295] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-30T19:01:39.325468] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-30T19:01:39.326582] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-30T19:01:39.326894] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-30T19:01:39.329098] [DEBUG] [LOCAL ] GNRC: Trimmed 65313 records to 45193 (keeping 200 days of data) [2025-09-30T19:01:39.449339] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:01:39.451038] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:01:39.466318] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-30T19:01:39.671533] [DEBUG] [LOCAL ] GNRC: Primary data saved (45193 records). [2025-09-30T19:01:39.671742] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-30T19:01:39.671901] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 32.5s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:01:39.853209] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:39.887638] [DEBUG] [LOCAL ] GOLF: Loaded 31352 existing records from primary storage. [2025-09-30T19:01:39.887935] [INFO ] [MAIN ] GOLF: Loaded 31352 existing records. [2025-09-30T19:01:40.081421] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:40.081742] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-30T19:01:40.081804] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-30T19:01:40.082870] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-30T19:01:40.082933] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-30T19:01:40.257114] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-30T19:01:40.477096] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:41.002448] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T19:01:41.054393] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-30T19:01:41.126161] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:01:41.750435] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T19:01:41.854401] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-30T19:01:42.654418] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-30T19:01:43.282903] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:01:43.454347] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-30T19:01:43.774275] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T19:01:44.051560] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:01:44.254348] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-30T19:01:44.864419] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T19:01:45.054415] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-30T19:01:45.854376] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-30T19:01:46.596925] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:01:46.654344] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-30T19:01:47.311883] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:01:47.454359] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-30T19:01:48.124381] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:01:48.254370] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-30T19:01:48.947158] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:01:49.054404] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-30T19:01:49.505457] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T19:01:49.847305] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:01:49.854300] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-30T19:01:50.634783] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:01:50.654371] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-30T19:01:51.454422] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-30T19:01:52.098946] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:01:52.101798] [INFO ] [REMOTE ] GNTY: Full fetch complete (10417 records). [2025-09-30T19:01:52.101884] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-30T19:01:52.241564] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:01:52.258705] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-30T19:01:52.537339] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-30T19:01:52.537419] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-30T19:01:52.537705] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-30T19:01:52.537767] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-30T19:01:52.538745] [DEBUG] [LOCAL ] GNTY: Trimmed 10417 records to 7330 (keeping 200 days of data) [2025-09-30T19:01:52.585065] [DEBUG] [LOCAL ] GNTY: Primary data saved (7330 records). [2025-09-30T19:01:52.585244] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-30T19:01:52.585342] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNTY took 21.3s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:01:52.773237] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:52.828428] [DEBUG] [LOCAL ] GOOS: Loaded 45160 existing records from primary storage. [2025-09-30T19:01:52.828819] [INFO ] [MAIN ] GOOS: Loaded 45160 existing records. [2025-09-30T19:01:53.031381] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:53.031759] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-30T19:01:53.031857] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-30T19:01:53.032211] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-30T19:01:53.032300] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-30T19:01:53.065450] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-30T19:01:53.425443] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:53.736956] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T19:01:53.854404] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-30T19:01:54.654346] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-30T19:01:54.792511] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:01:54.967443] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:01:55.454409] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-30T19:01:56.254360] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-30T19:01:56.350027] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:01:56.415725] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T19:01:57.054353] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-30T19:01:57.598623] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:01:57.854369] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-30T19:01:58.305863] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T19:01:58.654398] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-30T19:01:59.192225] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:01:59.454371] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-30T19:02:00.135775] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:02:00.254439] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-30T19:02:01.054333] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-30T19:02:01.151727] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:02:01.854397] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-30T19:02:02.191321] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T19:02:02.654350] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-30T19:02:02.838998] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:02:03.144812] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:02:03.454371] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-30T19:02:04.254401] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-30T19:02:04.463467] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:02:04.473197] [INFO ] [REMOTE ] GOF: Full fetch complete (62170 records). [2025-09-30T19:02:04.473464] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-30T19:02:04.917123] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-30T19:02:04.917387] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-30T19:02:04.918427] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-30T19:02:04.918617] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-30T19:02:04.952607] [DEBUG] [LOCAL ] GOF: Trimmed 62170 records to 42604 (keeping 200 days of data) [2025-09-30T19:02:04.952463] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:02:05.063809] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-30T19:02:05.263477] [DEBUG] [LOCAL ] GOF: Primary data saved (42604 records). [2025-09-30T19:02:05.263622] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-30T19:02:05.264382] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 27.4s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:02:05.454150] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:05.501571] [DEBUG] [LOCAL ] GOTU: Loaded 38697 existing records from primary storage. [2025-09-30T19:02:05.501961] [INFO ] [MAIN ] GOTU: Loaded 38697 existing records. [2025-09-30T19:02:05.725268] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:05.725724] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-30T19:02:05.725795] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-30T19:02:05.726106] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-30T19:02:05.726167] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-30T19:02:05.871700] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-30T19:02:06.207932] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:06.210994] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T19:02:06.372186] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:02:06.654361] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-30T19:02:06.961666] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:02:07.454374] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-30T19:02:08.254372] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-30T19:02:08.401839] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T19:02:08.413569] [INFO ] [REMOTE ] GNW: Full fetch complete (73510 records). [2025-09-30T19:02:08.413960] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-30T19:02:08.860437] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-30T19:02:08.860638] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-30T19:02:08.862145] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-30T19:02:08.862300] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-30T19:02:08.865940] [DEBUG] [LOCAL ] GNW: Trimmed 73510 records to 51327 (keeping 200 days of data) [2025-09-30T19:02:09.078886] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-30T19:02:09.119771] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:02:09.235919] [DEBUG] [LOCAL ] GNW: Primary data saved (51327 records). [2025-09-30T19:02:09.236076] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-30T19:02:09.236204] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 37.4s. Estimated remaining: 3h 1m 2s. Rate: 7.8 symbols/min [2025-09-30T19:02:09.439333] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:09.487107] [DEBUG] [LOCAL ] GPC: Loaded 46447 existing records from primary storage. [2025-09-30T19:02:09.487460] [INFO ] [MAIN ] GPC: Loaded 46447 existing records. [2025-09-30T19:02:09.684484] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:09.684983] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-30T19:02:09.685078] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-30T19:02:09.685343] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-30T19:02:09.685413] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-30T19:02:09.862865] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-30T19:02:10.107417] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:02:10.163954] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:10.365429] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:02:10.654377] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-30T19:02:11.430042] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:02:11.454322] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-30T19:02:12.002213] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:02:12.254443] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-30T19:02:13.054382] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-30T19:02:13.112917] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:02:13.854396] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-30T19:02:13.953320] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:02:14.239405] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:02:14.654401] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-30T19:02:14.769287] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:02:15.454391] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-30T19:02:16.254400] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-30T19:02:16.333939] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T19:02:16.728761] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:02:17.054389] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-30T19:02:17.854384] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-30T19:02:18.149556] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T19:02:18.227701] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:02:18.237085] [INFO ] [REMOTE ] GOOS: Full fetch complete (65596 records). [2025-09-30T19:02:18.237316] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-30T19:02:18.658079] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-30T19:02:18.761140] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-30T19:02:18.761237] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-30T19:02:18.762379] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-30T19:02:18.762481] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-30T19:02:18.764470] [DEBUG] [LOCAL ] GOOS: Trimmed 65596 records to 45062 (keeping 200 days of data) [2025-09-30T19:02:19.059186] [DEBUG] [LOCAL ] GOOS: Primary data saved (45062 records). [2025-09-30T19:02:19.059363] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-30T19:02:19.059681] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 26.5s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-09-30T19:02:19.265766] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:19.301196] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:02:19.327162] [DEBUG] [LOCAL ] GPI: Loaded 14808 existing records from primary storage. [2025-09-30T19:02:19.327441] [INFO ] [MAIN ] GPI: Loaded 14808 existing records. [2025-09-30T19:02:19.459491] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-30T19:02:19.533815] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:19.534062] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-30T19:02:19.534111] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-30T19:02:19.534448] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-30T19:02:19.534507] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-30T19:02:19.975297] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:20.029844] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T19:02:20.254413] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-30T19:02:20.776101] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:02:21.054391] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-30T19:02:21.841015] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T19:02:21.854305] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-30T19:02:21.902892] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:02:22.589934] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:02:22.655921] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-30T19:02:23.454400] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-30T19:02:23.971905] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:02:24.254382] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-30T19:02:25.054365] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-30T19:02:25.206575] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:02:25.555364] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T19:02:25.561917] [INFO ] [REMOTE ] GOLF: Full fetch complete (45027 records). [2025-09-30T19:02:25.562051] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-30T19:02:25.859512] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-30T19:02:26.000875] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-30T19:02:26.001080] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-30T19:02:26.001950] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-30T19:02:26.002057] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-30T19:02:26.004591] [DEBUG] [LOCAL ] GOLF: Trimmed 45027 records to 31236 (keeping 200 days of data) [2025-09-30T19:02:26.151389] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T19:02:26.281537] [DEBUG] [LOCAL ] GOLF: Primary data saved (31236 records). [2025-09-30T19:02:26.281732] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-30T19:02:26.281844] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 46.6s. Estimated remaining: 3h 0m 49s. Rate: 7.8 symbols/min [2025-09-30T19:02:26.654448] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-30T19:02:27.454377] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-30T19:02:27.522006] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T19:02:27.894340] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:02:28.254358] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-30T19:02:28.597132] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:02:29.054358] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-30T19:02:29.854369] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-30T19:02:29.997692] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:02:30.044431] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:02:30.654382] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-30T19:02:31.196808] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:02:31.454366] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-30T19:02:32.254331] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-30T19:02:32.316231] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:02:32.474051] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T19:02:33.054395] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-30T19:02:33.370803] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:02:33.745240] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:02:33.854368] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-30T19:02:34.654378] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-30T19:02:35.454358] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-30T19:02:35.534002] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T19:02:35.545876] [INFO ] [REMOTE ] GPC: Full fetch complete (69000 records). [2025-09-30T19:02:35.546088] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-30T19:02:35.706223] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T19:02:36.048200] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-30T19:02:36.048296] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-30T19:02:36.049267] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-30T19:02:36.049335] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-30T19:02:36.050815] [DEBUG] [LOCAL ] GPC: Trimmed 69000 records to 46398 (keeping 200 days of data) [2025-09-30T19:02:36.259903] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-30T19:02:36.378450] [DEBUG] [LOCAL ] GPC: Primary data saved (46398 records). [2025-09-30T19:02:36.378617] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-30T19:02:36.378768] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPC took 27.1s. Estimated remaining: 3h 0m 45s. Rate: 7.8 symbols/min [2025-09-30T19:02:36.645402] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:02:37.054414] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-30T19:02:37.867922] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T19:02:37.872592] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-30T19:02:38.556730] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:02:38.565846] [INFO ] [REMOTE ] GOTU: Full fetch complete (59372 records). [2025-09-30T19:02:38.566023] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-30T19:02:38.945632] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T19:02:38.976341] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-30T19:02:39.059286] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-30T19:02:39.059395] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-30T19:02:39.060330] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-30T19:02:39.060398] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-30T19:02:39.062136] [DEBUG] [LOCAL ] GOTU: Trimmed 59372 records to 38557 (keeping 200 days of data) [2025-09-30T19:02:39.316853] [DEBUG] [LOCAL ] GOTU: Primary data saved (38557 records). [2025-09-30T19:02:39.317005] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-30T19:02:39.317789] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 34.1s. Estimated remaining: 3h 0m 30s. Rate: 7.8 symbols/min [2025-09-30T19:02:40.106257] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T19:02:40.110571] [INFO ] [REMOTE ] GPI: Full fetch complete (21014 records). [2025-09-30T19:02:40.110702] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-30T19:02:40.508998] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-30T19:02:40.509118] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-30T19:02:40.509578] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-30T19:02:40.509636] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-30T19:02:40.510830] [DEBUG] [LOCAL ] GPI: Trimmed 21014 records to 14682 (keeping 200 days of data) [2025-09-30T19:02:40.615784] [DEBUG] [LOCAL ] GPI: Primary data saved (14682 records). [2025-09-30T19:02:40.615946] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-30T19:02:40.616089] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPI took 21.6s. Estimated remaining: 3h 0m 13s. Rate: 7.8 symbols/min [2025-09-30T19:02:41.271212] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.371029] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.413628] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.418335] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.428510] [DEBUG] [LOCAL ] GPJA: Loaded 4097 existing records from primary storage. [2025-09-30T19:02:41.428952] [INFO ] [MAIN ] GPJA: Loaded 4097 existing records. [2025-09-30T19:02:41.718380] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:41.719772] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-09-30T19:02:41.720895] [DEBUG] [LOCAL ] GPMT: Loaded 26288 existing records from primary storage. [2025-09-30T19:02:41.719954] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-30T19:02:41.721485] [INFO ] [MAIN ] GPMT: Loaded 26288 existing records. [2025-09-30T19:02:41.733730] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-30T19:02:41.721355] [INFO ] [MAIN ] GPN: Loaded 52049 existing records. [2025-09-30T19:02:41.755941] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-30T19:02:41.813257] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-30T19:02:41.906245] [DEBUG] [LOCAL ] GPK: Loaded 52653 existing records from primary storage. [2025-09-30T19:02:41.986246] [INFO ] [MAIN ] GPK: Loaded 52653 existing records. [2025-09-30T19:02:42.340907] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.437762] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.513344] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.566755] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-30T19:02:42.561497] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.626603] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-30T19:02:42.654308] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-30T19:02:42.654119] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-30T19:02:42.773192] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-30T19:02:42.795618] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.811391] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-30T19:02:42.889491] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.906115] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-30T19:02:42.985853] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-30T19:02:43.067843] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-30T19:02:43.071380] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.128147] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-30T19:02:43.757141] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.800105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-30T19:02:43.957205] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.988054] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-30T19:02:44.019224] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T19:02:44.026188] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-30T19:02:44.120934] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:44.121335] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-30T19:02:44.866968] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:02:44.870781] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-30T19:02:45.267677] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T19:02:45.269375] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-30T19:02:45.290000] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:02:45.296388] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-30T19:02:45.456313] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:02:45.543433] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:02:45.605872] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T19:02:45.854404] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-30T19:02:46.407616] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:02:46.654408] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-30T19:02:47.454369] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-30T19:02:47.507794] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:02:47.891104] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:02:48.010376] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:02:48.254371] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-30T19:02:49.054363] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-30T19:02:49.387855] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:02:49.429038] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T19:02:49.854358] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-30T19:02:50.654403] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-30T19:02:50.947099] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:02:51.074233] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:02:51.454402] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-30T19:02:52.254377] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-30T19:02:52.911562] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T19:02:52.991397] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:02:53.054410] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-30T19:02:53.854401] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-30T19:02:54.392271] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:02:54.654378] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-30T19:02:55.393528] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:02:55.454385] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-30T19:02:56.254366] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-30T19:02:56.293986] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T19:02:56.844454] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:02:57.054369] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-30T19:02:57.613422] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:02:57.854366] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-30T19:02:58.664411] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-30T19:02:58.686003] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:02:59.409600] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:02:59.448492] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:02:59.454300] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-30T19:03:00.254371] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-30T19:03:00.427564] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:03:00.843173] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T19:03:01.054400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-30T19:03:01.854426] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-30T19:03:02.654344] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-30T19:03:02.776195] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:03:03.454351] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-30T19:03:03.625392] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:03:03.689273] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:03:03.693322] [INFO ] [REMOTE ] GPMT: Full fetch complete (37452 records). [2025-09-30T19:03:03.693425] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-30T19:03:04.112916] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-30T19:03:04.113041] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-30T19:03:04.113753] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-30T19:03:04.113820] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-30T19:03:04.115081] [DEBUG] [LOCAL ] GPMT: Trimmed 37452 records to 26222 (keeping 200 days of data) [2025-09-30T19:03:04.264753] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-30T19:03:04.296605] [DEBUG] [LOCAL ] GPMT: Primary data saved (26222 records). [2025-09-30T19:03:04.296783] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-30T19:03:04.296881] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPMT took 23.7s. Estimated remaining: 3h 0m 29s. Rate: 7.8 symbols/min [2025-09-30T19:03:04.495555] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:04.529019] [DEBUG] [LOCAL ] GPOR: Loaded 22983 existing records from primary storage. [2025-09-30T19:03:04.529449] [INFO ] [MAIN ] GPOR: Loaded 22983 existing records. [2025-09-30T19:03:04.752863] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:04.753127] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-30T19:03:04.753266] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-30T19:03:04.753514] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-30T19:03:04.753591] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-30T19:03:05.067195] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-30T19:03:05.072995] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:03:05.121052] [INFO ] [REMOTE ] GPJA: Full fetch complete (7365 records). [2025-09-30T19:03:05.132844] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-30T19:03:05.271111] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:05.632137] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-30T19:03:05.632279] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-30T19:03:05.632510] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-30T19:03:05.632555] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-30T19:03:05.633020] [DEBUG] [LOCAL ] GPJA: Trimmed 7365 records to 4219 (keeping 200 days of data) [2025-09-30T19:03:05.661553] [DEBUG] [LOCAL ] GPJA: Primary data saved (4219 records). [2025-09-30T19:03:05.661729] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-30T19:03:05.661833] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPJA took 25.0s. Estimated remaining: 3h 0m 12s. Rate: 7.8 symbols/min [2025-09-30T19:03:05.858827] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:05.858951] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-30T19:03:05.899772] [DEBUG] [LOCAL ] GPRK: Loaded 39240 existing records from primary storage. [2025-09-30T19:03:05.900082] [INFO ] [MAIN ] GPRK: Loaded 39240 existing records. [2025-09-30T19:03:06.097490] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:06.097749] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-30T19:03:06.097808] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-30T19:03:06.098033] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-30T19:03:06.098092] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-30T19:03:06.506214] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:06.654386] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-30T19:03:06.813748] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:03:06.876935] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T19:03:07.454415] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-30T19:03:07.713030] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-30T19:03:07.989590] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:03:08.254370] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-30T19:03:08.926891] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:03:09.054376] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-30T19:03:09.854355] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-30T19:03:10.014405] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:03:10.320997] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:03:10.654363] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-30T19:03:11.134571] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T19:03:11.454530] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-30T19:03:11.739858] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T19:03:12.254400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-30T19:03:13.054319] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-30T19:03:13.262759] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:03:13.274814] [INFO ] [REMOTE ] GPK: Full fetch complete (75499 records). [2025-09-30T19:03:13.274999] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-30T19:03:13.787787] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-30T19:03:13.788030] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-30T19:03:13.789166] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-30T19:03:13.789450] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-30T19:03:13.791560] [DEBUG] [LOCAL ] GPK: Trimmed 75499 records to 52664 (keeping 200 days of data) [2025-09-30T19:03:13.868619] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-30T19:03:13.943588] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:03:14.220624] [DEBUG] [LOCAL ] GPK: Primary data saved (52664 records). [2025-09-30T19:03:14.220818] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-30T19:03:14.220913] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 33.6s. Estimated remaining: 3h 0m 6s. Rate: 7.8 symbols/min [2025-09-30T19:03:14.434097] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:14.467637] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T19:03:14.498804] [DEBUG] [LOCAL ] GRBK: Loaded 26896 existing records from primary storage. [2025-09-30T19:03:14.499130] [INFO ] [MAIN ] GRBK: Loaded 26896 existing records. [2025-09-30T19:03:14.656209] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-30T19:03:14.699170] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:14.699447] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-30T19:03:14.699508] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-30T19:03:14.699773] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-30T19:03:14.699836] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-30T19:03:15.099986] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:15.118074] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T19:03:15.454457] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-30T19:03:16.254393] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-30T19:03:16.325321] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T19:03:17.054411] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-30T19:03:17.122126] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:03:17.493376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:03:17.854365] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-30T19:03:18.654423] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-30T19:03:19.222726] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T19:03:19.235087] [INFO ] [REMOTE ] GPN: Full fetch complete (74854 records). [2025-09-30T19:03:19.235258] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-30T19:03:19.457040] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-30T19:03:19.657753] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:03:19.805555] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:03:19.810118] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-30T19:03:19.810237] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-30T19:03:19.811406] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-30T19:03:19.816481] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-30T19:03:19.819306] [DEBUG] [LOCAL ] GPN: Trimmed 74854 records to 52050 (keeping 200 days of data) [2025-09-30T19:03:20.206593] [DEBUG] [LOCAL ] GPN: Primary data saved (52050 records). [2025-09-30T19:03:20.206817] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-30T19:03:20.210539] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 39.6s. Estimated remaining: 2h 59m 56s. Rate: 7.8 symbols/min [2025-09-30T19:03:20.259492] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-30T19:03:20.419154] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:20.431138] [DEBUG] [LOCAL ] GRC: Loaded 8910 existing records from primary storage. [2025-09-30T19:03:20.431359] [INFO ] [MAIN ] GRC: Loaded 8910 existing records. [2025-09-30T19:03:20.640146] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:20.640430] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-30T19:03:20.640492] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-30T19:03:20.640821] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-30T19:03:20.640882] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-30T19:03:20.993072] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:03:21.057053] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-30T19:03:21.089060] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:21.374930] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T19:03:21.854401] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-30T19:03:22.234098] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:03:22.654402] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-30T19:03:22.853203] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T19:03:23.454356] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-30T19:03:24.130465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T19:03:24.254365] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-30T19:03:24.713364] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T19:03:25.054352] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-30T19:03:25.691847] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T19:03:25.854345] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-30T19:03:26.110804] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T19:03:26.623085] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T19:03:26.654353] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-30T19:03:27.454326] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-30T19:03:27.920496] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:03:28.254395] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-30T19:03:28.531455] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:03:29.054369] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-30T19:03:29.401506] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:03:29.854366] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-30T19:03:30.211131] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:03:30.654367] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-30T19:03:31.196874] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T19:03:31.203352] [INFO ] [REMOTE ] GPOR: Full fetch complete (34945 records). [2025-09-30T19:03:31.203457] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-30T19:03:31.459560] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-30T19:03:31.533979] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T19:03:31.647797] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-30T19:03:31.647919] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-30T19:03:31.648982] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-30T19:03:31.649074] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-30T19:03:31.650569] [DEBUG] [LOCAL ] GPOR: Trimmed 34945 records to 23091 (keeping 200 days of data) [2025-09-30T19:03:31.806775] [DEBUG] [LOCAL ] GPOR: Primary data saved (23091 records). [2025-09-30T19:03:31.806971] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-30T19:03:31.807130] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 27.5s. Estimated remaining: 2h 59m 54s. Rate: 7.8 symbols/min [2025-09-30T19:03:31.997691] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:32.019028] [DEBUG] [LOCAL ] GRDN: Loaded 20177 existing records from primary storage. [2025-09-30T19:03:32.019290] [INFO ] [MAIN ] GRDN: Loaded 20177 existing records. [2025-09-30T19:03:32.220760] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:32.221053] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-30T19:03:32.221141] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-30T19:03:32.221452] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-30T19:03:32.221531] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-30T19:03:32.259461] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-30T19:03:32.659836] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:32.906826] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:03:33.054365] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-30T19:03:33.412233] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:03:33.854373] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-30T19:03:34.128464] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:03:34.623238] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T19:03:34.654363] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-30T19:03:35.444311] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:03:35.454315] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-30T19:03:36.188982] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:03:36.254422] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-30T19:03:36.801604] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T19:03:37.054416] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-30T19:03:37.854372] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-30T19:03:38.309121] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:03:38.380889] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T19:03:38.654353] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-30T19:03:39.454326] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-30T19:03:39.784804] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:03:40.254381] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-30T19:03:40.909774] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:03:41.054333] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-30T19:03:41.126198] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T19:03:41.854410] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-30T19:03:42.130258] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:03:42.139083] [INFO ] [REMOTE ] GRBK: Full fetch complete (40550 records). [2025-09-30T19:03:42.139282] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-30T19:03:42.603991] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-30T19:03:42.604173] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-30T19:03:42.604924] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-30T19:03:42.604990] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-30T19:03:42.605949] [DEBUG] [LOCAL ] GRBK: Trimmed 40550 records to 26887 (keeping 200 days of data) [2025-09-30T19:03:42.655446] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-30T19:03:42.786325] [DEBUG] [LOCAL ] GRBK: Primary data saved (26887 records). [2025-09-30T19:03:42.786480] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-30T19:03:42.786605] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRBK took 28.6s. Estimated remaining: 2h 59m 51s. Rate: 7.8 symbols/min [2025-09-30T19:03:42.970973] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:43.017279] [DEBUG] [LOCAL ] GRMN: Loaded 41096 existing records from primary storage. [2025-09-30T19:03:43.017665] [INFO ] [MAIN ] GRMN: Loaded 41096 existing records. [2025-09-30T19:03:43.228777] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:43.229294] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-30T19:03:43.229355] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-30T19:03:43.230882] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-30T19:03:43.230949] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-30T19:03:43.458206] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-30T19:03:43.489061] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:03:43.563454] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:03:43.574467] [INFO ] [REMOTE ] GPRK: Full fetch complete (57306 records). [2025-09-30T19:03:43.579946] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-30T19:03:43.842733] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:44.114481] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-30T19:03:44.114580] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-30T19:03:44.116001] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-30T19:03:44.116096] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-30T19:03:44.117884] [DEBUG] [LOCAL ] GPRK: Trimmed 57306 records to 39299 (keeping 200 days of data) [2025-09-30T19:03:44.286231] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-30T19:03:44.359371] [DEBUG] [LOCAL ] GPRK: Primary data saved (39299 records). [2025-09-30T19:03:44.359524] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-30T19:03:44.359609] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GPRK took 38.7s. Estimated remaining: 2h 59m 34s. Rate: 7.8 symbols/min [2025-09-30T19:03:44.550679] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:44.565858] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:03:44.611817] [DEBUG] [LOCAL ] GRND: Loaded 49962 existing records from primary storage. [2025-09-30T19:03:44.612131] [INFO ] [MAIN ] GRND: Loaded 49962 existing records. [2025-09-30T19:03:44.800846] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:44.801123] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-30T19:03:44.801172] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-30T19:03:44.801548] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-30T19:03:44.801608] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-30T19:03:45.059562] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-30T19:03:45.209684] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:45.859469] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-30T19:03:45.872719] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:03:46.133307] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:03:46.625418] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:03:46.654320] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-30T19:03:47.435490] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T19:03:47.454364] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-30T19:03:48.036429] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T19:03:48.254376] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-30T19:03:49.015925] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:03:49.054363] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-30T19:03:49.854351] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-30T19:03:50.003619] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:03:50.006492] [INFO ] [REMOTE ] GRC: Full fetch complete (13068 records). [2025-09-30T19:03:50.006607] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-30T19:03:50.398461] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-30T19:03:50.398541] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-30T19:03:50.398897] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-30T19:03:50.398960] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-30T19:03:50.399447] [DEBUG] [LOCAL ] GRC: Trimmed 13068 records to 8931 (keeping 200 days of data) [2025-09-30T19:03:50.457579] [DEBUG] [LOCAL ] GRC: Primary data saved (8931 records). [2025-09-30T19:03:50.457755] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-30T19:03:50.457854] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 30.2s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-09-30T19:03:50.649087] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:50.654334] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-30T19:03:50.696034] [DEBUG] [LOCAL ] GRNT: Loaded 33708 existing records from primary storage. [2025-09-30T19:03:50.696348] [INFO ] [MAIN ] GRNT: Loaded 33708 existing records. [2025-09-30T19:03:50.890066] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:50.890275] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-30T19:03:50.890325] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-30T19:03:50.890632] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-30T19:03:50.890723] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-30T19:03:51.290972] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:51.304313] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T19:03:51.392200] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:03:51.454365] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-30T19:03:52.254600] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-30T19:03:53.051489] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T19:03:53.062193] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-30T19:03:53.107624] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T19:03:53.854382] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-30T19:03:54.403720] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:03:54.654375] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-30T19:03:55.183907] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T19:03:55.190559] [INFO ] [REMOTE ] GRDN: Full fetch complete (26193 records). [2025-09-30T19:03:55.190738] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-30T19:03:55.466415] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-30T19:03:55.603097] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-30T19:03:55.603202] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-30T19:03:55.603970] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-30T19:03:55.604057] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-30T19:03:55.604980] [DEBUG] [LOCAL ] GRDN: Trimmed 26193 records to 20313 (keeping 200 days of data) [2025-09-30T19:03:55.744746] [DEBUG] [LOCAL ] GRDN: Primary data saved (20313 records). [2025-09-30T19:03:55.744964] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-30T19:03:55.745390] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 23.9s. Estimated remaining: 2h 59m 13s. Rate: 7.8 symbols/min [2025-09-30T19:03:55.934889] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:55.971888] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:03:55.985884] [DEBUG] [LOCAL ] GROV: Loaded 9008 existing records from primary storage. [2025-09-30T19:03:55.986725] [INFO ] [MAIN ] GROV: Loaded 9008 existing records. [2025-09-30T19:03:56.194303] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:56.194604] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-30T19:03:56.194756] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-30T19:03:56.195004] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-30T19:03:56.195082] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-30T19:03:56.262766] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-30T19:03:56.598606] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:56.626725] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:03:57.054370] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-30T19:03:57.448118] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:03:57.854411] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-30T19:03:58.166103] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T19:03:58.654355] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-30T19:03:58.971899] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:03:59.454374] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-30T19:04:00.234979] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T19:04:00.254306] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-30T19:04:00.360134] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T19:04:01.054359] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-30T19:04:01.613873] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:04:01.771941] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T19:04:01.854365] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-30T19:04:02.660464] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-30T19:04:02.662222] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T19:04:03.454367] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-30T19:04:04.254378] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-30T19:04:04.432247] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:04:04.453449] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T19:04:05.054357] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-30T19:04:05.854361] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-30T19:04:05.932411] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:04:06.453613] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T19:04:06.654331] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-30T19:04:06.751719] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:04:07.454366] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-30T19:04:08.002258] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:04:08.254404] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-30T19:04:08.771279] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T19:04:09.059807] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-30T19:04:09.061978] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:04:09.854357] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-30T19:04:10.515795] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:04:10.654369] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-30T19:04:11.454339] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-30T19:04:11.616007] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:04:11.651726] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:04:12.254425] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-30T19:04:12.775323] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T19:04:13.001734] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T19:04:13.054397] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-30T19:04:13.854380] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-30T19:04:14.513463] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:04:14.534088] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T19:04:14.654411] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-30T19:04:15.454386] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-30T19:04:15.979181] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:04:16.215513] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:04:16.254368] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-30T19:04:17.054409] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-30T19:04:17.725549] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T19:04:17.854363] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-30T19:04:18.573998] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:04:18.654387] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-30T19:04:19.082159] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T19:04:19.090381] [INFO ] [REMOTE ] GRNT: Full fetch complete (48512 records). [2025-09-30T19:04:19.090631] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-30T19:04:19.459538] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-30T19:04:19.551070] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-30T19:04:19.551153] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-30T19:04:19.552027] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-30T19:04:19.552104] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-30T19:04:19.553255] [DEBUG] [LOCAL ] GRNT: Trimmed 48512 records to 33750 (keeping 200 days of data) [2025-09-30T19:04:19.781822] [DEBUG] [LOCAL ] GRNT: Primary data saved (33750 records). [2025-09-30T19:04:19.782104] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-30T19:04:19.782247] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRNT took 29.3s. Estimated remaining: 2h 59m 29s. Rate: 7.8 symbols/min [2025-09-30T19:04:20.018241] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:20.026242] [DEBUG] [LOCAL ] GRX: Loaded 4569 existing records from primary storage. [2025-09-30T19:04:20.026445] [INFO ] [MAIN ] GRX: Loaded 4569 existing records. [2025-09-30T19:04:20.239074] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:20.241443] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:04:20.241683] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-30T19:04:20.250283] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-30T19:04:20.250963] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-30T19:04:20.251031] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-30T19:04:20.262688] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-30T19:04:20.662720] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:21.054357] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-30T19:04:21.294014] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T19:04:21.306396] [INFO ] [REMOTE ] GRND: Full fetch complete (70642 records). [2025-09-30T19:04:21.306566] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-30T19:04:21.744380] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-30T19:04:21.744682] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-30T19:04:21.745821] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-30T19:04:21.746043] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-30T19:04:21.747765] [DEBUG] [LOCAL ] GRND: Trimmed 70642 records to 49918 (keeping 200 days of data) [2025-09-30T19:04:21.854685] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-30T19:04:21.857091] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:04:21.862263] [INFO ] [REMOTE ] GROV: Full fetch complete (14495 records). [2025-09-30T19:04:21.863088] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-30T19:04:22.232772] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:04:22.343129] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-30T19:04:22.343782] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-30T19:04:22.344474] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-30T19:04:22.344560] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-30T19:04:22.347134] [DEBUG] [LOCAL ] GROV: Trimmed 14495 records to 8951 (keeping 200 days of data) [2025-09-30T19:04:22.507761] [DEBUG] [LOCAL ] GROV: Primary data saved (8951 records). [2025-09-30T19:04:22.509490] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-30T19:04:22.510127] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GROV took 26.8s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-09-30T19:04:22.620880] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T19:04:22.657990] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-30T19:04:22.732954] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:22.808535] [DEBUG] [LOCAL ] GRND: Primary data saved (49918 records). [2025-09-30T19:04:22.808742] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-30T19:04:22.808882] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRND took 38.4s. Estimated remaining: 2h 58m 56s. Rate: 7.8 symbols/min [2025-09-30T19:04:23.030143] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:23.031798] [DEBUG] [LOCAL ] GS: Loaded 51915 existing records from primary storage. [2025-09-30T19:04:23.032577] [INFO ] [MAIN ] GS: Loaded 51915 existing records. [2025-09-30T19:04:23.241824] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:23.242115] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-30T19:04:23.242168] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-30T19:04:23.242583] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-30T19:04:23.242684] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-30T19:04:23.396868] [DEBUG] [LOCAL ] GSBD: Loaded 39044 existing records from primary storage. [2025-09-30T19:04:23.425961] [INFO ] [MAIN ] GSBD: Loaded 39044 existing records. [2025-09-30T19:04:23.466060] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-30T19:04:23.568792] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T19:04:23.908511] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:23.923157] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-30T19:04:23.946609] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-30T19:04:23.953434] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-30T19:04:23.953522] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-30T19:04:23.953375] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:24.259548] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-30T19:04:24.344219] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:25.054357] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-30T19:04:25.093480] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:04:25.580875] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T19:04:25.854421] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-30T19:04:25.971059] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:04:26.654364] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-30T19:04:27.454386] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-30T19:04:27.515766] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:04:28.254399] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-30T19:04:28.843890] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:04:29.054397] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-30T19:04:29.089342] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:04:29.100008] [INFO ] [REMOTE ] GRMN: Full fetch complete (59925 records). [2025-09-30T19:04:29.100198] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-30T19:04:29.526589] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-30T19:04:29.526749] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-30T19:04:29.527697] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-30T19:04:29.527782] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-30T19:04:29.554079] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:04:29.563063] [DEBUG] [LOCAL ] GRMN: Trimmed 59925 records to 41031 (keeping 200 days of data) [2025-09-30T19:04:29.666739] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:04:29.854341] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-30T19:04:29.857165] [DEBUG] [LOCAL ] GRMN: Primary data saved (41031 records). [2025-09-30T19:04:29.857366] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-30T19:04:29.857484] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRMN took 47.1s. Estimated remaining: 2h 58m 47s. Rate: 7.8 symbols/min [2025-09-30T19:04:30.040479] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:30.107829] [DEBUG] [LOCAL ] GSK: Loaded 53491 existing records from primary storage. [2025-09-30T19:04:30.108222] [INFO ] [MAIN ] GSK: Loaded 53491 existing records. [2025-09-30T19:04:30.314624] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:30.314881] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-30T19:04:30.314930] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-30T19:04:30.315464] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-30T19:04:30.315524] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-30T19:04:30.659461] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-30T19:04:30.702076] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:31.454392] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-30T19:04:31.825288] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T19:04:31.888760] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:04:32.254368] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-30T19:04:32.606696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T19:04:33.066332] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-30T19:04:33.072892] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:04:33.735764] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T19:04:33.854394] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-30T19:04:34.654350] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-30T19:04:35.336028] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:04:35.454355] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-30T19:04:36.254359] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-30T19:04:36.816493] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:04:36.835442] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:04:37.054471] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-30T19:04:37.228460] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:04:37.854372] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-30T19:04:37.864040] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:04:38.654381] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-30T19:04:39.088512] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T19:04:39.454425] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-30T19:04:40.254427] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-30T19:04:40.682377] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T19:04:40.931321] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-30T19:04:40.964208] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T19:04:41.054350] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-30T19:04:41.854396] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-30T19:04:42.654343] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-30T19:04:42.903716] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T19:04:43.454420] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-30T19:04:44.032610] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T19:04:44.123513] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:04:44.254586] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-30T19:04:45.054408] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-30T19:04:45.266565] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:04:45.791330] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:04:45.793905] [INFO ] [REMOTE ] GRX: Full fetch complete (6580 records). [2025-09-30T19:04:45.793985] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-30T19:04:45.859672] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-30T19:04:46.217783] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-30T19:04:46.217863] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-30T19:04:46.218056] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-30T19:04:46.218097] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-30T19:04:46.218536] [DEBUG] [LOCAL ] GRX: Trimmed 6580 records to 4617 (keeping 200 days of data) [2025-09-30T19:04:46.248169] [DEBUG] [LOCAL ] GRX: Primary data saved (4617 records). [2025-09-30T19:04:46.248308] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-30T19:04:46.248438] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 26.5s. Estimated remaining: 2h 58m 52s. Rate: 7.8 symbols/min [2025-09-30T19:04:46.450203] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:46.506394] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-30T19:04:46.531798] [DEBUG] [LOCAL ] GSL: Loaded 33319 existing records from primary storage. [2025-09-30T19:04:46.532119] [INFO ] [MAIN ] GSL: Loaded 33319 existing records. [2025-09-30T19:04:46.659496] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-30T19:04:46.734619] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:46.735464] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-30T19:04:46.735568] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-30T19:04:46.736070] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-30T19:04:46.736150] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-30T19:04:47.140117] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:47.454364] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-30T19:04:47.991265] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T19:04:48.254384] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-30T19:04:48.586193] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:04:48.846610] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T19:04:49.054364] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-30T19:04:49.854359] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-30T19:04:50.312934] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T19:04:50.654341] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-30T19:04:51.019787] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:04:51.097846] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:04:51.106573] [INFO ] [REMOTE ] GSBD: Full fetch complete (58422 records). [2025-09-30T19:04:51.106730] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-30T19:04:51.467214] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-30T19:04:51.527895] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-30T19:04:51.527984] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-30T19:04:51.528939] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-30T19:04:51.529011] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-30T19:04:51.530349] [DEBUG] [LOCAL ] GSBD: Trimmed 58422 records to 39087 (keeping 200 days of data) [2025-09-30T19:04:51.795864] [DEBUG] [LOCAL ] GSBD: Primary data saved (39087 records). [2025-09-30T19:04:51.796032] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-30T19:04:51.796123] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 29.0s. Estimated remaining: 2h 58m 42s. Rate: 7.8 symbols/min [2025-09-30T19:04:52.010446] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:52.062972] [DEBUG] [LOCAL ] GTES: Loaded 50587 existing records from primary storage. [2025-09-30T19:04:52.063373] [INFO ] [MAIN ] GTES: Loaded 50587 existing records. [2025-09-30T19:04:52.269024] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:52.262487] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-30T19:04:52.270553] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-30T19:04:52.270753] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-30T19:04:52.271320] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-30T19:04:52.271465] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-30T19:04:52.612226] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T19:04:52.765931] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:52.803953] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:04:53.054358] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-30T19:04:53.854379] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-30T19:04:54.567824] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T19:04:54.579523] [INFO ] [REMOTE ] GS: Full fetch complete (75708 records). [2025-09-30T19:04:54.579719] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-30T19:04:54.657372] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-30T19:04:55.002114] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-30T19:04:55.002284] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-30T19:04:55.003761] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-30T19:04:55.003948] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-30T19:04:55.007225] [DEBUG] [LOCAL ] GS: Trimmed 75708 records to 51906 (keeping 200 days of data) [2025-09-30T19:04:55.138415] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T19:04:55.198959] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:04:55.453238] [DEBUG] [LOCAL ] GS: Primary data saved (51906 records). [2025-09-30T19:04:55.453395] [INFO ] [MAIN ] GS: Full history saved. [2025-09-30T19:04:55.454464] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 32.9s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-09-30T19:04:55.454635] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-30T19:04:55.660127] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:55.707427] [DEBUG] [LOCAL ] GTLS: Loaded 42738 existing records from primary storage. [2025-09-30T19:04:55.707815] [INFO ] [MAIN ] GTLS: Loaded 42738 existing records. [2025-09-30T19:04:55.902482] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:55.902902] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-30T19:04:55.903150] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-30T19:04:55.903553] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-30T19:04:55.903613] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-30T19:04:56.191113] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:04:56.259480] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-30T19:04:56.325285] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:57.054386] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-30T19:04:57.127835] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:04:57.854342] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-30T19:04:58.278738] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T19:04:58.560183] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T19:04:58.654351] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-30T19:04:59.111363] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:04:59.454386] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-30T19:05:00.254381] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-30T19:05:00.994272] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T19:05:01.054416] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-30T19:05:01.227259] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:05:01.854400] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-30T19:05:02.287215] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T19:05:02.654361] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-30T19:05:02.866828] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:05:03.454342] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-30T19:05:03.863442] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T19:05:04.252900] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T19:05:04.260432] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-30T19:05:05.054378] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-30T19:05:05.181999] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T19:05:05.194364] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-09-30T19:05:05.194516] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-30T19:05:05.660482] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-30T19:05:05.662114] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:05:05.662321] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-30T19:05:05.671713] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-30T19:05:05.671842] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-30T19:05:05.673635] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53492 (keeping 200 days of data) [2025-09-30T19:05:05.873480] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-30T19:05:06.039851] [DEBUG] [LOCAL ] GSK: Primary data saved (53492 records). [2025-09-30T19:05:06.040023] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-30T19:05:06.040113] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 36.2s. Estimated remaining: 2h 58m 25s. Rate: 7.8 symbols/min [2025-09-30T19:05:06.226716] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:06.276295] [DEBUG] [LOCAL ] GTN: Loaded 45555 existing records from primary storage. [2025-09-30T19:05:06.276717] [INFO ] [MAIN ] GTN: Loaded 45555 existing records. [2025-09-30T19:05:06.543219] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:06.543723] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-30T19:05:06.543839] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-30T19:05:06.544373] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-30T19:05:06.544432] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-30T19:05:06.655996] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-30T19:05:06.956483] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:05:06.989125] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:07.454338] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-30T19:05:07.624908] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:05:08.259547] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-30T19:05:08.278623] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:05:08.668237] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:05:09.054367] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-30T19:05:09.859482] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-30T19:05:09.880236] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T19:05:10.654367] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-30T19:05:10.774568] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:05:11.454406] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-30T19:05:11.512956] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:05:12.254379] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-30T19:05:12.317038] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:05:12.518436] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T19:05:13.054411] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-30T19:05:13.860311] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-30T19:05:13.878615] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T19:05:14.286570] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:05:14.654379] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-30T19:05:15.439673] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:05:15.454322] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-30T19:05:15.914511] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T19:05:16.254375] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-30T19:05:17.054410] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-30T19:05:17.298691] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T19:05:17.312346] [INFO ] [REMOTE ] GTES: Full fetch complete (73912 records). [2025-09-30T19:05:17.312704] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-30T19:05:17.826551] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T19:05:17.863741] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-30T19:05:18.016862] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-30T19:05:18.016990] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-30T19:05:18.018614] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-30T19:05:18.018738] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-30T19:05:18.020602] [DEBUG] [LOCAL ] GTES: Trimmed 73912 records to 50537 (keeping 200 days of data) [2025-09-30T19:05:18.429405] [DEBUG] [LOCAL ] GTES: Primary data saved (50537 records). [2025-09-30T19:05:18.429804] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-30T19:05:18.430098] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTES took 26.6s. Estimated remaining: 2h 58m 24s. Rate: 7.8 symbols/min [2025-09-30T19:05:18.645696] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:18.654451] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-30T19:05:18.693598] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:05:18.714817] [DEBUG] [LOCAL ] GTY: Loaded 30315 existing records from primary storage. [2025-09-30T19:05:18.715135] [INFO ] [MAIN ] GTY: Loaded 30315 existing records. [2025-09-30T19:05:18.908248] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:18.908504] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-30T19:05:18.908553] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-30T19:05:18.909035] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-30T19:05:18.909096] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-30T19:05:19.302328] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:19.385925] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:05:19.454376] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-30T19:05:20.254403] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-30T19:05:20.390018] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T19:05:20.403480] [INFO ] [REMOTE ] GTLS: Full fetch complete (61371 records). [2025-09-30T19:05:20.403762] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-30T19:05:20.860850] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-30T19:05:20.861001] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-30T19:05:20.861914] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-30T19:05:20.861982] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-30T19:05:20.863383] [DEBUG] [LOCAL ] GTLS: Trimmed 61371 records to 42730 (keeping 200 days of data) [2025-09-30T19:05:21.058732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-30T19:05:21.139494] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:05:21.198470] [DEBUG] [LOCAL ] GTLS: Primary data saved (42730 records). [2025-09-30T19:05:21.198710] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-30T19:05:21.199573] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTLS took 25.7s. Estimated remaining: 2h 58m 9s. Rate: 7.8 symbols/min [2025-09-30T19:05:21.380188] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:21.397463] [DEBUG] [LOCAL ] GUG: Loaded 12025 existing records from primary storage. [2025-09-30T19:05:21.397926] [INFO ] [MAIN ] GUG: Loaded 12025 existing records. [2025-09-30T19:05:21.598758] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:21.619093] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-30T19:05:21.619813] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:05:21.620038] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-30T19:05:21.627683] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-30T19:05:21.627766] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-30T19:05:21.859457] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-30T19:05:22.036761] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:22.285440] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:05:22.654354] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-30T19:05:23.454329] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-30T19:05:23.552669] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:05:23.691507] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:05:24.254396] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-30T19:05:24.837459] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:05:25.054391] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-30T19:05:25.635773] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:05:25.854374] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-30T19:05:26.042170] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:05:26.654369] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-30T19:05:26.933097] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:05:27.454404] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-30T19:05:28.216206] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:05:28.254398] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-30T19:05:28.865754] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:05:29.054370] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-30T19:05:29.860219] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-30T19:05:29.880526] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:05:29.933596] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T19:05:30.654395] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-30T19:05:30.943498] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T19:05:31.454404] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-30T19:05:32.254335] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-30T19:05:32.308713] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:05:32.352760] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:05:32.363195] [INFO ] [REMOTE ] GTN: Full fetch complete (66425 records). [2025-09-30T19:05:32.363371] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-30T19:05:32.804935] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-30T19:05:32.805032] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-30T19:05:32.805988] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-30T19:05:32.806057] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-30T19:05:32.807796] [DEBUG] [LOCAL ] GTN: Trimmed 66425 records to 45533 (keeping 200 days of data) [2025-09-30T19:05:33.054600] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-30T19:05:33.102289] [DEBUG] [LOCAL ] GTN: Primary data saved (45533 records). [2025-09-30T19:05:33.102438] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-30T19:05:33.102553] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 27.1s. Estimated remaining: 2h 58m 7s. Rate: 7.8 symbols/min [2025-09-30T19:05:33.291770] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:33.311522] [DEBUG] [LOCAL ] GUT: Loaded 15315 existing records from primary storage. [2025-09-30T19:05:33.311817] [INFO ] [MAIN ] GUT: Loaded 15315 existing records. [2025-09-30T19:05:33.511042] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:33.511318] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-30T19:05:33.511457] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-30T19:05:33.511864] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-30T19:05:33.511975] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-30T19:05:33.663425] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:05:33.697674] [INFO ] [REMOTE ] GSL: Full fetch complete (47981 records). [2025-09-30T19:05:33.717787] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-30T19:05:33.857592] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-30T19:05:34.107125] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T19:05:34.256941] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:34.426295] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-30T19:05:34.426408] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-30T19:05:34.427192] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-30T19:05:34.427261] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-30T19:05:34.428574] [DEBUG] [LOCAL ] GSL: Trimmed 47981 records to 33345 (keeping 200 days of data) [2025-09-30T19:05:34.647876] [DEBUG] [LOCAL ] GSL: Primary data saved (33345 records). [2025-09-30T19:05:34.648040] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-30T19:05:34.648178] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GSL took 48.4s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-09-30T19:05:34.660168] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-30T19:05:34.839151] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:34.878113] [DEBUG] [LOCAL ] GVA: Loaded 33227 existing records from primary storage. [2025-09-30T19:05:34.878580] [INFO ] [MAIN ] GVA: Loaded 33227 existing records. [2025-09-30T19:05:35.079283] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:35.079592] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-30T19:05:35.079688] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-30T19:05:35.080501] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-30T19:05:35.080563] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-30T19:05:35.472102] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-30T19:05:35.512130] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:35.539011] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:05:35.666501] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:05:36.254377] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-30T19:05:36.545040] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:05:37.054328] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-30T19:05:37.532746] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:05:37.854378] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-30T19:05:38.136767] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:05:38.606897] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:05:38.654359] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-30T19:05:39.454397] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-30T19:05:39.543278] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T19:05:40.254391] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-30T19:05:40.715505] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T19:05:41.054378] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-30T19:05:41.224231] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:05:41.854359] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-30T19:05:42.182073] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T19:05:42.654343] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-30T19:05:42.673474] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T19:05:43.454394] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-30T19:05:44.064547] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:05:44.254350] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-30T19:05:44.306956] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:05:45.054382] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-30T19:05:45.083637] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T19:05:45.854366] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-30T19:05:46.436128] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:05:46.455409] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:05:46.654363] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-30T19:05:47.347987] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T19:05:47.352370] [INFO ] [REMOTE ] GUG: Full fetch complete (19847 records). [2025-09-30T19:05:47.352534] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-30T19:05:47.460369] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-30T19:05:47.926684] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-30T19:05:47.926789] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-30T19:05:47.927299] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-30T19:05:47.927376] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-30T19:05:47.928444] [DEBUG] [LOCAL ] GUG: Trimmed 19847 records to 12048 (keeping 200 days of data) [2025-09-30T19:05:48.009566] [DEBUG] [LOCAL ] GUG: Primary data saved (12048 records). [2025-09-30T19:05:48.009769] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-30T19:05:48.009950] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 26.8s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-09-30T19:05:48.241129] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:48.255432] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-30T19:05:48.266236] [DEBUG] [LOCAL ] GWH: Loaded 15818 existing records from primary storage. [2025-09-30T19:05:48.266584] [INFO ] [MAIN ] GWH: Loaded 15818 existing records. [2025-09-30T19:05:48.463827] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:48.464224] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-30T19:05:48.464326] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-30T19:05:48.464765] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-30T19:05:48.464881] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-30T19:05:48.866366] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:05:48.916508] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:49.054430] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-30T19:05:49.517607] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T19:05:49.731385] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T19:05:49.854369] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-30T19:05:50.389256] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-30T19:05:50.654376] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-30T19:05:51.208075] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T19:05:51.454376] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-30T19:05:52.254408] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-30T19:05:52.973069] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T19:05:53.054406] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-30T19:05:53.188614] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:05:53.854395] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-30T19:05:54.029995] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:05:54.654403] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-30T19:05:55.188762] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:05:55.454334] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-30T19:05:55.505992] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T19:05:56.254382] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-30T19:05:56.725242] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:05:56.732066] [INFO ] [REMOTE ] GTY: Full fetch complete (43379 records). [2025-09-30T19:05:56.732165] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-30T19:05:57.059435] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-30T19:05:57.165715] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-30T19:05:57.165795] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-30T19:05:57.166495] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-30T19:05:57.166557] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-30T19:05:57.168244] [DEBUG] [LOCAL ] GTY: Trimmed 43379 records to 30299 (keeping 200 days of data) [2025-09-30T19:05:57.381835] [DEBUG] [LOCAL ] GTY: Primary data saved (30299 records). [2025-09-30T19:05:57.381982] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-30T19:05:57.382111] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTY took 39.0s. Estimated remaining: 2h 57m 46s. Rate: 7.8 symbols/min [2025-09-30T19:05:57.589889] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:57.591540] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:05:57.642027] [DEBUG] [LOCAL ] GWRE: Loaded 40718 existing records from primary storage. [2025-09-30T19:05:57.642409] [INFO ] [MAIN ] GWRE: Loaded 40718 existing records. [2025-09-30T19:05:57.838474] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:57.838689] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-30T19:05:57.838748] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-30T19:05:57.839167] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-30T19:05:57.839236] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-30T19:05:57.861148] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-30T19:05:58.191275] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:05:58.268217] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:58.654394] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-30T19:05:59.251951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T19:05:59.454376] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-30T19:06:00.245894] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:06:00.255842] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-30T19:06:00.628611] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:06:01.054426] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-30T19:06:01.391606] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:06:01.854366] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-30T19:06:02.596292] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:06:02.654348] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-30T19:06:02.798520] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:06:03.454363] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-30T19:06:04.192452] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:06:04.198985] [INFO ] [REMOTE ] GVA: Full fetch complete (48604 records). [2025-09-30T19:06:04.199103] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-30T19:06:04.259486] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-30T19:06:04.625088] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-30T19:06:04.625230] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-30T19:06:04.626055] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-30T19:06:04.626132] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-30T19:06:04.627293] [DEBUG] [LOCAL ] GVA: Trimmed 48604 records to 33174 (keeping 200 days of data) [2025-09-30T19:06:04.781027] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:06:04.904624] [DEBUG] [LOCAL ] GVA: Primary data saved (33174 records). [2025-09-30T19:06:04.904820] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-30T19:06:04.904909] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GVA took 30.3s. Estimated remaining: 2h 57m 38s. Rate: 7.8 symbols/min [2025-09-30T19:06:05.061071] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-30T19:06:05.103044] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:05.105300] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:06:05.129048] [DEBUG] [LOCAL ] GWW: Loaded 19542 existing records from primary storage. [2025-09-30T19:06:05.129340] [INFO ] [MAIN ] GWW: Loaded 19542 existing records. [2025-09-30T19:06:05.346235] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:05.346547] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-30T19:06:05.346670] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-30T19:06:05.346986] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-30T19:06:05.347066] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-30T19:06:05.762476] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:05.854352] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-30T19:06:06.026364] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:06:06.029991] [INFO ] [REMOTE ] GUT: Full fetch complete (22829 records). [2025-09-30T19:06:06.030084] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-30T19:06:06.445179] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-30T19:06:06.445270] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-30T19:06:06.445921] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-30T19:06:06.445994] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-30T19:06:06.447166] [DEBUG] [LOCAL ] GUT: Trimmed 22829 records to 15320 (keeping 200 days of data) [2025-09-30T19:06:06.537761] [DEBUG] [LOCAL ] GUT: Primary data saved (15320 records). [2025-09-30T19:06:06.537902] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-30T19:06:06.538006] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GUT took 33.4s. Estimated remaining: 2h 57m 22s. Rate: 7.8 symbols/min [2025-09-30T19:06:06.659516] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-30T19:06:06.729585] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:06.784345] [DEBUG] [LOCAL ] GXO: Loaded 47499 existing records from primary storage. [2025-09-30T19:06:06.784736] [INFO ] [MAIN ] GXO: Loaded 47499 existing records. [2025-09-30T19:06:06.983439] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:06.990905] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-30T19:06:06.991021] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-30T19:06:06.992339] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-30T19:06:06.992452] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-30T19:06:06.992269] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:06:07.387310] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:07.454334] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-30T19:06:08.254419] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-30T19:06:08.491638] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:06:09.010848] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:06:09.054325] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-30T19:06:09.153319] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:06:09.854343] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-30T19:06:10.075306] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T19:06:10.654415] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-30T19:06:11.431786] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:06:11.454409] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-30T19:06:12.254365] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-30T19:06:12.325746] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:06:12.610325] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T19:06:13.054358] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-30T19:06:13.809981] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:06:13.854324] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-30T19:06:14.270967] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:06:14.654366] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-30T19:06:15.454318] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-30T19:06:15.511596] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:06:15.838734] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T19:06:16.254360] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-30T19:06:16.760733] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:06:17.054365] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-30T19:06:17.391527] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:06:17.854346] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-30T19:06:18.146403] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T19:06:18.654410] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-30T19:06:19.417408] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:06:19.454407] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-30T19:06:19.859582] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:06:20.254355] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-30T19:06:20.375513] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T19:06:21.054389] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-30T19:06:21.851431] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:06:21.860713] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-30T19:06:22.395493] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:06:22.654397] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-30T19:06:23.054012] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:06:23.454431] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-30T19:06:23.649865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:06:24.254409] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-30T19:06:24.619404] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:06:25.054555] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-30T19:06:25.506050] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:06:25.510678] [INFO ] [REMOTE ] GWH: Full fetch complete (21159 records). [2025-09-30T19:06:25.510870] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-30T19:06:25.856707] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-30T19:06:25.956091] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-30T19:06:25.956347] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-30T19:06:25.957180] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-30T19:06:25.957386] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-30T19:06:25.964167] [DEBUG] [LOCAL ] GWH: Trimmed 21159 records to 15953 (keeping 200 days of data) [2025-09-30T19:06:25.974492] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:06:26.024589] [INFO ] [REMOTE ] GWW: Full fetch complete (29255 records). [2025-09-30T19:06:26.047341] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-30T19:06:26.153579] [DEBUG] [LOCAL ] GWH: Primary data saved (15953 records). [2025-09-30T19:06:26.173296] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-30T19:06:26.195319] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 38.2s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-09-30T19:06:26.578373] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:26.633978] [DEBUG] [LOCAL ] GYLD: Loaded 1537 existing records from primary storage. [2025-09-30T19:06:26.644602] [INFO ] [MAIN ] GYLD: Loaded 1537 existing records. [2025-09-30T19:06:26.661966] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-30T19:06:26.753240] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-30T19:06:26.753485] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-30T19:06:26.768704] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-30T19:06:26.791599] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-30T19:06:26.836750] [DEBUG] [LOCAL ] GWW: Trimmed 29255 records to 19483 (keeping 200 days of data) [2025-09-30T19:06:27.013496] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:27.046117] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-30T19:06:27.046670] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-30T19:06:27.048895] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-30T19:06:27.050497] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-30T19:06:27.482693] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:27.484263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-30T19:06:27.491547] [DEBUG] [LOCAL ] GWW: Primary data saved (19483 records). [2025-09-30T19:06:27.491978] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-30T19:06:27.492246] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 22.6s. Estimated remaining: 2h 57m 14s. Rate: 7.8 symbols/min [2025-09-30T19:06:27.704378] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:06:27.708689] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:27.774665] [DEBUG] [LOCAL ] H: Loaded 44703 existing records from primary storage. [2025-09-30T19:06:27.775208] [INFO ] [MAIN ] H: Loaded 44703 existing records. [2025-09-30T19:06:27.852101] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-30T19:06:27.980779] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:27.981099] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-30T19:06:27.981196] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-30T19:06:27.981894] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-30T19:06:27.981957] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-30T19:06:28.120448] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:06:28.263860] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-30T19:06:28.402518] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:29.054403] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-30T19:06:29.309476] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-30T19:06:29.434128] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:06:29.854375] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-30T19:06:30.202563] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T19:06:30.654380] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-30T19:06:31.454408] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-30T19:06:32.253946] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T19:06:32.263570] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-30T19:06:33.054350] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-30T19:06:33.196301] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T19:06:33.205850] [INFO ] [REMOTE ] GWRE: Full fetch complete (61156 records). [2025-09-30T19:06:33.206004] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-30T19:06:33.550513] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T19:06:33.541692] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:06:33.683338] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-30T19:06:33.683445] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-30T19:06:33.684281] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-30T19:06:33.684346] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-30T19:06:33.685692] [DEBUG] [LOCAL ] GWRE: Trimmed 61156 records to 40664 (keeping 200 days of data) [2025-09-30T19:06:33.861898] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-30T19:06:33.948421] [DEBUG] [LOCAL ] GWRE: Primary data saved (40664 records). [2025-09-30T19:06:33.948526] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-30T19:06:33.948672] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWRE took 36.6s. Estimated remaining: 2h 57m 5s. Rate: 7.8 symbols/min [2025-09-30T19:06:34.128422] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:34.169709] [DEBUG] [LOCAL ] HAE: Loaded 39432 existing records from primary storage. [2025-09-30T19:06:34.170014] [INFO ] [MAIN ] HAE: Loaded 39432 existing records. [2025-09-30T19:06:34.359119] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T19:06:34.364833] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:34.366303] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-30T19:06:34.366352] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-30T19:06:34.366847] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-30T19:06:34.366906] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-30T19:06:34.658804] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-30T19:06:34.743841] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:35.454360] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-30T19:06:36.254375] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-30T19:06:36.323024] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:06:36.393491] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T19:06:36.679407] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-30T19:06:37.054393] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-30T19:06:37.478887] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:06:37.854364] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-30T19:06:38.654388] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-30T19:06:39.140169] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T19:06:39.454355] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-30T19:06:39.611241] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:06:39.624858] [INFO ] [REMOTE ] GXO: Full fetch complete (70037 records). [2025-09-30T19:06:39.625075] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-30T19:06:39.943999] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T19:06:40.054302] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-30T19:06:40.054396] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-30T19:06:40.055373] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-30T19:06:40.055443] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-30T19:06:40.056961] [DEBUG] [LOCAL ] GXO: Trimmed 70037 records to 47460 (keeping 200 days of data) [2025-09-30T19:06:40.265430] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-30T19:06:40.347560] [DEBUG] [LOCAL ] GXO: Primary data saved (47460 records). [2025-09-30T19:06:40.347727] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-30T19:06:40.347824] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 33.8s. Estimated remaining: 2h 56m 55s. Rate: 7.8 symbols/min [2025-09-30T19:06:40.529582] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:40.581956] [DEBUG] [LOCAL ] HAFN: Loaded 43393 existing records from primary storage. [2025-09-30T19:06:40.582308] [INFO ] [MAIN ] HAFN: Loaded 43393 existing records. [2025-09-30T19:06:40.804711] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:40.804959] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-30T19:06:40.805016] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-30T19:06:40.805555] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-30T19:06:40.805620] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-30T19:06:40.913754] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T19:06:40.917911] [INFO ] [REMOTE ] GYLD: Full fetch complete (2066 records). [2025-09-30T19:06:40.918005] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-30T19:06:41.061106] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-30T19:06:41.542675] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:41.613181] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-30T19:06:41.613257] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-30T19:06:41.613356] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-30T19:06:41.613403] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-30T19:06:41.613825] [DEBUG] [LOCAL ] GYLD: Trimmed 2066 records to 1541 (keeping 200 days of data) [2025-09-30T19:06:41.624164] [DEBUG] [LOCAL ] GYLD: Primary data saved (1541 records). [2025-09-30T19:06:41.624252] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-30T19:06:41.624361] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GYLD took 15.4s. Estimated remaining: 2h 56m 39s. Rate: 7.8 symbols/min [2025-09-30T19:06:41.806767] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:41.855105] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-30T19:06:41.877955] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-30T19:06:41.878335] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-30T19:06:42.065126] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:42.065338] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-30T19:06:42.065385] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-30T19:06:42.066189] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-30T19:06:42.066252] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-30T19:06:42.438754] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:42.535029] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:06:42.654360] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-30T19:06:43.454326] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-30T19:06:43.810724] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T19:06:44.154531] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:06:44.254380] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-30T19:06:44.931947] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:06:45.054335] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-30T19:06:45.854352] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-30T19:06:46.126330] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-30T19:06:46.591873] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:06:46.654365] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-30T19:06:47.454358] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-30T19:06:47.751786] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:06:48.046837] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:06:48.254363] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-30T19:06:49.054340] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-30T19:06:49.221192] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:06:49.854344] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-30T19:06:50.260321] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T19:06:50.654335] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-30T19:06:50.887705] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:06:51.226347] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:06:51.454410] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-30T19:06:52.117788] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:06:52.254344] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-30T19:06:53.054332] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-30T19:06:53.091882] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:06:53.801894] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T19:06:53.854364] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-30T19:06:54.509008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:06:54.654371] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-30T19:06:55.454379] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-30T19:06:55.654284] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:06:56.254399] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-30T19:06:56.480701] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:06:56.846414] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:06:57.054388] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-30T19:06:57.865396] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-30T19:06:57.871241] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:06:58.654334] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-30T19:06:58.734034] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:06:59.301584] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:06:59.454359] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-30T19:07:00.254333] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-30T19:07:00.319118] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:07:00.885890] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:07:01.054381] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-30T19:07:01.845174] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:07:01.854344] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-30T19:07:02.654372] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-30T19:07:03.125561] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T19:07:03.257374] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T19:07:03.454423] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-30T19:07:04.254387] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-30T19:07:04.304583] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:07:04.318234] [INFO ] [REMOTE ] H: Full fetch complete (62031 records). [2025-09-30T19:07:04.318427] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-30T19:07:04.745677] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-30T19:07:04.745831] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-30T19:07:04.746698] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-30T19:07:04.746761] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-30T19:07:04.748204] [DEBUG] [LOCAL ] H: Trimmed 62031 records to 44651 (keeping 200 days of data) [2025-09-30T19:07:05.045480] [DEBUG] [LOCAL ] H: Primary data saved (44651 records). [2025-09-30T19:07:05.045665] [INFO ] [MAIN ] H: Full history saved. [2025-09-30T19:07:05.045778] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 37.6s. Estimated remaining: 2h 56m 53s. Rate: 7.8 symbols/min [2025-09-30T19:07:05.072239] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-30T19:07:05.235007] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:05.263841] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:07:05.274347] [INFO ] [REMOTE ] HAE: Full fetch complete (58071 records). [2025-09-30T19:07:05.274521] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-30T19:07:05.613160] [DEBUG] [LOCAL ] HASI: Loaded 47129 existing records from primary storage. [2025-09-30T19:07:05.641286] [INFO ] [MAIN ] HASI: Loaded 47129 existing records. [2025-09-30T19:07:05.892165] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-30T19:07:05.917377] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-30T19:07:05.941211] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-30T19:07:05.969449] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:05.969914] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-30T19:07:05.970194] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-30T19:07:05.970103] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-30T19:07:05.971723] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-30T19:07:05.972011] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-30T19:07:06.012892] [DEBUG] [LOCAL ] HAE: Trimmed 58071 records to 39442 (keeping 200 days of data) [2025-09-30T19:07:06.490596] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T19:07:06.592896] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:06.577091] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-30T19:07:06.677780] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-30T19:07:06.717777] [DEBUG] [LOCAL ] HAE: Primary data saved (39442 records). [2025-09-30T19:07:06.718009] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-30T19:07:06.718202] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 32.8s. Estimated remaining: 2h 56m 37s. Rate: 7.8 symbols/min [2025-09-30T19:07:06.929096] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T19:07:06.932755] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:06.995294] [DEBUG] [LOCAL ] HAYW: Loaded 48702 existing records from primary storage. [2025-09-30T19:07:06.995670] [INFO ] [MAIN ] HAYW: Loaded 48702 existing records. [2025-09-30T19:07:07.188466] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:07.188784] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-30T19:07:07.188839] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-30T19:07:07.189263] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-30T19:07:07.189324] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-30T19:07:07.462981] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-30T19:07:07.597600] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:07.980675] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:07:08.254328] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-30T19:07:08.676692] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-30T19:07:09.054332] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-30T19:07:09.153536] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:07:09.547907] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:07:09.854367] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-30T19:07:10.594179] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:07:10.654356] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-30T19:07:11.446443] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:07:11.456197] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-30T19:07:12.254362] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-30T19:07:12.664283] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:07:12.722418] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:07:13.054364] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-30T19:07:13.795265] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:07:13.854359] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-30T19:07:14.654347] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-30T19:07:14.718229] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:07:14.727253] [INFO ] [REMOTE ] HAFN: Full fetch complete (65611 records). [2025-09-30T19:07:14.727404] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-30T19:07:15.149580] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-30T19:07:15.149705] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-30T19:07:15.150681] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-30T19:07:15.150754] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-30T19:07:15.152157] [DEBUG] [LOCAL ] HAFN: Trimmed 65611 records to 43295 (keeping 200 days of data) [2025-09-30T19:07:15.418013] [DEBUG] [LOCAL ] HAFN: Primary data saved (43295 records). [2025-09-30T19:07:15.418176] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-30T19:07:15.418278] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 35.1s. Estimated remaining: 2h 56m 31s. Rate: 7.8 symbols/min [2025-09-30T19:07:15.463247] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-30T19:07:15.620822] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:15.635619] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T19:07:15.652599] [DEBUG] [LOCAL ] HBB: Loaded 6697 existing records from primary storage. [2025-09-30T19:07:15.652890] [INFO ] [MAIN ] HBB: Loaded 6697 existing records. [2025-09-30T19:07:15.849578] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:15.849971] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-30T19:07:15.850206] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-30T19:07:15.850538] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-30T19:07:15.850598] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-30T19:07:16.251693] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:16.260009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-30T19:07:16.265878] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:07:17.054394] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-30T19:07:17.562514] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T19:07:17.854333] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-30T19:07:17.896413] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:07:18.432513] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:07:18.654356] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-30T19:07:19.454329] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-30T19:07:20.039852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T19:07:20.051596] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-30T19:07:20.051789] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-30T19:07:20.269225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-30T19:07:20.486862] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:07:20.546187] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-30T19:07:20.546295] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-30T19:07:20.547416] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-30T19:07:20.547493] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-30T19:07:20.549417] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-30T19:07:20.907371] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-30T19:07:20.907536] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-30T19:07:20.908451] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 39.3s. Estimated remaining: 2h 56m 20s. Rate: 7.8 symbols/min [2025-09-30T19:07:21.068288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-30T19:07:21.105624] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:21.149606] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:07:21.152892] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:07:21.215897] [DEBUG] [LOCAL ] HBI: Loaded 52992 existing records from primary storage. [2025-09-30T19:07:21.216229] [INFO ] [MAIN ] HBI: Loaded 52992 existing records. [2025-09-30T19:07:21.406214] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:21.406433] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-30T19:07:21.406486] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-30T19:07:21.406868] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-30T19:07:21.406938] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-30T19:07:21.798000] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:21.854383] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-30T19:07:22.643264] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:07:22.654492] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-30T19:07:23.454366] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-30T19:07:23.536683] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:07:24.210805] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:07:24.254383] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-30T19:07:24.795592] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:07:25.054352] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-30T19:07:25.655468] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:07:25.854347] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-30T19:07:25.888004] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:07:26.654406] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-30T19:07:27.454367] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-30T19:07:27.508952] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:07:28.118788] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T19:07:28.254388] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-30T19:07:28.354994] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:07:28.365733] [INFO ] [REMOTE ] HAYW: Full fetch complete (70921 records). [2025-09-30T19:07:28.365868] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-30T19:07:28.778789] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-30T19:07:28.778918] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-30T19:07:28.780110] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-30T19:07:28.780189] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-30T19:07:28.781962] [DEBUG] [LOCAL ] HAYW: Trimmed 70921 records to 48728 (keeping 200 days of data) [2025-09-30T19:07:29.010680] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T19:07:29.054567] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-30T19:07:29.112010] [DEBUG] [LOCAL ] HAYW: Primary data saved (48728 records). [2025-09-30T19:07:29.112167] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-30T19:07:29.112257] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAYW took 22.4s. Estimated remaining: 2h 56m 13s. Rate: 7.8 symbols/min [2025-09-30T19:07:29.298616] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:29.354478] [DEBUG] [LOCAL ] HBM: Loaded 52906 existing records from primary storage. [2025-09-30T19:07:29.354857] [INFO ] [MAIN ] HBM: Loaded 52906 existing records. [2025-09-30T19:07:29.548386] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:29.548604] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-30T19:07:29.548708] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-30T19:07:29.549204] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-30T19:07:29.549263] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-30T19:07:29.859437] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-30T19:07:29.934378] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:29.945084] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T19:07:30.654402] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-30T19:07:31.287840] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T19:07:31.454382] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-30T19:07:31.598712] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:07:32.254383] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-30T19:07:32.857433] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:07:33.054374] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-30T19:07:33.859488] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-30T19:07:33.875039] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:07:34.576118] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:07:34.623839] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T19:07:34.654355] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-30T19:07:35.454360] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-30T19:07:36.254356] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-30T19:07:36.347592] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:07:37.059459] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-30T19:07:37.079737] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:07:37.854342] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-30T19:07:37.961022] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:07:38.654392] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-30T19:07:38.904424] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:07:39.454351] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-30T19:07:39.578771] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:07:40.254356] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-30T19:07:40.370896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:07:40.381050] [INFO ] [REMOTE ] HASI: Full fetch complete (68092 records). [2025-09-30T19:07:40.381192] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-30T19:07:40.783589] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-30T19:07:40.783750] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-30T19:07:40.784665] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-30T19:07:40.784730] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-30T19:07:40.786137] [DEBUG] [LOCAL ] HASI: Trimmed 68092 records to 47161 (keeping 200 days of data) [2025-09-30T19:07:41.062705] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-30T19:07:41.077398] [DEBUG] [LOCAL ] HASI: Primary data saved (47161 records). [2025-09-30T19:07:41.077688] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-30T19:07:41.077868] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 36.0s. Estimated remaining: 2h 56m 11s. Rate: 7.8 symbols/min [2025-09-30T19:07:41.296993] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:41.300899] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T19:07:41.359042] [DEBUG] [LOCAL ] HCA: Loaded 46951 existing records from primary storage. [2025-09-30T19:07:41.359380] [INFO ] [MAIN ] HCA: Loaded 46951 existing records. [2025-09-30T19:07:41.545847] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:41.546057] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-30T19:07:41.546105] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-30T19:07:41.546744] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-30T19:07:41.546806] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-30T19:07:41.760087] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T19:07:41.864689] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-30T19:07:41.967334] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:42.003462] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T19:07:42.654368] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-30T19:07:43.454416] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-30T19:07:43.665418] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:07:44.146287] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:07:44.254369] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-30T19:07:44.450369] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:07:45.054360] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-30T19:07:45.854337] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-30T19:07:46.042747] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:07:46.654855] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-30T19:07:46.655612] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:07:46.658096] [INFO ] [REMOTE ] HBB: Full fetch complete (9690 records). [2025-09-30T19:07:46.658265] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-30T19:07:46.952825] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:07:47.122077] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-30T19:07:47.122161] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-30T19:07:47.122448] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-30T19:07:47.122511] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-30T19:07:47.123090] [DEBUG] [LOCAL ] HBB: Trimmed 9690 records to 6651 (keeping 200 days of data) [2025-09-30T19:07:47.166296] [DEBUG] [LOCAL ] HBB: Primary data saved (6651 records). [2025-09-30T19:07:47.166429] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-30T19:07:47.166517] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBB took 31.7s. Estimated remaining: 2h 56m 1s. Rate: 7.8 symbols/min [2025-09-30T19:07:47.454381] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-30T19:07:48.254378] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-30T19:07:48.352593] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:07:48.740782] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:07:49.054378] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-30T19:07:49.854329] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-30T19:07:50.167405] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T19:07:50.654337] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-30T19:07:50.707525] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:07:51.363675] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:07:51.454398] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-30T19:07:52.254369] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-30T19:07:52.586558] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:07:52.597819] [INFO ] [REMOTE ] HBI: Full fetch complete (76894 records). [2025-09-30T19:07:52.597968] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-30T19:07:53.029004] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-30T19:07:53.029094] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-30T19:07:53.030127] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-30T19:07:53.030194] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-30T19:07:53.031778] [DEBUG] [LOCAL ] HBI: Trimmed 76894 records to 52992 (keeping 200 days of data) [2025-09-30T19:07:53.361799] [DEBUG] [LOCAL ] HBI: Primary data saved (52992 records). [2025-09-30T19:07:53.362127] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-30T19:07:53.363810] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 32.5s. Estimated remaining: 2h 55m 52s. Rate: 7.8 symbols/min [2025-09-30T19:07:53.434708] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:07:53.446332] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-30T19:07:54.098207] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:07:54.113458] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-30T19:07:54.986069] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:07:54.997962] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-30T19:07:55.840137] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:07:55.852162] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-30T19:07:56.458338] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:07:56.469076] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-30T19:07:57.498158] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:07:57.509707] [INFO ] [REMOTE ] HBM: Full fetch complete (76194 records). [2025-09-30T19:07:57.509877] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-30T19:07:57.927249] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-30T19:07:57.927396] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-30T19:07:57.928633] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-30T19:07:57.928744] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-30T19:07:57.930534] [DEBUG] [LOCAL ] HBM: Trimmed 76194 records to 52903 (keeping 200 days of data) [2025-09-30T19:07:58.204863] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T19:07:58.223637] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-30T19:07:58.307170] [DEBUG] [LOCAL ] HBM: Primary data saved (52903 records). [2025-09-30T19:07:58.307363] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-30T19:07:58.307503] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 29.2s. Estimated remaining: 2h 55m 40s. Rate: 7.8 symbols/min [2025-09-30T19:08:00.122591] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:08:00.134701] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-30T19:08:01.841989] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:08:01.852801] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-30T19:08:03.831847] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T19:08:03.841697] [INFO ] [REMOTE ] HCA: Full fetch complete (68961 records). [2025-09-30T19:08:03.841909] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-30T19:08:04.260823] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-30T19:08:04.260918] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-30T19:08:04.261895] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-30T19:08:04.261961] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-30T19:08:04.263428] [DEBUG] [LOCAL ] HCA: Trimmed 68961 records to 46952 (keeping 200 days of data) [2025-09-30T19:08:04.578472] [DEBUG] [LOCAL ] HCA: Primary data saved (46952 records). [2025-09-30T19:08:04.578619] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-30T19:08:04.578781] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 23.5s. Estimated remaining: 2h 55m 31s. Rate: 7.8 symbols/min [2025-09-30T19:08:05.213190] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.236024] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.374720] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.395012] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.395763] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-30T19:08:05.395809] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-30T19:08:05.395981] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-30T19:08:05.396036] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-30T19:08:05.396078] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-30T19:08:05.396134] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-30T19:08:05.609258] [DEBUG] [LOCAL ] HCI: Loaded 13948 existing records from primary storage. [2025-09-30T19:08:05.640558] [INFO ] [MAIN ] HCI: Loaded 13948 existing records. [2025-09-30T19:08:05.843743] [DEBUG] [LOCAL ] HD: Loaded 53503 existing records from primary storage. [2025-09-30T19:08:05.833797] [DEBUG] [LOCAL ] HCC: Loaded 45384 existing records from primary storage. [2025-09-30T19:08:05.855522] [INFO ] [MAIN ] HD: Loaded 53503 existing records. [2025-09-30T19:08:05.873275] [INFO ] [MAIN ] HCC: Loaded 45384 existing records. [2025-09-30T19:08:06.206101] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.285472] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.321965] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-30T19:08:06.406139] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:06.455678] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-30T19:08:06.461717] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.467385] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-30T19:08:06.472779] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.495709] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-30T19:08:06.540098] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-30T19:08:06.570724] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.606697] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-30T19:08:06.640878] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.640754] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-30T19:08:06.654507] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-30T19:08:06.706988] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-30T19:08:06.717588] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-30T19:08:07.057114] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T19:08:07.112703] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-30T19:08:07.575460] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.617708] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-30T19:08:07.785008] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T19:08:07.816522] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.852368] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.854237] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-30T19:08:07.852771] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-30T19:08:07.853818] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-30T19:08:08.185383] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T19:08:08.186378] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-30T19:08:08.413487] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-30T19:08:08.414631] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-30T19:08:08.519242] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:08:08.524351] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-30T19:08:08.635343] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-30T19:08:08.636238] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-30T19:08:08.862324] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-30T19:08:08.863477] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-30T19:08:09.124401] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:08:09.127639] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-30T19:08:09.181735] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:08:09.182593] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-30T19:08:09.331519] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:08:09.447334] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-30T19:08:09.853681] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T19:08:09.864548] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-30T19:08:09.915141] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:08:10.337937] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:08:10.654364] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-30T19:08:11.025914] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-30T19:08:11.026636] [INFO ] [REMOTE ] HCXY: Full fetch complete (571 records). [2025-09-30T19:08:11.026733] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-30T19:08:11.212495] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-30T19:08:11.212714] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:08:11.212786] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:08:11.212859] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-30T19:08:11.212925] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-30T19:08:11.212990] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-30T19:08:11.213072] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-30T19:08:11.213185] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 6.6s. Estimated remaining: 2h 55m 22s. Rate: 7.8 symbols/min [2025-09-30T19:08:11.396412] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:11.463426] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-30T19:08:11.470262] [DEBUG] [LOCAL ] HDB: Loaded 51912 existing records from primary storage. [2025-09-30T19:08:11.470966] [INFO ] [MAIN ] HDB: Loaded 51912 existing records. [2025-09-30T19:08:11.734938] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:11.735199] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-30T19:08:11.735261] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-30T19:08:11.735875] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-30T19:08:11.735937] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-30T19:08:12.119037] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:12.254357] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-30T19:08:12.502514] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:08:13.054364] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-30T19:08:13.854354] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-30T19:08:13.934069] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:08:14.654395] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-30T19:08:15.122366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T19:08:15.348519] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T19:08:15.467385] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-30T19:08:15.495567] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T19:08:16.254370] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-30T19:08:16.963348] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T19:08:17.054363] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-30T19:08:17.138334] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:08:17.854398] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-30T19:08:18.654391] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-30T19:08:19.290803] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-30T19:08:19.454334] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-30T19:08:19.528349] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:08:19.623856] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T19:08:20.254374] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-30T19:08:21.054371] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-30T19:08:21.245918] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:08:21.498300] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T19:08:21.854355] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-30T19:08:22.654395] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-30T19:08:22.695927] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T19:08:22.732491] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:08:23.454370] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-30T19:08:24.166258] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:08:24.254393] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-30T19:08:25.054382] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-30T19:08:25.377990] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:08:25.800060] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:08:25.854403] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-30T19:08:26.103174] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:08:26.106865] [INFO ] [REMOTE ] HCI: Full fetch complete (19418 records). [2025-09-30T19:08:26.106950] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-30T19:08:26.497677] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-30T19:08:26.497767] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-30T19:08:26.498194] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-30T19:08:26.498264] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-30T19:08:26.499014] [DEBUG] [LOCAL ] HCI: Trimmed 19418 records to 13987 (keeping 200 days of data) [2025-09-30T19:08:26.588888] [DEBUG] [LOCAL ] HCI: Primary data saved (13987 records). [2025-09-30T19:08:26.589030] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-30T19:08:26.589128] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 21.9s. Estimated remaining: 2h 55m 24s. Rate: 7.8 symbols/min [2025-09-30T19:08:26.659564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-30T19:08:26.775812] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:26.830250] [DEBUG] [LOCAL ] HE: Loaded 49059 existing records from primary storage. [2025-09-30T19:08:26.830605] [INFO ] [MAIN ] HE: Loaded 49059 existing records. [2025-09-30T19:08:27.021374] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:27.021594] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-30T19:08:27.021680] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-30T19:08:27.022195] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-30T19:08:27.022254] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-30T19:08:27.432002] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:27.454373] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-30T19:08:27.967205] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T19:08:28.254343] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-30T19:08:28.460716] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:08:29.054374] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-30T19:08:29.115029] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:08:29.854372] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-30T19:08:30.393945] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T19:08:30.654345] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-30T19:08:30.748492] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:08:31.454338] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-30T19:08:31.546440] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:08:32.156334] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:08:32.254404] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-30T19:08:32.975529] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:08:33.054392] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-30T19:08:33.854370] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-30T19:08:34.045380] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:08:34.654353] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-30T19:08:34.906703] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:08:35.454347] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-30T19:08:35.598845] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:08:36.254345] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-30T19:08:36.455538] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T19:08:37.054357] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-30T19:08:37.173978] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:08:37.854361] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-30T19:08:37.973184] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:08:38.654373] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-30T19:08:39.099271] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:08:39.431212] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:08:39.444920] [INFO ] [REMOTE ] HDB: Full fetch complete (75250 records). [2025-09-30T19:08:39.445076] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-30T19:08:39.459461] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-30T19:08:39.868480] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-30T19:08:39.868565] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-30T19:08:39.869496] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-30T19:08:39.869567] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-30T19:08:39.871056] [DEBUG] [LOCAL ] HDB: Trimmed 75250 records to 51926 (keeping 200 days of data) [2025-09-30T19:08:40.228347] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T19:08:40.251263] [DEBUG] [LOCAL ] HDB: Primary data saved (51926 records). [2025-09-30T19:08:40.251411] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-30T19:08:40.251538] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HDB took 29.0s. Estimated remaining: 2h 55m 25s. Rate: 7.8 symbols/min [2025-09-30T19:08:40.256933] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-30T19:08:40.448687] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:40.486986] [DEBUG] [LOCAL ] HEI: Loaded 32223 existing records from primary storage. [2025-09-30T19:08:40.487281] [INFO ] [MAIN ] HEI: Loaded 32223 existing records. [2025-09-30T19:08:40.679382] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:40.679638] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-30T19:08:40.679724] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-30T19:08:40.680118] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-30T19:08:40.680178] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-30T19:08:41.058214] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-30T19:08:41.065916] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:41.306861] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T19:08:41.854364] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-30T19:08:42.121901] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T19:08:42.131972] [INFO ] [REMOTE ] HCC: Full fetch complete (64350 records). [2025-09-30T19:08:42.132169] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-30T19:08:42.577019] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-30T19:08:42.577109] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-30T19:08:42.578063] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-30T19:08:42.578167] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-30T19:08:42.579605] [DEBUG] [LOCAL ] HCC: Trimmed 64350 records to 45344 (keeping 200 days of data) [2025-09-30T19:08:42.675456] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-30T19:08:42.875078] [DEBUG] [LOCAL ] HCC: Primary data saved (45344 records). [2025-09-30T19:08:42.875222] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-30T19:08:42.875312] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HCC took 38.3s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-09-30T19:08:43.069414] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:43.079045] [DEBUG] [LOCAL ] HEQ: Loaded 6221 existing records from primary storage. [2025-09-30T19:08:43.079245] [INFO ] [MAIN ] HEQ: Loaded 6221 existing records. [2025-09-30T19:08:43.271236] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:43.271736] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-30T19:08:43.271807] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-30T19:08:43.272149] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-30T19:08:43.272211] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-30T19:08:43.634963] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-30T19:08:43.717580] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:43.718432] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-30T19:08:43.719621] [INFO ] [REMOTE ] HD: Full fetch complete (77442 records). [2025-09-30T19:08:43.719988] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-30T19:08:43.832770] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:08:44.262820] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-30T19:08:44.259813] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-30T19:08:44.263447] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-30T19:08:44.265283] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-30T19:08:44.267437] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:08:44.268695] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-30T19:08:44.279326] [DEBUG] [LOCAL ] HD: Trimmed 77442 records to 53497 (keeping 200 days of data) [2025-09-30T19:08:44.381042] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:08:44.642624] [DEBUG] [LOCAL ] HD: Primary data saved (53497 records). [2025-09-30T19:08:44.642828] [INFO ] [MAIN ] HD: Full history saved. [2025-09-30T19:08:44.642943] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 40.1s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-09-30T19:08:44.815783] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:44.864169] [DEBUG] [LOCAL ] HESM: Loaded 48194 existing records from primary storage. [2025-09-30T19:08:44.864502] [INFO ] [MAIN ] HESM: Loaded 48194 existing records. [2025-09-30T19:08:45.058338] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-30T19:08:45.062765] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:45.063220] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-30T19:08:45.064227] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-30T19:08:45.064934] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-30T19:08:45.064995] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-30T19:08:45.466064] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:45.855816] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:08:45.854448] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-30T19:08:46.494693] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:08:46.659699] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-30T19:08:46.670559] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:08:47.272355] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T19:08:47.454379] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-30T19:08:48.254363] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-30T19:08:49.054372] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-30T19:08:49.145029] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:08:49.641064] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:08:49.708639] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:08:49.854364] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-30T19:08:50.366876] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T19:08:50.654378] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-30T19:08:51.240406] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:08:51.454392] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-30T19:08:52.119576] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T19:08:52.254363] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-30T19:08:53.054386] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-30T19:08:53.749510] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T19:08:53.854346] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-30T19:08:53.945520] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:08:54.190630] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T19:08:54.654360] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-30T19:08:55.454372] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-30T19:08:56.254341] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-30T19:08:56.435513] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:08:57.027281] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:08:57.054373] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-30T19:08:57.554489] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:08:57.854412] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-30T19:08:58.302136] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T19:08:58.647964] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T19:08:58.651293] [INFO ] [REMOTE ] HEQ: Full fetch complete (9217 records). [2025-09-30T19:08:58.651397] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-30T19:08:58.664492] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-30T19:08:59.061851] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-30T19:08:59.061955] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-30T19:08:59.062233] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-30T19:08:59.062320] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-30T19:08:59.062886] [DEBUG] [LOCAL ] HEQ: Trimmed 9217 records to 6231 (keeping 200 days of data) [2025-09-30T19:08:59.104215] [DEBUG] [LOCAL ] HEQ: Primary data saved (6231 records). [2025-09-30T19:08:59.104341] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-30T19:08:59.104438] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 16.2s. Estimated remaining: 2h 54m 56s. Rate: 7.8 symbols/min [2025-09-30T19:08:59.293120] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:59.293252] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-30T19:08:59.293309] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-30T19:08:59.293420] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-30T19:08:59.293462] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-30T19:08:59.293505] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-30T19:08:59.293557] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-30T19:08:59.459465] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-30T19:08:59.719168] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:00.254349] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-30T19:09:00.305414] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:09:01.054351] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-30T19:09:01.314530] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:09:01.841596] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T19:09:01.854325] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-30T19:09:02.655410] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:09:02.654611] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-30T19:09:02.999137] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-30T19:09:03.445319] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:09:03.455032] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-30T19:09:03.701501] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-30T19:09:04.254372] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-30T19:09:05.054390] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-30T19:09:05.854350] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-30T19:09:05.883912] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T19:09:06.654412] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-30T19:09:06.855683] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:09:06.873134] [INFO ] [REMOTE ] HE: Full fetch complete (72413 records). [2025-09-30T19:09:06.873397] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-30T19:09:07.456299] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-30T19:09:07.514870] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-30T19:09:07.515126] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-30T19:09:07.516455] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-30T19:09:07.516582] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-30T19:09:07.519165] [DEBUG] [LOCAL ] HE: Trimmed 72413 records to 49067 (keeping 200 days of data) [2025-09-30T19:09:07.660104] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:09:07.705169] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T19:09:07.796372] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T19:09:07.922984] [DEBUG] [LOCAL ] HE: Primary data saved (49067 records). [2025-09-30T19:09:07.923130] [INFO ] [MAIN ] HE: Full history saved. [2025-09-30T19:09:07.923869] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 41.3s. Estimated remaining: 2h 54m 50s. Rate: 7.8 symbols/min [2025-09-30T19:09:08.105902] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:08.106070] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-30T19:09:08.106110] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-30T19:09:08.106261] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-30T19:09:08.106304] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-30T19:09:08.106346] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-30T19:09:08.106421] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-30T19:09:08.263750] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-30T19:09:08.506496] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:09.054368] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-30T19:09:09.292608] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T19:09:09.821276] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:09:09.854336] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-30T19:09:10.654368] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-30T19:09:11.452631] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:09:11.456392] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-30T19:09:11.710352] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-30T19:09:12.168932] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:09:12.254352] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-30T19:09:13.054360] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-30T19:09:13.854353] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-30T19:09:13.946633] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:09:14.092755] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-30T19:09:14.133479] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:09:14.139800] [INFO ] [REMOTE ] HEI: Full fetch complete (48825 records). [2025-09-30T19:09:14.139940] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-30T19:09:14.565225] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-30T19:09:14.565334] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-30T19:09:14.566150] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-30T19:09:14.566247] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-30T19:09:14.567348] [DEBUG] [LOCAL ] HEI: Trimmed 48825 records to 32152 (keeping 200 days of data) [2025-09-30T19:09:14.659880] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-30T19:09:14.781682] [DEBUG] [LOCAL ] HEI: Primary data saved (32152 records). [2025-09-30T19:09:14.781832] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-30T19:09:14.781926] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEI took 34.5s. Estimated remaining: 2h 54m 41s. Rate: 7.8 symbols/min [2025-09-30T19:09:14.978595] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:15.003198] [DEBUG] [LOCAL ] HFRO: Loaded 17595 existing records from primary storage. [2025-09-30T19:09:15.003541] [INFO ] [MAIN ] HFRO: Loaded 17595 existing records. [2025-09-30T19:09:15.096422] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T19:09:15.214786] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:15.215040] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-30T19:09:15.215089] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-30T19:09:15.215389] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-30T19:09:15.215503] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-30T19:09:15.460505] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-30T19:09:15.593236] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:15.745605] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T19:09:16.254399] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-30T19:09:16.452615] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-30T19:09:17.054353] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-30T19:09:17.854373] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-30T19:09:18.654372] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-30T19:09:18.693286] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:09:18.984713] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T19:09:19.062892] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:09:19.454360] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-30T19:09:19.922165] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:09:20.254390] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-30T19:09:21.054337] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-30T19:09:21.415848] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T19:09:21.438737] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:09:21.854385] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-30T19:09:22.654408] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-30T19:09:22.876909] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-30T19:09:23.454372] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-30T19:09:23.765203] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T19:09:23.775951] [INFO ] [REMOTE ] HESM: Full fetch complete (69131 records). [2025-09-30T19:09:23.776118] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-30T19:09:23.867245] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T19:09:23.892531] [INFO ] [REMOTE ] HF: Full fetch complete (498 records). [2025-09-30T19:09:23.892747] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-30T19:09:24.271350] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-30T19:09:24.350039] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-30T19:09:24.357013] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:09:24.377785] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:09:24.400063] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-30T19:09:24.416486] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-30T19:09:24.434291] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-30T19:09:24.436733] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-30T19:09:24.440882] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HF took 25.3s. Estimated remaining: 2h 54m 36s. Rate: 7.8 symbols/min [2025-09-30T19:09:24.498009] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-30T19:09:24.535358] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-30T19:09:24.553638] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-30T19:09:24.574708] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-30T19:09:24.633565] [DEBUG] [LOCAL ] HESM: Trimmed 69131 records to 48247 (keeping 200 days of data) [2025-09-30T19:09:24.656537] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:24.770346] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T19:09:24.798006] [DEBUG] [LOCAL ] HGER: Loaded 13386 existing records from primary storage. [2025-09-30T19:09:24.800061] [INFO ] [MAIN ] HGER: Loaded 13386 existing records. [2025-09-30T19:09:25.062827] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:25.057556] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-30T19:09:25.073293] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-30T19:09:25.102426] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-30T19:09:25.106748] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-30T19:09:25.107163] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-30T19:09:25.480320] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T19:09:25.557914] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:25.636368] [DEBUG] [LOCAL ] HESM: Primary data saved (48247 records). [2025-09-30T19:09:25.636543] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-30T19:09:25.636696] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HESM took 41.0s. Estimated remaining: 2h 54m 20s. Rate: 7.8 symbols/min [2025-09-30T19:09:25.826787] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:25.837614] [DEBUG] [LOCAL ] HGLB: Loaded 9393 existing records from primary storage. [2025-09-30T19:09:25.837856] [INFO ] [MAIN ] HGLB: Loaded 9393 existing records. [2025-09-30T19:09:25.861595] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-30T19:09:26.034249] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:26.034483] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-30T19:09:26.034532] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-30T19:09:26.034763] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-30T19:09:26.034825] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-30T19:09:26.415772] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:26.654344] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-30T19:09:26.915189] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:09:27.397902] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:09:27.454316] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-30T19:09:28.140720] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:09:28.254355] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-30T19:09:29.054400] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-30T19:09:29.549079] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T19:09:29.807572] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T19:09:29.854314] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-30T19:09:30.408016] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T19:09:30.654380] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-30T19:09:30.977668] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:09:31.454375] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-30T19:09:32.200252] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:09:32.254434] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-30T19:09:32.850858] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T19:09:33.054376] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-30T19:09:33.833009] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:09:33.854319] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-30T19:09:34.654409] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-30T19:09:34.676239] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T19:09:35.454386] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-30T19:09:35.694086] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T19:09:35.861360] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T19:09:36.254424] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-30T19:09:36.728378] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T19:09:37.054410] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-30T19:09:37.389340] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T19:09:37.854401] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-30T19:09:38.648364] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T19:09:38.654319] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-30T19:09:39.157670] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-30T19:09:39.159069] [INFO ] [REMOTE ] HFND: Full fetch complete (1797 records). [2025-09-30T19:09:39.159161] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-30T19:09:39.370126] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-30T19:09:39.370470] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:09:39.370545] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:09:39.370624] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-30T19:09:39.370740] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-30T19:09:39.370787] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-30T19:09:39.370845] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-30T19:09:39.370947] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFND took 31.4s. Estimated remaining: 2h 54m 20s. Rate: 7.8 symbols/min [2025-09-30T19:09:39.459621] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-30T19:09:39.550513] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:39.570941] [DEBUG] [LOCAL ] HGTY: Loaded 13122 existing records from primary storage. [2025-09-30T19:09:39.571258] [INFO ] [MAIN ] HGTY: Loaded 13122 existing records. [2025-09-30T19:09:39.779290] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:39.779523] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-30T19:09:39.779573] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-30T19:09:39.779818] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-30T19:09:39.779878] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-30T19:09:40.192955] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:40.215880] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T19:09:40.254366] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-30T19:09:40.990196] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:09:41.054396] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-30T19:09:41.772684] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:09:41.854362] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-30T19:09:42.654367] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-30T19:09:42.710170] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T19:09:43.412802] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:09:43.454389] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-30T19:09:43.934791] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T19:09:44.254365] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-30T19:09:44.993273] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:09:45.054385] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-30T19:09:45.854328] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-30T19:09:46.019158] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:09:46.605894] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:09:46.654370] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-30T19:09:47.413273] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T19:09:47.454362] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-30T19:09:48.055005] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:09:48.254409] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-30T19:09:49.028807] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:09:49.054324] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-30T19:09:49.613907] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:09:49.854388] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-30T19:09:50.654331] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-30T19:09:50.678401] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:09:51.454406] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-30T19:09:51.620754] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:09:51.623586] [INFO ] [REMOTE ] HGLB: Full fetch complete (14540 records). [2025-09-30T19:09:51.623688] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-30T19:09:52.021755] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T19:09:52.031012] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-30T19:09:52.031935] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-30T19:09:52.034326] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-30T19:09:52.034764] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-30T19:09:52.035290] [DEBUG] [LOCAL ] HGLB: Trimmed 14540 records to 9473 (keeping 200 days of data) [2025-09-30T19:09:52.097163] [DEBUG] [LOCAL ] HGLB: Primary data saved (9473 records). [2025-09-30T19:09:52.097327] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-30T19:09:52.097429] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGLB took 26.5s. Estimated remaining: 2h 54m 19s. Rate: 7.8 symbols/min [2025-09-30T19:09:52.254736] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-30T19:09:52.279976] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:52.325068] [DEBUG] [LOCAL ] HGV: Loaded 46645 existing records from primary storage. [2025-09-30T19:09:52.325385] [INFO ] [MAIN ] HGV: Loaded 46645 existing records. [2025-09-30T19:09:52.520517] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:52.520819] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-30T19:09:52.520878] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-30T19:09:52.521353] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-30T19:09:52.521419] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-30T19:09:52.933152] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:53.054337] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-30T19:09:53.114275] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T19:09:53.119124] [INFO ] [REMOTE ] HFRO: Full fetch complete (29074 records). [2025-09-30T19:09:53.119212] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-30T19:09:53.521827] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-30T19:09:53.521911] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-30T19:09:53.522503] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-30T19:09:53.522578] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-30T19:09:53.523389] [DEBUG] [LOCAL ] HFRO: Trimmed 29074 records to 17720 (keeping 200 days of data) [2025-09-30T19:09:53.636424] [DEBUG] [LOCAL ] HFRO: Primary data saved (17720 records). [2025-09-30T19:09:53.636606] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-30T19:09:53.636735] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFRO took 38.9s. Estimated remaining: 2h 54m 3s. Rate: 7.8 symbols/min [2025-09-30T19:09:53.832827] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:53.854406] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-30T19:09:53.869065] [DEBUG] [LOCAL ] HHH: Loaded 32605 existing records from primary storage. [2025-09-30T19:09:53.869437] [INFO ] [MAIN ] HHH: Loaded 32605 existing records. [2025-09-30T19:09:54.086490] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:54.086759] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-30T19:09:54.086817] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-30T19:09:54.087073] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-30T19:09:54.087133] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-30T19:09:54.491458] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:54.520090] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:09:54.654382] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-30T19:09:54.663157] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:09:55.454388] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-30T19:09:55.735599] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:09:55.998396] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T19:09:56.254409] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-30T19:09:56.859181] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:09:57.054363] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-30T19:09:57.854373] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-30T19:09:58.193212] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T19:09:58.654411] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-30T19:09:58.866779] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T19:09:59.454442] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-30T19:09:59.619168] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:10:00.254389] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-30T19:10:00.712817] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T19:10:00.718297] [INFO ] [REMOTE ] HGTY: Full fetch complete (17272 records). [2025-09-30T19:10:00.718447] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-30T19:10:01.059415] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-30T19:10:01.146680] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-30T19:10:01.146912] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-30T19:10:01.147405] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-30T19:10:01.147488] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-30T19:10:01.148556] [DEBUG] [LOCAL ] HGTY: Trimmed 17272 records to 13203 (keeping 200 days of data) [2025-09-30T19:10:01.217786] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:10:01.245528] [DEBUG] [LOCAL ] HGTY: Primary data saved (13203 records). [2025-09-30T19:10:01.245746] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-30T19:10:01.245838] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 21.9s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-09-30T19:10:01.427544] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:01.475101] [DEBUG] [LOCAL ] HI: Loaded 35198 existing records from primary storage. [2025-09-30T19:10:01.475445] [INFO ] [MAIN ] HI: Loaded 35198 existing records. [2025-09-30T19:10:01.718692] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:01.718985] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-30T19:10:01.719047] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-30T19:10:01.719376] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-30T19:10:01.719435] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-30T19:10:01.859548] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-30T19:10:02.142299] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:02.581433] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:10:02.654378] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-30T19:10:03.124481] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T19:10:03.129603] [INFO ] [REMOTE ] HGER: Full fetch complete (16680 records). [2025-09-30T19:10:03.129754] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-30T19:10:03.467482] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-30T19:10:03.519955] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-30T19:10:03.520043] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-30T19:10:03.520447] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-30T19:10:03.520489] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-30T19:10:03.521510] [DEBUG] [LOCAL ] HGER: Trimmed 16680 records to 13442 (keeping 200 days of data) [2025-09-30T19:10:03.614294] [DEBUG] [LOCAL ] HGER: Primary data saved (13442 records). [2025-09-30T19:10:03.614448] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-30T19:10:03.614542] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGER took 39.2s. Estimated remaining: 2h 53m 41s. Rate: 7.8 symbols/min [2025-09-30T19:10:03.833638] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:03.907281] [DEBUG] [LOCAL ] HIG: Loaded 51212 existing records from primary storage. [2025-09-30T19:10:03.907678] [INFO ] [MAIN ] HIG: Loaded 51212 existing records. [2025-09-30T19:10:04.127367] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T19:10:04.168900] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:04.169673] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-30T19:10:04.169736] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-30T19:10:04.170431] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-30T19:10:04.170492] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-30T19:10:04.261846] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-30T19:10:04.611680] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:04.684033] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:10:05.054371] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-30T19:10:05.679335] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T19:10:05.854355] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-30T19:10:06.654365] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-30T19:10:06.855738] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T19:10:07.272274] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:10:07.454372] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-30T19:10:08.239421] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:10:08.254307] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-30T19:10:08.802200] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:10:09.054361] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-30T19:10:09.854350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-30T19:10:09.907032] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:10:10.654359] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-30T19:10:11.251592] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:10:11.286084] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T19:10:11.454350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-30T19:10:11.893307] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:10:12.254353] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-30T19:10:12.808200] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T19:10:13.054360] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-30T19:10:13.757986] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:10:13.854349] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-30T19:10:14.404559] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T19:10:14.654392] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-30T19:10:15.259554] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:10:15.454358] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-30T19:10:15.760430] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:10:16.254387] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-30T19:10:16.530743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:10:17.054381] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-30T19:10:17.854340] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-30T19:10:18.032308] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T19:10:18.521798] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T19:10:18.654399] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-30T19:10:19.268359] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:10:19.454421] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-30T19:10:20.254356] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-30T19:10:20.589691] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:10:20.932114] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:10:21.054354] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-30T19:10:21.691615] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:10:21.854347] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-30T19:10:22.654428] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-30T19:10:22.743089] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:10:23.221314] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:10:23.454372] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-30T19:10:23.686637] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:10:23.693826] [INFO ] [REMOTE ] HHH: Full fetch complete (45395 records). [2025-09-30T19:10:23.693947] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-30T19:10:24.110075] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-30T19:10:24.110168] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-30T19:10:24.111042] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-30T19:10:24.111111] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-30T19:10:24.112232] [DEBUG] [LOCAL ] HHH: Trimmed 45395 records to 32605 (keeping 200 days of data) [2025-09-30T19:10:24.278974] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-30T19:10:24.332463] [DEBUG] [LOCAL ] HHH: Primary data saved (32605 records). [2025-09-30T19:10:24.332661] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-30T19:10:24.332884] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 30.7s. Estimated remaining: 2h 53m 50s. Rate: 7.8 symbols/min [2025-09-30T19:10:24.526214] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:24.575088] [DEBUG] [LOCAL ] HII: Loaded 34805 existing records from primary storage. [2025-09-30T19:10:24.575383] [INFO ] [MAIN ] HII: Loaded 34805 existing records. [2025-09-30T19:10:24.783924] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:24.784747] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-30T19:10:24.784929] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-30T19:10:24.785528] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-30T19:10:24.785599] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-30T19:10:24.957925] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:10:25.063234] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-30T19:10:25.229254] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:25.854407] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-30T19:10:25.912246] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:10:26.541814] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T19:10:26.654361] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-30T19:10:27.454353] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-30T19:10:27.501065] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:10:28.235581] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:10:28.245454] [INFO ] [REMOTE ] HGV: Full fetch complete (65815 records). [2025-09-30T19:10:28.245604] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-30T19:10:28.260307] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-30T19:10:28.670376] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-30T19:10:28.670503] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-30T19:10:28.671470] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-30T19:10:28.671538] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-30T19:10:28.674700] [DEBUG] [LOCAL ] HGV: Trimmed 65815 records to 46608 (keeping 200 days of data) [2025-09-30T19:10:28.934685] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:10:28.969720] [INFO ] [REMOTE ] HI: Full fetch complete (49925 records). [2025-09-30T19:10:28.978999] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-30T19:10:29.055801] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-30T19:10:29.092384] [DEBUG] [LOCAL ] HGV: Primary data saved (46608 records). [2025-09-30T19:10:29.106060] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-30T19:10:29.106712] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HGV took 37.0s. Estimated remaining: 2h 53m 39s. Rate: 7.8 symbols/min [2025-09-30T19:10:29.458730] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:29.669869] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-30T19:10:29.670038] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-30T19:10:29.670945] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-30T19:10:29.671104] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-30T19:10:29.674210] [DEBUG] [LOCAL ] HI: Trimmed 49925 records to 35264 (keeping 200 days of data) [2025-09-30T19:10:29.815926] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:10:29.863431] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-30T19:10:29.870711] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-30T19:10:29.873972] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-30T19:10:30.095370] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:30.147038] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-30T19:10:30.147423] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-30T19:10:30.167862] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-30T19:10:30.168701] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-30T19:10:30.324619] [DEBUG] [LOCAL ] HI: Primary data saved (35264 records). [2025-09-30T19:10:30.335416] [INFO ] [MAIN ] HI: Full history saved. [2025-09-30T19:10:30.340799] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HI took 29.1s. Estimated remaining: 2h 53m 22s. Rate: 7.8 symbols/min [2025-09-30T19:10:30.802837] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:30.838619] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:30.839510] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-30T19:10:30.881138] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:10:30.910610] [DEBUG] [LOCAL ] HIO: Loaded 23694 existing records from primary storage. [2025-09-30T19:10:30.910993] [INFO ] [MAIN ] HIO: Loaded 23694 existing records. [2025-09-30T19:10:31.105164] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:31.105392] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-30T19:10:31.105444] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-30T19:10:31.105834] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-30T19:10:31.105897] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-30T19:10:31.468900] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-30T19:10:31.508634] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:31.560776] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T19:10:32.254360] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-30T19:10:32.878338] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:10:33.054353] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-30T19:10:33.354684] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-30T19:10:33.641283] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:10:33.854352] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-30T19:10:34.217267] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:10:34.654382] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-30T19:10:35.405562] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T19:10:35.454338] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-30T19:10:36.254360] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-30T19:10:36.955444] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:10:37.031409] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-30T19:10:37.054402] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-30T19:10:37.508697] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T19:10:37.854364] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-30T19:10:38.654415] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-30T19:10:39.428884] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-30T19:10:39.454313] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-30T19:10:39.690342] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:10:39.774237] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T19:10:40.254385] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-30T19:10:41.054399] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-30T19:10:41.418418] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:10:41.854336] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-30T19:10:42.114872] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-30T19:10:42.478320] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T19:10:42.654371] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-30T19:10:42.725671] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T19:10:43.454423] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-30T19:10:44.103632] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:10:44.254421] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-30T19:10:45.054333] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-30T19:10:45.160618] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:10:45.854360] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-30T19:10:46.248271] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:10:46.255551] [INFO ] [REMOTE ] HII: Full fetch complete (53141 records). [2025-09-30T19:10:46.255710] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-30T19:10:46.659797] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-30T19:10:46.674147] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-30T19:10:46.674241] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-30T19:10:46.675109] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-30T19:10:46.675382] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-30T19:10:46.676601] [DEBUG] [LOCAL ] HII: Trimmed 53141 records to 34713 (keeping 200 days of data) [2025-09-30T19:10:46.915820] [DEBUG] [LOCAL ] HII: Primary data saved (34713 records). [2025-09-30T19:10:46.915971] [INFO ] [MAIN ] HII: Full history saved. [2025-09-30T19:10:46.916077] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 22.6s. Estimated remaining: 2h 53m 26s. Rate: 7.8 symbols/min [2025-09-30T19:10:47.131013] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:47.180421] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-30T19:10:47.208571] [DEBUG] [LOCAL ] HIPO: Loaded 22166 existing records from primary storage. [2025-09-30T19:10:47.208884] [INFO ] [MAIN ] HIPO: Loaded 22166 existing records. [2025-09-30T19:10:47.400896] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:47.401232] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-30T19:10:47.401284] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-30T19:10:47.401568] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-30T19:10:47.401637] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-30T19:10:47.468071] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-30T19:10:47.807418] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:47.840139] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:10:47.852472] [INFO ] [REMOTE ] HIG: Full fetch complete (73243 records). [2025-09-30T19:10:47.852692] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-30T19:10:48.067377] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T19:10:48.259529] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-30T19:10:48.351353] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-30T19:10:48.351445] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-30T19:10:48.352756] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-30T19:10:48.352837] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-30T19:10:48.354365] [DEBUG] [LOCAL ] HIG: Trimmed 73243 records to 51228 (keeping 200 days of data) [2025-09-30T19:10:48.692830] [DEBUG] [LOCAL ] HIG: Primary data saved (51228 records). [2025-09-30T19:10:48.692980] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-30T19:10:48.693079] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIG took 45.1s. Estimated remaining: 2h 53m 11s. Rate: 7.8 symbols/min [2025-09-30T19:10:48.882484] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:48.928504] [DEBUG] [LOCAL ] HIW: Loaded 44565 existing records from primary storage. [2025-09-30T19:10:48.928982] [INFO ] [MAIN ] HIW: Loaded 44565 existing records. [2025-09-30T19:10:49.069234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-30T19:10:49.123842] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:49.124238] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-30T19:10:49.124311] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-30T19:10:49.124714] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-30T19:10:49.124802] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-30T19:10:49.496937] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:10:49.591616] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:49.854326] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-30T19:10:49.894788] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T19:10:50.028008] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-30T19:10:50.654372] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-30T19:10:51.356877] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:10:51.454361] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-30T19:10:51.647136] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T19:10:52.254364] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-30T19:10:52.963182] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:10:52.984802] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T19:10:53.054408] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-30T19:10:53.854350] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-30T19:10:54.101990] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:10:54.654427] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-30T19:10:55.407060] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:10:55.454348] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-30T19:10:56.254411] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-30T19:10:57.059754] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-30T19:10:57.084974] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:10:57.227375] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:10:57.264132] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-30T19:10:57.854328] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-30T19:10:58.176203] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:10:58.654369] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-30T19:10:59.454395] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-30T19:10:59.855509] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:11:00.254337] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-30T19:11:00.634517] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-30T19:11:00.890235] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:11:01.027044] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:11:01.054337] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-30T19:11:01.854366] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-30T19:11:02.654353] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-30T19:11:02.732947] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:11:03.454395] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-30T19:11:03.593780] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:11:04.254374] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-30T19:11:04.660914] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-30T19:11:04.957952] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:11:05.013235] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:11:05.054382] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-30T19:11:05.854361] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-30T19:11:06.547567] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:11:06.654335] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-30T19:11:07.007412] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:11:07.454337] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-30T19:11:07.805442] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:11:08.254356] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-30T19:11:09.054119] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:11:09.057853] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-30T19:11:09.542340] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T19:11:09.547351] [INFO ] [REMOTE ] HIPO: Full fetch complete (31539 records). [2025-09-30T19:11:09.547495] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-30T19:11:09.859533] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-30T19:11:09.967369] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-30T19:11:09.967459] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-30T19:11:09.968132] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-30T19:11:09.968238] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-30T19:11:09.969192] [DEBUG] [LOCAL ] HIPO: Trimmed 31539 records to 22110 (keeping 200 days of data) [2025-09-30T19:11:10.105941] [DEBUG] [LOCAL ] HIPO: Primary data saved (22110 records). [2025-09-30T19:11:10.106076] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-30T19:11:10.106160] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 23.2s. Estimated remaining: 2h 53m 21s. Rate: 7.8 symbols/min [2025-09-30T19:11:10.284292] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:10.305776] [DEBUG] [LOCAL ] HIX: Loaded 20488 existing records from primary storage. [2025-09-30T19:11:10.306071] [INFO ] [MAIN ] HIX: Loaded 20488 existing records. [2025-09-30T19:11:10.547569] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:10.547861] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-30T19:11:10.547916] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-30T19:11:10.548099] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-30T19:11:10.548189] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-30T19:11:10.659433] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-30T19:11:10.939832] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:11.454328] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-30T19:11:11.548945] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:11:11.559048] [INFO ] [REMOTE ] HIW: Full fetch complete (64724 records). [2025-09-30T19:11:11.559209] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-30T19:11:11.982445] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-30T19:11:11.982890] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-30T19:11:11.984057] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-30T19:11:11.984301] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-30T19:11:11.997426] [DEBUG] [LOCAL ] HIW: Trimmed 64724 records to 44523 (keeping 200 days of data) [2025-09-30T19:11:12.019129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-30T19:11:12.109941] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-30T19:11:12.143450] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:11:12.142732] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-30T19:11:12.170606] [INFO ] [REMOTE ] HIO: Full fetch complete (37094 records). [2025-09-30T19:11:12.187941] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-30T19:11:12.868969] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:11:12.900548] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-30T19:11:13.171117] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-30T19:11:13.202109] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-30T19:11:13.202803] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-30T19:11:13.202608] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-30T19:11:13.241873] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-30T19:11:13.243147] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-30T19:11:13.249015] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-30T19:11:13.251113] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-30T19:11:13.269374] [DEBUG] [LOCAL ] HIO: Trimmed 37094 records to 23693 (keeping 200 days of data) [2025-09-30T19:11:13.272524] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-30T19:11:13.644940] [DEBUG] [LOCAL ] HIW: Primary data saved (44523 records). [2025-09-30T19:11:13.651063] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-30T19:11:13.651605] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIW took 25.0s. Estimated remaining: 2h 53m 8s. Rate: 7.8 symbols/min [2025-09-30T19:11:13.884630] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:13.936801] [DEBUG] [LOCAL ] HKD: Loaded 18306 existing records from primary storage. [2025-09-30T19:11:13.943218] [INFO ] [MAIN ] HKD: Loaded 18306 existing records. [2025-09-30T19:11:13.947946] [DEBUG] [LOCAL ] HIO: Primary data saved (23693 records). [2025-09-30T19:11:14.001379] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-30T19:11:14.050533] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIO took 43.7s. Estimated remaining: 2h 52m 51s. Rate: 7.8 symbols/min [2025-09-30T19:11:14.204017] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:11:14.270470] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-30T19:11:14.371823] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:14.394200] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-30T19:11:14.419290] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-30T19:11:14.434917] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-30T19:11:14.452853] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-30T19:11:14.457066] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:14.582817] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-30T19:11:14.588959] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-30T19:11:14.605022] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIMS took 45.5s. Estimated remaining: 2h 52m 34s. Rate: 7.8 symbols/min [2025-09-30T19:11:15.065955] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-30T19:11:15.108556] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:15.112264] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:15.112803] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-30T19:11:15.116195] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-09-30T19:11:15.349927] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:15.366041] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-30T19:11:15.367810] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-30T19:11:15.374633] [DEBUG] [LOCAL ] HLF: Loaded 48569 existing records from primary storage. [2025-09-30T19:11:15.374796] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-30T19:11:15.379137] [INFO ] [MAIN ] HLF: Loaded 48569 existing records. [2025-09-30T19:11:15.413944] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-30T19:11:15.428961] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:11:15.523394] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-30T19:11:15.738443] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:15.767439] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-30T19:11:15.774432] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-30T19:11:15.849329] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-30T19:11:15.863318] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-30T19:11:16.212923] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:16.267301] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-30T19:11:16.462500] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:16.471072] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-30T19:11:16.473712] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T19:11:16.696122] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T19:11:17.054400] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-30T19:11:17.854399] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-30T19:11:17.954004] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:11:18.243100] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T19:11:18.287547] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:11:18.654353] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-30T19:11:19.049112] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:11:19.454402] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-30T19:11:20.052324] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:11:20.254409] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-30T19:11:20.474759] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:11:21.054383] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-30T19:11:21.854380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-30T19:11:21.991616] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:11:22.253349] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:11:22.654419] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-30T19:11:23.104204] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T19:11:23.454367] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-30T19:11:24.254335] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-30T19:11:24.295715] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:11:25.054343] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-30T19:11:25.392236] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T19:11:25.431680] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:11:25.854370] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-30T19:11:26.173905] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T19:11:26.654357] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-30T19:11:26.835824] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:11:27.454387] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-30T19:11:28.254374] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-30T19:11:28.381130] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:11:28.603682] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:11:29.054339] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-30T19:11:29.114498] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T19:11:29.854398] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-30T19:11:30.624259] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:11:30.654347] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-30T19:11:30.912102] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T19:11:31.454421] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-30T19:11:32.254390] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-30T19:11:32.320576] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:11:32.537836] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:11:32.542594] [INFO ] [REMOTE ] HIX: Full fetch complete (30697 records). [2025-09-30T19:11:32.542795] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-30T19:11:32.965177] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-30T19:11:32.965288] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-30T19:11:32.965999] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-30T19:11:32.966089] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-30T19:11:32.967111] [DEBUG] [LOCAL ] HIX: Trimmed 30697 records to 20593 (keeping 200 days of data) [2025-09-30T19:11:33.060785] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-30T19:11:33.113175] [DEBUG] [LOCAL ] HIX: Primary data saved (20593 records). [2025-09-30T19:11:33.113338] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-30T19:11:33.113438] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 23.0s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min [2025-09-30T19:11:33.306888] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:33.343249] [DEBUG] [LOCAL ] HLI: Loaded 30942 existing records from primary storage. [2025-09-30T19:11:33.343542] [INFO ] [MAIN ] HLI: Loaded 30942 existing records. [2025-09-30T19:11:33.532461] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:33.532761] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-30T19:11:33.532852] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-30T19:11:33.533116] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-30T19:11:33.533194] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-30T19:11:33.857464] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-30T19:11:33.938121] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:34.089183] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:11:34.184534] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:11:34.654362] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-30T19:11:35.425091] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:11:35.454362] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-30T19:11:36.254412] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-30T19:11:36.570752] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:11:37.054393] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-30T19:11:37.213950] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:11:37.224843] [INFO ] [REMOTE ] HLF: Full fetch complete (71249 records). [2025-09-30T19:11:37.224999] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-30T19:11:37.453214] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:11:37.697618] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-30T19:11:37.697766] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-30T19:11:37.698760] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-30T19:11:37.698832] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-30T19:11:37.700326] [DEBUG] [LOCAL ] HLF: Trimmed 71249 records to 48536 (keeping 200 days of data) [2025-09-30T19:11:37.865481] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-30T19:11:37.997579] [DEBUG] [LOCAL ] HLF: Primary data saved (48536 records). [2025-09-30T19:11:37.997757] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-30T19:11:37.997863] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HLF took 23.4s. Estimated remaining: 2h 52m 29s. Rate: 7.8 symbols/min [2025-09-30T19:11:38.186981] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:38.216829] [DEBUG] [LOCAL ] HLIO: Loaded 27930 existing records from primary storage. [2025-09-30T19:11:38.217121] [INFO ] [MAIN ] HLIO: Loaded 27930 existing records. [2025-09-30T19:11:38.415333] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:38.415620] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-30T19:11:38.415706] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-30T19:11:38.416124] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-30T19:11:38.416184] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-30T19:11:38.659554] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-30T19:11:38.818075] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:38.996850] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:11:39.313850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:11:39.454404] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-30T19:11:39.502000] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T19:11:40.254366] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-30T19:11:40.834116] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:11:41.054355] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-30T19:11:41.221706] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:11:41.759894] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T19:11:41.854380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-30T19:11:42.654409] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-30T19:11:43.185270] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T19:11:43.191060] [INFO ] [REMOTE ] HKD: Full fetch complete (28523 records). [2025-09-30T19:11:43.191193] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-30T19:11:43.462504] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-30T19:11:43.604504] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-30T19:11:43.604581] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-30T19:11:43.605240] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-30T19:11:43.605304] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-30T19:11:43.606085] [DEBUG] [LOCAL ] HKD: Trimmed 28523 records to 18365 (keeping 200 days of data) [2025-09-30T19:11:43.727769] [DEBUG] [LOCAL ] HKD: Primary data saved (18365 records). [2025-09-30T19:11:43.728004] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-30T19:11:43.728164] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HKD took 30.1s. Estimated remaining: 2h 52m 19s. Rate: 7.8 symbols/min [2025-09-30T19:11:43.912749] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:43.955742] [DEBUG] [LOCAL ] HLLY: Loaded 33226 existing records from primary storage. [2025-09-30T19:11:43.956132] [INFO ] [MAIN ] HLLY: Loaded 33226 existing records. [2025-09-30T19:11:44.148333] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:44.148845] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-30T19:11:44.148969] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-30T19:11:44.157543] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-30T19:11:44.173049] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-30T19:11:44.175324] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:11:44.257330] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-30T19:11:44.572001] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:45.054383] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-30T19:11:45.659809] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-30T19:11:45.854345] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-30T19:11:45.933604] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:11:46.140151] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:11:46.654401] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-30T19:11:47.454332] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-30T19:11:47.641572] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:11:47.714209] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:11:48.254381] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-30T19:11:48.859239] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T19:11:49.054330] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-30T19:11:49.195387] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T19:11:49.854377] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-30T19:11:50.654339] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-30T19:11:50.944497] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:11:51.203501] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-30T19:11:51.335998] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:11:51.454395] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-30T19:11:52.254408] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-30T19:11:53.054383] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-30T19:11:53.324212] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:11:53.522266] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:11:53.854384] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-30T19:11:53.965781] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:11:54.654357] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-30T19:11:55.149560] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:11:55.454357] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-30T19:11:56.042755] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:11:56.254383] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-30T19:11:56.999739] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T19:11:57.054347] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-30T19:11:57.538511] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:11:57.854356] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-30T19:11:58.096374] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T19:11:58.654367] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-30T19:11:59.454339] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-30T19:11:59.933931] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T19:11:59.946085] [INFO ] [REMOTE ] HL: Full fetch complete (77655 records). [2025-09-30T19:11:59.946242] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-30T19:12:00.298314] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:12:00.276436] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-30T19:12:00.411193] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-30T19:12:00.411276] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-30T19:12:00.412308] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-30T19:12:00.412377] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-30T19:12:00.413904] [DEBUG] [LOCAL ] HL: Trimmed 77655 records to 53671 (keeping 200 days of data) [2025-09-30T19:12:00.763306] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-09-30T19:12:00.763461] [INFO ] [MAIN ] HL: Full history saved. [2025-09-30T19:12:00.764173] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 46.7s. Estimated remaining: 2h 52m 23s. Rate: 7.8 symbols/min [2025-09-30T19:12:00.957547] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:01.025573] [DEBUG] [LOCAL ] HLN: Loaded 53085 existing records from primary storage. [2025-09-30T19:12:01.025937] [INFO ] [MAIN ] HLN: Loaded 53085 existing records. [2025-09-30T19:12:01.065476] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-30T19:12:01.243847] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:01.244258] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-30T19:12:01.244347] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-30T19:12:01.261178] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-30T19:12:01.263512] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-30T19:12:01.331710] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:12:01.697414] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:01.716807] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:12:01.854358] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-30T19:12:02.445469] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:12:02.654362] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-30T19:12:03.178821] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T19:12:03.186809] [INFO ] [REMOTE ] HLI: Full fetch complete (45369 records). [2025-09-30T19:12:03.186964] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-30T19:12:03.459528] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-30T19:12:03.644860] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-30T19:12:03.644961] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-30T19:12:03.645803] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-30T19:12:03.645872] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-30T19:12:03.647081] [DEBUG] [LOCAL ] HLI: Trimmed 45369 records to 30960 (keeping 200 days of data) [2025-09-30T19:12:03.944009] [DEBUG] [LOCAL ] HLI: Primary data saved (30960 records). [2025-09-30T19:12:03.944292] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-30T19:12:03.944432] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 30.8s. Estimated remaining: 2h 52m 10s. Rate: 7.8 symbols/min [2025-09-30T19:12:04.256304] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-30T19:12:04.256208] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:04.316167] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:12:04.390184] [DEBUG] [LOCAL ] HLT: Loaded 50632 existing records from primary storage. [2025-09-30T19:12:04.390681] [INFO ] [MAIN ] HLT: Loaded 50632 existing records. [2025-09-30T19:12:04.697780] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:04.698636] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-30T19:12:04.698947] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-30T19:12:04.706343] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-30T19:12:04.718592] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-30T19:12:04.725631] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:12:05.056953] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-30T19:12:05.165070] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:05.367502] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:12:05.854375] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-30T19:12:06.654405] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-30T19:12:06.836723] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T19:12:07.455934] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-30T19:12:07.463173] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:12:07.574882] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:12:08.254364] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-30T19:12:08.703035] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:12:08.707846] [INFO ] [REMOTE ] HLIO: Full fetch complete (36212 records). [2025-09-30T19:12:08.707961] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-30T19:12:09.066819] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-30T19:12:09.122551] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-30T19:12:09.122688] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-30T19:12:09.123526] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-30T19:12:09.123596] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-30T19:12:09.126041] [DEBUG] [LOCAL ] HLIO: Trimmed 36212 records to 27935 (keeping 200 days of data) [2025-09-30T19:12:09.317395] [DEBUG] [LOCAL ] HLIO: Primary data saved (27935 records). [2025-09-30T19:12:09.322720] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-30T19:12:09.333712] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 31.3s. Estimated remaining: 2h 51m 59s. Rate: 7.8 symbols/min [2025-09-30T19:12:09.410036] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:12:09.543693] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:09.591446] [DEBUG] [LOCAL ] HLX: Loaded 47869 existing records from primary storage. [2025-09-30T19:12:09.591799] [INFO ] [MAIN ] HLX: Loaded 47869 existing records. [2025-09-30T19:12:09.786866] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:09.787134] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-30T19:12:09.787201] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-30T19:12:09.788257] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-30T19:12:09.788331] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-30T19:12:09.859505] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-30T19:12:10.223890] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:10.654393] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-30T19:12:10.883834] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:12:11.011123] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T19:12:11.019442] [INFO ] [REMOTE ] HLLY: Full fetch complete (46049 records). [2025-09-30T19:12:11.019622] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-30T19:12:11.416602] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-30T19:12:11.416720] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-30T19:12:11.417534] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-30T19:12:11.417598] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-30T19:12:11.418794] [DEBUG] [LOCAL ] HLLY: Trimmed 46049 records to 33120 (keeping 200 days of data) [2025-09-30T19:12:11.468800] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-30T19:12:11.614482] [DEBUG] [LOCAL ] HLLY: Primary data saved (33120 records). [2025-09-30T19:12:11.614666] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-30T19:12:11.614771] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 27.9s. Estimated remaining: 2h 51m 44s. Rate: 7.8 symbols/min [2025-09-30T19:12:11.792004] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:11.842947] [DEBUG] [LOCAL ] HMC: Loaded 46704 existing records from primary storage. [2025-09-30T19:12:11.843281] [INFO ] [MAIN ] HMC: Loaded 46704 existing records. [2025-09-30T19:12:12.044145] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:12.044489] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-30T19:12:12.044544] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-30T19:12:12.045633] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-30T19:12:12.045764] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-30T19:12:12.276969] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-30T19:12:12.385334] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:12:12.482800] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:13.054361] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-30T19:12:13.229299] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:12:13.854376] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-30T19:12:14.031449] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T19:12:14.654380] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-30T19:12:14.856556] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:12:15.416693] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:12:15.454387] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-30T19:12:16.254342] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-30T19:12:16.332389] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T19:12:17.054323] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-30T19:12:17.456486] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T19:12:17.854381] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-30T19:12:18.098091] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:12:18.654361] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-30T19:12:19.047402] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:12:19.127220] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:12:19.454379] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-30T19:12:20.254370] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-30T19:12:20.390677] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T19:12:21.061760] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-30T19:12:21.067250] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:12:21.854316] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-30T19:12:21.925965] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:12:22.654333] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-30T19:12:22.856566] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T19:12:23.310837] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:12:23.454365] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-30T19:12:24.254349] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-30T19:12:24.424078] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:12:25.054369] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-30T19:12:25.264100] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:12:25.723425] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:12:25.854374] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-30T19:12:26.488844] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T19:12:26.654387] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-30T19:12:27.454425] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-30T19:12:27.680024] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:12:28.254382] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-30T19:12:28.303854] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T19:12:28.990331] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:12:29.054362] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-30T19:12:29.595886] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:12:29.854366] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-30T19:12:30.367749] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:12:30.654368] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-30T19:12:31.454343] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-30T19:12:31.818667] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:12:31.831915] [INFO ] [REMOTE ] HLN: Full fetch complete (76778 records). [2025-09-30T19:12:31.832108] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-30T19:12:32.263737] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-30T19:12:32.267842] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-30T19:12:32.267945] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-30T19:12:32.269099] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-30T19:12:32.270196] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-30T19:12:32.272085] [DEBUG] [LOCAL ] HLN: Trimmed 76778 records to 53083 (keeping 200 days of data) [2025-09-30T19:12:32.429333] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:12:32.677498] [DEBUG] [LOCAL ] HLN: Primary data saved (53083 records). [2025-09-30T19:12:32.677683] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-30T19:12:32.678469] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 31.9s. Estimated remaining: 2h 51m 54s. Rate: 7.8 symbols/min [2025-09-30T19:12:32.865550] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:32.890732] [DEBUG] [LOCAL ] HMN: Loaded 23360 existing records from primary storage. [2025-09-30T19:12:32.891072] [INFO ] [MAIN ] HMN: Loaded 23360 existing records. [2025-09-30T19:12:33.059955] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-30T19:12:33.096871] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:33.098616] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-30T19:12:33.098817] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-30T19:12:33.100824] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-30T19:12:33.100892] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-30T19:12:33.428506] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:12:33.566438] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:33.854342] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-30T19:12:34.056008] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:12:34.654399] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-30T19:12:34.858934] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T19:12:35.429117] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:12:35.439804] [INFO ] [REMOTE ] HLT: Full fetch complete (73418 records). [2025-09-30T19:12:35.439958] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-30T19:12:35.462159] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-30T19:12:35.803623] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:12:35.900222] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-30T19:12:35.900336] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-30T19:12:35.901351] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-30T19:12:35.901418] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-30T19:12:35.902934] [DEBUG] [LOCAL ] HLT: Trimmed 73418 records to 50626 (keeping 200 days of data) [2025-09-30T19:12:36.244665] [DEBUG] [LOCAL ] HLT: Primary data saved (50626 records). [2025-09-30T19:12:36.244835] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-30T19:12:36.244947] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 32.3s. Estimated remaining: 2h 51m 41s. Rate: 7.8 symbols/min [2025-09-30T19:12:36.259503] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-30T19:12:36.428438] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:36.484304] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-30T19:12:36.484676] [INFO ] [MAIN ] HMY: Loaded 53136 existing records. [2025-09-30T19:12:36.669668] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:36.669927] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-30T19:12:36.670030] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-30T19:12:36.672178] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-30T19:12:36.672240] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-30T19:12:37.054911] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-30T19:12:37.054791] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:37.280329] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:12:37.290201] [INFO ] [REMOTE ] HLX: Full fetch complete (69198 records). [2025-09-30T19:12:37.290369] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-30T19:12:37.418913] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:12:37.742993] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-30T19:12:37.743086] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-30T19:12:37.743996] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-30T19:12:37.744079] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-30T19:12:37.745550] [DEBUG] [LOCAL ] HLX: Trimmed 69198 records to 47823 (keeping 200 days of data) [2025-09-30T19:12:37.854525] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-30T19:12:38.036801] [DEBUG] [LOCAL ] HLX: Primary data saved (47823 records). [2025-09-30T19:12:38.036944] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-30T19:12:38.037028] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 28.7s. Estimated remaining: 2h 51m 25s. Rate: 7.8 symbols/min [2025-09-30T19:12:38.224744] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:38.224951] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-30T19:12:38.224999] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-30T19:12:38.225111] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-30T19:12:38.225155] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-30T19:12:38.225198] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-30T19:12:38.225233] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-30T19:12:38.640560] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:38.654332] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-30T19:12:38.707222] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:12:38.866225] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:12:38.877669] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:12:38.877922] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-30T19:12:38.878014] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:12:38.878117] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-30T19:12:38.878216] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:12:38.878291] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-30T19:12:38.878356] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-30T19:12:38.878393] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-30T19:12:38.878455] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-30T19:12:38.878524] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HNGE took 0.8s. Estimated remaining: 2h 51m 9s. Rate: 7.8 symbols/min [2025-09-30T19:12:39.069929] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:39.101801] [DEBUG] [LOCAL ] HNI: Loaded 29037 existing records from primary storage. [2025-09-30T19:12:39.102086] [INFO ] [MAIN ] HNI: Loaded 29037 existing records. [2025-09-30T19:12:39.293900] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:39.294163] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-30T19:12:39.294213] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-30T19:12:39.296220] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-30T19:12:39.296285] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-30T19:12:39.459463] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-30T19:12:39.687164] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:40.254408] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-30T19:12:40.526456] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:12:41.054376] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-30T19:12:41.085060] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T19:12:41.854372] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-30T19:12:42.654378] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-30T19:12:42.944391] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:12:43.004134] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T19:12:43.454396] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-30T19:12:44.254330] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-30T19:12:44.291109] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:12:44.631378] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:12:45.054366] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-30T19:12:45.854399] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-30T19:12:45.987680] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T19:12:46.019512] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:12:46.654339] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-30T19:12:47.153364] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:12:47.454351] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-30T19:12:47.902886] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T19:12:48.254388] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-30T19:12:48.525040] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:12:49.054369] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-30T19:12:49.500623] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T19:12:49.854359] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-30T19:12:49.900115] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T19:12:50.654383] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-30T19:12:51.454426] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-30T19:12:51.642930] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:12:52.254341] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-30T19:12:52.422856] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T19:12:52.584763] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T19:12:53.054387] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-30T19:12:53.854335] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-30T19:12:53.894740] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:12:54.162117] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T19:12:54.654398] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-30T19:12:55.454338] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-30T19:12:55.665153] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T19:12:56.254371] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-30T19:12:56.361991] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:12:56.469541] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:12:56.481674] [INFO ] [REMOTE ] HMC: Full fetch complete (69483 records). [2025-09-30T19:12:56.481910] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-30T19:12:56.994501] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-30T19:12:56.994610] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-30T19:12:56.995782] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-30T19:12:56.995881] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-30T19:12:56.997544] [DEBUG] [LOCAL ] HMC: Trimmed 69483 records to 46717 (keeping 200 days of data) [2025-09-30T19:12:57.068024] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-30T19:12:57.447171] [DEBUG] [LOCAL ] HMC: Primary data saved (46717 records). [2025-09-30T19:12:57.447355] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-30T19:12:57.447577] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 45.8s. Estimated remaining: 2h 51m 15s. Rate: 7.8 symbols/min [2025-09-30T19:12:57.675431] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:57.731340] [DEBUG] [LOCAL ] HOG: Loaded 51157 existing records from primary storage. [2025-09-30T19:12:57.731736] [INFO ] [MAIN ] HOG: Loaded 51157 existing records. [2025-09-30T19:12:57.858009] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-30T19:12:57.959387] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:57.960556] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-30T19:12:57.960702] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-30T19:12:57.962688] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-30T19:12:57.962770] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-30T19:12:58.358186] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:12:58.356505] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:58.453433] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T19:12:58.654384] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-30T19:12:59.014011] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T19:12:59.021173] [INFO ] [REMOTE ] HMN: Full fetch complete (31606 records). [2025-09-30T19:12:59.021367] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-30T19:12:59.439905] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-30T19:12:59.439982] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-30T19:12:59.440579] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-30T19:12:59.440661] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-30T19:12:59.441501] [DEBUG] [LOCAL ] HMN: Trimmed 31606 records to 23372 (keeping 200 days of data) [2025-09-30T19:12:59.496982] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-30T19:12:59.595750] [DEBUG] [LOCAL ] HMN: Primary data saved (23372 records). [2025-09-30T19:12:59.595919] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-30T19:12:59.596072] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMN took 26.9s. Estimated remaining: 2h 51m 0s. Rate: 7.8 symbols/min [2025-09-30T19:13:00.254335] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-30T19:13:00.302241] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:13:01.054362] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-30T19:13:01.260443] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:13:01.861379] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-30T19:13:01.882470] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:13:02.504707] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:13:02.654365] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-30T19:13:03.454378] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-30T19:13:03.944287] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T19:13:04.048095] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:13:04.254363] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-30T19:13:04.950404] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:13:04.959396] [INFO ] [REMOTE ] HNI: Full fetch complete (41677 records). [2025-09-30T19:13:04.959515] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-30T19:13:05.059468] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-30T19:13:05.380196] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-30T19:13:05.380326] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-30T19:13:05.381131] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-30T19:13:05.381208] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-30T19:13:05.382191] [DEBUG] [LOCAL ] HNI: Trimmed 41677 records to 29190 (keeping 200 days of data) [2025-09-30T19:13:05.574437] [DEBUG] [LOCAL ] HNI: Primary data saved (29190 records). [2025-09-30T19:13:05.574563] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-30T19:13:05.574691] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 26.7s. Estimated remaining: 2h 50m 50s. Rate: 7.8 symbols/min [2025-09-30T19:13:06.076306] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:13:06.087716] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-30T19:13:06.699072] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:13:06.711043] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-30T19:13:07.951688] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:13:07.963631] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-30T19:13:08.710571] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:13:08.726305] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-30T19:13:09.749123] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:13:09.761173] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-30T19:13:10.929769] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:13:10.941593] [INFO ] [REMOTE ] HMY: Full fetch complete (76690 records). [2025-09-30T19:13:10.941812] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-30T19:13:11.400456] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-30T19:13:11.400592] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-30T19:13:11.401771] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-30T19:13:11.401867] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-30T19:13:11.413632] [DEBUG] [LOCAL ] HMY: Trimmed 76690 records to 53136 (keeping 200 days of data) [2025-09-30T19:13:11.433030] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:13:11.443805] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-30T19:13:11.790518] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-30T19:13:11.790742] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-30T19:13:11.790910] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HMY took 35.5s. Estimated remaining: 2h 50m 41s. Rate: 7.8 symbols/min [2025-09-30T19:13:13.404784] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:13:13.416368] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-30T19:13:15.186547] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:13:15.198830] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-30T19:13:17.089317] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:13:17.100572] [INFO ] [REMOTE ] HOG: Full fetch complete (74210 records). [2025-09-30T19:13:17.100820] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-30T19:13:17.516965] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-30T19:13:17.517078] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-30T19:13:17.518604] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-30T19:13:17.518703] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-30T19:13:17.520428] [DEBUG] [LOCAL ] HOG: Trimmed 74210 records to 51137 (keeping 200 days of data) [2025-09-30T19:13:17.858183] [DEBUG] [LOCAL ] HOG: Primary data saved (51137 records). [2025-09-30T19:13:17.858353] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-30T19:13:17.858477] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 20.4s. Estimated remaining: 2h 50m 31s. Rate: 7.8 symbols/min [2025-09-30T19:13:18.559800] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.563746] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.571724] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.700982] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.714942] [DEBUG] [LOCAL ] HOV: Loaded 13801 existing records from primary storage. [2025-09-30T19:13:18.715346] [INFO ] [MAIN ] HOV: Loaded 13801 existing records. [2025-09-30T19:13:18.888296] [DEBUG] [LOCAL ] HOMB: Loaded 43516 existing records from primary storage. [2025-09-30T19:13:18.913215] [INFO ] [MAIN ] HOMB: Loaded 43516 existing records. [2025-09-30T19:13:19.028126] [DEBUG] [LOCAL ] HOUS: Loaded 44315 existing records from primary storage. [2025-09-30T19:13:19.056743] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.062508] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.073227] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-30T19:13:19.073698] [INFO ] [MAIN ] HOUS: Loaded 44315 existing records. [2025-09-30T19:13:19.079331] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-30T19:13:19.185401] [DEBUG] [LOCAL ] HP: Loaded 51572 existing records from primary storage. [2025-09-30T19:13:19.155113] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-30T19:13:19.263164] [INFO ] [MAIN ] HP: Loaded 51572 existing records. [2025-09-30T19:13:19.487818] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.593772] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.671863] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-30T19:13:19.721347] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-30T19:13:19.762014] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-30T19:13:19.725631] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.917852] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.964183] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.893865] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.985856] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-30T19:13:19.968367] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-30T19:13:20.038898] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-30T19:13:20.033722] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-30T19:13:20.059777] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-30T19:13:20.096864] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-30T19:13:20.683789] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:20.793443] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-30T19:13:21.067835] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.122820] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-30T19:13:21.319888] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.341351] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-30T19:13:21.341086] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.341633] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-30T19:13:21.804299] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:13:21.808300] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-30T19:13:22.622927] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T19:13:22.626127] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-30T19:13:22.686009] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:13:22.695296] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-30T19:13:22.772685] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:13:22.784128] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-30T19:13:22.810156] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:13:22.819877] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-30T19:13:23.139431] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T19:13:23.142273] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-30T19:13:24.024299] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:13:24.027808] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-30T19:13:24.090349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:13:24.121432] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:13:24.120069] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-30T19:13:24.131576] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-30T19:13:24.364622] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:13:24.375386] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-30T19:13:24.948356] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T19:13:24.951741] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-30T19:13:25.601730] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T19:13:25.612002] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-30T19:13:25.638806] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:13:25.647794] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-30T19:13:25.703783] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:13:25.753212] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T19:13:25.854346] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-30T19:13:26.654344] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-30T19:13:26.703312] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T19:13:27.081106] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:13:27.309305] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:13:27.454374] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-30T19:13:28.254376] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-30T19:13:28.311536] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:13:28.511980] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:13:29.054373] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-30T19:13:29.278980] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T19:13:29.854396] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-30T19:13:30.541230] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:13:30.654386] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-30T19:13:31.454375] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-30T19:13:31.525970] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:13:32.096387] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:13:32.135400] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T19:13:32.254409] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-30T19:13:33.054369] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-30T19:13:33.854355] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-30T19:13:34.005934] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:13:34.050977] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T19:13:34.054581] [INFO ] [REMOTE ] HOV: Full fetch complete (19377 records). [2025-09-30T19:13:34.054723] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-30T19:13:34.432028] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-30T19:13:34.432119] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-30T19:13:34.432594] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-30T19:13:34.432680] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-30T19:13:34.433285] [DEBUG] [LOCAL ] HOV: Trimmed 19377 records to 13796 (keeping 200 days of data) [2025-09-30T19:13:34.524606] [DEBUG] [LOCAL ] HOV: Primary data saved (13796 records). [2025-09-30T19:13:34.524777] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-30T19:13:34.524888] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 16.7s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-09-30T19:13:34.669896] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-30T19:13:34.706737] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:34.762847] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-30T19:13:34.763221] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-30T19:13:34.948896] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:34.949149] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-30T19:13:34.949196] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-30T19:13:34.949791] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-30T19:13:34.949896] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-30T19:13:35.330779] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:35.454363] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-30T19:13:35.600868] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:13:36.125035] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:13:36.254374] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-30T19:13:37.059503] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-30T19:13:37.074385] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T19:13:37.841893] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:13:37.854316] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-30T19:13:38.654325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-30T19:13:39.121990] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-30T19:13:39.164863] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:13:39.454367] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-30T19:13:40.240663] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:13:40.254314] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-30T19:13:41.054350] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-30T19:13:41.336683] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:13:41.854356] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-30T19:13:42.036932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T19:13:42.047743] [INFO ] [REMOTE ] HOUS: Full fetch complete (63288 records). [2025-09-30T19:13:42.047945] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-30T19:13:42.466229] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-30T19:13:42.466337] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-30T19:13:42.467532] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-30T19:13:42.467618] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-30T19:13:42.469406] [DEBUG] [LOCAL ] HOUS: Trimmed 63288 records to 44419 (keeping 200 days of data) [2025-09-30T19:13:42.564211] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T19:13:42.679222] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-30T19:13:42.782059] [DEBUG] [LOCAL ] HOUS: Primary data saved (44419 records). [2025-09-30T19:13:42.782211] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-30T19:13:42.784004] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 24.9s. Estimated remaining: 2h 50m 28s. Rate: 7.8 symbols/min [2025-09-30T19:13:42.965195] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:42.976301] [DEBUG] [LOCAL ] HPF: Loaded 7335 existing records from primary storage. [2025-09-30T19:13:42.976516] [INFO ] [MAIN ] HPF: Loaded 7335 existing records. [2025-09-30T19:13:43.165374] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:43.165565] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-30T19:13:43.165612] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-30T19:13:43.165935] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-30T19:13:43.165994] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-30T19:13:43.459037] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-30T19:13:43.559114] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:43.627858] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:13:44.254323] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-30T19:13:44.523869] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:13:44.607833] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:13:45.054386] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-30T19:13:45.854350] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-30T19:13:46.397184] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T19:13:46.416530] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-30T19:13:46.654349] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-30T19:13:46.739762] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:13:46.749572] [INFO ] [REMOTE ] HOMB: Full fetch complete (63935 records). [2025-09-30T19:13:46.749752] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-30T19:13:47.170108] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-30T19:13:47.170197] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-30T19:13:47.171128] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-30T19:13:47.171194] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-30T19:13:47.172666] [DEBUG] [LOCAL ] HOMB: Trimmed 63935 records to 43513 (keeping 200 days of data) [2025-09-30T19:13:47.428341] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:13:47.454569] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-30T19:13:47.486741] [DEBUG] [LOCAL ] HOMB: Primary data saved (43513 records). [2025-09-30T19:13:47.486863] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-30T19:13:47.488351] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOMB took 29.6s. Estimated remaining: 2h 50m 16s. Rate: 7.8 symbols/min [2025-09-30T19:13:47.669588] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:47.690934] [DEBUG] [LOCAL ] HPI: Loaded 10210 existing records from primary storage. [2025-09-30T19:13:47.691174] [INFO ] [MAIN ] HPI: Loaded 10210 existing records. [2025-09-30T19:13:47.889740] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:47.890037] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-30T19:13:47.890091] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-30T19:13:47.890348] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-30T19:13:47.890412] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-30T19:13:48.202982] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:13:48.259052] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-30T19:13:48.287702] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:49.054384] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-30T19:13:49.665198] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:13:49.854442] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-30T19:13:50.011559] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:13:50.654404] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-30T19:13:51.290863] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:13:51.454360] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-30T19:13:51.970513] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T19:13:52.146607] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:13:52.254393] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-30T19:13:53.003954] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T19:13:53.054395] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-30T19:13:53.788107] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T19:13:53.854365] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-30T19:13:54.654375] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-30T19:13:55.082485] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:13:55.454373] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-30T19:13:55.973616] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-30T19:13:56.046719] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-30T19:13:56.254405] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-30T19:13:57.008302] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:13:57.054343] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-30T19:13:57.624838] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T19:13:57.854421] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-30T19:13:58.654372] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-30T19:13:59.387957] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:13:59.454410] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-30T19:13:59.671860] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:13:59.683545] [INFO ] [REMOTE ] HP: Full fetch complete (73949 records). [2025-09-30T19:13:59.683780] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-30T19:14:00.076234] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T19:14:00.136474] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-30T19:14:00.136567] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-30T19:14:00.137690] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-30T19:14:00.137764] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-30T19:14:00.139398] [DEBUG] [LOCAL ] HP: Trimmed 73949 records to 51593 (keeping 200 days of data) [2025-09-30T19:14:00.257082] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-30T19:14:00.475971] [DEBUG] [LOCAL ] HP: Primary data saved (51593 records). [2025-09-30T19:14:00.476133] [INFO ] [MAIN ] HP: Full history saved. [2025-09-30T19:14:00.476225] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 42.6s. Estimated remaining: 2h 50m 15s. Rate: 7.8 symbols/min [2025-09-30T19:14:00.669668] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:00.729300] [DEBUG] [LOCAL ] HPP: Loaded 50872 existing records from primary storage. [2025-09-30T19:14:00.729675] [INFO ] [MAIN ] HPP: Loaded 50872 existing records. [2025-09-30T19:14:00.907397] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:14:00.951538] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:00.952101] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-30T19:14:00.952156] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-30T19:14:00.952554] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-30T19:14:00.952617] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-30T19:14:01.057580] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-30T19:14:01.352725] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:01.854341] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-30T19:14:02.008453] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:14:02.010976] [INFO ] [REMOTE ] HPF: Full fetch complete (10877 records). [2025-09-30T19:14:02.011052] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-30T19:14:02.438335] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-30T19:14:02.438430] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-30T19:14:02.438757] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-30T19:14:02.438822] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-30T19:14:02.439552] [DEBUG] [LOCAL ] HPF: Trimmed 10877 records to 7392 (keeping 200 days of data) [2025-09-30T19:14:02.489676] [DEBUG] [LOCAL ] HPF: Primary data saved (7392 records). [2025-09-30T19:14:02.489839] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-30T19:14:02.489931] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 19.7s. Estimated remaining: 2h 50m 1s. Rate: 7.8 symbols/min [2025-09-30T19:14:02.656713] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-30T19:14:02.678877] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:02.734976] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-30T19:14:02.735327] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-30T19:14:02.930090] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:02.930333] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-30T19:14:02.930382] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-30T19:14:02.930825] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-30T19:14:02.930889] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-30T19:14:03.329780] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:03.454336] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-30T19:14:03.488391] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T19:14:03.571874] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T19:14:04.254380] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-30T19:14:05.032385] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:14:05.054326] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-30T19:14:05.407327] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T19:14:05.854350] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-30T19:14:06.654351] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-30T19:14:06.736110] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:14:06.943419] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T19:14:07.454384] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-30T19:14:08.256859] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-30T19:14:08.273565] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T19:14:08.275532] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:14:08.291718] [INFO ] [REMOTE ] HPI: Full fetch complete (13763 records). [2025-09-30T19:14:08.292527] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-30T19:14:08.792874] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-30T19:14:08.793012] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-30T19:14:08.793402] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-30T19:14:08.793593] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-30T19:14:08.794353] [DEBUG] [LOCAL ] HPI: Trimmed 13763 records to 10334 (keeping 200 days of data) [2025-09-30T19:14:08.861366] [DEBUG] [LOCAL ] HPI: Primary data saved (10334 records). [2025-09-30T19:14:08.861516] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-30T19:14:08.861609] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 21.4s. Estimated remaining: 2h 49m 51s. Rate: 7.8 symbols/min [2025-09-30T19:14:09.051233] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:09.054316] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-30T19:14:09.064770] [DEBUG] [LOCAL ] HPS: Loaded 10187 existing records from primary storage. [2025-09-30T19:14:09.064979] [INFO ] [MAIN ] HPS: Loaded 10187 existing records. [2025-09-30T19:14:09.260151] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:09.260372] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-30T19:14:09.260423] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-30T19:14:09.260762] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-30T19:14:09.260823] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-30T19:14:09.670231] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:09.854334] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-30T19:14:10.283600] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T19:14:10.654338] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-30T19:14:10.858444] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T19:14:11.363046] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:14:11.454402] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-30T19:14:12.254407] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-30T19:14:12.423806] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:14:13.054407] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-30T19:14:13.241860] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:14:13.266286] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:14:13.854392] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-30T19:14:14.654400] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-30T19:14:15.260102] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T19:14:15.271591] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-30T19:14:15.271763] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-30T19:14:15.454608] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-30T19:14:15.455595] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T19:14:15.728214] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T19:14:15.762868] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-30T19:14:15.763125] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-30T19:14:15.764174] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-30T19:14:15.764263] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-30T19:14:15.766091] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-30T19:14:16.124327] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-30T19:14:16.124483] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-30T19:14:16.124567] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 41.6s. Estimated remaining: 2h 49m 43s. Rate: 7.8 symbols/min [2025-09-30T19:14:16.266934] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-30T19:14:16.302711] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:16.332260] [DEBUG] [LOCAL ] HQH: Loaded 25061 existing records from primary storage. [2025-09-30T19:14:16.332540] [INFO ] [MAIN ] HQH: Loaded 25061 existing records. [2025-09-30T19:14:16.521881] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:16.522141] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-30T19:14:16.522206] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-30T19:14:16.522535] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-30T19:14:16.522595] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-30T19:14:16.904547] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:17.054367] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-30T19:14:17.477001] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T19:14:17.854140] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:14:17.863707] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-30T19:14:17.896859] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:14:18.654368] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-30T19:14:19.454374] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-30T19:14:19.468789] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T19:14:19.729704] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T19:14:20.254361] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-30T19:14:20.739691] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:14:20.862398] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:14:21.054338] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-30T19:14:21.856927] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-30T19:14:21.857972] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T19:14:22.654419] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-30T19:14:23.056421] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:14:23.454375] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-30T19:14:24.254343] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-30T19:14:24.311596] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:14:24.574338] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:14:24.731233] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T19:14:25.054373] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-30T19:14:25.854333] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-30T19:14:26.147071] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:14:26.654405] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-30T19:14:26.703973] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:14:27.394822] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T19:14:27.454357] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-30T19:14:28.254369] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-30T19:14:29.054344] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-30T19:14:29.427933] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:14:29.477185] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:14:29.854395] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-30T19:14:30.654382] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-30T19:14:30.701517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:14:30.757460] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:14:30.760745] [INFO ] [REMOTE ] HPS: Full fetch complete (15243 records). [2025-09-30T19:14:30.760832] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-30T19:14:31.150432] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-30T19:14:31.150517] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-30T19:14:31.150919] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-30T19:14:31.150986] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-30T19:14:31.151726] [DEBUG] [LOCAL ] HPS: Trimmed 15243 records to 10167 (keeping 200 days of data) [2025-09-30T19:14:31.226000] [DEBUG] [LOCAL ] HPS: Primary data saved (10167 records). [2025-09-30T19:14:31.226187] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-30T19:14:31.226284] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPS took 22.4s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-09-30T19:14:31.459537] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-30T19:14:31.491933] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:31.521691] [DEBUG] [LOCAL ] HQL: Loaded 15953 existing records from primary storage. [2025-09-30T19:14:31.522376] [INFO ] [MAIN ] HQL: Loaded 15953 existing records. [2025-09-30T19:14:31.710520] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:31.710876] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-30T19:14:31.710943] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-30T19:14:31.711240] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-30T19:14:31.711302] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-30T19:14:32.088802] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:32.254398] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-30T19:14:32.578557] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T19:14:32.908081] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:14:33.054351] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-30T19:14:33.457608] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T19:14:33.854375] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-30T19:14:34.654386] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-30T19:14:34.932147] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:14:34.996158] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T19:14:35.454387] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-30T19:14:36.254429] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-30T19:14:36.471468] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:14:36.886043] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:14:37.054368] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-30T19:14:37.212159] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T19:14:37.854374] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-30T19:14:38.144086] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:14:38.654372] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-30T19:14:38.886925] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:14:39.454404] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-30T19:14:40.254327] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-30T19:14:40.429975] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T19:14:40.611827] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:14:40.624018] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-30T19:14:40.624243] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-30T19:14:41.065902] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-30T19:14:41.061739] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-30T19:14:41.066044] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-30T19:14:41.068780] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-30T19:14:41.069030] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-30T19:14:41.072705] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-30T19:14:41.437299] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-30T19:14:41.437460] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-30T19:14:41.437620] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 38.9s. Estimated remaining: 2h 49m 40s. Rate: 7.8 symbols/min [2025-09-30T19:14:41.656962] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:41.739993] [DEBUG] [LOCAL ] HR: Loaded 51953 existing records from primary storage. [2025-09-30T19:14:41.740538] [INFO ] [MAIN ] HR: Loaded 51953 existing records. [2025-09-30T19:14:41.856423] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-30T19:14:42.146905] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:42.152938] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:14:42.153161] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-30T19:14:42.159979] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-30T19:14:42.161785] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-30T19:14:42.161904] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-30T19:14:42.193952] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:14:42.312622] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-09-30T19:14:42.340189] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-30T19:14:42.664998] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-30T19:14:43.023242] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:43.154169] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-30T19:14:43.154324] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-30T19:14:43.172017] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:14:43.171304] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-30T19:14:43.178050] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-30T19:14:43.180028] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 50907 (keeping 200 days of data) [2025-09-30T19:14:43.455461] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-30T19:14:43.493240] [DEBUG] [LOCAL ] HPP: Primary data saved (50907 records). [2025-09-30T19:14:43.493404] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-30T19:14:43.493562] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPP took 43.0s. Estimated remaining: 2h 49m 25s. Rate: 7.8 symbols/min [2025-09-30T19:14:43.695167] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:43.696884] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:14:43.747255] [DEBUG] [LOCAL ] HRB: Loaded 48501 existing records from primary storage. [2025-09-30T19:14:43.747687] [INFO ] [MAIN ] HRB: Loaded 48501 existing records. [2025-09-30T19:14:43.934431] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:43.934701] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-30T19:14:43.934774] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-30T19:14:43.935172] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-30T19:14:43.935232] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-30T19:14:44.259494] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-30T19:14:44.330006] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:44.380081] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:14:44.385622] [INFO ] [REMOTE ] HQH: Full fetch complete (37450 records). [2025-09-30T19:14:44.385782] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-30T19:14:44.808572] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-30T19:14:44.808867] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-30T19:14:44.809577] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-30T19:14:44.809672] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-30T19:14:44.810761] [DEBUG] [LOCAL ] HQH: Trimmed 37450 records to 25151 (keeping 200 days of data) [2025-09-30T19:14:44.990318] [DEBUG] [LOCAL ] HQH: Primary data saved (25151 records). [2025-09-30T19:14:44.990551] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-30T19:14:44.990777] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQH took 28.9s. Estimated remaining: 2h 49m 10s. Rate: 7.8 symbols/min [2025-09-30T19:14:45.059545] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-30T19:14:45.191564] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:45.233286] [DEBUG] [LOCAL ] HRI: Loaded 32840 existing records from primary storage. [2025-09-30T19:14:45.233609] [INFO ] [MAIN ] HRI: Loaded 32840 existing records. [2025-09-30T19:14:45.422592] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:45.422848] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-30T19:14:45.422897] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-30T19:14:45.423217] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-30T19:14:45.423276] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-30T19:14:45.803708] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:45.854333] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-30T19:14:46.270115] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T19:14:46.622403] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:14:46.654322] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-30T19:14:46.866853] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T19:14:47.454389] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-30T19:14:48.180395] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:14:48.254328] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-30T19:14:48.777522] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:14:49.054409] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-30T19:14:49.804096] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:14:49.854397] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-30T19:14:50.281756] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:14:50.654346] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-30T19:14:50.727510] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T19:14:51.454358] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-30T19:14:52.254369] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-30T19:14:52.532191] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:14:53.007422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:14:53.054331] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-30T19:14:53.435563] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:14:53.854374] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-30T19:14:54.626045] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T19:14:54.654378] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-30T19:14:55.454377] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-30T19:14:55.640679] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:14:56.254411] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-30T19:14:56.560388] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:14:56.987411] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:14:57.054381] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-30T19:14:57.854348] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-30T19:14:57.947889] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:14:58.654423] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-30T19:14:58.696416] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:14:59.369593] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:14:59.427840] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:14:59.454353] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-30T19:15:00.254434] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-30T19:15:01.054413] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-30T19:15:01.344423] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T19:15:01.854351] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-30T19:15:01.907601] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:15:02.105560] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T19:15:02.654408] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-30T19:15:03.343391] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:15:03.454364] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-30T19:15:03.784014] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T19:15:03.788400] [INFO ] [REMOTE ] HQL: Full fetch complete (24652 records). [2025-09-30T19:15:03.788499] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-30T19:15:04.187009] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-30T19:15:04.187092] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-30T19:15:04.187670] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-30T19:15:04.187746] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-30T19:15:04.188480] [DEBUG] [LOCAL ] HQL: Trimmed 24652 records to 16097 (keeping 200 days of data) [2025-09-30T19:15:04.264590] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-30T19:15:04.301236] [DEBUG] [LOCAL ] HQL: Primary data saved (16097 records). [2025-09-30T19:15:04.301398] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-30T19:15:04.301555] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 33.1s. Estimated remaining: 2h 49m 17s. Rate: 7.8 symbols/min [2025-09-30T19:15:04.498948] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:04.559187] [DEBUG] [LOCAL ] HRL: Loaded 53074 existing records from primary storage. [2025-09-30T19:15:04.559584] [INFO ] [MAIN ] HRL: Loaded 53074 existing records. [2025-09-30T19:15:04.753562] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:04.753927] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-30T19:15:04.754008] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-30T19:15:04.754546] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-30T19:15:04.754606] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-30T19:15:05.056308] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-30T19:15:05.150452] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:05.182674] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:15:05.409513] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:15:05.854359] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-30T19:15:06.497813] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:15:06.654360] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-30T19:15:07.454342] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-30T19:15:07.569082] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:15:08.254371] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-30T19:15:08.323125] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:15:08.616307] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:15:09.054376] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-30T19:15:09.347030] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:15:09.854354] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-30T19:15:10.654369] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-30T19:15:10.933030] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T19:15:10.945057] [INFO ] [REMOTE ] HRB: Full fetch complete (69749 records). [2025-09-30T19:15:10.945225] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-30T19:15:11.291448] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:15:11.427148] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-30T19:15:11.427280] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-30T19:15:11.428402] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-30T19:15:11.428473] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-30T19:15:11.433171] [DEBUG] [LOCAL ] HRB: Trimmed 69749 records to 48466 (keeping 200 days of data) [2025-09-30T19:15:11.490100] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-30T19:15:11.755693] [DEBUG] [LOCAL ] HRB: Primary data saved (48466 records). [2025-09-30T19:15:11.755884] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-30T19:15:11.755992] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRB took 28.3s. Estimated remaining: 2h 49m 9s. Rate: 7.8 symbols/min [2025-09-30T19:15:11.952109] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:11.988825] [DEBUG] [LOCAL ] HRTG: Loaded 33324 existing records from primary storage. [2025-09-30T19:15:11.989114] [INFO ] [MAIN ] HRTG: Loaded 33324 existing records. [2025-09-30T19:15:12.190942] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:12.191296] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-30T19:15:12.191353] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-30T19:15:12.191694] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-30T19:15:12.191760] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-30T19:15:12.259493] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-30T19:15:12.598394] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:12.630353] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T19:15:12.659812] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:15:12.666877] [INFO ] [REMOTE ] HRI: Full fetch complete (46186 records). [2025-09-30T19:15:12.666984] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-30T19:15:13.064267] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-30T19:15:13.082331] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-30T19:15:13.083365] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-30T19:15:13.084370] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-30T19:15:13.084455] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-30T19:15:13.085621] [DEBUG] [LOCAL ] HRI: Trimmed 46186 records to 32784 (keeping 200 days of data) [2025-09-30T19:15:13.298089] [DEBUG] [LOCAL ] HRI: Primary data saved (32784 records). [2025-09-30T19:15:13.298249] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-30T19:15:13.298340] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 28.3s. Estimated remaining: 2h 48m 53s. Rate: 7.8 symbols/min [2025-09-30T19:15:13.481540] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:13.533047] [DEBUG] [LOCAL ] HSBC: Loaded 51077 existing records from primary storage. [2025-09-30T19:15:13.533361] [INFO ] [MAIN ] HSBC: Loaded 51077 existing records. [2025-09-30T19:15:13.729899] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:13.730160] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-30T19:15:13.730235] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-30T19:15:13.730921] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-30T19:15:13.731002] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-30T19:15:13.859275] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-30T19:15:14.302148] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:14.332164] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:15:14.654346] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-30T19:15:14.755936] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:15:15.185792] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:15:15.454362] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-30T19:15:16.254344] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-30T19:15:16.620697] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T19:15:16.638211] [INFO ] [REMOTE ] HR: Full fetch complete (74834 records). [2025-09-30T19:15:16.638424] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-30T19:15:17.073278] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-30T19:15:17.073027] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-30T19:15:17.073780] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-30T19:15:17.076470] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-30T19:15:17.076722] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-30T19:15:17.078704] [DEBUG] [LOCAL ] HR: Trimmed 74834 records to 51939 (keeping 200 days of data) [2025-09-30T19:15:17.210032] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T19:15:17.264499] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:15:17.509239] [DEBUG] [LOCAL ] HR: Primary data saved (51939 records). [2025-09-30T19:15:17.509409] [INFO ] [MAIN ] HR: Full history saved. [2025-09-30T19:15:17.509517] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HR took 36.1s. Estimated remaining: 2h 48m 41s. Rate: 7.8 symbols/min [2025-09-30T19:15:17.694610] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:17.712306] [DEBUG] [LOCAL ] HSHP: Loaded 15287 existing records from primary storage. [2025-09-30T19:15:17.712568] [INFO ] [MAIN ] HSHP: Loaded 15287 existing records. [2025-09-30T19:15:17.870732] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-30T19:15:17.919885] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:17.920113] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-30T19:15:17.920163] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-30T19:15:17.920412] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-30T19:15:17.920469] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-30T19:15:18.327457] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:18.654371] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-30T19:15:18.812507] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:15:19.007581] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:15:19.454370] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-30T19:15:20.254379] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-30T19:15:20.763774] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:15:20.947689] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T19:15:21.054384] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-30T19:15:21.473236] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:15:21.854377] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-30T19:15:22.488333] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:15:22.654416] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-30T19:15:23.454364] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-30T19:15:23.670232] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:15:24.186418] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:15:24.254379] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-30T19:15:24.902033] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:15:24.962537] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T19:15:25.054397] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-30T19:15:25.787362] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:15:25.854378] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-30T19:15:26.654421] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-30T19:15:26.926146] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:15:27.454397] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-30T19:15:28.254415] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-30T19:15:28.308611] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T19:15:29.027041] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:15:29.054326] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-30T19:15:29.634958] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:15:29.854375] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-30T19:15:30.599841] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:15:30.654328] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-30T19:15:30.740007] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T19:15:31.454374] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-30T19:15:32.254424] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-30T19:15:32.559462] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T19:15:33.054434] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-30T19:15:33.282503] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:15:33.663879] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:15:33.854417] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-30T19:15:34.654437] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-30T19:15:34.867465] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T19:15:34.913762] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:15:35.454405] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-30T19:15:36.254349] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-30T19:15:36.348716] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:15:37.054454] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-30T19:15:37.242840] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:15:37.255581] [INFO ] [REMOTE ] HRL: Full fetch complete (76678 records). [2025-09-30T19:15:37.255866] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-30T19:15:37.690246] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-30T19:15:37.690542] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-30T19:15:37.691997] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-30T19:15:37.692153] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-30T19:15:37.694222] [DEBUG] [LOCAL ] HRL: Trimmed 76678 records to 53075 (keeping 200 days of data) [2025-09-30T19:15:37.827914] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:15:37.846320] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T19:15:37.846434] [INFO ] [REMOTE ] HRTG: Full fetch complete (42754 records). [2025-09-30T19:15:37.851905] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-30T19:15:37.866399] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-30T19:15:38.292026] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-30T19:15:38.292606] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-30T19:15:38.293830] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-30T19:15:38.294560] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-30T19:15:38.298338] [DEBUG] [LOCAL ] HRTG: Trimmed 42754 records to 33359 (keeping 200 days of data) [2025-09-30T19:15:38.673609] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-30T19:15:38.725771] [DEBUG] [LOCAL ] HRTG: Primary data saved (33359 records). [2025-09-30T19:15:38.727019] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-30T19:15:38.727156] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 27.0s. Estimated remaining: 2h 48m 50s. Rate: 7.8 symbols/min [2025-09-30T19:15:38.942840] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:38.939049] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:15:38.953378] [DEBUG] [LOCAL ] HRL: Primary data saved (53075 records). [2025-09-30T19:15:38.953480] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-30T19:15:38.954499] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRL took 34.7s. Estimated remaining: 2h 48m 33s. Rate: 7.8 symbols/min [2025-09-30T19:15:39.151696] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:39.163157] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-30T19:15:39.163253] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-30T19:15:39.163406] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-30T19:15:39.163459] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-30T19:15:39.163557] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-30T19:15:39.163623] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-30T19:15:39.319012] [DEBUG] [LOCAL ] HSY: Loaded 50371 existing records from primary storage. [2025-09-30T19:15:39.344411] [INFO ] [MAIN ] HSY: Loaded 50371 existing records. [2025-09-30T19:15:39.484017] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-30T19:15:39.789925] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:39.804160] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:39.804332] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-30T19:15:39.804453] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-30T19:15:39.805189] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-30T19:15:39.805250] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-30T19:15:40.202769] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:40.254356] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-30T19:15:40.543569] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:15:40.601340] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:15:41.054376] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-30T19:15:41.673215] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:15:41.814417] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:15:41.854387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-30T19:15:42.654395] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-30T19:15:42.851576] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:15:42.851983] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-30T19:15:42.852067] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:15:42.852113] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-30T19:15:42.852147] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:15:42.852185] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-30T19:15:42.852240] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-30T19:15:42.852275] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-30T19:15:42.852337] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-30T19:15:42.852406] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HTB took 3.9s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-09-30T19:15:43.036461] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:43.058842] [DEBUG] [LOCAL ] HTD: Loaded 13657 existing records from primary storage. [2025-09-30T19:15:43.059157] [INFO ] [MAIN ] HTD: Loaded 13657 existing records. [2025-09-30T19:15:43.259367] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:43.259588] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-30T19:15:43.259668] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-30T19:15:43.259959] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-30T19:15:43.260023] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-30T19:15:43.462045] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-30T19:15:43.719891] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:43.758182] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:15:44.254406] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-30T19:15:45.054330] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-30T19:15:45.198979] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:15:45.854389] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-30T19:15:45.875962] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T19:15:46.109510] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:15:46.654424] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-30T19:15:47.454369] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-30T19:15:47.715039] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T19:15:47.753147] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T19:15:47.757530] [INFO ] [REMOTE ] HSHP: Full fetch complete (23470 records). [2025-09-30T19:15:47.757699] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-30T19:15:48.168450] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-30T19:15:48.168546] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-30T19:15:48.169166] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-30T19:15:48.169238] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-30T19:15:48.170863] [DEBUG] [LOCAL ] HSHP: Trimmed 23470 records to 15280 (keeping 200 days of data) [2025-09-30T19:15:48.254595] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-30T19:15:48.274306] [DEBUG] [LOCAL ] HSHP: Primary data saved (15280 records). [2025-09-30T19:15:48.274517] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-30T19:15:48.274614] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSHP took 30.8s. Estimated remaining: 2h 48m 10s. Rate: 7.8 symbols/min [2025-09-30T19:15:48.475373] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:48.475583] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-30T19:15:48.475665] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-30T19:15:48.475797] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-30T19:15:48.475842] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-30T19:15:48.475887] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-30T19:15:48.475922] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-30T19:15:48.903807] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:49.043896] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:15:49.054463] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-30T19:15:49.054818] [INFO ] [REMOTE ] HSBC: Full fetch complete (73694 records). [2025-09-30T19:15:49.055865] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-30T19:15:49.488210] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-30T19:15:49.488308] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-30T19:15:49.489378] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-30T19:15:49.489447] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-30T19:15:49.491018] [DEBUG] [LOCAL ] HSBC: Trimmed 73694 records to 51058 (keeping 200 days of data) [2025-09-30T19:15:49.821311] [DEBUG] [LOCAL ] HSBC: Primary data saved (51058 records). [2025-09-30T19:15:49.821482] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-30T19:15:49.821581] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSBC took 36.5s. Estimated remaining: 2h 47m 55s. Rate: 7.8 symbols/min [2025-09-30T19:15:49.859588] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-30T19:15:50.024211] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:50.029502] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:15:50.065337] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T19:15:50.115082] [DEBUG] [LOCAL ] HTGC: Loaded 47424 existing records from primary storage. [2025-09-30T19:15:50.115478] [INFO ] [MAIN ] HTGC: Loaded 47424 existing records. [2025-09-30T19:15:50.298367] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T19:15:50.321128] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:50.321364] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-30T19:15:50.321427] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-30T19:15:50.321823] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-30T19:15:50.321884] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-30T19:15:50.659509] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-30T19:15:50.754297] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:51.125170] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T19:15:51.454363] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-30T19:15:51.785214] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T19:15:52.254435] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-30T19:15:53.049993] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T19:15:53.054309] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-30T19:15:53.836199] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:15:53.854369] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-30T19:15:54.654392] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-30T19:15:54.994596] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T19:15:55.329063] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:15:55.454394] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-30T19:15:55.876604] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T19:15:56.254368] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-30T19:15:56.562948] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-30T19:15:57.054343] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-30T19:15:57.368846] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T19:15:57.854367] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-30T19:15:58.654400] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-30T19:15:59.454348] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-30T19:15:59.645379] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:15:59.700754] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-30T19:16:00.247589] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:16:00.258274] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-30T19:16:00.536999] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-30T19:16:01.054372] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-30T19:16:01.854381] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-30T19:16:01.908920] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:16:02.654356] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-30T19:16:03.454357] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-30T19:16:03.546861] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:16:04.207353] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:16:04.254352] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-30T19:16:04.370607] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T19:16:04.695531] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T19:16:04.696294] [INFO ] [REMOTE ] HTFC: Full fetch complete (835 records). [2025-09-30T19:16:04.696365] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-30T19:16:04.896408] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-30T19:16:04.896593] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:16:04.896666] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:16:04.896745] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-30T19:16:04.896813] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-30T19:16:04.896852] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-30T19:16:04.896921] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-30T19:16:04.897005] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 16.6s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-09-30T19:16:05.061889] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-30T19:16:05.083768] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:05.118836] [DEBUG] [LOCAL ] HTH: Loaded 32136 existing records from primary storage. [2025-09-30T19:16:05.119146] [INFO ] [MAIN ] HTH: Loaded 32136 existing records. [2025-09-30T19:16:05.318073] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:05.318316] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-30T19:16:05.318368] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-30T19:16:05.318762] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-30T19:16:05.318823] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-30T19:16:05.711039] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:05.854376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-30T19:16:06.654340] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-30T19:16:06.809200] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:16:07.105042] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T19:16:07.454371] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-30T19:16:08.254348] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-30T19:16:08.297476] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:16:08.981570] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:16:09.054388] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-30T19:16:09.235165] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:16:09.854378] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-30T19:16:10.252241] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:16:10.654364] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-30T19:16:11.454370] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-30T19:16:11.687580] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:16:11.688400] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T19:16:12.254382] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-30T19:16:12.664161] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:16:13.054546] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-30T19:16:13.117809] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:16:13.854411] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-30T19:16:14.654326] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-30T19:16:14.823473] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:16:14.883183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:16:14.887276] [INFO ] [REMOTE ] HTD: Full fetch complete (19053 records). [2025-09-30T19:16:14.887381] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-30T19:16:15.311875] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-30T19:16:15.311996] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-30T19:16:15.312471] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-30T19:16:15.312520] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-30T19:16:15.313369] [DEBUG] [LOCAL ] HTD: Trimmed 19053 records to 13765 (keeping 200 days of data) [2025-09-30T19:16:15.407303] [DEBUG] [LOCAL ] HTD: Primary data saved (13765 records). [2025-09-30T19:16:15.407491] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-30T19:16:15.407628] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTD took 32.6s. Estimated remaining: 2h 47m 52s. Rate: 7.8 symbols/min [2025-09-30T19:16:15.459573] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-30T19:16:15.606312] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:15.626284] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:16:15.678583] [DEBUG] [LOCAL ] HUBB: Loaded 36843 existing records from primary storage. [2025-09-30T19:16:15.678954] [INFO ] [MAIN ] HUBB: Loaded 36843 existing records. [2025-09-30T19:16:15.875433] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:15.875681] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-30T19:16:15.875741] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-30T19:16:15.876120] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-30T19:16:15.876182] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-30T19:16:16.259574] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-30T19:16:16.262805] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:17.054401] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-30T19:16:17.514555] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T19:16:17.526636] [INFO ] [REMOTE ] HSY: Full fetch complete (73703 records). [2025-09-30T19:16:17.526850] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-30T19:16:17.804202] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:16:17.855930] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-30T19:16:18.046862] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-30T19:16:18.046949] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-30T19:16:18.048031] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-30T19:16:18.048097] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-30T19:16:18.049525] [DEBUG] [LOCAL ] HSY: Trimmed 73703 records to 50351 (keeping 200 days of data) [2025-09-30T19:16:18.386325] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:16:18.415063] [DEBUG] [LOCAL ] HSY: Primary data saved (50351 records). [2025-09-30T19:16:18.415221] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-30T19:16:18.415319] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HSY took 39.7s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-09-30T19:16:18.609376] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:18.654348] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-30T19:16:18.656982] [DEBUG] [LOCAL ] HUBS: Loaded 39200 existing records from primary storage. [2025-09-30T19:16:18.657298] [INFO ] [MAIN ] HUBS: Loaded 39200 existing records. [2025-09-30T19:16:18.862675] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:18.863144] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-30T19:16:18.863210] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-30T19:16:18.863534] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-30T19:16:18.863593] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-30T19:16:19.254756] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:19.454374] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-30T19:16:19.733290] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:16:19.819099] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:16:20.254382] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-30T19:16:20.673507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T19:16:21.054420] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-30T19:16:21.854408] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-30T19:16:21.999144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:16:22.598413] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:16:22.654380] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-30T19:16:23.430282] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:16:23.454348] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-30T19:16:23.867931] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:16:24.254380] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-30T19:16:24.926158] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:16:25.054383] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-30T19:16:25.394899] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T19:16:25.854430] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-30T19:16:26.627521] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:16:26.654411] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-30T19:16:27.454380] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-30T19:16:27.511016] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:16:27.717854] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:16:28.254406] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-30T19:16:29.054362] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-30T19:16:29.168301] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:16:29.829108] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:16:29.854328] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-30T19:16:30.284218] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T19:16:30.654376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-30T19:16:31.338618] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:16:31.348873] [INFO ] [REMOTE ] HTGC: Full fetch complete (68206 records). [2025-09-30T19:16:31.349134] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-30T19:16:31.462698] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-30T19:16:31.806928] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-30T19:16:31.807121] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-30T19:16:31.808064] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-30T19:16:31.808201] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-30T19:16:31.831699] [DEBUG] [LOCAL ] HTGC: Trimmed 68206 records to 47389 (keeping 200 days of data) [2025-09-30T19:16:31.831543] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:16:32.155344] [DEBUG] [LOCAL ] HTGC: Primary data saved (47389 records). [2025-09-30T19:16:32.155562] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-30T19:16:32.155834] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTGC took 42.3s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-09-30T19:16:32.261158] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-30T19:16:32.359378] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:32.410124] [DEBUG] [LOCAL ] HUM: Loaded 48801 existing records from primary storage. [2025-09-30T19:16:32.410499] [INFO ] [MAIN ] HUM: Loaded 48801 existing records. [2025-09-30T19:16:32.616534] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:32.616938] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-30T19:16:32.617007] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-30T19:16:32.617295] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-30T19:16:32.617371] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-30T19:16:33.030762] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:33.033353] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:16:33.054389] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-30T19:16:33.575557] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:16:33.854344] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-30T19:16:34.341779] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:16:34.654364] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-30T19:16:35.291483] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:16:35.454372] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-30T19:16:36.254342] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-30T19:16:36.527932] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T19:16:36.971240] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:16:37.054414] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-30T19:16:37.442380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:16:37.854411] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-30T19:16:38.468914] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T19:16:38.654392] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-30T19:16:39.277233] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:16:39.454368] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-30T19:16:40.254353] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-30T19:16:40.348810] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:16:40.984602] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T19:16:41.054363] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-30T19:16:41.797978] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:16:41.807039] [INFO ] [REMOTE ] HUBB: Full fetch complete (53719 records). [2025-09-30T19:16:41.807201] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-30T19:16:41.859509] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-30T19:16:42.227958] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-30T19:16:42.228058] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-30T19:16:42.229247] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-30T19:16:42.229337] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-30T19:16:42.230618] [DEBUG] [LOCAL ] HUBB: Trimmed 53719 records to 36727 (keeping 200 days of data) [2025-09-30T19:16:42.480709] [DEBUG] [LOCAL ] HUBB: Primary data saved (36727 records). [2025-09-30T19:16:42.481024] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-30T19:16:42.481149] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 27.1s. Estimated remaining: 2h 47m 34s. Rate: 7.8 symbols/min [2025-09-30T19:16:42.666888] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-30T19:16:42.670675] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:42.703619] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T19:16:42.761525] [DEBUG] [LOCAL ] HUN: Loaded 53195 existing records from primary storage. [2025-09-30T19:16:42.761971] [INFO ] [MAIN ] HUN: Loaded 53195 existing records. [2025-09-30T19:16:42.970557] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:42.970867] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-30T19:16:42.970928] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-30T19:16:42.971281] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-30T19:16:42.971353] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-30T19:16:43.361096] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:43.454417] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-30T19:16:43.701232] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T19:16:44.082755] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:16:44.090998] [INFO ] [REMOTE ] HTH: Full fetch complete (46703 records). [2025-09-30T19:16:44.091206] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-30T19:16:44.259612] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-30T19:16:44.659706] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-30T19:16:44.659915] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-30T19:16:44.661051] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-30T19:16:44.661163] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-30T19:16:44.662833] [DEBUG] [LOCAL ] HTH: Trimmed 46703 records to 32188 (keeping 200 days of data) [2025-09-30T19:16:44.893661] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:16:44.919538] [DEBUG] [LOCAL ] HTH: Primary data saved (32188 records). [2025-09-30T19:16:44.913543] [INFO ] [REMOTE ] HUBS: Full fetch complete (55431 records). [2025-09-30T19:16:44.919901] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-30T19:16:44.920026] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-30T19:16:44.920443] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTH took 40.0s. Estimated remaining: 2h 47m 20s. Rate: 7.8 symbols/min [2025-09-30T19:16:45.054776] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-30T19:16:45.304296] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:45.595903] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-30T19:16:45.608552] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-30T19:16:45.609613] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-30T19:16:45.609773] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-30T19:16:45.611130] [DEBUG] [LOCAL ] HUYA: Loaded 44246 existing records from primary storage. [2025-09-30T19:16:45.611675] [INFO ] [MAIN ] HUYA: Loaded 44246 existing records. [2025-09-30T19:16:45.711281] [DEBUG] [LOCAL ] HUBS: Trimmed 55431 records to 39238 (keeping 200 days of data) [2025-09-30T19:16:45.910140] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:45.915430] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-30T19:16:45.918594] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-30T19:16:45.920204] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-30T19:16:45.920538] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-30T19:16:46.472313] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:46.475724] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-30T19:16:46.523941] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-30T19:16:46.538124] [DEBUG] [LOCAL ] HUBS: Primary data saved (39238 records). [2025-09-30T19:16:46.538484] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-30T19:16:46.538622] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBS took 28.1s. Estimated remaining: 2h 47m 5s. Rate: 7.8 symbols/min [2025-09-30T19:16:46.660286] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-30T19:16:46.744120] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:46.779759] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T19:16:46.802709] [DEBUG] [LOCAL ] HVT: Loaded 15684 existing records from primary storage. [2025-09-30T19:16:46.802988] [INFO ] [MAIN ] HVT: Loaded 15684 existing records. [2025-09-30T19:16:46.996473] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:46.996814] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-30T19:16:46.996870] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-30T19:16:46.997198] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-30T19:16:46.997272] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-30T19:16:47.398699] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:47.454374] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-30T19:16:47.767620] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:16:48.264629] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-30T19:16:48.292573] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:16:49.054376] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-30T19:16:49.161594] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T19:16:49.483578] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:16:49.854389] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-30T19:16:50.418476] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:16:50.654365] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-30T19:16:50.951911] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T19:16:51.454382] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-30T19:16:52.254364] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-30T19:16:52.479500] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:16:52.918328] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:16:53.043896] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T19:16:53.054338] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-30T19:16:53.854360] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-30T19:16:54.654378] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-30T19:16:54.847821] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:16:55.273425] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:16:55.454405] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-30T19:16:56.247964] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:16:56.254297] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-30T19:16:56.445881] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T19:16:57.054341] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-30T19:16:57.282337] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:16:57.854352] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-30T19:16:58.654370] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-30T19:16:58.807536] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:16:59.457550] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-30T19:16:59.464430] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:16:59.476863] [INFO ] [REMOTE ] HUM: Full fetch complete (70970 records). [2025-09-30T19:16:59.477035] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-30T19:16:59.914965] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-30T19:16:59.915102] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-30T19:16:59.916218] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-30T19:16:59.916286] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-30T19:16:59.919743] [DEBUG] [LOCAL ] HUM: Trimmed 70970 records to 48794 (keeping 200 days of data) [2025-09-30T19:17:00.262837] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-30T19:17:00.287312] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:17:00.312555] [DEBUG] [LOCAL ] HUM: Primary data saved (48794 records). [2025-09-30T19:17:00.312741] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-30T19:17:00.312846] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUM took 28.2s. Estimated remaining: 2h 47m 5s. Rate: 7.8 symbols/min [2025-09-30T19:17:00.510546] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:00.575785] [DEBUG] [LOCAL ] HWM: Loaded 52984 existing records from primary storage. [2025-09-30T19:17:00.576234] [INFO ] [MAIN ] HWM: Loaded 52984 existing records. [2025-09-30T19:17:00.783139] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:00.783439] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-30T19:17:00.783519] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-30T19:17:00.798626] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T19:17:00.798707] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-30T19:17:00.803623] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-30T19:17:01.065423] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-30T19:17:01.202119] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:01.854362] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-30T19:17:02.218027] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T19:17:02.662397] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-30T19:17:02.681930] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:17:03.454399] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-30T19:17:03.673501] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T19:17:03.920894] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T19:17:04.047610] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:17:04.254357] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-30T19:17:05.054366] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-30T19:17:05.854359] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-30T19:17:06.046047] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:17:06.654338] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-30T19:17:06.932695] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:17:07.111226] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:17:07.377760] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:17:07.454380] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-30T19:17:08.254360] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-30T19:17:08.949456] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:17:09.054401] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-30T19:17:09.854375] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-30T19:17:10.005003] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:17:10.002971] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:17:10.654390] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-30T19:17:11.454318] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-30T19:17:11.560809] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:17:12.201489] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:17:12.254350] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-30T19:17:13.054321] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-30T19:17:13.182762] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:17:13.854370] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-30T19:17:14.017543] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:17:14.174724] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:17:14.654372] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-30T19:17:15.454315] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-30T19:17:15.488441] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:17:15.521519] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T19:17:15.524875] [INFO ] [REMOTE ] HVT: Full fetch complete (23465 records). [2025-09-30T19:17:15.524973] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-30T19:17:15.931995] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-30T19:17:15.932083] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-30T19:17:15.932624] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-30T19:17:15.932703] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-30T19:17:15.933367] [DEBUG] [LOCAL ] HVT: Trimmed 23465 records to 15579 (keeping 200 days of data) [2025-09-30T19:17:16.036543] [DEBUG] [LOCAL ] HVT: Primary data saved (15579 records). [2025-09-30T19:17:16.036717] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-30T19:17:16.036851] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 29.5s. Estimated remaining: 2h 47m 7s. Rate: 7.8 symbols/min [2025-09-30T19:17:16.230575] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:16.254367] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-30T19:17:16.294583] [DEBUG] [LOCAL ] HXL: Loaded 45991 existing records from primary storage. [2025-09-30T19:17:16.294964] [INFO ] [MAIN ] HXL: Loaded 45991 existing records. [2025-09-30T19:17:16.487990] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:16.488226] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-30T19:17:16.488286] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-30T19:17:16.488935] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-30T19:17:16.488998] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-30T19:17:16.871769] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:17.054427] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-30T19:17:17.303889] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T19:17:17.316251] [INFO ] [REMOTE ] HUN: Full fetch complete (76620 records). [2025-09-30T19:17:17.316418] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-30T19:17:17.785636] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-30T19:17:17.785791] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-30T19:17:17.786943] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-30T19:17:17.787023] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-30T19:17:17.788774] [DEBUG] [LOCAL ] HUN: Trimmed 76620 records to 53197 (keeping 200 days of data) [2025-09-30T19:17:17.861508] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-30T19:17:18.161114] [DEBUG] [LOCAL ] HUN: Primary data saved (53197 records). [2025-09-30T19:17:18.161347] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-30T19:17:18.162859] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUN took 35.7s. Estimated remaining: 2h 46m 52s. Rate: 7.8 symbols/min [2025-09-30T19:17:18.347529] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T19:17:18.409766] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:18.437428] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T19:17:18.455085] [DEBUG] [LOCAL ] HY: Loaded 9987 existing records from primary storage. [2025-09-30T19:17:18.455337] [INFO ] [MAIN ] HY: Loaded 9987 existing records. [2025-09-30T19:17:18.647617] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:18.647888] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-30T19:17:18.647938] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-30T19:17:18.648320] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-30T19:17:18.648400] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-30T19:17:18.659732] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-30T19:17:19.047336] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:19.283429] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:17:19.294434] [INFO ] [REMOTE ] HUYA: Full fetch complete (63647 records). [2025-09-30T19:17:19.294569] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-30T19:17:19.464545] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-30T19:17:19.717444] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-30T19:17:19.717552] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-30T19:17:19.718557] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-30T19:17:19.718637] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-30T19:17:19.720621] [DEBUG] [LOCAL ] HUYA: Trimmed 63647 records to 44164 (keeping 200 days of data) [2025-09-30T19:17:19.992277] [DEBUG] [LOCAL ] HUYA: Primary data saved (44164 records). [2025-09-30T19:17:19.992415] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-30T19:17:19.992523] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUYA took 35.1s. Estimated remaining: 2h 46m 37s. Rate: 7.8 symbols/min [2025-09-30T19:17:20.177364] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:20.177584] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-30T19:17:20.177737] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-30T19:17:20.177889] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-30T19:17:20.177932] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-30T19:17:20.177976] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-30T19:17:20.178008] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-30T19:17:20.257386] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-30T19:17:20.460828] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T19:17:20.591792] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:20.839273] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:17:21.054395] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-30T19:17:21.400126] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-30T19:17:21.862580] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-30T19:17:21.868825] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:17:22.652449] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:17:22.655017] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-30T19:17:23.454408] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-30T19:17:24.030880] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T19:17:24.254398] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-30T19:17:24.622130] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:17:25.054383] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-30T19:17:25.141510] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:17:25.358597] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-30T19:17:25.854415] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-30T19:17:26.654399] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-30T19:17:26.969881] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T19:17:27.454414] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-30T19:17:27.696632] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T19:17:27.843675] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T19:17:28.254343] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-30T19:17:28.567141] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-30T19:17:29.054393] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-30T19:17:29.854377] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-30T19:17:30.198234] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T19:17:30.654352] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-30T19:17:31.047169] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T19:17:31.152545] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T19:17:31.164278] [INFO ] [REMOTE ] HWM: Full fetch complete (76631 records). [2025-09-30T19:17:31.164435] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-30T19:17:31.459530] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-30T19:17:31.601164] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-30T19:17:31.601250] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-30T19:17:31.602323] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-30T19:17:31.602402] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-30T19:17:31.603936] [DEBUG] [LOCAL ] HWM: Trimmed 76631 records to 52974 (keeping 200 days of data) [2025-09-30T19:17:31.953198] [DEBUG] [LOCAL ] HWM: Primary data saved (52974 records). [2025-09-30T19:17:31.953337] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-30T19:17:31.953443] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 31.6s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min [2025-09-30T19:17:32.138085] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:32.138300] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-30T19:17:32.138344] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-30T19:17:32.138464] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-30T19:17:32.138511] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-30T19:17:32.138553] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-30T19:17:32.138590] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-30T19:17:32.259555] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-30T19:17:32.599304] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:32.719459] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:17:32.772787] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-30T19:17:33.054370] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-30T19:17:33.854378] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-30T19:17:33.915900] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T19:17:34.108543] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-30T19:17:34.654402] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-30T19:17:35.403712] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:17:35.454366] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-30T19:17:36.222233] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:17:36.254409] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-30T19:17:37.004376] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T19:17:37.054415] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-30T19:17:37.401813] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T19:17:37.854378] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-30T19:17:38.177046] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T19:17:38.654400] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-30T19:17:38.998129] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-30T19:17:38.998950] [INFO ] [REMOTE ] HYAC: Full fetch complete (862 records). [2025-09-30T19:17:38.999025] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-30T19:17:39.211795] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-30T19:17:39.212004] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:17:39.212077] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:17:39.212153] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-30T19:17:39.212221] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-30T19:17:39.212261] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-30T19:17:39.212323] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-30T19:17:39.212407] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 19.2s. Estimated remaining: 2h 46m 27s. Rate: 7.8 symbols/min [2025-09-30T19:17:39.407329] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:39.419867] [DEBUG] [LOCAL ] HYI: Loaded 9292 existing records from primary storage. [2025-09-30T19:17:39.420094] [INFO ] [MAIN ] HYI: Loaded 9292 existing records. [2025-09-30T19:17:39.459505] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-30T19:17:39.631852] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:39.632067] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-30T19:17:39.632113] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-30T19:17:39.632423] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-30T19:17:39.632482] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-30T19:17:40.039268] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:40.254329] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-30T19:17:40.341070] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:17:40.475470] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-30T19:17:41.054378] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-30T19:17:41.854374] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-30T19:17:41.991502] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:17:41.994729] [INFO ] [REMOTE ] HY: Full fetch complete (15183 records). [2025-09-30T19:17:41.994811] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-30T19:17:42.315327] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T19:17:42.407322] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-30T19:17:42.407411] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-30T19:17:42.407776] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-30T19:17:42.407840] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-30T19:17:42.408533] [DEBUG] [LOCAL ] HY: Trimmed 15183 records to 9962 (keeping 200 days of data) [2025-09-30T19:17:42.476855] [DEBUG] [LOCAL ] HY: Primary data saved (9962 records). [2025-09-30T19:17:42.477016] [INFO ] [MAIN ] HY: Full history saved. [2025-09-30T19:17:42.477106] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HY took 24.3s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-09-30T19:17:42.660545] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:42.660616] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-30T19:17:42.713821] [DEBUG] [LOCAL ] HYT: Loaded 33536 existing records from primary storage. [2025-09-30T19:17:42.714249] [INFO ] [MAIN ] HYT: Loaded 33536 existing records. [2025-09-30T19:17:42.909527] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:42.909863] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-30T19:17:42.909950] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-30T19:17:42.910559] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-30T19:17:42.910620] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-30T19:17:43.295776] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:43.454380] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-30T19:17:44.254349] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-30T19:17:44.354548] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:17:44.354970] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:17:44.520243] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-30T19:17:45.054373] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-30T19:17:45.854357] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-30T19:17:46.654450] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-30T19:17:46.746539] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:17:47.150170] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:17:47.401883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:17:47.454404] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-30T19:17:48.254373] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-30T19:17:48.607355] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T19:17:49.054367] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-30T19:17:49.140443] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:17:49.789187] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:17:49.854337] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-30T19:17:50.591310] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T19:17:50.654392] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-30T19:17:51.454365] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-30T19:17:52.178029] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:17:52.254375] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-30T19:17:53.039579] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:17:53.054398] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-30T19:17:53.216412] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T19:17:53.854544] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-30T19:17:53.857867] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T19:17:54.171674] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:17:54.654372] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-30T19:17:54.899279] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-30T19:17:55.454363] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-30T19:17:55.799053] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T19:17:56.254354] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-30T19:17:56.674158] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T19:17:56.674905] [INFO ] [REMOTE ] HYBX: Full fetch complete (783 records). [2025-09-30T19:17:56.674989] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-30T19:17:56.867284] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-30T19:17:56.867478] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:17:56.867548] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:17:56.867624] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-30T19:17:56.867727] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-30T19:17:56.867771] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-30T19:17:56.867857] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-30T19:17:56.867932] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 24.9s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-09-30T19:17:57.055220] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-30T19:17:57.055138] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:57.062929] [DEBUG] [LOCAL ] HYTR: Loaded 3140 existing records from primary storage. [2025-09-30T19:17:57.063170] [INFO ] [MAIN ] HYTR: Loaded 3140 existing records. [2025-09-30T19:17:57.255690] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:57.255896] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-30T19:17:57.255943] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-30T19:17:57.256161] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-30T19:17:57.256219] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-30T19:17:57.690135] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:57.854361] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-30T19:17:58.344331] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T19:17:58.654353] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-30T19:17:58.685999] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:17:59.454382] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-30T19:17:59.691259] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:18:00.254377] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-30T19:18:01.054394] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-30T19:18:01.168853] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:18:01.815515] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:18:01.845395] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:18:01.854566] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-30T19:18:02.654362] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-30T19:18:03.020972] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T19:18:03.392430] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:18:03.454410] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-30T19:18:04.159521] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:18:04.254358] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-30T19:18:05.054358] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-30T19:18:05.081554] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T19:18:05.854358] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-30T19:18:06.181518] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:18:06.624234] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T19:18:06.654348] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-30T19:18:07.454355] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-30T19:18:07.545833] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T19:18:07.548486] [INFO ] [REMOTE ] HYI: Full fetch complete (13369 records). [2025-09-30T19:18:07.548623] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-30T19:18:07.864107] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T19:18:07.983021] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-30T19:18:07.983110] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-30T19:18:07.983420] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-30T19:18:07.983462] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-30T19:18:07.984081] [DEBUG] [LOCAL ] HYI: Trimmed 13369 records to 9392 (keeping 200 days of data) [2025-09-30T19:18:08.046572] [DEBUG] [LOCAL ] HYI: Primary data saved (9392 records). [2025-09-30T19:18:08.046763] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-30T19:18:08.046865] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYI took 28.8s. Estimated remaining: 2h 46m 11s. Rate: 7.8 symbols/min [2025-09-30T19:18:08.254403] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-30T19:18:08.282755] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:08.318284] [DEBUG] [LOCAL ] HZO: Loaded 29189 existing records from primary storage. [2025-09-30T19:18:08.318712] [INFO ] [MAIN ] HZO: Loaded 29189 existing records. [2025-09-30T19:18:08.556023] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:08.556311] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-30T19:18:08.556370] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-30T19:18:08.556875] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-30T19:18:08.556935] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-30T19:18:08.955033] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:09.054388] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-30T19:18:09.698115] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:18:09.854346] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-30T19:18:10.413034] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T19:18:10.447472] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:18:10.458319] [INFO ] [REMOTE ] HXL: Full fetch complete (66211 records). [2025-09-30T19:18:10.458500] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-30T19:18:10.662897] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-30T19:18:10.907240] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-30T19:18:10.907341] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-30T19:18:10.908335] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-30T19:18:10.908402] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-30T19:18:10.909906] [DEBUG] [LOCAL ] HXL: Trimmed 66211 records to 46000 (keeping 200 days of data) [2025-09-30T19:18:11.225947] [DEBUG] [LOCAL ] HXL: Primary data saved (46000 records). [2025-09-30T19:18:11.226130] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-30T19:18:11.226245] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HXL took 55.2s. Estimated remaining: 2h 45m 57s. Rate: 7.8 symbols/min [2025-09-30T19:18:11.454446] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-30T19:18:11.888203] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T19:18:11.904093] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:18:12.254404] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-30T19:18:12.956409] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T19:18:13.054397] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-30T19:18:13.526324] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T19:18:13.854412] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-30T19:18:14.654356] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-30T19:18:15.346731] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T19:18:15.454415] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-30T19:18:15.864766] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:18:16.254397] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-30T19:18:16.929367] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:18:16.940622] [INFO ] [REMOTE ] HYT: Full fetch complete (47376 records). [2025-09-30T19:18:16.940884] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-30T19:18:17.063156] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-30T19:18:17.390799] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-30T19:18:17.390951] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-30T19:18:17.391998] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-30T19:18:17.392076] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-30T19:18:17.413387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:18:17.418561] [DEBUG] [LOCAL ] HYT: Trimmed 47376 records to 33686 (keeping 200 days of data) [2025-09-30T19:18:17.483816] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T19:18:17.654848] [DEBUG] [LOCAL ] HYT: Primary data saved (33686 records). [2025-09-30T19:18:17.655017] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-30T19:18:17.655536] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYT took 35.2s. Estimated remaining: 2h 45m 48s. Rate: 7.8 symbols/min [2025-09-30T19:18:17.854349] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-30T19:18:18.315600] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T19:18:18.654389] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-30T19:18:19.454416] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-30T19:18:19.720080] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:18:20.035324] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:18:20.036567] [INFO ] [REMOTE ] HYTR: Full fetch complete (4504 records). [2025-09-30T19:18:20.036638] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-30T19:18:20.267738] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-30T19:18:20.413005] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-30T19:18:20.413087] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-30T19:18:20.413227] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-30T19:18:20.413266] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-30T19:18:20.413637] [DEBUG] [LOCAL ] HYTR: Trimmed 4504 records to 3151 (keeping 200 days of data) [2025-09-30T19:18:20.433676] [DEBUG] [LOCAL ] HYTR: Primary data saved (3151 records). [2025-09-30T19:18:20.433800] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-30T19:18:20.433897] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 23.6s. Estimated remaining: 2h 45m 35s. Rate: 7.8 symbols/min [2025-09-30T19:18:21.509610] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T19:18:21.518055] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-30T19:18:22.714227] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T19:18:22.720709] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-30T19:18:23.937511] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:18:23.944210] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-30T19:18:24.959196] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T19:18:24.966628] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-30T19:18:26.354843] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T19:18:26.361086] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-30T19:18:27.727387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:18:27.733834] [INFO ] [REMOTE ] HZO: Full fetch complete (40916 records). [2025-09-30T19:18:27.733939] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-30T19:18:28.154835] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-30T19:18:28.154966] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-30T19:18:28.155793] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-30T19:18:28.155860] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-30T19:18:28.157154] [DEBUG] [LOCAL ] HZO: Trimmed 40916 records to 29205 (keeping 200 days of data) [2025-09-30T19:18:28.338080] [DEBUG] [LOCAL ] HZO: Primary data saved (29205 records). [2025-09-30T19:18:28.338256] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-30T19:18:28.338365] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 20.3s. Estimated remaining: 2h 45m 27s. Rate: 7.8 symbols/min [2025-09-30T19:18:29.177290] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.152456] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.291763] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.312932] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.370564] [DEBUG] [LOCAL ] IAE: Loaded 6041 existing records from primary storage. [2025-09-30T19:18:29.371591] [INFO ] [MAIN ] IAE: Loaded 6041 existing records. [2025-09-30T19:18:29.528946] [DEBUG] [LOCAL ] IBN: Loaded 52868 existing records from primary storage. [2025-09-30T19:18:29.535812] [INFO ] [MAIN ] IBN: Loaded 52868 existing records. [2025-09-30T19:18:29.630154] [DEBUG] [LOCAL ] IBM: Loaded 53636 existing records from primary storage. [2025-09-30T19:18:29.668862] [INFO ] [MAIN ] IBM: Loaded 53636 existing records. [2025-09-30T19:18:29.892408] [DEBUG] [LOCAL ] IAG: Loaded 53448 existing records from primary storage. [2025-09-30T19:18:30.028518] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.034464] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.045052] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-30T19:18:30.018509] [INFO ] [MAIN ] IAG: Loaded 53448 existing records. [2025-09-30T19:18:30.094614] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-30T19:18:30.111289] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-30T19:18:30.276995] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.349821] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.484487] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-30T19:18:30.508102] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.545264] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-30T19:18:30.576400] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-30T19:18:30.658450] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.763778] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.757614] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-30T19:18:30.809417] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.830216] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-30T19:18:30.849542] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-30T19:18:30.887568] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-30T19:18:30.903841] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-30T19:18:30.966097] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-30T19:18:31.432966] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:31.465287] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-30T19:18:31.870857] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:31.899594] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-30T19:18:32.160887] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:32.181717] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-30T19:18:32.185891] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:32.187208] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-30T19:18:32.314909] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:18:32.316842] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-30T19:18:33.101596] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T19:18:33.103519] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-30T19:18:33.788754] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T19:18:33.790973] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-30T19:18:33.845707] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T19:18:33.857459] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-30T19:18:33.956511] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:18:33.968506] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-30T19:18:34.013340] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:18:34.024901] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-30T19:18:34.176471] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T19:18:34.178836] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-30T19:18:34.843059] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:18:34.844851] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-30T19:18:35.236964] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T19:18:35.239209] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-30T19:18:35.366343] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:18:35.454411] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-30T19:18:35.587909] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T19:18:35.843028] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:18:35.878911] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T19:18:36.254370] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-30T19:18:36.848876] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:18:37.054411] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-30T19:18:37.854317] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-30T19:18:38.365306] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T19:18:38.495338] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:18:38.523172] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T19:18:38.654375] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-30T19:18:39.454602] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-30T19:18:40.254367] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-30T19:18:40.831332] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:18:40.903118] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:18:41.054361] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-30T19:18:41.115223] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:18:41.854368] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-30T19:18:42.654394] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-30T19:18:42.693509] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:18:42.696013] [INFO ] [REMOTE ] IAE: Full fetch complete (8646 records). [2025-09-30T19:18:42.696160] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-30T19:18:43.110155] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-30T19:18:43.110290] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-30T19:18:43.110625] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-30T19:18:43.110739] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-30T19:18:43.111356] [DEBUG] [LOCAL ] IAE: Trimmed 8646 records to 6043 (keeping 200 days of data) [2025-09-30T19:18:43.180489] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T19:18:43.182823] [DEBUG] [LOCAL ] IAE: Primary data saved (6043 records). [2025-09-30T19:18:43.194803] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-30T19:18:43.195383] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 14.9s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-09-30T19:18:43.380917] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:43.416888] [DEBUG] [LOCAL ] IBP: Loaded 29054 existing records from primary storage. [2025-09-30T19:18:43.417160] [INFO ] [MAIN ] IBP: Loaded 29054 existing records. [2025-09-30T19:18:43.462910] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-30T19:18:43.618411] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:43.618693] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-30T19:18:43.618777] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-30T19:18:43.619255] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-30T19:18:43.619338] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-30T19:18:44.016851] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:44.254392] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-30T19:18:44.945262] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T19:18:45.008889] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:18:45.054326] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-30T19:18:45.854336] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-30T19:18:46.090813] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T19:18:46.151802] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T19:18:46.654374] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-30T19:18:47.454401] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-30T19:18:47.750070] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T19:18:48.254386] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-30T19:18:48.519779] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T19:18:49.054357] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-30T19:18:49.250554] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:18:49.699418] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:18:49.854345] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-30T19:18:50.654358] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-30T19:18:51.233105] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:18:51.360240] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:18:51.454387] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-30T19:18:52.254386] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-30T19:18:52.459303] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:18:53.007098] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:18:53.054363] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-30T19:18:53.279483] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:18:53.854347] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-30T19:18:54.654366] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-30T19:18:55.187010] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T19:18:55.454352] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-30T19:18:55.645681] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:18:55.945317] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:18:56.254364] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-30T19:18:57.054366] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-30T19:18:57.321279] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:18:57.333159] [INFO ] [REMOTE ] IAG: Full fetch complete (77245 records). [2025-09-30T19:18:57.333317] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-30T19:18:57.759348] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-30T19:18:57.759450] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-30T19:18:57.760635] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-30T19:18:57.760734] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-30T19:18:57.762375] [DEBUG] [LOCAL ] IAG: Trimmed 77245 records to 53449 (keeping 200 days of data) [2025-09-30T19:18:57.859691] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-30T19:18:58.106250] [DEBUG] [LOCAL ] IAG: Primary data saved (53449 records). [2025-09-30T19:18:58.106405] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-30T19:18:58.107043] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IAG took 29.8s. Estimated remaining: 2h 45m 29s. Rate: 7.8 symbols/min [2025-09-30T19:18:58.318036] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:58.369438] [DEBUG] [LOCAL ] IBTA: Loaded 37651 existing records from primary storage. [2025-09-30T19:18:58.369793] [INFO ] [MAIN ] IBTA: Loaded 37651 existing records. [2025-09-30T19:18:58.604187] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:58.623257] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-30T19:18:58.624865] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T19:18:58.625051] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-30T19:18:58.633141] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-30T19:18:58.633283] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-30T19:18:58.659449] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-30T19:18:58.998886] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-30T19:18:59.096300] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:59.155458] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:18:59.454368] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-30T19:18:59.642720] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:19:00.254396] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-30T19:19:00.605932] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:19:01.054365] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-30T19:19:01.854368] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-30T19:19:02.331837] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:19:02.458931] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:19:02.472344] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-30T19:19:02.472491] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-30T19:19:02.660863] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-30T19:19:02.896866] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-30T19:19:02.897061] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-30T19:19:02.898176] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-30T19:19:02.898244] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-30T19:19:02.899783] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53635 (keeping 200 days of data) [2025-09-30T19:19:03.025394] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T19:19:03.283429] [DEBUG] [LOCAL ] IBM: Primary data saved (53635 records). [2025-09-30T19:19:03.283576] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-30T19:19:03.283720] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 34.9s. Estimated remaining: 2h 45m 18s. Rate: 7.8 symbols/min [2025-09-30T19:19:03.454507] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-30T19:19:03.479001] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:03.545277] [DEBUG] [LOCAL ] ICE: Loaded 53015 existing records from primary storage. [2025-09-30T19:19:03.545712] [INFO ] [MAIN ] ICE: Loaded 53015 existing records. [2025-09-30T19:19:03.744872] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:03.745158] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-30T19:19:03.745235] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-30T19:19:03.745925] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-30T19:19:03.746000] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-30T19:19:04.092761] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:19:04.217290] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:04.254325] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-30T19:19:04.675709] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:19:05.054354] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-30T19:19:05.854360] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-30T19:19:06.247207] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:19:06.654406] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-30T19:19:06.730756] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T19:19:07.012556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:19:07.024451] [INFO ] [REMOTE ] IBN: Full fetch complete (76284 records). [2025-09-30T19:19:07.024587] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-30T19:19:07.465861] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-30T19:19:07.470095] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-30T19:19:07.471305] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-30T19:19:07.472723] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-30T19:19:07.472926] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-30T19:19:07.474997] [DEBUG] [LOCAL ] IBN: Trimmed 76284 records to 52867 (keeping 200 days of data) [2025-09-30T19:19:07.811334] [DEBUG] [LOCAL ] IBN: Primary data saved (52867 records). [2025-09-30T19:19:07.811488] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-30T19:19:07.812626] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBN took 39.5s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-09-30T19:19:07.996487] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:08.042445] [DEBUG] [LOCAL ] ICL: Loaded 38401 existing records from primary storage. [2025-09-30T19:19:08.042771] [INFO ] [MAIN ] ICL: Loaded 38401 existing records. [2025-09-30T19:19:08.229408] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:08.229699] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-30T19:19:08.229779] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-30T19:19:08.230350] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-30T19:19:08.230445] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-30T19:19:08.257717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-30T19:19:08.623603] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:08.656155] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T19:19:08.689610] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T19:19:09.054379] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-30T19:19:09.739770] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:19:09.854345] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-30T19:19:10.323995] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:19:10.330161] [INFO ] [REMOTE ] IBP: Full fetch complete (41162 records). [2025-09-30T19:19:10.330292] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-30T19:19:10.659476] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-30T19:19:10.730006] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-30T19:19:10.730097] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-30T19:19:10.730811] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-30T19:19:10.730876] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-30T19:19:10.731909] [DEBUG] [LOCAL ] IBP: Trimmed 41162 records to 28967 (keeping 200 days of data) [2025-09-30T19:19:10.922595] [DEBUG] [LOCAL ] IBP: Primary data saved (28967 records). [2025-09-30T19:19:10.922783] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-30T19:19:10.922888] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 27.7s. Estimated remaining: 2h 44m 54s. Rate: 7.8 symbols/min [2025-09-30T19:19:11.120914] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:11.187281] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:19:11.185626] [DEBUG] [LOCAL ] IDA: Loaded 31989 existing records from primary storage. [2025-09-30T19:19:11.198383] [INFO ] [MAIN ] IDA: Loaded 31989 existing records. [2025-09-30T19:19:11.389995] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:11.390256] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-30T19:19:11.390319] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-30T19:19:11.390709] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-30T19:19:11.390778] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-30T19:19:11.459545] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-30T19:19:11.771365] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:12.036798] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:19:12.254402] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-30T19:19:12.959589] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:19:13.054362] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-30T19:19:13.548626] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:19:13.854347] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-30T19:19:14.513205] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T19:19:14.611890] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:19:14.654357] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-30T19:19:15.454387] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-30T19:19:15.857342] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:19:16.254384] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-30T19:19:16.612030] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:19:17.054377] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-30T19:19:17.448317] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T19:19:17.854363] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-30T19:19:18.654375] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-30T19:19:18.929731] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:19:19.369397] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:19:19.454365] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-30T19:19:20.122782] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:19:20.254413] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-30T19:19:21.054341] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-30T19:19:21.225964] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:19:21.633949] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:19:21.854363] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-30T19:19:22.597319] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:19:22.606708] [INFO ] [REMOTE ] IBTA: Full fetch complete (50720 records). [2025-09-30T19:19:22.606865] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-30T19:19:22.659492] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-30T19:19:23.055813] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-30T19:19:23.055940] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-30T19:19:23.056731] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-30T19:19:23.056826] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-30T19:19:23.057991] [DEBUG] [LOCAL ] IBTA: Trimmed 50720 records to 37607 (keeping 200 days of data) [2025-09-30T19:19:23.289360] [DEBUG] [LOCAL ] IBTA: Primary data saved (37607 records). [2025-09-30T19:19:23.289511] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-30T19:19:23.290102] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 25.2s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-09-30T19:19:23.473361] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-30T19:19:23.477956] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:23.492584] [DEBUG] [LOCAL ] IDE: Loaded 8697 existing records from primary storage. [2025-09-30T19:19:23.492887] [INFO ] [MAIN ] IDE: Loaded 8697 existing records. [2025-09-30T19:19:23.698574] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:23.698879] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-30T19:19:23.699040] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-30T19:19:23.699336] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-30T19:19:23.699460] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-30T19:19:24.109746] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:19:24.119151] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-30T19:19:24.172860] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:24.254330] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-30T19:19:25.051053] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T19:19:25.059770] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-30T19:19:25.070171] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T19:19:25.854327] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-30T19:19:26.009474] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T19:19:26.654379] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-30T19:19:27.454337] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-30T19:19:27.547950] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:19:28.038345] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:19:28.216573] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:19:28.254359] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-30T19:19:28.986507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:19:29.054375] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-30T19:19:29.854358] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-30T19:19:30.398142] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:19:30.654361] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-30T19:19:31.355358] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:19:31.454379] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-30T19:19:32.025449] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:19:32.254373] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-30T19:19:32.665475] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T19:19:33.054395] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-30T19:19:33.760895] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:19:33.854365] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-30T19:19:34.392963] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:19:34.654397] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-30T19:19:34.879592] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:19:35.454370] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-30T19:19:36.073320] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T19:19:36.254364] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-30T19:19:36.384607] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:19:37.054339] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-30T19:19:37.109155] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:19:37.854360] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-30T19:19:38.654433] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-30T19:19:39.056544] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T19:19:39.077459] [INFO ] [REMOTE ] ICE: Full fetch complete (76755 records). [2025-09-30T19:19:39.077749] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-30T19:19:39.429948] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:19:39.463481] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-30T19:19:39.537289] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T19:19:39.594214] [INFO ] [REMOTE ] ICL: Full fetch complete (55949 records). [2025-09-30T19:19:39.594439] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-30T19:19:39.894266] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-30T19:19:39.901448] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-30T19:19:39.917725] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-30T19:19:39.920307] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-30T19:19:40.031815] [DEBUG] [LOCAL ] ICE: Trimmed 76755 records to 53003 (keeping 200 days of data) [2025-09-30T19:19:40.252441] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-30T19:19:40.254909] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-30T19:19:40.257693] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-30T19:19:40.259350] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-30T19:19:40.260462] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-30T19:19:40.270978] [DEBUG] [LOCAL ] ICL: Trimmed 55949 records to 38406 (keeping 200 days of data) [2025-09-30T19:19:40.732434] [DEBUG] [LOCAL ] ICL: Primary data saved (38406 records). [2025-09-30T19:19:40.734312] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-30T19:19:40.734429] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICL took 32.9s. Estimated remaining: 2h 44m 55s. Rate: 7.8 symbols/min [2025-09-30T19:19:40.947325] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:40.957106] [DEBUG] [LOCAL ] ICE: Primary data saved (53003 records). [2025-09-30T19:19:40.957232] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-30T19:19:40.957313] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 37.7s. Estimated remaining: 2h 44m 39s. Rate: 7.8 symbols/min [2025-09-30T19:19:41.060167] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:19:41.086242] [DEBUG] [LOCAL ] IDT: Loaded 17684 existing records from primary storage. [2025-09-30T19:19:41.103222] [INFO ] [MAIN ] IDT: Loaded 17684 existing records. [2025-09-30T19:19:41.087592] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-30T19:19:41.255851] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:41.281492] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T19:19:41.411709] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:41.411955] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-30T19:19:41.412004] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-30T19:19:41.412294] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-30T19:19:41.412353] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-30T19:19:41.562930] [DEBUG] [LOCAL ] IEX: Loaded 38289 existing records from primary storage. [2025-09-30T19:19:41.590921] [INFO ] [MAIN ] IEX: Loaded 38289 existing records. [2025-09-30T19:19:41.855013] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-30T19:19:41.860738] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:19:41.999828] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:42.018450] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-30T19:19:42.019071] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-30T19:19:42.043396] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:42.043453] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-30T19:19:42.043910] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-30T19:19:42.411695] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:42.654362] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-30T19:19:43.218247] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T19:19:43.439818] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T19:19:43.454308] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-30T19:19:44.196175] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:19:44.198828] [INFO ] [REMOTE ] IDE: Full fetch complete (12700 records). [2025-09-30T19:19:44.198906] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-30T19:19:44.262153] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-30T19:19:44.594289] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-30T19:19:44.594370] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-30T19:19:44.594680] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-30T19:19:44.594743] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-30T19:19:44.595203] [DEBUG] [LOCAL ] IDE: Trimmed 12700 records to 8748 (keeping 200 days of data) [2025-09-30T19:19:44.650525] [DEBUG] [LOCAL ] IDE: Primary data saved (8748 records). [2025-09-30T19:19:44.650695] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-30T19:19:44.650797] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 21.4s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min [2025-09-30T19:19:44.842878] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:44.897373] [DEBUG] [LOCAL ] IFF: Loaded 50976 existing records from primary storage. [2025-09-30T19:19:44.897738] [INFO ] [MAIN ] IFF: Loaded 50976 existing records. [2025-09-30T19:19:45.060140] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-30T19:19:45.092152] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:45.093158] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-30T19:19:45.093227] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-30T19:19:45.093885] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-30T19:19:45.093956] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-30T19:19:45.483264] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:45.763958] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:19:45.854341] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-30T19:19:46.663604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-30T19:19:46.666857] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:19:46.676758] [INFO ] [REMOTE ] IDA: Full fetch complete (44793 records). [2025-09-30T19:19:46.676877] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-30T19:19:47.099162] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-30T19:19:47.099304] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-30T19:19:47.100096] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-30T19:19:47.100176] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-30T19:19:47.107700] [DEBUG] [LOCAL ] IDA: Trimmed 44793 records to 32082 (keeping 200 days of data) [2025-09-30T19:19:47.119782] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:19:47.339626] [DEBUG] [LOCAL ] IDA: Primary data saved (32082 records). [2025-09-30T19:19:47.339799] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-30T19:19:47.339887] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDA took 36.4s. Estimated remaining: 2h 44m 13s. Rate: 7.8 symbols/min [2025-09-30T19:19:47.459524] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-30T19:19:47.531965] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:47.555541] [DEBUG] [LOCAL ] IFN: Loaded 18221 existing records from primary storage. [2025-09-30T19:19:47.555882] [INFO ] [MAIN ] IFN: Loaded 18221 existing records. [2025-09-30T19:19:47.756882] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:47.757127] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-30T19:19:47.757183] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-30T19:19:47.757495] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-30T19:19:47.757556] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-30T19:19:48.168749] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:48.254326] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-30T19:19:48.297991] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T19:19:48.416611] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T19:19:49.054335] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-30T19:19:49.159235] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:19:49.854356] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-30T19:19:50.369746] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:19:50.654354] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-30T19:19:50.875896] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:19:51.454415] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-30T19:19:51.914811] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:19:52.254365] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-30T19:19:53.054357] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-30T19:19:53.264826] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:19:53.854332] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-30T19:19:53.888382] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:19:53.940752] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T19:19:54.654377] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-30T19:19:55.454336] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-30T19:19:55.574704] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T19:19:55.718538] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T19:19:56.254359] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-30T19:19:57.054334] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-30T19:19:57.096389] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:19:57.624188] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:19:57.854368] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-30T19:19:57.898715] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:19:58.654359] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-30T19:19:59.375394] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:19:59.428417] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:19:59.454312] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-30T19:20:00.254357] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-30T19:20:00.955992] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:20:00.976695] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:20:01.054349] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-30T19:20:01.854364] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-30T19:20:02.122384] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:20:02.572846] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T19:20:02.654374] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-30T19:20:03.454373] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-30T19:20:04.254356] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-30T19:20:04.516268] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:20:04.568842] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:20:05.054352] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-30T19:20:05.785741] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T19:20:05.854370] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-30T19:20:06.648512] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:20:06.658333] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-30T19:20:07.454379] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-30T19:20:07.583159] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:20:07.611181] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:20:08.254375] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-30T19:20:08.435281] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:20:09.054347] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-30T19:20:09.179019] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:20:09.854326] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-30T19:20:09.934853] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T19:20:10.654380] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-30T19:20:11.454389] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-30T19:20:11.595483] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:20:11.637361] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:20:12.254319] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-30T19:20:12.349356] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T19:20:13.054390] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-30T19:20:13.478013] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:20:13.482924] [INFO ] [REMOTE ] IDT: Full fetch complete (22701 records). [2025-09-30T19:20:13.483031] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-30T19:20:13.877000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-30T19:20:13.891317] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-30T19:20:13.891400] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-30T19:20:13.891981] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-30T19:20:13.892047] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-30T19:20:13.892777] [DEBUG] [LOCAL ] IDT: Trimmed 22701 records to 17861 (keeping 200 days of data) [2025-09-30T19:20:14.005781] [DEBUG] [LOCAL ] IDT: Primary data saved (17861 records). [2025-09-30T19:20:14.005960] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-30T19:20:14.006095] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 33.3s. Estimated remaining: 2h 44m 27s. Rate: 7.8 symbols/min [2025-09-30T19:20:14.192680] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:14.216125] [DEBUG] [LOCAL ] IFS: Loaded 22930 existing records from primary storage. [2025-09-30T19:20:14.216393] [INFO ] [MAIN ] IFS: Loaded 22930 existing records. [2025-09-30T19:20:14.423479] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:14.423923] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-30T19:20:14.424072] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-30T19:20:14.424795] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-30T19:20:14.424860] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-30T19:20:14.658568] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-30T19:20:14.887126] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:14.918902] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:20:14.972780] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:20:15.454407] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-30T19:20:16.254374] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-30T19:20:16.313095] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:20:16.323035] [INFO ] [REMOTE ] IEX: Full fetch complete (53413 records). [2025-09-30T19:20:16.323213] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-30T19:20:16.699552] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:20:16.736717] [INFO ] [REMOTE ] IFN: Full fetch complete (29052 records). [2025-09-30T19:20:16.750356] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-30T19:20:16.750755] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-30T19:20:16.750966] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-30T19:20:16.751851] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-30T19:20:16.757437] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-30T19:20:16.868201] [DEBUG] [LOCAL ] IEX: Trimmed 53413 records to 38324 (keeping 200 days of data) [2025-09-30T19:20:17.059534] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-30T19:20:17.262049] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:20:17.301463] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-30T19:20:17.304150] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-30T19:20:17.305771] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-30T19:20:17.306703] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-30T19:20:17.319288] [DEBUG] [LOCAL ] IFN: Trimmed 29052 records to 18249 (keeping 200 days of data) [2025-09-30T19:20:17.543947] [DEBUG] [LOCAL ] IEX: Primary data saved (38324 records). [2025-09-30T19:20:17.544681] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-30T19:20:17.544827] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 36.6s. Estimated remaining: 2h 44m 15s. Rate: 7.8 symbols/min [2025-09-30T19:20:17.694705] [DEBUG] [LOCAL ] IFN: Primary data saved (18249 records). [2025-09-30T19:20:17.719226] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-30T19:20:17.744208] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:17.741219] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 30.4s. Estimated remaining: 2h 43m 58s. Rate: 7.8 symbols/min [2025-09-30T19:20:17.854951] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-30T19:20:17.875278] [DEBUG] [LOCAL ] IGA: Loaded 9733 existing records from primary storage. [2025-09-30T19:20:17.914386] [INFO ] [MAIN ] IGA: Loaded 9733 existing records. [2025-09-30T19:20:18.014429] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:18.154082] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:18.161162] [DEBUG] [LOCAL ] IGD: Loaded 18910 existing records from primary storage. [2025-09-30T19:20:18.160797] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-30T19:20:18.161514] [INFO ] [MAIN ] IGD: Loaded 18910 existing records. [2025-09-30T19:20:18.161410] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-30T19:20:18.232996] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-30T19:20:18.270239] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-30T19:20:18.506850] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:18.549284] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-30T19:20:18.590736] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-30T19:20:18.633918] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-30T19:20:18.658085] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-30T19:20:18.989702] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T19:20:18.976992] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:19.046345] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-30T19:20:19.248402] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:19.282979] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:20:19.295045] [INFO ] [REMOTE ] IFF: Full fetch complete (73018 records). [2025-09-30T19:20:19.295225] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-30T19:20:19.464060] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-30T19:20:19.729910] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-30T19:20:19.729998] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-30T19:20:19.731078] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-30T19:20:19.731147] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-30T19:20:19.732745] [DEBUG] [LOCAL ] IFF: Trimmed 73018 records to 50986 (keeping 200 days of data) [2025-09-30T19:20:20.073197] [DEBUG] [LOCAL ] IFF: Primary data saved (50986 records). [2025-09-30T19:20:20.073478] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-30T19:20:20.073584] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 35.4s. Estimated remaining: 2h 43m 44s. Rate: 7.8 symbols/min [2025-09-30T19:20:20.264003] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-30T19:20:20.265010] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:20.272148] [DEBUG] [LOCAL ] IGI: Loaded 3620 existing records from primary storage. [2025-09-30T19:20:20.272348] [INFO ] [MAIN ] IGI: Loaded 3620 existing records. [2025-09-30T19:20:20.426208] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:20:20.505802] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:20.516992] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-30T19:20:20.517766] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-30T19:20:20.518312] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T19:20:20.522913] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-30T19:20:20.522999] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-30T19:20:20.920106] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:20.987710] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:20:21.054388] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-30T19:20:21.662768] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T19:20:21.854378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-30T19:20:22.654370] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-30T19:20:23.074242] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T19:20:23.427801] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:20:23.454350] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-30T19:20:24.254338] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-30T19:20:24.651112] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:20:24.717428] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T19:20:25.054403] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-30T19:20:25.654880] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:20:25.854375] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-30T19:20:26.654337] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-30T19:20:26.968402] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:20:27.087104] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:20:27.454400] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-30T19:20:28.254387] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-30T19:20:28.468904] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:20:29.054379] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-30T19:20:29.383555] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:20:29.653121] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:20:29.854348] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-30T19:20:30.491303] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:20:30.654369] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-30T19:20:31.134579] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:20:31.454426] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-30T19:20:32.254432] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-30T19:20:32.542399] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:20:32.999271] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:20:33.054402] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-30T19:20:33.854385] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-30T19:20:34.169079] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:20:34.458685] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:20:34.654399] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-30T19:20:35.264214] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T19:20:35.454398] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-30T19:20:36.254365] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-30T19:20:36.448217] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:20:36.753377] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T19:20:37.054360] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-30T19:20:37.695298] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:20:37.697541] [INFO ] [REMOTE ] IGI: Full fetch complete (5272 records). [2025-09-30T19:20:37.697676] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-30T19:20:37.860806] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-30T19:20:38.096507] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-30T19:20:38.096615] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-30T19:20:38.096822] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-30T19:20:38.096876] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-30T19:20:38.097252] [DEBUG] [LOCAL ] IGI: Trimmed 5272 records to 3617 (keeping 200 days of data) [2025-09-30T19:20:38.123100] [DEBUG] [LOCAL ] IGI: Primary data saved (3617 records). [2025-09-30T19:20:38.123202] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-30T19:20:38.123282] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IGI took 18.0s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min [2025-09-30T19:20:38.295352] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:38.339082] [DEBUG] [LOCAL ] IGR: Loaded 30457 existing records from primary storage. [2025-09-30T19:20:38.339429] [INFO ] [MAIN ] IGR: Loaded 30457 existing records. [2025-09-30T19:20:38.537318] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:38.537794] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-30T19:20:38.537858] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-30T19:20:38.538271] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-30T19:20:38.538337] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-30T19:20:38.659512] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-30T19:20:38.762115] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T19:20:38.956263] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:39.454346] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-30T19:20:39.807909] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:20:40.254371] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-30T19:20:40.349270] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T19:20:41.054392] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-30T19:20:41.335511] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T19:20:41.854358] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-30T19:20:42.123805] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:20:42.654362] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-30T19:20:43.103564] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:20:43.108984] [INFO ] [REMOTE ] IFS: Full fetch complete (31604 records). [2025-09-30T19:20:43.109104] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-30T19:20:43.470422] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-30T19:20:43.524375] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-30T19:20:43.524470] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-30T19:20:43.525134] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-30T19:20:43.525205] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-30T19:20:43.526544] [DEBUG] [LOCAL ] IFS: Trimmed 31604 records to 22986 (keeping 200 days of data) [2025-09-30T19:20:43.666081] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:20:43.706751] [DEBUG] [LOCAL ] IFS: Primary data saved (22986 records). [2025-09-30T19:20:43.706899] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-30T19:20:43.707002] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IFS took 29.7s. Estimated remaining: 2h 43m 39s. Rate: 7.8 symbols/min [2025-09-30T19:20:43.898459] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:43.904471] [DEBUG] [LOCAL ] IH: Loaded 3313 existing records from primary storage. [2025-09-30T19:20:43.904724] [INFO ] [MAIN ] IH: Loaded 3313 existing records. [2025-09-30T19:20:44.071455] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:20:44.105455] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:44.106069] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-30T19:20:44.106133] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-30T19:20:44.106371] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-30T19:20:44.106432] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-30T19:20:44.264328] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-30T19:20:44.506624] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:45.054367] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-30T19:20:45.651372] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:20:45.854379] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-30T19:20:45.877611] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T19:20:46.654377] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-30T19:20:47.059446] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:20:47.454398] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-30T19:20:47.807905] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:20:48.254333] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-30T19:20:48.418712] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T19:20:48.660772] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T19:20:49.054397] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-30T19:20:49.854364] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-30T19:20:50.358318] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T19:20:50.431109] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:20:50.654363] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-30T19:20:51.454369] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-30T19:20:51.958233] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:20:52.258039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-30T19:20:52.260932] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:20:52.832376] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T19:20:53.054375] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-30T19:20:53.625515] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T19:20:53.854367] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-30T19:20:54.322712] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T19:20:54.654356] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-30T19:20:55.454351] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-30T19:20:55.876978] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T19:20:55.957388] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:20:56.254350] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-30T19:20:56.746127] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T19:20:57.054376] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-30T19:20:57.854366] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-30T19:20:58.440859] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:20:58.468275] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:20:58.654380] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-30T19:20:59.354710] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T19:20:59.454354] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-30T19:21:00.254337] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-30T19:21:00.965296] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:21:00.968396] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:21:00.976918] [INFO ] [REMOTE ] IH: Full fetch complete (4971 records). [2025-09-30T19:21:00.977109] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-30T19:21:01.059514] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-30T19:21:01.383232] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-30T19:21:01.383314] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-30T19:21:01.383473] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-30T19:21:01.383513] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-30T19:21:01.383927] [DEBUG] [LOCAL ] IH: Trimmed 4971 records to 3225 (keeping 200 days of data) [2025-09-30T19:21:01.403581] [DEBUG] [LOCAL ] IH: Primary data saved (3225 records). [2025-09-30T19:21:01.403763] [INFO ] [MAIN ] IH: Full history saved. [2025-09-30T19:21:01.403866] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IH took 17.7s. Estimated remaining: 2h 43m 42s. Rate: 7.8 symbols/min [2025-09-30T19:21:01.626104] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:01.637532] [DEBUG] [LOCAL ] IHD: Loaded 6922 existing records from primary storage. [2025-09-30T19:21:01.637804] [INFO ] [MAIN ] IHD: Loaded 6922 existing records. [2025-09-30T19:21:01.857354] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-30T19:21:01.857252] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:01.858826] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-30T19:21:01.859071] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-30T19:21:01.859381] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-30T19:21:01.859630] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-30T19:21:01.998569] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:21:02.306376] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:02.397983] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T19:21:02.654378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-30T19:21:03.454336] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-30T19:21:03.740547] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T19:21:03.744679] [INFO ] [REMOTE ] IGD: Full fetch complete (29631 records). [2025-09-30T19:21:03.744782] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-30T19:21:04.159206] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-30T19:21:04.159325] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-30T19:21:04.159986] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-30T19:21:04.160053] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-30T19:21:04.161021] [DEBUG] [LOCAL ] IGD: Trimmed 29631 records to 19008 (keeping 200 days of data) [2025-09-30T19:21:04.254489] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-30T19:21:04.289784] [DEBUG] [LOCAL ] IGD: Primary data saved (19008 records). [2025-09-30T19:21:04.290004] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-30T19:21:04.290152] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 46.5s. Estimated remaining: 2h 43m 29s. Rate: 7.8 symbols/min [2025-09-30T19:21:04.431587] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T19:21:04.450243] [INFO ] [REMOTE ] IGA: Full fetch complete (13690 records). [2025-09-30T19:21:04.473743] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-30T19:21:04.504469] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:04.791004] [DEBUG] [LOCAL ] IHG: Loaded 24500 existing records from primary storage. [2025-09-30T19:21:04.798186] [INFO ] [MAIN ] IHG: Loaded 24500 existing records. [2025-09-30T19:21:04.983935] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T19:21:05.055685] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-30T19:21:05.088903] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-30T19:21:05.094971] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-30T19:21:05.113189] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-30T19:21:05.119357] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-30T19:21:05.159737] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:05.160445] [DEBUG] [LOCAL ] IGA: Trimmed 13690 records to 9775 (keeping 200 days of data) [2025-09-30T19:21:05.160712] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-30T19:21:05.161141] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-30T19:21:05.161488] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-30T19:21:05.161558] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-30T19:21:05.579899] [DEBUG] [LOCAL ] IGA: Primary data saved (9775 records). [2025-09-30T19:21:05.595342] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-30T19:21:05.605733] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGA took 48.1s. Estimated remaining: 2h 43m 14s. Rate: 7.8 symbols/min [2025-09-30T19:21:05.776059] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:05.864885] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-30T19:21:05.869242] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:05.929944] [DEBUG] [LOCAL ] IHS: Loaded 38991 existing records from primary storage. [2025-09-30T19:21:05.930303] [INFO ] [MAIN ] IHS: Loaded 38991 existing records. [2025-09-30T19:21:06.142780] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:06.142997] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-30T19:21:06.143047] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-30T19:21:06.143291] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-30T19:21:06.143350] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-30T19:21:06.562216] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:06.636953] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:21:06.655569] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-30T19:21:06.660154] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:21:06.667513] [INFO ] [REMOTE ] IGR: Full fetch complete (45785 records). [2025-09-30T19:21:06.667704] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-30T19:21:07.079933] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-30T19:21:07.080015] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-30T19:21:07.080821] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-30T19:21:07.080899] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-30T19:21:07.082102] [DEBUG] [LOCAL ] IGR: Trimmed 45785 records to 30505 (keeping 200 days of data) [2025-09-30T19:21:07.271709] [DEBUG] [LOCAL ] IGR: Primary data saved (30505 records). [2025-09-30T19:21:07.271864] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-30T19:21:07.272463] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IGR took 29.1s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-09-30T19:21:07.459526] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-30T19:21:07.463992] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:07.475935] [DEBUG] [LOCAL ] IIF: Loaded 5715 existing records from primary storage. [2025-09-30T19:21:07.476206] [INFO ] [MAIN ] IIF: Loaded 5715 existing records. [2025-09-30T19:21:07.681896] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:07.682337] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-30T19:21:07.682439] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-30T19:21:07.682686] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-30T19:21:07.682750] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-30T19:21:07.844138] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T19:21:08.077281] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:08.254387] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-30T19:21:09.044494] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T19:21:09.054315] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-30T19:21:09.143020] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T19:21:09.556034] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T19:21:09.854419] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-30T19:21:10.654564] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-30T19:21:10.989829] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T19:21:11.430428] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:21:11.454374] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-30T19:21:12.254390] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-30T19:21:12.308007] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T19:21:13.054317] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-30T19:21:13.307013] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:21:13.847436] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:21:13.854310] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-30T19:21:14.654361] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-30T19:21:14.995119] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:21:15.259487] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:21:15.454362] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-30T19:21:16.254357] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-30T19:21:16.616745] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T19:21:17.054382] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-30T19:21:17.264672] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:21:17.821361] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:21:17.854394] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-30T19:21:18.520877] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T19:21:18.654391] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-30T19:21:19.431693] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T19:21:19.454421] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-30T19:21:20.040356] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:21:20.254393] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-30T19:21:21.054373] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-30T19:21:21.700246] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:21:21.854347] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-30T19:21:22.397546] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T19:21:22.654366] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-30T19:21:23.460386] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-30T19:21:23.484220] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:21:23.905976] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:21:24.259628] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-30T19:21:24.263621] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T19:21:25.054448] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-30T19:21:25.479322] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:21:25.848624] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:21:25.854302] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-30T19:21:26.457261] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:21:26.654376] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-30T19:21:27.454328] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-30T19:21:27.613072] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:21:28.254366] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-30T19:21:28.363164] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:21:28.365390] [INFO ] [REMOTE ] IHD: Full fetch complete (11839 records). [2025-09-30T19:21:28.365462] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-30T19:21:28.758858] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-30T19:21:28.758952] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-30T19:21:28.759269] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-30T19:21:28.759316] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-30T19:21:28.759834] [DEBUG] [LOCAL ] IHD: Trimmed 11839 records to 6983 (keeping 200 days of data) [2025-09-30T19:21:28.803032] [DEBUG] [LOCAL ] IHD: Primary data saved (6983 records). [2025-09-30T19:21:28.803178] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-30T19:21:28.803266] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 27.4s. Estimated remaining: 2h 43m 8s. Rate: 7.8 symbols/min [2025-09-30T19:21:28.992362] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:29.011808] [DEBUG] [LOCAL ] IIIN: Loaded 16511 existing records from primary storage. [2025-09-30T19:21:29.012060] [INFO ] [MAIN ] IIIN: Loaded 16511 existing records. [2025-09-30T19:21:29.059913] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-30T19:21:29.216046] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:29.216260] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-30T19:21:29.216309] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-30T19:21:29.216537] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-30T19:21:29.216606] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-30T19:21:29.635274] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:29.642326] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:21:29.683959] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:21:29.854346] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-30T19:21:30.654379] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-30T19:21:30.999535] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:21:31.454362] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-30T19:21:31.769051] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T19:21:31.798728] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:21:32.254363] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-30T19:21:33.054416] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-30T19:21:33.690088] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T19:21:33.743730] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T19:21:33.854352] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-30T19:21:34.654361] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-30T19:21:35.213270] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T19:21:35.220472] [INFO ] [REMOTE ] IHS: Full fetch complete (51979 records). [2025-09-30T19:21:35.220593] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-30T19:21:35.347540] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:21:35.459454] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-30T19:21:35.689889] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-30T19:21:35.689979] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-30T19:21:35.690900] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-30T19:21:35.691016] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-30T19:21:35.692321] [DEBUG] [LOCAL ] IHS: Trimmed 51979 records to 39106 (keeping 200 days of data) [2025-09-30T19:21:35.918610] [DEBUG] [LOCAL ] IHS: Primary data saved (39106 records). [2025-09-30T19:21:35.918823] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-30T19:21:35.918957] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 30.3s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-09-30T19:21:36.037264] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:21:36.055031] [INFO ] [REMOTE ] IIF: Full fetch complete (9469 records). [2025-09-30T19:21:36.065438] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-30T19:21:36.202002] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:36.256369] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-30T19:21:36.408848] [DEBUG] [LOCAL ] IIM: Loaded 15934 existing records from primary storage. [2025-09-30T19:21:36.441274] [INFO ] [MAIN ] IIM: Loaded 15934 existing records. [2025-09-30T19:21:36.715300] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-30T19:21:36.732942] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-30T19:21:36.744631] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-30T19:21:36.753459] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-30T19:21:36.781620] [DEBUG] [LOCAL ] IIF: Trimmed 9469 records to 5721 (keeping 200 days of data) [2025-09-30T19:21:36.781247] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:36.782057] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-30T19:21:36.782528] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-30T19:21:36.782857] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-30T19:21:36.782928] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-30T19:21:36.942199] [DEBUG] [LOCAL ] IIF: Primary data saved (5721 records). [2025-09-30T19:21:36.948319] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-30T19:21:36.953625] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 29.7s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-09-30T19:21:37.061631] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-30T19:21:37.339404] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:37.432954] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:37.456555] [DEBUG] [LOCAL ] IIPR: Loaded 29651 existing records from primary storage. [2025-09-30T19:21:37.456904] [INFO ] [MAIN ] IIPR: Loaded 29651 existing records. [2025-09-30T19:21:37.616287] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:21:37.681283] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:37.681514] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-30T19:21:37.681563] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-30T19:21:37.681939] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-30T19:21:37.682003] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-30T19:21:37.866816] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-30T19:21:38.071210] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:38.090853] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:21:38.654389] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-30T19:21:38.732595] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T19:21:39.454370] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-30T19:21:40.124042] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:21:40.254368] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-30T19:21:40.595987] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:21:41.054370] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-30T19:21:41.723453] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:21:41.854369] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-30T19:21:42.140808] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:21:42.654404] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-30T19:21:43.127923] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:21:43.132972] [INFO ] [REMOTE ] IHG: Full fetch complete (33728 records). [2025-09-30T19:21:43.133116] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-30T19:21:43.455904] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-30T19:21:43.573917] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-30T19:21:43.574027] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-30T19:21:43.574840] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-30T19:21:43.574906] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-30T19:21:43.575863] [DEBUG] [LOCAL ] IHG: Trimmed 33728 records to 24441 (keeping 200 days of data) [2025-09-30T19:21:43.688699] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:21:43.757592] [DEBUG] [LOCAL ] IHG: Primary data saved (24441 records). [2025-09-30T19:21:43.757774] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-30T19:21:43.757888] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHG took 39.5s. Estimated remaining: 2h 42m 35s. Rate: 7.8 symbols/min [2025-09-30T19:21:43.943151] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:43.991622] [DEBUG] [LOCAL ] IMAX: Loaded 42742 existing records from primary storage. [2025-09-30T19:21:43.991963] [INFO ] [MAIN ] IMAX: Loaded 42742 existing records. [2025-09-30T19:21:44.186300] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:44.186533] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-30T19:21:44.186579] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-30T19:21:44.187025] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-30T19:21:44.187115] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-30T19:21:44.259470] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-30T19:21:44.606452] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:44.881597] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T19:21:45.054374] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-30T19:21:45.423606] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:21:45.854346] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-30T19:21:46.441471] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:21:46.462539] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:21:46.654354] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-30T19:21:47.454366] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-30T19:21:47.783094] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T19:21:48.254398] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-30T19:21:48.956240] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T19:21:49.054406] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-30T19:21:49.263031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:21:49.854351] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-30T19:21:50.478470] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:21:50.654373] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-30T19:21:50.855461] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T19:21:51.454359] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-30T19:21:51.630706] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:21:52.254352] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-30T19:21:52.521844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:21:53.054374] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-30T19:21:53.274847] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T19:21:53.854352] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-30T19:21:54.491444] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:21:54.654373] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-30T19:21:55.399675] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:21:55.454366] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-30T19:21:55.754234] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T19:21:56.254363] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-30T19:21:56.985929] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:21:57.054381] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-30T19:21:57.184242] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T19:21:57.854356] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-30T19:21:57.897483] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T19:21:58.654344] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-30T19:21:59.046944] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T19:21:59.454360] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-30T19:21:59.576092] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:22:00.254359] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-30T19:22:00.656610] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:22:01.054388] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-30T19:22:01.251814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T19:22:01.256582] [INFO ] [REMOTE ] IIIN: Full fetch complete (24988 records). [2025-09-30T19:22:01.256793] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-30T19:22:01.710547] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-30T19:22:01.710734] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-30T19:22:01.711508] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-30T19:22:01.711590] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-30T19:22:01.725064] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T19:22:01.725199] [DEBUG] [LOCAL ] IIIN: Trimmed 24988 records to 16449 (keeping 200 days of data) [2025-09-30T19:22:01.840103] [DEBUG] [LOCAL ] IIIN: Primary data saved (16449 records). [2025-09-30T19:22:01.840265] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-30T19:22:01.840357] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 33.0s. Estimated remaining: 2h 42m 39s. Rate: 7.8 symbols/min [2025-09-30T19:22:01.863276] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-30T19:22:02.047558] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:02.104098] [DEBUG] [LOCAL ] INFA: Loaded 49743 existing records from primary storage. [2025-09-30T19:22:02.104557] [INFO ] [MAIN ] INFA: Loaded 49743 existing records. [2025-09-30T19:22:02.333884] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:02.334125] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-30T19:22:02.334175] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-30T19:22:02.334720] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-30T19:22:02.334781] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-30T19:22:02.659486] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-30T19:22:02.762921] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:03.391039] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:22:03.454365] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-30T19:22:03.905770] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:22:03.910275] [INFO ] [REMOTE ] IIM: Full fetch complete (25346 records). [2025-09-30T19:22:03.910427] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-30T19:22:04.259452] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-30T19:22:04.332993] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-30T19:22:04.333084] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-30T19:22:04.333700] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-30T19:22:04.333767] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-30T19:22:04.334566] [DEBUG] [LOCAL ] IIM: Trimmed 25346 records to 15962 (keeping 200 days of data) [2025-09-30T19:22:04.450607] [DEBUG] [LOCAL ] IIM: Primary data saved (15962 records). [2025-09-30T19:22:04.451097] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-30T19:22:04.451396] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 28.5s. Estimated remaining: 2h 42m 26s. Rate: 7.8 symbols/min [2025-09-30T19:22:04.649159] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:04.670621] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T19:22:04.736583] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-30T19:22:04.736963] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-09-30T19:22:04.939541] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:04.939845] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-30T19:22:04.939909] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-30T19:22:04.940512] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-30T19:22:04.940574] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-30T19:22:05.059517] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-30T19:22:05.354316] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:05.790868] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:22:05.854332] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-30T19:22:06.564287] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T19:22:06.654361] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-30T19:22:07.454368] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-30T19:22:07.535046] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:22:07.974810] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:22:08.254394] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-30T19:22:08.868540] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:22:09.054401] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-30T19:22:09.834888] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:22:09.854302] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-30T19:22:10.488806] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:22:10.654379] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-30T19:22:11.407102] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:22:11.416956] [INFO ] [REMOTE ] IMAX: Full fetch complete (59731 records). [2025-09-30T19:22:11.417121] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-30T19:22:11.463873] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-30T19:22:11.877441] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-30T19:22:11.877574] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-30T19:22:11.879241] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-30T19:22:11.879322] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-30T19:22:11.880910] [DEBUG] [LOCAL ] IMAX: Trimmed 59731 records to 42737 (keeping 200 days of data) [2025-09-30T19:22:12.150807] [DEBUG] [LOCAL ] IMAX: Primary data saved (42737 records). [2025-09-30T19:22:12.150953] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-30T19:22:12.151153] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IMAX took 28.4s. Estimated remaining: 2h 42m 18s. Rate: 7.8 symbols/min [2025-09-30T19:22:12.259839] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-30T19:22:12.355677] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:12.378045] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:22:12.440339] [DEBUG] [LOCAL ] ING: Loaded 50745 existing records from primary storage. [2025-09-30T19:22:12.440703] [INFO ] [MAIN ] ING: Loaded 50745 existing records. [2025-09-30T19:22:12.640282] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:12.640854] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-30T19:22:12.640978] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-30T19:22:12.642082] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-30T19:22:12.642324] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-30T19:22:12.753363] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T19:22:12.790929] [INFO ] [REMOTE ] IIPR: Full fetch complete (44441 records). [2025-09-30T19:22:12.796782] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-30T19:22:13.055619] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-30T19:22:13.403369] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:13.516819] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-30T19:22:13.516953] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-30T19:22:13.518316] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-30T19:22:13.518401] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-30T19:22:13.520758] [DEBUG] [LOCAL ] IIPR: Trimmed 44441 records to 29709 (keeping 200 days of data) [2025-09-30T19:22:13.659852] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T19:22:13.758265] [DEBUG] [LOCAL ] IIPR: Primary data saved (29709 records). [2025-09-30T19:22:13.758423] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-30T19:22:13.758555] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IIPR took 36.8s. Estimated remaining: 2h 42m 3s. Rate: 7.8 symbols/min [2025-09-30T19:22:13.859442] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-30T19:22:13.948971] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:13.987247] [DEBUG] [LOCAL ] INGM: Loaded 28641 existing records from primary storage. [2025-09-30T19:22:13.987561] [INFO ] [MAIN ] INGM: Loaded 28641 existing records. [2025-09-30T19:22:14.183940] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:14.184178] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-30T19:22:14.184229] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-30T19:22:14.184547] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-30T19:22:14.184621] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-30T19:22:14.592543] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:14.623353] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:22:14.654385] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-30T19:22:15.279208] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:22:15.454378] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-30T19:22:16.254345] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-30T19:22:16.324533] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:22:17.022808] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:22:17.054386] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-30T19:22:17.799572] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:22:17.854346] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-30T19:22:18.654386] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-30T19:22:18.718713] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:22:19.454325] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-30T19:22:19.885201] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T19:22:20.254402] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-30T19:22:20.330310] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:22:21.054366] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-30T19:22:21.280012] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:22:21.854357] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-30T19:22:22.157353] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:22:22.401044] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:22:22.654402] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-30T19:22:23.069688] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:22:23.454377] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-30T19:22:24.254379] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-30T19:22:24.401743] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T19:22:24.900247] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:22:25.054380] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-30T19:22:25.457092] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:22:25.854355] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-30T19:22:26.654348] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-30T19:22:26.872740] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:22:26.901433] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:22:27.454421] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-30T19:22:28.088431] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T19:22:28.254375] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-30T19:22:28.867747] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:22:29.054373] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-30T19:22:29.854403] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-30T19:22:29.964449] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:22:30.413381] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:22:30.654416] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-30T19:22:31.454335] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-30T19:22:31.713926] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:22:31.901617] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:22:32.254408] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-30T19:22:32.842696] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:22:32.854685] [INFO ] [REMOTE ] INFA: Full fetch complete (71521 records). [2025-09-30T19:22:32.854865] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-30T19:22:33.060541] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-30T19:22:33.298521] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-30T19:22:33.298619] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-30T19:22:33.299732] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-30T19:22:33.299803] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-30T19:22:33.301476] [DEBUG] [LOCAL ] INFA: Trimmed 71521 records to 49666 (keeping 200 days of data) [2025-09-30T19:22:33.620437] [DEBUG] [LOCAL ] INFA: Primary data saved (49666 records). [2025-09-30T19:22:33.620581] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-30T19:22:33.620707] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 31.8s. Estimated remaining: 2h 42m 10s. Rate: 7.8 symbols/min [2025-09-30T19:22:33.825196] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:33.861960] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-30T19:22:33.865102] [DEBUG] [LOCAL ] INGR: Loaded 33254 existing records from primary storage. [2025-09-30T19:22:33.865763] [INFO ] [MAIN ] INGR: Loaded 33254 existing records. [2025-09-30T19:22:34.059744] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:34.060085] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-30T19:22:34.060143] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-30T19:22:34.060830] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-30T19:22:34.060899] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-30T19:22:34.213920] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:22:34.552920] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:34.654376] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-30T19:22:34.788415] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:22:35.008358] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:22:35.454430] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-30T19:22:36.254418] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-30T19:22:36.613001] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T19:22:36.675940] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-30T19:22:37.054432] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-30T19:22:37.854374] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-30T19:22:38.016774] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:22:38.211088] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:22:38.654393] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-30T19:22:38.710024] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:22:39.454423] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-30T19:22:40.208017] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:22:40.226847] [INFO ] [REMOTE ] INFY: Full fetch complete (77544 records). [2025-09-30T19:22:40.227130] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-30T19:22:40.259550] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-30T19:22:40.697994] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-30T19:22:40.698107] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-30T19:22:40.699251] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-30T19:22:40.699338] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-30T19:22:40.701018] [DEBUG] [LOCAL ] INFY: Trimmed 77544 records to 53598 (keeping 200 days of data) [2025-09-30T19:22:41.057001] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-30T19:22:41.079464] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-30T19:22:41.079833] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-30T19:22:41.080103] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 36.6s. Estimated remaining: 2h 42m 2s. Rate: 7.8 symbols/min [2025-09-30T19:22:41.156387] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:22:41.291551] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:41.341515] [DEBUG] [LOCAL ] INN: Loaded 41816 existing records from primary storage. [2025-09-30T19:22:41.341919] [INFO ] [MAIN ] INN: Loaded 41816 existing records. [2025-09-30T19:22:41.564682] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:41.564966] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-30T19:22:41.565037] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-30T19:22:41.565639] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-30T19:22:41.565752] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-30T19:22:41.856918] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-30T19:22:42.060722] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:42.170956] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T19:22:42.462359] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:22:42.469043] [INFO ] [REMOTE ] INGM: Full fetch complete (42471 records). [2025-09-30T19:22:42.469160] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-30T19:22:42.664285] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-30T19:22:42.897531] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-30T19:22:42.897623] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-30T19:22:42.898416] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-30T19:22:42.898479] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-30T19:22:42.899539] [DEBUG] [LOCAL ] INGM: Trimmed 42471 records to 28628 (keeping 200 days of data) [2025-09-30T19:22:43.088118] [DEBUG] [LOCAL ] INGM: Primary data saved (28628 records). [2025-09-30T19:22:43.088328] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-30T19:22:43.089251] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INGM took 29.3s. Estimated remaining: 2h 41m 47s. Rate: 7.8 symbols/min [2025-09-30T19:22:43.272699] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:43.272911] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-30T19:22:43.273037] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-30T19:22:43.273207] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-30T19:22:43.273276] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-30T19:22:43.273327] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-30T19:22:43.273361] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-30T19:22:43.463184] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-30T19:22:43.611196] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:22:43.718347] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:43.885554] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:22:44.254393] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-30T19:22:44.488457] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:22:44.488924] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-30T19:22:44.489095] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:22:44.489205] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-30T19:22:44.489271] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:22:44.489342] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-30T19:22:44.489408] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-30T19:22:44.489447] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-30T19:22:44.489486] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-30T19:22:44.489534] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INR took 1.4s. Estimated remaining: 2h 41m 33s. Rate: 7.8 symbols/min [2025-09-30T19:22:44.684381] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:44.743778] [DEBUG] [LOCAL ] INSP: Loaded 36932 existing records from primary storage. [2025-09-30T19:22:44.744114] [INFO ] [MAIN ] INSP: Loaded 36932 existing records. [2025-09-30T19:22:44.950052] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:44.950324] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-30T19:22:44.950378] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-30T19:22:44.950794] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-30T19:22:44.950854] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-30T19:22:45.056157] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-30T19:22:45.359284] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:45.390584] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:22:45.406529] [INFO ] [REMOTE ] ING: Full fetch complete (73622 records). [2025-09-30T19:22:45.406947] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-30T19:22:45.859980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-30T19:22:45.885113] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-30T19:22:45.885195] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-30T19:22:45.886246] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-30T19:22:45.886316] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-30T19:22:45.888016] [DEBUG] [LOCAL ] ING: Trimmed 73622 records to 50722 (keeping 200 days of data) [2025-09-30T19:22:46.207661] [DEBUG] [LOCAL ] ING: Primary data saved (50722 records). [2025-09-30T19:22:46.207803] [INFO ] [MAIN ] ING: Full history saved. [2025-09-30T19:22:46.207886] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. ING took 34.1s. Estimated remaining: 2h 41m 18s. Rate: 7.8 symbols/min [2025-09-30T19:22:46.395994] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:46.439883] [DEBUG] [LOCAL ] INSW: Loaded 40136 existing records from primary storage. [2025-09-30T19:22:46.440273] [INFO ] [MAIN ] INSW: Loaded 40136 existing records. [2025-09-30T19:22:46.648575] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:46.649016] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-30T19:22:46.649228] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-30T19:22:46.649933] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-30T19:22:46.650045] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-30T19:22:46.655285] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-30T19:22:46.801106] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:22:47.090120] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:47.350717] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:22:47.454359] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-30T19:22:48.018618] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:22:48.254410] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-30T19:22:48.979617] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:22:49.054383] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-30T19:22:49.686481] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:22:49.854392] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-30T19:22:50.328815] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:22:50.654361] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-30T19:22:51.264554] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:22:51.454401] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-30T19:22:52.241098] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:22:52.254308] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-30T19:22:53.054436] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-30T19:22:53.854376] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-30T19:23:05.438295] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (11.58 seconds). [2025-09-30T19:23:05.445989] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-30T19:23:05.796422] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (12.74 seconds). [2025-09-30T19:23:05.804881] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-30T19:23:06.425537] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (14.17 seconds). [2025-09-30T19:23:06.435851] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-30T19:23:07.096867] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (15.64 seconds). [2025-09-30T19:23:07.105386] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-30T19:23:07.146281] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:23:07.153837] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-30T19:23:08.117757] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:23:08.127129] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-30T19:23:08.326044] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-30T19:23:08.333966] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-30T19:23:08.404382] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T19:23:08.416186] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-30T19:23:08.709455] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:23:08.719973] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-30T19:23:09.478381] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T19:23:09.507117] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-30T19:23:09.508773] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:23:09.517857] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-30T19:23:09.769428] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:23:09.779196] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-30T19:23:10.304631] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T19:23:10.315918] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-30T19:23:10.430457] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T19:23:10.438486] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-30T19:23:10.776244] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T19:23:10.783989] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-30T19:23:11.477716] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:23:11.487437] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-30T19:23:11.964864] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:23:11.975274] [INFO ] [REMOTE ] INGR: Full fetch complete (50065 records). [2025-09-30T19:23:11.975535] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-30T19:23:12.164084] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:23:12.269564] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-30T19:23:12.496468] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-30T19:23:12.506333] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-30T19:23:12.507444] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-30T19:23:12.507557] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-30T19:23:12.510732] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:23:12.521021] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-30T19:23:12.521183] [DEBUG] [LOCAL ] INGR: Trimmed 50065 records to 33275 (keeping 200 days of data) [2025-09-30T19:23:12.754444] [DEBUG] [LOCAL ] INGR: Primary data saved (33275 records). [2025-09-30T19:23:12.754674] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-30T19:23:12.754812] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INGR took 39.1s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min [2025-09-30T19:23:12.955295] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:13.023010] [DEBUG] [LOCAL ] INVH: Loaded 53135 existing records from primary storage. [2025-09-30T19:23:13.023398] [INFO ] [MAIN ] INVH: Loaded 53135 existing records. [2025-09-30T19:23:13.256536] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:23:13.266422] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:13.275407] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-30T19:23:13.275522] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-30T19:23:13.276708] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-30T19:23:13.276822] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-30T19:23:13.276605] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-30T19:23:13.706436] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:13.706999] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-30T19:23:13.736683] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:23:13.747177] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-30T19:23:14.390610] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T19:23:14.403866] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-30T19:23:14.952625] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:23:14.962453] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-30T19:23:15.035126] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T19:23:15.044500] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-30T19:23:15.201384] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:23:15.212973] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-30T19:23:15.972105] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:23:15.982792] [INFO ] [REMOTE ] INSP: Full fetch complete (52837 records). [2025-09-30T19:23:15.982945] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-30T19:23:16.414133] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-30T19:23:16.414256] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-30T19:23:16.415142] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-30T19:23:16.415224] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-30T19:23:16.416734] [DEBUG] [LOCAL ] INSP: Trimmed 52837 records to 37045 (keeping 200 days of data) [2025-09-30T19:23:16.566194] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:23:16.583193] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-30T19:23:16.669748] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:23:16.709030] [INFO ] [REMOTE ] INN: Full fetch complete (57808 records). [2025-09-30T19:23:16.716725] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-30T19:23:16.914486] [DEBUG] [LOCAL ] INSP: Primary data saved (37045 records). [2025-09-30T19:23:16.921883] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-30T19:23:16.923208] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 32.4s. Estimated remaining: 2h 41m 20s. Rate: 7.8 symbols/min [2025-09-30T19:23:17.204767] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T19:23:17.295887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-30T19:23:17.358316] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:17.434417] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-30T19:23:17.434506] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-30T19:23:17.435348] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-30T19:23:17.435417] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-30T19:23:17.436826] [DEBUG] [LOCAL ] INN: Trimmed 57808 records to 41730 (keeping 200 days of data) [2025-09-30T19:23:17.562088] [DEBUG] [LOCAL ] INVX: Loaded 29009 existing records from primary storage. [2025-09-30T19:23:17.566313] [INFO ] [MAIN ] INVX: Loaded 29009 existing records. [2025-09-30T19:23:17.775225] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:17.778329] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-30T19:23:17.778505] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-30T19:23:17.779034] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-30T19:23:17.779113] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-30T19:23:18.089049] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:23:18.150965] [INFO ] [REMOTE ] INSW: Full fetch complete (60605 records). [2025-09-30T19:23:18.175464] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-30T19:23:18.446620] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:18.453360] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-30T19:23:18.498408] [DEBUG] [LOCAL ] INN: Primary data saved (41730 records). [2025-09-30T19:23:18.504178] [INFO ] [MAIN ] INN: Full history saved. [2025-09-30T19:23:18.524503] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INN took 37.4s. Estimated remaining: 2h 41m 5s. Rate: 7.8 symbols/min [2025-09-30T19:23:18.896978] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:18.977273] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-30T19:23:18.977394] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-30T19:23:18.978585] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-30T19:23:18.978766] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-30T19:23:18.991392] [DEBUG] [LOCAL ] INSW: Trimmed 60605 records to 40060 (keeping 200 days of data) [2025-09-30T19:23:19.018540] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:23:19.083496] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-30T19:23:19.186513] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-30T19:23:19.194004] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-30T19:23:19.514566] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:19.515629] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-30T19:23:19.516307] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-30T19:23:19.519244] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-30T19:23:19.519578] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-30T19:23:19.980496] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:19.981020] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-30T19:23:19.980711] [DEBUG] [LOCAL ] INSW: Primary data saved (40060 records). [2025-09-30T19:23:19.982237] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-30T19:23:19.982365] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 33.8s. Estimated remaining: 2h 40m 51s. Rate: 7.8 symbols/min [2025-09-30T19:23:20.099250] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:23:20.108027] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-30T19:23:20.877070] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:23:20.889829] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-30T19:23:21.476189] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T19:23:21.484179] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-30T19:23:22.272814] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:23:22.285141] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-30T19:23:22.413763] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:23:22.420471] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-30T19:23:22.688596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-30T19:23:22.700181] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-30T19:23:23.406257] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:23:23.454412] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-30T19:23:24.109778] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:23:24.254407] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-30T19:23:24.897364] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:23:25.054330] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-30T19:23:25.387906] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-30T19:23:25.854369] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-30T19:23:25.927043] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:23:26.318012] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:23:26.654566] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-30T19:23:27.454411] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-30T19:23:27.946557] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T19:23:28.259457] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-30T19:23:28.280813] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-30T19:23:29.003720] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:23:29.054381] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-30T19:23:29.252058] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:23:29.854402] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-30T19:23:30.654404] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-30T19:23:31.472987] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-30T19:23:31.485337] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-30T19:23:31.682714] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:23:31.751464] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:23:32.254343] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-30T19:23:33.054423] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-30T19:23:33.785137] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:23:33.797051] [INFO ] [REMOTE ] INVH: Full fetch complete (76726 records). [2025-09-30T19:23:33.797262] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-30T19:23:34.266322] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-30T19:23:34.266608] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-30T19:23:34.267729] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-30T19:23:34.268027] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-30T19:23:34.290192] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:23:34.288023] [DEBUG] [LOCAL ] INVH: Trimmed 76726 records to 53130 (keeping 200 days of data) [2025-09-30T19:23:34.297521] [INFO ] [REMOTE ] INVX: Full fetch complete (44239 records). [2025-09-30T19:23:34.297752] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-30T19:23:34.515160] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-30T19:23:34.578583] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-30T19:23:34.928473] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-30T19:23:34.929755] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-30T19:23:34.931481] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-30T19:23:34.931568] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-30T19:23:34.937222] [DEBUG] [LOCAL ] INVX: Trimmed 44239 records to 29027 (keeping 200 days of data) [2025-09-30T19:23:35.255526] [DEBUG] [LOCAL ] INVX: Primary data saved (29027 records). [2025-09-30T19:23:35.256150] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-30T19:23:35.256279] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 18.3s. Estimated remaining: 2h 40m 52s. Rate: 7.8 symbols/min [2025-09-30T19:23:35.358601] [DEBUG] [LOCAL ] INVH: Primary data saved (53130 records). [2025-09-30T19:23:35.358793] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-30T19:23:35.358901] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 22.6s. Estimated remaining: 2h 40m 35s. Rate: 7.8 symbols/min [2025-09-30T19:23:37.409533] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-30T19:23:37.422667] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-30T19:23:39.928769] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-30T19:23:39.941009] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-30T19:23:42.718347] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-30T19:23:42.731922] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-30T19:23:45.432968] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-30T19:23:45.445367] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-30T19:23:48.257443] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-30T19:23:48.271636] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-30T19:23:48.271875] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-30T19:23:48.707741] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-30T19:23:48.707843] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-30T19:23:48.708995] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-30T19:23:48.709107] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-30T19:23:48.711028] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-30T19:23:49.091577] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-30T19:23:49.091767] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-30T19:23:49.091867] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 30.6s. Estimated remaining: 2h 40m 34s. Rate: 7.8 symbols/min [2025-09-30T19:23:49.692980] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.814041] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.900528] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.942057] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.962699] [DEBUG] [LOCAL ] IPI: Loaded 21413 existing records from primary storage. [2025-09-30T19:23:49.963001] [INFO ] [MAIN ] IPI: Loaded 21413 existing records. [2025-09-30T19:23:50.125574] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-30T19:23:50.151189] [INFO ] [MAIN ] IOT: Loaded 53470 existing records. [2025-09-30T19:23:50.278987] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:50.348492] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-30T19:23:50.365267] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-30T19:23:50.373887] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-09-30T19:23:50.380045] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-09-30T19:23:50.380559] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-30T19:23:50.380420] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-09-30T19:23:50.380807] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-30T19:23:50.386705] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-09-30T19:23:50.691032] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:50.815868] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-30T19:23:50.867012] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-30T19:23:51.034548] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-30T19:23:51.087879] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:51.079955] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:51.098019] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-30T19:23:51.111327] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-30T19:23:51.106068] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-30T19:23:51.088000] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-30T19:23:51.122851] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-30T19:23:51.133942] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-30T19:23:51.155380] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-30T19:23:51.155574] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-30T19:23:51.155696] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-30T19:23:51.805570] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:51.930184] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-30T19:23:52.503768] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.590123] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-30T19:23:52.584317] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.591471] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-30T19:23:52.589817] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.592836] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-30T19:23:53.167528] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:23:53.171804] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-30T19:23:54.059101] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T19:23:54.063424] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-30T19:23:54.123918] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:23:54.135288] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-30T19:23:54.356478] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:23:54.368471] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-30T19:23:54.439493] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:23:54.456959] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-30T19:23:54.770453] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T19:23:54.775075] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-30T19:23:55.690168] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:23:55.701297] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-30T19:23:55.744958] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:23:55.750790] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-30T19:23:55.837019] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:23:55.847936] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-30T19:23:56.193093] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:23:56.204068] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-30T19:23:56.524565] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T19:23:56.530233] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-30T19:23:56.940698] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T19:23:56.951830] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-30T19:23:57.483519] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T19:23:57.494976] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-30T19:23:57.542828] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T19:23:57.549318] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-30T19:23:58.003615] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T19:23:58.014361] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-30T19:23:58.695919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:23:58.701159] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-30T19:23:58.876445] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:23:58.890391] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-30T19:23:58.927434] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:23:58.941239] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-30T19:23:59.641454] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T19:23:59.646447] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-30T19:23:59.984080] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:23:59.996772] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-30T19:24:00.547448] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:24:00.562336] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-30T19:24:00.673050] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:24:00.685165] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-30T19:24:00.849048] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T19:24:00.853946] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-30T19:24:01.672250] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:24:01.684331] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-30T19:24:02.038799] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T19:24:02.044870] [INFO ] [REMOTE ] IPI: Full fetch complete (29363 records). [2025-09-30T19:24:02.045034] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-30T19:24:02.317684] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:24:02.409911] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-30T19:24:02.488355] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T19:24:02.525779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-30T19:24:02.601491] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-30T19:24:02.601613] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-30T19:24:02.602433] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-30T19:24:02.602502] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-30T19:24:02.603490] [DEBUG] [LOCAL ] IPI: Trimmed 29363 records to 21401 (keeping 200 days of data) [2025-09-30T19:24:02.739127] [DEBUG] [LOCAL ] IPI: Primary data saved (21401 records). [2025-09-30T19:24:02.739270] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-30T19:24:02.739355] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 13.6s. Estimated remaining: 2h 40m 33s. Rate: 7.8 symbols/min [2025-09-30T19:24:02.931294] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:02.952104] [DEBUG] [LOCAL ] IQI: Loaded 18003 existing records from primary storage. [2025-09-30T19:24:02.952419] [INFO ] [MAIN ] IQI: Loaded 18003 existing records. [2025-09-30T19:24:03.157899] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:03.158349] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-30T19:24:03.158463] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-30T19:24:03.159099] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-30T19:24:03.159241] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-30T19:24:03.327957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:24:03.389578] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-30T19:24:03.628741] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:03.629086] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-30T19:24:03.879813] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:24:03.891899] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-30T19:24:04.422247] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T19:24:04.435023] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-30T19:24:04.601980] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T19:24:04.862785] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:24:05.054397] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-30T19:24:05.577967] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:24:05.854361] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-30T19:24:06.201501] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:24:06.408810] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:24:06.654412] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-30T19:24:07.454425] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-30T19:24:07.538576] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:24:08.254381] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-30T19:24:08.435293] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:24:09.054389] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-30T19:24:09.118450] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:24:09.681599] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:24:09.854422] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-30T19:24:10.654394] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-30T19:24:10.881133] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T19:24:11.201146] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T19:24:11.223454] [INFO ] [REMOTE ] IOT: Full fetch complete (77381 records). [2025-09-30T19:24:11.223722] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-30T19:24:11.459498] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-30T19:24:11.708320] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-30T19:24:11.708442] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-30T19:24:11.709560] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-30T19:24:11.709635] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-30T19:24:11.711350] [DEBUG] [LOCAL ] IOT: Trimmed 77381 records to 53470 (keeping 200 days of data) [2025-09-30T19:24:12.046667] [DEBUG] [LOCAL ] IOT: Primary data saved (53470 records). [2025-09-30T19:24:12.046905] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-30T19:24:12.047047] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 23.0s. Estimated remaining: 2h 40m 27s. Rate: 7.8 symbols/min [2025-09-30T19:24:12.239937] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:12.263872] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-30T19:24:12.291537] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T19:24:12.299726] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:24:12.312262] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-09-30T19:24:12.312520] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-30T19:24:12.678680] [DEBUG] [LOCAL ] IQV: Loaded 50103 existing records from primary storage. [2025-09-30T19:24:12.687443] [INFO ] [MAIN ] IQV: Loaded 50103 existing records. [2025-09-30T19:24:12.911354] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-30T19:24:12.911833] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-30T19:24:12.918548] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-30T19:24:12.923820] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-30T19:24:13.000473] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:13.000886] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-30T19:24:13.000947] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-30T19:24:13.001025] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 53330 (keeping 200 days of data) [2025-09-30T19:24:13.001740] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-30T19:24:13.001803] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-30T19:24:13.086620] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-30T19:24:13.529831] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:13.785795] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-09-30T19:24:13.785965] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-30T19:24:13.788185] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 24.6s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-09-30T19:24:13.862146] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-30T19:24:13.995684] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:14.056459] [DEBUG] [LOCAL ] IR: Loaded 52686 existing records from primary storage. [2025-09-30T19:24:14.056854] [INFO ] [MAIN ] IR: Loaded 52686 existing records. [2025-09-30T19:24:14.279554] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:14.280694] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-30T19:24:14.280844] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-30T19:24:14.282595] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-30T19:24:14.282705] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-30T19:24:14.454293] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:24:14.670961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-30T19:24:14.708741] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-30T19:24:14.784105] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:14.784314] [INFO ] [REMOTE ] IP: Full fetch complete (77066 records). [2025-09-30T19:24:14.784695] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-30T19:24:15.216159] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-30T19:24:15.216262] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-30T19:24:15.217437] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-30T19:24:15.217539] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-30T19:24:15.219452] [DEBUG] [LOCAL ] IP: Trimmed 77066 records to 53313 (keeping 200 days of data) [2025-09-30T19:24:15.467275] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-30T19:24:15.478970] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:24:15.626284] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:24:15.658135] [DEBUG] [LOCAL ] IP: Primary data saved (53313 records). [2025-09-30T19:24:15.658345] [INFO ] [MAIN ] IP: Full history saved. [2025-09-30T19:24:15.659432] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 26.5s. Estimated remaining: 2h 39m 59s. Rate: 7.8 symbols/min [2025-09-30T19:24:15.864240] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:15.926255] [DEBUG] [LOCAL ] IRM: Loaded 49362 existing records from primary storage. [2025-09-30T19:24:15.926675] [INFO ] [MAIN ] IRM: Loaded 49362 existing records. [2025-09-30T19:24:16.132239] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:16.132505] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-30T19:24:16.132561] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-30T19:24:16.133466] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-30T19:24:16.133535] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-30T19:24:16.259558] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-30T19:24:16.553921] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:17.054363] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-30T19:24:17.235787] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:24:17.289951] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T19:24:17.854380] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-30T19:24:18.565889] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T19:24:18.654398] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-30T19:24:19.454431] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-30T19:24:19.556076] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:24:20.254352] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-30T19:24:20.426022] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T19:24:21.054385] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-30T19:24:21.363129] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T19:24:21.362423] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:24:21.854390] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-30T19:24:22.496474] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:24:22.654410] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-30T19:24:23.454364] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-30T19:24:23.582554] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:24:23.912010] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:24:24.254382] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-30T19:24:25.054387] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-30T19:24:25.239400] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:24:25.280735] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:24:25.287238] [INFO ] [REMOTE ] IQI: Full fetch complete (27047 records). [2025-09-30T19:24:25.287382] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-30T19:24:25.719012] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-30T19:24:25.719308] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-30T19:24:25.719900] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-30T19:24:25.719972] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-30T19:24:25.720887] [DEBUG] [LOCAL ] IQI: Trimmed 27047 records to 18036 (keeping 200 days of data) [2025-09-30T19:24:25.850727] [DEBUG] [LOCAL ] IQI: Primary data saved (18036 records). [2025-09-30T19:24:25.850897] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-30T19:24:25.850990] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 23.1s. Estimated remaining: 2h 39m 54s. Rate: 7.8 symbols/min [2025-09-30T19:24:25.856354] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-30T19:24:26.070702] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:26.095558] [DEBUG] [LOCAL ] IRS: Loaded 21787 existing records from primary storage. [2025-09-30T19:24:26.095892] [INFO ] [MAIN ] IRS: Loaded 21787 existing records. [2025-09-30T19:24:26.300077] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:26.300363] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-30T19:24:26.300556] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-30T19:24:26.301451] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-30T19:24:26.301516] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-30T19:24:26.660142] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-30T19:24:26.674004] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T19:24:26.762791] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:27.454391] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-30T19:24:27.720595] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:24:28.254368] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-30T19:24:28.488821] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:24:28.812485] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T19:24:29.054340] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-30T19:24:29.854330] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-30T19:24:29.979401] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:24:30.457318] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:24:30.654412] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-30T19:24:31.454357] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-30T19:24:31.518281] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:24:31.591000] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:24:32.254383] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-30T19:24:33.054338] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-30T19:24:33.105490] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:24:33.854400] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-30T19:24:34.027011] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:24:34.113609] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T19:24:34.654388] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-30T19:24:35.219290] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:24:35.322672] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T19:24:35.454617] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-30T19:24:36.254416] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-30T19:24:36.516760] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:24:37.054361] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-30T19:24:37.854326] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-30T19:24:38.122914] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T19:24:38.661914] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-30T19:24:38.691981] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:24:38.991746] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:24:39.454369] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-30T19:24:40.254328] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-30T19:24:40.495684] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:24:41.060307] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-30T19:24:41.075588] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T19:24:41.341779] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T19:24:41.854374] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-30T19:24:42.441722] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:24:42.654350] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-30T19:24:43.454422] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-30T19:24:43.729574] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T19:24:44.254420] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-30T19:24:44.406531] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:24:44.550604] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:24:45.054382] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-30T19:24:45.850065] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:24:45.860620] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-30T19:24:45.863311] [INFO ] [REMOTE ] IR: Full fetch complete (76152 records). [2025-09-30T19:24:45.863583] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-30T19:24:46.305816] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:24:46.335179] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-30T19:24:46.335298] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-30T19:24:46.336817] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-30T19:24:46.336898] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-30T19:24:46.338406] [DEBUG] [LOCAL ] IR: Trimmed 76152 records to 52685 (keeping 200 days of data) [2025-09-30T19:24:46.660837] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-30T19:24:46.687551] [DEBUG] [LOCAL ] IR: Primary data saved (52685 records). [2025-09-30T19:24:46.687742] [INFO ] [MAIN ] IR: Full history saved. [2025-09-30T19:24:46.687844] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 32.9s. Estimated remaining: 2h 40m 1s. Rate: 7.8 symbols/min [2025-09-30T19:24:46.873097] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:46.923894] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-30T19:24:46.924247] [INFO ] [MAIN ] IRT: Loaded 50393 existing records. [2025-09-30T19:24:47.128118] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:47.128756] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-30T19:24:47.128822] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-30T19:24:47.129976] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-30T19:24:47.130038] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-30T19:24:47.459443] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-30T19:24:47.531011] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:47.849882] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:24:47.860926] [INFO ] [REMOTE ] IRM: Full fetch complete (72239 records). [2025-09-30T19:24:47.861088] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-30T19:24:48.261524] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-30T19:24:48.306214] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-30T19:24:48.306876] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-30T19:24:48.322075] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-30T19:24:48.331904] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-30T19:24:48.353071] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T19:24:48.361764] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T19:24:48.373006] [DEBUG] [LOCAL ] IRM: Trimmed 72239 records to 49336 (keeping 200 days of data) [2025-09-30T19:24:48.702839] [DEBUG] [LOCAL ] IRM: Primary data saved (49336 records). [2025-09-30T19:24:48.702988] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-30T19:24:48.704612] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 33.0s. Estimated remaining: 2h 39m 47s. Rate: 7.8 symbols/min [2025-09-30T19:24:48.896811] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:48.916201] [DEBUG] [LOCAL ] ISD: Loaded 15526 existing records from primary storage. [2025-09-30T19:24:48.916515] [INFO ] [MAIN ] ISD: Loaded 15526 existing records. [2025-09-30T19:24:49.070157] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-30T19:24:49.116846] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:49.117110] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-30T19:24:49.117160] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-30T19:24:49.117724] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-30T19:24:49.117788] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-30T19:24:49.510339] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:49.686770] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:24:49.854323] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-30T19:24:50.654368] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-30T19:24:50.945496] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T19:24:50.956032] [INFO ] [REMOTE ] IQV: Full fetch complete (72214 records). [2025-09-30T19:24:50.956211] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-30T19:24:51.365045] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:24:51.433184] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-30T19:24:51.433286] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-30T19:24:51.434462] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-30T19:24:51.434538] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-30T19:24:51.436280] [DEBUG] [LOCAL ] IQV: Trimmed 72214 records to 50073 (keeping 200 days of data) [2025-09-30T19:24:51.495024] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-30T19:24:51.785958] [DEBUG] [LOCAL ] IQV: Primary data saved (50073 records). [2025-09-30T19:24:51.786113] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-30T19:24:51.786217] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IQV took 39.7s. Estimated remaining: 2h 39m 34s. Rate: 7.8 symbols/min [2025-09-30T19:24:51.992153] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:52.042509] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:24:52.061776] [INFO ] [REMOTE ] IRS: Full fetch complete (32168 records). [2025-09-30T19:24:52.063135] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-30T19:24:52.064048] [DEBUG] [LOCAL ] IT: Loaded 41834 existing records from primary storage. [2025-09-30T19:24:52.103691] [INFO ] [MAIN ] IT: Loaded 41834 existing records. [2025-09-30T19:24:52.258242] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-30T19:24:52.613157] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:52.613874] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-30T19:24:52.613957] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-30T19:24:52.644743] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-30T19:24:52.650057] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-30T19:24:52.784704] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-30T19:24:52.813580] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-30T19:24:52.841000] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-30T19:24:52.846326] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-30T19:24:52.869278] [DEBUG] [LOCAL ] IRS: Trimmed 32168 records to 21827 (keeping 200 days of data) [2025-09-30T19:24:53.248924] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:24:53.295499] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:53.297156] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-30T19:24:53.340119] [DEBUG] [LOCAL ] IRS: Primary data saved (21827 records). [2025-09-30T19:24:53.340323] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-30T19:24:53.340552] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 27.5s. Estimated remaining: 2h 39m 19s. Rate: 7.8 symbols/min [2025-09-30T19:24:53.441991] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:24:53.550638] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:53.596785] [DEBUG] [LOCAL ] ITGR: Loaded 31645 existing records from primary storage. [2025-09-30T19:24:53.597474] [INFO ] [MAIN ] ITGR: Loaded 31645 existing records. [2025-09-30T19:24:53.815237] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:53.815552] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-30T19:24:53.815632] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-30T19:24:53.815984] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-30T19:24:53.816069] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-30T19:24:53.859517] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-30T19:24:54.217194] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:54.463479] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:24:54.654397] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-30T19:24:55.242859] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:24:55.454392] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-30T19:24:55.829927] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:24:56.254411] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-30T19:24:56.607532] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:24:57.054372] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-30T19:24:57.854364] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-30T19:24:58.102622] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:24:58.515093] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:24:58.654389] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-30T19:24:58.903930] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T19:24:59.454358] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-30T19:24:59.840597] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T19:25:00.254344] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-30T19:25:00.291024] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:25:01.054403] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-30T19:25:01.480711] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:25:01.854409] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-30T19:25:02.532491] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:25:02.654353] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-30T19:25:03.454412] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-30T19:25:03.524797] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:25:03.806423] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:25:04.254385] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-30T19:25:04.857963] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:25:05.054380] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-30T19:25:05.721828] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:25:05.854373] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-30T19:25:06.035871] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:25:06.654404] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-30T19:25:07.035188] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:25:07.454470] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-30T19:25:08.182374] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:25:08.254372] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-30T19:25:08.703780] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:25:09.054402] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-30T19:25:09.854378] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-30T19:25:10.063492] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:25:10.394080] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:25:10.654352] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-30T19:25:11.089516] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T19:25:11.462269] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-30T19:25:11.467545] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T19:25:12.254427] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-30T19:25:13.041806] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:25:13.054392] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-30T19:25:13.149615] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:25:13.854503] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-30T19:25:14.130615] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:25:14.137700] [INFO ] [REMOTE ] ITGR: Full fetch complete (41618 records). [2025-09-30T19:25:14.137820] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-30T19:25:14.563766] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-30T19:25:14.563884] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-30T19:25:14.564610] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-30T19:25:14.564698] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-30T19:25:14.566107] [DEBUG] [LOCAL ] ITGR: Trimmed 41618 records to 31521 (keeping 200 days of data) [2025-09-30T19:25:14.666205] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-30T19:25:14.788933] [DEBUG] [LOCAL ] ITGR: Primary data saved (31521 records). [2025-09-30T19:25:14.789095] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-30T19:25:14.789217] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. ITGR took 21.4s. Estimated remaining: 2h 39m 27s. Rate: 7.8 symbols/min [2025-09-30T19:25:14.995934] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:15.008531] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:25:15.059176] [DEBUG] [LOCAL ] ITT: Loaded 32914 existing records from primary storage. [2025-09-30T19:25:15.059637] [INFO ] [MAIN ] ITT: Loaded 32914 existing records. [2025-09-30T19:25:15.272932] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:15.273146] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-30T19:25:15.273193] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-30T19:25:15.273819] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-30T19:25:15.273882] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-30T19:25:15.454624] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-30T19:25:15.746905] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:16.069561] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T19:25:16.254398] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-30T19:25:17.054414] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-30T19:25:17.129593] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:25:17.624169] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:25:17.635574] [INFO ] [REMOTE ] IRT: Full fetch complete (72539 records). [2025-09-30T19:25:17.635765] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-30T19:25:17.863858] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-30T19:25:18.055836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T19:25:18.163687] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-30T19:25:18.163794] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-30T19:25:18.164858] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-30T19:25:18.164948] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-30T19:25:18.166546] [DEBUG] [LOCAL ] IRT: Trimmed 72539 records to 50402 (keeping 200 days of data) [2025-09-30T19:25:18.501832] [DEBUG] [LOCAL ] IRT: Primary data saved (50402 records). [2025-09-30T19:25:18.501986] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-30T19:25:18.502105] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 31.8s. Estimated remaining: 2h 39m 15s. Rate: 7.8 symbols/min [2025-09-30T19:25:18.661702] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-30T19:25:18.700690] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:18.756089] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-09-30T19:25:18.756638] [INFO ] [MAIN ] ITUB: Loaded 53318 existing records. [2025-09-30T19:25:18.961060] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:18.961322] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-30T19:25:18.961395] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-30T19:25:18.962624] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-30T19:25:18.962722] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-30T19:25:19.384698] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:19.454405] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-30T19:25:19.867584] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:25:20.069411] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:25:20.254375] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-30T19:25:21.054342] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-30T19:25:21.217849] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:25:21.260031] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:25:21.854593] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-30T19:25:22.654611] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-30T19:25:22.913500] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T19:25:22.924602] [INFO ] [REMOTE ] IT: Full fetch complete (55851 records). [2025-09-30T19:25:22.924895] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-30T19:25:23.334110] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-30T19:25:23.339492] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-30T19:25:23.341772] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-30T19:25:23.342463] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:25:23.346695] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-30T19:25:23.349539] [DEBUG] [LOCAL ] IT: Trimmed 55851 records to 41916 (keeping 200 days of data) [2025-09-30T19:25:23.472207] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-30T19:25:23.483460] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:25:23.677370] [DEBUG] [LOCAL ] IT: Primary data saved (41916 records). [2025-09-30T19:25:23.677512] [INFO ] [MAIN ] IT: Full history saved. [2025-09-30T19:25:23.677632] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 31.9s. Estimated remaining: 2h 39m 4s. Rate: 7.8 symbols/min [2025-09-30T19:25:23.863168] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:23.925392] [DEBUG] [LOCAL ] ITW: Loaded 45913 existing records from primary storage. [2025-09-30T19:25:23.925940] [INFO ] [MAIN ] ITW: Loaded 45913 existing records. [2025-09-30T19:25:24.146497] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:24.146776] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-30T19:25:24.146827] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-30T19:25:24.147822] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-30T19:25:24.147913] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-30T19:25:24.259886] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-30T19:25:24.567916] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:24.586371] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:25:25.054401] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-30T19:25:25.310836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:25:25.314803] [INFO ] [REMOTE ] ISD: Full fetch complete (23940 records). [2025-09-30T19:25:25.314914] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-30T19:25:25.749295] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-30T19:25:25.749380] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-30T19:25:25.749896] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-30T19:25:25.749960] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-30T19:25:25.750676] [DEBUG] [LOCAL ] ISD: Trimmed 23940 records to 15486 (keeping 200 days of data) [2025-09-30T19:25:25.855937] [DEBUG] [LOCAL ] ISD: Primary data saved (15486 records). [2025-09-30T19:25:25.855696] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-30T19:25:25.856122] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-30T19:25:25.856323] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ISD took 37.2s. Estimated remaining: 2h 38m 51s. Rate: 7.8 symbols/min [2025-09-30T19:25:26.046922] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:26.107073] [DEBUG] [LOCAL ] IVR: Loaded 47835 existing records from primary storage. [2025-09-30T19:25:26.107437] [INFO ] [MAIN ] IVR: Loaded 47835 existing records. [2025-09-30T19:25:26.307090] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:26.307339] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-30T19:25:26.307391] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-30T19:25:26.307962] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-30T19:25:26.308025] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-30T19:25:26.656274] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-30T19:25:26.765505] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:26.807561] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:25:27.454402] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-30T19:25:27.585168] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T19:25:27.669938] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:25:28.254412] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-30T19:25:28.966325] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:25:29.054445] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-30T19:25:29.854388] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-30T19:25:29.891072] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:25:30.654451] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-30T19:25:30.872763] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T19:25:31.124564] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:25:31.454386] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-30T19:25:32.254403] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-30T19:25:32.433497] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T19:25:33.054333] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-30T19:25:33.254245] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:25:33.854386] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-30T19:25:33.899800] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:25:34.654400] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-30T19:25:34.711030] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:25:35.310589] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:25:35.454374] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-30T19:25:36.196442] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:25:36.254369] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-30T19:25:36.929293] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:25:37.054436] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-30T19:25:37.854379] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-30T19:25:38.011963] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T19:25:38.654498] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-30T19:25:39.014467] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T19:25:39.067348] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:25:39.454383] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-30T19:25:40.254379] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-30T19:25:40.916623] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:25:40.954892] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-30T19:25:41.054441] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-30T19:25:41.854389] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-30T19:25:42.090665] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:25:42.110474] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T19:25:42.654371] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-30T19:25:43.454365] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-30T19:25:43.507803] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:25:44.254379] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-30T19:25:44.459493] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T19:25:45.054363] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-30T19:25:45.171895] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:25:45.605900] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T19:25:45.615445] [INFO ] [REMOTE ] ITT: Full fetch complete (46963 records). [2025-09-30T19:25:45.615680] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-30T19:25:45.859607] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-30T19:25:46.062062] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-30T19:25:46.062167] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-30T19:25:46.063042] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-30T19:25:46.063134] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-30T19:25:46.064359] [DEBUG] [LOCAL ] ITT: Trimmed 46963 records to 32807 (keeping 200 days of data) [2025-09-30T19:25:46.281879] [DEBUG] [LOCAL ] ITT: Primary data saved (32807 records). [2025-09-30T19:25:46.282036] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-30T19:25:46.282124] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 31.5s. Estimated remaining: 2h 38m 57s. Rate: 7.8 symbols/min [2025-09-30T19:25:46.470070] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:46.513299] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:25:46.552737] [DEBUG] [LOCAL ] IVT: Loaded 30671 existing records from primary storage. [2025-09-30T19:25:46.553184] [INFO ] [MAIN ] IVT: Loaded 30671 existing records. [2025-09-30T19:25:46.662262] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-30T19:25:46.753128] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:46.753385] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-30T19:25:46.753442] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-30T19:25:46.754121] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-30T19:25:46.754196] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-30T19:25:47.156915] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:47.454356] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-30T19:25:47.584545] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:25:47.598013] [INFO ] [REMOTE ] ITUB: Full fetch complete (77175 records). [2025-09-30T19:25:47.598236] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-30T19:25:48.074084] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-30T19:25:48.074287] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-30T19:25:48.075754] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-30T19:25:48.099858] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-30T19:25:48.104989] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:25:48.120001] [DEBUG] [LOCAL ] ITUB: Trimmed 77175 records to 53327 (keeping 200 days of data) [2025-09-30T19:25:48.254428] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-30T19:25:48.461434] [DEBUG] [LOCAL ] ITUB: Primary data saved (53327 records). [2025-09-30T19:25:48.461589] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-30T19:25:48.461713] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 30.0s. Estimated remaining: 2h 38m 43s. Rate: 7.8 symbols/min [2025-09-30T19:25:48.646558] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:48.708294] [DEBUG] [LOCAL ] IVZ: Loaded 53127 existing records from primary storage. [2025-09-30T19:25:48.708708] [INFO ] [MAIN ] IVZ: Loaded 53127 existing records. [2025-09-30T19:25:48.916204] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:48.916514] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-30T19:25:48.916571] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-30T19:25:48.917177] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-30T19:25:48.917241] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-30T19:25:49.063963] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-30T19:25:49.301520] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T19:25:49.386218] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:49.646183] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:25:49.854394] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-30T19:25:50.654330] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-30T19:25:51.076030] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:25:51.121381] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:25:51.454369] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-30T19:25:52.254323] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-30T19:25:52.450752] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T19:25:52.956450] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:25:53.054320] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-30T19:25:53.633026] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:25:53.854403] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-30T19:25:54.654348] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-30T19:25:54.697129] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:25:55.454374] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-30T19:25:55.566866] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T19:25:56.254373] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-30T19:25:56.621488] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-30T19:25:56.635144] [INFO ] [REMOTE ] IVR: Full fetch complete (69057 records). [2025-09-30T19:25:56.635332] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-30T19:25:57.072161] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-30T19:25:57.105927] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-30T19:25:57.106111] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-30T19:25:57.107167] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-30T19:25:57.107343] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-30T19:25:57.109561] [DEBUG] [LOCAL ] IVR: Trimmed 69057 records to 47877 (keeping 200 days of data) [2025-09-30T19:25:57.226251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:25:57.442166] [DEBUG] [LOCAL ] IVR: Primary data saved (47877 records). [2025-09-30T19:25:57.442324] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-30T19:25:57.442422] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 31.6s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-09-30T19:25:57.631149] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:57.652983] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:25:57.680514] [DEBUG] [LOCAL ] IX: Loaded 22541 existing records from primary storage. [2025-09-30T19:25:57.680800] [INFO ] [MAIN ] IX: Loaded 22541 existing records. [2025-09-30T19:25:57.862162] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-30T19:25:57.894133] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:57.895751] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-30T19:25:57.895845] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-30T19:25:57.896563] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-30T19:25:57.896729] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-30T19:25:58.333861] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:58.654430] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-30T19:25:58.967936] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T19:25:59.454386] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-30T19:25:59.708842] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T19:25:59.720930] [INFO ] [REMOTE ] ITW: Full fetch complete (66378 records). [2025-09-30T19:25:59.721098] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-30T19:26:00.085691] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:26:00.200751] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-30T19:26:00.200856] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-30T19:26:00.201864] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-30T19:26:00.201931] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-30T19:26:00.203438] [DEBUG] [LOCAL ] ITW: Trimmed 66378 records to 45869 (keeping 200 days of data) [2025-09-30T19:26:00.266369] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-30T19:26:00.514489] [DEBUG] [LOCAL ] ITW: Primary data saved (45869 records). [2025-09-30T19:26:00.514631] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-30T19:26:00.514754] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. ITW took 36.8s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-09-30T19:26:00.705543] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:00.778053] [DEBUG] [LOCAL ] J: Loaded 40155 existing records from primary storage. [2025-09-30T19:26:00.778522] [INFO ] [MAIN ] J: Loaded 40155 existing records. [2025-09-30T19:26:00.991766] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:00.992149] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-30T19:26:00.992225] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-30T19:26:00.992788] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-30T19:26:00.992862] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-30T19:26:01.059457] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-30T19:26:01.436119] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:26:01.441576] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:01.730674] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:26:01.854380] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-30T19:26:01.897801] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T19:26:02.654337] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-30T19:26:02.913063] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T19:26:03.398082] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:26:03.454447] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-30T19:26:04.254500] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-30T19:26:05.054414] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-30T19:26:05.281911] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:26:05.555609] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:26:05.854323] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-30T19:26:05.935088] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T19:26:06.654404] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-30T19:26:06.989152] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:26:07.454404] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-30T19:26:07.736915] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T19:26:08.254396] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-30T19:26:08.808757] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T19:26:08.817465] [INFO ] [REMOTE ] IVT: Full fetch complete (45467 records). [2025-09-30T19:26:08.817694] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-30T19:26:09.055716] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-30T19:26:09.289171] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-30T19:26:09.289356] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-30T19:26:09.290433] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-30T19:26:09.290552] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-30T19:26:09.310108] [DEBUG] [LOCAL ] IVT: Trimmed 45467 records to 30715 (keeping 200 days of data) [2025-09-30T19:26:09.310764] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:26:09.521822] [DEBUG] [LOCAL ] IVT: Primary data saved (30715 records). [2025-09-30T19:26:09.521985] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-30T19:26:09.522078] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 23.2s. Estimated remaining: 2h 38m 18s. Rate: 7.8 symbols/min [2025-09-30T19:26:09.737253] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:09.802384] [DEBUG] [LOCAL ] JBGS: Loaded 42397 existing records from primary storage. [2025-09-30T19:26:09.802842] [INFO ] [MAIN ] JBGS: Loaded 42397 existing records. [2025-09-30T19:26:09.859585] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-30T19:26:10.020056] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:10.020359] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-30T19:26:10.020415] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-30T19:26:10.020866] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-30T19:26:10.020925] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-30T19:26:10.411454] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:10.654373] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-30T19:26:10.727949] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:26:11.108450] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:26:11.454413] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-30T19:26:11.748416] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:26:12.254370] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-30T19:26:13.054377] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-30T19:26:13.235791] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T19:26:13.711984] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T19:26:13.854344] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-30T19:26:13.930222] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T19:26:14.654397] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-30T19:26:15.333327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:26:15.454328] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-30T19:26:15.841064] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:26:16.254411] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-30T19:26:16.753131] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:26:17.054415] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-30T19:26:17.605077] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T19:26:17.854356] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-30T19:26:18.032084] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T19:26:18.654403] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-30T19:26:19.385610] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:26:19.454401] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-30T19:26:20.195553] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T19:26:20.254350] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-30T19:26:20.684606] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T19:26:20.688898] [INFO ] [REMOTE ] IX: Full fetch complete (27194 records). [2025-09-30T19:26:20.689015] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-30T19:26:21.064200] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-30T19:26:21.096868] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-30T19:26:21.096949] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-30T19:26:21.097604] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-30T19:26:21.097712] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-30T19:26:21.098962] [DEBUG] [LOCAL ] IX: Trimmed 27194 records to 22541 (keeping 200 days of data) [2025-09-30T19:26:21.250203] [DEBUG] [LOCAL ] IX: Primary data saved (22541 records). [2025-09-30T19:26:21.250350] [INFO ] [MAIN ] IX: Full history saved. [2025-09-30T19:26:21.250452] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 23.8s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-09-30T19:26:21.502562] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:21.549744] [DEBUG] [LOCAL ] JBI: Loaded 43571 existing records from primary storage. [2025-09-30T19:26:21.550312] [INFO ] [MAIN ] JBI: Loaded 43571 existing records. [2025-09-30T19:26:21.751762] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:21.751983] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-30T19:26:21.752077] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-30T19:26:21.752547] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-30T19:26:21.752612] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-30T19:26:21.859543] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-30T19:26:22.208430] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:22.214139] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T19:26:22.635673] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:26:22.654327] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-30T19:26:23.454373] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-30T19:26:23.824375] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:26:24.254375] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-30T19:26:24.411528] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T19:26:24.605930] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:26:25.054360] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-30T19:26:25.856055] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-30T19:26:25.862783] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T19:26:26.548498] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:26:26.654379] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-30T19:26:27.464190] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-30T19:26:27.484209] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:26:28.155358] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:26:28.254361] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-30T19:26:29.054374] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-30T19:26:29.120599] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:26:29.133377] [INFO ] [REMOTE ] IVZ: Full fetch complete (76767 records). [2025-09-30T19:26:29.133570] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-30T19:26:29.595732] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-30T19:26:29.595872] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-30T19:26:29.597363] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-30T19:26:29.597524] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-30T19:26:29.599637] [DEBUG] [LOCAL ] IVZ: Trimmed 76767 records to 53127 (keeping 200 days of data) [2025-09-30T19:26:29.734175] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:26:29.870526] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-30T19:26:29.996112] [DEBUG] [LOCAL ] IVZ: Primary data saved (53127 records). [2025-09-30T19:26:29.996277] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-30T19:26:29.996365] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IVZ took 41.5s. Estimated remaining: 2h 38m 8s. Rate: 7.8 symbols/min [2025-09-30T19:26:30.201085] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:30.236102] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:26:30.297373] [DEBUG] [LOCAL ] JBL: Loaded 48388 existing records from primary storage. [2025-09-30T19:26:30.297773] [INFO ] [MAIN ] JBL: Loaded 48388 existing records. [2025-09-30T19:26:30.517060] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:30.517270] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-30T19:26:30.517350] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-30T19:26:30.517936] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-30T19:26:30.518012] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-30T19:26:30.665872] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-30T19:26:30.944475] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:31.095707] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:26:31.454425] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-30T19:26:32.259537] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-30T19:26:32.279400] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T19:26:33.054384] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-30T19:26:33.117789] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:26:33.854362] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-30T19:26:33.900851] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:26:34.194329] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:26:34.654366] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-30T19:26:35.408675] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:26:35.454381] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-30T19:26:35.846136] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T19:26:36.254347] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-30T19:26:37.033430] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T19:26:37.054384] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-30T19:26:37.439180] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:26:37.854362] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-30T19:26:38.616354] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:26:38.654333] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-30T19:26:39.454364] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-30T19:26:39.760521] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:26:40.259525] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-30T19:26:40.274020] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T19:26:40.283779] [INFO ] [REMOTE ] JBGS: Full fetch complete (59155 records). [2025-09-30T19:26:40.283947] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-30T19:26:40.720105] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-30T19:26:40.720290] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-30T19:26:40.721233] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-30T19:26:40.721333] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-30T19:26:40.722872] [DEBUG] [LOCAL ] JBGS: Trimmed 59155 records to 42396 (keeping 200 days of data) [2025-09-30T19:26:40.861961] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:26:41.035852] [DEBUG] [LOCAL ] JBGS: Primary data saved (42396 records). [2025-09-30T19:26:41.035998] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-30T19:26:41.036097] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. JBGS took 31.5s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-09-30T19:26:41.059492] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-30T19:26:41.222432] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:41.260246] [DEBUG] [LOCAL ] JBND: Loaded 25760 existing records from primary storage. [2025-09-30T19:26:41.260634] [INFO ] [MAIN ] JBND: Loaded 25760 existing records. [2025-09-30T19:26:41.530546] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:41.530970] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-30T19:26:41.531047] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-30T19:26:41.531483] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-30T19:26:41.531554] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-30T19:26:41.859772] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-30T19:26:41.867874] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T19:26:42.098191] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:42.654358] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-30T19:26:42.926185] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T19:26:43.454541] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:26:43.454618] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-30T19:26:43.465041] [INFO ] [REMOTE ] J: Full fetch complete (59075 records). [2025-09-30T19:26:43.465168] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-30T19:26:43.904609] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-30T19:26:43.904773] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-30T19:26:43.905824] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-30T19:26:43.905892] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-30T19:26:43.907170] [DEBUG] [LOCAL ] J: Trimmed 59075 records to 40135 (keeping 200 days of data) [2025-09-30T19:26:44.174437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:26:44.218831] [DEBUG] [LOCAL ] J: Primary data saved (40135 records). [2025-09-30T19:26:44.218970] [INFO ] [MAIN ] J: Full history saved. [2025-09-30T19:26:44.219057] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. J took 43.7s. Estimated remaining: 2h 37m 51s. Rate: 7.8 symbols/min [2025-09-30T19:26:44.259565] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-30T19:26:44.418758] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:44.418984] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-30T19:26:44.419030] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-30T19:26:44.419170] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-30T19:26:44.419214] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-30T19:26:44.419262] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-30T19:26:44.419297] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-30T19:26:44.822726] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:45.054338] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-30T19:26:45.255919] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:26:45.256290] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-30T19:26:45.256383] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:26:45.256430] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-30T19:26:45.256661] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:26:45.256862] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-30T19:26:45.256983] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-30T19:26:45.257165] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-30T19:26:45.262471] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-30T19:26:45.268721] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBS took 1.0s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-09-30T19:26:45.269998] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:26:45.481026] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:45.481317] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-30T19:26:45.491737] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-30T19:26:45.505991] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-30T19:26:45.509002] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-30T19:26:45.509272] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-30T19:26:45.509378] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-30T19:26:45.545117] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T19:26:45.859565] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-30T19:26:45.921282] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:46.654389] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-30T19:26:46.881962] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:26:46.882300] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-30T19:26:46.882436] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:26:46.882537] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-30T19:26:46.882631] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:26:46.882742] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-30T19:26:46.882819] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-30T19:26:46.882873] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-30T19:26:46.882937] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-30T19:26:46.883061] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 37m 22s. Rate: 7.8 symbols/min [2025-09-30T19:26:47.073789] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:47.083804] [DEBUG] [LOCAL ] JCE: Loaded 6576 existing records from primary storage. [2025-09-30T19:26:47.084027] [INFO ] [MAIN ] JCE: Loaded 6576 existing records. [2025-09-30T19:26:47.275914] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:47.276146] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-30T19:26:47.276193] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-30T19:26:47.276503] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-30T19:26:47.276563] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-30T19:26:47.456533] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-30T19:26:47.652259] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:47.690303] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:26:48.254337] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-30T19:26:48.471173] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T19:26:49.054387] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-30T19:26:49.670270] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:26:49.681191] [INFO ] [REMOTE ] JBI: Full fetch complete (64483 records). [2025-09-30T19:26:49.681427] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-30T19:26:49.863273] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-30T19:26:50.141606] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-30T19:26:50.141732] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-30T19:26:50.142623] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-30T19:26:50.142711] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-30T19:26:50.144135] [DEBUG] [LOCAL ] JBI: Trimmed 64483 records to 43584 (keeping 200 days of data) [2025-09-30T19:26:50.412217] [DEBUG] [LOCAL ] JBI: Primary data saved (43584 records). [2025-09-30T19:26:50.412358] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-30T19:26:50.414672] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBI took 29.2s. Estimated remaining: 2h 37m 10s. Rate: 7.8 symbols/min [2025-09-30T19:26:50.603357] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:50.663378] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-30T19:26:50.698859] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:26:50.710298] [DEBUG] [LOCAL ] JCI: Loaded 53544 existing records from primary storage. [2025-09-30T19:26:50.710985] [INFO ] [MAIN ] JCI: Loaded 53544 existing records. [2025-09-30T19:26:50.796058] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T19:26:50.922909] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:50.923144] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-30T19:26:50.923194] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-30T19:26:50.923892] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-30T19:26:50.923971] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-30T19:26:51.315912] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:51.394966] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:26:51.454382] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-30T19:26:52.254379] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-30T19:26:52.877761] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:26:53.054351] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-30T19:26:53.709560] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:26:53.854385] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-30T19:26:54.286775] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:26:54.458925] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:26:54.654357] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-30T19:26:55.424397] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:26:55.454340] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-30T19:26:56.254408] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-30T19:26:56.465442] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:26:57.054358] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-30T19:26:57.854386] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-30T19:26:57.905448] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T19:26:58.047863] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:26:58.654398] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-30T19:26:59.454383] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-30T19:26:59.608013] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:26:59.938800] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T19:26:59.947983] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-30T19:27:00.254405] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-30T19:27:00.981021] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T19:27:01.054397] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-30T19:27:01.854382] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-30T19:27:02.576891] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:27:02.644359] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:27:02.654794] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-30T19:27:03.454338] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-30T19:27:03.571437] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:27:04.254395] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-30T19:27:05.054359] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-30T19:27:05.365168] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T19:27:05.532235] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T19:27:05.532549] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:27:05.854381] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-30T19:27:06.654400] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-30T19:27:07.427533] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:27:07.439019] [INFO ] [REMOTE ] JBL: Full fetch complete (70255 records). [2025-09-30T19:27:07.439181] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-30T19:27:07.460562] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-30T19:27:07.880535] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-30T19:27:07.880675] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-30T19:27:07.881863] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-30T19:27:07.881944] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-30T19:27:07.883439] [DEBUG] [LOCAL ] JBL: Trimmed 70255 records to 48383 (keeping 200 days of data) [2025-09-30T19:27:08.139133] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:27:08.149424] [INFO ] [REMOTE ] JBND: Full fetch complete (33987 records). [2025-09-30T19:27:08.150440] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-30T19:27:08.257532] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-30T19:27:08.603311] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-30T19:27:08.603935] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-30T19:27:08.604732] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-30T19:27:08.606771] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-30T19:27:08.635362] [DEBUG] [LOCAL ] JBND: Trimmed 33987 records to 25895 (keeping 200 days of data) [2025-09-30T19:27:08.734828] [DEBUG] [LOCAL ] JBL: Primary data saved (48383 records). [2025-09-30T19:27:08.762627] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-30T19:27:08.763789] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBL took 38.8s. Estimated remaining: 2h 37m 14s. Rate: 7.8 symbols/min [2025-09-30T19:27:08.982351] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:09.018358] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:27:09.060230] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-30T19:27:09.090429] [DEBUG] [LOCAL ] JEF: Loaded 49996 existing records from primary storage. [2025-09-30T19:27:09.092240] [INFO ] [MAIN ] JEF: Loaded 49996 existing records. [2025-09-30T19:27:09.132548] [DEBUG] [LOCAL ] JBND: Primary data saved (25895 records). [2025-09-30T19:27:09.169236] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-30T19:27:09.178198] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 28.1s. Estimated remaining: 2h 36m 58s. Rate: 7.8 symbols/min [2025-09-30T19:27:09.428520] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:09.433576] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-30T19:27:09.434003] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-30T19:27:09.444601] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-30T19:27:09.455290] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-30T19:27:09.565158] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:09.839456] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:27:09.842544] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-30T19:27:09.893206] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-30T19:27:09.972354] [DEBUG] [LOCAL ] JELD: Loaded 46097 existing records from primary storage. [2025-09-30T19:27:10.004992] [INFO ] [MAIN ] JELD: Loaded 46097 existing records. [2025-09-30T19:27:10.140873] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:10.302503] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:10.302753] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-30T19:27:10.302808] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-30T19:27:10.303212] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-30T19:27:10.303272] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-30T19:27:10.639512] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:27:10.657370] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-30T19:27:10.739751] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:11.454379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-30T19:27:12.254375] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-30T19:27:12.506667] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:27:12.803702] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:27:12.807379] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T19:27:12.815398] [INFO ] [REMOTE ] JCE: Full fetch complete (9304 records). [2025-09-30T19:27:12.815476] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-30T19:27:13.063443] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-30T19:27:13.199690] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-30T19:27:13.199806] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-30T19:27:13.200061] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-30T19:27:13.200107] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-30T19:27:13.200607] [DEBUG] [LOCAL ] JCE: Trimmed 9304 records to 6688 (keeping 200 days of data) [2025-09-30T19:27:13.241557] [DEBUG] [LOCAL ] JCE: Primary data saved (6688 records). [2025-09-30T19:27:13.241710] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-30T19:27:13.241827] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 26.4s. Estimated remaining: 2h 36m 46s. Rate: 7.8 symbols/min [2025-09-30T19:27:13.435638] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:13.449673] [DEBUG] [LOCAL ] JEQ: Loaded 8974 existing records from primary storage. [2025-09-30T19:27:13.449899] [INFO ] [MAIN ] JEQ: Loaded 8974 existing records. [2025-09-30T19:27:13.648283] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:13.648508] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-30T19:27:13.648593] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-30T19:27:13.648912] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-30T19:27:13.648978] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-30T19:27:13.859606] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-30T19:27:14.045964] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:14.654411] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-30T19:27:14.895502] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:27:15.105323] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T19:27:15.384945] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:27:15.454457] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-30T19:27:16.254392] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-30T19:27:17.031988] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:27:17.054341] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-30T19:27:17.854328] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-30T19:27:18.116483] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T19:27:18.394878] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T19:27:18.654379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-30T19:27:18.946966] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T19:27:19.454920] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-30T19:27:19.949617] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:27:20.039814] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T19:27:20.254365] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-30T19:27:21.054398] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-30T19:27:21.854326] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-30T19:27:21.939436] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:27:22.501716] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:27:22.538115] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:27:22.654376] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-30T19:27:23.454418] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-30T19:27:24.151706] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:27:24.254376] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-30T19:27:24.920478] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:27:25.054357] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-30T19:27:25.854336] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-30T19:27:26.069102] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:27:26.490740] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:27:26.625962] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T19:27:26.654374] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-30T19:27:27.454387] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-30T19:27:28.254399] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-30T19:27:28.524683] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:27:28.537612] [INFO ] [REMOTE ] JCI: Full fetch complete (77412 records). [2025-09-30T19:27:28.537842] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-30T19:27:28.989742] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-30T19:27:28.990017] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-30T19:27:28.991065] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-30T19:27:28.991211] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-30T19:27:29.024548] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:27:29.022850] [DEBUG] [LOCAL ] JCI: Trimmed 77412 records to 53543 (keeping 200 days of data) [2025-09-30T19:27:29.097411] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-30T19:27:29.401254] [DEBUG] [LOCAL ] JCI: Primary data saved (53543 records). [2025-09-30T19:27:29.401406] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-30T19:27:29.402366] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JCI took 39.0s. Estimated remaining: 2h 36m 48s. Rate: 7.8 symbols/min [2025-09-30T19:27:29.584583] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:29.619182] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T19:27:29.656583] [DEBUG] [LOCAL ] JFR: Loaded 30591 existing records from primary storage. [2025-09-30T19:27:29.657061] [INFO ] [MAIN ] JFR: Loaded 30591 existing records. [2025-09-30T19:27:29.850827] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:29.851069] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-30T19:27:29.851118] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-30T19:27:29.851511] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-30T19:27:29.851583] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-30T19:27:29.862948] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-30T19:27:30.259197] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:30.638194] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:27:30.654328] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-30T19:27:31.454324] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-30T19:27:31.740464] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T19:27:31.971942] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:27:32.191535] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:27:32.254378] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-30T19:27:33.054354] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-30T19:27:33.807970] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:27:33.854352] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-30T19:27:34.054204] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T19:27:34.292037] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T19:27:34.654386] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-30T19:27:35.454379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-30T19:27:36.254361] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-30T19:27:36.522795] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T19:27:37.050949] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:27:37.060428] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-30T19:27:37.389922] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:27:37.568589] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-30T19:27:37.854364] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-30T19:27:38.654357] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-30T19:27:39.454386] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-30T19:27:39.540101] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:27:39.550624] [INFO ] [REMOTE ] JELD: Full fetch complete (63881 records). [2025-09-30T19:27:39.550841] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-30T19:27:39.790154] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T19:27:39.996821] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-30T19:27:39.996914] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-30T19:27:39.997785] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-30T19:27:39.997852] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-30T19:27:39.999247] [DEBUG] [LOCAL ] JELD: Trimmed 63881 records to 46062 (keeping 200 days of data) [2025-09-30T19:27:40.257935] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-30T19:27:40.269533] [DEBUG] [LOCAL ] JELD: Primary data saved (46062 records). [2025-09-30T19:27:40.269627] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-30T19:27:40.269739] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JELD took 31.1s. Estimated remaining: 2h 36m 43s. Rate: 7.8 symbols/min [2025-09-30T19:27:40.445507] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:40.459386] [DEBUG] [LOCAL ] JGH: Loaded 10966 existing records from primary storage. [2025-09-30T19:27:40.459626] [INFO ] [MAIN ] JGH: Loaded 10966 existing records. [2025-09-30T19:27:40.649274] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:40.649633] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-30T19:27:40.649809] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-30T19:27:40.650269] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-30T19:27:40.650385] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-30T19:27:40.840335] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:27:41.067011] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-30T19:27:41.073622] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:41.522804] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:27:41.594717] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T19:27:41.597371] [INFO ] [REMOTE ] JEQ: Full fetch complete (11758 records). [2025-09-30T19:27:41.597464] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-30T19:27:41.859478] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-30T19:27:41.979015] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-30T19:27:41.979096] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-30T19:27:41.979392] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-30T19:27:41.979456] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-30T19:27:41.980074] [DEBUG] [LOCAL ] JEQ: Trimmed 11758 records to 8895 (keeping 200 days of data) [2025-09-30T19:27:42.036207] [DEBUG] [LOCAL ] JEQ: Primary data saved (8895 records). [2025-09-30T19:27:42.036343] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-30T19:27:42.036425] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 28.8s. Estimated remaining: 2h 36m 29s. Rate: 7.8 symbols/min [2025-09-30T19:27:42.213876] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:42.273762] [DEBUG] [LOCAL ] JHG: Loaded 47709 existing records from primary storage. [2025-09-30T19:27:42.274085] [INFO ] [MAIN ] JHG: Loaded 47709 existing records. [2025-09-30T19:27:42.462926] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:42.463176] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-30T19:27:42.463244] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-30T19:27:42.463758] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-30T19:27:42.463820] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-30T19:27:42.659496] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-30T19:27:42.871873] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:43.287803] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:27:43.454334] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-30T19:27:43.494252] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T19:27:44.254410] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-30T19:27:45.054367] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-30T19:27:45.297083] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T19:27:45.308896] [INFO ] [REMOTE ] JEF: Full fetch complete (72925 records). [2025-09-30T19:27:45.309073] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-30T19:27:45.858131] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-30T19:27:45.861795] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-30T19:27:45.862282] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-30T19:27:45.867709] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-30T19:27:45.864872] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:27:45.877194] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-30T19:27:45.880703] [DEBUG] [LOCAL ] JEF: Trimmed 72925 records to 50008 (keeping 200 days of data) [2025-09-30T19:27:46.030038] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:27:46.295113] [DEBUG] [LOCAL ] JEF: Primary data saved (50008 records). [2025-09-30T19:27:46.295275] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-30T19:27:46.295395] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEF took 37.5s. Estimated remaining: 2h 36m 18s. Rate: 7.8 symbols/min [2025-09-30T19:27:46.529703] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:46.536386] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-09-30T19:27:46.536613] [INFO ] [MAIN ] JHI: Loaded 3586 existing records. [2025-09-30T19:27:46.659537] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-30T19:27:46.740147] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:46.740548] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-30T19:27:46.740602] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-30T19:27:46.740856] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-30T19:27:46.740918] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-30T19:27:46.843135] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:27:47.147978] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:47.454360] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-30T19:27:48.048567] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:27:48.263778] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-30T19:27:48.271362] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:27:48.841679] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T19:27:49.054400] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-30T19:27:49.854327] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-30T19:27:50.279833] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:27:50.654373] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-30T19:27:51.166378] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T19:27:51.461671] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-30T19:27:51.468095] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:27:52.120007] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:27:52.254403] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-30T19:27:53.032942] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T19:27:53.054368] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-30T19:27:53.830157] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:27:53.854364] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-30T19:27:54.654415] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-30T19:27:55.127255] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:27:55.171386] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:27:55.454366] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-30T19:27:56.031260] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T19:27:56.254370] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-30T19:27:56.847715] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:27:57.054369] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-30T19:27:57.539961] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T19:27:57.854364] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-30T19:27:58.654362] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-30T19:27:59.416292] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:27:59.454339] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-30T19:27:59.671939] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:27:59.983946] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T19:28:00.254401] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-30T19:28:01.054334] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-30T19:28:01.135454] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:28:01.854374] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-30T19:28:02.418118] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:28:02.422455] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:28:02.654362] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-30T19:28:03.148496] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T19:28:03.454401] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-30T19:28:04.254342] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-30T19:28:04.423981] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:28:05.054420] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-30T19:28:05.854417] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-30T19:28:05.972403] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:28:05.975875] [INFO ] [REMOTE ] JGH: Full fetch complete (14981 records). [2025-09-30T19:28:05.976047] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-30T19:28:06.154349] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:28:06.448347] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-30T19:28:06.448434] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-30T19:28:06.448867] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-30T19:28:06.448934] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-30T19:28:06.449617] [DEBUG] [LOCAL ] JGH: Trimmed 14981 records to 11028 (keeping 200 days of data) [2025-09-30T19:28:06.489556] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T19:28:06.529021] [DEBUG] [LOCAL ] JGH: Primary data saved (11028 records). [2025-09-30T19:28:06.529157] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-30T19:28:06.529241] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 26.3s. Estimated remaining: 2h 36m 24s. Rate: 7.8 symbols/min [2025-09-30T19:28:06.659503] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-30T19:28:06.763038] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:06.768078] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-09-30T19:28:06.768894] [INFO ] [MAIN ] JHS: Loaded 2826 existing records. [2025-09-30T19:28:06.981293] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:06.981540] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-30T19:28:06.981589] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-30T19:28:06.981795] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-30T19:28:06.981857] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-30T19:28:07.393464] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:07.454449] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-30T19:28:08.254442] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-30T19:28:08.338561] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T19:28:08.589735] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-30T19:28:08.969025] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:28:08.977016] [INFO ] [REMOTE ] JFR: Full fetch complete (48259 records). [2025-09-30T19:28:08.977176] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-30T19:28:09.059491] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-30T19:28:09.402211] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-30T19:28:09.402321] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-30T19:28:09.403183] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-30T19:28:09.403251] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-30T19:28:09.404320] [DEBUG] [LOCAL ] JFR: Trimmed 48259 records to 30656 (keeping 200 days of data) [2025-09-30T19:28:09.606413] [DEBUG] [LOCAL ] JFR: Primary data saved (30656 records). [2025-09-30T19:28:09.606570] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-30T19:28:09.607781] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 40.2s. Estimated remaining: 2h 36m 11s. Rate: 7.8 symbols/min [2025-09-30T19:28:09.735270] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:28:09.815116] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:09.854373] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-30T19:28:09.877027] [DEBUG] [LOCAL ] JHX: Loaded 51295 existing records from primary storage. [2025-09-30T19:28:09.877458] [INFO ] [MAIN ] JHX: Loaded 51295 existing records. [2025-09-30T19:28:10.078210] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:10.078448] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-30T19:28:10.078495] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-30T19:28:10.079216] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-30T19:28:10.079285] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-30T19:28:10.485803] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:10.563930] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:28:10.566028] [INFO ] [REMOTE ] JHI: Full fetch complete (5300 records). [2025-09-30T19:28:10.566119] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-30T19:28:10.659540] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-30T19:28:10.961900] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-30T19:28:10.961994] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-30T19:28:10.962195] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-30T19:28:10.962243] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-30T19:28:10.962718] [DEBUG] [LOCAL ] JHI: Trimmed 5300 records to 3583 (keeping 200 days of data) [2025-09-30T19:28:10.986782] [DEBUG] [LOCAL ] JHI: Primary data saved (3583 records). [2025-09-30T19:28:10.986917] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-30T19:28:10.987009] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHI took 24.7s. Estimated remaining: 2h 35m 57s. Rate: 7.8 symbols/min [2025-09-30T19:28:11.175965] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:11.197728] [DEBUG] [LOCAL ] JILL: Loaded 16701 existing records from primary storage. [2025-09-30T19:28:11.197972] [INFO ] [MAIN ] JILL: Loaded 16701 existing records. [2025-09-30T19:28:11.428475] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:11.428763] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-30T19:28:11.428820] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-30T19:28:11.429111] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-30T19:28:11.429171] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-30T19:28:11.461130] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-30T19:28:11.804631] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:12.089972] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T19:28:12.254431] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-30T19:28:12.394990] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:28:13.054423] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-30T19:28:13.315769] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:28:13.718815] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:28:13.854369] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-30T19:28:14.654342] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-30T19:28:14.793945] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:28:15.454347] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-30T19:28:15.516382] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:28:16.254371] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-30T19:28:16.301295] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:28:17.054357] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-30T19:28:17.084484] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T19:28:17.854363] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-30T19:28:18.343520] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T19:28:18.654368] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-30T19:28:18.690294] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:28:19.454327] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-30T19:28:19.862252] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T19:28:20.165364] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T19:28:20.254434] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-30T19:28:21.054391] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-30T19:28:21.267323] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:28:21.515869] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T19:28:21.854357] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-30T19:28:22.654381] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-30T19:28:23.138824] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:28:23.303152] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:28:23.314100] [INFO ] [REMOTE ] JHG: Full fetch complete (68304 records). [2025-09-30T19:28:23.314246] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-30T19:28:23.459534] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-30T19:28:23.779862] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-30T19:28:23.779964] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-30T19:28:23.781014] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-30T19:28:23.781087] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-30T19:28:23.782730] [DEBUG] [LOCAL ] JHG: Trimmed 68304 records to 47675 (keeping 200 days of data) [2025-09-30T19:28:24.100136] [DEBUG] [LOCAL ] JHG: Primary data saved (47675 records). [2025-09-30T19:28:24.100302] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-30T19:28:24.100413] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 42.1s. Estimated remaining: 2h 35m 55s. Rate: 7.8 symbols/min [2025-09-30T19:28:24.256719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-30T19:28:24.292353] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:24.341280] [DEBUG] [LOCAL ] JKS: Loaded 40106 existing records from primary storage. [2025-09-30T19:28:24.341594] [INFO ] [MAIN ] JKS: Loaded 40106 existing records. [2025-09-30T19:28:24.542526] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:28:24.549069] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:24.552954] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-30T19:28:24.553407] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-30T19:28:24.554251] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-30T19:28:24.554312] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-30T19:28:25.043561] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:25.054328] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-30T19:28:25.854324] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-30T19:28:25.982942] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:28:26.339222] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:28:26.654337] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-30T19:28:26.964095] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:28:27.454407] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-30T19:28:28.175393] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:28:28.189881] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T19:28:28.254363] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-30T19:28:29.054366] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-30T19:28:29.251622] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:28:29.612332] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:28:29.854373] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-30T19:28:30.654339] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-30T19:28:30.921674] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T19:28:30.925971] [INFO ] [REMOTE ] JILL: Full fetch complete (22898 records). [2025-09-30T19:28:30.926102] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-30T19:28:31.341442] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-30T19:28:31.341537] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-30T19:28:31.342098] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-30T19:28:31.342163] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-30T19:28:31.343189] [DEBUG] [LOCAL ] JILL: Trimmed 22898 records to 16637 (keeping 200 days of data) [2025-09-30T19:28:31.448609] [DEBUG] [LOCAL ] JILL: Primary data saved (16637 records). [2025-09-30T19:28:31.448790] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-30T19:28:31.448890] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 20.5s. Estimated remaining: 2h 35m 47s. Rate: 7.8 symbols/min [2025-09-30T19:28:31.454312] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-30T19:28:32.221566] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:28:32.254315] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-30T19:28:32.655966] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:28:33.054370] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-30T19:28:33.384534] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:28:33.854358] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-30T19:28:34.654365] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-30T19:28:34.731826] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:28:35.235957] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T19:28:35.295021] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:28:35.454359] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-30T19:28:36.254387] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-30T19:28:37.054458] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-30T19:28:37.411689] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T19:28:37.520051] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:28:37.854360] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-30T19:28:37.960932] [DEBUG] [REMOTE ] JKS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-30T19:28:37.961298] [WARN ] [REMOTE ] JKS: No data returned for month 2025-05 [2025-09-30T19:28:37.961394] [FATAL] [REMOTE ] JKS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:28:37.961481] [FATAL] [MAIN ] JKS: Failed to fetch primary data. [2025-09-30T19:28:37.961544] [WARN ] [MAIN ] JKS: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:28:37.961615] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-30T19:28:37.961716] [DEBUG] [LOCAL ] JKS: No primary data file found to delete. [2025-09-30T19:28:37.961765] [INFO ] [LOCAL ] JKS: Starting deletion of derivative data. [2025-09-30T19:28:37.962390] [DEBUG] [LOCAL ] JKS: Deleted derivative data file. [2025-09-30T19:28:37.962482] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JKS took 13.9s. Estimated remaining: 2h 35m 38s. Rate: 7.8 symbols/min [2025-09-30T19:28:38.102207] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:28:38.654443] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-30T19:28:39.301276] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T19:28:39.302857] [INFO ] [REMOTE ] JHS: Full fetch complete (4443 records). [2025-09-30T19:28:39.302945] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-30T19:28:39.461086] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-30T19:28:39.692417] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-30T19:28:39.692512] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-30T19:28:39.692710] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-30T19:28:39.692772] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-30T19:28:39.693181] [DEBUG] [LOCAL ] JHS: Trimmed 4443 records to 2831 (keeping 200 days of data) [2025-09-30T19:28:39.712008] [DEBUG] [LOCAL ] JHS: Primary data saved (2831 records). [2025-09-30T19:28:39.712133] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-30T19:28:39.712217] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHS took 33.2s. Estimated remaining: 2h 35m 24s. Rate: 7.8 symbols/min [2025-09-30T19:28:41.443198] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T19:28:41.454529] [INFO ] [REMOTE ] JHX: Full fetch complete (58231 records). [2025-09-30T19:28:41.454723] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-30T19:28:41.899859] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-30T19:28:41.899959] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-30T19:28:41.900903] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-30T19:28:41.900972] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-30T19:28:41.902342] [DEBUG] [LOCAL ] JHX: Trimmed 58231 records to 51603 (keeping 200 days of data) [2025-09-30T19:28:42.223716] [DEBUG] [LOCAL ] JHX: Primary data saved (51603 records). [2025-09-30T19:28:42.223865] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-30T19:28:42.224687] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JHX took 32.6s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-09-30T19:28:42.906715] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:42.904863] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:42.985257] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:43.008737] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-30T19:28:43.013360] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-30T19:28:43.013110] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:43.016440] [DEBUG] [LOCAL ] JLS: Loaded 4105 existing records from primary storage. [2025-09-30T19:28:43.016870] [INFO ] [MAIN ] JLS: Loaded 4105 existing records. [2025-09-30T19:28:43.016622] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-30T19:28:43.017473] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-30T19:28:43.022878] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-30T19:28:43.023065] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-30T19:28:43.336804] [DEBUG] [LOCAL ] JLL: Loaded 31761 existing records from primary storage. [2025-09-30T19:28:43.431321] [INFO ] [MAIN ] JLL: Loaded 31761 existing records. [2025-09-30T19:28:43.506008] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:43.536510] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-30T19:28:43.620565] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-30T19:28:43.637729] [DEBUG] [LOCAL ] JMIA: Loaded 50591 existing records from primary storage. [2025-09-30T19:28:43.677426] [INFO ] [MAIN ] JMIA: Loaded 50591 existing records. [2025-09-30T19:28:43.696448] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-30T19:28:43.748450] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-30T19:28:43.929900] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:43.991470] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-30T19:28:44.171875] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:44.182622] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-30T19:28:44.187865] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-30T19:28:44.216343] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-30T19:28:44.261781] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-30T19:28:44.272797] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:44.300754] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-30T19:28:44.349995] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-30T19:28:44.446023] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-30T19:28:44.508938] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-30T19:28:44.696254] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:28:44.729426] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-30T19:28:44.946834] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:44.981743] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-30T19:28:45.317856] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T19:28:45.317742] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:45.323484] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-30T19:28:45.324083] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-30T19:28:45.411371] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:45.411705] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-30T19:28:45.643457] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:28:45.644984] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-30T19:28:45.965106] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T19:28:45.967011] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-30T19:28:46.186206] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T19:28:46.301689] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T19:28:46.654343] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-30T19:28:46.751708] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:28:47.059208] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:28:47.206123] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T19:28:47.454408] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-30T19:28:47.875373] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T19:28:48.254375] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-30T19:28:49.054413] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-30T19:28:49.749107] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:28:49.854394] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-30T19:28:50.326608] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:28:50.654376] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-30T19:28:51.454332] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-30T19:28:51.568669] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T19:28:51.951378] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T19:28:52.025016] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T19:28:52.254356] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-30T19:28:52.889384] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T19:28:53.054381] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-30T19:28:53.854368] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-30T19:28:54.163468] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T19:28:54.654405] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-30T19:28:55.454361] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-30T19:28:55.566459] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T19:28:55.795140] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-30T19:28:55.957753] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T19:28:56.254359] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-30T19:28:56.725958] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:28:57.054370] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-30T19:28:57.469416] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T19:28:57.854398] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-30T19:28:58.482722] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T19:28:58.483716] [INFO ] [REMOTE ] JMM: Full fetch complete (2284 records). [2025-09-30T19:28:58.483790] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-30T19:28:58.666469] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-30T19:28:58.681233] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-30T19:28:58.682533] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:28:58.682605] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:28:58.682700] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-30T19:28:58.682795] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-30T19:28:58.682854] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-30T19:28:58.682915] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-30T19:28:58.683009] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 16.5s. Estimated remaining: 2h 35m 12s. Rate: 7.8 symbols/min [2025-09-30T19:28:58.865076] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:58.925260] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-30T19:28:58.925669] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-30T19:28:59.122034] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:59.122330] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-30T19:28:59.122387] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-30T19:28:59.123449] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-30T19:28:59.123508] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-30T19:28:59.429428] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T19:28:59.457605] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-30T19:28:59.517173] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:00.254418] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-30T19:29:00.763570] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:29:00.943287] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:29:01.054446] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-30T19:29:01.854421] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-30T19:29:02.654396] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-30T19:29:03.446687] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-30T19:29:03.457593] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-30T19:29:03.545720] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:29:03.998453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:29:04.031412] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T19:29:04.254359] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-30T19:29:04.695935] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T19:29:05.054401] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-30T19:29:05.614781] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T19:29:05.854379] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-30T19:29:06.654404] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-30T19:29:07.277844] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T19:29:07.279474] [INFO ] [REMOTE ] JLS: Full fetch complete (5838 records). [2025-09-30T19:29:07.279550] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-30T19:29:07.464697] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-30T19:29:07.738869] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-30T19:29:07.739002] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-30T19:29:07.739207] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-30T19:29:07.739290] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-30T19:29:07.740085] [DEBUG] [LOCAL ] JLS: Trimmed 5838 records to 4126 (keeping 200 days of data) [2025-09-30T19:29:07.792100] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:29:07.807810] [DEBUG] [LOCAL ] JLS: Primary data saved (4126 records). [2025-09-30T19:29:07.807916] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-30T19:29:07.807995] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 25.5s. Estimated remaining: 2h 35m 6s. Rate: 7.8 symbols/min [2025-09-30T19:29:07.997502] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:08.060055] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-30T19:29:08.060456] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-30T19:29:08.253170] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:08.253380] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-30T19:29:08.253432] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-30T19:29:08.253878] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-30T19:29:08.253940] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-30T19:29:08.265455] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-30T19:29:08.670944] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:08.981957] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:29:09.054383] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-30T19:29:09.854407] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-30T19:29:10.528089] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T19:29:10.654388] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-30T19:29:11.454363] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-30T19:29:11.558092] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:29:11.654668] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-30T19:29:11.728554] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T19:29:12.254421] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-30T19:29:13.054378] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-30T19:29:13.558696] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T19:29:13.854355] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-30T19:29:14.115078] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T19:29:14.122105] [INFO ] [REMOTE ] JLL: Full fetch complete (44798 records). [2025-09-30T19:29:14.122255] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-30T19:29:14.536974] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-30T19:29:14.537095] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-30T19:29:14.537851] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-30T19:29:14.537926] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-30T19:29:14.540071] [DEBUG] [LOCAL ] JLL: Trimmed 44798 records to 31661 (keeping 200 days of data) [2025-09-30T19:29:14.654731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-30T19:29:14.752366] [DEBUG] [LOCAL ] JLL: Primary data saved (31661 records). [2025-09-30T19:29:14.752671] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-30T19:29:14.753095] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLL took 32.5s. Estimated remaining: 2h 34m 58s. Rate: 7.8 symbols/min [2025-09-30T19:29:14.962366] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:14.980605] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-30T19:29:15.015677] [DEBUG] [LOCAL ] JOE: Loaded 24232 existing records from primary storage. [2025-09-30T19:29:15.016012] [INFO ] [MAIN ] JOE: Loaded 24232 existing records. [2025-09-30T19:29:15.205307] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:15.205554] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-30T19:29:15.205602] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-30T19:29:15.206010] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-30T19:29:15.206087] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-30T19:29:15.465982] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-30T19:29:15.613405] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:15.655662] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:29:16.254368] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-30T19:29:16.514800] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T19:29:17.054362] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-30T19:29:17.438593] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:29:17.854376] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-30T19:29:17.954694] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-30T19:29:18.654355] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-30T19:29:19.053994] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:29:19.454409] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-30T19:29:19.596606] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:29:20.158376] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T19:29:20.254366] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-30T19:29:21.054374] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-30T19:29:21.320069] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:29:21.576835] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T19:29:21.588943] [INFO ] [REMOTE ] JMIA: Full fetch complete (73256 records). [2025-09-30T19:29:21.589168] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-30T19:29:21.859836] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-30T19:29:22.035134] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-30T19:29:22.035262] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-30T19:29:22.036629] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-30T19:29:22.036726] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-30T19:29:22.038395] [DEBUG] [LOCAL ] JMIA: Trimmed 73256 records to 50631 (keeping 200 days of data) [2025-09-30T19:29:22.354004] [DEBUG] [LOCAL ] JMIA: Primary data saved (50631 records). [2025-09-30T19:29:22.354154] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-30T19:29:22.354327] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 40.1s. Estimated remaining: 2h 34m 50s. Rate: 7.8 symbols/min [2025-09-30T19:29:22.547767] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:22.558207] [DEBUG] [LOCAL ] JOF: Loaded 7056 existing records from primary storage. [2025-09-30T19:29:22.558428] [INFO ] [MAIN ] JOF: Loaded 7056 existing records. [2025-09-30T19:29:22.660313] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-30T19:29:22.746132] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:22.746349] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-30T19:29:22.746400] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-30T19:29:22.746631] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-30T19:29:22.746721] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-30T19:29:23.142968] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:23.159956] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:29:23.458882] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-30T19:29:23.462883] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-30T19:29:24.254422] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-30T19:29:24.612342] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:29:24.741917] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T19:29:25.054357] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-30T19:29:25.715435] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:29:25.854352] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-30T19:29:26.650965] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-30T19:29:26.661634] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-30T19:29:26.679303] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T19:29:27.454374] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-30T19:29:27.871025] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:29:28.254378] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-30T19:29:28.827782] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T19:29:29.054329] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-30T19:29:29.524870] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-30T19:29:29.854360] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-30T19:29:30.654367] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-30T19:29:31.454381] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-30T19:29:31.651203] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-30T19:29:31.753243] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:29:32.203472] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T19:29:32.205629] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-30T19:29:32.254329] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-30T19:29:33.054348] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-30T19:29:33.854363] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-30T19:29:34.654338] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-30T19:29:34.679681] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T19:29:34.810276] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-30T19:29:34.935883] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T19:29:35.454361] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-30T19:29:35.836302] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T19:29:36.254400] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-30T19:29:37.054360] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-30T19:29:37.645396] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:29:37.797007] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T19:29:37.809376] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-30T19:29:37.809546] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-30T19:29:37.859541] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-30T19:29:38.235735] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-30T19:29:38.235839] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-30T19:29:38.236925] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-30T19:29:38.236996] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-30T19:29:38.238774] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-30T19:29:38.592849] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-30T19:29:38.593001] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-30T19:29:38.594889] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JNJ took 39.9s. Estimated remaining: 2h 34m 51s. Rate: 7.8 symbols/min [2025-09-30T19:29:38.662305] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-30T19:29:38.818326] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-30T19:29:38.823058] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:38.876446] [DEBUG] [LOCAL ] JPC: Loaded 37088 existing records from primary storage. [2025-09-30T19:29:38.876876] [INFO ] [MAIN ] JPC: Loaded 37088 existing records. [2025-09-30T19:29:39.099904] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:39.102080] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-30T19:29:39.102298] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-30T19:29:39.107227] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-30T19:29:39.108042] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-30T19:29:39.108303] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T19:29:39.101900] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T19:29:39.459505] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-30T19:29:39.489588] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:40.254374] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-30T19:29:40.779815] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T19:29:40.784984] [INFO ] [REMOTE ] JOE: Full fetch complete (36101 records). [2025-09-30T19:29:40.785103] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-30T19:29:41.063942] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-30T19:29:41.202188] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-30T19:29:41.202277] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-30T19:29:41.203002] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-30T19:29:41.203098] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-30T19:29:41.204184] [DEBUG] [LOCAL ] JOE: Trimmed 36101 records to 24183 (keeping 200 days of data) [2025-09-30T19:29:41.355413] [DEBUG] [LOCAL ] JOE: Primary data saved (24183 records). [2025-09-30T19:29:41.355611] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-30T19:29:41.355784] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 26.6s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-09-30T19:29:41.541154] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:41.599000] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-30T19:29:41.599366] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-30T19:29:41.726195] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T19:29:41.819773] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:41.820300] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-30T19:29:41.820449] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-30T19:29:41.829351] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-30T19:29:41.829462] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-30T19:29:41.866172] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-30T19:29:41.918983] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:29:42.262070] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:42.470263] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:29:42.654366] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-30T19:29:43.454382] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-30T19:29:44.137833] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:29:44.254361] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-30T19:29:44.296103] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:29:44.298775] [INFO ] [REMOTE ] JOF: Full fetch complete (9526 records). [2025-09-30T19:29:44.298867] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-30T19:29:44.737263] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-30T19:29:44.737363] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-30T19:29:44.737617] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-30T19:29:44.737689] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-30T19:29:44.738228] [DEBUG] [LOCAL ] JOF: Trimmed 9526 records to 7020 (keeping 200 days of data) [2025-09-30T19:29:44.780529] [DEBUG] [LOCAL ] JOF: Primary data saved (7020 records). [2025-09-30T19:29:44.780667] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-30T19:29:44.780807] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 22.4s. Estimated remaining: 2h 34m 26s. Rate: 7.8 symbols/min [2025-09-30T19:29:44.959124] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:44.993496] [DEBUG] [LOCAL ] JQC: Loaded 33913 existing records from primary storage. [2025-09-30T19:29:44.993804] [INFO ] [MAIN ] JQC: Loaded 33913 existing records. [2025-09-30T19:29:45.059783] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-30T19:29:45.182217] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:45.182472] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-30T19:29:45.182519] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-30T19:29:45.182852] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-30T19:29:45.182911] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-30T19:29:45.566493] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:45.854388] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-30T19:29:46.493293] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T19:29:46.607236] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:29:46.654407] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-30T19:29:46.860580] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:29:47.454378] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-30T19:29:48.254361] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-30T19:29:48.978213] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:29:49.054332] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-30T19:29:49.423365] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-30T19:29:49.601289] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T19:29:49.854372] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-30T19:29:50.654370] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-30T19:29:51.005700] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T19:29:51.173738] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T19:29:51.454357] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-30T19:29:51.878321] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:29:52.254406] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-30T19:29:52.873992] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T19:29:53.054432] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-30T19:29:53.701741] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:29:53.854342] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-30T19:29:54.654327] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-30T19:29:54.861466] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:29:55.220842] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:29:55.454364] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-30T19:29:55.503387] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T19:29:56.254365] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-30T19:29:56.830058] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T19:29:57.054389] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-30T19:29:57.854335] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-30T19:29:57.927627] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T19:29:58.335864] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T19:29:58.654356] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-30T19:29:59.454381] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-30T19:30:00.254440] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-30T19:30:00.645814] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-30T19:30:00.658755] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-30T19:30:00.658972] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-30T19:30:00.968061] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:30:01.056834] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-30T19:30:01.152732] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-30T19:30:01.152836] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-30T19:30:01.153919] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-30T19:30:01.154003] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-30T19:30:01.155707] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-30T19:30:01.281066] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-30T19:30:01.567373] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-30T19:30:01.567516] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-30T19:30:01.567632] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 53.8s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-09-30T19:30:01.771549] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:01.810680] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:30:01.837576] [DEBUG] [LOCAL ] JRI: Loaded 14768 existing records from primary storage. [2025-09-30T19:30:01.837912] [INFO ] [MAIN ] JRI: Loaded 14768 existing records. [2025-09-30T19:30:01.859713] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-30T19:30:02.061383] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:02.061765] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-30T19:30:02.061900] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-30T19:30:02.062452] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-30T19:30:02.062516] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-30T19:30:02.471320] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:30:02.514957] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:02.654371] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-30T19:30:03.454367] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-30T19:30:03.662084] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:30:04.254350] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-30T19:30:04.328454] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-30T19:30:05.060600] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-30T19:30:05.075791] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:30:05.436697] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:30:05.854376] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-30T19:30:06.654412] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-30T19:30:07.136329] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:30:07.143559] [INFO ] [REMOTE ] JQC: Full fetch complete (48957 records). [2025-09-30T19:30:07.143755] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-30T19:30:07.459454] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-30T19:30:07.565960] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-30T19:30:07.566132] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-30T19:30:07.567043] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-30T19:30:07.567187] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-30T19:30:07.568870] [DEBUG] [LOCAL ] JQC: Trimmed 48957 records to 34076 (keeping 200 days of data) [2025-09-30T19:30:07.700120] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-30T19:30:07.835413] [DEBUG] [LOCAL ] JQC: Primary data saved (34076 records). [2025-09-30T19:30:07.835610] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-30T19:30:07.835822] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JQC took 23.1s. Estimated remaining: 2h 34m 18s. Rate: 7.8 symbols/min [2025-09-30T19:30:08.027591] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:08.044510] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:30:08.053201] [INFO ] [REMOTE ] JPC: Full fetch complete (55708 records). [2025-09-30T19:30:08.053320] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-30T19:30:08.160593] [DEBUG] [LOCAL ] JRS: Loaded 11178 existing records from primary storage. [2025-09-30T19:30:08.172718] [INFO ] [MAIN ] JRS: Loaded 11178 existing records. [2025-09-30T19:30:08.272793] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-30T19:30:08.578672] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:08.629381] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-30T19:30:08.646844] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-30T19:30:08.664500] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-30T19:30:08.663855] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T19:30:08.685548] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-30T19:30:08.853534] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-30T19:30:08.871491] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-30T19:30:08.884741] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-30T19:30:08.890618] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-30T19:30:08.954459] [DEBUG] [LOCAL ] JPC: Trimmed 55708 records to 37115 (keeping 200 days of data) [2025-09-30T19:30:09.072774] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-30T19:30:09.291168] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:09.413092] [DEBUG] [LOCAL ] JPC: Primary data saved (37115 records). [2025-09-30T19:30:09.413251] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-30T19:30:09.414738] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPC took 30.8s. Estimated remaining: 2h 34m 4s. Rate: 7.8 symbols/min [2025-09-30T19:30:09.609934] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:09.664703] [DEBUG] [LOCAL ] JXN: Loaded 45731 existing records from primary storage. [2025-09-30T19:30:09.665034] [INFO ] [MAIN ] JXN: Loaded 45731 existing records. [2025-09-30T19:30:09.863874] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:09.855810] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-30T19:30:09.865286] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-30T19:30:09.865354] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-30T19:30:09.865703] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-30T19:30:09.865764] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-30T19:30:10.173752] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T19:30:10.287905] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:10.654376] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-30T19:30:10.874324] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-30T19:30:10.895146] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T19:30:11.454366] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-30T19:30:12.216632] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:30:12.254323] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-30T19:30:13.054386] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-30T19:30:13.742399] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-30T19:30:13.781818] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:30:13.800522] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:30:13.854335] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-30T19:30:14.622401] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:30:14.654340] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-30T19:30:15.454406] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-30T19:30:16.226315] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T19:30:16.254371] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-30T19:30:16.899098] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T19:30:17.054370] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-30T19:30:17.188374] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-30T19:30:17.200280] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-30T19:30:17.200460] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-30T19:30:17.614910] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-30T19:30:17.615033] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-30T19:30:17.616418] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-30T19:30:17.616492] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-30T19:30:17.618751] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-30T19:30:17.855865] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-30T19:30:17.882071] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:30:18.011680] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-30T19:30:18.011860] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-30T19:30:18.011958] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JPM took 36.7s. Estimated remaining: 2h 33m 58s. Rate: 7.8 symbols/min [2025-09-30T19:30:18.211295] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:18.263888] [DEBUG] [LOCAL ] K: Loaded 49924 existing records from primary storage. [2025-09-30T19:30:18.264273] [INFO ] [MAIN ] K: Loaded 49924 existing records. [2025-09-30T19:30:18.460588] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:18.460938] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-30T19:30:18.460993] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-30T19:30:18.461502] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-30T19:30:18.461736] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-30T19:30:18.658746] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-30T19:30:18.792168] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T19:30:18.889774] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:19.454364] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-30T19:30:19.753870] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T19:30:20.254366] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-30T19:30:20.319003] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T19:30:21.050969] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T19:30:21.054217] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-30T19:30:21.854357] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-30T19:30:21.891448] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:30:21.896216] [INFO ] [REMOTE ] JRI: Full fetch complete (23192 records). [2025-09-30T19:30:21.896319] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-30T19:30:22.303078] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-30T19:30:22.303166] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-30T19:30:22.303693] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-30T19:30:22.303771] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-30T19:30:22.304578] [DEBUG] [LOCAL ] JRI: Trimmed 23192 records to 14806 (keeping 200 days of data) [2025-09-30T19:30:22.410991] [DEBUG] [LOCAL ] JRI: Primary data saved (14806 records). [2025-09-30T19:30:22.411142] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-30T19:30:22.411271] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRI took 20.8s. Estimated remaining: 2h 33m 47s. Rate: 7.8 symbols/min [2025-09-30T19:30:22.610076] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:22.621880] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:30:22.636545] [DEBUG] [LOCAL ] KAI: Loaded 13338 existing records from primary storage. [2025-09-30T19:30:22.636877] [INFO ] [MAIN ] KAI: Loaded 13338 existing records. [2025-09-30T19:30:22.659541] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-30T19:30:22.836684] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:22.837073] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-30T19:30:22.837147] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-30T19:30:22.837397] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-30T19:30:22.837458] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-30T19:30:23.272963] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:23.454362] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-30T19:30:23.613750] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:30:24.254382] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-30T19:30:24.337496] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:30:25.054415] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-30T19:30:25.167220] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T19:30:25.854336] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-30T19:30:25.893046] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:30:26.626898] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T19:30:26.654400] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-30T19:30:27.297792] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:30:27.300903] [INFO ] [REMOTE ] JRS: Full fetch complete (16148 records). [2025-09-30T19:30:27.300982] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-30T19:30:27.459632] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-30T19:30:27.704265] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-30T19:30:27.704356] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-30T19:30:27.704871] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-30T19:30:27.704936] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-30T19:30:27.705698] [DEBUG] [LOCAL ] JRS: Trimmed 16148 records to 11261 (keeping 200 days of data) [2025-09-30T19:30:27.772662] [DEBUG] [LOCAL ] JRS: Primary data saved (11261 records). [2025-09-30T19:30:27.772814] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-30T19:30:27.772905] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JRS took 19.9s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-09-30T19:30:27.960371] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:28.003989] [DEBUG] [LOCAL ] KAR: Loaded 39817 existing records from primary storage. [2025-09-30T19:30:28.004301] [INFO ] [MAIN ] KAR: Loaded 39817 existing records. [2025-09-30T19:30:28.192992] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:28.193227] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-30T19:30:28.193277] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-30T19:30:28.193696] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-30T19:30:28.193757] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-30T19:30:28.259926] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-30T19:30:28.586517] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:29.054334] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-30T19:30:29.272885] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:30:29.854321] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-30T19:30:29.918374] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:30:30.028210] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:30:30.654356] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-30T19:30:31.454359] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-30T19:30:31.522886] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:30:32.254349] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-30T19:30:32.441692] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:30:32.995946] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:30:33.054353] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-30T19:30:33.798936] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:30:33.854373] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-30T19:30:34.178032] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T19:30:34.654329] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-30T19:30:34.861176] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T19:30:35.454325] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-30T19:30:35.779377] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T19:30:36.254407] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-30T19:30:36.617039] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:30:37.054386] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-30T19:30:37.593987] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T19:30:37.854415] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-30T19:30:38.654416] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-30T19:30:38.738786] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:30:39.454334] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-30T19:30:39.597945] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T19:30:39.676466] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:30:40.254361] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-30T19:30:40.891492] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:30:41.054412] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-30T19:30:41.860198] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-30T19:30:41.886151] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:30:42.589064] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:30:42.634211] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:30:42.654341] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-30T19:30:43.454410] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-30T19:30:44.192587] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:30:44.254348] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-30T19:30:44.949803] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:30:45.054337] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-30T19:30:45.211628] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:30:45.854423] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-30T19:30:46.234929] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:30:46.654405] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-30T19:30:47.358095] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:30:47.454348] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-30T19:30:48.254332] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-30T19:30:48.347954] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:30:48.450035] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:30:49.054404] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-30T19:30:49.800102] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T19:30:49.854353] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-30T19:30:49.965320] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:30:49.968477] [INFO ] [REMOTE ] KAI: Full fetch complete (18876 records). [2025-09-30T19:30:49.968566] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-30T19:30:50.394567] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-30T19:30:50.394682] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-30T19:30:50.395161] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-30T19:30:50.395211] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-30T19:30:50.395997] [DEBUG] [LOCAL ] KAI: Trimmed 18876 records to 13286 (keeping 200 days of data) [2025-09-30T19:30:50.486787] [DEBUG] [LOCAL ] KAI: Primary data saved (13286 records). [2025-09-30T19:30:50.487009] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-30T19:30:50.487124] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 28.1s. Estimated remaining: 2h 33m 44s. Rate: 7.8 symbols/min [2025-09-30T19:30:50.663765] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-30T19:30:50.698718] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:50.729318] [DEBUG] [LOCAL ] KB: Loaded 24026 existing records from primary storage. [2025-09-30T19:30:50.729757] [INFO ] [MAIN ] KB: Loaded 24026 existing records. [2025-09-30T19:30:50.911926] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:50.912279] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-30T19:30:50.912335] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-30T19:30:50.912761] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-30T19:30:50.912823] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-30T19:30:51.295881] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:51.454393] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-30T19:30:51.682625] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T19:30:51.692451] [INFO ] [REMOTE ] JXN: Full fetch complete (65297 records). [2025-09-30T19:30:51.692636] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-30T19:30:52.118020] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-30T19:30:52.118230] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-30T19:30:52.119324] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-30T19:30:52.119410] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-30T19:30:52.121003] [DEBUG] [LOCAL ] JXN: Trimmed 65297 records to 45657 (keeping 200 days of data) [2025-09-30T19:30:52.254621] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-30T19:30:52.410060] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:30:52.448280] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:30:52.505499] [DEBUG] [LOCAL ] JXN: Primary data saved (45657 records). [2025-09-30T19:30:52.505661] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-30T19:30:52.506257] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. JXN took 43.1s. Estimated remaining: 2h 33m 31s. Rate: 7.8 symbols/min [2025-09-30T19:30:52.695740] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:52.724599] [DEBUG] [LOCAL ] KBDC: Loaded 20926 existing records from primary storage. [2025-09-30T19:30:52.724939] [INFO ] [MAIN ] KBDC: Loaded 20926 existing records. [2025-09-30T19:30:52.924065] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:52.924299] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-30T19:30:52.924353] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-30T19:30:52.924859] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-30T19:30:52.924922] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-30T19:30:53.059525] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-30T19:30:53.318750] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:53.854398] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-30T19:30:53.984813] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:30:54.223148] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:30:54.654390] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-30T19:30:54.697311] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T19:30:55.454384] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-30T19:30:56.254343] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-30T19:30:56.533792] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:30:56.582203] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:30:57.054357] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-30T19:30:57.199185] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:30:57.854367] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-30T19:30:58.654376] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-30T19:30:58.871791] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:30:58.937541] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T19:30:59.454372] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-30T19:30:59.473781] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T19:31:00.254366] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-30T19:31:00.625125] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:31:01.054366] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-30T19:31:01.642335] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:31:01.854413] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-30T19:31:02.654435] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-30T19:31:02.757060] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T19:31:03.004757] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:31:03.454370] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-30T19:31:04.254374] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-30T19:31:04.880886] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T19:31:04.892864] [INFO ] [REMOTE ] K: Full fetch complete (72028 records). [2025-09-30T19:31:04.893040] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-30T19:31:05.054800] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-30T19:31:05.148619] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T19:31:05.367712] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-30T19:31:05.367936] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-30T19:31:05.369080] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-30T19:31:05.369167] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-30T19:31:05.396698] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:31:05.396873] [DEBUG] [LOCAL ] K: Trimmed 72028 records to 49962 (keeping 200 days of data) [2025-09-30T19:31:05.407582] [INFO ] [REMOTE ] KAR: Full fetch complete (56767 records). [2025-09-30T19:31:05.407806] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-30T19:31:05.859932] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-30T19:31:05.975937] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-30T19:31:05.976323] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-30T19:31:05.977425] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-30T19:31:05.978342] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-30T19:31:05.981595] [DEBUG] [LOCAL ] KAR: Trimmed 56767 records to 39860 (keeping 200 days of data) [2025-09-30T19:31:06.381222] [DEBUG] [LOCAL ] KAR: Primary data saved (39860 records). [2025-09-30T19:31:06.387419] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-30T19:31:06.387630] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 38.6s. Estimated remaining: 2h 33m 29s. Rate: 7.8 symbols/min [2025-09-30T19:31:06.654236] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:06.680782] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:31:06.679788] [DEBUG] [LOCAL ] K: Primary data saved (49962 records). [2025-09-30T19:31:06.686637] [INFO ] [MAIN ] K: Full history saved. [2025-09-30T19:31:06.692630] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. K took 48.7s. Estimated remaining: 2h 33m 14s. Rate: 7.8 symbols/min [2025-09-30T19:31:06.698921] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-30T19:31:06.724940] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T19:31:06.905765] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:06.916942] [DEBUG] [LOCAL ] KBR: No existing data file found in primary storage. [2025-09-30T19:31:06.917025] [WARN ] [MAIN ] KBR: No existing data found, performing full refresh instead. [2025-09-30T19:31:06.917156] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-30T19:31:06.917199] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-30T19:31:06.917242] [DEBUG] [LOCAL ] KBR: No primary data file found to delete. [2025-09-30T19:31:06.917274] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-30T19:31:07.078299] [DEBUG] [LOCAL ] KBH: Loaded 48938 existing records from primary storage. [2025-09-30T19:31:07.109032] [INFO ] [MAIN ] KBH: Loaded 48938 existing records. [2025-09-30T19:31:07.471571] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-30T19:31:07.551420] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:07.559667] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:07.561222] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-30T19:31:07.561709] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-30T19:31:07.562229] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-30T19:31:07.562291] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-30T19:31:07.968531] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:07.985334] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T19:31:08.254340] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-30T19:31:08.504774] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T19:31:09.054368] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-30T19:31:09.856390] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-30T19:31:09.860097] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:31:10.654380] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-30T19:31:10.724523] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:31:11.134213] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T19:31:11.454381] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-30T19:31:12.031631] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:31:12.254332] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-30T19:31:12.412528] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:31:13.054333] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-30T19:31:13.077450] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:31:13.854371] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-30T19:31:14.486449] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T19:31:14.493474] [INFO ] [REMOTE ] KBDC: Full fetch complete (28708 records). [2025-09-30T19:31:14.493635] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-30T19:31:14.659444] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-30T19:31:14.925974] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-30T19:31:14.926094] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-30T19:31:14.926796] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-30T19:31:14.926860] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-30T19:31:14.927634] [DEBUG] [LOCAL ] KBDC: Trimmed 28708 records to 21049 (keeping 200 days of data) [2025-09-30T19:31:15.041006] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:31:15.048588] [INFO ] [REMOTE ] KB: Full fetch complete (34123 records). [2025-09-30T19:31:15.051203] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-30T19:31:15.435665] [DEBUG] [LOCAL ] KBDC: Primary data saved (21049 records). [2025-09-30T19:31:15.451250] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-30T19:31:15.476124] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 23.0s. Estimated remaining: 2h 33m 7s. Rate: 7.8 symbols/min [2025-09-30T19:31:15.456512] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-30T19:31:15.592700] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-30T19:31:15.609843] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-30T19:31:15.633324] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-30T19:31:15.633436] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-30T19:31:15.682099] [DEBUG] [LOCAL ] KB: Trimmed 34123 records to 24012 (keeping 200 days of data) [2025-09-30T19:31:15.735526] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:15.921993] [DEBUG] [LOCAL ] KB: Primary data saved (24012 records). [2025-09-30T19:31:15.921895] [DEBUG] [LOCAL ] KD: Loaded 52300 existing records from primary storage. [2025-09-30T19:31:15.922147] [INFO ] [MAIN ] KB: Full history saved. [2025-09-30T19:31:15.922265] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KB took 25.4s. Estimated remaining: 2h 32m 52s. Rate: 7.8 symbols/min [2025-09-30T19:31:15.922697] [INFO ] [MAIN ] KD: Loaded 52300 existing records. [2025-09-30T19:31:16.271308] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:16.303167] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-30T19:31:16.335289] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-30T19:31:16.339843] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:16.339963] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-30T19:31:16.340284] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-30T19:31:16.471062] [DEBUG] [LOCAL ] KEN: Loaded 4731 existing records from primary storage. [2025-09-30T19:31:16.497837] [INFO ] [MAIN ] KEN: Loaded 4731 existing records. [2025-09-30T19:31:16.890019] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:16.895716] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-30T19:31:16.895860] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-30T19:31:16.995390] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:16.984292] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-30T19:31:17.006734] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-30T19:31:17.010901] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-30T19:31:17.044780] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-30T19:31:17.125395] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-30T19:31:17.436666] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:31:17.470835] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:17.854355] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-30T19:31:18.467328] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:31:18.511455] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:31:18.654373] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-30T19:31:19.454366] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-30T19:31:19.548241] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:31:20.254388] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-30T19:31:20.377112] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:31:20.732520] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T19:31:21.000806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:31:21.054391] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-30T19:31:21.854376] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-30T19:31:22.654358] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-30T19:31:22.817015] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:31:23.454320] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-30T19:31:23.658471] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:31:24.254350] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-30T19:31:24.333374] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:31:25.054351] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-30T19:31:25.306812] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:31:25.854377] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-30T19:31:26.014504] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:31:26.427000] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:31:26.654380] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-30T19:31:26.869076] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T19:31:27.454363] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-30T19:31:28.254366] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-30T19:31:28.430929] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T19:31:29.054355] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-30T19:31:29.214300] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T19:31:29.862954] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-30T19:31:29.869169] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:31:30.414866] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T19:31:30.654353] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-30T19:31:31.454324] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-30T19:31:31.672665] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T19:31:31.919731] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:31:32.259442] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-30T19:31:32.276577] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:31:33.054368] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-30T19:31:33.854339] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-30T19:31:33.986396] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:31:34.654368] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-30T19:31:35.258825] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:31:35.270723] [INFO ] [REMOTE ] KBH: Full fetch complete (70774 records). [2025-09-30T19:31:35.270933] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-30T19:31:35.454724] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-30T19:31:35.693961] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-30T19:31:35.694188] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-30T19:31:35.695255] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-30T19:31:35.695344] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-30T19:31:35.727674] [DEBUG] [LOCAL ] KBH: Trimmed 70774 records to 48913 (keeping 200 days of data) [2025-09-30T19:31:35.729828] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T19:31:36.053908] [DEBUG] [LOCAL ] KBH: Primary data saved (48913 records). [2025-09-30T19:31:36.054060] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-30T19:31:36.054207] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBH took 29.7s. Estimated remaining: 2h 32m 57s. Rate: 7.8 symbols/min [2025-09-30T19:31:36.259997] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:36.255235] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-30T19:31:36.296585] [DEBUG] [LOCAL ] KEP: Loaded 30817 existing records from primary storage. [2025-09-30T19:31:36.300298] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:31:36.300801] [INFO ] [MAIN ] KEP: Loaded 30817 existing records. [2025-09-30T19:31:36.506234] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:31:36.527599] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:36.537441] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-30T19:31:36.537527] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-30T19:31:36.538343] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-30T19:31:36.538411] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-30T19:31:36.944702] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:37.054374] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-30T19:31:37.854364] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-30T19:31:38.010167] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T19:31:38.654394] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-30T19:31:38.756974] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:31:38.767470] [INFO ] [REMOTE ] KBR: Full fetch complete (69904 records). [2025-09-30T19:31:38.767627] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-30T19:31:39.022412] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:31:39.289232] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-30T19:31:39.289314] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-30T19:31:39.290416] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-30T19:31:39.290485] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-30T19:31:39.292053] [DEBUG] [LOCAL ] KBR: Trimmed 69904 records to 48052 (keeping 200 days of data) [2025-09-30T19:31:39.487860] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-30T19:31:39.640075] [DEBUG] [LOCAL ] KBR: Primary data saved (48052 records). [2025-09-30T19:31:39.640434] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-30T19:31:39.640985] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBR took 32.9s. Estimated remaining: 2h 32m 45s. Rate: 7.8 symbols/min [2025-09-30T19:31:39.904079] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:39.954192] [DEBUG] [LOCAL ] KEX: Loaded 38072 existing records from primary storage. [2025-09-30T19:31:39.954555] [INFO ] [MAIN ] KEX: Loaded 38072 existing records. [2025-09-30T19:31:40.099554] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:31:40.177185] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:40.178077] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-30T19:31:40.178198] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-30T19:31:40.179299] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-30T19:31:40.179362] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-30T19:31:40.259483] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-30T19:31:40.605141] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:40.639249] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-30T19:31:41.054331] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-30T19:31:41.415497] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:31:41.854336] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-30T19:31:42.547957] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:31:42.654376] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-30T19:31:42.996590] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:31:43.454402] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-30T19:31:44.191941] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:31:44.203701] [INFO ] [REMOTE ] KD: Full fetch complete (75655 records). [2025-09-30T19:31:44.203886] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-30T19:31:44.263034] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-30T19:31:44.629156] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-30T19:31:44.629328] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-30T19:31:44.630316] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-30T19:31:44.630407] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-30T19:31:44.631989] [DEBUG] [LOCAL ] KD: Trimmed 75655 records to 52305 (keeping 200 days of data) [2025-09-30T19:31:44.955910] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:31:44.996344] [DEBUG] [LOCAL ] KD: Primary data saved (52305 records). [2025-09-30T19:31:45.011236] [INFO ] [MAIN ] KD: Full history saved. [2025-09-30T19:31:45.012803] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 29.5s. Estimated remaining: 2h 32m 35s. Rate: 7.8 symbols/min [2025-09-30T19:31:45.019814] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:31:45.059509] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-30T19:31:45.225401] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:45.225626] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-30T19:31:45.225716] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-30T19:31:45.225865] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-30T19:31:45.225936] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-30T19:31:45.226060] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-30T19:31:45.226150] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-30T19:31:45.609576] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:45.780837] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:31:45.854388] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-30T19:31:46.577850] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T19:31:46.654403] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-30T19:31:47.454398] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-30T19:31:48.009854] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T19:31:48.051006] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T19:31:48.254364] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-30T19:31:49.054393] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-30T19:31:49.371877] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T19:31:49.854401] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-30T19:31:50.538447] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T19:31:50.540324] [INFO ] [REMOTE ] KEN: Full fetch complete (5951 records). [2025-09-30T19:31:50.540456] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-30T19:31:50.660428] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-30T19:31:50.969752] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-30T19:31:50.969859] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-30T19:31:50.970062] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-30T19:31:50.970351] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-30T19:31:50.970990] [DEBUG] [LOCAL ] KEN: Trimmed 5951 records to 4740 (keeping 200 days of data) [2025-09-30T19:31:51.001384] [DEBUG] [LOCAL ] KEN: Primary data saved (4740 records). [2025-09-30T19:31:51.001628] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-30T19:31:51.001762] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEN took 35.1s. Estimated remaining: 2h 32m 26s. Rate: 7.8 symbols/min [2025-09-30T19:31:51.164290] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-30T19:31:51.240745] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:51.295833] [DEBUG] [LOCAL ] KEYS: Loaded 43195 existing records from primary storage. [2025-09-30T19:31:51.296207] [INFO ] [MAIN ] KEYS: Loaded 43195 existing records. [2025-09-30T19:31:51.464410] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-30T19:31:51.500586] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:51.501162] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-30T19:31:51.501223] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-30T19:31:51.501787] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-30T19:31:51.501850] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-30T19:31:51.908463] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:52.251713] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:31:52.259781] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-30T19:31:53.054375] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-30T19:31:53.343215] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:31:53.393559] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T19:31:53.854388] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-30T19:31:54.542722] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:31:54.654372] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-30T19:31:55.441446] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:31:55.456308] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-30T19:31:55.934664] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:31:56.254432] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-30T19:31:56.391187] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T19:31:57.054384] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-30T19:31:57.449513] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:31:57.854358] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-30T19:31:58.354211] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:31:58.654384] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-30T19:31:59.454327] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-30T19:31:59.574462] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:32:00.186535] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:32:00.254362] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-30T19:32:00.935681] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T19:32:01.054410] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-30T19:32:01.854337] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-30T19:32:02.101260] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:32:02.654371] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-30T19:32:02.689807] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:32:03.289979] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:32:03.454425] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-30T19:32:04.196391] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:32:04.254350] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-30T19:32:04.989725] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:32:05.054407] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-30T19:32:05.768161] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:32:05.854369] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-30T19:32:06.514292] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T19:32:06.524417] [INFO ] [REMOTE ] KEX: Full fetch complete (55688 records). [2025-09-30T19:32:06.524591] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-30T19:32:06.659555] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-30T19:32:06.961465] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-30T19:32:06.961562] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-30T19:32:06.962472] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-30T19:32:06.962540] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-30T19:32:06.963930] [DEBUG] [LOCAL ] KEX: Trimmed 55688 records to 38053 (keeping 200 days of data) [2025-09-30T19:32:07.208513] [DEBUG] [LOCAL ] KEX: Primary data saved (38053 records). [2025-09-30T19:32:07.208718] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-30T19:32:07.208872] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 27.6s. Estimated remaining: 2h 32m 27s. Rate: 7.8 symbols/min [2025-09-30T19:32:07.372350] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:32:07.432724] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:07.438685] [DEBUG] [LOCAL ] KF: Loaded 2467 existing records from primary storage. [2025-09-30T19:32:07.438957] [INFO ] [MAIN ] KF: Loaded 2467 existing records. [2025-09-30T19:32:07.460246] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-30T19:32:07.634828] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:07.635066] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-30T19:32:07.635114] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-30T19:32:07.635304] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-30T19:32:07.635363] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-30T19:32:08.053086] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:08.254347] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-30T19:32:08.553251] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T19:32:08.736022] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:32:08.753805] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T19:32:09.054371] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-30T19:32:09.854386] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-30T19:32:10.654373] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-30T19:32:10.756717] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:32:11.145307] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T19:32:11.260531] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:32:11.267689] [INFO ] [REMOTE ] KEP: Full fetch complete (41659 records). [2025-09-30T19:32:11.267828] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-30T19:32:11.462478] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-30T19:32:11.703286] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-30T19:32:11.703389] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-30T19:32:11.704388] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-30T19:32:11.704465] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-30T19:32:11.706044] [DEBUG] [LOCAL ] KEP: Trimmed 41659 records to 30960 (keeping 200 days of data) [2025-09-30T19:32:11.909831] [DEBUG] [LOCAL ] KEP: Primary data saved (30960 records). [2025-09-30T19:32:11.910020] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-30T19:32:11.910195] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEP took 35.9s. Estimated remaining: 2h 32m 16s. Rate: 7.8 symbols/min [2025-09-30T19:32:12.099427] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:12.125577] [DEBUG] [LOCAL ] KFRC: Loaded 19512 existing records from primary storage. [2025-09-30T19:32:12.125873] [INFO ] [MAIN ] KFRC: Loaded 19512 existing records. [2025-09-30T19:32:12.259442] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-30T19:32:12.330962] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:12.331220] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-30T19:32:12.331291] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-30T19:32:12.331578] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-30T19:32:12.331638] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-30T19:32:12.731623] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:13.054373] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-30T19:32:13.513216] [DEBUG] [REMOTE ] KF: Error fetching primary data for 2025-02: Server request status code is 503. [2025-09-30T19:32:13.513575] [WARN ] [REMOTE ] KF: No data returned for month 2025-02 [2025-09-30T19:32:13.513699] [FATAL] [REMOTE ] KF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:32:13.513828] [FATAL] [MAIN ] KF: Failed to fetch primary data. [2025-09-30T19:32:13.513899] [WARN ] [MAIN ] KF: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:32:13.513956] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-30T19:32:13.514013] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-09-30T19:32:13.514048] [INFO ] [LOCAL ] KF: Starting deletion of derivative data. [2025-09-30T19:32:13.514415] [DEBUG] [LOCAL ] KF: Deleted derivative data file. [2025-09-30T19:32:13.514544] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 6.3s. Estimated remaining: 2h 32m 2s. Rate: 7.8 symbols/min [2025-09-30T19:32:13.705985] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:13.717680] [DEBUG] [LOCAL ] KFS: Loaded 8440 existing records from primary storage. [2025-09-30T19:32:13.717919] [INFO ] [MAIN ] KFS: Loaded 8440 existing records. [2025-09-30T19:32:13.887570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-30T19:32:13.925402] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:13.926639] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-30T19:32:13.926748] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-30T19:32:13.927128] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-30T19:32:13.927256] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-30T19:32:14.265697] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T19:32:14.369515] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:14.654338] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-30T19:32:14.869332] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T19:32:15.029555] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:32:15.454427] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-30T19:32:16.041440] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T19:32:16.069047] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:32:16.254360] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-30T19:32:16.825390] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T19:32:17.054349] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-30T19:32:17.854360] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-30T19:32:18.486397] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T19:32:18.654337] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-30T19:32:18.893600] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T19:32:19.454368] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-30T19:32:19.586111] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T19:32:20.065906] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T19:32:20.254364] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-30T19:32:21.054354] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-30T19:32:21.854340] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-30T19:32:22.208419] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T19:32:22.220038] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-09-30T19:32:22.220227] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-30T19:32:22.442273] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:32:22.443812] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:32:22.444009] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:32:22.444355] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-30T19:32:22.444539] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-30T19:32:22.444599] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-30T19:32:22.444681] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-30T19:32:22.444800] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEY took 37.4s. Estimated remaining: 2h 31m 56s. Rate: 7.8 symbols/min [2025-09-30T19:32:22.532483] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:32:22.643201] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:22.657984] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-30T19:32:22.687261] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:32:22.725633] [DEBUG] [LOCAL ] KFY: Loaded 30178 existing records from primary storage. [2025-09-30T19:32:22.725956] [INFO ] [MAIN ] KFY: Loaded 30178 existing records. [2025-09-30T19:32:22.930091] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:22.930336] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-30T19:32:22.930386] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-30T19:32:22.930846] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-30T19:32:22.930908] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-30T19:32:23.335865] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:23.341887] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:32:23.454355] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-30T19:32:24.254361] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-30T19:32:24.409465] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T19:32:25.040869] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:32:25.054500] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-30T19:32:25.854359] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-30T19:32:26.109848] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:32:26.654366] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-30T19:32:26.666985] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:32:27.454351] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-30T19:32:27.984319] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T19:32:28.254351] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-30T19:32:28.417703] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T19:32:29.054350] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-30T19:32:29.591828] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:32:29.854389] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-30T19:32:30.048269] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:32:30.614259] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:32:30.654414] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-30T19:32:31.454345] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-30T19:32:31.837036] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:32:32.254407] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-30T19:32:33.061700] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-30T19:32:33.067955] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:32:33.078537] [INFO ] [REMOTE ] KEYS: Full fetch complete (62920 records). [2025-09-30T19:32:33.078715] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-30T19:32:33.544102] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-30T19:32:33.544388] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-30T19:32:33.545541] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-30T19:32:33.545722] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-30T19:32:33.547861] [DEBUG] [LOCAL ] KEYS: Trimmed 62920 records to 43162 (keeping 200 days of data) [2025-09-30T19:32:33.685492] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:32:33.854450] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-30T19:32:33.897999] [DEBUG] [LOCAL ] KEYS: Primary data saved (43162 records). [2025-09-30T19:32:33.898248] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-30T19:32:33.898490] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 42.9s. Estimated remaining: 2h 31m 52s. Rate: 7.8 symbols/min [2025-09-30T19:32:34.084082] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T19:32:34.111392] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:34.186460] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-30T19:32:34.186958] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-30T19:32:34.386184] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:34.386502] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-30T19:32:34.386558] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-30T19:32:34.387413] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-30T19:32:34.387490] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-30T19:32:34.665492] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-30T19:32:34.786198] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:35.057914] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:32:35.454460] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-30T19:32:35.636174] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:32:36.254399] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-30T19:32:36.672287] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T19:32:36.798867] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T19:32:36.801586] [INFO ] [REMOTE ] KFS: Full fetch complete (10559 records). [2025-09-30T19:32:36.801722] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-30T19:32:37.059883] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-30T19:32:37.203060] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-30T19:32:37.203179] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-30T19:32:37.203556] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-30T19:32:37.203676] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-30T19:32:37.204235] [DEBUG] [LOCAL ] KFS: Trimmed 10559 records to 8472 (keeping 200 days of data) [2025-09-30T19:32:37.257248] [DEBUG] [LOCAL ] KFS: Primary data saved (8472 records). [2025-09-30T19:32:37.257407] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-30T19:32:37.257532] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 23.7s. Estimated remaining: 2h 31m 40s. Rate: 7.8 symbols/min [2025-09-30T19:32:37.440513] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:37.495049] [DEBUG] [LOCAL ] KGS: Loaded 45714 existing records from primary storage. [2025-09-30T19:32:37.495403] [INFO ] [MAIN ] KGS: Loaded 45714 existing records. [2025-09-30T19:32:37.682146] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:37.682372] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-30T19:32:37.682419] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-30T19:32:37.682812] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-30T19:32:37.682872] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-30T19:32:37.869787] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-30T19:32:38.109825] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:38.654453] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-30T19:32:38.966762] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T19:32:38.994506] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:32:39.454394] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-30T19:32:40.186166] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:32:40.254327] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-30T19:32:40.615812] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:32:41.054414] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-30T19:32:41.828000] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:32:41.854325] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-30T19:32:42.337100] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:32:42.343058] [INFO ] [REMOTE ] KFRC: Full fetch complete (25562 records). [2025-09-30T19:32:42.343208] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-30T19:32:42.657031] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-30T19:32:42.745860] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-30T19:32:42.745944] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-30T19:32:42.746531] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-30T19:32:42.747620] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-30T19:32:42.748489] [DEBUG] [LOCAL ] KFRC: Trimmed 25562 records to 19559 (keeping 200 days of data) [2025-09-30T19:32:42.880010] [DEBUG] [LOCAL ] KFRC: Primary data saved (19559 records). [2025-09-30T19:32:42.880425] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-30T19:32:42.880668] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFRC took 31.0s. Estimated remaining: 2h 31m 30s. Rate: 7.8 symbols/min [2025-09-30T19:32:43.074029] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:43.155721] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:32:43.223825] [DEBUG] [LOCAL ] KIM: Loaded 53047 existing records from primary storage. [2025-09-30T19:32:43.224219] [INFO ] [MAIN ] KIM: Loaded 53047 existing records. [2025-09-30T19:32:43.436854] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:43.437112] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-30T19:32:43.437163] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-30T19:32:43.437750] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-30T19:32:43.437812] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-30T19:32:43.461443] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-30T19:32:43.885577] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:44.086187] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:32:44.254366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-30T19:32:45.054388] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-30T19:32:45.492887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T19:32:45.854412] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-30T19:32:45.942735] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T19:32:46.397673] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:32:46.654393] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-30T19:32:47.052194] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T19:32:47.454390] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-30T19:32:48.002348] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T19:32:48.254434] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-30T19:32:49.054329] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-30T19:32:49.098482] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:32:49.854605] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-30T19:32:49.859752] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:32:50.436744] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:32:50.654410] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-30T19:32:51.028360] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:32:51.454366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-30T19:32:52.254347] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-30T19:32:52.308474] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T19:32:53.054370] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-30T19:32:53.313487] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T19:32:53.749608] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:32:53.854373] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-30T19:32:54.537828] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:32:54.545435] [INFO ] [REMOTE ] KFY: Full fetch complete (43493 records). [2025-09-30T19:32:54.545598] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-30T19:32:54.660047] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-30T19:32:54.980145] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-30T19:32:54.980258] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-30T19:32:54.981358] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-30T19:32:54.981447] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-30T19:32:54.982699] [DEBUG] [LOCAL ] KFY: Trimmed 43493 records to 30083 (keeping 200 days of data) [2025-09-30T19:32:55.136632] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T19:32:55.225695] [DEBUG] [LOCAL ] KFY: Primary data saved (30083 records). [2025-09-30T19:32:55.225869] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-30T19:32:55.226552] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 32.8s. Estimated remaining: 2h 31m 27s. Rate: 7.8 symbols/min [2025-09-30T19:32:55.422475] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:55.450430] [DEBUG] [LOCAL ] KIO: Loaded 21347 existing records from primary storage. [2025-09-30T19:32:55.450732] [INFO ] [MAIN ] KIO: Loaded 21347 existing records. [2025-09-30T19:32:55.463120] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-30T19:32:55.676962] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:55.677211] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-30T19:32:55.677260] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-30T19:32:55.677453] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-30T19:32:55.677513] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-30T19:32:56.086322] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:56.254397] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-30T19:32:56.573872] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:32:56.952807] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:32:57.054371] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-30T19:32:57.854375] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-30T19:32:57.998763] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:32:58.654362] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-30T19:32:58.848098] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:32:59.454354] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-30T19:32:59.556958] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:33:00.001208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:33:00.254364] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-30T19:33:01.054401] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-30T19:33:01.302107] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:33:01.706740] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T19:33:01.854320] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-30T19:33:02.206041] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T19:33:02.217285] [INFO ] [REMOTE ] KGS: Full fetch complete (66333 records). [2025-09-30T19:33:02.217469] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-30T19:33:02.638475] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-30T19:33:02.638565] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-30T19:33:02.639461] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-30T19:33:02.639531] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-30T19:33:02.640982] [DEBUG] [LOCAL ] KGS: Trimmed 66333 records to 45721 (keeping 200 days of data) [2025-09-30T19:33:02.696840] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-30T19:33:02.943945] [DEBUG] [LOCAL ] KGS: Primary data saved (45721 records). [2025-09-30T19:33:02.944119] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-30T19:33:02.944225] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 25.7s. Estimated remaining: 2h 31m 19s. Rate: 7.8 symbols/min [2025-09-30T19:33:03.125551] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:03.186450] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-09-30T19:33:03.186956] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-09-30T19:33:03.386888] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:03.387232] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-30T19:33:03.387289] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-30T19:33:03.387750] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-30T19:33:03.387815] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-30T19:33:03.461203] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-30T19:33:03.820877] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:03.856619] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T19:33:03.885398] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:33:04.254376] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-30T19:33:05.054442] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-30T19:33:05.445105] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T19:33:05.854357] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-30T19:33:05.905751] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T19:33:06.591726] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:33:06.654363] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-30T19:33:07.454342] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-30T19:33:07.615882] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:33:08.254379] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-30T19:33:08.473194] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:33:09.054414] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-30T19:33:09.380346] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:33:09.391855] [INFO ] [REMOTE ] KIM: Full fetch complete (76824 records). [2025-09-30T19:33:09.392026] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-30T19:33:09.859715] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-30T19:33:09.855461] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-30T19:33:09.859871] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-30T19:33:09.861290] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-30T19:33:09.862418] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-30T19:33:09.864990] [DEBUG] [LOCAL ] KIM: Trimmed 76824 records to 53046 (keeping 200 days of data) [2025-09-30T19:33:09.995145] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T19:33:10.246988] [DEBUG] [LOCAL ] KIM: Primary data saved (53046 records). [2025-09-30T19:33:10.247138] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-30T19:33:10.247224] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 27.4s. Estimated remaining: 2h 31m 11s. Rate: 7.8 symbols/min [2025-09-30T19:33:10.424884] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:10.433606] [DEBUG] [LOCAL ] KKRS: Loaded 5769 existing records from primary storage. [2025-09-30T19:33:10.433971] [INFO ] [MAIN ] KKRS: Loaded 5769 existing records. [2025-09-30T19:33:10.580141] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:33:10.660380] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-30T19:33:10.666422] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:10.666722] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-30T19:33:10.666797] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-30T19:33:10.667988] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-30T19:33:10.668051] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-30T19:33:11.027632] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:11.454381] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-30T19:33:12.082809] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-30T19:33:12.254366] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-30T19:33:12.768334] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T19:33:13.054365] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-30T19:33:13.310492] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:33:13.698348] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T19:33:13.854320] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-30T19:33:13.962377] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-30T19:33:13.974246] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-09-30T19:33:13.974425] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-30T19:33:14.393841] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-30T19:33:14.393947] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-30T19:33:14.394955] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-30T19:33:14.395022] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-30T19:33:14.396566] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 53699 (keeping 200 days of data) [2025-09-30T19:33:14.654343] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-30T19:33:14.767489] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-30T19:33:14.767684] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-30T19:33:14.767797] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KGC took 40.9s. Estimated remaining: 2h 31m 0s. Rate: 7.8 symbols/min [2025-09-30T19:33:14.955399] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T19:33:14.974175] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:14.974469] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-30T19:33:14.978942] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-30T19:33:14.979914] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-30T19:33:14.979969] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-30T19:33:14.980019] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-30T19:33:14.980051] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-30T19:33:15.359154] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:15.454369] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-30T19:33:16.013242] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T19:33:16.254358] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-30T19:33:16.415831] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:33:16.416239] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-30T19:33:16.416351] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:33:16.416419] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-30T19:33:16.416585] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:33:16.416784] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-30T19:33:16.416850] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-30T19:33:16.416886] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-30T19:33:16.417005] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-30T19:33:16.417075] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 1.6s. Estimated remaining: 2h 30m 47s. Rate: 7.8 symbols/min [2025-09-30T19:33:16.614272] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:16.614459] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-30T19:33:16.614514] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-30T19:33:16.614629] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-30T19:33:16.614722] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-30T19:33:16.614908] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-30T19:33:16.615041] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-30T19:33:16.873452] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-30T19:33:17.058219] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-30T19:33:17.061555] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:17.469155] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T19:33:17.854364] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-30T19:33:18.654358] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-30T19:33:19.454360] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-30T19:33:19.701985] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:33:19.823905] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-30T19:33:19.823719] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:33:20.254362] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-30T19:33:20.979806] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:33:21.054347] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-30T19:33:21.762424] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T19:33:21.854356] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-30T19:33:22.623232] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:33:22.654320] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-30T19:33:23.252677] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:33:23.454356] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-30T19:33:23.656504] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:33:23.656913] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-30T19:33:23.657013] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:33:23.657084] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-30T19:33:23.657151] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:33:23.657227] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-30T19:33:23.657294] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-30T19:33:23.657333] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-30T19:33:23.657375] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-30T19:33:23.657426] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 7.2s. Estimated remaining: 2h 30m 39s. Rate: 7.8 symbols/min [2025-09-30T19:33:23.839043] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:23.878781] [DEBUG] [LOCAL ] KLC: Loaded 36594 existing records from primary storage. [2025-09-30T19:33:23.879099] [INFO ] [MAIN ] KLC: Loaded 36594 existing records. [2025-09-30T19:33:24.071454] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:24.071711] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-30T19:33:24.071775] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-30T19:33:24.072195] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-30T19:33:24.072258] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-30T19:33:24.260170] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-30T19:33:24.476463] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:25.054369] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-30T19:33:25.854372] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-30T19:33:26.154140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T19:33:26.183567] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T19:33:26.420352] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T19:33:26.654357] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-30T19:33:27.454324] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-30T19:33:27.749964] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:33:28.088613] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T19:33:28.254404] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-30T19:33:29.054354] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-30T19:33:29.688524] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:33:29.854375] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-30T19:33:30.192323] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T19:33:30.197454] [INFO ] [REMOTE ] KIO: Full fetch complete (31084 records). [2025-09-30T19:33:30.197608] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-30T19:33:30.606569] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-30T19:33:30.606700] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-30T19:33:30.607400] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-30T19:33:30.607449] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-30T19:33:30.608441] [DEBUG] [LOCAL ] KIO: Trimmed 31084 records to 21369 (keeping 200 days of data) [2025-09-30T19:33:30.667115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-30T19:33:30.759662] [DEBUG] [LOCAL ] KIO: Primary data saved (21369 records). [2025-09-30T19:33:30.759812] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-30T19:33:30.759900] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KIO took 35.5s. Estimated remaining: 2h 30m 30s. Rate: 7.8 symbols/min [2025-09-30T19:33:31.454352] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-30T19:33:31.653529] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T19:33:31.934367] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:33:32.091914] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:33:32.093457] [INFO ] [REMOTE ] KKRS: Full fetch complete (7924 records). [2025-09-30T19:33:32.093529] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-30T19:33:32.259461] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-30T19:33:32.501012] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-30T19:33:32.501088] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-30T19:33:32.501287] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-30T19:33:32.501325] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-30T19:33:32.501757] [DEBUG] [LOCAL ] KKRS: Trimmed 7924 records to 5689 (keeping 200 days of data) [2025-09-30T19:33:32.538312] [DEBUG] [LOCAL ] KKRS: Primary data saved (5689 records). [2025-09-30T19:33:32.538470] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-30T19:33:32.538570] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRS took 22.3s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-09-30T19:33:33.054321] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-30T19:33:33.450889] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T19:33:33.854390] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-30T19:33:34.977415] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T19:33:34.989447] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-30T19:33:35.250540] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:33:35.454371] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-30T19:33:36.563570] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:33:36.572806] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-30T19:33:36.855140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:33:36.866798] [INFO ] [REMOTE ] KKR: Full fetch complete (77443 records). [2025-09-30T19:33:36.866988] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-30T19:33:37.307755] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-30T19:33:37.307968] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-30T19:33:37.309113] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-30T19:33:37.309198] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-30T19:33:37.311023] [DEBUG] [LOCAL ] KKR: Trimmed 77443 records to 53500 (keeping 200 days of data) [2025-09-30T19:33:37.675445] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-09-30T19:33:37.675597] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-30T19:33:37.675750] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKR took 34.7s. Estimated remaining: 2h 30m 7s. Rate: 7.8 symbols/min [2025-09-30T19:33:38.130029] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:33:38.138814] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-30T19:33:39.534552] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:33:39.542325] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-30T19:33:40.869846] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T19:33:40.880360] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-30T19:33:42.354211] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T19:33:42.363460] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-30T19:33:43.617413] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:33:43.625621] [INFO ] [REMOTE ] KLC: Full fetch complete (50683 records). [2025-09-30T19:33:43.625825] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-30T19:33:44.031999] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-30T19:33:44.032083] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-30T19:33:44.032976] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-30T19:33:44.033085] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-30T19:33:44.034286] [DEBUG] [LOCAL ] KLC: Trimmed 50683 records to 36676 (keeping 200 days of data) [2025-09-30T19:33:44.257317] [DEBUG] [LOCAL ] KLC: Primary data saved (36676 records). [2025-09-30T19:33:44.257476] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-30T19:33:44.257568] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLC took 20.6s. Estimated remaining: 2h 29m 58s. Rate: 7.8 symbols/min [2025-09-30T19:33:45.033536] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.123510] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.126716] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.155578] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.163353] [DEBUG] [LOCAL ] KMPB: Loaded 3626 existing records from primary storage. [2025-09-30T19:33:45.163918] [INFO ] [MAIN ] KMPB: Loaded 3626 existing records. [2025-09-30T19:33:45.406706] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:45.433897] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-30T19:33:45.435200] [DEBUG] [LOCAL ] KMPR: Loaded 38685 existing records from primary storage. [2025-09-30T19:33:45.435569] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-30T19:33:45.436556] [DEBUG] [LOCAL ] KMT: Loaded 42985 existing records from primary storage. [2025-09-30T19:33:45.453414] [INFO ] [MAIN ] KMT: Loaded 42985 existing records. [2025-09-30T19:33:45.453086] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-30T19:33:45.453629] [INFO ] [MAIN ] KMPR: Loaded 38685 existing records. [2025-09-30T19:33:45.459141] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-30T19:33:45.459284] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-30T19:33:45.585755] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-30T19:33:46.253941] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.321121] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.328185] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.327805] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.343105] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.335522] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-30T19:33:46.335583] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.354427] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-30T19:33:46.354326] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-30T19:33:46.374664] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-30T19:33:46.399976] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-30T19:33:46.400104] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-30T19:33:46.415694] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-30T19:33:46.415601] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-30T19:33:46.494771] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-30T19:33:46.857342] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:46.946171] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-30T19:33:47.641750] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.642337] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-30T19:33:47.826249] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.829518] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-30T19:33:47.822925] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:33:47.834933] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-30T19:33:47.832581] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.835903] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-30T19:33:48.278189] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-30T19:33:48.279448] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-30T19:33:48.660095] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T19:33:48.661622] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-30T19:33:48.684397] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:33:48.690320] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-30T19:33:49.256688] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:33:49.257522] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:33:49.266768] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-30T19:33:49.269236] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-30T19:33:49.836969] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-30T19:33:49.842499] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:33:49.850365] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-30T19:33:49.857372] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-30T19:33:49.862154] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:33:49.863702] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-30T19:33:50.315464] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T19:33:50.654349] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-30T19:33:50.720691] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:33:51.176195] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:33:51.275044] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T19:33:51.454410] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-30T19:33:52.038591] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:33:52.254365] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-30T19:33:52.391295] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T19:33:52.756697] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T19:33:53.054409] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-30T19:33:53.854395] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-30T19:33:54.451044] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:33:54.654377] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-30T19:33:55.012981] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T19:33:55.416363] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:33:55.454394] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-30T19:33:56.254407] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-30T19:33:56.528035] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:33:56.738783] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T19:33:56.740383] [INFO ] [REMOTE ] KMPB: Full fetch complete (5112 records). [2025-09-30T19:33:56.740480] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-30T19:33:57.059461] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-30T19:33:57.137176] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-30T19:33:57.137263] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-30T19:33:57.137440] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-30T19:33:57.137514] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-30T19:33:57.137954] [DEBUG] [LOCAL ] KMPB: Trimmed 5112 records to 3749 (keeping 200 days of data) [2025-09-30T19:33:57.162397] [DEBUG] [LOCAL ] KMPB: Primary data saved (3749 records). [2025-09-30T19:33:57.162520] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-30T19:33:57.162688] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 12.9s. Estimated remaining: 2h 29m 55s. Rate: 7.8 symbols/min [2025-09-30T19:33:57.346802] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:57.405905] [DEBUG] [LOCAL ] KMX: Loaded 53147 existing records from primary storage. [2025-09-30T19:33:57.406301] [INFO ] [MAIN ] KMX: Loaded 53147 existing records. [2025-09-30T19:33:57.603446] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:57.603721] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-30T19:33:57.603778] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-30T19:33:57.604163] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-30T19:33:57.604224] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-30T19:33:57.859622] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-30T19:33:58.012366] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:58.659801] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-30T19:33:58.678348] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T19:33:59.454371] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-30T19:33:59.861419] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T19:34:00.254324] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-30T19:34:00.364909] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:34:01.033783] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:34:01.054318] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-30T19:34:01.847463] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:34:01.857097] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-30T19:34:02.454365] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T19:34:02.654359] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-30T19:34:03.454397] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-30T19:34:03.901740] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T19:34:04.254336] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-30T19:34:04.293816] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:34:05.054362] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-30T19:34:05.106964] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:34:05.854382] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-30T19:34:06.297403] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T19:34:06.654350] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-30T19:34:06.991204] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:34:07.001544] [INFO ] [REMOTE ] KMPR: Full fetch complete (51246 records). [2025-09-30T19:34:07.001807] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-30T19:34:07.391809] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:34:07.468086] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-30T19:34:07.488042] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-30T19:34:07.488118] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-30T19:34:07.489083] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-30T19:34:07.489269] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-30T19:34:07.490608] [DEBUG] [LOCAL ] KMPR: Trimmed 51246 records to 38781 (keeping 200 days of data) [2025-09-30T19:34:07.750899] [DEBUG] [LOCAL ] KMPR: Primary data saved (38781 records). [2025-09-30T19:34:07.751054] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-30T19:34:07.751224] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 23.5s. Estimated remaining: 2h 29m 50s. Rate: 7.8 symbols/min [2025-09-30T19:34:07.939373] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:07.983617] [DEBUG] [LOCAL ] KN: Loaded 38615 existing records from primary storage. [2025-09-30T19:34:07.984021] [INFO ] [MAIN ] KN: Loaded 38615 existing records. [2025-09-30T19:34:08.177466] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:08.177731] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-30T19:34:08.177788] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-30T19:34:08.178088] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-30T19:34:08.178192] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-30T19:34:08.261454] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-30T19:34:08.596961] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:08.875972] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T19:34:09.054376] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-30T19:34:09.189091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:34:09.688432] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:34:09.854323] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-30T19:34:10.654624] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-30T19:34:10.661504] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:34:10.940400] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:34:11.454378] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-30T19:34:12.113976] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:34:12.254413] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-30T19:34:12.793206] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:34:13.054354] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-30T19:34:13.854384] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-30T19:34:14.386035] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T19:34:14.432245] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:34:14.654355] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-30T19:34:15.454359] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-30T19:34:15.544244] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:34:15.665420] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:34:16.254383] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-30T19:34:17.054372] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-30T19:34:17.400045] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T19:34:17.854400] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-30T19:34:18.054096] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:34:18.654336] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-30T19:34:19.041197] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T19:34:19.454365] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-30T19:34:19.630873] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T19:34:19.640346] [INFO ] [REMOTE ] KMT: Full fetch complete (62064 records). [2025-09-30T19:34:19.640497] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-30T19:34:20.053420] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-30T19:34:20.053504] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-30T19:34:20.054446] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-30T19:34:20.054514] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-30T19:34:20.055851] [DEBUG] [LOCAL ] KMT: Trimmed 62064 records to 42940 (keeping 200 days of data) [2025-09-30T19:34:20.277004] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-30T19:34:20.337270] [DEBUG] [LOCAL ] KMT: Primary data saved (42940 records). [2025-09-30T19:34:20.337425] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-30T19:34:20.337566] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 36.1s. Estimated remaining: 2h 29m 47s. Rate: 7.8 symbols/min [2025-09-30T19:34:20.525457] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:20.561887] [DEBUG] [LOCAL ] KNF: Loaded 35771 existing records from primary storage. [2025-09-30T19:34:20.562238] [INFO ] [MAIN ] KNF: Loaded 35771 existing records. [2025-09-30T19:34:20.762803] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:20.763317] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-30T19:34:20.763430] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-30T19:34:20.763865] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-30T19:34:20.764046] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-30T19:34:20.907925] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:34:21.012289] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-30T19:34:21.039706] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-30T19:34:21.382569] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:21.397152] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-30T19:34:21.587948] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-30T19:34:21.708155] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-30T19:34:21.708291] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-30T19:34:21.709320] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-30T19:34:21.709419] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-30T19:34:21.711363] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-09-30T19:34:21.739458] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:34:21.854552] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-30T19:34:22.105159] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-30T19:34:22.105319] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-30T19:34:22.106462] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 37.8s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-09-30T19:34:22.294228] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:22.308637] [DEBUG] [LOCAL ] KNOP: Loaded 10275 existing records from primary storage. [2025-09-30T19:34:22.308950] [INFO ] [MAIN ] KNOP: Loaded 10275 existing records. [2025-09-30T19:34:22.525111] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:22.525365] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-30T19:34:22.525425] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-30T19:34:22.525605] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-30T19:34:22.525710] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-30T19:34:22.658032] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-30T19:34:22.925575] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:22.971534] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:34:23.298776] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T19:34:23.454362] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-30T19:34:24.254333] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-30T19:34:24.295819] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:34:24.422597] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T19:34:25.054376] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-30T19:34:25.854351] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-30T19:34:25.927846] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:34:26.654314] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-30T19:34:27.075437] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T19:34:27.109464] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T19:34:27.403826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:34:27.454345] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-30T19:34:28.192096] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T19:34:28.254366] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-30T19:34:29.046505] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T19:34:29.054307] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-30T19:34:29.854357] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-30T19:34:29.966002] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:34:30.654370] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-30T19:34:31.160928] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:34:31.454380] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-30T19:34:32.075185] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:34:32.089485] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T19:34:32.254393] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-30T19:34:33.054383] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-30T19:34:33.854364] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-30T19:34:34.140846] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T19:34:34.177794] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:34:34.597699] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:34:34.654391] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-30T19:34:35.454362] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-30T19:34:36.254341] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-30T19:34:36.723676] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T19:34:36.737443] [INFO ] [REMOTE ] KMX: Full fetch complete (75999 records). [2025-09-30T19:34:36.737633] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-30T19:34:37.115733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-30T19:34:37.125277] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:34:37.269710] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-30T19:34:37.269810] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-30T19:34:37.270926] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-30T19:34:37.271008] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-30T19:34:37.272525] [DEBUG] [LOCAL ] KMX: Trimmed 75999 records to 53148 (keeping 200 days of data) [2025-09-30T19:34:37.624996] [DEBUG] [LOCAL ] KMX: Primary data saved (53148 records). [2025-09-30T19:34:37.625195] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-30T19:34:37.625383] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 40.5s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-09-30T19:34:37.816061] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:37.841900] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:34:37.851160] [INFO ] [REMOTE ] KN: Full fetch complete (56378 records). [2025-09-30T19:34:37.851348] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-30T19:34:37.857262] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-30T19:34:37.994620] [DEBUG] [LOCAL ] KNSL: Loaded 18116 existing records from primary storage. [2025-09-30T19:34:38.039351] [INFO ] [MAIN ] KNSL: Loaded 18116 existing records. [2025-09-30T19:34:38.312100] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:34:38.533452] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:38.548336] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-30T19:34:38.548525] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-30T19:34:38.548636] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-30T19:34:38.548830] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-30T19:34:38.549936] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-30T19:34:38.550030] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-30T19:34:38.549855] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-30T19:34:38.555317] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-30T19:34:38.659761] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-30T19:34:38.665855] [DEBUG] [LOCAL ] KN: Trimmed 56378 records to 38575 (keeping 200 days of data) [2025-09-30T19:34:39.065302] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:39.217716] [DEBUG] [LOCAL ] KN: Primary data saved (38575 records). [2025-09-30T19:34:39.217875] [INFO ] [MAIN ] KN: Full history saved. [2025-09-30T19:34:39.217977] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 31.5s. Estimated remaining: 2h 29m 20s. Rate: 7.8 symbols/min [2025-09-30T19:34:39.365600] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:34:39.396094] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:34:39.453618] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:39.454332] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-30T19:34:39.498210] [DEBUG] [LOCAL ] KNTK: Loaded 46082 existing records from primary storage. [2025-09-30T19:34:39.498530] [INFO ] [MAIN ] KNTK: Loaded 46082 existing records. [2025-09-30T19:34:39.703161] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:39.703423] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-30T19:34:39.703479] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-30T19:34:39.703942] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-30T19:34:39.704009] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-30T19:34:40.168322] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:40.254353] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-30T19:34:40.782788] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:34:41.054345] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-30T19:34:41.801275] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:34:41.854367] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-30T19:34:42.269788] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:34:42.654404] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-30T19:34:42.942625] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:34:43.454336] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-30T19:34:43.778991] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T19:34:44.254376] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-30T19:34:44.392037] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:34:44.396715] [INFO ] [REMOTE ] KNOP: Full fetch complete (14801 records). [2025-09-30T19:34:44.396815] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-30T19:34:44.815584] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-30T19:34:44.815936] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-30T19:34:44.816283] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-30T19:34:44.816327] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-30T19:34:44.816858] [DEBUG] [LOCAL ] KNOP: Trimmed 14801 records to 10406 (keeping 200 days of data) [2025-09-30T19:34:44.879507] [DEBUG] [LOCAL ] KNOP: Primary data saved (10406 records). [2025-09-30T19:34:44.879675] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-30T19:34:44.879813] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 22.8s. Estimated remaining: 2h 29m 11s. Rate: 7.8 symbols/min [2025-09-30T19:34:45.056221] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-30T19:34:45.057912] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:45.122911] [DEBUG] [LOCAL ] KNX: Loaded 52588 existing records from primary storage. [2025-09-30T19:34:45.123339] [INFO ] [MAIN ] KNX: Loaded 52588 existing records. [2025-09-30T19:34:45.311441] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:45.311676] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-30T19:34:45.311757] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-30T19:34:45.313113] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-30T19:34:45.313175] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-30T19:34:45.706075] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:45.782220] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:34:45.854364] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-30T19:34:46.495467] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:34:46.654368] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-30T19:34:47.089359] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:34:47.454413] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-30T19:34:47.748741] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:34:48.254340] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-30T19:34:48.459458] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:34:49.054356] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-30T19:34:49.854389] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-30T19:34:49.966010] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:34:50.500997] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:34:50.654426] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-30T19:34:51.447146] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:34:51.460889] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-30T19:34:51.999336] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T19:34:52.254358] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-30T19:34:53.039506] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:34:53.048184] [INFO ] [REMOTE ] KNF: Full fetch complete (50702 records). [2025-09-30T19:34:53.048318] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-30T19:34:53.060560] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-30T19:34:53.469792] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:34:53.517831] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-30T19:34:53.517911] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-30T19:34:53.518811] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-30T19:34:53.518878] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-30T19:34:53.521333] [DEBUG] [LOCAL ] KNF: Trimmed 50702 records to 35821 (keeping 200 days of data) [2025-09-30T19:34:53.750026] [DEBUG] [LOCAL ] KNF: Primary data saved (35821 records). [2025-09-30T19:34:53.750213] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-30T19:34:53.750346] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 33.4s. Estimated remaining: 2h 29m 4s. Rate: 7.8 symbols/min [2025-09-30T19:34:53.859485] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-30T19:34:53.948028] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:53.948270] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-30T19:34:53.948338] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-30T19:34:53.948452] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-30T19:34:53.948494] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-30T19:34:53.948596] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-30T19:34:53.948669] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-30T19:34:54.330004] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:54.493566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T19:34:54.654369] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-30T19:34:55.454332] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-30T19:34:55.539714] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:34:56.254398] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-30T19:34:57.054390] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-30T19:34:57.191791] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:34:57.265858] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-30T19:34:57.388336] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T19:34:57.854335] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-30T19:34:58.071616] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:34:58.654377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-30T19:34:59.454356] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-30T19:34:59.622154] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:35:00.254409] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-30T19:35:01.054379] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-30T19:35:01.213879] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:35:01.237164] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T19:35:01.306624] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-30T19:35:01.854358] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-30T19:35:02.654329] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-30T19:35:02.742592] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:35:03.454394] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-30T19:35:03.627941] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:35:04.254413] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-30T19:35:04.928927] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-30T19:35:04.972638] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:35:05.054377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-30T19:35:05.424402] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T19:35:05.854384] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-30T19:35:06.654354] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-30T19:35:06.679112] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:35:07.371157] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T19:35:07.454360] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-30T19:35:08.254330] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-30T19:35:08.409485] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T19:35:09.054390] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-30T19:35:09.755129] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:35:09.854374] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-30T19:35:10.112918] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-30T19:35:10.654358] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-30T19:35:10.786199] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T19:35:10.797458] [INFO ] [REMOTE ] KNTK: Full fetch complete (64461 records). [2025-09-30T19:35:10.797624] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-30T19:35:11.228593] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-30T19:35:11.228731] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-30T19:35:11.229690] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-30T19:35:11.229755] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-30T19:35:11.231837] [DEBUG] [LOCAL ] KNTK: Trimmed 64461 records to 46115 (keeping 200 days of data) [2025-09-30T19:35:11.454988] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-30T19:35:11.564114] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:35:11.595482] [DEBUG] [LOCAL ] KNTK: Primary data saved (46115 records). [2025-09-30T19:35:11.596595] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:35:11.596146] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-30T19:35:11.600570] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 32.4s. Estimated remaining: 2h 29m 6s. Rate: 7.8 symbols/min [2025-09-30T19:35:11.647147] [INFO ] [REMOTE ] KNSL: Full fetch complete (26572 records). [2025-09-30T19:35:11.674921] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-30T19:35:11.952204] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:12.218580] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-30T19:35:12.218714] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-30T19:35:12.219319] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-30T19:35:12.219390] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-30T19:35:12.232927] [DEBUG] [LOCAL ] KNSL: Trimmed 26572 records to 18106 (keeping 200 days of data) [2025-09-30T19:35:12.234080] [DEBUG] [LOCAL ] KODK: Loaded 43409 existing records from primary storage. [2025-09-30T19:35:12.234751] [INFO ] [MAIN ] KODK: Loaded 43409 existing records. [2025-09-30T19:35:12.309585] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-30T19:35:12.540706] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:12.542156] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-30T19:35:12.543120] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-30T19:35:12.546034] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-30T19:35:12.546923] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-30T19:35:12.995425] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:13.005622] [DEBUG] [LOCAL ] KNSL: Primary data saved (18106 records). [2025-09-30T19:35:13.005818] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-30T19:35:13.005939] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNSL took 35.4s. Estimated remaining: 2h 28m 52s. Rate: 7.8 symbols/min [2025-09-30T19:35:13.059800] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-30T19:35:13.207437] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:13.238401] [DEBUG] [LOCAL ] KOF: Loaded 25940 existing records from primary storage. [2025-09-30T19:35:13.238700] [INFO ] [MAIN ] KOF: Loaded 25940 existing records. [2025-09-30T19:35:13.433696] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:13.433904] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-30T19:35:13.433953] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-30T19:35:13.434412] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-30T19:35:13.434474] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-30T19:35:13.861265] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:13.861826] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-30T19:35:13.899280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-30T19:35:14.273008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:35:14.284785] [INFO ] [REMOTE ] KNX: Full fetch complete (75769 records). [2025-09-30T19:35:14.285015] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-30T19:35:14.663574] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-30T19:35:14.728879] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-30T19:35:14.729004] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-30T19:35:14.730122] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-30T19:35:14.730205] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-30T19:35:14.764525] [DEBUG] [LOCAL ] KNX: Trimmed 75769 records to 52592 (keeping 200 days of data) [2025-09-30T19:35:14.766078] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:35:14.895962] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T19:35:15.158794] [DEBUG] [LOCAL ] KNX: Primary data saved (52592 records). [2025-09-30T19:35:15.158940] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-30T19:35:15.159789] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 30.3s. Estimated remaining: 2h 28m 39s. Rate: 7.8 symbols/min [2025-09-30T19:35:15.378014] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:15.398802] [DEBUG] [LOCAL ] KOP: Loaded 17654 existing records from primary storage. [2025-09-30T19:35:15.399086] [INFO ] [MAIN ] KOP: Loaded 17654 existing records. [2025-09-30T19:35:15.459689] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-30T19:35:15.594071] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:15.594287] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-30T19:35:15.594337] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-30T19:35:15.594891] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-30T19:35:15.594954] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-30T19:35:15.981617] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:16.254362] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-30T19:35:16.674059] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:35:16.910240] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-30T19:35:17.054419] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-30T19:35:17.854377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-30T19:35:17.916890] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:35:17.981401] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:35:18.654368] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-30T19:35:19.454355] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-30T19:35:20.256326] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-30T19:35:20.280671] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T19:35:20.580667] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T19:35:20.676254] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-30T19:35:21.054356] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-30T19:35:21.313052] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:35:21.854361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-30T19:35:22.654404] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-30T19:35:22.824088] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:35:23.454383] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-30T19:35:23.600028] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T19:35:24.259224] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-30T19:35:24.264378] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:35:24.387584] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:35:25.054351] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-30T19:35:25.854361] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-30T19:35:26.357220] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T19:35:26.654331] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-30T19:35:26.756962] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-30T19:35:26.767485] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-30T19:35:26.767671] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-30T19:35:26.998435] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T19:35:26.999391] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:35:26.999522] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:35:26.999763] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-30T19:35:26.999925] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-30T19:35:27.000019] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-30T19:35:27.000131] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-30T19:35:27.000348] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KO took 33.2s. Estimated remaining: 2h 28m 36s. Rate: 7.8 symbols/min [2025-09-30T19:35:27.148624] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T19:35:27.222579] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:27.228712] [DEBUG] [LOCAL ] KORE: Loaded 1992 existing records from primary storage. [2025-09-30T19:35:27.228954] [INFO ] [MAIN ] KORE: Loaded 1992 existing records. [2025-09-30T19:35:27.451459] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:27.451737] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-30T19:35:27.451832] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-30T19:35:27.452056] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-30T19:35:27.452119] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-30T19:35:27.465628] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-30T19:35:27.872499] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:27.886124] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T19:35:28.254361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-30T19:35:28.832809] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T19:35:28.939045] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T19:35:29.054403] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-30T19:35:29.854363] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-30T19:35:30.122296] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:35:30.654411] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-30T19:35:31.311225] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:35:31.454409] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-30T19:35:31.955930] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:35:32.254363] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-30T19:35:32.538343] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:35:33.054400] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-30T19:35:33.462031] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:35:33.854383] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-30T19:35:33.898831] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:35:34.654452] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-30T19:35:35.234991] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:35:35.454391] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-30T19:35:35.510055] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:35:35.927552] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:35:36.254381] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-30T19:35:37.054401] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-30T19:35:37.854370] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-30T19:35:37.993392] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T19:35:38.352094] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:35:38.445775] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:35:38.654376] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-30T19:35:39.411178] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:35:39.454426] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-30T19:35:39.812610] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T19:35:40.254366] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-30T19:35:41.054388] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-30T19:35:41.854343] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-30T19:35:42.010829] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:35:42.020034] [INFO ] [REMOTE ] KODK: Full fetch complete (63450 records). [2025-09-30T19:35:42.020153] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-30T19:35:42.381839] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:35:42.518581] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:35:42.518786] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-30T19:35:42.520461] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-30T19:35:42.521568] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-30T19:35:42.521709] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-30T19:35:42.523272] [DEBUG] [LOCAL ] KODK: Trimmed 63450 records to 43436 (keeping 200 days of data) [2025-09-30T19:35:42.692158] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-30T19:35:42.791369] [DEBUG] [LOCAL ] KODK: Primary data saved (43436 records). [2025-09-30T19:35:42.791504] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-30T19:35:42.791593] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KODK took 31.2s. Estimated remaining: 2h 28m 36s. Rate: 7.8 symbols/min [2025-09-30T19:35:42.988684] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:43.042489] [DEBUG] [LOCAL ] KOS: Loaded 53047 existing records from primary storage. [2025-09-30T19:35:43.042882] [INFO ] [MAIN ] KOS: Loaded 53047 existing records. [2025-09-30T19:35:43.238935] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:43.239206] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-30T19:35:43.239268] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-30T19:35:43.240458] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-30T19:35:43.240520] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-30T19:35:43.463273] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-30T19:35:43.692260] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:43.833808] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T19:35:43.839292] [INFO ] [REMOTE ] KOP: Full fetch complete (25432 records). [2025-09-30T19:35:43.839456] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-30T19:35:44.266386] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-30T19:35:44.429316] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-30T19:35:44.429422] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-30T19:35:44.430236] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-30T19:35:44.430306] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-30T19:35:44.431302] [DEBUG] [LOCAL ] KOP: Trimmed 25432 records to 17616 (keeping 200 days of data) [2025-09-30T19:35:44.602719] [DEBUG] [LOCAL ] KOP: Primary data saved (17616 records). [2025-09-30T19:35:44.602983] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-30T19:35:44.603281] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 29.4s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-09-30T19:35:44.706148] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:35:44.772549] [INFO ] [REMOTE ] KOF: Full fetch complete (37069 records). [2025-09-30T19:35:44.784439] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-30T19:35:45.059712] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-30T19:35:45.054467] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:45.403337] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-30T19:35:45.403431] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-30T19:35:45.404146] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-30T19:35:45.404229] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-30T19:35:45.406257] [DEBUG] [LOCAL ] KOF: Trimmed 37069 records to 26038 (keeping 200 days of data) [2025-09-30T19:35:45.427339] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-09-30T19:35:45.427756] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-09-30T19:35:45.635527] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:35:45.758458] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:45.759773] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-30T19:35:45.761068] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-30T19:35:45.763319] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-30T19:35:45.763622] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-30T19:35:45.865032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-30T19:35:46.162680] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:35:46.240541] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:46.313739] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T19:35:46.317482] [DEBUG] [LOCAL ] KOF: Primary data saved (26038 records). [2025-09-30T19:35:46.317588] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-30T19:35:46.317711] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 33.3s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-09-30T19:35:46.508790] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:46.556201] [DEBUG] [LOCAL ] KRC: Loaded 48355 existing records from primary storage. [2025-09-30T19:35:46.556539] [INFO ] [MAIN ] KRC: Loaded 48355 existing records. [2025-09-30T19:35:46.659518] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-30T19:35:46.775240] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:46.775749] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-30T19:35:46.775810] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-30T19:35:46.777615] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-30T19:35:46.777718] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-30T19:35:47.168508] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:47.180339] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T19:35:47.454404] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-30T19:35:48.254401] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-30T19:35:49.054382] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-30T19:35:49.131620] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:35:49.498410] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:35:49.862252] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-30T19:35:49.883695] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:35:50.415229] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T19:35:50.416361] [INFO ] [REMOTE ] KORE: Full fetch complete (5989 records). [2025-09-30T19:35:50.416435] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-30T19:35:50.659550] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-30T19:35:50.855790] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-30T19:35:50.855914] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-30T19:35:50.856114] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-30T19:35:50.856228] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-30T19:35:50.856624] [DEBUG] [LOCAL ] KORE: Trimmed 5989 records to 1997 (keeping 200 days of data) [2025-09-30T19:35:50.869367] [DEBUG] [LOCAL ] KORE: Primary data saved (1997 records). [2025-09-30T19:35:50.869458] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-30T19:35:50.869548] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 23.9s. Estimated remaining: 2h 27m 58s. Rate: 7.8 symbols/min [2025-09-30T19:35:51.052337] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:51.096233] [DEBUG] [LOCAL ] KREF: Loaded 37243 existing records from primary storage. [2025-09-30T19:35:51.096551] [INFO ] [MAIN ] KREF: Loaded 37243 existing records. [2025-09-30T19:35:51.293699] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:51.294038] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-30T19:35:51.294089] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-30T19:35:51.295378] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-30T19:35:51.295445] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-30T19:35:51.460319] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-30T19:35:51.724476] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:52.254407] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-30T19:35:52.416306] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:35:53.054464] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-30T19:35:53.278492] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T19:35:53.355115] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T19:35:53.854402] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-30T19:35:54.654376] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-30T19:35:54.798176] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T19:35:55.408884] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:35:55.454338] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-30T19:35:55.491372] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:35:56.254373] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-30T19:35:57.054373] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-30T19:35:57.269008] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T19:35:57.514073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:35:57.854421] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-30T19:35:58.654375] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-30T19:35:58.783211] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T19:35:59.454405] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-30T19:35:59.620612] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:36:00.254362] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-30T19:36:00.486379] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:36:01.054371] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-30T19:36:01.142484] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:36:01.747367] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:36:01.854407] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-30T19:36:02.654392] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-30T19:36:02.982241] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T19:36:03.454370] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-30T19:36:03.515706] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:36:03.823232] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:36:04.254369] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-30T19:36:05.054383] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-30T19:36:05.278146] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:36:05.744968] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:36:05.854391] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-30T19:36:06.633517] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:36:06.654311] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-30T19:36:07.454356] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-30T19:36:07.681805] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:36:08.032063] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:36:08.254389] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-30T19:36:09.054400] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-30T19:36:09.446420] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T19:36:09.496106] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T19:36:09.854383] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-30T19:36:10.511878] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:36:10.654404] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-30T19:36:11.442674] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:36:11.454452] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-30T19:36:12.169545] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:36:12.254361] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-30T19:36:13.054422] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-30T19:36:13.854333] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-30T19:36:13.964732] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-30T19:36:14.268301] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:36:14.401006] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:36:14.654364] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-30T19:36:15.285440] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:36:15.454402] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-30T19:36:16.254373] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-30T19:36:16.404144] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:36:16.973901] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T19:36:16.982634] [INFO ] [REMOTE ] KREF: Full fetch complete (52335 records). [2025-09-30T19:36:16.982919] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-30T19:36:17.059517] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-30T19:36:17.401351] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-30T19:36:17.401479] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-30T19:36:17.402437] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-30T19:36:17.402551] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-30T19:36:17.404033] [DEBUG] [LOCAL ] KREF: Trimmed 52335 records to 37396 (keeping 200 days of data) [2025-09-30T19:36:17.648751] [DEBUG] [LOCAL ] KREF: Primary data saved (37396 records). [2025-09-30T19:36:17.648904] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-30T19:36:17.649111] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KREF took 26.8s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-09-30T19:36:17.835937] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:17.865269] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-30T19:36:17.886605] [DEBUG] [LOCAL ] KRG: Loaded 49153 existing records from primary storage. [2025-09-30T19:36:17.886971] [INFO ] [MAIN ] KRG: Loaded 49153 existing records. [2025-09-30T19:36:18.089156] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:36:18.146019] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:18.146767] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-30T19:36:18.147030] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-30T19:36:18.148613] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-30T19:36:18.148731] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-30T19:36:18.547157] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:18.654333] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-30T19:36:18.721704] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:36:18.733335] [INFO ] [REMOTE ] KOS: Full fetch complete (76844 records). [2025-09-30T19:36:18.733482] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-30T19:36:19.185495] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-30T19:36:19.185615] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-30T19:36:19.187285] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-30T19:36:19.187370] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-30T19:36:19.189069] [DEBUG] [LOCAL ] KOS: Trimmed 76844 records to 53049 (keeping 200 days of data) [2025-09-30T19:36:19.462062] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-30T19:36:19.515461] [DEBUG] [LOCAL ] KOS: Primary data saved (53049 records). [2025-09-30T19:36:19.515606] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-30T19:36:19.515742] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KOS took 36.7s. Estimated remaining: 2h 27m 56s. Rate: 7.8 symbols/min [2025-09-30T19:36:19.745366] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:19.745620] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-30T19:36:19.745809] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-30T19:36:19.746128] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-30T19:36:19.746290] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-30T19:36:19.746374] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-30T19:36:19.746426] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-30T19:36:20.081305] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:36:20.143871] [INFO ] [REMOTE ] KRC: Full fetch complete (69813 records). [2025-09-30T19:36:20.179357] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-30T19:36:20.202740] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:20.267801] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-30T19:36:20.550937] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:36:20.557135] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-30T19:36:20.562631] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:36:20.573512] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-30T19:36:20.602063] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:36:20.639671] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-30T19:36:20.692438] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-30T19:36:20.691962] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-30T19:36:20.695377] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-30T19:36:20.695292] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:36:20.693172] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-30T19:36:20.695588] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-30T19:36:20.697100] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 1.2s. Estimated remaining: 2h 27m 42s. Rate: 7.8 symbols/min [2025-09-30T19:36:20.696951] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-30T19:36:20.706668] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-30T19:36:20.825051] [DEBUG] [LOCAL ] KRC: Trimmed 69813 records to 48305 (keeping 200 days of data) [2025-09-30T19:36:20.904226] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:21.029929] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:36:21.058156] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-30T19:36:21.081676] [DEBUG] [LOCAL ] KRO: Loaded 26010 existing records from primary storage. [2025-09-30T19:36:21.083548] [INFO ] [MAIN ] KRO: Loaded 26010 existing records. [2025-09-30T19:36:21.297755] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:21.298243] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-30T19:36:21.298620] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-30T19:36:21.299815] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-30T19:36:21.300108] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-30T19:36:21.808425] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:21.868769] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-30T19:36:21.904183] [DEBUG] [LOCAL ] KRC: Primary data saved (48305 records). [2025-09-30T19:36:21.904345] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-30T19:36:21.904462] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 35.6s. Estimated remaining: 2h 27m 28s. Rate: 7.8 symbols/min [2025-09-30T19:36:22.088506] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:22.135480] [DEBUG] [LOCAL ] KRP: Loaded 37163 existing records from primary storage. [2025-09-30T19:36:22.135924] [INFO ] [MAIN ] KRP: Loaded 37163 existing records. [2025-09-30T19:36:22.336574] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:22.337243] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-30T19:36:22.337481] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-30T19:36:22.338824] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-30T19:36:22.338960] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-30T19:36:22.507619] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:36:22.654896] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-30T19:36:22.803978] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:22.819411] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T19:36:23.454413] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-30T19:36:24.048392] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:36:24.254375] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-30T19:36:25.054401] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-30T19:36:25.658217] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:36:25.671101] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-30T19:36:25.671325] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-30T19:36:25.864587] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-30T19:36:26.036351] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:36:26.129929] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:36:26.192702] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-30T19:36:26.192848] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-30T19:36:26.194282] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-30T19:36:26.194363] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-30T19:36:26.196710] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 53681 (keeping 200 days of data) [2025-09-30T19:36:26.614227] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-09-30T19:36:26.614520] [INFO ] [MAIN ] KR: Full history saved. [2025-09-30T19:36:26.614698] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KR took 42.0s. Estimated remaining: 2h 27m 17s. Rate: 7.8 symbols/min [2025-09-30T19:36:26.659969] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-30T19:36:26.801851] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:26.867919] [DEBUG] [LOCAL ] KSS: Loaded 53605 existing records from primary storage. [2025-09-30T19:36:26.868524] [INFO ] [MAIN ] KSS: Loaded 53605 existing records. [2025-09-30T19:36:27.084568] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:27.085025] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-30T19:36:27.085207] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-30T19:36:27.086385] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-30T19:36:27.086462] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-30T19:36:27.458977] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-30T19:36:27.465064] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:27.480599] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:36:28.254338] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-30T19:36:28.345502] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:36:28.517229] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:36:29.054355] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-30T19:36:29.551082] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:36:29.854395] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-30T19:36:30.461040] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T19:36:30.654386] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-30T19:36:31.365799] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:36:31.454400] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-30T19:36:32.254744] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:36:32.254864] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-30T19:36:32.786713] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T19:36:33.054428] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-30T19:36:33.854415] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-30T19:36:34.248038] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:36:34.553907] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T19:36:34.654416] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-30T19:36:34.995395] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T19:36:35.454416] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-30T19:36:36.254384] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-30T19:36:36.619486] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T19:36:37.054452] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-30T19:36:37.243448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:36:37.707410] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:36:37.854434] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-30T19:36:38.572239] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:36:38.654388] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-30T19:36:39.464530] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-30T19:36:39.470721] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:36:40.254398] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-30T19:36:40.603605] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:36:40.708139] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-30T19:36:41.054381] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-30T19:36:41.855988] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-30T19:36:41.860182] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:36:41.873028] [INFO ] [REMOTE ] KRG: Full fetch complete (71119 records). [2025-09-30T19:36:41.873269] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-30T19:36:42.298544] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-30T19:36:42.298666] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-30T19:36:42.299618] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-30T19:36:42.299698] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-30T19:36:42.301191] [DEBUG] [LOCAL ] KRG: Trimmed 71119 records to 49160 (keeping 200 days of data) [2025-09-30T19:36:42.633334] [DEBUG] [LOCAL ] KRG: Primary data saved (49160 records). [2025-09-30T19:36:42.633570] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-30T19:36:42.633758] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 25.0s. Estimated remaining: 2h 27m 18s. Rate: 7.8 symbols/min [2025-09-30T19:36:42.659486] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-30T19:36:42.828431] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:42.867252] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:36:42.901925] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:36:42.947450] [DEBUG] [LOCAL ] KT: Loaded 45650 existing records from primary storage. [2025-09-30T19:36:42.947951] [INFO ] [MAIN ] KT: Loaded 45650 existing records. [2025-09-30T19:36:43.157256] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:43.157520] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-30T19:36:43.157572] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-30T19:36:43.158185] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-30T19:36:43.158268] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-30T19:36:43.459602] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-30T19:36:43.574312] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:44.102590] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:36:44.254445] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-30T19:36:45.054459] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-30T19:36:45.595121] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T19:36:45.769913] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:36:45.846279] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:36:45.855959] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-30T19:36:46.654374] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-30T19:36:47.399304] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T19:36:47.454357] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-30T19:36:48.254386] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-30T19:36:48.981390] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:36:49.054382] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-30T19:36:49.854490] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-30T19:36:50.094221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (3.44 seconds). [2025-09-30T19:36:50.624570] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:36:50.632407] [INFO ] [REMOTE ] KRP: Full fetch complete (54912 records). [2025-09-30T19:36:50.632528] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-30T19:36:50.668171] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-30T19:36:51.055359] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-30T19:36:51.055507] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-30T19:36:51.056463] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-30T19:36:51.056541] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-30T19:36:51.057864] [DEBUG] [LOCAL ] KRP: Trimmed 54912 records to 37125 (keeping 200 days of data) [2025-09-30T19:36:51.296659] [DEBUG] [LOCAL ] KRP: Primary data saved (37125 records). [2025-09-30T19:36:51.296815] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-30T19:36:51.296961] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 29.4s. Estimated remaining: 2h 27m 11s. Rate: 7.8 symbols/min [2025-09-30T19:36:51.481379] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:51.523016] [DEBUG] [LOCAL ] KTB: Loaded 41099 existing records from primary storage. [2025-09-30T19:36:51.523362] [INFO ] [MAIN ] KTB: Loaded 41099 existing records. [2025-09-30T19:36:51.724131] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:51.724380] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-30T19:36:51.724431] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-30T19:36:51.724868] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-30T19:36:51.724931] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-30T19:36:52.082430] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T19:36:52.074456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (3.82 seconds). [2025-09-30T19:36:52.125367] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-30T19:36:52.221247] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:52.254341] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-30T19:36:52.385264] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:36:53.054446] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-30T19:36:53.412009] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T19:36:53.854414] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-30T19:36:54.061142] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T19:36:54.384391] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:36:54.654374] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-30T19:36:55.454381] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-30T19:36:55.551438] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:36:55.607003] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T19:36:56.254403] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-30T19:36:56.896160] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:36:56.902884] [INFO ] [REMOTE ] KRO: Full fetch complete (34904 records). [2025-09-30T19:36:56.902987] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-30T19:36:57.063767] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-30T19:36:57.321060] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-30T19:36:57.321220] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-30T19:36:57.322062] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-30T19:36:57.322132] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-30T19:36:57.323422] [DEBUG] [LOCAL ] KRO: Trimmed 34904 records to 26036 (keeping 200 days of data) [2025-09-30T19:36:57.484481] [DEBUG] [LOCAL ] KRO: Primary data saved (26036 records). [2025-09-30T19:36:57.484626] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-30T19:36:57.484751] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRO took 36.8s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-09-30T19:36:57.667504] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:57.682564] [DEBUG] [LOCAL ] KTF: Loaded 12803 existing records from primary storage. [2025-09-30T19:36:57.682918] [INFO ] [MAIN ] KTF: Loaded 12803 existing records. [2025-09-30T19:36:57.871372] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-30T19:36:57.878945] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:57.880192] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-30T19:36:57.880411] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-30T19:36:57.881091] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-30T19:36:57.881159] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-30T19:36:58.093660] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:36:58.325331] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:58.351680] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:36:58.654406] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-30T19:36:59.454333] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-30T19:36:59.655594] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:36:59.927018] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T19:37:00.254398] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-30T19:37:01.016836] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:37:01.054353] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-30T19:37:01.170366] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T19:37:01.854358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-30T19:37:02.631332] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T19:37:02.654351] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-30T19:37:02.845894] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:37:02.859215] [INFO ] [REMOTE ] KSS: Full fetch complete (77635 records). [2025-09-30T19:37:02.859433] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-30T19:37:03.337988] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-30T19:37:03.338107] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-30T19:37:03.339248] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-30T19:37:03.339343] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-30T19:37:03.356605] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T19:37:03.359961] [DEBUG] [LOCAL ] KSS: Trimmed 77635 records to 53603 (keeping 200 days of data) [2025-09-30T19:37:03.455292] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-30T19:37:03.722157] [DEBUG] [LOCAL ] KSS: Primary data saved (53603 records). [2025-09-30T19:37:03.722319] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-30T19:37:03.723496] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KSS took 37.1s. Estimated remaining: 2h 26m 53s. Rate: 7.8 symbols/min [2025-09-30T19:37:03.923029] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:03.923282] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-30T19:37:03.923359] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-30T19:37:03.923529] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-30T19:37:03.923574] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-30T19:37:03.923617] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-30T19:37:03.923686] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-30T19:37:04.259581] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-30T19:37:04.350049] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:04.835425] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:37:05.054326] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-30T19:37:05.285601] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:37:05.854357] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-30T19:37:06.654399] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-30T19:37:06.696466] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:37:07.307110] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T19:37:07.462597] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-30T19:37:07.469000] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T19:37:08.254362] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-30T19:37:08.271844] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:37:09.054366] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-30T19:37:09.854515] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-30T19:37:10.294915] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T19:37:10.652240] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:37:10.655987] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-30T19:37:11.186027] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T19:37:11.454351] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-30T19:37:11.601951] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:37:12.254367] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-30T19:37:13.059820] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-30T19:37:13.080013] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:37:13.854343] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-30T19:37:14.639962] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-30T19:37:14.652984] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T19:37:14.657342] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-30T19:37:14.745528] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:37:15.454367] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-30T19:37:16.231109] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:37:16.254363] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-30T19:37:16.315405] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:37:17.054376] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-30T19:37:17.111119] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T19:37:17.113763] [INFO ] [REMOTE ] KTF: Full fetch complete (17976 records). [2025-09-30T19:37:17.113853] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-30T19:37:17.515531] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-30T19:37:17.515609] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-30T19:37:17.516079] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-30T19:37:17.516153] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-30T19:37:17.517059] [DEBUG] [LOCAL ] KTF: Trimmed 17976 records to 12688 (keeping 200 days of data) [2025-09-30T19:37:17.598525] [DEBUG] [LOCAL ] KTF: Primary data saved (12688 records). [2025-09-30T19:37:17.598694] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-30T19:37:17.598803] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 20.1s. Estimated remaining: 2h 26m 51s. Rate: 7.8 symbols/min [2025-09-30T19:37:17.787992] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:17.846886] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-30T19:37:17.847263] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-30T19:37:17.859667] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-30T19:37:18.056098] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:18.056395] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-30T19:37:18.056452] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-30T19:37:18.057043] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-30T19:37:18.057106] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-30T19:37:18.454265] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:18.654361] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-30T19:37:19.123920] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:37:19.251335] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:37:19.454377] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-30T19:37:20.227483] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:37:20.236492] [INFO ] [REMOTE ] KTB: Full fetch complete (57737 records). [2025-09-30T19:37:20.236685] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-30T19:37:20.259597] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-30T19:37:20.690567] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-30T19:37:20.690736] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-30T19:37:20.691712] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-30T19:37:20.691783] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-30T19:37:20.693100] [DEBUG] [LOCAL ] KTB: Trimmed 57737 records to 41051 (keeping 200 days of data) [2025-09-30T19:37:20.960313] [DEBUG] [LOCAL ] KTB: Primary data saved (41051 records). [2025-09-30T19:37:20.960511] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-30T19:37:20.960613] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 29.7s. Estimated remaining: 2h 26m 39s. Rate: 7.8 symbols/min [2025-09-30T19:37:21.071628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T19:37:21.065960] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-30T19:37:21.164292] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:21.198834] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T19:37:21.263483] [DEBUG] [LOCAL ] KVYO: Loaded 49993 existing records from primary storage. [2025-09-30T19:37:21.263921] [INFO ] [MAIN ] KVYO: Loaded 49993 existing records. [2025-09-30T19:37:21.452545] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:21.452831] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-30T19:37:21.452883] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-30T19:37:21.453364] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-30T19:37:21.453423] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-30T19:37:21.835677] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:21.854312] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-30T19:37:22.654353] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-30T19:37:22.955084] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:37:22.965585] [INFO ] [REMOTE ] KT: Full fetch complete (66710 records). [2025-09-30T19:37:22.965751] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-30T19:37:23.405891] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-30T19:37:23.406026] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-30T19:37:23.407128] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-30T19:37:23.407196] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-30T19:37:23.408872] [DEBUG] [LOCAL ] KT: Trimmed 66710 records to 45663 (keeping 200 days of data) [2025-09-30T19:37:23.470965] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-30T19:37:23.553005] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:37:23.761578] [DEBUG] [LOCAL ] KT: Primary data saved (45663 records). [2025-09-30T19:37:23.761754] [INFO ] [MAIN ] KT: Full history saved. [2025-09-30T19:37:23.761852] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KT took 41.1s. Estimated remaining: 2h 26m 27s. Rate: 7.8 symbols/min [2025-09-30T19:37:23.945282] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:23.963051] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T19:37:23.991721] [DEBUG] [LOCAL ] KW: Loaded 40567 existing records from primary storage. [2025-09-30T19:37:23.992032] [INFO ] [MAIN ] KW: Loaded 40567 existing records. [2025-09-30T19:37:24.191815] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:24.192191] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-30T19:37:24.192352] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-30T19:37:24.192771] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-30T19:37:24.192855] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-30T19:37:24.259463] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-30T19:37:24.396515] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:37:24.634218] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:24.780327] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T19:37:25.054406] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-30T19:37:25.854391] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-30T19:37:26.305116] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T19:37:26.654599] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-30T19:37:26.863478] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:37:27.454398] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-30T19:37:28.254347] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-30T19:37:28.561714] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:37:29.054415] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-30T19:37:29.227426] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:37:29.322562] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:37:29.854433] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-30T19:37:30.428842] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T19:37:30.662987] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-30T19:37:30.668682] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:37:31.454417] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-30T19:37:32.095238] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:37:32.116814] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T19:37:32.119015] [INFO ] [REMOTE ] KUKE: Full fetch complete (8348 records). [2025-09-30T19:37:32.119099] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-30T19:37:32.259476] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-30T19:37:32.338679] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:37:32.339189] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:37:32.339270] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:37:32.339346] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-30T19:37:32.339428] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-30T19:37:32.339485] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-30T19:37:32.339545] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-30T19:37:32.339691] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KUKE took 28.6s. Estimated remaining: 2h 26m 20s. Rate: 7.8 symbols/min [2025-09-30T19:37:32.527115] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:32.546632] [DEBUG] [LOCAL ] KWR: Loaded 16635 existing records from primary storage. [2025-09-30T19:37:32.546937] [INFO ] [MAIN ] KWR: Loaded 16635 existing records. [2025-09-30T19:37:32.770361] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:32.770707] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-30T19:37:32.770773] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-30T19:37:32.771126] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-30T19:37:32.771187] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-30T19:37:33.060043] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-30T19:37:33.196677] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:33.643202] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:37:33.854410] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-30T19:37:34.654360] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-30T19:37:34.941207] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:37:35.022741] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:37:35.454376] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-30T19:37:36.255567] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-30T19:37:36.280668] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:37:36.409350] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T19:37:37.054398] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-30T19:37:37.587636] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:37:37.854365] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-30T19:37:38.654393] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-30T19:37:38.716607] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:37:39.332349] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:37:39.454397] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-30T19:37:39.767747] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T19:37:40.254389] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-30T19:37:40.452568] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T19:37:41.054366] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-30T19:37:41.713920] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:37:41.854364] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-30T19:37:42.221915] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:37:42.654351] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-30T19:37:43.310167] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:37:43.454362] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-30T19:37:43.633158] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:37:44.254378] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-30T19:37:44.907633] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:37:45.054324] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-30T19:37:45.854365] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-30T19:37:45.910499] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T19:37:46.029355] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:37:46.654374] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-30T19:37:47.454376] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-30T19:37:47.536344] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:37:48.162451] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T19:37:48.254380] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-30T19:37:48.599207] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T19:37:49.054363] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-30T19:37:49.426055] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:37:49.854380] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-30T19:37:50.217498] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:37:50.654381] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-30T19:37:50.789043] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T19:37:51.454377] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-30T19:37:52.254337] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-30T19:37:52.402372] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:37:52.405904] [INFO ] [REMOTE ] KWR: Full fetch complete (23937 records). [2025-09-30T19:37:52.406001] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-30T19:37:52.733285] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T19:37:52.855590] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-30T19:37:52.855707] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-30T19:37:52.856270] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-30T19:37:52.856335] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-30T19:37:52.857177] [DEBUG] [LOCAL ] KWR: Trimmed 23937 records to 16599 (keeping 200 days of data) [2025-09-30T19:37:52.981695] [DEBUG] [LOCAL ] KWR: Primary data saved (16599 records). [2025-09-30T19:37:52.981900] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-30T19:37:52.982055] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 20.6s. Estimated remaining: 2h 26m 24s. Rate: 7.8 symbols/min [2025-09-30T19:37:53.060440] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-30T19:37:53.187937] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:53.227297] [DEBUG] [LOCAL ] KYN: Loaded 30077 existing records from primary storage. [2025-09-30T19:37:53.227805] [INFO ] [MAIN ] KYN: Loaded 30077 existing records. [2025-09-30T19:37:53.431080] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:53.431931] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-30T19:37:53.446576] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-30T19:37:53.459826] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-30T19:37:53.459753] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:37:53.460029] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-30T19:37:53.839499] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:53.854361] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-30T19:37:54.472878] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:37:54.487511] [INFO ] [REMOTE ] KVYO: Full fetch complete (71527 records). [2025-09-30T19:37:54.487744] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-30T19:37:54.662540] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-30T19:37:54.915303] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-30T19:37:54.915402] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-30T19:37:54.916485] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-30T19:37:54.916555] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-30T19:37:54.918302] [DEBUG] [LOCAL ] KVYO: Trimmed 71527 records to 50023 (keeping 200 days of data) [2025-09-30T19:37:55.224209] [DEBUG] [LOCAL ] KVYO: Primary data saved (50023 records). [2025-09-30T19:37:55.224356] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-30T19:37:55.224488] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KVYO took 34.3s. Estimated remaining: 2h 26m 11s. Rate: 7.8 symbols/min [2025-09-30T19:37:55.409781] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:55.455068] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-30T19:37:55.457143] [DEBUG] [LOCAL ] L: Loaded 40928 existing records from primary storage. [2025-09-30T19:37:55.457569] [INFO ] [MAIN ] L: Loaded 40928 existing records. [2025-09-30T19:37:55.667566] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:55.668042] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-30T19:37:55.668264] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-30T19:37:55.668958] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-30T19:37:55.669047] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-30T19:37:56.164810] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:56.167577] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T19:37:56.193464] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-09-30T19:37:56.200063] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-30T19:37:56.213540] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:37:56.258594] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-30T19:37:56.746301] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-30T19:37:56.746466] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-30T19:37:56.749248] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-30T19:37:56.749327] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-30T19:37:56.752569] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 53667 (keeping 200 days of data) [2025-09-30T19:37:57.079901] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-30T19:37:57.143917] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:37:57.181801] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-30T19:37:57.181983] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-30T19:37:57.182166] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVUE took 39.6s. Estimated remaining: 2h 25m 58s. Rate: 7.8 symbols/min [2025-09-30T19:37:57.366758] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:57.421398] [DEBUG] [LOCAL ] LAC: Loaded 52321 existing records from primary storage. [2025-09-30T19:37:57.421797] [INFO ] [MAIN ] LAC: Loaded 52321 existing records. [2025-09-30T19:37:57.657887] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:57.658358] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-30T19:37:57.658564] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-30T19:37:57.659272] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-30T19:37:57.659370] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-30T19:37:57.858086] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-30T19:37:57.933392] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:37:58.101099] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:58.135802] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T19:37:58.654368] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-30T19:37:59.276960] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:37:59.454362] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-30T19:38:00.254356] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-30T19:38:00.300633] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:38:01.054363] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-30T19:38:01.502255] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T19:38:01.751340] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T19:38:01.854359] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-30T19:38:02.219425] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:38:02.228296] [INFO ] [REMOTE ] KW: Full fetch complete (57050 records). [2025-09-30T19:38:02.228467] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-30T19:38:02.646597] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-30T19:38:02.646714] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-30T19:38:02.647631] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-30T19:38:02.647718] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-30T19:38:02.649098] [DEBUG] [LOCAL ] KW: Trimmed 57050 records to 40564 (keeping 200 days of data) [2025-09-30T19:38:02.654360] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-30T19:38:02.912301] [DEBUG] [LOCAL ] KW: Primary data saved (40564 records). [2025-09-30T19:38:02.912440] [INFO ] [MAIN ] KW: Full history saved. [2025-09-30T19:38:02.912525] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KW took 39.2s. Estimated remaining: 2h 25m 49s. Rate: 7.8 symbols/min [2025-09-30T19:38:03.116101] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:03.143949] [DEBUG] [LOCAL ] LAD: Loaded 23520 existing records from primary storage. [2025-09-30T19:38:03.144242] [INFO ] [MAIN ] LAD: Loaded 23520 existing records. [2025-09-30T19:38:03.314336] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:38:03.392761] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:03.393028] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-30T19:38:03.393098] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-30T19:38:03.393496] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-30T19:38:03.393558] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-30T19:38:03.456993] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-30T19:38:03.786291] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:03.805191] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T19:38:04.254361] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-30T19:38:05.054348] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-30T19:38:05.247972] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:38:05.524088] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:38:05.854375] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-30T19:38:05.959235] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:38:06.654370] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-30T19:38:07.454363] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-30T19:38:07.525348] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:38:08.254381] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-30T19:38:08.759338] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-30T19:38:08.902159] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:38:09.054351] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-30T19:38:09.502283] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:38:09.854365] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-30T19:38:10.654317] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-30T19:38:10.700244] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T19:38:11.055244] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T19:38:11.454372] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-30T19:38:12.191727] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:38:12.254351] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-30T19:38:12.339733] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:38:13.054351] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-30T19:38:13.567749] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:38:13.854348] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-30T19:38:14.241223] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:38:14.654359] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-30T19:38:15.454356] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-30T19:38:15.625119] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:38:15.912011] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:38:16.254362] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-30T19:38:16.567952] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:38:17.054347] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-30T19:38:17.832531] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:38:17.854339] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-30T19:38:17.888934] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:38:18.654395] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-30T19:38:18.794685] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:38:19.454362] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-30T19:38:20.254323] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-30T19:38:20.292161] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T19:38:20.302842] [INFO ] [REMOTE ] L: Full fetch complete (59524 records). [2025-09-30T19:38:20.302978] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-30T19:38:20.750130] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-30T19:38:20.750333] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-30T19:38:20.751327] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-30T19:38:20.751430] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-30T19:38:20.772455] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:38:20.779996] [DEBUG] [LOCAL ] L: Trimmed 59524 records to 40964 (keeping 200 days of data) [2025-09-30T19:38:21.048996] [DEBUG] [LOCAL ] L: Primary data saved (40964 records). [2025-09-30T19:38:21.049127] [INFO ] [MAIN ] L: Full history saved. [2025-09-30T19:38:21.049206] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. L took 25.8s. Estimated remaining: 2h 25m 51s. Rate: 7.8 symbols/min [2025-09-30T19:38:21.060737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-30T19:38:21.239194] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:21.281128] [DEBUG] [LOCAL ] LADR: Loaded 38625 existing records from primary storage. [2025-09-30T19:38:21.281517] [INFO ] [MAIN ] LADR: Loaded 38625 existing records. [2025-09-30T19:38:21.474989] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:21.475247] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-30T19:38:21.475299] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-30T19:38:21.475679] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-30T19:38:21.475756] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-30T19:38:21.865216] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-30T19:38:21.917614] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:22.164557] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:38:22.469749] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:38:22.654413] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-30T19:38:23.120257] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T19:38:23.454382] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-30T19:38:24.254439] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-30T19:38:24.444975] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:38:24.833769] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T19:38:24.840377] [INFO ] [REMOTE ] KYN: Full fetch complete (44629 records). [2025-09-30T19:38:24.840531] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-30T19:38:25.059521] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-30T19:38:25.255087] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-30T19:38:25.255193] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-30T19:38:25.256066] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-30T19:38:25.256157] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-30T19:38:25.257500] [DEBUG] [LOCAL ] KYN: Trimmed 44629 records to 30028 (keeping 200 days of data) [2025-09-30T19:38:25.475879] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:38:25.499447] [DEBUG] [LOCAL ] KYN: Primary data saved (30028 records). [2025-09-30T19:38:25.499602] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-30T19:38:25.501582] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. KYN took 32.5s. Estimated remaining: 2h 25m 40s. Rate: 7.8 symbols/min [2025-09-30T19:38:25.680135] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:25.686382] [DEBUG] [LOCAL ] LANV: Loaded 2823 existing records from primary storage. [2025-09-30T19:38:25.686592] [INFO ] [MAIN ] LANV: Loaded 2823 existing records. [2025-09-30T19:38:25.866178] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-30T19:38:25.872453] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:25.873699] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-30T19:38:25.873789] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-30T19:38:25.874055] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-30T19:38:25.874185] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-30T19:38:26.302886] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:26.654363] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-30T19:38:26.932967] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:38:27.205412] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T19:38:27.377383] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:38:27.454385] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-30T19:38:28.254379] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-30T19:38:28.632595] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T19:38:28.825313] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:38:29.054391] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-30T19:38:29.854423] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-30T19:38:30.398197] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:38:30.654358] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-30T19:38:31.018891] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T19:38:31.024018] [INFO ] [REMOTE ] LAD: Full fetch complete (35448 records). [2025-09-30T19:38:31.024213] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-30T19:38:31.455597] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-30T19:38:31.455294] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-30T19:38:31.455736] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-30T19:38:31.457267] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-30T19:38:31.457335] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-30T19:38:31.458812] [DEBUG] [LOCAL ] LAD: Trimmed 35448 records to 23493 (keeping 200 days of data) [2025-09-30T19:38:31.641061] [DEBUG] [LOCAL ] LAD: Primary data saved (23493 records). [2025-09-30T19:38:31.641286] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-30T19:38:31.641450] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAD took 28.7s. Estimated remaining: 2h 25m 31s. Rate: 7.8 symbols/min [2025-09-30T19:38:31.859583] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:31.859794] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-30T19:38:31.859853] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-30T19:38:31.860001] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-30T19:38:31.860057] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-30T19:38:31.860103] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-30T19:38:31.860137] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-30T19:38:32.276705] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-30T19:38:32.283009] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:32.287468] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:38:32.709452] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:38:33.054342] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-30T19:38:33.427810] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:38:33.428170] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-30T19:38:33.428263] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:38:33.428314] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-30T19:38:33.428376] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:38:33.428449] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-30T19:38:33.428516] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-30T19:38:33.428554] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-30T19:38:33.428611] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-30T19:38:33.428709] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAR took 1.8s. Estimated remaining: 2h 25m 18s. Rate: 7.8 symbols/min [2025-09-30T19:38:33.718635] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-30T19:38:33.854361] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-30T19:38:34.654408] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-30T19:38:35.454390] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-30T19:38:35.498758] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:38:35.869526] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T19:38:36.254330] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-30T19:38:36.622500] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:38:36.716891] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T19:38:37.054351] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-30T19:38:37.408433] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T19:38:37.854384] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-30T19:38:38.271111] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:38:38.654436] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-30T19:38:39.454422] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-30T19:38:39.965218] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:38:40.254386] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-30T19:38:41.054368] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-30T19:38:41.476670] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T19:38:41.559547] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T19:38:41.704712] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:38:41.716336] [INFO ] [REMOTE ] LAC: Full fetch complete (75979 records). [2025-09-30T19:38:41.716511] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-30T19:38:41.869200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-30T19:38:42.145398] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-30T19:38:42.145492] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-30T19:38:42.146518] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-30T19:38:42.146588] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-30T19:38:42.148193] [DEBUG] [LOCAL ] LAC: Trimmed 75979 records to 52329 (keeping 200 days of data) [2025-09-30T19:38:42.453427] [DEBUG] [LOCAL ] LAC: Primary data saved (52329 records). [2025-09-30T19:38:42.453579] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-30T19:38:42.453691] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 45.3s. Estimated remaining: 2h 25m 12s. Rate: 7.8 symbols/min [2025-09-30T19:38:42.481478] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T19:38:42.654378] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-30T19:38:43.292217] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:38:43.293821] [INFO ] [REMOTE ] LANV: Full fetch complete (4421 records). [2025-09-30T19:38:43.293896] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-30T19:38:43.475977] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-30T19:38:43.684164] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-30T19:38:43.684480] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-30T19:38:43.684678] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-30T19:38:43.684739] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-30T19:38:43.685127] [DEBUG] [LOCAL ] LANV: Trimmed 4421 records to 2826 (keeping 200 days of data) [2025-09-30T19:38:43.701840] [DEBUG] [LOCAL ] LANV: Primary data saved (2826 records). [2025-09-30T19:38:43.701930] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-30T19:38:43.702006] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 18.2s. Estimated remaining: 2h 24m 58s. Rate: 7.8 symbols/min [2025-09-30T19:38:45.051983] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T19:38:45.062169] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-30T19:38:46.516263] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:38:46.525102] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-30T19:38:47.935395] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:38:47.944332] [INFO ] [REMOTE ] LADR: Full fetch complete (55276 records). [2025-09-30T19:38:47.944476] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-30T19:38:48.345682] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-30T19:38:48.345773] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-30T19:38:48.346634] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-30T19:38:48.346722] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-30T19:38:48.347944] [DEBUG] [LOCAL ] LADR: Trimmed 55276 records to 38698 (keeping 200 days of data) [2025-09-30T19:38:48.590639] [DEBUG] [LOCAL ] LADR: Primary data saved (38698 records). [2025-09-30T19:38:48.590807] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-30T19:38:48.590893] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LADR took 27.5s. Estimated remaining: 2h 24m 48s. Rate: 7.8 symbols/min [2025-09-30T19:38:49.339545] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.369783] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.392479] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.388951] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.422416] [DEBUG] [LOCAL ] LAW: Loaded 13949 existing records from primary storage. [2025-09-30T19:38:49.422724] [INFO ] [MAIN ] LAW: Loaded 13949 existing records. [2025-09-30T19:38:49.660311] [DEBUG] [LOCAL ] LAZ: Loaded 44983 existing records from primary storage. [2025-09-30T19:38:49.659622] [DEBUG] [LOCAL ] LB: Loaded 37552 existing records from primary storage. [2025-09-30T19:38:49.694314] [INFO ] [MAIN ] LB: Loaded 37552 existing records. [2025-09-30T19:38:49.711220] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:49.711712] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-30T19:38:49.711476] [INFO ] [MAIN ] LAZ: Loaded 44983 existing records. [2025-09-30T19:38:49.712695] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-30T19:38:49.712564] [DEBUG] [LOCAL ] LBRT: Loaded 52915 existing records from primary storage. [2025-09-30T19:38:49.730807] [INFO ] [MAIN ] LBRT: Loaded 52915 existing records. [2025-09-30T19:38:49.780780] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-30T19:38:49.854132] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-30T19:38:50.432514] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.474747] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.493429] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.477730] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.522508] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-30T19:38:50.499627] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.534872] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.543221] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-30T19:38:50.543126] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-30T19:38:50.534703] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-30T19:38:50.572276] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-30T19:38:50.591270] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-30T19:38:50.616290] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-30T19:38:50.648252] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-30T19:38:50.808828] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-30T19:38:51.110513] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:51.144107] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-30T19:38:51.877809] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:51.935758] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-30T19:38:52.014514] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:52.033578] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-30T19:38:52.040365] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:52.041880] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-30T19:38:52.195984] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T19:38:52.199870] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-30T19:38:53.183347] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:38:53.187398] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-30T19:38:53.360861] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:38:53.370384] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-30T19:38:53.520403] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:38:53.529877] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-30T19:38:53.727388] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T19:38:53.731205] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-30T19:38:53.804604] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:38:53.815512] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-30T19:38:54.227562] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T19:38:54.231142] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-30T19:38:54.831803] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:38:54.842780] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-30T19:38:55.005837] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T19:38:55.105281] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T19:38:55.197545] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T19:38:55.454395] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-30T19:38:55.944369] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:38:56.254360] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-30T19:38:56.954366] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:38:57.054358] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-30T19:38:57.694399] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:38:57.854368] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-30T19:38:58.654533] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-30T19:38:58.667489] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:38:58.709278] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T19:38:59.454396] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-30T19:39:00.254337] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-30T19:39:00.331796] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:39:00.727476] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:39:01.054368] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-30T19:39:01.767881] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:39:01.794589] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:39:01.854356] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-30T19:39:02.654412] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-30T19:39:02.829829] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T19:39:03.454400] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-30T19:39:04.254360] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-30T19:39:04.324502] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:39:04.450339] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:39:05.054349] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-30T19:39:05.774292] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:39:05.854348] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-30T19:39:06.167133] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T19:39:06.171038] [INFO ] [REMOTE ] LAW: Full fetch complete (20540 records). [2025-09-30T19:39:06.171114] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-30T19:39:06.566509] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-30T19:39:06.566589] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-30T19:39:06.567082] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-30T19:39:06.567146] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-30T19:39:06.567840] [DEBUG] [LOCAL ] LAW: Trimmed 20540 records to 13998 (keeping 200 days of data) [2025-09-30T19:39:06.653772] [DEBUG] [LOCAL ] LAW: Primary data saved (13998 records). [2025-09-30T19:39:06.653917] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-30T19:39:06.654001] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 18.1s. Estimated remaining: 2h 24m 49s. Rate: 7.8 symbols/min [2025-09-30T19:39:06.659556] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-30T19:39:06.850834] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:06.903484] [DEBUG] [LOCAL ] LC: Loaded 47828 existing records from primary storage. [2025-09-30T19:39:06.903874] [INFO ] [MAIN ] LC: Loaded 47828 existing records. [2025-09-30T19:39:07.112935] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:07.113188] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-30T19:39:07.113238] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-30T19:39:07.113777] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-30T19:39:07.113856] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-30T19:39:07.456467] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-30T19:39:07.532501] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:07.568816] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:39:08.207012] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:39:08.254367] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-30T19:39:09.021305] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:39:09.054365] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-30T19:39:09.854334] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-30T19:39:09.980990] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T19:39:10.654392] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-30T19:39:10.780106] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:39:11.454419] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-30T19:39:11.581600] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:39:12.256927] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-30T19:39:12.262744] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:39:12.752984] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:39:13.054341] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-30T19:39:13.675278] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T19:39:13.854354] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-30T19:39:14.654355] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-30T19:39:14.924345] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T19:39:15.454333] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-30T19:39:15.539989] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:39:16.187543] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:39:16.254338] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-30T19:39:17.059511] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-30T19:39:17.076052] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:39:17.853906] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:39:17.857012] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-30T19:39:18.654366] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-30T19:39:18.785995] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:39:19.456976] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-30T19:39:19.462891] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:39:19.473083] [INFO ] [REMOTE ] LAZ: Full fetch complete (65824 records). [2025-09-30T19:39:19.473237] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-30T19:39:19.904289] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-30T19:39:19.904405] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-30T19:39:19.905521] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-30T19:39:19.905596] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-30T19:39:19.907571] [DEBUG] [LOCAL ] LAZ: Trimmed 65824 records to 44962 (keeping 200 days of data) [2025-09-30T19:39:20.211064] [DEBUG] [LOCAL ] LAZ: Primary data saved (44962 records). [2025-09-30T19:39:20.211209] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-30T19:39:20.211296] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 31.6s. Estimated remaining: 2h 24m 47s. Rate: 7.8 symbols/min [2025-09-30T19:39:20.264772] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-30T19:39:20.405020] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:20.440600] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:39:20.453209] [INFO ] [REMOTE ] LBRT: Full fetch complete (76540 records). [2025-09-30T19:39:20.453388] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-30T19:39:20.611286] [DEBUG] [LOCAL ] LCII: Loaded 28223 existing records from primary storage. [2025-09-30T19:39:20.635068] [INFO ] [MAIN ] LCII: Loaded 28223 existing records. [2025-09-30T19:39:21.173239] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:21.206385] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-30T19:39:21.231566] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-30T19:39:21.231808] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-30T19:39:21.233111] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-30T19:39:21.233275] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-30T19:39:21.233345] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-30T19:39:21.234214] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-30T19:39:21.234391] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-30T19:39:21.298810] [DEBUG] [LOCAL ] LBRT: Trimmed 76540 records to 52915 (keeping 200 days of data) [2025-09-30T19:39:21.406438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T19:39:21.586467] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-30T19:39:21.846286] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:21.854560] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-30T19:39:22.012544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T19:39:22.024586] [INFO ] [REMOTE ] LB: Full fetch complete (55874 records). [2025-09-30T19:39:22.025682] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-30T19:39:22.473787] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-30T19:39:22.474167] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-30T19:39:22.476230] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-30T19:39:22.476321] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-30T19:39:22.479099] [DEBUG] [LOCAL ] LB: Trimmed 55874 records to 37689 (keeping 200 days of data) [2025-09-30T19:39:22.700463] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:39:22.706314] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-30T19:39:22.821337] [DEBUG] [LOCAL ] LBRT: Primary data saved (52915 records). [2025-09-30T19:39:22.822227] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-30T19:39:22.822348] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 34.2s. Estimated remaining: 2h 24m 35s. Rate: 7.8 symbols/min [2025-09-30T19:39:23.040255] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:23.057527] [DEBUG] [LOCAL ] LB: Primary data saved (37689 records). [2025-09-30T19:39:23.057861] [INFO ] [MAIN ] LB: Full history saved. [2025-09-30T19:39:23.058007] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LB took 34.5s. Estimated remaining: 2h 24m 20s. Rate: 7.8 symbols/min [2025-09-30T19:39:23.281636] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:23.285321] [DEBUG] [LOCAL ] LDI: Loaded 44119 existing records from primary storage. [2025-09-30T19:39:23.286434] [INFO ] [MAIN ] LDI: Loaded 44119 existing records. [2025-09-30T19:39:23.445245] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:39:23.526306] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:23.528041] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-30T19:39:23.539978] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-30T19:39:23.541486] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-30T19:39:23.542058] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-30T19:39:23.542125] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-30T19:39:23.682684] [DEBUG] [LOCAL ] LDOS: Loaded 45633 existing records from primary storage. [2025-09-30T19:39:23.711900] [INFO ] [MAIN ] LDOS: Loaded 45633 existing records. [2025-09-30T19:39:24.221166] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:24.246439] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-30T19:39:24.255248] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-30T19:39:24.278609] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:24.281333] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:39:24.281929] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-30T19:39:24.286776] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-30T19:39:24.287999] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-30T19:39:24.657555] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:24.962733] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T19:39:25.054356] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-30T19:39:25.364094] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:39:25.854457] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-30T19:39:26.505938] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:39:26.654474] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-30T19:39:27.074686] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:39:27.454367] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-30T19:39:28.254411] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-30T19:39:28.370304] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T19:39:28.583391] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:39:29.054415] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-30T19:39:29.854404] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-30T19:39:29.911134] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:39:30.290032] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T19:39:30.654457] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-30T19:39:31.091866] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:39:31.454442] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-30T19:39:32.107798] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:39:32.254372] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-30T19:39:33.054346] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-30T19:39:33.118895] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:39:33.525772] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:39:33.854397] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-30T19:39:34.390706] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:39:34.654405] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-30T19:39:35.330136] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:39:35.340811] [INFO ] [REMOTE ] LC: Full fetch complete (70539 records). [2025-09-30T19:39:35.340959] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-30T19:39:35.459433] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-30T19:39:35.766674] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-30T19:39:35.766793] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-30T19:39:35.767888] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-30T19:39:35.768032] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-30T19:39:35.769590] [DEBUG] [LOCAL ] LC: Trimmed 70539 records to 47854 (keeping 200 days of data) [2025-09-30T19:39:35.890444] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:39:36.086490] [DEBUG] [LOCAL ] LC: Primary data saved (47854 records). [2025-09-30T19:39:36.086678] [INFO ] [MAIN ] LC: Full history saved. [2025-09-30T19:39:36.086789] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 29.4s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min [2025-09-30T19:39:36.268919] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-30T19:39:36.273742] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:36.291081] [DEBUG] [LOCAL ] LDP: Loaded 12962 existing records from primary storage. [2025-09-30T19:39:36.291314] [INFO ] [MAIN ] LDP: Loaded 12962 existing records. [2025-09-30T19:39:36.476748] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:36.477003] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-30T19:39:36.477065] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-30T19:39:36.477244] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-30T19:39:36.477303] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-30T19:39:36.883561] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T19:39:36.906278] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:37.054349] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-30T19:39:37.407997] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:39:37.854403] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-30T19:39:38.593633] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:39:38.654410] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-30T19:39:39.267345] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:39:39.454393] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-30T19:39:39.905896] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:39:40.254377] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-30T19:39:40.924994] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T19:39:41.054349] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-30T19:39:41.712462] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:39:41.854377] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-30T19:39:42.387686] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:39:42.654382] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-30T19:39:43.238664] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:39:43.454371] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-30T19:39:44.254348] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-30T19:39:44.332362] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:39:44.732345] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:39:44.739402] [INFO ] [REMOTE ] LCII: Full fetch complete (39162 records). [2025-09-30T19:39:44.739526] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-30T19:39:45.059583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-30T19:39:45.176619] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-30T19:39:45.176813] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-30T19:39:45.177623] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-30T19:39:45.177747] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-30T19:39:45.178730] [DEBUG] [LOCAL ] LCII: Trimmed 39162 records to 28110 (keeping 200 days of data) [2025-09-30T19:39:45.373548] [DEBUG] [LOCAL ] LCII: Primary data saved (28110 records). [2025-09-30T19:39:45.374631] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T19:39:45.374791] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-30T19:39:45.375082] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 25.2s. Estimated remaining: 2h 24m 11s. Rate: 7.8 symbols/min [2025-09-30T19:39:45.566350] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:45.608760] [DEBUG] [LOCAL ] LEA: Loaded 41756 existing records from primary storage. [2025-09-30T19:39:45.609071] [INFO ] [MAIN ] LEA: Loaded 41756 existing records. [2025-09-30T19:39:45.801749] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:45.802102] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-30T19:39:45.802160] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-30T19:39:45.803309] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-30T19:39:45.803369] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-30T19:39:45.866774] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-30T19:39:46.177728] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:46.654340] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-30T19:39:46.839382] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:39:47.454341] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-30T19:39:47.717136] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:39:47.912820] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T19:39:48.254366] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-30T19:39:49.018366] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:39:49.054351] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-30T19:39:49.817008] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:39:49.854356] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-30T19:39:50.585748] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:39:50.654342] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-30T19:39:51.446240] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:39:51.454917] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-30T19:39:51.581689] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T19:39:52.254362] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-30T19:39:53.054351] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-30T19:39:53.811203] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T19:39:53.822739] [INFO ] [REMOTE ] LDI: Full fetch complete (60422 records). [2025-09-30T19:39:53.822888] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-30T19:39:53.868478] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-30T19:39:53.946052] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:39:54.148622] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:39:54.197995] [INFO ] [REMOTE ] LDOS: Full fetch complete (67695 records). [2025-09-30T19:39:54.208438] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-30T19:39:54.378838] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-30T19:39:54.384122] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-30T19:39:54.385219] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-30T19:39:54.405493] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-30T19:39:54.462344] [DEBUG] [LOCAL ] LDI: Trimmed 60422 records to 44128 (keeping 200 days of data) [2025-09-30T19:39:54.673976] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-30T19:39:54.940789] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-30T19:39:54.946322] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-30T19:39:54.954282] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-30T19:39:54.954687] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-30T19:39:54.961924] [DEBUG] [LOCAL ] LDOS: Trimmed 67695 records to 45593 (keeping 200 days of data) [2025-09-30T19:39:55.100794] [DEBUG] [LOCAL ] LDI: Primary data saved (44128 records). [2025-09-30T19:39:55.103543] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-30T19:39:55.104536] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 32.3s. Estimated remaining: 2h 24m 5s. Rate: 7.8 symbols/min [2025-09-30T19:39:55.302525] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:55.330856] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:39:55.466301] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-30T19:39:55.487398] [DEBUG] [LOCAL ] LEG: Loaded 50337 existing records from primary storage. [2025-09-30T19:39:55.488724] [INFO ] [MAIN ] LEG: Loaded 50337 existing records. [2025-09-30T19:39:55.700011] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:55.701344] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-30T19:39:55.701692] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-30T19:39:55.702732] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-30T19:39:55.704235] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-30T19:39:55.858282] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:39:56.141770] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:56.186732] [DEBUG] [LOCAL ] LDOS: Primary data saved (45593 records). [2025-09-30T19:39:56.186924] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-30T19:39:56.189138] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 33.1s. Estimated remaining: 2h 23m 52s. Rate: 7.8 symbols/min [2025-09-30T19:39:56.259506] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-30T19:39:56.386754] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:56.458428] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-09-30T19:39:56.458827] [INFO ] [MAIN ] LEN: Loaded 53195 existing records. [2025-09-30T19:39:56.662019] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:56.662271] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-30T19:39:56.662318] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-30T19:39:56.662828] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-30T19:39:56.662887] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-30T19:39:57.060764] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-30T19:39:57.076766] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:57.153616] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:39:57.206549] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T19:39:57.854369] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-30T19:39:58.654345] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-30T19:39:58.817608] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:39:59.363639] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:39:59.454376] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-30T19:39:59.635425] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:40:00.254382] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-30T19:40:01.054358] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-30T19:40:01.344807] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T19:40:01.855536] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-30T19:40:01.857758] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T19:40:02.040065] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T19:40:02.654361] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-30T19:40:03.454374] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-30T19:40:03.609297] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:40:03.927569] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T19:40:04.254372] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-30T19:40:05.054365] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-30T19:40:05.145354] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:40:05.238546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T19:40:05.854356] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-30T19:40:06.655696] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-30T19:40:06.661314] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:40:07.361527] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T19:40:07.454344] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-30T19:40:07.591240] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:40:07.594339] [INFO ] [REMOTE ] LDP: Full fetch complete (19461 records). [2025-09-30T19:40:07.594447] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-30T19:40:07.996799] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-30T19:40:07.996878] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-30T19:40:07.997304] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-30T19:40:07.997368] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-30T19:40:07.998012] [DEBUG] [LOCAL ] LDP: Trimmed 19461 records to 12967 (keeping 200 days of data) [2025-09-30T19:40:08.083865] [DEBUG] [LOCAL ] LDP: Primary data saved (12967 records). [2025-09-30T19:40:08.084011] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-30T19:40:08.084170] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 32.0s. Estimated remaining: 2h 23m 48s. Rate: 7.8 symbols/min [2025-09-30T19:40:08.263812] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-30T19:40:08.268548] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:08.288133] [DEBUG] [LOCAL ] LEO: Loaded 17498 existing records from primary storage. [2025-09-30T19:40:08.288411] [INFO ] [MAIN ] LEO: Loaded 17498 existing records. [2025-09-30T19:40:08.487901] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:08.488222] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-30T19:40:08.488304] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-30T19:40:08.488715] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-30T19:40:08.488812] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-30T19:40:08.934900] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:08.969832] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:40:09.054365] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-30T19:40:09.854337] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-30T19:40:10.263386] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T19:40:10.645270] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:40:10.654672] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-30T19:40:11.134897] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:40:11.454378] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-30T19:40:12.254369] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-30T19:40:12.563579] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:40:13.033471] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T19:40:13.054318] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-30T19:40:13.764074] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:40:13.854351] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-30T19:40:14.114869] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T19:40:14.654325] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-30T19:40:15.454400] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-30T19:40:15.527792] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T19:40:15.538324] [INFO ] [REMOTE ] LEA: Full fetch complete (60918 records). [2025-09-30T19:40:15.538498] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-30T19:40:15.956408] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-30T19:40:15.956503] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-30T19:40:15.957393] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-30T19:40:15.957460] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-30T19:40:15.958810] [DEBUG] [LOCAL ] LEA: Trimmed 60918 records to 41744 (keeping 200 days of data) [2025-09-30T19:40:16.249885] [DEBUG] [LOCAL ] LEA: Primary data saved (41744 records). [2025-09-30T19:40:16.250052] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-30T19:40:16.250188] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 30.9s. Estimated remaining: 2h 23m 41s. Rate: 7.8 symbols/min [2025-09-30T19:40:16.255768] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-30T19:40:16.482728] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:16.546453] [DEBUG] [LOCAL ] LEVI: Loaded 51512 existing records from primary storage. [2025-09-30T19:40:16.546919] [INFO ] [MAIN ] LEVI: Loaded 51512 existing records. [2025-09-30T19:40:16.688353] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T19:40:16.757552] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:40:16.846604] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:16.846823] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-30T19:40:16.846871] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-30T19:40:16.847177] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-30T19:40:16.847236] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-30T19:40:17.059594] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-30T19:40:17.238726] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:17.813142] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:40:17.854391] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-30T19:40:18.654374] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-30T19:40:18.975244] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T19:40:19.454323] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-30T19:40:19.497052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:40:19.549270] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:40:20.254373] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-30T19:40:21.054329] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-30T19:40:21.118830] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:40:21.741224] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:40:21.854316] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-30T19:40:22.245632] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:40:22.654423] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-30T19:40:23.454571] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-30T19:40:23.603771] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T19:40:23.611187] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:40:24.254374] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-30T19:40:25.054328] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-30T19:40:25.601127] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T19:40:25.854422] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-30T19:40:25.910807] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:40:26.033910] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T19:40:26.654415] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-30T19:40:27.454350] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-30T19:40:27.545947] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:40:27.614430] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:40:28.254426] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-30T19:40:29.054405] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-30T19:40:29.854349] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-30T19:40:29.902915] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T19:40:29.914700] [INFO ] [REMOTE ] LEN: Full fetch complete (77039 records). [2025-09-30T19:40:29.914915] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-30T19:40:30.065972] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T19:40:30.171945] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:40:30.445038] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-30T19:40:30.445136] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-30T19:40:30.446157] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-30T19:40:30.446238] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-30T19:40:30.447839] [DEBUG] [LOCAL ] LEN: Trimmed 77039 records to 53188 (keeping 200 days of data) [2025-09-30T19:40:30.679810] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-30T19:40:30.811366] [DEBUG] [LOCAL ] LEN: Primary data saved (53188 records). [2025-09-30T19:40:30.811525] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-30T19:40:30.812097] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEN took 34.6s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-09-30T19:40:31.015072] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:31.036320] [DEBUG] [LOCAL ] LFT: Loaded 18238 existing records from primary storage. [2025-09-30T19:40:31.036593] [INFO ] [MAIN ] LFT: Loaded 18238 existing records. [2025-09-30T19:40:31.238848] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:31.239202] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-30T19:40:31.239452] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-30T19:40:31.239828] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-30T19:40:31.239893] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-30T19:40:31.461174] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-30T19:40:31.513191] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:40:31.714018] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:31.725356] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:40:31.729527] [INFO ] [REMOTE ] LEO: Full fetch complete (27010 records). [2025-09-30T19:40:31.729671] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-30T19:40:32.138950] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-30T19:40:32.139042] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-30T19:40:32.139692] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-30T19:40:32.139757] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-30T19:40:32.140536] [DEBUG] [LOCAL ] LEO: Trimmed 27010 records to 17325 (keeping 200 days of data) [2025-09-30T19:40:32.250919] [DEBUG] [LOCAL ] LEO: Primary data saved (17325 records). [2025-09-30T19:40:32.251072] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-30T19:40:32.251158] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 24.2s. Estimated remaining: 2h 23m 26s. Rate: 7.8 symbols/min [2025-09-30T19:40:32.263434] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-30T19:40:32.454615] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:32.468512] [DEBUG] [LOCAL ] LGI: Loaded 9870 existing records from primary storage. [2025-09-30T19:40:32.468884] [INFO ] [MAIN ] LGI: Loaded 9870 existing records. [2025-09-30T19:40:32.684961] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:32.685207] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-30T19:40:32.685257] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-30T19:40:32.685437] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-30T19:40:32.685497] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-30T19:40:33.061415] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-30T19:40:33.092700] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:33.340300] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:40:33.509915] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T19:40:33.854382] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-30T19:40:34.574264] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:40:34.654379] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-30T19:40:35.039980] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-30T19:40:35.454372] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-30T19:40:36.254374] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-30T19:40:36.335906] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:40:36.896019] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:40:36.909545] [INFO ] [REMOTE ] LEG: Full fetch complete (73158 records). [2025-09-30T19:40:36.909750] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-30T19:40:37.055418] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-30T19:40:37.274898] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:40:37.374722] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-30T19:40:37.374851] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-30T19:40:37.375841] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-30T19:40:37.375934] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-30T19:40:37.377488] [DEBUG] [LOCAL ] LEG: Trimmed 73158 records to 50291 (keeping 200 days of data) [2025-09-30T19:40:37.706421] [DEBUG] [LOCAL ] LEG: Primary data saved (50291 records). [2025-09-30T19:40:37.706567] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-30T19:40:37.706736] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEG took 42.6s. Estimated remaining: 2h 23m 16s. Rate: 7.8 symbols/min [2025-09-30T19:40:37.866842] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-30T19:40:37.902238] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:37.943010] [DEBUG] [LOCAL ] LH: Loaded 37834 existing records from primary storage. [2025-09-30T19:40:37.943310] [INFO ] [MAIN ] LH: Loaded 37834 existing records. [2025-09-30T19:40:38.145875] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:38.146162] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-30T19:40:38.146218] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-30T19:40:38.146616] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-30T19:40:38.146726] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-30T19:40:38.565219] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:38.600828] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:40:38.654379] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-30T19:40:38.760884] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:40:39.454365] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-30T19:40:40.116197] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T19:40:40.254364] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-30T19:40:40.378177] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T19:40:41.054431] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-30T19:40:41.836248] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:40:41.854321] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-30T19:40:41.876371] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T19:40:42.654380] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-30T19:40:43.384934] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:40:43.400231] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:40:43.454405] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-30T19:40:44.254430] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-30T19:40:45.054364] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-30T19:40:45.434368] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:40:45.459688] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:40:45.854382] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-30T19:40:46.450589] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:40:46.654381] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-30T19:40:46.736258] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:40:47.454383] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-30T19:40:48.254360] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-30T19:40:48.312634] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:40:48.414609] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:40:48.808725] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T19:40:49.054385] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-30T19:40:49.799463] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:40:49.854363] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-30T19:40:50.621282] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:40:50.654397] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-30T19:40:51.454415] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-30T19:40:51.984248] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T19:40:52.254338] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-30T19:40:52.296150] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:40:53.035504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:40:53.054358] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-30T19:40:53.854394] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-30T19:40:54.594479] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:40:54.654406] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-30T19:40:55.073555] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:40:55.454371] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-30T19:40:56.254374] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-30T19:40:56.561235] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T19:40:56.577811] [INFO ] [REMOTE ] LEVI: Full fetch complete (74446 records). [2025-09-30T19:40:56.577996] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-30T19:40:57.025845] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-30T19:40:57.026052] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-30T19:40:57.027202] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-30T19:40:57.027285] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-30T19:40:57.058938] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-30T19:40:57.060571] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:40:57.066142] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:40:57.077070] [DEBUG] [LOCAL ] LEVI: Trimmed 74446 records to 51554 (keeping 200 days of data) [2025-09-30T19:40:57.082227] [INFO ] [REMOTE ] LGI: Full fetch complete (14293 records). [2025-09-30T19:40:57.082355] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-30T19:40:57.610706] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-30T19:40:57.611079] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-30T19:40:57.611906] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-30T19:40:57.611989] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-30T19:40:57.615132] [DEBUG] [LOCAL ] LGI: Trimmed 14293 records to 9828 (keeping 200 days of data) [2025-09-30T19:40:57.802139] [DEBUG] [LOCAL ] LGI: Primary data saved (9828 records). [2025-09-30T19:40:57.803116] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-30T19:40:57.803258] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 25.6s. Estimated remaining: 2h 23m 19s. Rate: 7.8 symbols/min [2025-09-30T19:40:57.856111] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-30T19:40:58.012194] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:58.118285] [DEBUG] [LOCAL ] LEVI: Primary data saved (51554 records). [2025-09-30T19:40:58.118445] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-30T19:40:58.118535] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 41.9s. Estimated remaining: 2h 23m 5s. Rate: 7.8 symbols/min [2025-09-30T19:40:58.246490] [DEBUG] [LOCAL ] LHX: Loaded 48649 existing records from primary storage. [2025-09-30T19:40:58.262819] [INFO ] [MAIN ] LHX: Loaded 48649 existing records. [2025-09-30T19:40:58.353153] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:58.394990] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:40:58.557806] [DEBUG] [LOCAL ] LII: Loaded 27955 existing records from primary storage. [2025-09-30T19:40:58.563773] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:58.564065] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-30T19:40:58.564157] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-30T19:40:58.564405] [INFO ] [MAIN ] LII: Loaded 27955 existing records. [2025-09-30T19:40:58.598912] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-30T19:40:58.633293] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-30T19:40:58.655534] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-30T19:40:58.882756] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:58.883314] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-30T19:40:58.893934] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-30T19:40:58.925123] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-30T19:40:58.936444] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-30T19:40:59.430970] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:59.457270] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-30T19:40:59.599564] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:59.630660] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:40:59.788249] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:41:00.254359] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-30T19:41:01.054363] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-30T19:41:01.211273] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T19:41:01.499233] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:41:01.854392] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-30T19:41:02.469942] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:41:02.654326] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-30T19:41:02.884313] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:41:02.888393] [INFO ] [REMOTE ] LFT: Full fetch complete (24105 records). [2025-09-30T19:41:02.888494] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-30T19:41:03.407703] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-30T19:41:03.407822] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-30T19:41:03.408417] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-30T19:41:03.408485] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-30T19:41:03.409902] [DEBUG] [LOCAL ] LFT: Trimmed 24105 records to 18306 (keeping 200 days of data) [2025-09-30T19:41:03.465883] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-30T19:41:03.549207] [DEBUG] [LOCAL ] LFT: Primary data saved (18306 records). [2025-09-30T19:41:03.549409] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-30T19:41:03.549596] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LFT took 32.7s. Estimated remaining: 2h 22m 56s. Rate: 7.8 symbols/min [2025-09-30T19:41:03.780666] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:03.826747] [DEBUG] [LOCAL ] LION: Loaded 43772 existing records from primary storage. [2025-09-30T19:41:03.827073] [INFO ] [MAIN ] LION: Loaded 43772 existing records. [2025-09-30T19:41:04.036119] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:04.036378] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-30T19:41:04.036449] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-30T19:41:04.043490] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-30T19:41:04.052811] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-30T19:41:04.061742] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:41:04.168868] [INFO ] [REMOTE ] LH: Full fetch complete (54860 records). [2025-09-30T19:41:04.182296] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-30T19:41:04.257306] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-30T19:41:04.806121] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:04.906931] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-30T19:41:04.907024] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-30T19:41:04.907868] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-30T19:41:04.907968] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-30T19:41:04.909260] [DEBUG] [LOCAL ] LH: Trimmed 54860 records to 37822 (keeping 200 days of data) [2025-09-30T19:41:05.093910] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-30T19:41:05.170467] [DEBUG] [LOCAL ] LH: Primary data saved (37822 records). [2025-09-30T19:41:05.170745] [INFO ] [MAIN ] LH: Full history saved. [2025-09-30T19:41:05.170853] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 27.5s. Estimated remaining: 2h 22m 42s. Rate: 7.8 symbols/min [2025-09-30T19:41:05.388066] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:05.388725] [DEBUG] [LOCAL ] LITB: No existing data file found in primary storage. [2025-09-30T19:41:05.388803] [WARN ] [MAIN ] LITB: No existing data found, performing full refresh instead. [2025-09-30T19:41:05.389121] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-30T19:41:05.389345] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-30T19:41:05.389682] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-09-30T19:41:05.389790] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-30T19:41:05.660449] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:41:05.861193] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:05.857936] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-30T19:41:05.887927] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T19:41:05.905766] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:41:06.654458] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-30T19:41:07.149585] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T19:41:07.454415] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-30T19:41:07.537467] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:41:07.948274] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T19:41:08.254362] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-30T19:41:09.054375] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-30T19:41:09.854339] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-30T19:41:09.969009] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T19:41:10.370613] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:41:10.654365] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-30T19:41:10.679924] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T19:41:11.133136] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T19:41:11.454397] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-30T19:41:12.254437] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-30T19:41:12.911693] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:41:13.054360] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-30T19:41:13.088215] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T19:41:13.854469] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-30T19:41:14.654478] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-30T19:41:14.876601] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:41:15.219814] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T19:41:15.362468] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T19:41:15.454388] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-30T19:41:16.254406] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-30T19:41:17.052218] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:41:17.066608] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-30T19:41:17.701856] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:41:17.743969] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:41:17.854353] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-30T19:41:18.654360] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-30T19:41:19.128326] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T19:41:19.146877] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:41:19.454408] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-30T19:41:19.740954] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T19:41:20.254399] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-30T19:41:21.054382] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-30T19:41:21.849324] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:41:21.859680] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-30T19:41:22.168543] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T19:41:22.318556] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T19:41:22.654351] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-30T19:41:23.454365] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-30T19:41:24.088238] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:41:24.254381] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-30T19:41:24.483917] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:41:25.054343] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-30T19:41:25.408432] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:41:25.854376] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-30T19:41:26.284813] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T19:41:26.654395] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-30T19:41:27.089771] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T19:41:27.100276] [INFO ] [REMOTE ] LHX: Full fetch complete (70797 records). [2025-09-30T19:41:27.100451] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-30T19:41:27.456392] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-30T19:41:27.474750] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T19:41:27.494589] [INFO ] [REMOTE ] LITB: Full fetch complete (5625 records). [2025-09-30T19:41:27.519860] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-30T19:41:27.570608] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-30T19:41:27.570771] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-30T19:41:27.571755] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-30T19:41:27.571841] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-30T19:41:27.689609] [DEBUG] [LOCAL ] LHX: Trimmed 70797 records to 48643 (keeping 200 days of data) [2025-09-30T19:41:28.110249] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-30T19:41:28.110577] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-30T19:41:28.110809] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-30T19:41:28.110891] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-30T19:41:28.113281] [DEBUG] [LOCAL ] LITB: Trimmed 5625 records to 4352 (keeping 200 days of data) [2025-09-30T19:41:28.150012] [DEBUG] [LOCAL ] LITB: Primary data saved (4352 records). [2025-09-30T19:41:28.150982] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-30T19:41:28.151338] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LITB took 23.0s. Estimated remaining: 2h 22m 48s. Rate: 7.8 symbols/min [2025-09-30T19:41:28.259917] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-30T19:41:28.374761] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:28.607110] [DEBUG] [LOCAL ] LLY: Loaded 53280 existing records from primary storage. [2025-09-30T19:41:28.609298] [INFO ] [MAIN ] LLY: Loaded 53280 existing records. [2025-09-30T19:41:28.835930] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:28.837204] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-30T19:41:28.837575] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-30T19:41:28.838725] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-30T19:41:28.839048] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-30T19:41:28.877170] [DEBUG] [LOCAL ] LHX: Primary data saved (48643 records). [2025-09-30T19:41:28.913372] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-30T19:41:28.926865] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 31.1s. Estimated remaining: 2h 22m 34s. Rate: 7.8 symbols/min [2025-09-30T19:41:29.306430] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:29.468174] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:29.512144] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-30T19:41:29.516190] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-30T19:41:29.563312] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:41:29.589185] [DEBUG] [LOCAL ] LMND: Loaded 51875 existing records from primary storage. [2025-09-30T19:41:29.589598] [INFO ] [MAIN ] LMND: Loaded 51875 existing records. [2025-09-30T19:41:29.782290] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:29.782531] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-30T19:41:29.782580] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-30T19:41:29.783166] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-30T19:41:29.783245] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-30T19:41:29.859504] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-30T19:41:30.201513] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:30.654386] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-30T19:41:31.119569] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:41:31.454413] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-30T19:41:32.065071] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-30T19:41:32.254403] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-30T19:41:32.410736] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:41:33.054364] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-30T19:41:33.129075] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:41:33.854368] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-30T19:41:34.654369] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-30T19:41:34.707803] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-30T19:41:34.814070] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:41:35.454368] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-30T19:41:35.627576] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:41:35.871725] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:41:35.878331] [INFO ] [REMOTE ] LII: Full fetch complete (41301 records). [2025-09-30T19:41:35.878496] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-30T19:41:36.262606] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-30T19:41:36.310623] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-30T19:41:36.310808] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-30T19:41:36.311671] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-30T19:41:36.311743] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-30T19:41:36.312900] [DEBUG] [LOCAL ] LII: Trimmed 41301 records to 27966 (keeping 200 days of data) [2025-09-30T19:41:36.514952] [DEBUG] [LOCAL ] LII: Primary data saved (27966 records). [2025-09-30T19:41:36.515136] [INFO ] [MAIN ] LII: Full history saved. [2025-09-30T19:41:36.515230] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LII took 38.4s. Estimated remaining: 2h 22m 27s. Rate: 7.8 symbols/min [2025-09-30T19:41:36.699770] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:36.758478] [DEBUG] [LOCAL ] LMT: Loaded 49839 existing records from primary storage. [2025-09-30T19:41:36.758853] [INFO ] [MAIN ] LMT: Loaded 49839 existing records. [2025-09-30T19:41:36.947874] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:36.948136] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-30T19:41:36.948197] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-30T19:41:36.948946] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-30T19:41:36.949011] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-30T19:41:37.059537] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-30T19:41:37.354134] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:37.433570] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:41:37.854373] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-30T19:41:37.987789] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:41:38.654417] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-30T19:41:39.045715] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T19:41:39.454383] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-30T19:41:40.254485] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-30T19:41:40.304439] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:41:40.317359] [INFO ] [REMOTE ] LION: Full fetch complete (54787 records). [2025-09-30T19:41:40.317669] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-30T19:41:40.519852] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-30T19:41:40.829950] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-30T19:41:40.830202] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-30T19:41:40.831354] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-30T19:41:40.831463] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-30T19:41:40.833460] [DEBUG] [LOCAL ] LION: Trimmed 54787 records to 44032 (keeping 200 days of data) [2025-09-30T19:41:40.959621] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:41:41.077176] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-30T19:41:41.138598] [DEBUG] [LOCAL ] LION: Primary data saved (44032 records). [2025-09-30T19:41:41.138780] [INFO ] [MAIN ] LION: Full history saved. [2025-09-30T19:41:41.139363] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 37.6s. Estimated remaining: 2h 22m 16s. Rate: 7.8 symbols/min [2025-09-30T19:41:41.329780] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:41.388381] [DEBUG] [LOCAL ] LNC: Loaded 51612 existing records from primary storage. [2025-09-30T19:41:41.388763] [INFO ] [MAIN ] LNC: Loaded 51612 existing records. [2025-09-30T19:41:41.606109] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:41.606388] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-30T19:41:41.606450] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-30T19:41:41.606948] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-30T19:41:41.607009] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-30T19:41:41.863476] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-30T19:41:42.014285] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:42.284013] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T19:41:42.654371] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-30T19:41:43.270938] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-30T19:41:43.454402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-30T19:41:43.781539] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:41:44.254346] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-30T19:41:44.347241] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T19:41:45.054385] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-30T19:41:45.854335] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-30T19:41:46.070559] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:41:46.114692] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-30T19:41:46.276110] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:41:46.654372] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-30T19:41:47.454426] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-30T19:41:47.842627] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T19:41:48.254359] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-30T19:41:49.054359] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-30T19:41:49.116168] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T19:41:49.546502] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T19:41:49.628861] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T19:41:49.854363] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-30T19:41:50.654406] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-30T19:41:51.222686] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T19:41:51.454450] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-30T19:41:52.254392] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-30T19:41:52.326762] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:41:52.447460] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-30T19:41:53.054391] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-30T19:41:53.116617] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:41:53.854336] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-30T19:41:54.264406] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:41:54.654562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-30T19:41:54.875236] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:41:55.454436] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-30T19:41:56.079805] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-30T19:41:56.254402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-30T19:41:56.778440] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T19:41:56.963707] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:41:57.054354] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-30T19:41:57.854386] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-30T19:41:58.639988] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T19:41:58.654386] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-30T19:41:59.224891] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T19:41:59.237671] [INFO ] [REMOTE ] LMND: Full fetch complete (75300 records). [2025-09-30T19:41:59.237846] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-30T19:41:59.467732] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-30T19:41:59.675510] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-30T19:41:59.675668] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-30T19:41:59.676679] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-30T19:41:59.676891] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-30T19:41:59.678602] [DEBUG] [LOCAL ] LMND: Trimmed 75300 records to 51876 (keeping 200 days of data) [2025-09-30T19:41:59.794342] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:42:00.035086] [DEBUG] [LOCAL ] LMND: Primary data saved (51876 records). [2025-09-30T19:42:00.035232] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-30T19:42:00.035329] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 31.1s. Estimated remaining: 2h 22m 18s. Rate: 7.8 symbols/min [2025-09-30T19:42:00.230230] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:00.238761] [DEBUG] [LOCAL ] LND: Loaded 4918 existing records from primary storage. [2025-09-30T19:42:00.239043] [INFO ] [MAIN ] LND: Loaded 4918 existing records. [2025-09-30T19:42:00.261789] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-30T19:42:00.448404] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:00.448760] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-30T19:42:00.448978] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-30T19:42:00.449524] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-30T19:42:00.449599] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-30T19:42:00.857712] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:00.891867] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T19:42:01.054356] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-30T19:42:01.854343] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-30T19:42:01.969506] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-30T19:42:01.985965] [INFO ] [REMOTE ] LLY: Full fetch complete (77263 records). [2025-09-30T19:42:01.986184] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-30T19:42:02.433382] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-30T19:42:02.433519] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-30T19:42:02.434841] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-30T19:42:02.435008] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-30T19:42:02.440974] [DEBUG] [LOCAL ] LLY: Trimmed 77263 records to 53281 (keeping 200 days of data) [2025-09-30T19:42:02.596797] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-30T19:42:02.698845] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-30T19:42:02.848310] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:42:02.877545] [DEBUG] [LOCAL ] LLY: Primary data saved (53281 records). [2025-09-30T19:42:02.877722] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-30T19:42:02.877895] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 34.7s. Estimated remaining: 2h 22m 6s. Rate: 7.8 symbols/min [2025-09-30T19:42:03.058057] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:03.123053] [DEBUG] [LOCAL ] LNG: Loaded 51428 existing records from primary storage. [2025-09-30T19:42:03.123433] [INFO ] [MAIN ] LNG: Loaded 51428 existing records. [2025-09-30T19:42:03.322463] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:03.322708] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-30T19:42:03.322764] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-30T19:42:03.323605] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-30T19:42:03.323718] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-30T19:42:03.464966] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-30T19:42:03.919832] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T19:42:03.926542] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:04.154369] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:42:04.254319] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-30T19:42:04.450832] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T19:42:05.054371] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-30T19:42:05.854357] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-30T19:42:06.401398] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T19:42:06.482334] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:42:06.654360] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-30T19:42:07.454367] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-30T19:42:07.680512] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:42:07.895469] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T19:42:08.254350] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-30T19:42:08.851906] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:42:08.862725] [INFO ] [REMOTE ] LMT: Full fetch complete (72507 records). [2025-09-30T19:42:08.862886] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-30T19:42:09.055505] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-30T19:42:09.285741] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-30T19:42:09.285870] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-30T19:42:09.287013] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-30T19:42:09.287084] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-30T19:42:09.288680] [DEBUG] [LOCAL ] LMT: Trimmed 72507 records to 49835 (keeping 200 days of data) [2025-09-30T19:42:09.617587] [DEBUG] [LOCAL ] LMT: Primary data saved (49835 records). [2025-09-30T19:42:09.617781] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-30T19:42:09.617914] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 33.1s. Estimated remaining: 2h 21m 58s. Rate: 7.8 symbols/min [2025-09-30T19:42:09.800120] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:09.814219] [DEBUG] [LOCAL ] LNN: Loaded 11213 existing records from primary storage. [2025-09-30T19:42:09.814449] [INFO ] [MAIN ] LNN: Loaded 11213 existing records. [2025-09-30T19:42:09.871748] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-30T19:42:10.008595] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:10.008938] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-30T19:42:10.009096] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-30T19:42:10.009409] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-30T19:42:10.009510] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-30T19:42:10.353449] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T19:42:10.407275] [INFO ] [REMOTE ] LNC: Full fetch complete (74159 records). [2025-09-30T19:42:10.424066] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-30T19:42:10.446607] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:10.651478] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:42:10.675770] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-30T19:42:10.914565] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-30T19:42:10.914799] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-30T19:42:10.916005] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-30T19:42:10.916104] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-30T19:42:10.918007] [DEBUG] [LOCAL ] LNC: Trimmed 74159 records to 51615 (keeping 200 days of data) [2025-09-30T19:42:11.043847] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T19:42:11.288886] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T19:42:11.306510] [DEBUG] [LOCAL ] LNC: Primary data saved (51615 records). [2025-09-30T19:42:11.306694] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-30T19:42:11.308916] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 30.2s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-09-30T19:42:11.463693] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-30T19:42:11.494702] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:11.544090] [DEBUG] [LOCAL ] LOAR: Loaded 41633 existing records from primary storage. [2025-09-30T19:42:11.544505] [INFO ] [MAIN ] LOAR: Loaded 41633 existing records. [2025-09-30T19:42:11.737257] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:11.737490] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-30T19:42:11.737540] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-30T19:42:11.738015] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-30T19:42:11.738103] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-30T19:42:12.137313] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:12.214599] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:42:12.254327] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-30T19:42:12.886936] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T19:42:13.054366] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-30T19:42:13.854370] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-30T19:42:14.654348] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-30T19:42:14.975302] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T19:42:15.352834] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:42:15.454365] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-30T19:42:15.487021] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T19:42:16.254388] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-30T19:42:17.054374] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-30T19:42:17.351894] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:42:17.405129] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:42:17.854353] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-30T19:42:17.904146] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:42:18.500535] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T19:42:18.654359] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-30T19:42:19.330981] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:42:19.454355] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-30T19:42:20.254409] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-30T19:42:21.054363] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-30T19:42:21.383050] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T19:42:21.574521] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:42:21.854369] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-30T19:42:22.194607] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:42:22.654355] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-30T19:42:23.301891] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T19:42:23.454358] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-30T19:42:23.687076] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:42:24.254381] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-30T19:42:24.484326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:42:24.877536] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T19:42:25.054374] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-30T19:42:25.854377] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-30T19:42:26.579880] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:42:26.654448] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-30T19:42:27.454350] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-30T19:42:27.608897] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:42:27.714128] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T19:42:28.057679] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:42:28.254396] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-30T19:42:29.054341] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-30T19:42:29.854398] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-30T19:42:30.028738] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:42:30.638255] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:42:30.640621] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:42:30.654306] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-30T19:42:31.454378] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-30T19:42:31.482623] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T19:42:31.484546] [INFO ] [REMOTE ] LND: Full fetch complete (8508 records). [2025-09-30T19:42:31.484690] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-30T19:42:31.885557] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-30T19:42:31.885629] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-30T19:42:31.885878] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-30T19:42:31.885927] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-30T19:42:31.886337] [DEBUG] [LOCAL ] LND: Trimmed 8508 records to 4911 (keeping 200 days of data) [2025-09-30T19:42:31.913920] [DEBUG] [LOCAL ] LND: Primary data saved (4911 records). [2025-09-30T19:42:31.914021] [INFO ] [MAIN ] LND: Full history saved. [2025-09-30T19:42:31.914113] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 31.9s. Estimated remaining: 2h 21m 49s. Rate: 7.8 symbols/min [2025-09-30T19:42:32.111198] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:32.107809] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:42:32.146280] [DEBUG] [LOCAL ] LOB: Loaded 27432 existing records from primary storage. [2025-09-30T19:42:32.146549] [INFO ] [MAIN ] LOB: Loaded 27432 existing records. [2025-09-30T19:42:32.259725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-30T19:42:32.353572] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:32.353805] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-30T19:42:32.353854] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-30T19:42:32.354213] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-30T19:42:32.354285] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-30T19:42:32.747853] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:33.054391] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-30T19:42:33.337759] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:42:33.854345] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-30T19:42:34.217006] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:42:34.654408] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-30T19:42:34.708557] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T19:42:34.711724] [INFO ] [REMOTE ] LNN: Full fetch complete (15629 records). [2025-09-30T19:42:34.711877] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-30T19:42:35.159922] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-30T19:42:35.160024] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-30T19:42:35.160419] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-30T19:42:35.160491] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-30T19:42:35.161146] [DEBUG] [LOCAL ] LNN: Trimmed 15629 records to 11224 (keeping 200 days of data) [2025-09-30T19:42:35.234418] [DEBUG] [LOCAL ] LNN: Primary data saved (11224 records). [2025-09-30T19:42:35.234560] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-30T19:42:35.234684] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 25.6s. Estimated remaining: 2h 21m 37s. Rate: 7.8 symbols/min [2025-09-30T19:42:35.423107] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:35.428628] [DEBUG] [LOCAL ] LOCL: Loaded 3631 existing records from primary storage. [2025-09-30T19:42:35.428837] [INFO ] [MAIN ] LOCL: Loaded 3631 existing records. [2025-09-30T19:42:35.461014] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-30T19:42:35.621168] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:35.621424] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-30T19:42:35.621475] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-30T19:42:35.621717] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-30T19:42:35.621778] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-30T19:42:36.006055] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:36.254409] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-30T19:42:36.472531] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:42:37.054408] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-30T19:42:37.167261] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:42:37.222949] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:42:37.671221] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T19:42:37.854382] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-30T19:42:38.654401] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-30T19:42:38.919483] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:42:39.105727] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T19:42:39.454370] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-30T19:42:40.254383] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-30T19:42:40.938803] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:42:40.981556] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:42:41.054389] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-30T19:42:41.510322] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T19:42:41.854361] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-30T19:42:42.654389] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-30T19:42:43.163973] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:42:43.454404] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-30T19:42:44.254353] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-30T19:42:44.358713] [DEBUG] [REMOTE ] LOCL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T19:42:44.359017] [WARN ] [REMOTE ] LOCL: No data returned for month 2025-04 [2025-09-30T19:42:44.359125] [FATAL] [REMOTE ] LOCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:42:44.359203] [FATAL] [MAIN ] LOCL: Failed to fetch primary data. [2025-09-30T19:42:44.359267] [WARN ] [MAIN ] LOCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:42:44.359341] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-30T19:42:44.359406] [DEBUG] [LOCAL ] LOCL: No primary data file found to delete. [2025-09-30T19:42:44.359443] [INFO ] [LOCAL ] LOCL: Starting deletion of derivative data. [2025-09-30T19:42:44.359969] [DEBUG] [LOCAL ] LOCL: Deleted derivative data file. [2025-09-30T19:42:44.360071] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 9.1s. Estimated remaining: 2h 21m 31s. Rate: 7.8 symbols/min [2025-09-30T19:42:44.554254] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:44.589267] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:42:44.636348] [INFO ] [REMOTE ] LNG: Full fetch complete (74683 records). [2025-09-30T19:42:44.636987] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-30T19:42:44.656155] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:42:44.765238] [DEBUG] [LOCAL ] LOMA: Loaded 32012 existing records from primary storage. [2025-09-30T19:42:44.791567] [INFO ] [MAIN ] LOMA: Loaded 32012 existing records. [2025-09-30T19:42:45.059543] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-30T19:42:45.154110] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:45.203846] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-30T19:42:45.215733] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-30T19:42:45.221564] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-30T19:42:45.231946] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-30T19:42:45.437942] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-30T19:42:45.438127] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-30T19:42:45.439577] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-30T19:42:45.445133] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-30T19:42:45.517927] [DEBUG] [LOCAL ] LNG: Trimmed 74683 records to 51406 (keeping 200 days of data) [2025-09-30T19:42:45.855339] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-30T19:42:45.855268] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:46.093681] [DEBUG] [LOCAL ] LNG: Primary data saved (51406 records). [2025-09-30T19:42:46.093856] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-30T19:42:46.093955] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 43.2s. Estimated remaining: 2h 21m 18s. Rate: 7.8 symbols/min [2025-09-30T19:42:46.282438] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:46.338184] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:42:46.362929] [DEBUG] [LOCAL ] LOW: Loaded 52947 existing records from primary storage. [2025-09-30T19:42:46.363394] [INFO ] [MAIN ] LOW: Loaded 52947 existing records. [2025-09-30T19:42:46.558998] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:46.559309] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-30T19:42:46.559384] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-30T19:42:46.560089] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-30T19:42:46.560156] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-30T19:42:46.664313] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-30T19:42:46.943718] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:47.454367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-30T19:42:47.454276] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:42:47.465574] [INFO ] [REMOTE ] LOAR: Full fetch complete (56398 records). [2025-09-30T19:42:47.465813] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-30T19:42:47.697242] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T19:42:47.948702] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-30T19:42:47.949017] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-30T19:42:47.949991] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-30T19:42:47.950062] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-30T19:42:47.951449] [DEBUG] [LOCAL ] LOAR: Trimmed 56398 records to 41572 (keeping 200 days of data) [2025-09-30T19:42:48.224770] [DEBUG] [LOCAL ] LOAR: Primary data saved (41572 records). [2025-09-30T19:42:48.224930] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-30T19:42:48.225911] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 36.9s. Estimated remaining: 2h 21m 5s. Rate: 7.8 symbols/min [2025-09-30T19:42:48.260592] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-30T19:42:48.422509] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:48.473606] [DEBUG] [LOCAL ] LPG: Loaded 39930 existing records from primary storage. [2025-09-30T19:42:48.473961] [INFO ] [MAIN ] LPG: Loaded 39930 existing records. [2025-09-30T19:42:48.679227] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:48.679515] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-30T19:42:48.679567] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-30T19:42:48.679826] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-30T19:42:48.679885] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-30T19:42:49.078767] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-30T19:42:49.085119] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:49.428153] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T19:42:49.495430] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:42:49.854365] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-30T19:42:50.275275] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:42:50.654391] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-30T19:42:51.303270] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:42:51.454400] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-30T19:42:52.035406] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T19:42:52.254353] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-30T19:42:52.895926] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T19:42:53.054367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-30T19:42:53.513946] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:42:53.854344] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-30T19:42:54.654345] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-30T19:42:54.859327] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T19:42:55.454348] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-30T19:42:55.510771] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:42:55.511920] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:42:56.254400] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-30T19:42:56.756337] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:42:57.054370] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-30T19:42:57.770883] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:42:57.854356] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-30T19:42:58.654366] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-30T19:42:59.022338] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:42:59.332450] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:42:59.454359] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-30T19:42:59.584524] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T19:42:59.591034] [INFO ] [REMOTE ] LOB: Full fetch complete (37813 records). [2025-09-30T19:42:59.591282] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-30T19:43:00.028903] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-30T19:43:00.028992] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-30T19:43:00.029762] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-30T19:43:00.029828] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-30T19:43:00.030898] [DEBUG] [LOCAL ] LOB: Trimmed 37813 records to 27471 (keeping 200 days of data) [2025-09-30T19:43:00.225780] [DEBUG] [LOCAL ] LOB: Primary data saved (27471 records). [2025-09-30T19:43:00.225931] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-30T19:43:00.226045] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 28.3s. Estimated remaining: 2h 21m 1s. Rate: 7.8 symbols/min [2025-09-30T19:43:00.259603] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-30T19:43:00.428365] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:00.457479] [DEBUG] [LOCAL ] LPL: Loaded 26121 existing records from primary storage. [2025-09-30T19:43:00.457798] [INFO ] [MAIN ] LPL: Loaded 26121 existing records. [2025-09-30T19:43:00.651632] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:00.651862] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-30T19:43:00.651910] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-30T19:43:00.652373] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-30T19:43:00.652431] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-30T19:43:01.050591] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:01.054309] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-30T19:43:01.506954] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T19:43:01.836900] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T19:43:01.854313] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-30T19:43:02.252182] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:43:02.654381] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-30T19:43:03.214614] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T19:43:03.454381] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-30T19:43:03.960587] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:43:04.254362] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-30T19:43:04.880952] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:43:05.054357] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-30T19:43:05.556088] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:43:05.854358] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-30T19:43:06.654327] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-30T19:43:07.020194] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:43:07.048692] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T19:43:07.454361] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-30T19:43:07.670047] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:43:08.254429] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-30T19:43:09.055104] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-30T19:43:09.058472] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T19:43:09.720132] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:43:09.790785] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T19:43:09.854357] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-30T19:43:10.654367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-30T19:43:10.878923] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T19:43:11.454374] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-30T19:43:12.254343] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-30T19:43:12.397552] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T19:43:12.477925] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T19:43:13.054359] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-30T19:43:13.585051] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:43:13.854370] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-30T19:43:14.654344] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-30T19:43:14.815450] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:43:15.004430] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T19:43:15.454381] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-30T19:43:16.182123] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:43:16.254390] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-30T19:43:17.054625] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-30T19:43:17.354511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T19:43:17.721714] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:43:17.729811] [INFO ] [REMOTE ] LPG: Full fetch complete (59652 records). [2025-09-30T19:43:17.729962] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-30T19:43:17.859513] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-30T19:43:18.147635] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-30T19:43:18.147771] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-30T19:43:18.148984] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-30T19:43:18.149060] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-30T19:43:18.150560] [DEBUG] [LOCAL ] LPG: Trimmed 59652 records to 39874 (keeping 200 days of data) [2025-09-30T19:43:18.441978] [DEBUG] [LOCAL ] LPG: Primary data saved (39874 records). [2025-09-30T19:43:18.442187] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-30T19:43:18.443533] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPG took 30.2s. Estimated remaining: 2h 21m 3s. Rate: 7.8 symbols/min [2025-09-30T19:43:18.655459] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:18.655906] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-30T19:43:18.700968] [DEBUG] [LOCAL ] LPX: Loaded 39661 existing records from primary storage. [2025-09-30T19:43:18.701292] [INFO ] [MAIN ] LPX: Loaded 39661 existing records. [2025-09-30T19:43:18.938002] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:18.938798] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-30T19:43:18.950715] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-30T19:43:18.953506] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T19:43:18.954698] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:43:18.964080] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-30T19:43:18.969350] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-30T19:43:19.026955] [INFO ] [REMOTE ] LOMA: Full fetch complete (48081 records). [2025-09-30T19:43:19.045778] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-30T19:43:19.466250] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-30T19:43:19.956963] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:20.084346] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-30T19:43:20.084481] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-30T19:43:20.086047] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-30T19:43:20.086141] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-30T19:43:20.088268] [DEBUG] [LOCAL ] LOMA: Trimmed 48081 records to 32080 (keeping 200 days of data) [2025-09-30T19:43:20.256139] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-30T19:43:20.366322] [DEBUG] [LOCAL ] LOMA: Primary data saved (32080 records). [2025-09-30T19:43:20.366603] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-30T19:43:20.366767] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 36.0s. Estimated remaining: 2h 20m 50s. Rate: 7.8 symbols/min [2025-09-30T19:43:20.582351] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:20.636306] [DEBUG] [LOCAL ] LRN: Loaded 39826 existing records from primary storage. [2025-09-30T19:43:20.636680] [INFO ] [MAIN ] LRN: Loaded 39826 existing records. [2025-09-30T19:43:20.812399] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-30T19:43:20.911962] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:20.923006] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-30T19:43:20.917566] [INFO ] [REMOTE ] LOW: Full fetch complete (76509 records). [2025-09-30T19:43:20.931250] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-30T19:43:20.931061] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-30T19:43:20.933706] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:43:20.946524] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-30T19:43:20.993247] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-30T19:43:21.062818] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-30T19:43:21.854930] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-30T19:43:21.862195] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:21.862634] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-30T19:43:21.863123] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-30T19:43:21.864357] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-30T19:43:21.865462] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-30T19:43:21.868510] [DEBUG] [LOCAL ] LOW: Trimmed 76509 records to 52947 (keeping 200 days of data) [2025-09-30T19:43:22.013938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:43:22.262242] [DEBUG] [LOCAL ] LOW: Primary data saved (52947 records). [2025-09-30T19:43:22.262377] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-30T19:43:22.262466] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 36.2s. Estimated remaining: 2h 20m 37s. Rate: 7.8 symbols/min [2025-09-30T19:43:22.444817] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:22.488212] [DEBUG] [LOCAL ] LSPD: Loaded 42949 existing records from primary storage. [2025-09-30T19:43:22.488545] [INFO ] [MAIN ] LSPD: Loaded 42949 existing records. [2025-09-30T19:43:22.684284] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-30T19:43:22.684175] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:22.685346] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-30T19:43:22.685478] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-30T19:43:22.685769] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-30T19:43:22.685894] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-30T19:43:22.841049] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:43:23.122794] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:23.454334] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-30T19:43:23.544303] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:43:23.926595] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:43:24.254397] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-30T19:43:25.051727] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:43:25.059999] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-30T19:43:25.062078] [INFO ] [REMOTE ] LPL: Full fetch complete (35228 records). [2025-09-30T19:43:25.062164] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-30T19:43:25.471867] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-30T19:43:25.471959] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-30T19:43:25.472605] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-30T19:43:25.472676] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-30T19:43:25.473740] [DEBUG] [LOCAL ] LPL: Trimmed 35228 records to 26306 (keeping 200 days of data) [2025-09-30T19:43:25.643195] [DEBUG] [LOCAL ] LPL: Primary data saved (26306 records). [2025-09-30T19:43:25.643368] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-30T19:43:25.643466] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPL took 25.4s. Estimated remaining: 2h 20m 26s. Rate: 7.8 symbols/min [2025-09-30T19:43:25.846562] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:25.857627] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-30T19:43:25.861886] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:43:25.903751] [DEBUG] [LOCAL ] LTC: Loaded 29954 existing records from primary storage. [2025-09-30T19:43:25.904385] [INFO ] [MAIN ] LTC: Loaded 29954 existing records. [2025-09-30T19:43:26.094617] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:26.095415] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-30T19:43:26.095466] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-30T19:43:26.095806] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-30T19:43:26.095865] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-30T19:43:26.486149] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:26.586911] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:43:26.654357] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-30T19:43:27.201828] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T19:43:27.454333] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-30T19:43:27.576426] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T19:43:28.254409] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-30T19:43:29.054403] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-30T19:43:29.057502] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T19:43:29.530273] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T19:43:29.854368] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-30T19:43:30.587847] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:43:30.654370] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-30T19:43:31.448001] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:43:31.456406] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-30T19:43:31.845595] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T19:43:32.254360] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-30T19:43:32.815524] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:43:33.054395] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-30T19:43:33.853859] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:43:33.862390] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-30T19:43:34.265927] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:43:34.654348] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-30T19:43:35.455990] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-30T19:43:35.461164] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:43:35.753116] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T19:43:36.254353] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-30T19:43:36.592756] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:43:37.054378] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-30T19:43:37.350085] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:43:37.854375] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-30T19:43:38.499237] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:43:38.654433] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-30T19:43:39.069125] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:43:39.454369] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-30T19:43:40.260505] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-30T19:43:40.298397] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:43:41.030494] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:43:41.054316] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-30T19:43:41.168552] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T19:43:41.854373] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-30T19:43:42.609554] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T19:43:42.618610] [INFO ] [REMOTE ] LPX: Full fetch complete (58778 records). [2025-09-30T19:43:42.618860] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-30T19:43:42.659443] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-30T19:43:43.089905] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-30T19:43:43.090121] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-30T19:43:43.091250] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-30T19:43:43.091374] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-30T19:43:43.092894] [DEBUG] [LOCAL ] LPX: Trimmed 58778 records to 39672 (keeping 200 days of data) [2025-09-30T19:43:43.217495] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:43:43.394981] [DEBUG] [LOCAL ] LPX: Primary data saved (39672 records). [2025-09-30T19:43:43.395138] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-30T19:43:43.395967] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 25.0s. Estimated remaining: 2h 20m 27s. Rate: 7.8 symbols/min [2025-09-30T19:43:43.460895] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-30T19:43:43.576630] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:43.640215] [DEBUG] [LOCAL ] LTH: Loaded 51770 existing records from primary storage. [2025-09-30T19:43:43.640674] [INFO ] [MAIN ] LTH: Loaded 51770 existing records. [2025-09-30T19:43:43.832513] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:43.832769] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-30T19:43:43.832823] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-30T19:43:43.833183] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-30T19:43:43.833243] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-30T19:43:44.222402] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:44.249172] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:43:44.258747] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-30T19:43:44.892219] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T19:43:45.054358] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-30T19:43:45.743540] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:43:45.854378] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-30T19:43:46.236254] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:43:46.654355] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-30T19:43:47.344908] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T19:43:47.454359] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-30T19:43:48.098070] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:43:48.254353] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-30T19:43:48.650723] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:43:49.054367] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-30T19:43:49.700049] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:43:49.854341] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-30T19:43:50.659437] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-30T19:43:50.674950] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:43:51.028421] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:43:51.454358] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-30T19:43:52.147196] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:43:52.254368] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-30T19:43:52.800366] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:43:53.054368] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-30T19:43:53.764683] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:43:53.854347] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-30T19:43:54.250278] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T19:43:54.259372] [INFO ] [REMOTE ] LSPD: Full fetch complete (61599 records). [2025-09-30T19:43:54.259520] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-30T19:43:54.659684] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-30T19:43:54.680597] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-30T19:43:54.680709] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-30T19:43:54.681776] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-30T19:43:54.681841] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-30T19:43:54.683176] [DEBUG] [LOCAL ] LSPD: Trimmed 61599 records to 42882 (keeping 200 days of data) [2025-09-30T19:43:54.957280] [DEBUG] [LOCAL ] LSPD: Primary data saved (42882 records). [2025-09-30T19:43:54.957425] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-30T19:43:54.957516] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LSPD took 32.7s. Estimated remaining: 2h 20m 22s. Rate: 7.8 symbols/min [2025-09-30T19:43:55.065247] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T19:43:55.454390] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-30T19:43:56.254403] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-30T19:43:56.355254] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:43:56.364421] [INFO ] [REMOTE ] LRN: Full fetch complete (58442 records). [2025-09-30T19:43:56.364568] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-30T19:43:56.787443] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-30T19:43:56.787614] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-30T19:43:56.788547] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-30T19:43:56.788669] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-30T19:43:56.790184] [DEBUG] [LOCAL ] LRN: Trimmed 58442 records to 39818 (keeping 200 days of data) [2025-09-30T19:43:56.903324] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:43:56.913877] [INFO ] [REMOTE ] LTC: Full fetch complete (43384 records). [2025-09-30T19:43:56.919699] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-30T19:43:57.471086] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-30T19:43:57.471491] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-30T19:43:57.474165] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-30T19:43:57.474519] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-30T19:43:57.478977] [DEBUG] [LOCAL ] LTC: Trimmed 43384 records to 30125 (keeping 200 days of data) [2025-09-30T19:43:57.609017] [DEBUG] [LOCAL ] LRN: Primary data saved (39818 records). [2025-09-30T19:43:57.609240] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-30T19:43:57.609637] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LRN took 37.2s. Estimated remaining: 2h 20m 10s. Rate: 7.8 symbols/min [2025-09-30T19:43:57.702634] [DEBUG] [LOCAL ] LTC: Primary data saved (30125 records). [2025-09-30T19:43:57.702876] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-30T19:43:57.703113] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTC took 32.1s. Estimated remaining: 2h 19m 56s. Rate: 7.8 symbols/min [2025-09-30T19:43:57.740123] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:43:57.752090] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-30T19:43:59.473530] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:43:59.485451] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-30T19:44:01.315575] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:44:01.326900] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-30T19:44:02.905966] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:44:02.917862] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-30T19:44:04.475753] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:44:04.487396] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-30T19:44:05.807548] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:44:05.819714] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-30T19:44:07.621139] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:44:07.632907] [INFO ] [REMOTE ] LTH: Full fetch complete (74124 records). [2025-09-30T19:44:07.633090] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-30T19:44:08.109266] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-30T19:44:08.109444] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-30T19:44:08.110447] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-30T19:44:08.110567] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-30T19:44:08.112218] [DEBUG] [LOCAL ] LTH: Trimmed 74124 records to 51759 (keeping 200 days of data) [2025-09-30T19:44:08.466936] [DEBUG] [LOCAL ] LTH: Primary data saved (51759 records). [2025-09-30T19:44:08.467134] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-30T19:44:08.474501] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 25.1s. Estimated remaining: 2h 19m 51s. Rate: 7.8 symbols/min [2025-09-30T19:44:09.214272] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.231223] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.265972] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.278291] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.279177] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-30T19:44:09.279249] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-30T19:44:09.279358] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-30T19:44:09.279398] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-30T19:44:09.279440] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-30T19:44:09.279473] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-30T19:44:09.584851] [DEBUG] [LOCAL ] LTM: Loaded 36751 existing records from primary storage. [2025-09-30T19:44:09.647267] [INFO ] [MAIN ] LTM: Loaded 36751 existing records. [2025-09-30T19:44:09.653724] [DEBUG] [LOCAL ] LU: Loaded 48923 existing records from primary storage. [2025-09-30T19:44:09.700737] [INFO ] [MAIN ] LU: Loaded 48923 existing records. [2025-09-30T19:44:09.723575] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-30T19:44:09.777308] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-30T19:44:10.225711] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:10.328770] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.258461] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-30T19:44:10.344543] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.374474] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-30T19:44:10.432550] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.461329] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.473296] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-30T19:44:10.477695] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.469523] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-30T19:44:10.478178] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.478384] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-30T19:44:10.478275] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-30T19:44:10.478630] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-30T19:44:10.483948] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-30T19:44:10.484088] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-30T19:44:10.502192] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-30T19:44:11.688495] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.734094] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-30T19:44:11.839378] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.844246] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.844691] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-30T19:44:11.845265] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-30T19:44:11.862170] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T19:44:11.867802] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-30T19:44:12.877635] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:44:12.885507] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-30T19:44:13.365401] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T19:44:13.383281] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-30T19:44:13.549377] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:44:13.565979] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-30T19:44:13.653538] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:44:13.672219] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-30T19:44:13.758012] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T19:44:13.764569] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-30T19:44:14.334486] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T19:44:14.342387] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-30T19:44:14.916719] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T19:44:14.922778] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-30T19:44:15.182626] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:44:15.193463] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-30T19:44:15.474895] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T19:44:15.486604] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-30T19:44:15.640102] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:44:15.646684] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-30T19:44:15.788888] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T19:44:15.795475] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-30T19:44:16.559285] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T19:44:16.569250] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-30T19:44:16.694822] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T19:44:16.704979] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-30T19:44:17.087739] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T19:44:17.095751] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-30T19:44:17.376974] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T19:44:17.388687] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-30T19:44:17.944452] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:44:17.950721] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-30T19:44:18.023011] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T19:44:18.263209] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:44:18.654361] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-30T19:44:18.765574] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:44:19.228425] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T19:44:19.454402] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-30T19:44:20.002148] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T19:44:20.254355] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-30T19:44:20.940363] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:44:21.054344] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-30T19:44:21.854472] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-30T19:44:21.957064] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:44:22.660497] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-30T19:44:22.698884] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:44:22.990922] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:44:23.454372] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-30T19:44:24.142251] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T19:44:24.162897] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:44:24.254383] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-30T19:44:25.054371] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-30T19:44:25.854373] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-30T19:44:25.962307] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:44:25.968897] [INFO ] [REMOTE ] LUCK: Full fetch complete (41087 records). [2025-09-30T19:44:25.969146] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-30T19:44:26.133279] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:44:26.250189] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:44:26.250995] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:44:26.251100] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:44:26.251233] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-30T19:44:26.251340] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-30T19:44:26.251410] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-30T19:44:26.251494] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-30T19:44:26.251728] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 17.8s. Estimated remaining: 2h 19m 52s. Rate: 7.8 symbols/min [2025-09-30T19:44:26.455170] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:26.522730] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-30T19:44:26.523283] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-30T19:44:26.661862] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-30T19:44:26.743209] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:26.743551] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-30T19:44:26.743604] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-30T19:44:26.744199] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-30T19:44:26.744279] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-30T19:44:27.147990] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:27.192548] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:44:27.454405] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-30T19:44:28.254397] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-30T19:44:28.652446] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T19:44:29.048686] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:44:29.058721] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-30T19:44:29.768695] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:44:29.779480] [INFO ] [REMOTE ] LTM: Full fetch complete (47621 records). [2025-09-30T19:44:29.779682] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-30T19:44:29.859486] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-30T19:44:30.181938] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-30T19:44:30.182032] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-30T19:44:30.182825] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-30T19:44:30.182888] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-30T19:44:30.184043] [DEBUG] [LOCAL ] LTM: Trimmed 47621 records to 36826 (keeping 200 days of data) [2025-09-30T19:44:30.430000] [DEBUG] [LOCAL ] LTM: Primary data saved (36826 records). [2025-09-30T19:44:30.430213] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-30T19:44:30.430352] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LTM took 22.0s. Estimated remaining: 2h 19m 41s. Rate: 7.8 symbols/min [2025-09-30T19:44:30.660290] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-30T19:44:30.663954] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:30.665332] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-30T19:44:30.665468] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-30T19:44:30.665701] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-30T19:44:30.665775] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-30T19:44:30.666129] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-30T19:44:30.666201] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-30T19:44:30.886768] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:44:31.115097] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:31.452126] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:44:31.462480] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-30T19:44:31.978400] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:44:32.254418] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-30T19:44:32.486388] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:44:32.486838] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-30T19:44:32.486956] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:44:32.487043] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-30T19:44:32.487129] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:44:32.487224] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-30T19:44:32.487314] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-30T19:44:32.487407] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-30T19:44:32.487482] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-30T19:44:32.487549] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 19m 29s. Rate: 7.8 symbols/min [2025-09-30T19:44:32.685192] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:32.747125] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-30T19:44:32.747673] [INFO ] [MAIN ] LVS: Loaded 53564 existing records. [2025-09-30T19:44:32.955458] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:32.955752] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-30T19:44:32.955817] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-30T19:44:32.956185] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-30T19:44:32.956245] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-30T19:44:33.057270] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-30T19:44:33.363565] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:33.395155] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T19:44:33.854403] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-30T19:44:34.621501] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:44:34.654381] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-30T19:44:35.454374] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-30T19:44:35.980515] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T19:44:35.992946] [INFO ] [REMOTE ] LUMN: Full fetch complete (77635 records). [2025-09-30T19:44:35.993216] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-30T19:44:36.260338] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-30T19:44:36.446479] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-30T19:44:36.446637] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-30T19:44:36.447924] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-30T19:44:36.448012] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-30T19:44:36.465582] [DEBUG] [LOCAL ] LUMN: Trimmed 77635 records to 53634 (keeping 200 days of data) [2025-09-30T19:44:36.482373] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:44:36.834019] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-30T19:44:36.834185] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-30T19:44:36.834936] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 28.4s. Estimated remaining: 2h 19m 18s. Rate: 7.8 symbols/min [2025-09-30T19:44:37.042071] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:37.054423] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-30T19:44:37.068108] [DEBUG] [LOCAL ] LVWR: Loaded 17628 existing records from primary storage. [2025-09-30T19:44:37.068523] [INFO ] [MAIN ] LVWR: Loaded 17628 existing records. [2025-09-30T19:44:37.290075] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:37.290326] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-30T19:44:37.290398] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-30T19:44:37.290715] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-30T19:44:37.290844] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-30T19:44:37.741474] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:37.745434] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T19:44:37.796552] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:44:37.807968] [INFO ] [REMOTE ] LU: Full fetch complete (70404 records). [2025-09-30T19:44:37.808199] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-30T19:44:37.859524] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-30T19:44:38.265043] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-30T19:44:38.265136] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-30T19:44:38.266370] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-30T19:44:38.266467] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-30T19:44:38.268048] [DEBUG] [LOCAL ] LU: Trimmed 70404 records to 48947 (keeping 200 days of data) [2025-09-30T19:44:38.570785] [DEBUG] [LOCAL ] LU: Primary data saved (48947 records). [2025-09-30T19:44:38.571034] [INFO ] [MAIN ] LU: Full history saved. [2025-09-30T19:44:38.571160] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LU took 30.1s. Estimated remaining: 2h 19m 6s. Rate: 7.8 symbols/min [2025-09-30T19:44:38.664923] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-30T19:44:38.814766] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:38.884044] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T19:44:38.912744] [DEBUG] [LOCAL ] LW: Loaded 51154 existing records from primary storage. [2025-09-30T19:44:38.913507] [INFO ] [MAIN ] LW: Loaded 51154 existing records. [2025-09-30T19:44:39.108722] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:39.108972] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-30T19:44:39.109022] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-30T19:44:39.109353] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-30T19:44:39.109413] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-30T19:44:39.360249] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:44:39.467340] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-30T19:44:39.512878] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:39.711766] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T19:44:40.092215] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T19:44:40.254387] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-30T19:44:41.054360] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-30T19:44:41.448817] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T19:44:41.854342] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-30T19:44:42.288590] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T19:44:42.654371] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-30T19:44:43.207745] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T19:44:43.454340] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-30T19:44:43.643109] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:44:44.254386] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-30T19:44:44.816917] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T19:44:45.054375] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-30T19:44:45.854417] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-30T19:44:46.340668] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T19:44:46.654383] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-30T19:44:46.883225] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:44:47.229584] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:44:47.454368] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-30T19:44:48.254360] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-30T19:44:48.320933] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:44:48.958553] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:44:49.054359] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-30T19:44:49.812039] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:44:49.854411] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-30T19:44:50.479762] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:44:50.654372] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-30T19:44:51.316469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:44:51.424622] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:44:51.454326] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-30T19:44:52.254342] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-30T19:44:52.531524] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:44:53.054358] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-30T19:44:53.854343] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-30T19:44:54.192404] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:44:54.654382] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-30T19:44:55.238542] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T19:44:55.312832] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:44:55.454347] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-30T19:44:55.881863] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:44:56.254406] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-30T19:44:57.054375] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-30T19:44:57.100892] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:44:57.361289] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T19:44:57.854369] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-30T19:44:58.654356] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-30T19:44:58.782039] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:44:59.435180] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:44:59.458370] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-30T19:44:59.461542] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T19:45:00.254352] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-30T19:45:01.054404] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-30T19:45:01.675067] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:45:01.690148] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-30T19:45:01.690363] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-30T19:45:01.864207] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-30T19:45:02.151623] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-30T19:45:02.157232] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-30T19:45:02.164329] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-30T19:45:02.165474] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-30T19:45:02.166278] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T19:45:02.175419] [INFO ] [REMOTE ] LVWR: Full fetch complete (19918 records). [2025-09-30T19:45:02.175637] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-30T19:45:02.213726] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-30T19:45:02.680033] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-30T19:45:02.737370] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-30T19:45:02.844261] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-30T19:45:02.844705] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-30T19:45:02.845677] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-30T19:45:02.846039] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-30T19:45:02.849939] [DEBUG] [LOCAL ] LVWR: Trimmed 19918 records to 17657 (keeping 200 days of data) [2025-09-30T19:45:03.090396] [DEBUG] [LOCAL ] LVWR: Primary data saved (17657 records). [2025-09-30T19:45:03.091054] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-30T19:45:03.091390] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.3s. Estimated remaining: 2h 19m 12s. Rate: 7.8 symbols/min [2025-09-30T19:45:03.361466] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:03.389792] [DEBUG] [LOCAL ] LXFR: Loaded 16896 existing records from primary storage. [2025-09-30T19:45:03.391258] [INFO ] [MAIN ] LXFR: Loaded 16896 existing records. [2025-09-30T19:45:03.515306] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-30T19:45:03.515547] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-30T19:45:03.521450] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LUV took 37.3s. Estimated remaining: 2h 18m 58s. Rate: 7.8 symbols/min [2025-09-30T19:45:03.655609] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:03.695566] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-30T19:45:03.700884] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-30T19:45:03.716896] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-30T19:45:03.721353] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-30T19:45:03.885096] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:04.043142] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:45:04.131810] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-30T19:45:04.221418] [DEBUG] [LOCAL ] LXP: Loaded 50667 existing records from primary storage. [2025-09-30T19:45:04.254225] [INFO ] [MAIN ] LXP: Loaded 50667 existing records. [2025-09-30T19:45:04.322519] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:04.365404] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-30T19:45:04.539694] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:04.539995] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-30T19:45:04.555571] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-30T19:45:04.570196] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-30T19:45:04.571428] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:45:04.571553] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-30T19:45:04.990015] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:05.054428] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-30T19:45:05.512276] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:45:05.854356] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-30T19:45:06.111981] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:45:06.654386] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-30T19:45:07.110973] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T19:45:07.123208] [INFO ] [REMOTE ] LVS: Full fetch complete (77514 records). [2025-09-30T19:45:07.123411] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-30T19:45:07.457864] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-30T19:45:07.641834] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-30T19:45:07.641997] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-30T19:45:07.643297] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-30T19:45:07.643402] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-30T19:45:07.646897] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:45:07.663839] [DEBUG] [LOCAL ] LVS: Trimmed 77514 records to 53564 (keeping 200 days of data) [2025-09-30T19:45:08.113529] [DEBUG] [LOCAL ] LVS: Primary data saved (53564 records). [2025-09-30T19:45:08.113746] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-30T19:45:08.113875] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVS took 35.6s. Estimated remaining: 2h 18m 48s. Rate: 7.8 symbols/min [2025-09-30T19:45:08.254815] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-30T19:45:08.329282] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:08.374605] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:45:08.426564] [DEBUG] [LOCAL ] LXU: Loaded 31780 existing records from primary storage. [2025-09-30T19:45:08.427009] [INFO ] [MAIN ] LXU: Loaded 31780 existing records. [2025-09-30T19:45:08.686404] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:45:08.692372] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:08.697857] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-30T19:45:08.697945] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-30T19:45:08.698253] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-30T19:45:08.698315] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-30T19:45:09.070824] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-30T19:45:09.123702] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:09.854337] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-30T19:45:09.990396] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:45:10.074335] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T19:45:10.654365] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-30T19:45:11.454377] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-30T19:45:11.840002] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:45:11.851751] [INFO ] [REMOTE ] LW: Full fetch complete (74652 records). [2025-09-30T19:45:11.851929] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-30T19:45:12.289351] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-30T19:45:12.337553] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:45:12.357424] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-30T19:45:12.363040] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-30T19:45:12.391070] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-30T19:45:12.394541] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-30T19:45:12.397954] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:45:12.410320] [DEBUG] [LOCAL ] LW: Trimmed 74652 records to 51157 (keeping 200 days of data) [2025-09-30T19:45:12.792168] [DEBUG] [LOCAL ] LW: Primary data saved (51157 records). [2025-09-30T19:45:12.792324] [INFO ] [MAIN ] LW: Full history saved. [2025-09-30T19:45:12.792412] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 34.2s. Estimated remaining: 2h 18m 38s. Rate: 7.8 symbols/min [2025-09-30T19:45:13.003487] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:13.057250] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-30T19:45:13.059971] [DEBUG] [LOCAL ] LYB: Loaded 53599 existing records from primary storage. [2025-09-30T19:45:13.060685] [INFO ] [MAIN ] LYB: Loaded 53599 existing records. [2025-09-30T19:45:13.266196] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:13.266685] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-30T19:45:13.266834] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-30T19:45:13.267112] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-30T19:45:13.267172] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-30T19:45:13.558110] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T19:45:13.741333] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:13.854394] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-30T19:45:14.134544] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T19:45:14.654367] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-30T19:45:15.173581] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:45:15.454388] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-30T19:45:16.254346] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-30T19:45:16.411619] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:45:16.564329] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T19:45:17.054412] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-30T19:45:17.338120] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:45:17.854387] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-30T19:45:17.994110] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:45:18.654431] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-30T19:45:19.248510] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:45:19.454419] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-30T19:45:19.970372] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T19:45:20.254368] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-30T19:45:20.832899] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:45:21.054382] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-30T19:45:21.702426] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:45:21.854385] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-30T19:45:22.384551] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:45:22.654358] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-30T19:45:23.246846] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T19:45:23.454409] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-30T19:45:24.254427] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-30T19:45:24.575278] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:45:25.054367] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-30T19:45:25.194917] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T19:45:25.331436] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T19:45:25.854343] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-30T19:45:26.466173] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T19:45:26.654400] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-30T19:45:27.454370] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-30T19:45:27.820333] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T19:45:27.851787] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:45:28.254376] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-30T19:45:28.857560] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:45:28.983189] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T19:45:29.054391] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-30T19:45:29.854386] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-30T19:45:30.467409] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:45:30.654366] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-30T19:45:30.920062] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T19:45:30.923798] [INFO ] [REMOTE ] LXFR: Full fetch complete (25073 records). [2025-09-30T19:45:30.923928] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-30T19:45:31.332262] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-30T19:45:31.332342] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-30T19:45:31.332868] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-30T19:45:31.332930] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-30T19:45:31.333629] [DEBUG] [LOCAL ] LXFR: Trimmed 25073 records to 16855 (keeping 200 days of data) [2025-09-30T19:45:31.444636] [DEBUG] [LOCAL ] LXFR: Primary data saved (16855 records). [2025-09-30T19:45:31.444804] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-30T19:45:31.444891] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXFR took 28.4s. Estimated remaining: 2h 18m 39s. Rate: 7.8 symbols/min [2025-09-30T19:45:31.459571] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-30T19:45:31.676325] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:31.739357] [DEBUG] [LOCAL ] LYG: Loaded 52817 existing records from primary storage. [2025-09-30T19:45:31.739912] [INFO ] [MAIN ] LYG: Loaded 52817 existing records. [2025-09-30T19:45:31.940587] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:31.940873] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-30T19:45:31.940929] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-30T19:45:31.941328] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-30T19:45:31.941412] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-30T19:45:32.257297] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-30T19:45:32.352873] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:32.387007] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:45:32.895454] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:45:33.054374] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-30T19:45:33.854364] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-30T19:45:34.117250] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:45:34.402119] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:45:34.654392] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-30T19:45:35.331097] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:45:35.342042] [INFO ] [REMOTE ] LXP: Full fetch complete (72564 records). [2025-09-30T19:45:35.342230] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-30T19:45:35.457159] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-30T19:45:35.781957] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-30T19:45:35.782069] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-30T19:45:35.783354] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-30T19:45:35.783431] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-30T19:45:35.785045] [DEBUG] [LOCAL ] LXP: Trimmed 72564 records to 50687 (keeping 200 days of data) [2025-09-30T19:45:36.142309] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:45:36.167575] [DEBUG] [LOCAL ] LXP: Primary data saved (50687 records). [2025-09-30T19:45:36.167773] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-30T19:45:36.167913] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXP took 32.6s. Estimated remaining: 2h 18m 29s. Rate: 7.8 symbols/min [2025-09-30T19:45:36.259476] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-30T19:45:36.396738] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:36.463334] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-09-30T19:45:36.463705] [INFO ] [MAIN ] LYV: Loaded 51121 existing records. [2025-09-30T19:45:36.679103] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:36.679328] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-30T19:45:36.679379] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-30T19:45:36.680045] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-30T19:45:36.680106] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-30T19:45:37.092073] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:37.084356] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-30T19:45:37.258517] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:45:37.310867] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T19:45:37.854377] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-30T19:45:38.654414] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-30T19:45:38.849873] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:45:39.460047] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-30T19:45:39.475704] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T19:45:39.901009] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:45:39.909808] [INFO ] [REMOTE ] LXU: Full fetch complete (44884 records). [2025-09-30T19:45:39.910005] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-30T19:45:40.259486] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-30T19:45:40.352575] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-30T19:45:40.352714] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-30T19:45:40.353591] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-30T19:45:40.353683] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-30T19:45:40.354840] [DEBUG] [LOCAL ] LXU: Trimmed 44884 records to 31733 (keeping 200 days of data) [2025-09-30T19:45:40.542227] [DEBUG] [LOCAL ] LXU: Primary data saved (31733 records). [2025-09-30T19:45:40.542376] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-30T19:45:40.542467] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXU took 32.4s. Estimated remaining: 2h 18m 19s. Rate: 7.8 symbols/min [2025-09-30T19:45:40.733813] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:40.770538] [DEBUG] [LOCAL ] LZB: Loaded 35586 existing records from primary storage. [2025-09-30T19:45:40.770932] [INFO ] [MAIN ] LZB: Loaded 35586 existing records. [2025-09-30T19:45:40.992772] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:40.993026] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-30T19:45:40.993083] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-30T19:45:40.993397] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-30T19:45:40.993463] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-30T19:45:41.070163] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-30T19:45:41.413588] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:41.449670] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T19:45:41.854338] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-30T19:45:42.251369] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T19:45:42.473735] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T19:45:42.654387] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-30T19:45:43.454334] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-30T19:45:43.795985] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:45:44.254349] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-30T19:45:44.352990] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:45:45.054410] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-30T19:45:45.553949] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:45:45.592835] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T19:45:45.610463] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-30T19:45:45.610635] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-30T19:45:45.866708] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-30T19:45:46.054382] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-30T19:45:46.054475] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-30T19:45:46.055619] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-30T19:45:46.055724] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-30T19:45:46.057302] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53600 (keeping 200 days of data) [2025-09-30T19:45:46.411509] [DEBUG] [LOCAL ] LYB: Primary data saved (53600 records). [2025-09-30T19:45:46.411696] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-30T19:45:46.411810] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYB took 33.6s. Estimated remaining: 2h 18m 10s. Rate: 7.8 symbols/min [2025-09-30T19:45:46.612344] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:46.627176] [DEBUG] [LOCAL ] LZM: Loaded 13838 existing records from primary storage. [2025-09-30T19:45:46.627462] [INFO ] [MAIN ] LZM: Loaded 13838 existing records. [2025-09-30T19:45:46.662732] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-30T19:45:46.836993] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:46.837318] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-30T19:45:46.837450] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-30T19:45:46.837985] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-30T19:45:46.838106] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-30T19:45:46.991769] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:45:47.293120] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:47.454370] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-30T19:45:47.655069] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T19:45:48.145031] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:45:48.254322] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-30T19:45:48.263956] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T19:45:49.054393] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-30T19:45:49.854380] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-30T19:45:50.012949] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:45:50.576795] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T19:45:50.654359] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-30T19:45:51.033287] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:45:51.454352] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-30T19:45:51.459175] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T19:45:52.254379] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-30T19:45:52.840560] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:45:53.054355] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-30T19:45:53.854359] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-30T19:45:54.027978] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:45:54.583278] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T19:45:54.654361] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-30T19:45:55.454332] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-30T19:45:55.559961] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:45:56.254338] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-30T19:45:56.357542] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T19:45:56.508961] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:45:57.054351] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-30T19:45:57.734850] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:45:57.854370] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-30T19:45:58.425077] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:45:58.654350] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-30T19:45:59.454679] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-30T19:45:59.459435] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:45:59.473692] [INFO ] [REMOTE ] LYG: Full fetch complete (76057 records). [2025-09-30T19:45:59.473900] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-30T19:45:59.920211] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-30T19:45:59.920365] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-30T19:45:59.921519] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-30T19:45:59.921669] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-30T19:45:59.941408] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:45:59.949112] [DEBUG] [LOCAL ] LYG: Trimmed 76057 records to 52804 (keeping 200 days of data) [2025-09-30T19:46:00.261284] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-30T19:46:00.289148] [DEBUG] [LOCAL ] LYG: Primary data saved (52804 records). [2025-09-30T19:46:00.289323] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-30T19:46:00.292499] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYG took 28.8s. Estimated remaining: 2h 18m 7s. Rate: 7.8 symbols/min [2025-09-30T19:46:00.472565] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:00.534292] [DEBUG] [LOCAL ] M: Loaded 53537 existing records from primary storage. [2025-09-30T19:46:00.534821] [INFO ] [MAIN ] M: Loaded 53537 existing records. [2025-09-30T19:46:00.751528] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:00.751878] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-30T19:46:00.751929] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-30T19:46:00.753253] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-30T19:46:00.753317] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-30T19:46:01.064994] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-30T19:46:01.166889] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:01.270970] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:46:01.412201] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T19:46:01.854408] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-30T19:46:02.475945] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:46:02.623590] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:46:02.654329] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-30T19:46:03.454429] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-30T19:46:04.254348] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-30T19:46:04.581630] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T19:46:04.723825] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T19:46:05.054371] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-30T19:46:05.178696] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T19:46:05.818492] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:46:05.854335] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-30T19:46:06.654363] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-30T19:46:06.819088] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:46:07.454375] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-30T19:46:08.076829] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T19:46:08.254367] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-30T19:46:08.895298] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:46:09.054375] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-30T19:46:09.703490] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:46:09.854390] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-30T19:46:10.645702] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:46:10.655852] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-30T19:46:11.454334] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-30T19:46:11.773719] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T19:46:11.786366] [INFO ] [REMOTE ] LYV: Full fetch complete (73672 records). [2025-09-30T19:46:11.786544] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-30T19:46:12.232814] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-30T19:46:12.232987] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-30T19:46:12.234330] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-30T19:46:12.234455] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-30T19:46:12.254682] [DEBUG] [LOCAL ] LYV: Trimmed 73672 records to 51121 (keeping 200 days of data) [2025-09-30T19:46:12.257100] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-30T19:46:12.260772] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:46:12.330104] [INFO ] [REMOTE ] LZB: Full fetch complete (50496 records). [2025-09-30T19:46:12.357561] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-30T19:46:12.965929] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-30T19:46:12.967301] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-30T19:46:12.972435] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-30T19:46:12.972946] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-30T19:46:13.000124] [DEBUG] [LOCAL ] LZB: Trimmed 50496 records to 35551 (keeping 200 days of data) [2025-09-30T19:46:13.203775] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:46:13.214610] [INFO ] [REMOTE ] LZM: Full fetch complete (18307 records). [2025-09-30T19:46:13.215789] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-30T19:46:13.250045] [DEBUG] [LOCAL ] LYV: Primary data saved (51121 records). [2025-09-30T19:46:13.285038] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-30T19:46:13.322850] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T19:46:13.328250] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LYV took 37.2s. Estimated remaining: 2h 18m 4s. Rate: 7.8 symbols/min [2025-09-30T19:46:13.398353] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-30T19:46:13.747422] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:13.907221] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-30T19:46:13.910171] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-30T19:46:13.911221] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-30T19:46:13.912163] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-30T19:46:13.916343] [DEBUG] [LOCAL ] LZM: Trimmed 18307 records to 13960 (keeping 200 days of data) [2025-09-30T19:46:14.088000] [DEBUG] [LOCAL ] MA: Loaded 52540 existing records from primary storage. [2025-09-30T19:46:14.089881] [INFO ] [MAIN ] MA: Loaded 52540 existing records. [2025-09-30T19:46:14.314289] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:14.316395] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-30T19:46:14.317006] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-30T19:46:14.318876] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-30T19:46:14.318998] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-30T19:46:14.434509] [DEBUG] [LOCAL ] LZM: Primary data saved (13960 records). [2025-09-30T19:46:14.447451] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-30T19:46:14.447928] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 28.0s. Estimated remaining: 2h 17m 51s. Rate: 7.8 symbols/min [2025-09-30T19:46:14.529569] [DEBUG] [LOCAL ] LZB: Primary data saved (35551 records). [2025-09-30T19:46:14.575825] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-30T19:46:14.646234] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZB took 34.1s. Estimated remaining: 2h 17m 37s. Rate: 7.8 symbols/min [2025-09-30T19:46:14.950003] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:15.129165] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:15.146099] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-30T19:46:15.238260] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:15.256918] [DEBUG] [LOCAL ] MAA: Loaded 42690 existing records from primary storage. [2025-09-30T19:46:15.257301] [INFO ] [MAIN ] MAA: Loaded 42690 existing records. [2025-09-30T19:46:15.523585] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:15.532998] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-30T19:46:15.552142] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-30T19:46:15.554468] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T19:46:15.566865] [DEBUG] [LOCAL ] MAC: Loaded 49693 existing records from primary storage. [2025-09-30T19:46:15.567218] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-30T19:46:15.568209] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-30T19:46:15.568148] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-30T19:46:15.581588] [INFO ] [MAIN ] MAC: Loaded 49693 existing records. [2025-09-30T19:46:16.029074] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:16.069743] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-30T19:46:16.094863] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-30T19:46:16.101439] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-30T19:46:16.117205] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-30T19:46:16.226531] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:16.268550] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-30T19:46:16.783625] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:16.784176] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-30T19:46:17.184526] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T19:46:17.196666] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-30T19:46:17.588349] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T19:46:17.854332] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-30T19:46:17.938511] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:46:18.654357] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-30T19:46:18.702025] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T19:46:19.157866] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T19:46:19.454382] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-30T19:46:19.715829] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:46:20.148317] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:46:20.254391] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-30T19:46:20.946154] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T19:46:21.054344] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-30T19:46:21.838693] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:46:21.854329] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-30T19:46:22.222846] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T19:46:22.654389] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-30T19:46:23.454392] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-30T19:46:23.749497] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:46:23.888960] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:46:24.254427] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-30T19:46:25.054327] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-30T19:46:25.472037] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T19:46:25.854387] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-30T19:46:25.950620] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:46:26.424067] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T19:46:26.654409] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-30T19:46:27.459538] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-30T19:46:27.465561] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:46:28.254356] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-30T19:46:28.338002] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:46:29.054360] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-30T19:46:29.661894] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T19:46:29.854347] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-30T19:46:30.390763] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T19:46:30.402819] [INFO ] [REMOTE ] M: Full fetch complete (77520 records). [2025-09-30T19:46:30.403008] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-30T19:46:30.659206] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-30T19:46:30.848555] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-30T19:46:30.848765] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-30T19:46:30.850007] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-30T19:46:30.850199] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-30T19:46:30.868112] [DEBUG] [LOCAL ] M: Trimmed 77520 records to 53535 (keeping 200 days of data) [2025-09-30T19:46:30.884386] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:46:31.268304] [DEBUG] [LOCAL ] M: Primary data saved (53535 records). [2025-09-30T19:46:31.268499] [INFO ] [MAIN ] M: Full history saved. [2025-09-30T19:46:31.269228] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. M took 31.0s. Estimated remaining: 2h 17m 36s. Rate: 7.8 symbols/min [2025-09-30T19:46:31.459506] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-30T19:46:31.463456] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:31.493679] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:46:31.539885] [DEBUG] [LOCAL ] MAGN: Loaded 34851 existing records from primary storage. [2025-09-30T19:46:31.540228] [INFO ] [MAIN ] MAGN: Loaded 34851 existing records. [2025-09-30T19:46:31.736923] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:31.737153] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-30T19:46:31.737201] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-30T19:46:31.738037] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-30T19:46:31.738131] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-30T19:46:32.135075] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:32.254324] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-30T19:46:32.363757] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:46:33.054382] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-30T19:46:33.243033] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T19:46:33.358880] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:46:33.854373] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-30T19:46:34.654356] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-30T19:46:35.097274] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T19:46:35.180972] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:46:35.454378] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-30T19:46:36.019545] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:46:36.254373] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-30T19:46:37.054372] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-30T19:46:37.133887] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:46:37.854393] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-30T19:46:38.091891] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:46:38.500422] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T19:46:38.654392] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-30T19:46:39.454391] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-30T19:46:39.518046] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T19:46:40.254449] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-30T19:46:40.595255] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T19:46:40.761914] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T19:46:41.054360] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-30T19:46:41.854315] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-30T19:46:41.892674] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:46:42.654368] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-30T19:46:43.021732] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T19:46:43.033703] [INFO ] [REMOTE ] MA: Full fetch complete (76253 records). [2025-09-30T19:46:43.033880] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-30T19:46:43.460323] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-30T19:46:43.493876] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-30T19:46:43.495072] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-30T19:46:43.496453] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-30T19:46:43.496667] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-30T19:46:43.524874] [DEBUG] [LOCAL ] MA: Trimmed 76253 records to 52531 (keeping 200 days of data) [2025-09-30T19:46:43.529450] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T19:46:43.895924] [DEBUG] [LOCAL ] MA: Primary data saved (52531 records). [2025-09-30T19:46:43.896075] [INFO ] [MAIN ] MA: Full history saved. [2025-09-30T19:46:43.896182] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MA took 30.6s. Estimated remaining: 2h 17m 33s. Rate: 7.8 symbols/min [2025-09-30T19:46:44.083103] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:44.115926] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:46:44.162563] [DEBUG] [LOCAL ] MAIN: Loaded 41208 existing records from primary storage. [2025-09-30T19:46:44.162940] [INFO ] [MAIN ] MAIN: Loaded 41208 existing records. [2025-09-30T19:46:44.259960] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-30T19:46:44.359703] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:44.359933] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-30T19:46:44.359995] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-30T19:46:44.360988] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-30T19:46:44.361051] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-30T19:46:44.773900] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:44.868726] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:46:45.054369] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-30T19:46:45.854332] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-30T19:46:45.977925] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:46:45.989623] [INFO ] [REMOTE ] MAA: Full fetch complete (61113 records). [2025-09-30T19:46:45.989813] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-30T19:46:46.424125] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-30T19:46:46.424250] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-30T19:46:46.425442] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-30T19:46:46.425582] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-30T19:46:46.427433] [DEBUG] [LOCAL ] MAA: Trimmed 61113 records to 42672 (keeping 200 days of data) [2025-09-30T19:46:46.562679] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:46:46.575383] [INFO ] [REMOTE ] MAC: Full fetch complete (71444 records). [2025-09-30T19:46:46.576115] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-30T19:46:46.660741] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-30T19:46:47.053573] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-30T19:46:47.055052] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-30T19:46:47.056700] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-30T19:46:47.056842] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-30T19:46:47.062440] [DEBUG] [LOCAL ] MAC: Trimmed 71444 records to 49676 (keeping 200 days of data) [2025-09-30T19:46:47.289119] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:46:47.363038] [DEBUG] [LOCAL ] MAA: Primary data saved (42672 records). [2025-09-30T19:46:47.363874] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-30T19:46:47.364475] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAA took 32.9s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-09-30T19:46:47.458639] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-30T19:46:47.681522] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:47.734159] [DEBUG] [LOCAL ] MAN: Loaded 43536 existing records from primary storage. [2025-09-30T19:46:47.735352] [INFO ] [MAIN ] MAN: Loaded 43536 existing records. [2025-09-30T19:46:47.974273] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:47.977933] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-30T19:46:47.978032] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-30T19:46:48.022706] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-30T19:46:48.023587] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-30T19:46:48.176167] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T19:46:48.254401] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-30T19:46:48.405151] [DEBUG] [LOCAL ] MAC: Primary data saved (49676 records). [2025-09-30T19:46:48.405886] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-30T19:46:48.406007] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 33.7s. Estimated remaining: 2h 17m 8s. Rate: 7.8 symbols/min [2025-09-30T19:46:48.610506] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:48.690143] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:48.718955] [DEBUG] [LOCAL ] MANU: Loaded 27013 existing records from primary storage. [2025-09-30T19:46:48.719261] [INFO ] [MAIN ] MANU: Loaded 27013 existing records. [2025-09-30T19:46:48.917829] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:48.918044] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-30T19:46:48.918131] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-30T19:46:48.918423] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-30T19:46:48.918481] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-30T19:46:49.054747] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-30T19:46:49.351753] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T19:46:49.384010] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:49.463222] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:46:49.854387] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-30T19:46:50.267393] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:46:50.654364] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-30T19:46:51.008035] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:46:51.454377] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-30T19:46:52.065048] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:46:52.254354] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-30T19:46:52.928817] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:46:53.054356] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-30T19:46:53.818473] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:46:53.854362] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-30T19:46:54.551982] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:46:54.654365] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-30T19:46:55.454363] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-30T19:46:55.540876] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:46:55.770740] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T19:46:56.254350] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-30T19:46:56.755523] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:46:57.054355] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-30T19:46:57.854353] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-30T19:46:58.080889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:46:58.265061] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:46:58.654399] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-30T19:46:59.221439] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:46:59.229256] [INFO ] [REMOTE ] MAGN: Full fetch complete (50939 records). [2025-09-30T19:46:59.229452] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-30T19:46:59.456405] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-30T19:46:59.673717] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-30T19:46:59.673971] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-30T19:46:59.674950] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-30T19:46:59.675065] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-30T19:46:59.698453] [DEBUG] [LOCAL ] MAGN: Trimmed 50939 records to 34849 (keeping 200 days of data) [2025-09-30T19:46:59.698327] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:46:59.929560] [DEBUG] [LOCAL ] MAGN: Primary data saved (34849 records). [2025-09-30T19:46:59.929761] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-30T19:46:59.930517] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 28.7s. Estimated remaining: 2h 17m 4s. Rate: 7.8 symbols/min [2025-09-30T19:47:00.121743] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:00.177782] [DEBUG] [LOCAL ] MAS: Loaded 52336 existing records from primary storage. [2025-09-30T19:47:00.178195] [INFO ] [MAIN ] MAS: Loaded 52336 existing records. [2025-09-30T19:47:00.259546] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-30T19:47:00.399418] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:00.400465] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-30T19:47:00.400537] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-30T19:47:00.401791] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-30T19:47:00.401877] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-30T19:47:00.773992] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:01.054368] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-30T19:47:01.374927] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T19:47:01.646936] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T19:47:01.854367] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-30T19:47:02.338394] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:47:02.654379] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-30T19:47:03.454377] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-30T19:47:03.536253] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T19:47:04.254840] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-30T19:47:04.254766] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:47:04.636007] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:47:05.054384] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-30T19:47:05.416465] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:47:05.854410] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-30T19:47:06.632163] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T19:47:06.654349] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-30T19:47:07.036603] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:47:07.454402] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-30T19:47:08.053076] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T19:47:08.254406] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-30T19:47:09.054436] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-30T19:47:09.156131] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:47:09.616873] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T19:47:09.854408] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-30T19:47:10.654332] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-30T19:47:10.834903] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:47:11.454368] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-30T19:47:11.549410] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:47:11.925946] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:47:12.254406] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-30T19:47:13.054327] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-30T19:47:13.160254] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T19:47:13.169708] [INFO ] [REMOTE ] MAIN: Full fetch complete (59751 records). [2025-09-30T19:47:13.169951] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-30T19:47:13.618475] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-30T19:47:13.618587] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-30T19:47:13.619734] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-30T19:47:13.619821] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-30T19:47:13.643943] [DEBUG] [LOCAL ] MAIN: Trimmed 59751 records to 41190 (keeping 200 days of data) [2025-09-30T19:47:13.645412] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:47:13.879768] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-30T19:47:13.930492] [DEBUG] [LOCAL ] MAIN: Primary data saved (41190 records). [2025-09-30T19:47:13.930624] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-30T19:47:13.930737] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 30.0s. Estimated remaining: 2h 17m 1s. Rate: 7.8 symbols/min [2025-09-30T19:47:14.120414] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:14.157216] [DEBUG] [LOCAL ] MATV: Loaded 37051 existing records from primary storage. [2025-09-30T19:47:14.157515] [INFO ] [MAIN ] MATV: Loaded 37051 existing records. [2025-09-30T19:47:14.364748] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:14.365058] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-30T19:47:14.365200] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-30T19:47:14.365576] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-30T19:47:14.365672] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-30T19:47:14.506188] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:47:14.659984] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-30T19:47:14.797352] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:15.448328] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T19:47:15.458751] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-30T19:47:16.254350] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-30T19:47:16.491180] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:47:16.745070] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:47:17.054390] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-30T19:47:17.615848] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T19:47:17.854338] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-30T19:47:18.080972] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:47:18.654401] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-30T19:47:19.454319] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-30T19:47:19.499375] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:47:19.509131] [INFO ] [REMOTE ] MAN: Full fetch complete (62067 records). [2025-09-30T19:47:19.509266] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-30T19:47:19.927479] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-30T19:47:19.927562] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-30T19:47:19.928677] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-30T19:47:19.928757] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-30T19:47:19.930278] [DEBUG] [LOCAL ] MAN: Trimmed 62067 records to 43544 (keeping 200 days of data) [2025-09-30T19:47:20.059695] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:47:20.240915] [DEBUG] [LOCAL ] MAN: Primary data saved (43544 records). [2025-09-30T19:47:20.241044] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-30T19:47:20.241177] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 32.9s. Estimated remaining: 2h 16m 52s. Rate: 7.8 symbols/min [2025-09-30T19:47:20.263533] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-30T19:47:20.432139] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:20.467278] [DEBUG] [LOCAL ] MATX: Loaded 31452 existing records from primary storage. [2025-09-30T19:47:20.467553] [INFO ] [MAIN ] MATX: Loaded 31452 existing records. [2025-09-30T19:47:20.657751] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:20.658113] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-30T19:47:20.658172] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-30T19:47:20.658426] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-30T19:47:20.658515] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-30T19:47:21.055518] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-30T19:47:21.055427] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:21.118249] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:47:21.125766] [INFO ] [REMOTE ] MANU: Full fetch complete (38285 records). [2025-09-30T19:47:21.125900] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-30T19:47:21.521403] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-30T19:47:21.521489] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-30T19:47:21.522272] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-30T19:47:21.522337] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-30T19:47:21.523325] [DEBUG] [LOCAL ] MANU: Trimmed 38285 records to 27013 (keeping 200 days of data) [2025-09-30T19:47:21.690874] [DEBUG] [LOCAL ] MANU: Primary data saved (27013 records). [2025-09-30T19:47:21.691062] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-30T19:47:21.691171] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MANU took 33.3s. Estimated remaining: 2h 16m 40s. Rate: 7.8 symbols/min [2025-09-30T19:47:21.810924] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:47:21.859450] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-30T19:47:21.908408] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:21.940968] [DEBUG] [LOCAL ] MAX: Loaded 30602 existing records from primary storage. [2025-09-30T19:47:21.941325] [INFO ] [MAIN ] MAX: Loaded 30602 existing records. [2025-09-30T19:47:22.133254] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:22.133506] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-30T19:47:22.133558] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-30T19:47:22.133888] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-30T19:47:22.133947] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-30T19:47:22.519976] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:22.654351] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-30T19:47:22.786076] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:47:22.845558] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T19:47:23.454335] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-30T19:47:23.745918] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:47:24.254358] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-30T19:47:25.054384] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-30T19:47:25.319152] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T19:47:25.854353] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-30T19:47:25.890015] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:47:26.426966] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:47:26.654410] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-30T19:47:27.454350] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-30T19:47:27.643339] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T19:47:28.101958] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:47:28.254372] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-30T19:47:28.605626] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:47:29.054400] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-30T19:47:29.825336] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:47:29.854381] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-30T19:47:30.375360] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:47:30.654402] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-30T19:47:31.230259] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:47:31.454354] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-30T19:47:32.223157] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:47:32.235225] [INFO ] [REMOTE ] MAS: Full fetch complete (74826 records). [2025-09-30T19:47:32.235421] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-30T19:47:32.261718] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-30T19:47:32.687728] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-30T19:47:32.687849] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-30T19:47:32.689010] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-30T19:47:32.689082] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-30T19:47:32.690625] [DEBUG] [LOCAL ] MAS: Trimmed 74826 records to 52338 (keeping 200 days of data) [2025-09-30T19:47:32.944093] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:47:33.054375] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-30T19:47:33.085630] [DEBUG] [LOCAL ] MAS: Primary data saved (52338 records). [2025-09-30T19:47:33.085806] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-30T19:47:33.086598] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MAS took 33.2s. Estimated remaining: 2h 16m 35s. Rate: 7.8 symbols/min [2025-09-30T19:47:33.274784] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:33.293110] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T19:47:33.341341] [DEBUG] [LOCAL ] MBC: Loaded 43180 existing records from primary storage. [2025-09-30T19:47:33.341766] [INFO ] [MAIN ] MBC: Loaded 43180 existing records. [2025-09-30T19:47:33.524754] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:33.525000] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-30T19:47:33.525054] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-30T19:47:33.525338] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-30T19:47:33.525402] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-30T19:47:33.856521] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-30T19:47:33.892916] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:34.021388] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:47:34.654335] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-30T19:47:34.834797] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:47:35.454367] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-30T19:47:36.254400] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-30T19:47:36.486132] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:47:37.054423] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-30T19:47:37.775493] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:47:37.854329] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-30T19:47:38.199584] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:47:38.654408] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-30T19:47:39.268962] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:47:39.275868] [INFO ] [REMOTE ] MATV: Full fetch complete (52388 records). [2025-09-30T19:47:39.275989] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-30T19:47:39.458125] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-30T19:47:39.626847] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (4.97 seconds). [2025-09-30T19:47:39.751936] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-30T19:47:39.752024] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-30T19:47:39.752874] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-30T19:47:39.752938] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-30T19:47:39.754084] [DEBUG] [LOCAL ] MATV: Trimmed 52388 records to 36847 (keeping 200 days of data) [2025-09-30T19:47:39.987931] [DEBUG] [LOCAL ] MATV: Primary data saved (36847 records). [2025-09-30T19:47:39.988105] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-30T19:47:39.988209] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 26.1s. Estimated remaining: 2h 16m 27s. Rate: 7.8 symbols/min [2025-09-30T19:47:40.167999] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:40.192090] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:47:40.221303] [DEBUG] [LOCAL ] MBI: Loaded 24353 existing records from primary storage. [2025-09-30T19:47:40.221679] [INFO ] [MAIN ] MBI: Loaded 24353 existing records. [2025-09-30T19:47:40.259476] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-30T19:47:40.417974] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:40.418337] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-30T19:47:40.418487] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-30T19:47:40.418907] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-30T19:47:40.419011] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-30T19:47:40.624695] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:47:40.838319] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:41.054355] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-30T19:47:41.838348] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:47:41.854307] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-30T19:47:42.363761] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:47:42.654358] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-30T19:47:43.294424] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:47:43.454383] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-30T19:47:43.952230] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:47:44.254382] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-30T19:47:44.541081] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T19:47:45.054317] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-30T19:47:45.448071] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:47:45.854322] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-30T19:47:46.041244] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:47:46.654376] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-30T19:47:47.173100] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T19:47:47.454333] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-30T19:47:47.490511] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:47:48.254375] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-30T19:47:48.960715] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:47:49.054327] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-30T19:47:49.586874] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T19:47:49.854349] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-30T19:47:50.353350] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:47:50.654365] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-30T19:47:51.081999] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T19:47:51.454384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-30T19:47:52.224855] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T19:47:52.254324] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-30T19:47:52.794262] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T19:47:52.801465] [INFO ] [REMOTE ] MATX: Full fetch complete (42584 records). [2025-09-30T19:47:52.801677] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-30T19:47:53.059478] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-30T19:47:53.237419] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-30T19:47:53.237543] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-30T19:47:53.238422] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-30T19:47:53.238537] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-30T19:47:53.239768] [DEBUG] [LOCAL ] MATX: Trimmed 42584 records to 31534 (keeping 200 days of data) [2025-09-30T19:47:53.451073] [DEBUG] [LOCAL ] MATX: Primary data saved (31534 records). [2025-09-30T19:47:53.451418] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-30T19:47:53.451526] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MATX took 33.2s. Estimated remaining: 2h 16m 24s. Rate: 7.8 symbols/min [2025-09-30T19:47:53.585391] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:47:53.681419] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:53.725189] [DEBUG] [LOCAL ] MC: Loaded 44106 existing records from primary storage. [2025-09-30T19:47:53.725497] [INFO ] [MAIN ] MC: Loaded 44106 existing records. [2025-09-30T19:47:53.859495] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-30T19:47:53.917917] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:53.918179] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-30T19:47:53.918241] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-30T19:47:53.918604] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-30T19:47:53.918692] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-30T19:47:54.464059] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:54.571413] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:47:54.582412] [INFO ] [REMOTE ] MAX: Full fetch complete (45233 records). [2025-09-30T19:47:54.582692] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-30T19:47:54.659515] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-30T19:47:54.994609] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-30T19:47:54.994726] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-30T19:47:54.995469] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-30T19:47:54.995512] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-30T19:47:54.996534] [DEBUG] [LOCAL ] MAX: Trimmed 45233 records to 30628 (keeping 200 days of data) [2025-09-30T19:47:55.181304] [DEBUG] [LOCAL ] MAX: Primary data saved (30628 records). [2025-09-30T19:47:55.181444] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-30T19:47:55.181548] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MAX took 33.5s. Estimated remaining: 2h 16m 11s. Rate: 7.8 symbols/min [2025-09-30T19:47:55.372851] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:55.397418] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:47:55.416019] [DEBUG] [LOCAL ] MCB: Loaded 11659 existing records from primary storage. [2025-09-30T19:47:55.416272] [INFO ] [MAIN ] MCB: Loaded 11659 existing records. [2025-09-30T19:47:55.461203] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-30T19:47:55.611183] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:55.611449] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-30T19:47:55.611510] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-30T19:47:55.611813] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-30T19:47:55.611871] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-30T19:47:56.023976] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:56.051224] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:47:56.254368] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-30T19:47:56.971508] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:47:56.987815] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T19:47:57.054365] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-30T19:47:57.854364] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-30T19:47:58.644510] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:47:58.655734] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-30T19:47:58.893611] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:47:59.454401] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-30T19:48:00.049403] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:48:00.254356] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-30T19:48:00.345724] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:48:01.054389] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-30T19:48:01.803628] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:48:01.818953] [INFO ] [REMOTE ] MBC: Full fetch complete (62838 records). [2025-09-30T19:48:01.819252] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-30T19:48:01.856045] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-30T19:48:01.957183] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T19:48:02.396881] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-30T19:48:02.396967] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-30T19:48:02.398135] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-30T19:48:02.398201] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-30T19:48:02.399578] [DEBUG] [LOCAL ] MBC: Trimmed 62838 records to 43179 (keeping 200 days of data) [2025-09-30T19:48:02.655513] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-30T19:48:02.679742] [DEBUG] [LOCAL ] MBC: Primary data saved (43179 records). [2025-09-30T19:48:02.679854] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-30T19:48:02.681112] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 29.6s. Estimated remaining: 2h 16m 3s. Rate: 7.8 symbols/min [2025-09-30T19:48:02.860037] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:02.860260] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-30T19:48:02.860315] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-30T19:48:02.860435] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-30T19:48:02.860476] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-30T19:48:02.860516] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-30T19:48:02.860549] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-30T19:48:03.264960] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:03.278391] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T19:48:03.454377] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-30T19:48:04.196038] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:48:04.254332] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-30T19:48:04.291327] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T19:48:05.054372] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-30T19:48:05.854331] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-30T19:48:05.962062] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T19:48:06.155844] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:48:06.654329] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-30T19:48:06.890516] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T19:48:07.454371] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-30T19:48:08.254406] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-30T19:48:08.655498] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T19:48:08.973834] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:48:09.065971] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-30T19:48:09.071886] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T19:48:09.854404] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-30T19:48:10.635875] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:48:10.654314] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-30T19:48:11.087234] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T19:48:11.454361] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-30T19:48:11.568994] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:48:12.254350] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-30T19:48:13.020303] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:48:13.054350] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-30T19:48:13.167994] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:48:13.854349] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-30T19:48:13.965760] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T19:48:14.654422] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-30T19:48:15.416677] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:48:15.454394] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-30T19:48:16.033952] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:48:16.254437] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-30T19:48:16.527340] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:48:16.695784] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:48:17.054387] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-30T19:48:17.727062] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T19:48:17.730277] [INFO ] [REMOTE ] MCB: Full fetch complete (16347 records). [2025-09-30T19:48:17.730403] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-30T19:48:17.859521] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-30T19:48:18.126584] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-30T19:48:18.126701] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-30T19:48:18.127124] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-30T19:48:18.127175] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-30T19:48:18.127842] [DEBUG] [LOCAL ] MCB: Trimmed 16347 records to 11531 (keeping 200 days of data) [2025-09-30T19:48:18.203679] [DEBUG] [LOCAL ] MCB: Primary data saved (11531 records). [2025-09-30T19:48:18.203835] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-30T19:48:18.203924] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 23.0s. Estimated remaining: 2h 16m 2s. Rate: 7.8 symbols/min [2025-09-30T19:48:18.392230] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:18.403554] [DEBUG] [LOCAL ] MCI: Loaded 6387 existing records from primary storage. [2025-09-30T19:48:18.403816] [INFO ] [MAIN ] MCI: Loaded 6387 existing records. [2025-09-30T19:48:18.602941] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:18.603255] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-30T19:48:18.603320] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-30T19:48:18.603616] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-30T19:48:18.603704] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-30T19:48:18.660890] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-30T19:48:18.992300] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:19.243206] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T19:48:19.248816] [INFO ] [REMOTE ] MBI: Full fetch complete (36488 records). [2025-09-30T19:48:19.248925] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-30T19:48:19.463578] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-30T19:48:19.656105] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-30T19:48:19.656188] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-30T19:48:19.656981] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-30T19:48:19.657065] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-30T19:48:19.658004] [DEBUG] [LOCAL ] MBI: Trimmed 36488 records to 24289 (keeping 200 days of data) [2025-09-30T19:48:19.804558] [DEBUG] [LOCAL ] MBI: Primary data saved (24289 records). [2025-09-30T19:48:19.804713] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-30T19:48:19.804843] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MBI took 39.8s. Estimated remaining: 2h 15m 49s. Rate: 7.8 symbols/min [2025-09-30T19:48:20.006045] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:20.054536] [DEBUG] [LOCAL ] MCK: Loaded 39218 existing records from primary storage. [2025-09-30T19:48:20.054938] [INFO ] [MAIN ] MCK: Loaded 39218 existing records. [2025-09-30T19:48:20.258240] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-30T19:48:20.257919] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:20.260996] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-30T19:48:20.261110] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-30T19:48:20.261788] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-30T19:48:20.261937] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-30T19:48:20.594472] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:48:20.702455] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:20.954493] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:48:21.054389] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-30T19:48:21.711842] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-30T19:48:21.854380] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-30T19:48:22.587156] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:48:22.654363] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-30T19:48:23.454379] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-30T19:48:24.099831] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-30T19:48:24.107394] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T19:48:24.254340] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-30T19:48:24.360383] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T19:48:24.369807] [INFO ] [REMOTE ] MC: Full fetch complete (62468 records). [2025-09-30T19:48:24.370038] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-30T19:48:24.822836] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-30T19:48:24.822955] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-30T19:48:24.824001] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-30T19:48:24.824069] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-30T19:48:24.826681] [DEBUG] [LOCAL ] MC: Trimmed 62468 records to 44091 (keeping 200 days of data) [2025-09-30T19:48:25.055743] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-30T19:48:25.113167] [DEBUG] [LOCAL ] MC: Primary data saved (44091 records). [2025-09-30T19:48:25.113347] [INFO ] [MAIN ] MC: Full history saved. [2025-09-30T19:48:25.113502] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MC took 31.7s. Estimated remaining: 2h 15m 40s. Rate: 7.8 symbols/min [2025-09-30T19:48:25.299274] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:25.309712] [DEBUG] [LOCAL ] MCN: Loaded 8133 existing records from primary storage. [2025-09-30T19:48:25.309925] [INFO ] [MAIN ] MCN: Loaded 8133 existing records. [2025-09-30T19:48:25.498958] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:25.499224] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-30T19:48:25.499274] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-30T19:48:25.499563] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-30T19:48:25.499668] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-30T19:48:25.857457] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-30T19:48:25.894303] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:25.926600] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:48:26.022075] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:48:26.654452] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-30T19:48:27.148352] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T19:48:27.454370] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-30T19:48:28.102612] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-30T19:48:28.119444] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T19:48:28.254382] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-30T19:48:29.054415] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-30T19:48:29.854366] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-30T19:48:30.479387] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-30T19:48:30.500996] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T19:48:30.633816] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:48:30.654317] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-30T19:48:31.454374] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-30T19:48:32.136870] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T19:48:32.201932] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T19:48:32.254336] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-30T19:48:33.054401] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-30T19:48:33.854377] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-30T19:48:34.302201] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T19:48:34.564054] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-30T19:48:34.619031] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:48:34.654391] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-30T19:48:35.114170] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T19:48:35.454406] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-30T19:48:36.254396] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-30T19:48:36.831047] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T19:48:37.054367] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-30T19:48:37.719800] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-30T19:48:37.741342] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:48:37.854366] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-30T19:48:38.370012] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T19:48:38.654390] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-30T19:48:39.454358] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-30T19:48:40.254368] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-30T19:48:40.903373] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:48:40.914834] [INFO ] [REMOTE ] MCD: Full fetch complete (77029 records). [2025-09-30T19:48:40.915049] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-30T19:48:41.037372] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:48:41.056758] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-30T19:48:41.154865] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:48:41.157973] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:48:41.158228] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:48:41.158354] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-30T19:48:41.158467] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-30T19:48:41.158606] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-30T19:48:41.158812] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-30T19:48:41.158922] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCD took 38.5s. Estimated remaining: 2h 15m 39s. Rate: 7.8 symbols/min [2025-09-30T19:48:41.362531] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:41.385124] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T19:48:41.444869] [DEBUG] [LOCAL ] MCO: Loaded 39341 existing records from primary storage. [2025-09-30T19:48:41.445201] [INFO ] [MAIN ] MCO: Loaded 39341 existing records. [2025-09-30T19:48:41.636970] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:41.637214] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-30T19:48:41.637262] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-30T19:48:41.637723] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-30T19:48:41.637784] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-30T19:48:41.859485] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-30T19:48:41.956930] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:48:41.970535] [INFO ] [REMOTE ] MCI: Full fetch complete (9927 records). [2025-09-30T19:48:41.980957] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-30T19:48:42.131958] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:42.456100] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-30T19:48:42.456177] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-30T19:48:42.456445] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-30T19:48:42.456508] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-30T19:48:42.457042] [DEBUG] [LOCAL ] MCI: Trimmed 9927 records to 6378 (keeping 200 days of data) [2025-09-30T19:48:42.499978] [DEBUG] [LOCAL ] MCI: Primary data saved (6378 records). [2025-09-30T19:48:42.500123] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-30T19:48:42.500224] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCI took 24.3s. Estimated remaining: 2h 15m 26s. Rate: 7.8 symbols/min [2025-09-30T19:48:42.659525] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-30T19:48:42.692018] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:42.704897] [DEBUG] [LOCAL ] MCR: Loaded 8763 existing records from primary storage. [2025-09-30T19:48:42.705293] [INFO ] [MAIN ] MCR: Loaded 8763 existing records. [2025-09-30T19:48:42.889750] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:42.890006] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-30T19:48:42.890058] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-30T19:48:42.890296] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-30T19:48:42.890359] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-30T19:48:43.281106] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:43.454372] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-30T19:48:43.539177] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:48:43.976790] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T19:48:44.254371] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-30T19:48:44.357555] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:48:45.054376] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-30T19:48:45.100587] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T19:48:45.606769] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T19:48:45.854356] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-30T19:48:46.654376] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-30T19:48:47.067043] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:48:47.353466] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T19:48:47.454390] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-30T19:48:48.254346] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-30T19:48:48.271795] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T19:48:48.356275] [DEBUG] [REMOTE ] MCK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-30T19:48:48.356558] [WARN ] [REMOTE ] MCK: No data returned for month 2025-07 [2025-09-30T19:48:48.356688] [FATAL] [REMOTE ] MCK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:48:48.356781] [FATAL] [MAIN ] MCK: Failed to fetch primary data. [2025-09-30T19:48:48.356825] [WARN ] [MAIN ] MCK: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:48:48.356895] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-30T19:48:48.356960] [DEBUG] [LOCAL ] MCK: No primary data file found to delete. [2025-09-30T19:48:48.356996] [INFO ] [LOCAL ] MCK: Starting deletion of derivative data. [2025-09-30T19:48:48.357569] [DEBUG] [LOCAL ] MCK: Deleted derivative data file. [2025-09-30T19:48:48.357681] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCK took 28.6s. Estimated remaining: 2h 15m 17s. Rate: 7.8 symbols/min [2025-09-30T19:48:48.550001] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:48.571952] [DEBUG] [LOCAL ] MCS: Loaded 20946 existing records from primary storage. [2025-09-30T19:48:48.572259] [INFO ] [MAIN ] MCS: Loaded 20946 existing records. [2025-09-30T19:48:48.788525] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:48.788793] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-30T19:48:48.788844] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-30T19:48:48.789141] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-30T19:48:48.789200] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-30T19:48:49.059592] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-30T19:48:49.176145] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:49.854365] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-30T19:48:50.594380] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:48:50.654331] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-30T19:48:50.858876] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T19:48:51.454408] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-30T19:48:52.185501] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:48:52.254361] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-30T19:48:52.541067] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:48:52.739540] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T19:48:53.054372] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-30T19:48:53.854448] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-30T19:48:53.927158] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T19:48:54.611118] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T19:48:54.654373] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-30T19:48:55.395080] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:48:55.454341] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-30T19:48:56.254354] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-30T19:48:57.054357] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-30T19:48:57.132354] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:48:57.183627] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T19:48:57.457282] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T19:48:57.854359] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-30T19:48:58.654378] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-30T19:48:59.411469] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T19:48:59.454337] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-30T19:48:59.649786] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:49:00.254926] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T19:49:00.254333] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-30T19:49:01.054371] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-30T19:49:01.645290] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T19:49:01.854408] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-30T19:49:02.260323] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:49:02.654396] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-30T19:49:03.338405] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T19:49:03.389316] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T19:49:03.391777] [INFO ] [REMOTE ] MCR: Full fetch complete (14117 records). [2025-09-30T19:49:03.391934] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-30T19:49:03.461080] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-30T19:49:03.821287] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-30T19:49:03.821376] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-30T19:49:03.821748] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-30T19:49:03.821822] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-30T19:49:03.822368] [DEBUG] [LOCAL ] MCR: Trimmed 14117 records to 8737 (keeping 200 days of data) [2025-09-30T19:49:03.883400] [DEBUG] [LOCAL ] MCR: Primary data saved (8737 records). [2025-09-30T19:49:03.883760] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-30T19:49:03.883900] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCR took 21.4s. Estimated remaining: 2h 15m 15s. Rate: 7.8 symbols/min [2025-09-30T19:49:04.254380] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-30T19:49:05.001063] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T19:49:05.017374] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T19:49:05.054347] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-30T19:49:05.822061] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:49:05.854333] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-30T19:49:06.654436] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-30T19:49:07.359160] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T19:49:07.379111] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:49:07.454395] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-30T19:49:08.254383] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-30T19:49:09.054385] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-30T19:49:09.273682] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:49:09.282884] [INFO ] [REMOTE ] MCO: Full fetch complete (56815 records). [2025-09-30T19:49:09.283028] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-30T19:49:09.445939] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:49:09.741840] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-30T19:49:09.741944] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-30T19:49:09.742960] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-30T19:49:09.743027] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-30T19:49:09.744323] [DEBUG] [LOCAL ] MCO: Trimmed 56815 records to 39288 (keeping 200 days of data) [2025-09-30T19:49:09.847761] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:49:09.854503] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-30T19:49:10.022554] [DEBUG] [LOCAL ] MCO: Primary data saved (39288 records). [2025-09-30T19:49:10.022808] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-30T19:49:10.024520] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCO took 28.9s. Estimated remaining: 2h 15m 6s. Rate: 7.8 symbols/min [2025-09-30T19:49:10.563387] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:49:10.654416] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-30T19:49:11.454421] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-30T19:49:11.814914] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:49:12.254343] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-30T19:49:12.339204] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T19:49:12.341261] [INFO ] [REMOTE ] MCN: Full fetch complete (11638 records). [2025-09-30T19:49:12.341470] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-30T19:49:12.716996] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-30T19:49:12.717104] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-30T19:49:12.717424] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-30T19:49:12.717467] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-30T19:49:12.717982] [DEBUG] [LOCAL ] MCN: Trimmed 11638 records to 8182 (keeping 200 days of data) [2025-09-30T19:49:12.765458] [DEBUG] [LOCAL ] MCN: Primary data saved (8182 records). [2025-09-30T19:49:12.765592] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-30T19:49:12.765707] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCN took 47.7s. Estimated remaining: 2h 14m 55s. Rate: 7.8 symbols/min [2025-09-30T19:49:13.284257] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:49:13.289842] [INFO ] [REMOTE ] MCS: Full fetch complete (30338 records). [2025-09-30T19:49:13.289991] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-30T19:49:13.791187] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-30T19:49:13.791505] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-30T19:49:13.792317] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-30T19:49:13.792437] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-30T19:49:13.794597] [DEBUG] [LOCAL ] MCS: Trimmed 30338 records to 20933 (keeping 200 days of data) [2025-09-30T19:49:13.949885] [DEBUG] [LOCAL ] MCS: Primary data saved (20933 records). [2025-09-30T19:49:13.950013] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-30T19:49:13.950120] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 25.6s. Estimated remaining: 2h 14m 42s. Rate: 7.8 symbols/min [2025-09-30T19:49:14.647455] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.663159] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.698138] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.759109] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.787164] [DEBUG] [LOCAL ] MDST: Loaded 5616 existing records from primary storage. [2025-09-30T19:49:14.787663] [INFO ] [MAIN ] MDST: Loaded 5616 existing records. [2025-09-30T19:49:14.835559] [DEBUG] [LOCAL ] MCY: Loaded 24642 existing records from primary storage. [2025-09-30T19:49:14.861821] [INFO ] [MAIN ] MCY: Loaded 24642 existing records. [2025-09-30T19:49:15.189328] [DEBUG] [LOCAL ] MD: Loaded 38420 existing records from primary storage. [2025-09-30T19:49:15.239177] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-30T19:49:15.249934] [INFO ] [MAIN ] MD: Loaded 38420 existing records. [2025-09-30T19:49:15.250535] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-30T19:49:15.249575] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.250859] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.326525] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-30T19:49:15.447377] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-30T19:49:15.556015] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-30T19:49:15.555910] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.586284] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.607874] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-30T19:49:15.702883] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-30T19:49:15.762460] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-30T19:49:15.833659] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.895563] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.931459] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-30T19:49:15.921742] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:16.000409] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-30T19:49:16.027442] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-30T19:49:16.053562] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-30T19:49:16.072087] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-30T19:49:16.196686] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-30T19:49:16.252595] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-30T19:49:16.840000] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:16.882288] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-30T19:49:17.057313] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.120729] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-30T19:49:17.380324] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.380864] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-30T19:49:17.477596] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.478639] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-30T19:49:17.624420] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:49:17.626605] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-30T19:49:18.290532] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:49:18.292637] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-30T19:49:18.425255] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:49:18.431544] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-30T19:49:18.906537] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T19:49:18.908971] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-30T19:49:18.976785] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:49:19.364993] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T19:49:19.454330] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-30T19:49:19.501350] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:49:19.583349] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:49:20.254396] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-30T19:49:21.015694] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:49:21.054329] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-30T19:49:21.458585] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T19:49:21.854353] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-30T19:49:22.073988] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:49:22.654370] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-30T19:49:23.197566] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:49:23.454403] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-30T19:49:23.757122] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:49:24.254369] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-30T19:49:25.054344] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-30T19:49:25.183369] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:49:25.505324] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T19:49:25.537756] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T19:49:25.854371] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-30T19:49:26.654369] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-30T19:49:27.161181] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:49:27.454350] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-30T19:49:28.254341] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-30T19:49:28.572194] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:49:28.888509] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T19:49:28.951398] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:49:29.054373] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-30T19:49:29.854399] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-30T19:49:30.480382] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T19:49:30.654353] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-30T19:49:30.815475] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T19:49:31.454416] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-30T19:49:32.052340] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:49:32.153493] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T19:49:32.254351] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-30T19:49:33.054375] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-30T19:49:33.817436] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:49:33.854305] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-30T19:49:33.888240] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T19:49:34.654350] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-30T19:49:35.180054] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T19:49:35.365882] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:49:35.454395] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-30T19:49:36.254362] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-30T19:49:36.612840] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T19:49:37.054400] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-30T19:49:37.854349] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-30T19:49:37.908236] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T19:49:37.910686] [INFO ] [REMOTE ] MDST: Full fetch complete (8583 records). [2025-09-30T19:49:37.910763] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-30T19:49:38.310836] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-30T19:49:38.310923] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-30T19:49:38.311279] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-30T19:49:38.311362] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-30T19:49:38.311980] [DEBUG] [LOCAL ] MDST: Trimmed 8583 records to 5641 (keeping 200 days of data) [2025-09-30T19:49:38.377391] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T19:49:38.398899] [DEBUG] [LOCAL ] MDST: Primary data saved (5641 records). [2025-09-30T19:49:38.399026] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-30T19:49:38.399129] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 24.4s. Estimated remaining: 2h 14m 47s. Rate: 7.8 symbols/min [2025-09-30T19:49:38.586754] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:38.648083] [DEBUG] [LOCAL ] MDU: Loaded 47900 existing records from primary storage. [2025-09-30T19:49:38.648433] [INFO ] [MAIN ] MDU: Loaded 47900 existing records. [2025-09-30T19:49:38.659683] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-30T19:49:38.853461] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:38.853795] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-30T19:49:38.853848] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-30T19:49:38.854382] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-30T19:49:38.854441] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-30T19:49:39.186104] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:49:39.280754] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:39.454359] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-30T19:49:40.206129] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:49:40.254417] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-30T19:49:41.011462] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:49:41.054346] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-30T19:49:41.475100] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:49:41.479815] [INFO ] [REMOTE ] MCY: Full fetch complete (41507 records). [2025-09-30T19:49:41.479913] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-30T19:49:41.872861] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-30T19:49:41.891072] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-30T19:49:41.891162] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-30T19:49:41.892046] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-30T19:49:41.892227] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-30T19:49:41.893447] [DEBUG] [LOCAL ] MCY: Trimmed 41507 records to 24490 (keeping 200 days of data) [2025-09-30T19:49:42.061830] [DEBUG] [LOCAL ] MCY: Primary data saved (24490 records). [2025-09-30T19:49:42.061973] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-30T19:49:42.062094] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 28.1s. Estimated remaining: 2h 14m 37s. Rate: 7.8 symbols/min [2025-09-30T19:49:42.237752] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:42.247699] [DEBUG] [LOCAL ] MDV: Loaded 8553 existing records from primary storage. [2025-09-30T19:49:42.247909] [INFO ] [MAIN ] MDV: Loaded 8553 existing records. [2025-09-30T19:49:42.433301] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:42.433551] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-30T19:49:42.433627] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-30T19:49:42.434079] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-30T19:49:42.434137] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-30T19:49:42.668775] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-30T19:49:42.830607] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:42.866186] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:49:43.336059] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:49:43.454363] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-30T19:49:44.254385] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-30T19:49:44.350542] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T19:49:44.724294] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T19:49:45.054333] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-30T19:49:45.088612] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:49:45.697803] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:49:45.854357] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-30T19:49:46.447430] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:49:46.654359] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-30T19:49:47.454360] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-30T19:49:47.486502] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T19:49:48.254362] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-30T19:49:48.905973] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:49:48.914152] [INFO ] [REMOTE ] MD: Full fetch complete (55143 records). [2025-09-30T19:49:48.914266] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-30T19:49:49.066230] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-30T19:49:49.334556] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-30T19:49:49.334677] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-30T19:49:49.335613] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-30T19:49:49.335697] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-30T19:49:49.337019] [DEBUG] [LOCAL ] MD: Trimmed 55143 records to 38339 (keeping 200 days of data) [2025-09-30T19:49:49.588444] [DEBUG] [LOCAL ] MD: Primary data saved (38339 records). [2025-09-30T19:49:49.588590] [INFO ] [MAIN ] MD: Full history saved. [2025-09-30T19:49:49.588707] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 35.6s. Estimated remaining: 2h 14m 29s. Rate: 7.8 symbols/min [2025-09-30T19:49:49.777283] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:49.817578] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:49:49.836819] [DEBUG] [LOCAL ] MEC: Loaded 16296 existing records from primary storage. [2025-09-30T19:49:49.837091] [INFO ] [MAIN ] MEC: Loaded 16296 existing records. [2025-09-30T19:49:49.859748] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-30T19:49:49.975781] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:49:50.048214] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:50.048466] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-30T19:49:50.048517] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-30T19:49:50.048887] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-30T19:49:50.048949] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-30T19:49:50.434041] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:50.654368] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-30T19:49:51.432970] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:49:51.454385] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-30T19:49:51.903595] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T19:49:51.916262] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-30T19:49:51.916425] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-30T19:49:52.060423] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T19:49:52.259529] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-30T19:49:52.373350] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-30T19:49:52.373444] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-30T19:49:52.374521] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-30T19:49:52.374596] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-30T19:49:52.378777] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-30T19:49:52.733514] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-30T19:49:52.733686] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-30T19:49:52.733791] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 38.8s. Estimated remaining: 2h 14m 17s. Rate: 7.8 symbols/min [2025-09-30T19:49:52.919880] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:52.944113] [DEBUG] [LOCAL ] MED: Loaded 21598 existing records from primary storage. [2025-09-30T19:49:52.944409] [INFO ] [MAIN ] MED: Loaded 21598 existing records. [2025-09-30T19:49:53.054665] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-30T19:49:53.140855] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:53.141238] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-30T19:49:53.141289] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-30T19:49:53.141634] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-30T19:49:53.141721] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-30T19:49:53.346953] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:49:53.549700] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:53.854442] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-30T19:49:54.466285] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:49:54.654374] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-30T19:49:55.052620] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:49:55.415001] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:49:55.454374] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-30T19:49:56.254352] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-30T19:49:56.316341] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:49:57.054351] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-30T19:49:57.781791] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:49:57.854330] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-30T19:49:57.970199] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T19:49:58.654389] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-30T19:49:58.833741] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:49:59.417887] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:49:59.454347] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-30T19:50:00.254354] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-30T19:50:00.453834] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T19:50:01.054411] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-30T19:50:01.762915] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:50:01.792235] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T19:50:01.854411] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-30T19:50:02.654374] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-30T19:50:03.032844] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:50:03.096473] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:50:03.454431] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-30T19:50:04.254419] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-30T19:50:04.687516] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T19:50:05.054394] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-30T19:50:05.854336] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-30T19:50:05.896828] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:50:06.054474] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:50:06.595457] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:50:06.597355] [INFO ] [REMOTE ] MDV: Full fetch complete (11606 records). [2025-09-30T19:50:06.597429] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-30T19:50:06.661350] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-30T19:50:06.987124] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-30T19:50:06.987200] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-30T19:50:06.987492] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-30T19:50:06.987530] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-30T19:50:06.988031] [DEBUG] [LOCAL ] MDV: Trimmed 11606 records to 8512 (keeping 200 days of data) [2025-09-30T19:50:07.041840] [DEBUG] [LOCAL ] MDV: Primary data saved (8512 records). [2025-09-30T19:50:07.041987] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-30T19:50:07.042070] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 25.0s. Estimated remaining: 2h 14m 15s. Rate: 7.8 symbols/min [2025-09-30T19:50:07.227279] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:07.267865] [DEBUG] [LOCAL ] MEG: Loaded 31838 existing records from primary storage. [2025-09-30T19:50:07.268225] [INFO ] [MAIN ] MEG: Loaded 31838 existing records. [2025-09-30T19:50:07.459836] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-30T19:50:07.464923] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:07.465883] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-30T19:50:07.465938] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-30T19:50:07.466363] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-30T19:50:07.466434] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-30T19:50:07.856805] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:08.258068] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-30T19:50:08.263968] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:50:08.725300] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:50:09.001014] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:50:09.054374] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-30T19:50:09.854368] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-30T19:50:10.143788] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T19:50:10.654358] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-30T19:50:11.405900] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:50:11.454328] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-30T19:50:11.748280] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:50:12.254392] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-30T19:50:12.777088] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:50:13.054400] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-30T19:50:13.854372] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-30T19:50:14.106345] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:50:14.240497] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T19:50:14.654338] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-30T19:50:14.780214] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T19:50:15.454335] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-30T19:50:15.677438] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T19:50:16.254374] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-30T19:50:16.477912] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T19:50:17.054422] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-30T19:50:17.854373] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-30T19:50:17.974197] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:50:18.025240] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:50:18.654376] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-30T19:50:18.947039] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T19:50:18.951490] [INFO ] [REMOTE ] MED: Full fetch complete (32659 records). [2025-09-30T19:50:18.951613] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-30T19:50:19.366578] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-30T19:50:19.366690] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-30T19:50:19.367429] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-30T19:50:19.367485] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-30T19:50:19.368364] [DEBUG] [LOCAL ] MED: Trimmed 32659 records to 21517 (keeping 200 days of data) [2025-09-30T19:50:19.459220] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-30T19:50:19.510094] [DEBUG] [LOCAL ] MED: Primary data saved (21517 records). [2025-09-30T19:50:19.510240] [INFO ] [MAIN ] MED: Full history saved. [2025-09-30T19:50:19.510338] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MED took 26.8s. Estimated remaining: 2h 14m 11s. Rate: 7.8 symbols/min [2025-09-30T19:50:19.698945] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:19.714960] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T19:50:19.719926] [INFO ] [REMOTE ] MEC: Full fetch complete (22820 records). [2025-09-30T19:50:19.720060] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-30T19:50:19.864022] [DEBUG] [LOCAL ] MEGI: Loaded 20146 existing records from primary storage. [2025-09-30T19:50:19.870153] [INFO ] [MAIN ] MEGI: Loaded 20146 existing records. [2025-09-30T19:50:20.271050] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:20.293911] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-30T19:50:20.299258] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-30T19:50:20.285594] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-30T19:50:20.313477] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-30T19:50:20.334694] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-30T19:50:20.578945] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-30T19:50:20.610260] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-30T19:50:20.617781] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-30T19:50:20.635879] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-30T19:50:20.682111] [DEBUG] [LOCAL ] MEC: Trimmed 22820 records to 16312 (keeping 200 days of data) [2025-09-30T19:50:20.953789] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:20.996882] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:50:21.011817] [DEBUG] [LOCAL ] MEC: Primary data saved (16312 records). [2025-09-30T19:50:21.011950] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-30T19:50:21.012047] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 31.4s. Estimated remaining: 2h 13m 58s. Rate: 7.8 symbols/min [2025-09-30T19:50:21.059488] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-30T19:50:21.195958] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:21.232771] [DEBUG] [LOCAL ] MEI: Loaded 32162 existing records from primary storage. [2025-09-30T19:50:21.233052] [INFO ] [MAIN ] MEI: Loaded 32162 existing records. [2025-09-30T19:50:21.421604] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:21.421847] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-30T19:50:21.421958] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-30T19:50:21.422337] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-30T19:50:21.422400] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-30T19:50:21.818275] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:21.848154] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T19:50:21.858288] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-30T19:50:21.860040] [INFO ] [REMOTE ] MDU: Full fetch complete (70325 records). [2025-09-30T19:50:21.860138] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-30T19:50:22.289684] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-30T19:50:22.289871] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-30T19:50:22.290912] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-30T19:50:22.291078] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-30T19:50:22.292842] [DEBUG] [LOCAL ] MDU: Trimmed 70325 records to 47904 (keeping 200 days of data) [2025-09-30T19:50:22.541530] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:50:22.640352] [DEBUG] [LOCAL ] MDU: Primary data saved (47904 records). [2025-09-30T19:50:22.640500] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-30T19:50:22.640589] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MDU took 44.2s. Estimated remaining: 2h 13m 46s. Rate: 7.8 symbols/min [2025-09-30T19:50:22.663492] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-30T19:50:22.829286] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:22.889402] [DEBUG] [LOCAL ] MET: Loaded 53311 existing records from primary storage. [2025-09-30T19:50:22.889910] [INFO ] [MAIN ] MET: Loaded 53311 existing records. [2025-09-30T19:50:23.099351] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:23.099692] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-30T19:50:23.099753] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-30T19:50:23.100533] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-30T19:50:23.100594] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-30T19:50:23.350195] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:50:23.459470] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-30T19:50:23.522083] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:24.103781] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:50:24.254356] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-30T19:50:24.491026] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:50:25.054383] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-30T19:50:25.346887] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:50:25.854388] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-30T19:50:26.654373] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-30T19:50:26.804949] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T19:50:26.917337] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T19:50:27.454407] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-30T19:50:27.855722] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:50:28.104881] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T19:50:28.254354] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-30T19:50:29.054380] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-30T19:50:29.850759] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:50:29.861006] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-30T19:50:30.177413] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:50:30.654387] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-30T19:50:31.124696] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T19:50:31.264228] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:50:31.454405] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-30T19:50:32.254413] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-30T19:50:32.927356] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:50:32.934953] [INFO ] [REMOTE ] MEG: Full fetch complete (48003 records). [2025-09-30T19:50:32.935081] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-30T19:50:33.057978] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-30T19:50:33.301418] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:50:33.406489] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-30T19:50:33.406571] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-30T19:50:33.407432] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-30T19:50:33.407530] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-30T19:50:33.409027] [DEBUG] [LOCAL ] MEG: Trimmed 48003 records to 31793 (keeping 200 days of data) [2025-09-30T19:50:33.611112] [DEBUG] [LOCAL ] MEG: Primary data saved (31793 records). [2025-09-30T19:50:33.611293] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-30T19:50:33.611390] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 26.6s. Estimated remaining: 2h 13m 41s. Rate: 7.8 symbols/min [2025-09-30T19:50:33.810634] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:33.858626] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-30T19:50:33.862699] [DEBUG] [LOCAL ] MFA: Loaded 45387 existing records from primary storage. [2025-09-30T19:50:33.863251] [INFO ] [MAIN ] MFA: Loaded 45387 existing records. [2025-09-30T19:50:34.060581] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:34.060827] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-30T19:50:34.060876] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-30T19:50:34.061275] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-30T19:50:34.061334] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-30T19:50:34.381536] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:50:34.470370] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:34.654382] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-30T19:50:34.757022] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T19:50:35.454371] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-30T19:50:36.184820] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T19:50:36.254368] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-30T19:50:36.590512] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:50:37.054357] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-30T19:50:37.854348] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-30T19:50:38.029373] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:50:38.490353] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:50:38.654370] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-30T19:50:39.454427] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-30T19:50:39.503132] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:50:39.786006] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T19:50:40.254364] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-30T19:50:41.054325] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-30T19:50:41.414136] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T19:50:41.458804] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:50:41.854426] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-30T19:50:42.185512] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:50:42.654406] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-30T19:50:43.454374] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-30T19:50:43.691633] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:50:44.254367] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-30T19:50:44.351320] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:50:44.356261] [INFO ] [REMOTE ] MEGI: Full fetch complete (30501 records). [2025-09-30T19:50:44.356490] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-30T19:50:44.809292] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-30T19:50:44.809436] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-30T19:50:44.810405] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-30T19:50:44.810525] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-30T19:50:44.812123] [DEBUG] [LOCAL ] MEGI: Trimmed 30501 records to 20119 (keeping 200 days of data) [2025-09-30T19:50:44.943766] [DEBUG] [LOCAL ] MEGI: Primary data saved (20119 records). [2025-09-30T19:50:44.943906] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-30T19:50:44.944137] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 25.4s. Estimated remaining: 2h 13m 36s. Rate: 7.8 symbols/min [2025-09-30T19:50:45.059529] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-30T19:50:45.124440] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:45.131194] [DEBUG] [LOCAL ] MFAN: Loaded 4198 existing records from primary storage. [2025-09-30T19:50:45.131389] [INFO ] [MAIN ] MFAN: Loaded 4198 existing records. [2025-09-30T19:50:45.320531] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:45.320953] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-30T19:50:45.321107] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-30T19:50:45.321312] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-30T19:50:45.321390] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-30T19:50:45.728492] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T19:50:45.734360] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:45.854356] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-30T19:50:46.325919] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (3.67 seconds). [2025-09-30T19:50:46.654331] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-30T19:50:46.829955] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:50:47.400761] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:50:47.454329] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-30T19:50:48.143960] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:50:48.254339] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-30T19:50:49.054373] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-30T19:50:49.202530] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:50:49.854367] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-30T19:50:50.046608] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:50:50.311560] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T19:50:50.367233] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T19:50:50.654355] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-30T19:50:51.230470] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:50:51.454352] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-30T19:50:52.254391] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-30T19:50:52.921032] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:50:52.929034] [INFO ] [REMOTE ] MEI: Full fetch complete (45426 records). [2025-09-30T19:50:52.929193] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-30T19:50:53.059507] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-30T19:50:53.355369] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-30T19:50:53.355455] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-30T19:50:53.356330] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-30T19:50:53.356414] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-30T19:50:53.357683] [DEBUG] [LOCAL ] MEI: Trimmed 45426 records to 32087 (keeping 200 days of data) [2025-09-30T19:50:53.564997] [DEBUG] [LOCAL ] MEI: Primary data saved (32087 records). [2025-09-30T19:50:53.565181] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-30T19:50:53.567404] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 32.6s. Estimated remaining: 2h 13m 29s. Rate: 7.8 symbols/min [2025-09-30T19:50:53.771072] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:53.783518] [DEBUG] [LOCAL ] MFAO: Loaded 3789 existing records from primary storage. [2025-09-30T19:50:53.783860] [INFO ] [MAIN ] MFAO: Loaded 3789 existing records. [2025-09-30T19:50:53.860205] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-30T19:50:54.028613] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:54.031299] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-30T19:50:54.031409] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-30T19:50:54.031125] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T19:50:54.040664] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-30T19:50:54.040748] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-30T19:50:54.463363] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:54.504219] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:50:54.569911] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T19:50:54.654368] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-30T19:50:54.969060] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-30T19:50:55.454409] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-30T19:50:55.846926] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-30T19:50:56.254417] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-30T19:50:57.054386] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-30T19:50:57.709354] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T19:50:57.739223] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T19:50:57.854412] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-30T19:50:58.286812] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T19:50:58.654404] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-30T19:50:59.454376] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-30T19:51:00.254348] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-30T19:51:00.362269] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:51:00.842721] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:51:01.054394] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-30T19:51:01.275881] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:51:01.417975] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T19:51:01.854574] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-30T19:51:02.654390] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-30T19:51:03.216937] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:51:03.452891] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:51:03.461900] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-30T19:51:04.022513] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T19:51:04.254389] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-30T19:51:05.054390] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-30T19:51:05.635504] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:51:05.854364] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-30T19:51:06.156615] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T19:51:06.166581] [INFO ] [REMOTE ] MFA: Full fetch complete (65101 records). [2025-09-30T19:51:06.166766] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-30T19:51:06.483907] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T19:51:06.636540] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-30T19:51:06.636629] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-30T19:51:06.637699] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-30T19:51:06.637777] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-30T19:51:06.639237] [DEBUG] [LOCAL ] MFA: Trimmed 65101 records to 45453 (keeping 200 days of data) [2025-09-30T19:51:06.704442] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-30T19:51:06.935305] [DEBUG] [LOCAL ] MFA: Primary data saved (45453 records). [2025-09-30T19:51:06.935442] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-30T19:51:06.935607] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFA took 33.3s. Estimated remaining: 2h 13m 26s. Rate: 7.8 symbols/min [2025-09-30T19:51:07.129922] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:07.197338] [DEBUG] [LOCAL ] MFC: Loaded 51201 existing records from primary storage. [2025-09-30T19:51:07.197875] [INFO ] [MAIN ] MFC: Loaded 51201 existing records. [2025-09-30T19:51:07.313688] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T19:51:07.403860] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:07.404129] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-30T19:51:07.404199] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-30T19:51:07.404963] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-30T19:51:07.405040] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-30T19:51:07.459551] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-30T19:51:07.821828] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:08.254366] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-30T19:51:08.792887] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T19:51:09.054336] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-30T19:51:09.184809] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T19:51:09.196949] [INFO ] [REMOTE ] MET: Full fetch complete (77117 records). [2025-09-30T19:51:09.197165] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-30T19:51:09.624090] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-30T19:51:09.624200] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-30T19:51:09.625372] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-30T19:51:09.625457] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-30T19:51:09.627193] [DEBUG] [LOCAL ] MET: Trimmed 77117 records to 53310 (keeping 200 days of data) [2025-09-30T19:51:09.857395] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-30T19:51:09.986089] [DEBUG] [LOCAL ] MET: Primary data saved (53310 records). [2025-09-30T19:51:09.986275] [INFO ] [MAIN ] MET: Full history saved. [2025-09-30T19:51:09.986457] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MET took 47.3s. Estimated remaining: 2h 13m 14s. Rate: 7.8 symbols/min [2025-09-30T19:51:10.166994] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:10.216450] [DEBUG] [LOCAL ] MFG: Loaded 49118 existing records from primary storage. [2025-09-30T19:51:10.216803] [INFO ] [MAIN ] MFG: Loaded 49118 existing records. [2025-09-30T19:51:10.426493] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:10.426947] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-30T19:51:10.427006] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-30T19:51:10.432212] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-30T19:51:10.432355] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-30T19:51:10.474897] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T19:51:10.666265] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-30T19:51:10.883013] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:10.914660] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T19:51:11.314342] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T19:51:11.454408] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-30T19:51:12.031390] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T19:51:12.254403] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-30T19:51:13.054376] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-30T19:51:13.854325] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-30T19:51:13.862785] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:51:13.864470] [INFO ] [REMOTE ] MFAN: Full fetch complete (5656 records). [2025-09-30T19:51:13.865105] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-30T19:51:14.085000] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T19:51:14.369497] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-30T19:51:14.369574] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-30T19:51:14.369748] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-30T19:51:14.369810] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-30T19:51:14.370192] [DEBUG] [LOCAL ] MFAN: Trimmed 5656 records to 4223 (keeping 200 days of data) [2025-09-30T19:51:14.395595] [DEBUG] [LOCAL ] MFAN: Primary data saved (4223 records). [2025-09-30T19:51:14.395728] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-30T19:51:14.395857] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAN took 29.5s. Estimated remaining: 2h 13m 4s. Rate: 7.8 symbols/min [2025-09-30T19:51:14.643483] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:14.654489] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-30T19:51:14.669100] [DEBUG] [LOCAL ] MFM: Loaded 14381 existing records from primary storage. [2025-09-30T19:51:14.669360] [INFO ] [MAIN ] MFM: Loaded 14381 existing records. [2025-09-30T19:51:14.883011] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:14.883392] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-30T19:51:14.883458] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-30T19:51:14.884123] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-30T19:51:14.884187] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-30T19:51:15.321886] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T19:51:15.326068] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:15.331030] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:51:15.328731] [INFO ] [REMOTE ] MFAO: Full fetch complete (5268 records). [2025-09-30T19:51:15.340403] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-30T19:51:15.456304] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-30T19:51:15.740520] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-30T19:51:15.740599] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-30T19:51:15.740779] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-30T19:51:15.740842] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-30T19:51:15.741236] [DEBUG] [LOCAL ] MFAO: Trimmed 5268 records to 3793 (keeping 200 days of data) [2025-09-30T19:51:15.764873] [DEBUG] [LOCAL ] MFAO: Primary data saved (3793 records). [2025-09-30T19:51:15.765002] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-30T19:51:15.765086] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFAO took 22.2s. Estimated remaining: 2h 12m 52s. Rate: 7.8 symbols/min [2025-09-30T19:51:15.948365] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:15.948544] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-30T19:51:15.948583] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-30T19:51:15.948727] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-30T19:51:15.948783] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-30T19:51:15.948827] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-30T19:51:15.948860] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-30T19:51:16.259469] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-30T19:51:16.316231] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T19:51:16.351916] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:17.054401] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-30T19:51:17.690915] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T19:51:17.719899] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T19:51:17.854388] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-30T19:51:18.654358] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-30T19:51:18.961058] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-30T19:51:19.225061] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T19:51:19.454378] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-30T19:51:20.166656] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T19:51:20.254298] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-30T19:51:21.054359] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-30T19:51:21.842456] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:51:21.854298] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-30T19:51:22.022106] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:51:22.654362] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-30T19:51:22.732749] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:51:23.454379] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-30T19:51:24.108764] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:51:24.254369] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-30T19:51:24.497570] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T19:51:25.054380] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-30T19:51:25.711837] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:51:25.854395] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-30T19:51:25.899595] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T19:51:26.060045] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-30T19:51:26.654367] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-30T19:51:27.454358] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-30T19:51:28.021666] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T19:51:28.254377] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-30T19:51:28.451920] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:51:29.054371] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-30T19:51:29.854334] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-30T19:51:29.881630] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:51:29.956042] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:51:30.158726] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-30T19:51:30.654373] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-30T19:51:30.850774] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-30T19:51:31.454367] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-30T19:51:31.790856] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T19:51:32.254349] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-30T19:51:32.903811] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T19:51:33.054336] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-30T19:51:33.762772] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:51:33.854367] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-30T19:51:34.112746] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-30T19:51:34.654395] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-30T19:51:35.454403] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-30T19:51:36.254406] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-30T19:51:36.321308] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:51:36.520144] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T19:51:36.524551] [INFO ] [REMOTE ] MFM: Full fetch complete (19325 records). [2025-09-30T19:51:36.524688] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-30T19:51:36.917906] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-30T19:51:36.918070] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-30T19:51:36.918638] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-30T19:51:36.918747] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-30T19:51:36.919688] [DEBUG] [LOCAL ] MFM: Trimmed 19325 records to 14379 (keeping 200 days of data) [2025-09-30T19:51:37.007282] [DEBUG] [LOCAL ] MFM: Primary data saved (14379 records). [2025-09-30T19:51:37.007432] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-30T19:51:37.007519] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 22.6s. Estimated remaining: 2h 12m 54s. Rate: 7.8 symbols/min [2025-09-30T19:51:37.059493] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-30T19:51:37.196338] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:37.204599] [DEBUG] [LOCAL ] MFSG: Loaded 5270 existing records from primary storage. [2025-09-30T19:51:37.204844] [INFO ] [MAIN ] MFSG: Loaded 5270 existing records. [2025-09-30T19:51:37.393088] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:37.393337] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-30T19:51:37.393386] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-30T19:51:37.393559] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-30T19:51:37.393618] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-30T19:51:37.784602] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:37.854363] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-30T19:51:37.918685] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:51:38.328000] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:51:38.654395] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-30T19:51:38.942537] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T19:51:39.454373] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-30T19:51:40.146477] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T19:51:40.148566] [INFO ] [REMOTE ] MFSB: Full fetch complete (1649 records). [2025-09-30T19:51:40.148709] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-30T19:51:40.256574] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-30T19:51:40.380905] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-30T19:51:40.381115] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:51:40.381199] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:51:40.381464] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-30T19:51:40.381708] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-30T19:51:40.381835] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-30T19:51:40.381949] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-30T19:51:40.382052] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFSB took 24.6s. Estimated remaining: 2h 12m 43s. Rate: 7.8 symbols/min [2025-09-30T19:51:40.595894] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:40.599208] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T19:51:40.628556] [DEBUG] [LOCAL ] MFSI: Loaded 11308 existing records from primary storage. [2025-09-30T19:51:40.628834] [INFO ] [MAIN ] MFSI: Loaded 11308 existing records. [2025-09-30T19:51:40.820615] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:40.820869] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-30T19:51:40.820919] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-30T19:51:40.821250] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-30T19:51:40.821309] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-30T19:51:41.064574] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-30T19:51:41.228431] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:41.854340] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-30T19:51:41.900595] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:51:42.396721] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T19:51:42.654347] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-30T19:51:42.893453] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:51:43.454366] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-30T19:51:44.254333] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-30T19:51:44.344951] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:51:44.616441] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T19:51:45.054373] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-30T19:51:45.109620] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:51:45.627436] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:51:45.854359] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-30T19:51:46.266809] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T19:51:46.654351] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-30T19:51:47.098906] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T19:51:47.454358] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-30T19:51:48.254343] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-30T19:51:49.054856] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-30T19:51:49.342572] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:51:49.356208] [INFO ] [REMOTE ] MFC: Full fetch complete (74188 records). [2025-09-30T19:51:49.356434] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-30T19:51:49.722054] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T19:51:49.871532] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-30T19:51:49.872181] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-30T19:51:49.873316] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-30T19:51:49.874500] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-30T19:51:49.874720] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-30T19:51:49.876577] [DEBUG] [LOCAL ] MFC: Trimmed 74188 records to 51177 (keeping 200 days of data) [2025-09-30T19:51:50.006060] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T19:51:50.020520] [INFO ] [REMOTE ] MFG: Full fetch complete (68741 records). [2025-09-30T19:51:50.024534] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-30T19:51:50.264588] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T19:51:50.601117] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-30T19:51:50.602852] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-30T19:51:50.604482] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-30T19:51:50.604858] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-30T19:51:50.609086] [DEBUG] [LOCAL ] MFG: Trimmed 68741 records to 49131 (keeping 200 days of data) [2025-09-30T19:51:50.665973] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-30T19:51:50.943106] [DEBUG] [LOCAL ] MFC: Primary data saved (51177 records). [2025-09-30T19:51:50.945223] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-30T19:51:50.945592] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFC took 44.0s. Estimated remaining: 2h 12m 38s. Rate: 7.8 symbols/min [2025-09-30T19:51:51.138999] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:51.146114] [DEBUG] [LOCAL ] MFSV: Loaded 2499 existing records from primary storage. [2025-09-30T19:51:51.146835] [INFO ] [MAIN ] MFSV: Loaded 2499 existing records. [2025-09-30T19:51:51.315058] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T19:51:51.405518] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:51.406629] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-30T19:51:51.406731] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-30T19:51:51.407717] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-30T19:51:51.408029] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-30T19:51:51.459204] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-30T19:51:51.530913] [DEBUG] [LOCAL ] MFG: Primary data saved (49131 records). [2025-09-30T19:51:51.534161] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-30T19:51:51.545196] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFG took 41.6s. Estimated remaining: 2h 12m 25s. Rate: 7.8 symbols/min [2025-09-30T19:51:51.972769] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:51:52.031007] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:52.044688] [DEBUG] [LOCAL ] MG: Loaded 16410 existing records from primary storage. [2025-09-30T19:51:52.044973] [INFO ] [MAIN ] MG: Loaded 16410 existing records. [2025-09-30T19:51:52.157085] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T19:51:52.259438] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-30T19:51:52.263728] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:51:52.264710] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-30T19:51:52.264812] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-30T19:51:52.265095] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-30T19:51:52.265157] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-30T19:51:52.675294] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:51:52.941274] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:51:53.054402] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-30T19:51:53.460537] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T19:51:53.854394] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-30T19:51:54.451792] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T19:51:54.654391] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-30T19:51:55.258164] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:51:55.454379] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-30T19:51:56.160287] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T19:51:56.254362] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-30T19:51:57.054342] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-30T19:51:57.196489] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:51:57.854318] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-30T19:51:58.089188] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T19:51:58.654329] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-30T19:51:58.774849] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:51:59.454354] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-30T19:51:59.623846] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:52:00.092577] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T19:52:00.254403] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-30T19:52:01.007192] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:52:01.054343] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-30T19:52:01.854357] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-30T19:52:01.882030] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T19:52:01.884300] [INFO ] [REMOTE ] MFSG: Full fetch complete (6027 records). [2025-09-30T19:52:01.884375] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-30T19:52:02.273240] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-30T19:52:02.273358] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-30T19:52:02.273557] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-30T19:52:02.273600] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-30T19:52:02.274041] [DEBUG] [LOCAL ] MFSG: Trimmed 6027 records to 5340 (keeping 200 days of data) [2025-09-30T19:52:02.310597] [DEBUG] [LOCAL ] MFSG: Primary data saved (5340 records). [2025-09-30T19:52:02.310747] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-30T19:52:02.310841] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 25.3s. Estimated remaining: 2h 12m 19s. Rate: 7.8 symbols/min [2025-09-30T19:52:02.493769] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:02.576324] [DEBUG] [LOCAL ] MGA: Loaded 50645 existing records from primary storage. [2025-09-30T19:52:02.576731] [INFO ] [MAIN ] MGA: Loaded 50645 existing records. [2025-09-30T19:52:02.658364] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-30T19:52:02.778171] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:02.778498] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-30T19:52:02.778565] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-30T19:52:02.779120] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-30T19:52:02.779182] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-30T19:52:02.950584] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T19:52:02.966073] [INFO ] [REMOTE ] MFSI: Full fetch complete (13578 records). [2025-09-30T19:52:02.978287] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-30T19:52:03.102396] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T19:52:03.415832] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:03.462594] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-30T19:52:03.700500] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-30T19:52:03.700577] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-30T19:52:03.700891] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-30T19:52:03.700984] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-30T19:52:03.701551] [DEBUG] [LOCAL ] MFSI: Trimmed 13578 records to 11363 (keeping 200 days of data) [2025-09-30T19:52:03.779193] [DEBUG] [LOCAL ] MFSI: Primary data saved (11363 records). [2025-09-30T19:52:03.779333] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-30T19:52:03.779420] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 23.4s. Estimated remaining: 2h 12m 7s. Rate: 7.8 symbols/min [2025-09-30T19:52:03.941693] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T19:52:03.976089] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:03.982544] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-30T19:52:03.982745] [INFO ] [MAIN ] MGF: Loaded 4186 existing records. [2025-09-30T19:52:04.179259] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:04.179503] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-30T19:52:04.179557] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-30T19:52:04.179802] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-30T19:52:04.179860] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-30T19:52:04.259479] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-30T19:52:04.561528] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:04.743024] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T19:52:05.054361] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-30T19:52:05.854357] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-30T19:52:06.285858] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T19:52:06.654368] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-30T19:52:06.776290] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T19:52:06.980703] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T19:52:07.454433] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-30T19:52:07.886176] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-30T19:52:08.254364] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-30T19:52:09.054373] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-30T19:52:09.463589] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T19:52:09.831127] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:52:09.854387] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-30T19:52:10.276387] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:52:10.654402] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-30T19:52:11.287739] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T19:52:11.454418] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-30T19:52:12.254405] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-30T19:52:12.312775] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T19:52:12.672880] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T19:52:13.054386] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-30T19:52:13.593535] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T19:52:13.854401] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-30T19:52:14.654349] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-30T19:52:14.822673] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:52:15.291853] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T19:52:15.454348] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-30T19:52:16.254412] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-30T19:52:16.464666] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:52:16.907864] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T19:52:17.054376] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-30T19:52:17.854339] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-30T19:52:18.020092] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T19:52:18.413985] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T19:52:18.654413] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-30T19:52:19.111199] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-30T19:52:19.454429] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-30T19:52:20.034493] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T19:52:20.254483] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-30T19:52:20.910443] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T19:52:21.054430] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-30T19:52:21.854442] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-30T19:52:21.951755] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T19:52:22.563225] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:52:22.565098] [INFO ] [REMOTE ] MFSV: Full fetch complete (3165 records). [2025-09-30T19:52:22.565178] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-30T19:52:22.659515] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-30T19:52:22.959999] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-30T19:52:22.960115] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-30T19:52:22.960319] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-30T19:52:22.960361] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-30T19:52:22.960798] [DEBUG] [LOCAL ] MFSV: Trimmed 3165 records to 2521 (keeping 200 days of data) [2025-09-30T19:52:22.977714] [DEBUG] [LOCAL ] MFSV: Primary data saved (2521 records). [2025-09-30T19:52:22.977818] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-30T19:52:22.977906] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MFSV took 32.0s. Estimated remaining: 2h 12m 8s. Rate: 7.8 symbols/min [2025-09-30T19:52:23.171183] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:23.215793] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T19:52:23.238585] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-09-30T19:52:23.239012] [INFO ] [MAIN ] MGM: Loaded 53608 existing records. [2025-09-30T19:52:23.434181] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:23.434451] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-30T19:52:23.434512] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-30T19:52:23.435205] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-30T19:52:23.435267] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-30T19:52:23.464291] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-30T19:52:23.814878] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:24.156752] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:52:24.254403] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-30T19:52:24.958473] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T19:52:24.960070] [INFO ] [REMOTE ] MGF: Full fetch complete (5841 records). [2025-09-30T19:52:24.960147] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-30T19:52:25.059734] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-30T19:52:25.384615] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-30T19:52:25.384730] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-30T19:52:25.384913] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-30T19:52:25.384976] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-30T19:52:25.385414] [DEBUG] [LOCAL ] MGF: Trimmed 5841 records to 4201 (keeping 200 days of data) [2025-09-30T19:52:25.411785] [DEBUG] [LOCAL ] MGF: Primary data saved (4201 records). [2025-09-30T19:52:25.411918] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-30T19:52:25.412022] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 21.6s. Estimated remaining: 2h 11m 56s. Rate: 7.8 symbols/min [2025-09-30T19:52:25.597570] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:25.605562] [DEBUG] [LOCAL ] MGR: Loaded 5598 existing records from primary storage. [2025-09-30T19:52:25.605807] [INFO ] [MAIN ] MGR: Loaded 5598 existing records. [2025-09-30T19:52:25.811255] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:25.811547] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-30T19:52:25.811611] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-30T19:52:25.811889] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-30T19:52:25.811951] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-30T19:52:25.859517] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-30T19:52:26.113389] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T19:52:26.227968] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:26.654396] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-30T19:52:27.454415] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-30T19:52:27.579611] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:52:28.233550] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T19:52:28.254332] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-30T19:52:28.584266] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T19:52:28.799794] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T19:52:29.054364] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-30T19:52:29.854376] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-30T19:52:30.604571] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:52:30.654319] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-30T19:52:31.454341] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-30T19:52:31.606152] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T19:52:31.997635] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T19:52:32.254346] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-30T19:52:32.343038] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:52:33.054371] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-30T19:52:33.652980] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:52:33.854335] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-30T19:52:34.040939] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:52:34.654379] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-30T19:52:35.454344] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-30T19:52:35.822023] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:52:36.254327] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-30T19:52:36.376881] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T19:52:36.401819] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:52:36.405628] [INFO ] [REMOTE ] MG: Full fetch complete (24012 records). [2025-09-30T19:52:36.405810] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-30T19:52:36.811260] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-30T19:52:36.811346] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-30T19:52:36.811914] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-30T19:52:36.811979] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-30T19:52:36.812694] [DEBUG] [LOCAL ] MG: Trimmed 24012 records to 16406 (keeping 200 days of data) [2025-09-30T19:52:36.910379] [DEBUG] [LOCAL ] MG: Primary data saved (16406 records). [2025-09-30T19:52:36.910524] [INFO ] [MAIN ] MG: Full history saved. [2025-09-30T19:52:36.910611] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MG took 45.3s. Estimated remaining: 2h 11m 51s. Rate: 7.8 symbols/min [2025-09-30T19:52:37.064198] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-30T19:52:37.100092] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:37.107551] [DEBUG] [LOCAL ] MGRB: Loaded 4057 existing records from primary storage. [2025-09-30T19:52:37.108334] [INFO ] [MAIN ] MGRB: Loaded 4057 existing records. [2025-09-30T19:52:37.312007] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:37.312242] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-30T19:52:37.312290] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-30T19:52:37.312501] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-30T19:52:37.312561] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-30T19:52:37.658265] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:52:37.742635] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:37.862940] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-30T19:52:37.885014] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:52:38.282592] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T19:52:38.654365] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-30T19:52:39.454361] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-30T19:52:40.254349] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-30T19:52:40.620845] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:52:40.989120] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T19:52:41.054425] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-30T19:52:41.132559] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T19:52:41.644239] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T19:52:41.854371] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-30T19:52:42.654361] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-30T19:52:43.228937] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T19:52:43.454346] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-30T19:52:43.585867] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:52:44.254351] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-30T19:52:44.900322] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T19:52:45.054369] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-30T19:52:45.422998] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:52:45.854358] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-30T19:52:46.654329] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-30T19:52:46.709431] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:52:47.223239] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T19:52:47.461898] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-30T19:52:47.467808] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T19:52:48.254420] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-30T19:52:49.054358] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-30T19:52:49.361135] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T19:52:49.781191] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T19:52:49.854365] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-30T19:52:50.041434] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:52:50.052821] [INFO ] [REMOTE ] MGA: Full fetch complete (73702 records). [2025-09-30T19:52:50.052995] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-30T19:52:50.502964] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-30T19:52:50.503073] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-30T19:52:50.504183] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-30T19:52:50.504252] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-30T19:52:50.507052] [DEBUG] [LOCAL ] MGA: Trimmed 73702 records to 50634 (keeping 200 days of data) [2025-09-30T19:52:50.654431] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-30T19:52:50.869018] [DEBUG] [LOCAL ] MGA: Primary data saved (50634 records). [2025-09-30T19:52:50.869160] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-30T19:52:50.869259] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGA took 48.6s. Estimated remaining: 2h 11m 48s. Rate: 7.8 symbols/min [2025-09-30T19:52:51.052815] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:51.058171] [DEBUG] [LOCAL ] MGRD: Loaded 2194 existing records from primary storage. [2025-09-30T19:52:51.058340] [INFO ] [MAIN ] MGRD: Loaded 2194 existing records. [2025-09-30T19:52:51.251415] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:51.251686] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-30T19:52:51.251747] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-30T19:52:51.251982] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-30T19:52:51.252042] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-30T19:52:51.376983] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:52:51.461148] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-30T19:52:51.673081] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:51.757251] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T19:52:51.772843] [INFO ] [REMOTE ] MGM: Full fetch complete (77601 records). [2025-09-30T19:52:51.773018] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-30T19:52:52.209074] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-30T19:52:52.205313] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T19:52:52.209229] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-30T19:52:52.211838] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-30T19:52:52.212336] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-30T19:52:52.214318] [DEBUG] [LOCAL ] MGM: Trimmed 77601 records to 53608 (keeping 200 days of data) [2025-09-30T19:52:52.265898] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-30T19:52:52.551554] [DEBUG] [LOCAL ] MGM: Primary data saved (53608 records). [2025-09-30T19:52:52.551719] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-30T19:52:52.551882] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGM took 29.6s. Estimated remaining: 2h 11m 36s. Rate: 7.8 symbols/min [2025-09-30T19:52:52.784042] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:52.794724] [DEBUG] [LOCAL ] MGRE: Loaded 6643 existing records from primary storage. [2025-09-30T19:52:52.794940] [INFO ] [MAIN ] MGRE: Loaded 6643 existing records. [2025-09-30T19:52:52.933831] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T19:52:53.004814] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:53.005077] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-30T19:52:53.005127] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-30T19:52:53.005373] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-30T19:52:53.005451] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-30T19:52:53.063039] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-30T19:52:53.408427] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:53.854362] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-30T19:52:53.875913] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:52:53.877858] [INFO ] [REMOTE ] MGR: Full fetch complete (8295 records). [2025-09-30T19:52:53.877963] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-30T19:52:54.264909] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-30T19:52:54.264997] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-30T19:52:54.265227] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-30T19:52:54.265283] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-30T19:52:54.265952] [DEBUG] [LOCAL ] MGR: Trimmed 8295 records to 5591 (keeping 200 days of data) [2025-09-30T19:52:54.307836] [DEBUG] [LOCAL ] MGR: Primary data saved (5591 records). [2025-09-30T19:52:54.307992] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-30T19:52:54.308119] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGR took 28.9s. Estimated remaining: 2h 11m 24s. Rate: 7.8 symbols/min [2025-09-30T19:52:54.494829] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T19:52:54.517755] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:52:54.586365] [DEBUG] [LOCAL ] MGY: Loaded 52421 existing records from primary storage. [2025-09-30T19:52:54.586774] [INFO ] [MAIN ] MGY: Loaded 52421 existing records. [2025-09-30T19:52:54.659530] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-30T19:52:54.810413] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:52:54.810850] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-30T19:52:54.810937] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-30T19:52:54.812030] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-30T19:52:54.812144] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-30T19:52:55.243121] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:52:55.318266] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:52:55.454412] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-30T19:52:56.036081] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T19:52:56.254402] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-30T19:52:57.054377] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-30T19:52:57.391746] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T19:52:57.854374] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-30T19:52:57.921737] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:52:58.536499] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:52:58.654378] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-30T19:52:59.338670] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:52:59.454355] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-30T19:53:00.254418] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-30T19:53:00.766308] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T19:53:01.054382] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-30T19:53:01.108190] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:53:01.634702] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T19:53:01.854396] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-30T19:53:02.394163] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T19:53:02.654427] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-30T19:53:03.120292] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:53:03.454390] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-30T19:53:04.232241] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T19:53:04.254369] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-30T19:53:05.054368] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-30T19:53:05.604200] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T19:53:05.605333] [INFO ] [REMOTE ] MGRB: Full fetch complete (6163 records). [2025-09-30T19:53:05.605421] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-30T19:53:05.859512] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-30T19:53:06.005674] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:53:06.102897] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-30T19:53:06.102986] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-30T19:53:06.103180] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-30T19:53:06.103275] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-30T19:53:06.103716] [DEBUG] [LOCAL ] MGRB: Trimmed 6163 records to 4058 (keeping 200 days of data) [2025-09-30T19:53:06.129967] [DEBUG] [LOCAL ] MGRB: Primary data saved (4058 records). [2025-09-30T19:53:06.130105] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-30T19:53:06.130260] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRB took 29.2s. Estimated remaining: 2h 11m 19s. Rate: 7.8 symbols/min [2025-09-30T19:53:06.326199] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:06.326378] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-30T19:53:06.326564] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-30T19:53:06.326708] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-30T19:53:06.326761] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-30T19:53:06.326806] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-30T19:53:06.326887] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-30T19:53:06.608851] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:53:06.659455] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-30T19:53:06.743195] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:07.454365] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-30T19:53:07.668181] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:53:07.668525] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-30T19:53:07.668629] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:53:07.668736] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-30T19:53:07.668809] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:53:07.668890] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-30T19:53:07.668973] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-30T19:53:07.669034] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-30T19:53:07.669094] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-30T19:53:07.669170] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MH took 1.5s. Estimated remaining: 2h 11m 7s. Rate: 7.8 symbols/min [2025-09-30T19:53:07.855948] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:07.874600] [DEBUG] [LOCAL ] MHD: Loaded 12230 existing records from primary storage. [2025-09-30T19:53:07.874912] [INFO ] [MAIN ] MHD: Loaded 12230 existing records. [2025-09-30T19:53:08.064493] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:08.064757] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-30T19:53:08.064814] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-30T19:53:08.065049] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-30T19:53:08.065106] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-30T19:53:08.262536] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-30T19:53:08.447260] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:08.645362] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T19:53:08.649482] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T19:53:09.054448] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-30T19:53:09.726839] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T19:53:09.854413] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-30T19:53:10.587102] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T19:53:10.654358] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-30T19:53:11.394927] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T19:53:11.454330] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-30T19:53:12.254356] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-30T19:53:12.271923] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T19:53:12.274718] [INFO ] [REMOTE ] MGRE: Full fetch complete (9488 records). [2025-09-30T19:53:12.274797] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-30T19:53:12.635841] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-30T19:53:12.635943] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-30T19:53:12.636328] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-30T19:53:12.636372] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-30T19:53:12.636895] [DEBUG] [LOCAL ] MGRE: Trimmed 9488 records to 6679 (keeping 200 days of data) [2025-09-30T19:53:12.686234] [DEBUG] [LOCAL ] MGRE: Primary data saved (6679 records). [2025-09-30T19:53:12.686465] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-30T19:53:12.686629] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 20.1s. Estimated remaining: 2h 10m 57s. Rate: 7.8 symbols/min [2025-09-30T19:53:12.858314] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:12.870054] [DEBUG] [LOCAL ] MHF: Loaded 8646 existing records from primary storage. [2025-09-30T19:53:12.870272] [INFO ] [MAIN ] MHF: Loaded 8646 existing records. [2025-09-30T19:53:13.053261] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:13.053550] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-30T19:53:13.053624] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-30T19:53:13.054083] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-30T19:53:13.054157] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-30T19:53:13.064979] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-30T19:53:13.380682] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T19:53:13.450587] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:13.508684] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-30T19:53:13.854462] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-30T19:53:14.654426] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-30T19:53:15.187889] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T19:53:15.244764] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T19:53:15.454373] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-30T19:53:16.254400] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-30T19:53:17.009605] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T19:53:17.054342] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-30T19:53:17.152970] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:53:17.857879] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-30T19:53:17.858893] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T19:53:18.311301] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T19:53:18.654358] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-30T19:53:19.454370] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-30T19:53:19.578761] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T19:53:19.972002] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T19:53:20.254351] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-30T19:53:21.054349] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-30T19:53:21.106216] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:53:21.854366] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-30T19:53:22.654335] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-30T19:53:22.742263] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:53:22.822492] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:53:23.454338] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-30T19:53:23.505227] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:53:24.107097] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T19:53:24.254414] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-30T19:53:25.054359] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-30T19:53:25.854345] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-30T19:53:25.980407] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:53:26.012403] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:53:26.295495] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-30T19:53:26.654368] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-30T19:53:27.454370] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-30T19:53:28.254343] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-30T19:53:28.291033] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:53:28.324136] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T19:53:28.874629] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T19:53:29.054402] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-30T19:53:29.854334] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-30T19:53:30.152501] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T19:53:30.654370] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-30T19:53:30.695772] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:53:31.437116] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:53:31.454350] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-30T19:53:32.254337] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-30T19:53:32.464605] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T19:53:32.468425] [INFO ] [REMOTE ] MHD: Full fetch complete (18779 records). [2025-09-30T19:53:32.468507] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-30T19:53:32.875915] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-30T19:53:32.876104] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-30T19:53:32.876589] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-30T19:53:32.876732] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-30T19:53:32.877436] [DEBUG] [LOCAL ] MHD: Trimmed 18779 records to 12259 (keeping 200 days of data) [2025-09-30T19:53:32.958594] [DEBUG] [LOCAL ] MHD: Primary data saved (12259 records). [2025-09-30T19:53:32.958756] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-30T19:53:32.958895] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHD took 25.3s. Estimated remaining: 2h 10m 59s. Rate: 7.8 symbols/min [2025-09-30T19:53:33.059465] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-30T19:53:33.147627] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:33.196162] [DEBUG] [LOCAL ] MHK: Loaded 42333 existing records from primary storage. [2025-09-30T19:53:33.196482] [INFO ] [MAIN ] MHK: Loaded 42333 existing records. [2025-09-30T19:53:33.390930] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:33.391188] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-30T19:53:33.391246] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-30T19:53:33.391832] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-30T19:53:33.391928] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-30T19:53:33.780455] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:33.854331] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-30T19:53:34.015314] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:53:34.026493] [INFO ] [REMOTE ] MGY: Full fetch complete (75598 records). [2025-09-30T19:53:34.026681] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-30T19:53:34.145342] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:53:34.161813] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-30T19:53:34.464029] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-30T19:53:34.464116] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-30T19:53:34.465228] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-30T19:53:34.465297] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-30T19:53:34.466929] [DEBUG] [LOCAL ] MGY: Trimmed 75598 records to 52425 (keeping 200 days of data) [2025-09-30T19:53:34.662292] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-30T19:53:34.816109] [DEBUG] [LOCAL ] MGY: Primary data saved (52425 records). [2025-09-30T19:53:34.816255] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-30T19:53:34.817226] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 40.5s. Estimated remaining: 2h 10m 47s. Rate: 7.8 symbols/min [2025-09-30T19:53:34.996905] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:34.997076] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-30T19:53:34.997115] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-30T19:53:34.997230] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-30T19:53:34.997273] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-30T19:53:34.997316] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-30T19:53:34.997350] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-30T19:53:35.352873] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:53:35.397434] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:35.454363] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-30T19:53:36.050040] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-30T19:53:36.051068] [INFO ] [REMOTE ] MGRD: Full fetch complete (3519 records). [2025-09-30T19:53:36.051140] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-30T19:53:36.259513] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-30T19:53:36.433953] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-30T19:53:36.434030] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-30T19:53:36.434181] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-30T19:53:36.434224] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-30T19:53:36.434753] [DEBUG] [LOCAL ] MGRD: Trimmed 3519 records to 2230 (keeping 200 days of data) [2025-09-30T19:53:36.449317] [DEBUG] [LOCAL ] MGRD: Primary data saved (2230 records). [2025-09-30T19:53:36.449386] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-30T19:53:36.449491] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MGRD took 45.6s. Estimated remaining: 2h 10m 35s. Rate: 7.8 symbols/min [2025-09-30T19:53:36.627371] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:36.640499] [DEBUG] [LOCAL ] MHN: Loaded 7704 existing records from primary storage. [2025-09-30T19:53:36.640806] [INFO ] [MAIN ] MHN: Loaded 7704 existing records. [2025-09-30T19:53:36.839534] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:36.839805] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-30T19:53:36.839860] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-30T19:53:36.840121] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-30T19:53:36.840181] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-30T19:53:37.060588] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-30T19:53:37.202373] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:53:37.288364] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:37.854377] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-30T19:53:38.576332] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:53:38.654323] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-30T19:53:38.716268] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:53:39.454327] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-30T19:53:39.563079] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T19:53:40.249966] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:53:40.252689] [INFO ] [REMOTE ] MHF: Full fetch complete (12613 records). [2025-09-30T19:53:40.252781] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-30T19:53:40.264134] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-30T19:53:40.669237] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-30T19:53:40.669323] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-30T19:53:40.669675] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-30T19:53:40.669746] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-30T19:53:40.670263] [DEBUG] [LOCAL ] MHF: Trimmed 12613 records to 8721 (keeping 200 days of data) [2025-09-30T19:53:40.723449] [DEBUG] [LOCAL ] MHF: Primary data saved (8721 records). [2025-09-30T19:53:40.723608] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-30T19:53:40.723734] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHF took 28.0s. Estimated remaining: 2h 10m 24s. Rate: 7.8 symbols/min [2025-09-30T19:53:40.913367] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:40.941465] [DEBUG] [LOCAL ] MHO: Loaded 24091 existing records from primary storage. [2025-09-30T19:53:40.941809] [INFO ] [MAIN ] MHO: Loaded 24091 existing records. [2025-09-30T19:53:41.056497] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-30T19:53:41.110492] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:53:41.156044] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:41.156292] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-30T19:53:41.156384] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-30T19:53:41.157127] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-30T19:53:41.157189] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-30T19:53:41.551745] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:41.854361] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-30T19:53:42.188847] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-30T19:53:42.610814] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:53:42.654357] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-30T19:53:43.454352] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-30T19:53:43.790259] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T19:53:44.225275] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:53:44.254307] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-30T19:53:45.054355] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-30T19:53:45.758489] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:53:45.773373] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T19:53:45.854321] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-30T19:53:46.616789] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T19:53:46.654308] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-30T19:53:47.334766] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T19:53:47.454376] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-30T19:53:48.254367] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-30T19:53:48.584000] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T19:53:49.054329] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-30T19:53:49.094832] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:53:49.416423] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T19:53:49.854348] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-30T19:53:50.238178] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-30T19:53:50.654432] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-30T19:53:50.765031] [DEBUG] [REMOTE ] MHLA: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-30T19:53:50.765462] [WARN ] [REMOTE ] MHLA: No data returned for month 2025-05 [2025-09-30T19:53:50.765606] [FATAL] [REMOTE ] MHLA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:53:50.765761] [FATAL] [MAIN ] MHLA: Failed to fetch primary data. [2025-09-30T19:53:50.765889] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:53:50.765987] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-30T19:53:50.766084] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-30T19:53:50.766146] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-30T19:53:50.766218] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-30T19:53:50.766297] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHLA took 15.9s. Estimated remaining: 2h 10m 18s. Rate: 7.8 symbols/min [2025-09-30T19:53:51.060266] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:51.060484] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-30T19:53:51.060533] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-30T19:53:51.060714] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-30T19:53:51.060781] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-30T19:53:51.060906] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-30T19:53:51.060972] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-30T19:53:51.461371] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-30T19:53:51.601542] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:52.254370] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-30T19:53:53.054415] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-30T19:53:53.175890] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T19:53:53.480742] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:53:53.532879] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T19:53:53.854405] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-30T19:53:54.593604] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T19:53:54.654369] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-30T19:53:55.454368] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-30T19:53:55.838302] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:53:55.838684] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-30T19:53:55.838792] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:53:55.838850] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-30T19:53:55.838918] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:53:55.838995] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-30T19:53:55.839096] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-30T19:53:55.839150] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-30T19:53:55.839197] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-30T19:53:55.839266] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MIAX took 5.1s. Estimated remaining: 2h 10m 9s. Rate: 7.8 symbols/min [2025-09-30T19:53:56.024462] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:53:56.051339] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:53:56.073741] [DEBUG] [LOCAL ] MIN: Loaded 13101 existing records from primary storage. [2025-09-30T19:53:56.074002] [INFO ] [MAIN ] MIN: Loaded 13101 existing records. [2025-09-30T19:53:56.259566] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-30T19:53:56.265493] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:53:56.266726] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-30T19:53:56.266826] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-30T19:53:56.267174] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-30T19:53:56.267246] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-30T19:53:56.659888] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:53:57.048931] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T19:53:57.054314] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-30T19:53:57.854391] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-30T19:53:58.654378] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-30T19:53:58.701857] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T19:53:58.721500] [INFO ] [REMOTE ] MHN: Full fetch complete (11815 records). [2025-09-30T19:53:58.722595] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:53:58.722733] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-30T19:53:59.125468] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-30T19:53:59.125546] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-30T19:53:59.125865] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-30T19:53:59.125929] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-30T19:53:59.126468] [DEBUG] [LOCAL ] MHN: Trimmed 11815 records to 7611 (keeping 200 days of data) [2025-09-30T19:53:59.176180] [DEBUG] [LOCAL ] MHN: Primary data saved (7611 records). [2025-09-30T19:53:59.176305] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-30T19:53:59.176386] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHN took 22.7s. Estimated remaining: 2h 9m 58s. Rate: 7.8 symbols/min [2025-09-30T19:53:59.330764] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T19:53:59.454385] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-30T19:54:00.189868] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:54:00.254344] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-30T19:54:01.005795] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:54:01.054365] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-30T19:54:01.854411] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-30T19:54:02.045774] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:54:02.654407] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-30T19:54:03.098374] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T19:54:03.163374] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T19:54:03.454403] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-30T19:54:04.254344] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-30T19:54:04.910167] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:54:05.054314] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-30T19:54:05.460542] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T19:54:05.854401] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-30T19:54:06.545906] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:54:06.579883] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:54:06.654363] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-30T19:54:07.454334] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-30T19:54:07.757204] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:54:08.254351] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-30T19:54:08.669018] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:54:09.054420] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-30T19:54:09.271849] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T19:54:09.854378] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-30T19:54:10.611717] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:54:10.642096] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:54:10.651430] [INFO ] [REMOTE ] MHK: Full fetch complete (60735 records). [2025-09-30T19:54:10.651590] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-30T19:54:10.664442] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-30T19:54:11.092367] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-30T19:54:11.092459] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-30T19:54:11.093463] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-30T19:54:11.093531] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-30T19:54:11.095126] [DEBUG] [LOCAL ] MHK: Trimmed 60735 records to 42249 (keeping 200 days of data) [2025-09-30T19:54:11.373892] [DEBUG] [LOCAL ] MHK: Primary data saved (42249 records). [2025-09-30T19:54:11.374036] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-30T19:54:11.374156] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MHK took 38.4s. Estimated remaining: 2h 9m 54s. Rate: 7.8 symbols/min [2025-09-30T19:54:11.454380] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-30T19:54:11.816227] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:54:12.254401] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-30T19:54:12.414174] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T19:54:12.417633] [INFO ] [REMOTE ] MIN: Full fetch complete (17664 records). [2025-09-30T19:54:12.417807] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-30T19:54:12.854397] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-30T19:54:12.854480] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-30T19:54:12.854929] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-30T19:54:12.854993] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-30T19:54:12.855634] [DEBUG] [LOCAL ] MIN: Trimmed 17664 records to 13086 (keeping 200 days of data) [2025-09-30T19:54:12.938804] [DEBUG] [LOCAL ] MIN: Primary data saved (13086 records). [2025-09-30T19:54:12.938993] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-30T19:54:12.939107] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MIN took 17.1s. Estimated remaining: 2h 9m 41s. Rate: 7.8 symbols/min [2025-09-30T19:54:13.079962] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:54:13.085402] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-30T19:54:14.066259] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T19:54:14.073172] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-30T19:54:14.993534] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T19:54:15.000203] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-30T19:54:15.980044] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T19:54:15.986520] [INFO ] [REMOTE ] MHO: Full fetch complete (37363 records). [2025-09-30T19:54:15.986711] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-30T19:54:16.421272] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-30T19:54:16.421407] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-30T19:54:16.422302] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-30T19:54:16.422405] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-30T19:54:16.423484] [DEBUG] [LOCAL ] MHO: Trimmed 37363 records to 24027 (keeping 200 days of data) [2025-09-30T19:54:16.595579] [DEBUG] [LOCAL ] MHO: Primary data saved (24027 records). [2025-09-30T19:54:16.595790] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-30T19:54:16.595902] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MHO took 35.9s. Estimated remaining: 2h 9m 31s. Rate: 7.8 symbols/min [2025-09-30T19:54:17.326337] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:17.446697] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:17.445686] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:17.463378] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-30T19:54:17.488953] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:17.490597] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-30T19:54:17.490904] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-30T19:54:17.490959] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-30T19:54:17.491008] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-30T19:54:17.491042] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-30T19:54:17.547256] [DEBUG] [LOCAL ] MITP: Loaded 2411 existing records from primary storage. [2025-09-30T19:54:17.562415] [INFO ] [MAIN ] MITP: Loaded 2411 existing records. [2025-09-30T19:54:17.796423] [DEBUG] [LOCAL ] MITT: Loaded 22903 existing records from primary storage. [2025-09-30T19:54:17.851468] [INFO ] [MAIN ] MITT: Loaded 22903 existing records. [2025-09-30T19:54:17.893157] [DEBUG] [LOCAL ] MIR: Loaded 50898 existing records from primary storage. [2025-09-30T19:54:17.962296] [INFO ] [MAIN ] MIR: Loaded 50898 existing records. [2025-09-30T19:54:18.310057] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:18.347999] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-30T19:54:18.393324] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-30T19:54:18.489973] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:18.551498] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:18.535951] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-30T19:54:18.557028] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-30T19:54:18.557171] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-30T19:54:18.590881] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-30T19:54:18.590800] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-30T19:54:18.598117] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:18.598186] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-30T19:54:18.599208] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-30T19:54:18.599391] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-30T19:54:18.599472] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-30T19:54:18.667714] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-30T19:54:18.783704] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-30T19:54:19.040274] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T19:54:19.129870] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-30T19:54:19.652710] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:19.697755] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-30T19:54:19.734176] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:54:19.742501] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:19.772071] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-30T19:54:19.761210] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-30T19:54:19.841442] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:19.842249] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-30T19:54:20.268618] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T19:54:20.269853] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-30T19:54:20.328816] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-30T19:54:20.663088] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T19:54:21.045261] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:54:21.054313] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-30T19:54:21.157403] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:54:21.617627] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:54:21.854394] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-30T19:54:22.654397] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-30T19:54:23.014334] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-30T19:54:23.455032] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-30T19:54:23.458115] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:54:23.790037] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T19:54:24.254385] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-30T19:54:25.054396] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-30T19:54:25.486178] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T19:54:25.525926] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:54:25.854376] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-30T19:54:26.077990] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-30T19:54:26.654368] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-30T19:54:27.454372] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-30T19:54:27.886308] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:54:27.989191] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T19:54:28.254366] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-30T19:54:29.054376] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-30T19:54:29.803922] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T19:54:29.854328] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-30T19:54:29.985307] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T19:54:30.654365] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-30T19:54:31.070453] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T19:54:31.454365] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-30T19:54:31.592734] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T19:54:31.910407] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T19:54:32.254345] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-30T19:54:32.659589] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T19:54:32.660416] [INFO ] [REMOTE ] MITN: Full fetch complete (2311 records). [2025-09-30T19:54:32.660520] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-30T19:54:32.860482] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T19:54:32.860696] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:54:32.860768] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:54:32.860839] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-30T19:54:32.860905] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-30T19:54:32.860942] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-30T19:54:32.861029] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-30T19:54:32.861173] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITN took 16.3s. Estimated remaining: 2h 9m 29s. Rate: 7.8 symbols/min [2025-09-30T19:54:33.040384] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:33.049008] [DEBUG] [LOCAL ] MIY: Loaded 5996 existing records from primary storage. [2025-09-30T19:54:33.049228] [INFO ] [MAIN ] MIY: Loaded 5996 existing records. [2025-09-30T19:54:33.060193] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-30T19:54:33.244461] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:33.244720] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-30T19:54:33.244782] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-30T19:54:33.245026] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-30T19:54:33.245086] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-30T19:54:33.636188] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:33.854358] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-30T19:54:34.656475] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-30T19:54:34.661240] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T19:54:34.784423] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T19:54:35.454338] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-30T19:54:35.696281] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T19:54:35.996795] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-30T19:54:36.254383] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-30T19:54:37.054361] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-30T19:54:37.706929] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T19:54:37.854325] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-30T19:54:38.005149] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T19:54:38.480065] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T19:54:38.654358] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-30T19:54:39.454391] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-30T19:54:40.013998] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T19:54:40.254346] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-30T19:54:40.416805] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T19:54:40.846436] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:54:41.054349] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-30T19:54:41.854329] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-30T19:54:41.953515] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T19:54:42.562877] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T19:54:42.654361] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-30T19:54:43.079949] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T19:54:43.454416] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-30T19:54:44.254404] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-30T19:54:44.781023] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:54:45.054383] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-30T19:54:45.496058] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T19:54:45.854361] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-30T19:54:46.136675] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-30T19:54:46.270494] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T19:54:46.283278] [INFO ] [REMOTE ] MIR: Full fetch complete (73424 records). [2025-09-30T19:54:46.283457] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-30T19:54:46.665843] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-30T19:54:46.729808] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-30T19:54:46.729905] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-30T19:54:46.731023] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-30T19:54:46.731094] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-30T19:54:46.732635] [DEBUG] [LOCAL ] MIR: Trimmed 73424 records to 50989 (keeping 200 days of data) [2025-09-30T19:54:47.053694] [DEBUG] [LOCAL ] MIR: Primary data saved (50989 records). [2025-09-30T19:54:47.053851] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-30T19:54:47.053945] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MIR took 30.5s. Estimated remaining: 2h 9m 26s. Rate: 7.8 symbols/min [2025-09-30T19:54:47.234704] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:47.296715] [DEBUG] [LOCAL ] MKC: Loaded 52432 existing records from primary storage. [2025-09-30T19:54:47.297053] [INFO ] [MAIN ] MKC: Loaded 52432 existing records. [2025-09-30T19:54:47.408281] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:54:47.462994] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-30T19:54:47.498994] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:47.499374] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-30T19:54:47.499426] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-30T19:54:47.501064] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-30T19:54:47.501170] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-30T19:54:48.000162] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:48.038710] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:54:48.039771] [INFO ] [REMOTE ] MITP: Full fetch complete (3350 records). [2025-09-30T19:54:48.039849] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-30T19:54:48.259529] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-30T19:54:48.433943] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-30T19:54:48.434033] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-30T19:54:48.434158] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-30T19:54:48.434199] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-30T19:54:48.434601] [DEBUG] [LOCAL ] MITP: Trimmed 3350 records to 2386 (keeping 200 days of data) [2025-09-30T19:54:48.449497] [DEBUG] [LOCAL ] MITP: Primary data saved (2386 records). [2025-09-30T19:54:48.449616] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-30T19:54:48.449729] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITP took 31.8s. Estimated remaining: 2h 9m 14s. Rate: 7.8 symbols/min [2025-09-30T19:54:48.628535] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:48.672886] [DEBUG] [LOCAL ] MKL: Loaded 34012 existing records from primary storage. [2025-09-30T19:54:48.673216] [INFO ] [MAIN ] MKL: Loaded 34012 existing records. [2025-09-30T19:54:48.862958] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:48.863203] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-30T19:54:48.863262] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-30T19:54:48.863633] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-30T19:54:48.863743] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-30T19:54:49.055219] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-30T19:54:49.260856] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:49.412764] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:54:49.854370] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-30T19:54:50.654352] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-30T19:54:50.827184] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:54:50.984012] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:54:51.389801] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:54:51.454348] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-30T19:54:52.254397] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-30T19:54:52.777104] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:54:52.842113] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:54:53.054372] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-30T19:54:53.680599] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T19:54:53.854365] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-30T19:54:54.654360] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-30T19:54:55.454360] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-30T19:54:55.520059] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:54:55.567856] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T19:54:56.254347] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-30T19:54:56.262465] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:54:56.264316] [INFO ] [REMOTE ] MIY: Full fetch complete (9009 records). [2025-09-30T19:54:56.264386] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-30T19:54:56.651778] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-30T19:54:56.651859] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-30T19:54:56.652106] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-30T19:54:56.652146] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-30T19:54:56.652605] [DEBUG] [LOCAL ] MIY: Trimmed 9009 records to 5968 (keeping 200 days of data) [2025-09-30T19:54:56.693115] [DEBUG] [LOCAL ] MIY: Primary data saved (5968 records). [2025-09-30T19:54:56.693267] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-30T19:54:56.693358] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 23.8s. Estimated remaining: 2h 9m 7s. Rate: 7.8 symbols/min [2025-09-30T19:54:56.900087] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:54:56.952123] [DEBUG] [LOCAL ] MLI: Loaded 43645 existing records from primary storage. [2025-09-30T19:54:56.952434] [INFO ] [MAIN ] MLI: Loaded 43645 existing records. [2025-09-30T19:54:57.059720] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-30T19:54:57.148772] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:54:57.149015] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-30T19:54:57.149063] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-30T19:54:57.149556] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-30T19:54:57.149617] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-30T19:54:57.543278] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:54:57.851082] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T19:54:57.860680] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-30T19:54:58.487316] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:54:58.654354] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-30T19:54:58.704496] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T19:54:59.454398] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-30T19:55:00.070061] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T19:55:00.254356] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-30T19:55:00.974892] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:55:01.054401] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-30T19:55:01.854366] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-30T19:55:02.205419] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T19:55:02.427464] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T19:55:02.654399] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-30T19:55:03.273032] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:55:03.278162] [INFO ] [REMOTE ] MITT: Full fetch complete (34964 records). [2025-09-30T19:55:03.278261] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-30T19:55:03.464638] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-30T19:55:03.696215] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-30T19:55:03.696575] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-30T19:55:03.697335] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-30T19:55:03.697448] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-30T19:55:03.699514] [DEBUG] [LOCAL ] MITT: Trimmed 34964 records to 22919 (keeping 200 days of data) [2025-09-30T19:55:03.838490] [DEBUG] [LOCAL ] MITT: Primary data saved (22919 records). [2025-09-30T19:55:03.838626] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-30T19:55:03.838806] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MITT took 47.2s. Estimated remaining: 2h 8m 59s. Rate: 7.8 symbols/min [2025-09-30T19:55:04.025247] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:04.025433] [DEBUG] [LOCAL ] MLM: No existing data file found in primary storage. [2025-09-30T19:55:04.025512] [WARN ] [MAIN ] MLM: No existing data found, performing full refresh instead. [2025-09-30T19:55:04.025692] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-30T19:55:04.025749] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-30T19:55:04.025794] [DEBUG] [LOCAL ] MLM: No primary data file found to delete. [2025-09-30T19:55:04.025832] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-30T19:55:04.259232] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-30T19:55:04.371072] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:55:04.470487] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:04.877171] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T19:55:05.054395] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-30T19:55:05.854335] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-30T19:55:05.955331] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:55:06.586108] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:55:06.654395] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-30T19:55:07.142034] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:55:07.454403] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-30T19:55:08.254343] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-30T19:55:08.546742] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T19:55:09.054345] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-30T19:55:09.255202] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T19:55:09.652381] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:55:09.854374] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-30T19:55:10.486227] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:55:10.654368] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-30T19:55:11.297932] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T19:55:11.454405] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-30T19:55:12.188093] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:55:12.254375] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-30T19:55:12.391739] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:55:13.054375] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-30T19:55:13.554700] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:55:13.854393] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-30T19:55:14.441816] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T19:55:14.654371] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-30T19:55:15.303763] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:55:15.454410] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-30T19:55:16.241455] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:55:16.254367] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-30T19:55:16.840267] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T19:55:17.054404] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-30T19:55:17.854326] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-30T19:55:18.105921] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:55:18.141382] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:55:18.654407] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-30T19:55:19.269708] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T19:55:19.454372] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-30T19:55:20.261811] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-30T19:55:20.267846] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:55:20.786203] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:55:21.054366] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-30T19:55:21.536584] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T19:55:21.854442] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-30T19:55:22.654373] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-30T19:55:22.827712] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:55:23.096017] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T19:55:23.454315] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-30T19:55:23.934956] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T19:55:24.254363] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-30T19:55:25.054357] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-30T19:55:25.209438] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T19:55:25.711134] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T19:55:25.720597] [INFO ] [REMOTE ] MLM: Full fetch complete (45619 records). [2025-09-30T19:55:25.720886] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-30T19:55:25.859462] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-30T19:55:26.142773] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-30T19:55:26.143178] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-30T19:55:26.144007] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-30T19:55:26.144082] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-30T19:55:26.145226] [DEBUG] [LOCAL ] MLM: Trimmed 45619 records to 30109 (keeping 200 days of data) [2025-09-30T19:55:26.353349] [DEBUG] [LOCAL ] MLM: Primary data saved (30109 records). [2025-09-30T19:55:26.353517] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-30T19:55:26.353759] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MLM took 22.5s. Estimated remaining: 2h 9m 2s. Rate: 7.8 symbols/min [2025-09-30T19:55:26.535606] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:26.557897] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:55:26.566406] [INFO ] [REMOTE ] MKL: Full fetch complete (49564 records). [2025-09-30T19:55:26.566593] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-30T19:55:26.668977] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-30T19:55:26.720520] [DEBUG] [LOCAL ] MLNK: Loaded 25428 existing records from primary storage. [2025-09-30T19:55:26.752623] [INFO ] [MAIN ] MLNK: Loaded 25428 existing records. [2025-09-30T19:55:27.216559] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:27.228566] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-30T19:55:27.250595] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-30T19:55:27.263948] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-30T19:55:27.264133] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-30T19:55:27.263872] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-30T19:55:27.285883] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-30T19:55:27.324558] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-30T19:55:27.347098] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-30T19:55:27.438369] [DEBUG] [LOCAL ] MKL: Trimmed 49564 records to 34021 (keeping 200 days of data) [2025-09-30T19:55:27.727911] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:55:27.807792] [INFO ] [REMOTE ] MLI: Full fetch complete (63462 records). [2025-09-30T19:55:27.816616] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-30T19:55:27.815482] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:27.819048] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-30T19:55:28.275691] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-30T19:55:28.276183] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-30T19:55:28.277411] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-30T19:55:28.278150] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-30T19:55:28.285317] [DEBUG] [LOCAL ] MLI: Trimmed 63462 records to 43572 (keeping 200 days of data) [2025-09-30T19:55:28.512492] [DEBUG] [LOCAL ] MKL: Primary data saved (34021 records). [2025-09-30T19:55:28.513724] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-30T19:55:28.517804] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MKL took 40.1s. Estimated remaining: 2h 8m 50s. Rate: 7.8 symbols/min [2025-09-30T19:55:28.806330] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:28.872412] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:55:28.888237] [DEBUG] [LOCAL ] MLP: Loaded 2991 existing records from primary storage. [2025-09-30T19:55:28.889260] [INFO ] [REMOTE ] MKC: Full fetch complete (75549 records). [2025-09-30T19:55:28.889154] [INFO ] [MAIN ] MLP: Loaded 2991 existing records. [2025-09-30T19:55:28.895493] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-30T19:55:29.296462] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:29.304626] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-30T19:55:29.305254] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:55:29.323255] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-30T19:55:29.329078] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-30T19:55:29.358896] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-30T19:55:29.364815] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-30T19:55:29.863819] [DEBUG] [LOCAL ] MLI: Primary data saved (43572 records). [2025-09-30T19:55:29.889589] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-30T19:55:29.889752] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-30T19:55:29.889842] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-30T19:55:29.892364] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLI took 33.2s. Estimated remaining: 2h 8m 38s. Rate: 7.8 symbols/min [2025-09-30T19:55:29.909348] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-30T19:55:29.914895] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-30T19:55:30.096023] [DEBUG] [LOCAL ] MKC: Trimmed 75549 records to 52440 (keeping 200 days of data) [2025-09-30T19:55:30.348094] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:30.364896] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-30T19:55:30.398628] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:30.430690] [DEBUG] [LOCAL ] MLR: Loaded 12553 existing records from primary storage. [2025-09-30T19:55:30.431608] [INFO ] [MAIN ] MLR: Loaded 12553 existing records. [2025-09-30T19:55:30.621877] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:55:30.667675] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:30.669998] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-30T19:55:30.670233] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-30T19:55:30.670536] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-30T19:55:30.671773] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-30T19:55:30.672401] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-30T19:55:30.857833] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T19:55:30.902205] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-30T19:55:31.197161] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:31.306315] [DEBUG] [LOCAL ] MKC: Primary data saved (52440 records). [2025-09-30T19:55:31.306938] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-30T19:55:31.307047] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MKC took 44.3s. Estimated remaining: 2h 8m 25s. Rate: 7.8 symbols/min [2025-09-30T19:55:31.455595] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-30T19:55:31.540320] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:31.554349] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T19:55:31.618523] [DEBUG] [LOCAL ] MMC: Loaded 51782 existing records from primary storage. [2025-09-30T19:55:31.618948] [INFO ] [MAIN ] MMC: Loaded 51782 existing records. [2025-09-30T19:55:31.724608] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T19:55:31.820804] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:31.821039] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-30T19:55:31.821086] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-30T19:55:31.821835] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-30T19:55:31.821894] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-30T19:55:32.225045] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:32.238716] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T19:55:32.254321] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-30T19:55:32.732239] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T19:55:33.054361] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-30T19:55:33.716133] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:55:33.854376] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-30T19:55:34.654362] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-30T19:55:34.967892] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T19:55:35.454386] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-30T19:55:36.254401] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-30T19:55:36.505769] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:55:36.627422] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:55:36.913826] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T19:55:37.054378] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-30T19:55:37.854366] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-30T19:55:38.654369] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-30T19:55:38.820032] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T19:55:39.166093] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:55:39.454375] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-30T19:55:39.492960] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T19:55:40.254393] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-30T19:55:41.054370] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-30T19:55:41.216823] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:55:41.238439] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:55:41.854399] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-30T19:55:42.025240] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T19:55:42.654416] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-30T19:55:42.772438] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T19:55:43.113029] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T19:55:43.454368] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-30T19:55:44.046316] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:55:44.254366] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-30T19:55:45.054354] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-30T19:55:45.257356] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T19:55:45.637546] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:55:45.854363] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-30T19:55:46.654352] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-30T19:55:47.167704] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T19:55:47.454405] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-30T19:55:48.205033] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:55:48.254414] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-30T19:55:48.765404] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T19:55:48.772480] [INFO ] [REMOTE ] MLNK: Full fetch complete (35938 records). [2025-09-30T19:55:48.772617] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-30T19:55:49.058781] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-30T19:55:49.104418] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T19:55:49.200575] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-30T19:55:49.200681] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-30T19:55:49.201509] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-30T19:55:49.201587] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-30T19:55:49.202488] [DEBUG] [LOCAL ] MLNK: Trimmed 35938 records to 25422 (keeping 200 days of data) [2025-09-30T19:55:49.367552] [DEBUG] [LOCAL ] MLNK: Primary data saved (25422 records). [2025-09-30T19:55:49.367758] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-30T19:55:49.367912] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 23.0s. Estimated remaining: 2h 8m 25s. Rate: 7.8 symbols/min [2025-09-30T19:55:49.572330] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:49.587697] [DEBUG] [LOCAL ] MMD: Loaded 11387 existing records from primary storage. [2025-09-30T19:55:49.587983] [INFO ] [MAIN ] MMD: Loaded 11387 existing records. [2025-09-30T19:55:49.779128] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:49.779368] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-30T19:55:49.779418] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-30T19:55:49.779598] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-30T19:55:49.779687] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-30T19:55:49.862977] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-30T19:55:50.194890] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:50.654360] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-30T19:55:50.677096] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:55:51.064333] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T19:55:51.066993] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T19:55:51.454403] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-30T19:55:52.138608] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T19:55:52.254348] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-30T19:55:53.054350] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-30T19:55:53.335113] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:55:53.338931] [INFO ] [REMOTE ] MLR: Full fetch complete (18677 records). [2025-09-30T19:55:53.339243] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-30T19:55:53.640887] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:55:53.764437] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-30T19:55:53.764530] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-30T19:55:53.765062] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-30T19:55:53.765141] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-30T19:55:53.765961] [DEBUG] [LOCAL ] MLR: Trimmed 18677 records to 12551 (keeping 200 days of data) [2025-09-30T19:55:53.850218] [DEBUG] [LOCAL ] MLR: Primary data saved (12551 records). [2025-09-30T19:55:53.850376] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-30T19:55:53.850465] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 23.9s. Estimated remaining: 2h 8m 15s. Rate: 7.8 symbols/min [2025-09-30T19:55:53.855937] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-30T19:55:54.066490] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:54.087009] [DEBUG] [LOCAL ] MMI: Loaded 15142 existing records from primary storage. [2025-09-30T19:55:54.087281] [INFO ] [MAIN ] MMI: Loaded 15142 existing records. [2025-09-30T19:55:54.302575] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:55:54.302874] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-30T19:55:54.302949] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-30T19:55:54.303286] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-30T19:55:54.303359] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-30T19:55:54.655443] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-30T19:55:54.751085] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:55:54.757146] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:55.454383] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-30T19:55:56.219854] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:55:56.254326] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-30T19:55:56.331582] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T19:55:56.787221] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T19:55:57.054424] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-30T19:55:57.768850] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:55:57.770179] [INFO ] [REMOTE ] MLP: Full fetch complete (4582 records). [2025-09-30T19:55:57.770254] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-30T19:55:57.859495] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-30T19:55:58.169958] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-30T19:55:58.170041] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-30T19:55:58.170186] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-30T19:55:58.170225] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-30T19:55:58.170692] [DEBUG] [LOCAL ] MLP: Trimmed 4582 records to 2980 (keeping 200 days of data) [2025-09-30T19:55:58.189093] [DEBUG] [LOCAL ] MLP: Primary data saved (2980 records). [2025-09-30T19:55:58.189229] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-30T19:55:58.189327] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MLP took 29.7s. Estimated remaining: 2h 8m 5s. Rate: 7.8 symbols/min [2025-09-30T19:55:58.384065] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:58.384413] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-30T19:55:58.384473] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-30T19:55:58.384592] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-30T19:55:58.384687] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-30T19:55:58.384756] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-30T19:55:58.384834] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-30T19:55:58.660497] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-30T19:55:58.775541] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T19:55:58.816745] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:55:59.454396] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-30T19:55:59.653390] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:55:59.653849] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-30T19:55:59.653965] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:55:59.654014] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-30T19:55:59.654076] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:55:59.654184] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-30T19:55:59.654267] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-30T19:55:59.654316] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-30T19:55:59.654386] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-30T19:55:59.654436] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMID took 1.5s. Estimated remaining: 2h 7m 53s. Rate: 7.8 symbols/min [2025-09-30T19:55:59.845890] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:55:59.846060] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-30T19:55:59.846100] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-30T19:55:59.846214] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-30T19:55:59.846255] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-30T19:55:59.846297] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-30T19:55:59.846330] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-30T19:56:00.231844] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:00.254341] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-30T19:56:00.474607] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:56:00.562479] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-30T19:56:01.054362] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-30T19:56:01.854424] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-30T19:56:01.914770] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T19:56:02.432067] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:56:02.654365] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-30T19:56:03.454375] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-30T19:56:03.653084] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T19:56:04.254364] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-30T19:56:05.054357] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-30T19:56:05.185275] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T19:56:05.450887] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T19:56:05.854383] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-30T19:56:06.029140] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:56:06.654372] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-30T19:56:07.454347] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-30T19:56:07.568463] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:56:07.575600] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:56:08.086517] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T19:56:08.254396] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-30T19:56:08.757684] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T19:56:09.054378] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-30T19:56:09.566104] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-30T19:56:09.854387] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-30T19:56:10.585849] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:56:10.654396] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-30T19:56:11.454378] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-30T19:56:11.626873] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T19:56:12.254377] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-30T19:56:13.054418] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-30T19:56:13.068099] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:56:13.321399] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:56:13.333021] [INFO ] [REMOTE ] MMC: Full fetch complete (74725 records). [2025-09-30T19:56:13.333227] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-30T19:56:13.538426] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T19:56:13.779439] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-30T19:56:13.779549] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-30T19:56:13.780759] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-30T19:56:13.780830] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-30T19:56:13.782415] [DEBUG] [LOCAL ] MMC: Trimmed 74725 records to 51784 (keeping 200 days of data) [2025-09-30T19:56:13.879361] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-30T19:56:14.128091] [DEBUG] [LOCAL ] MMC: Primary data saved (51784 records). [2025-09-30T19:56:14.128316] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-30T19:56:14.128419] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMC took 42.8s. Estimated remaining: 2h 7m 50s. Rate: 7.8 symbols/min [2025-09-30T19:56:14.320180] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:14.327035] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T19:56:14.386551] [DEBUG] [LOCAL ] MMM: Loaded 53201 existing records from primary storage. [2025-09-30T19:56:14.386964] [INFO ] [MAIN ] MMM: Loaded 53201 existing records. [2025-09-30T19:56:14.580457] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:14.580717] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-30T19:56:14.580775] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-30T19:56:14.581135] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-30T19:56:14.581200] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-30T19:56:14.659476] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-30T19:56:14.989942] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:15.403345] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:56:15.454328] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-30T19:56:15.894620] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-30T19:56:16.254345] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-30T19:56:16.917417] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-30T19:56:17.054381] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-30T19:56:17.854406] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-30T19:56:18.654365] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-30T19:56:18.777038] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:56:18.780349] [INFO ] [REMOTE ] MMD: Full fetch complete (18010 records). [2025-09-30T19:56:18.780439] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-30T19:56:18.974832] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-30T19:56:19.190225] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-30T19:56:19.190532] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-30T19:56:19.191205] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-30T19:56:19.191292] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-30T19:56:19.217091] [DEBUG] [LOCAL ] MMD: Trimmed 18010 records to 11403 (keeping 200 days of data) [2025-09-30T19:56:19.223407] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T19:56:19.309412] [DEBUG] [LOCAL ] MMD: Primary data saved (11403 records). [2025-09-30T19:56:19.309561] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-30T19:56:19.309684] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMD took 29.9s. Estimated remaining: 2h 7m 41s. Rate: 7.8 symbols/min [2025-09-30T19:56:19.459419] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-30T19:56:19.520457] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:19.558554] [DEBUG] [LOCAL ] MMS: Loaded 33771 existing records from primary storage. [2025-09-30T19:56:19.558896] [INFO ] [MAIN ] MMS: Loaded 33771 existing records. [2025-09-30T19:56:19.765251] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:19.765501] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-30T19:56:19.765551] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-30T19:56:19.765945] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-30T19:56:19.766006] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-30T19:56:20.181499] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:20.254346] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-30T19:56:21.054364] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-30T19:56:21.469880] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T19:56:21.494400] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T19:56:21.842841] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:56:21.854311] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-30T19:56:22.654427] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-30T19:56:22.989234] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-30T19:56:23.454330] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-30T19:56:23.548599] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T19:56:23.782085] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T19:56:24.254372] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-30T19:56:25.054358] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-30T19:56:25.506485] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T19:56:25.507406] [INFO ] [REMOTE ] MMKT: Full fetch complete (2092 records). [2025-09-30T19:56:25.507480] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-30T19:56:25.708157] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T19:56:25.708370] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:56:25.708441] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:56:25.708519] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-30T19:56:25.708614] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-30T19:56:25.708697] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-30T19:56:25.708756] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-30T19:56:25.708815] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMKT took 26.1s. Estimated remaining: 2h 7m 32s. Rate: 7.8 symbols/min [2025-09-30T19:56:25.871861] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-30T19:56:25.911165] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:25.930255] [DEBUG] [LOCAL ] MMT: Loaded 10929 existing records from primary storage. [2025-09-30T19:56:25.930519] [INFO ] [MAIN ] MMT: Loaded 10929 existing records. [2025-09-30T19:56:26.118783] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T19:56:26.174430] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:26.174671] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-30T19:56:26.174734] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-30T19:56:26.175148] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-30T19:56:26.175209] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-30T19:56:26.559931] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:26.654397] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-30T19:56:26.993946] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:56:27.412466] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T19:56:27.454362] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-30T19:56:28.254427] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-30T19:56:29.054442] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-30T19:56:29.452563] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T19:56:29.768052] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T19:56:29.796299] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T19:56:29.854367] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-30T19:56:30.578695] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-30T19:56:30.654358] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-30T19:56:31.454383] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-30T19:56:31.633895] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:56:32.254343] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-30T19:56:33.054327] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-30T19:56:33.465327] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T19:56:33.531187] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T19:56:33.608994] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:56:33.854358] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-30T19:56:34.654361] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-30T19:56:34.867418] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T19:56:35.454340] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-30T19:56:35.681025] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T19:56:36.254359] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-30T19:56:36.718628] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T19:56:37.058629] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-30T19:56:37.062839] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:56:37.854406] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-30T19:56:37.893327] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T19:56:38.654397] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-30T19:56:39.454383] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-30T19:56:39.644945] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T19:56:39.930890] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T19:56:40.254344] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-30T19:56:40.844826] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T19:56:41.054370] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-30T19:56:41.145392] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T19:56:41.148820] [INFO ] [REMOTE ] MMI: Full fetch complete (21019 records). [2025-09-30T19:56:41.148915] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-30T19:56:41.564009] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-30T19:56:41.564101] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-30T19:56:41.564608] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-30T19:56:41.564689] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-30T19:56:41.565432] [DEBUG] [LOCAL ] MMI: Trimmed 21019 records to 15065 (keeping 200 days of data) [2025-09-30T19:56:41.668998] [DEBUG] [LOCAL ] MMI: Primary data saved (15065 records). [2025-09-30T19:56:41.669169] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-30T19:56:41.669266] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMI took 47.8s. Estimated remaining: 2h 7m 30s. Rate: 7.8 symbols/min [2025-09-30T19:56:41.858273] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-30T19:56:41.858148] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:41.878819] [DEBUG] [LOCAL ] MMU: Loaded 16811 existing records from primary storage. [2025-09-30T19:56:41.879162] [INFO ] [MAIN ] MMU: Loaded 16811 existing records. [2025-09-30T19:56:42.099287] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:42.099525] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-30T19:56:42.099583] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-30T19:56:42.099848] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-30T19:56:42.099908] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-30T19:56:42.595148] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:42.617962] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:56:42.654330] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-30T19:56:43.454297] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-30T19:56:43.509591] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:56:44.162108] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:56:44.170312] [INFO ] [REMOTE ] MMS: Full fetch complete (52075 records). [2025-09-30T19:56:44.170440] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-30T19:56:44.256597] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-30T19:56:44.476417] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T19:56:44.614728] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-30T19:56:44.614838] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-30T19:56:44.615794] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-30T19:56:44.615863] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-30T19:56:44.617551] [DEBUG] [LOCAL ] MMS: Trimmed 52075 records to 33782 (keeping 200 days of data) [2025-09-30T19:56:44.837388] [DEBUG] [LOCAL ] MMS: Primary data saved (33782 records). [2025-09-30T19:56:44.837536] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-30T19:56:44.837622] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMS took 25.5s. Estimated remaining: 2h 7m 19s. Rate: 7.8 symbols/min [2025-09-30T19:56:45.026385] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:45.051850] [DEBUG] [LOCAL ] MNR: Loaded 24542 existing records from primary storage. [2025-09-30T19:56:45.052142] [INFO ] [MAIN ] MNR: Loaded 24542 existing records. [2025-09-30T19:56:45.063801] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-30T19:56:45.253444] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:45.253749] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-30T19:56:45.253807] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-30T19:56:45.254095] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-30T19:56:45.254153] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-30T19:56:45.625827] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:45.854384] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-30T19:56:46.309748] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T19:56:46.340005] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:56:46.654483] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-30T19:56:46.671709] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:56:47.454381] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-30T19:56:47.609138] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T19:56:48.254355] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-30T19:56:48.349849] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:56:48.352137] [INFO ] [REMOTE ] MMT: Full fetch complete (16138 records). [2025-09-30T19:56:48.352234] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-30T19:56:48.755156] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-30T19:56:48.755239] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-30T19:56:48.755639] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-30T19:56:48.755723] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-30T19:56:48.756320] [DEBUG] [LOCAL ] MMT: Trimmed 16138 records to 10795 (keeping 200 days of data) [2025-09-30T19:56:48.821661] [DEBUG] [LOCAL ] MMT: Primary data saved (10795 records). [2025-09-30T19:56:48.821819] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-30T19:56:48.821917] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMT took 23.1s. Estimated remaining: 2h 7m 9s. Rate: 7.8 symbols/min [2025-09-30T19:56:49.006798] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:56:49.056382] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-30T19:56:49.058938] [DEBUG] [LOCAL ] MNSO: Loaded 44433 existing records from primary storage. [2025-09-30T19:56:49.059473] [INFO ] [MAIN ] MNSO: Loaded 44433 existing records. [2025-09-30T19:56:49.262260] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:56:49.262611] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-30T19:56:49.262770] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-30T19:56:49.263245] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-30T19:56:49.263305] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-30T19:56:49.402747] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T19:56:49.670712] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:56:49.854390] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-30T19:56:50.200716] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:56:50.654370] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-30T19:56:51.454382] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-30T19:56:51.586628] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T19:56:51.729077] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T19:56:52.254339] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-30T19:56:52.404470] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T19:56:53.054364] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-30T19:56:53.642827] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:56:53.854367] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-30T19:56:54.055490] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T19:56:54.654377] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-30T19:56:54.941021] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:56:55.454394] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-30T19:56:56.254365] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-30T19:56:56.668617] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T19:56:56.728169] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:56:57.054343] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-30T19:56:57.221051] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T19:56:57.854320] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-30T19:56:58.324053] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:56:58.654368] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-30T19:56:58.775220] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T19:56:59.454420] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-30T19:57:00.254375] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-30T19:57:00.312329] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:57:00.980102] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:57:01.021385] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:57:01.054399] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-30T19:57:01.854407] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-30T19:57:02.170904] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:57:02.654366] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-30T19:57:03.444539] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:57:03.454555] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-30T19:57:03.794948] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:57:04.254342] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-30T19:57:05.054401] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-30T19:57:05.748108] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T19:57:05.854361] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-30T19:57:05.932892] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-30T19:57:05.962860] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:57:05.968222] [INFO ] [REMOTE ] MMU: Full fetch complete (25625 records). [2025-09-30T19:57:05.968361] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-30T19:57:06.370883] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-30T19:57:06.370970] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-30T19:57:06.371523] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-30T19:57:06.371597] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-30T19:57:06.372456] [DEBUG] [LOCAL ] MMU: Trimmed 25625 records to 16779 (keeping 200 days of data) [2025-09-30T19:57:06.477758] [DEBUG] [LOCAL ] MMU: Primary data saved (16779 records). [2025-09-30T19:57:06.477914] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-30T19:57:06.478043] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMU took 24.8s. Estimated remaining: 2h 7m 8s. Rate: 7.8 symbols/min [2025-09-30T19:57:06.659715] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-30T19:57:06.661084] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:06.662392] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-30T19:57:06.662450] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-30T19:57:06.662623] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-30T19:57:06.662703] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-30T19:57:06.662758] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-30T19:57:06.662791] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-30T19:57:07.072323] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:07.454390] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-30T19:57:07.578085] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:57:08.254356] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-30T19:57:08.614240] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T19:57:08.620112] [INFO ] [REMOTE ] MNR: Full fetch complete (36851 records). [2025-09-30T19:57:08.620388] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-30T19:57:08.786731] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T19:57:08.850916] [INFO ] [REMOTE ] MMM: Full fetch complete (77108 records). [2025-09-30T19:57:08.881894] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-30T19:57:09.055071] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-30T19:57:09.268497] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-30T19:57:09.273858] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-30T19:57:09.290916] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-30T19:57:09.292671] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-30T19:57:09.377089] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:57:09.390683] [DEBUG] [LOCAL ] MNR: Trimmed 36851 records to 24517 (keeping 200 days of data) [2025-09-30T19:57:09.423041] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-30T19:57:09.431206] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:57:09.518759] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-30T19:57:09.557751] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:57:09.559169] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-30T19:57:09.570704] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-30T19:57:09.575931] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-30T19:57:09.582307] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-30T19:57:09.610062] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNTN took 3.1s. Estimated remaining: 2h 6m 57s. Rate: 7.8 symbols/min [2025-09-30T19:57:09.761735] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-30T19:57:09.788133] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-30T19:57:09.796075] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-30T19:57:09.801758] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-30T19:57:09.900854] [DEBUG] [LOCAL ] MMM: Trimmed 77108 records to 53187 (keeping 200 days of data) [2025-09-30T19:57:09.900746] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:09.902516] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-30T19:57:09.902993] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-30T19:57:09.905094] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-30T19:57:09.905889] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-30T19:57:09.907601] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-30T19:57:09.965103] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-30T19:57:10.181277] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T19:57:10.246694] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-30T19:57:10.383084] [DEBUG] [LOCAL ] MNR: Primary data saved (24517 records). [2025-09-30T19:57:10.401702] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-30T19:57:10.415172] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNR took 25.6s. Estimated remaining: 2h 6m 45s. Rate: 7.8 symbols/min [2025-09-30T19:57:10.667340] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:10.674218] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-30T19:57:10.752181] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:10.906974] [DEBUG] [LOCAL ] MOD: Loaded 45386 existing records from primary storage. [2025-09-30T19:57:10.910868] [INFO ] [MAIN ] MOD: Loaded 45386 existing records. [2025-09-30T19:57:11.194287] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:11.199950] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-30T19:57:11.200688] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-30T19:57:11.201717] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-30T19:57:11.202043] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-30T19:57:11.477590] [DEBUG] [LOCAL ] MMM: Primary data saved (53187 records). [2025-09-30T19:57:11.501501] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-30T19:57:11.542265] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MMM took 57.4s. Estimated remaining: 2h 6m 32s. Rate: 7.8 symbols/min [2025-09-30T19:57:11.773048] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:11.799543] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-30T19:57:11.893309] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:11.934978] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:57:12.000886] [DEBUG] [LOCAL ] MODG: Loaded 51575 existing records from primary storage. [2025-09-30T19:57:12.001211] [INFO ] [MAIN ] MODG: Loaded 51575 existing records. [2025-09-30T19:57:12.200402] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:12.200634] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-30T19:57:12.200761] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-30T19:57:12.201187] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-30T19:57:12.201248] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-30T19:57:12.262336] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-30T19:57:12.633081] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:13.063362] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-30T19:57:13.069820] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-30T19:57:13.359766] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:57:13.564126] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:57:13.854386] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-30T19:57:14.654335] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-30T19:57:14.927058] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T19:57:15.426536] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:57:15.454315] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-30T19:57:16.254377] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-30T19:57:16.922742] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-30T19:57:17.054371] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-30T19:57:17.237895] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T19:57:17.805391] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:57:17.854325] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-30T19:57:18.452779] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T19:57:18.654369] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-30T19:57:19.179382] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:57:19.454375] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-30T19:57:20.254379] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-30T19:57:20.519405] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T19:57:21.054404] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-30T19:57:21.190974] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T19:57:21.201211] [INFO ] [REMOTE ] MNSO: Full fetch complete (64206 records). [2025-09-30T19:57:21.201379] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-30T19:57:21.641184] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-30T19:57:21.641297] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-30T19:57:21.642475] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-30T19:57:21.642583] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-30T19:57:21.644176] [DEBUG] [LOCAL ] MNSO: Trimmed 64206 records to 44420 (keeping 200 days of data) [2025-09-30T19:57:21.880628] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-30T19:57:21.989059] [DEBUG] [LOCAL ] MNSO: Primary data saved (44420 records). [2025-09-30T19:57:21.989262] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-30T19:57:21.990287] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNSO took 33.2s. Estimated remaining: 2h 6m 27s. Rate: 7.8 symbols/min [2025-09-30T19:57:22.043718] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:57:22.203018] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:22.251014] [DEBUG] [LOCAL ] MOH: Loaded 41824 existing records from primary storage. [2025-09-30T19:57:22.251346] [INFO ] [MAIN ] MOH: Loaded 41824 existing records. [2025-09-30T19:57:22.445752] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:22.446014] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-30T19:57:22.446076] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-30T19:57:22.446699] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-30T19:57:22.446761] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-30T19:57:22.670581] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-30T19:57:22.832460] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:23.331469] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-30T19:57:23.454410] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-30T19:57:23.523820] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:57:24.254365] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-30T19:57:24.475838] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:57:24.632925] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:57:25.054389] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-30T19:57:25.854361] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-30T19:57:25.903469] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:57:26.567070] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:57:26.654351] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-30T19:57:27.454357] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-30T19:57:27.849380] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T19:57:28.060775] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:57:28.254362] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-30T19:57:29.054346] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-30T19:57:29.152925] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:57:29.854373] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-30T19:57:30.654376] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-30T19:57:30.730299] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T19:57:30.828823] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:57:31.442173] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:57:31.454319] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-30T19:57:32.109635] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:57:32.254354] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-30T19:57:33.054336] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-30T19:57:33.155487] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T19:57:33.854355] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-30T19:57:33.941790] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:57:34.657071] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-30T19:57:34.661370] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T19:57:35.335847] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T19:57:35.454361] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-30T19:57:36.079819] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T19:57:36.254384] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-30T19:57:36.982597] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:57:37.054339] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-30T19:57:37.854369] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-30T19:57:38.424581] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-30T19:57:38.464853] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:57:38.654430] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-30T19:57:39.454440] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-30T19:57:39.711818] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:57:40.254360] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-30T19:57:40.662971] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:57:41.054373] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-30T19:57:41.108483] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:57:41.117875] [INFO ] [REMOTE ] MOD: Full fetch complete (66302 records). [2025-09-30T19:57:41.118049] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-30T19:57:41.550729] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-30T19:57:41.550935] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-30T19:57:41.551950] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-30T19:57:41.552015] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-30T19:57:41.553544] [DEBUG] [LOCAL ] MOD: Trimmed 66302 records to 45309 (keeping 200 days of data) [2025-09-30T19:57:41.837403] [DEBUG] [LOCAL ] MOD: Primary data saved (45309 records). [2025-09-30T19:57:41.837538] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-30T19:57:41.837678] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MOD took 31.4s. Estimated remaining: 2h 6m 28s. Rate: 7.8 symbols/min [2025-09-30T19:57:41.862305] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-30T19:57:42.036944] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:42.069522] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:57:42.081097] [INFO ] [REMOTE ] MODG: Full fetch complete (74782 records). [2025-09-30T19:57:42.081264] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-30T19:57:42.446056] [DEBUG] [LOCAL ] MOS: Loaded 53505 existing records from primary storage. [2025-09-30T19:57:42.457206] [INFO ] [MAIN ] MOS: Loaded 53505 existing records. [2025-09-30T19:57:42.688447] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-30T19:57:42.694502] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-30T19:57:42.711565] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-30T19:57:42.722001] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-30T19:57:42.785332] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:42.786355] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-30T19:57:42.786483] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-30T19:57:42.786225] [DEBUG] [LOCAL ] MODG: Trimmed 74782 records to 51561 (keeping 200 days of data) [2025-09-30T19:57:42.787096] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-30T19:57:42.787172] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-30T19:57:43.311511] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:43.320512] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-30T19:57:43.460380] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-30T19:57:43.475398] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-30T19:57:43.562717] [DEBUG] [LOCAL ] MODG: Primary data saved (51561 records). [2025-09-30T19:57:43.562878] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-30T19:57:43.562972] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MODG took 32.0s. Estimated remaining: 2h 6m 16s. Rate: 7.8 symbols/min [2025-09-30T19:57:43.747763] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:43.776889] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T19:57:43.805746] [DEBUG] [LOCAL ] MOV: Loaded 22031 existing records from primary storage. [2025-09-30T19:57:43.806060] [INFO ] [MAIN ] MOV: Loaded 22031 existing records. [2025-09-30T19:57:43.996974] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:43.997256] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-30T19:57:43.997307] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-30T19:57:43.997574] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-30T19:57:43.997633] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-30T19:57:44.264212] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-30T19:57:44.379286] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:44.971786] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:57:45.054355] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-30T19:57:45.840768] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-30T19:57:45.854301] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-30T19:57:45.899704] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T19:57:45.910012] [INFO ] [REMOTE ] MOH: Full fetch complete (58415 records). [2025-09-30T19:57:45.910182] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-30T19:57:46.343523] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-30T19:57:46.343695] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-30T19:57:46.345702] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-30T19:57:46.345783] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-30T19:57:46.348513] [DEBUG] [LOCAL ] MOH: Trimmed 58415 records to 41781 (keeping 200 days of data) [2025-09-30T19:57:46.612315] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:57:46.654586] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-30T19:57:46.675705] [DEBUG] [LOCAL ] MOH: Primary data saved (41781 records). [2025-09-30T19:57:46.675838] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-30T19:57:46.677474] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOH took 24.7s. Estimated remaining: 2h 6m 5s. Rate: 7.8 symbols/min [2025-09-30T19:57:46.867158] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:46.927981] [DEBUG] [LOCAL ] MP: Loaded 53669 existing records from primary storage. [2025-09-30T19:57:46.928517] [INFO ] [MAIN ] MP: Loaded 53669 existing records. [2025-09-30T19:57:47.134462] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:47.134727] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-30T19:57:47.134785] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-30T19:57:47.135436] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-30T19:57:47.135502] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-30T19:57:47.459495] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-30T19:57:47.545419] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:47.662683] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:57:48.098047] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-30T19:57:48.112462] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-30T19:57:48.112636] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-30T19:57:48.266069] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-30T19:57:48.360822] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:57:48.361754] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:57:48.361853] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:57:48.361925] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-30T19:57:48.362018] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-30T19:57:48.362079] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-30T19:57:48.362136] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-30T19:57:48.362231] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MO took 38.8s. Estimated remaining: 2h 5m 53s. Rate: 7.8 symbols/min [2025-09-30T19:57:48.547398] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:57:48.555876] [DEBUG] [LOCAL ] MPA: Loaded 5231 existing records from primary storage. [2025-09-30T19:57:48.556090] [INFO ] [MAIN ] MPA: Loaded 5231 existing records. [2025-09-30T19:57:48.755964] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:57:48.756180] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-30T19:57:48.756229] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-30T19:57:48.756448] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-30T19:57:48.756508] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-30T19:57:49.057890] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-30T19:57:49.177919] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:57:49.210485] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:57:49.245003] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:57:49.854369] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-30T19:57:50.654384] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-30T19:57:50.835881] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T19:57:51.238722] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T19:57:51.454359] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-30T19:57:51.701405] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:57:51.770917] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T19:57:52.254381] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-30T19:57:53.054363] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-30T19:57:53.854376] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-30T19:57:54.157046] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T19:57:54.175597] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:57:54.212299] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T19:57:54.654352] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-30T19:57:55.454377] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-30T19:57:56.022214] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T19:57:56.254365] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-30T19:57:56.450046] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T19:57:57.054355] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-30T19:57:57.392398] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T19:57:57.854369] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-30T19:57:58.654366] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-30T19:57:58.763779] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T19:57:59.454415] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-30T19:57:59.701444] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:57:59.969923] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T19:58:00.254366] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-30T19:58:01.054372] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-30T19:58:01.103391] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:58:01.161610] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T19:58:01.854387] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-30T19:58:02.654389] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-30T19:58:02.764548] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:58:03.454376] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-30T19:58:03.555783] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:58:03.767632] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:58:04.110885] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T19:58:04.254380] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-30T19:58:05.054380] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-30T19:58:05.854358] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-30T19:58:05.892265] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:58:06.487984] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T19:58:06.654383] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-30T19:58:07.242184] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:58:07.454325] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-30T19:58:07.589324] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:58:08.064712] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T19:58:08.254561] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-30T19:58:09.054330] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-30T19:58:09.374024] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T19:58:09.854385] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-30T19:58:10.654385] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-30T19:58:10.754476] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:58:10.768317] [INFO ] [REMOTE ] MOS: Full fetch complete (77453 records). [2025-09-30T19:58:10.768542] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-30T19:58:11.012499] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T19:58:11.238920] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-30T19:58:11.239063] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-30T19:58:11.240228] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-30T19:58:11.240306] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-30T19:58:11.241951] [DEBUG] [LOCAL ] MOS: Trimmed 77453 records to 53504 (keeping 200 days of data) [2025-09-30T19:58:11.475710] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-30T19:58:11.607565] [DEBUG] [LOCAL ] MOS: Primary data saved (53504 records). [2025-09-30T19:58:11.607766] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-30T19:58:11.607934] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOS took 29.8s. Estimated remaining: 2h 5m 56s. Rate: 7.8 symbols/min [2025-09-30T19:58:11.800231] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:11.866148] [DEBUG] [LOCAL ] MPC: Loaded 52108 existing records from primary storage. [2025-09-30T19:58:11.866514] [INFO ] [MAIN ] MPC: Loaded 52108 existing records. [2025-09-30T19:58:12.057289] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:12.057509] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-30T19:58:12.057577] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-30T19:58:12.058337] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-30T19:58:12.058414] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-30T19:58:12.214710] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:58:12.247452] [INFO ] [REMOTE ] MPA: Full fetch complete (7130 records). [2025-09-30T19:58:12.249522] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-30T19:58:12.258041] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-30T19:58:12.606933] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:12.884186] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-30T19:58:12.884378] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-30T19:58:12.884696] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-30T19:58:12.884801] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-30T19:58:12.885965] [DEBUG] [LOCAL ] MPA: Trimmed 7130 records to 5222 (keeping 200 days of data) [2025-09-30T19:58:12.922818] [DEBUG] [LOCAL ] MPA: Primary data saved (5222 records). [2025-09-30T19:58:12.923090] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-30T19:58:12.923735] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MPA took 24.6s. Estimated remaining: 2h 5m 44s. Rate: 7.8 symbols/min [2025-09-30T19:58:13.010694] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:58:13.034855] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-30T19:58:13.059523] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-30T19:58:13.188101] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:13.245871] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-09-30T19:58:13.246236] [INFO ] [MAIN ] MPLX: Loaded 50731 existing records. [2025-09-30T19:58:13.439490] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:13.439762] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-30T19:58:13.439908] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-30T19:58:13.440435] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-30T19:58:13.440495] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-30T19:58:13.845232] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:13.854398] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-30T19:58:14.654337] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-30T19:58:14.893469] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:58:14.939322] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:58:14.944268] [INFO ] [REMOTE ] MOV: Full fetch complete (30603 records). [2025-09-30T19:58:14.944378] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-30T19:58:15.356276] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-30T19:58:15.356418] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-30T19:58:15.357195] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-30T19:58:15.357264] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-30T19:58:15.358193] [DEBUG] [LOCAL ] MOV: Trimmed 30603 records to 21979 (keeping 200 days of data) [2025-09-30T19:58:15.455199] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-30T19:58:15.502735] [DEBUG] [LOCAL ] MOV: Primary data saved (21979 records). [2025-09-30T19:58:15.502878] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-30T19:58:15.502968] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MOV took 31.9s. Estimated remaining: 2h 5m 33s. Rate: 7.8 symbols/min [2025-09-30T19:58:15.686719] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:15.693856] [DEBUG] [LOCAL ] MPV: Loaded 4996 existing records from primary storage. [2025-09-30T19:58:15.694059] [INFO ] [MAIN ] MPV: Loaded 4996 existing records. [2025-09-30T19:58:15.892326] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:15.892665] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-30T19:58:15.892848] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-30T19:58:15.893166] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-30T19:58:15.893314] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-30T19:58:16.251583] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T19:58:16.257026] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-30T19:58:16.345427] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:17.054367] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-30T19:58:17.854339] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-30T19:58:17.911428] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T19:58:18.083860] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T19:58:18.488876] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T19:58:18.654337] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-30T19:58:18.936769] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:58:19.336665] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:58:19.454375] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-30T19:58:20.254405] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-30T19:58:21.054358] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-30T19:58:21.854330] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-30T19:58:21.980576] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:58:22.102630] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-30T19:58:22.472635] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:58:22.622186] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T19:58:22.654347] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-30T19:58:23.454915] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-30T19:58:23.457521] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T19:58:24.254360] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-30T19:58:24.659856] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T19:58:25.054352] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-30T19:58:25.179697] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T19:58:25.854365] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-30T19:58:26.472402] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T19:58:26.654376] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-30T19:58:26.812629] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T19:58:27.454360] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-30T19:58:28.205991] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T19:58:28.254327] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-30T19:58:29.054370] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-30T19:58:29.152008] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:58:29.681478] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T19:58:29.779315] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:58:29.854385] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-30T19:58:30.422682] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T19:58:30.654350] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-30T19:58:31.454366] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-30T19:58:32.254388] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-30T19:58:32.776165] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T19:58:33.008375] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-30T19:58:33.054351] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-30T19:58:33.854397] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-30T19:58:34.047633] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:58:34.401132] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T19:58:34.434455] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T19:58:34.654375] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-30T19:58:35.454387] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-30T19:58:36.032503] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:58:36.034317] [INFO ] [REMOTE ] MPV: Full fetch complete (8030 records). [2025-09-30T19:58:36.034415] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-30T19:58:36.263092] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-30T19:58:36.439268] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-30T19:58:36.439480] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-30T19:58:36.439808] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-30T19:58:36.439933] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-30T19:58:36.440570] [DEBUG] [LOCAL ] MPV: Trimmed 8030 records to 4979 (keeping 200 days of data) [2025-09-30T19:58:36.503348] [DEBUG] [LOCAL ] MPV: Primary data saved (4979 records). [2025-09-30T19:58:36.504104] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-30T19:58:36.505537] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:58:36.505750] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPV took 21.0s. Estimated remaining: 2h 5m 34s. Rate: 7.8 symbols/min [2025-09-30T19:58:36.709814] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:36.785014] [DEBUG] [LOCAL ] MPW: Loaded 53495 existing records from primary storage. [2025-09-30T19:58:36.785407] [INFO ] [MAIN ] MPW: Loaded 53495 existing records. [2025-09-30T19:58:36.981404] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:36.982716] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-30T19:58:36.982780] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-30T19:58:36.983748] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-30T19:58:36.983821] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-30T19:58:37.059993] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-30T19:58:37.368198] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:37.854336] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-30T19:58:38.025962] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:58:38.648240] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:58:38.662240] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-30T19:58:39.454397] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-30T19:58:40.254404] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-30T19:58:40.298253] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-30T19:58:40.310709] [INFO ] [REMOTE ] MP: Full fetch complete (77313 records). [2025-09-30T19:58:40.310877] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-30T19:58:40.781325] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T19:58:40.833934] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-30T19:58:40.834043] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-30T19:58:40.835208] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-30T19:58:40.835276] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-30T19:58:40.837269] [DEBUG] [LOCAL ] MP: Trimmed 77313 records to 53675 (keeping 200 days of data) [2025-09-30T19:58:41.055134] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-30T19:58:41.186806] [DEBUG] [LOCAL ] MP: Primary data saved (53675 records). [2025-09-30T19:58:41.186968] [INFO ] [MAIN ] MP: Full history saved. [2025-09-30T19:58:41.187981] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MP took 54.5s. Estimated remaining: 2h 5m 25s. Rate: 7.8 symbols/min [2025-09-30T19:58:41.391357] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:41.426177] [DEBUG] [LOCAL ] MPX: Loaded 4085 existing records from primary storage. [2025-09-30T19:58:41.428369] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T19:58:41.428619] [INFO ] [MAIN ] MPX: Loaded 4085 existing records. [2025-09-30T19:58:41.476448] [INFO ] [REMOTE ] MPC: Full fetch complete (75855 records). [2025-09-30T19:58:41.512380] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-30T19:58:41.750762] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:41.779078] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-30T19:58:41.785163] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-30T19:58:41.805875] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-30T19:58:41.828680] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-30T19:58:42.359264] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-30T19:58:42.359509] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-30T19:58:42.380406] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-30T19:58:42.400285] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-30T19:58:42.484106] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-30T19:58:42.490434] [DEBUG] [LOCAL ] MPC: Trimmed 75855 records to 52086 (keeping 200 days of data) [2025-09-30T19:58:42.518039] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-30T19:58:42.671434] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:42.680824] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-30T19:58:42.773450] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:58:42.801571] [INFO ] [REMOTE ] MPLX: Full fetch complete (74059 records). [2025-09-30T19:58:42.805740] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-30T19:58:43.366173] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-30T19:58:43.373233] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-30T19:58:43.374811] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-30T19:58:43.378236] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-30T19:58:43.378096] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:58:43.387520] [DEBUG] [LOCAL ] MPLX: Trimmed 74059 records to 50737 (keeping 200 days of data) [2025-09-30T19:58:43.489338] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-30T19:58:43.594175] [DEBUG] [LOCAL ] MPC: Primary data saved (52086 records). [2025-09-30T19:58:43.596794] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-30T19:58:43.596975] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPC took 32.0s. Estimated remaining: 2h 5m 13s. Rate: 7.8 symbols/min [2025-09-30T19:58:43.795127] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:43.862940] [DEBUG] [LOCAL ] MQT: Loaded 8558 existing records from primary storage. [2025-09-30T19:58:43.900320] [INFO ] [MAIN ] MQT: Loaded 8558 existing records. [2025-09-30T19:58:44.070809] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:58:44.140016] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:44.141161] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-30T19:58:44.141954] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-30T19:58:44.142625] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-30T19:58:44.143281] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-30T19:58:44.279184] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-30T19:58:44.551064] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T19:58:44.615143] [DEBUG] [LOCAL ] MPLX: Primary data saved (50737 records). [2025-09-30T19:58:44.625937] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-30T19:58:44.636385] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPLX took 31.7s. Estimated remaining: 2h 5m 1s. Rate: 7.8 symbols/min [2025-09-30T19:58:44.799983] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:44.956012] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:58:44.961861] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:58:44.981868] [DEBUG] [LOCAL ] MQY: Loaded 16850 existing records from primary storage. [2025-09-30T19:58:44.982161] [INFO ] [MAIN ] MQY: Loaded 16850 existing records. [2025-09-30T19:58:45.059611] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-30T19:58:45.187635] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:58:45.187920] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-30T19:58:45.188028] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-30T19:58:45.188423] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-30T19:58:45.188484] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-30T19:58:45.570808] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:58:45.854351] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-30T19:58:45.925559] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T19:58:46.654421] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-30T19:58:46.992277] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:58:47.303815] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T19:58:47.454360] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-30T19:58:48.254370] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-30T19:58:49.054392] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-30T19:58:49.217076] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:58:49.282283] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:58:49.854334] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-30T19:58:49.897043] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:58:50.654375] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-30T19:58:50.860925] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:58:51.454403] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-30T19:58:52.254346] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-30T19:58:52.447185] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:58:52.619817] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:58:53.015923] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T19:58:53.054354] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-30T19:58:53.854383] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-30T19:58:54.074789] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T19:58:54.635844] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:58:54.654303] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-30T19:58:55.454333] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-30T19:58:55.598049] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T19:58:56.254384] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-30T19:58:56.655417] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T19:58:57.054395] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-30T19:58:57.581633] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T19:58:57.854327] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-30T19:58:57.954575] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T19:58:58.476025] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T19:58:58.654417] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-30T19:58:59.454395] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-30T19:59:00.118979] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T19:59:00.254331] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-30T19:59:00.685902] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T19:59:00.714127] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T19:59:01.054375] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-30T19:59:01.630948] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:59:01.854412] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-30T19:59:02.654370] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-30T19:59:03.350552] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T19:59:03.454357] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-30T19:59:03.599495] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:59:04.011115] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:59:04.254416] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-30T19:59:04.957476] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T19:59:05.054387] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-30T19:59:05.854377] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-30T19:59:06.048417] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T19:59:06.051099] [INFO ] [REMOTE ] MQT: Full fetch complete (13372 records). [2025-09-30T19:59:06.051312] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-30T19:59:06.441349] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-30T19:59:06.441431] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-30T19:59:06.441810] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-30T19:59:06.441874] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-30T19:59:06.442373] [DEBUG] [LOCAL ] MQT: Trimmed 13372 records to 8614 (keeping 200 days of data) [2025-09-30T19:59:06.496291] [DEBUG] [LOCAL ] MQT: Primary data saved (8614 records). [2025-09-30T19:59:06.496438] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-30T19:59:06.496529] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MQT took 22.9s. Estimated remaining: 2h 5m 3s. Rate: 7.8 symbols/min [2025-09-30T19:59:06.659466] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-30T19:59:06.714875] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:06.757878] [DEBUG] [LOCAL ] MRC: Loaded 37586 existing records from primary storage. [2025-09-30T19:59:06.758231] [INFO ] [MAIN ] MRC: Loaded 37586 existing records. [2025-09-30T19:59:06.874950] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T19:59:06.962366] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:06.962594] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-30T19:59:06.962669] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-30T19:59:06.963041] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-30T19:59:06.963102] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-30T19:59:07.338314] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:07.454375] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-30T19:59:08.254333] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-30T19:59:08.521087] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T19:59:08.691688] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T19:59:08.853234] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:59:09.054402] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-30T19:59:09.854409] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-30T19:59:10.442238] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T19:59:10.654381] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-30T19:59:11.225044] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-30T19:59:11.454369] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-30T19:59:11.669542] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T19:59:12.042620] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T19:59:12.044069] [INFO ] [REMOTE ] MPX: Full fetch complete (6748 records). [2025-09-30T19:59:12.044149] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-30T19:59:12.259472] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-30T19:59:12.463678] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-30T19:59:12.463775] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-30T19:59:12.463971] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-30T19:59:12.464015] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-30T19:59:12.464466] [DEBUG] [LOCAL ] MPX: Trimmed 6748 records to 4071 (keeping 200 days of data) [2025-09-30T19:59:12.489772] [DEBUG] [LOCAL ] MPX: Primary data saved (4071 records). [2025-09-30T19:59:12.489899] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-30T19:59:12.489982] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MPX took 31.3s. Estimated remaining: 2h 4m 54s. Rate: 7.8 symbols/min [2025-09-30T19:59:13.054351] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-30T19:59:13.854374] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-30T19:59:14.131574] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:59:14.145423] [INFO ] [REMOTE ] MPW: Full fetch complete (77514 records). [2025-09-30T19:59:14.145638] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-30T19:59:14.284515] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T19:59:14.321769] [INFO ] [REMOTE ] MQY: Full fetch complete (27139 records). [2025-09-30T19:59:14.338793] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-30T19:59:14.953297] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-30T19:59:14.967599] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-30T19:59:14.968864] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-30T19:59:14.974743] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-30T19:59:15.049460] [DEBUG] [LOCAL ] MPW: Trimmed 77514 records to 53495 (keeping 200 days of data) [2025-09-30T19:59:15.079227] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-30T19:59:15.079584] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-30T19:59:15.079969] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-30T19:59:15.080019] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-30T19:59:15.080864] [DEBUG] [LOCAL ] MQY: Trimmed 27139 records to 16937 (keeping 200 days of data) [2025-09-30T19:59:15.308569] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:59:15.321941] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-30T19:59:15.332713] [DEBUG] [LOCAL ] MQY: Primary data saved (16937 records). [2025-09-30T19:59:15.333421] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-30T19:59:15.333688] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 30.7s. Estimated remaining: 2h 4m 43s. Rate: 7.8 symbols/min [2025-09-30T19:59:15.562620] [DEBUG] [LOCAL ] MPW: Primary data saved (53495 records). [2025-09-30T19:59:15.562784] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-30T19:59:15.562873] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MPW took 39.0s. Estimated remaining: 2h 4m 30s. Rate: 7.8 symbols/min [2025-09-30T19:59:16.430606] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T19:59:16.439694] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-30T19:59:17.906448] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:59:17.915422] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-30T19:59:19.448694] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:59:19.457946] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-30T19:59:20.737993] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:59:20.746113] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-30T19:59:22.177408] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:59:22.185421] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-30T19:59:23.742323] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:59:23.755976] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-30T19:59:25.122510] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T19:59:25.132261] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-30T19:59:26.587180] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:59:26.596146] [INFO ] [REMOTE ] MRC: Full fetch complete (54789 records). [2025-09-30T19:59:26.596323] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-30T19:59:27.013996] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-30T19:59:27.014111] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-30T19:59:27.015174] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-30T19:59:27.015243] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-30T19:59:27.016625] [DEBUG] [LOCAL ] MRC: Trimmed 54789 records to 37475 (keeping 200 days of data) [2025-09-30T19:59:27.244151] [DEBUG] [LOCAL ] MRC: Primary data saved (37475 records). [2025-09-30T19:59:27.244305] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-30T19:59:27.244400] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRC took 20.7s. Estimated remaining: 2h 4m 25s. Rate: 7.8 symbols/min [2025-09-30T19:59:27.937882] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:28.033596] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:28.026118] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-30T19:59:28.035038] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-30T19:59:28.035207] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-30T19:59:28.035255] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-30T19:59:28.069450] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:28.053575] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:28.053681] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-30T19:59:28.070406] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-30T19:59:28.218109] [DEBUG] [LOCAL ] MSA: Loaded 18823 existing records from primary storage. [2025-09-30T19:59:28.219268] [INFO ] [MAIN ] MSA: Loaded 18823 existing records. [2025-09-30T19:59:28.596330] [DEBUG] [LOCAL ] MS: Loaded 53692 existing records from primary storage. [2025-09-30T19:59:28.627097] [INFO ] [MAIN ] MS: Loaded 53692 existing records. [2025-09-30T19:59:28.633207] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-30T19:59:28.672350] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-09-30T19:59:28.717194] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:28.743082] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-30T19:59:28.822275] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-30T19:59:28.899704] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-30T19:59:28.962188] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-30T19:59:29.029743] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:29.052866] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-30T19:59:29.285836] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:29.306107] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-30T19:59:29.334023] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:29.334162] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-30T19:59:29.340187] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-30T19:59:29.350570] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-30T19:59:29.350727] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-30T19:59:29.350863] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-30T19:59:29.373299] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-30T19:59:29.418565] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-30T19:59:29.564097] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:59:29.659269] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-30T19:59:29.924278] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:59:29.970906] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-30T19:59:29.996719] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:59:30.184308] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-30T19:59:30.229009] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:30.225370] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-30T19:59:30.257496] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-30T19:59:30.257120] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-30T19:59:30.275449] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-30T19:59:30.286601] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 3.0s. Estimated remaining: 2h 4m 14s. Rate: 7.8 symbols/min [2025-09-30T19:59:30.526752] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:30.553478] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-30T19:59:30.566161] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:30.569919] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-30T19:59:30.647872] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:30.657495] [DEBUG] [LOCAL ] MSB: Loaded 7854 existing records from primary storage. [2025-09-30T19:59:30.657729] [INFO ] [MAIN ] MSB: Loaded 7854 existing records. [2025-09-30T19:59:30.843546] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:30.843838] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-30T19:59:30.843894] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-30T19:59:30.844185] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-30T19:59:30.844250] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-30T19:59:31.275208] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:31.275778] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-30T19:59:31.337966] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:59:31.342365] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-30T19:59:31.997909] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:59:31.999992] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-30T19:59:32.228579] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T19:59:32.232565] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-30T19:59:32.477776] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T19:59:32.489901] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-30T19:59:32.539913] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:59:32.551210] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-30T19:59:32.732069] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T19:59:32.736014] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-30T19:59:33.244773] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:59:33.248796] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-30T19:59:33.591933] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T19:59:33.595615] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-30T19:59:34.045878] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T19:59:34.050300] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-30T19:59:34.255383] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T19:59:34.257792] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-30T19:59:34.381399] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T19:59:34.393883] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-30T19:59:34.592760] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T19:59:34.604697] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-30T19:59:34.735891] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T19:59:34.738600] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-30T19:59:35.265059] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:59:35.454397] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-30T19:59:35.488526] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:59:35.973328] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T19:59:36.259430] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-30T19:59:36.266608] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:59:36.597153] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T19:59:37.054359] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-30T19:59:37.854362] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-30T19:59:38.249020] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T19:59:38.273065] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:59:38.654401] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-30T19:59:38.828074] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:59:39.454337] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-30T19:59:39.678952] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T19:59:40.254379] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-30T19:59:41.029939] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:59:41.054326] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-30T19:59:41.289342] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:59:41.503868] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T19:59:41.854363] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-30T19:59:42.654371] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-30T19:59:42.928349] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T19:59:43.454358] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-30T19:59:44.253979] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:59:44.256701] [INFO ] [REMOTE ] MSB: Full fetch complete (12956 records). [2025-09-30T19:59:44.256504] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-30T19:59:44.256846] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-30T19:59:44.657557] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-30T19:59:44.657730] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-30T19:59:44.658347] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-30T19:59:44.658429] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-30T19:59:44.659137] [DEBUG] [LOCAL ] MSB: Trimmed 12956 records to 7838 (keeping 200 days of data) [2025-09-30T19:59:44.712028] [DEBUG] [LOCAL ] MSB: Primary data saved (7838 records). [2025-09-30T19:59:44.712216] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-30T19:59:44.712327] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSB took 14.4s. Estimated remaining: 2h 4m 11s. Rate: 7.8 symbols/min [2025-09-30T19:59:44.900249] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:44.900724] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-30T19:59:44.900921] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-30T19:59:44.901069] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-30T19:59:44.901224] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-30T19:59:44.901354] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-30T19:59:44.901411] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-30T19:59:45.066629] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-30T19:59:45.102246] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T19:59:45.360986] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:45.362598] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T19:59:45.854368] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-30T19:59:46.654397] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-30T19:59:46.983849] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-30T19:59:47.112984] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T19:59:47.117705] [INFO ] [REMOTE ] MSA: Full fetch complete (25805 records). [2025-09-30T19:59:47.117796] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-30T19:59:47.459464] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-30T19:59:47.621518] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-30T19:59:47.621241] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-30T19:59:47.621744] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-30T19:59:47.633392] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-30T19:59:47.633834] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-30T19:59:47.635331] [DEBUG] [LOCAL ] MSA: Trimmed 25805 records to 18880 (keeping 200 days of data) [2025-09-30T19:59:47.756775] [DEBUG] [LOCAL ] MSA: Primary data saved (18880 records). [2025-09-30T19:59:47.756921] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-30T19:59:47.757008] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSA took 20.5s. Estimated remaining: 2h 4m 1s. Rate: 7.8 symbols/min [2025-09-30T19:59:47.937520] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:59:47.976142] [DEBUG] [LOCAL ] MSCI: Loaded 34572 existing records from primary storage. [2025-09-30T19:59:47.976443] [INFO ] [MAIN ] MSCI: Loaded 34572 existing records. [2025-09-30T19:59:48.159983] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:59:48.160284] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-30T19:59:48.160341] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-30T19:59:48.160851] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-30T19:59:48.160914] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-30T19:59:48.259599] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-30T19:59:48.544928] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:59:48.759748] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T19:59:49.054386] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-30T19:59:49.854401] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-30T19:59:49.885921] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T19:59:49.921450] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-30T19:59:50.654369] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-30T19:59:51.087753] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T19:59:51.454362] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-30T19:59:51.759536] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T19:59:52.254377] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-30T19:59:52.582574] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T19:59:53.054400] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-30T19:59:53.575422] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-30T19:59:53.854402] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-30T19:59:54.654389] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-30T19:59:54.996117] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T19:59:55.131183] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T19:59:55.191915] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:59:55.454378] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-30T19:59:56.254375] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-30T19:59:56.600752] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-30T19:59:56.633492] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:59:57.054365] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-30T19:59:57.854365] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-30T19:59:58.297853] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T19:59:58.299720] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T19:59:58.654381] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-30T19:59:59.454370] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-30T20:00:00.254360] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-30T20:00:00.718425] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T20:00:01.054408] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-30T20:00:01.095951] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T20:00:01.225740] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-30T20:00:01.854420] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-30T20:00:02.026121] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T20:00:02.027565] [INFO ] [REMOTE ] MSC: Full fetch complete (2529 records). [2025-09-30T20:00:02.027673] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-30T20:00:02.303325] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-30T20:00:02.303554] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:00:02.303662] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:00:02.303808] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-30T20:00:02.303888] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-30T20:00:02.303967] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-30T20:00:02.304061] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-30T20:00:02.304162] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSC took 17.6s. Estimated remaining: 2h 3m 58s. Rate: 7.8 symbols/min [2025-09-30T20:00:02.523561] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:02.542400] [DEBUG] [LOCAL ] MSD: Loaded 15734 existing records from primary storage. [2025-09-30T20:00:02.542697] [INFO ] [MAIN ] MSD: Loaded 15734 existing records. [2025-09-30T20:00:02.662379] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-30T20:00:02.773374] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:02.773702] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-30T20:00:02.773764] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-30T20:00:02.774748] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-30T20:00:02.774810] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-30T20:00:03.192890] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:03.454347] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-30T20:00:03.656567] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:00:04.254363] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-30T20:00:04.382619] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T20:00:05.050929] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T20:00:05.062907] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-30T20:00:05.747518] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T20:00:05.854369] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-30T20:00:06.654415] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-30T20:00:07.251307] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T20:00:07.401693] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T20:00:07.454403] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-30T20:00:08.254377] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-30T20:00:08.652261] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T20:00:08.664668] [INFO ] [REMOTE ] MS: Full fetch complete (77718 records). [2025-09-30T20:00:08.664894] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-30T20:00:08.977505] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T20:00:09.060755] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-30T20:00:09.138154] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-30T20:00:09.138428] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-30T20:00:09.139700] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-30T20:00:09.140014] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-30T20:00:09.143403] [DEBUG] [LOCAL ] MS: Trimmed 77718 records to 53691 (keeping 200 days of data) [2025-09-30T20:00:09.236079] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T20:00:09.534621] [DEBUG] [LOCAL ] MS: Primary data saved (53691 records). [2025-09-30T20:00:09.534794] [INFO ] [MAIN ] MS: Full history saved. [2025-09-30T20:00:09.534882] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MS took 42.3s. Estimated remaining: 2h 3m 50s. Rate: 7.8 symbols/min [2025-09-30T20:00:09.729719] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:09.776300] [DEBUG] [LOCAL ] MSDL: Loaded 38124 existing records from primary storage. [2025-09-30T20:00:09.776676] [INFO ] [MAIN ] MSDL: Loaded 38124 existing records. [2025-09-30T20:00:09.858330] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-30T20:00:09.992434] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:09.992874] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-30T20:00:09.992972] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-30T20:00:09.993869] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-30T20:00:09.993933] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-30T20:00:10.132581] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T20:00:10.422672] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:10.654371] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-30T20:00:11.454400] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-30T20:00:11.655849] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T20:00:12.082795] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:00:12.107897] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T20:00:12.254412] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-30T20:00:13.054398] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-30T20:00:13.686433] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T20:00:13.701163] [INFO ] [REMOTE ] MSCI: Full fetch complete (50448 records). [2025-09-30T20:00:13.701418] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-30T20:00:13.859516] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-30T20:00:14.130054] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-30T20:00:14.130159] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-30T20:00:14.131042] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-30T20:00:14.131119] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-30T20:00:14.132908] [DEBUG] [LOCAL ] MSCI: Trimmed 50448 records to 34570 (keeping 200 days of data) [2025-09-30T20:00:14.393214] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T20:00:14.416440] [DEBUG] [LOCAL ] MSCI: Primary data saved (34570 records). [2025-09-30T20:00:14.416600] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-30T20:00:14.416782] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 26.7s. Estimated remaining: 2h 3m 40s. Rate: 7.8 symbols/min [2025-09-30T20:00:14.620583] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:14.652299] [DEBUG] [LOCAL ] MSGE: Loaded 26891 existing records from primary storage. [2025-09-30T20:00:14.652569] [INFO ] [MAIN ] MSGE: Loaded 26891 existing records. [2025-09-30T20:00:14.663977] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-30T20:00:14.850597] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:14.850843] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-30T20:00:14.850896] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-30T20:00:14.851352] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-30T20:00:14.851440] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-30T20:00:15.227511] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:15.380533] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T20:00:15.454351] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-30T20:00:16.254391] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-30T20:00:16.541442] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-30T20:00:16.562562] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-30T20:00:16.562811] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-30T20:00:16.950529] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T20:00:17.062891] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-30T20:00:17.297140] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-30T20:00:17.298242] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-30T20:00:17.300605] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-30T20:00:17.336580] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-30T20:00:17.340610] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T20:00:17.354964] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 53789 (keeping 200 days of data) [2025-09-30T20:00:17.762241] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-30T20:00:17.762398] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-30T20:00:17.765034] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MRK took 50.5s. Estimated remaining: 2h 3m 29s. Rate: 7.8 symbols/min [2025-09-30T20:00:17.859574] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-30T20:00:17.964619] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:17.986235] [DEBUG] [LOCAL ] MSGS: Loaded 17098 existing records from primary storage. [2025-09-30T20:00:17.986523] [INFO ] [MAIN ] MSGS: Loaded 17098 existing records. [2025-09-30T20:00:18.197197] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:18.197426] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-30T20:00:18.197506] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-30T20:00:18.197884] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-30T20:00:18.197947] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-30T20:00:18.472015] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T20:00:18.662584] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-30T20:00:18.688581] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:18.973933] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T20:00:19.311065] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T20:00:19.454361] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-30T20:00:20.031770] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T20:00:20.254381] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-30T20:00:21.054395] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-30T20:00:21.375882] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T20:00:21.721327] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T20:00:21.854362] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-30T20:00:22.654352] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-30T20:00:23.232765] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T20:00:23.454368] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-30T20:00:23.509522] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T20:00:24.254372] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-30T20:00:24.635855] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T20:00:25.054384] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-30T20:00:25.436262] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T20:00:25.855875] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-30T20:00:25.858726] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T20:00:26.654343] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-30T20:00:27.016887] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T20:00:27.454374] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-30T20:00:28.179755] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T20:00:28.254337] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-30T20:00:28.629117] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T20:00:28.633707] [INFO ] [REMOTE ] MSD: Full fetch complete (22373 records). [2025-09-30T20:00:28.633832] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-30T20:00:29.047571] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-30T20:00:29.047676] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-30T20:00:29.048186] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-30T20:00:29.048248] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-30T20:00:29.049188] [DEBUG] [LOCAL ] MSD: Trimmed 22373 records to 15819 (keeping 200 days of data) [2025-09-30T20:00:29.089324] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-30T20:00:29.153693] [DEBUG] [LOCAL ] MSD: Primary data saved (15819 records). [2025-09-30T20:00:29.153864] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-30T20:00:29.153984] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSD took 26.8s. Estimated remaining: 2h 3m 24s. Rate: 7.8 symbols/min [2025-09-30T20:00:29.356721] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:29.409593] [DEBUG] [LOCAL ] MSI: Loaded 40336 existing records from primary storage. [2025-09-30T20:00:29.409947] [INFO ] [MAIN ] MSI: Loaded 40336 existing records. [2025-09-30T20:00:29.631929] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:29.632240] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-30T20:00:29.632466] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-30T20:00:29.640019] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-30T20:00:29.652220] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-30T20:00:29.726995] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T20:00:29.860456] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-30T20:00:30.080789] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:30.092775] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T20:00:30.654411] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-30T20:00:31.335616] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T20:00:31.454362] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-30T20:00:31.837993] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:00:32.254422] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-30T20:00:32.884382] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T20:00:33.054406] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-30T20:00:33.210622] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T20:00:33.854360] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-30T20:00:34.154983] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T20:00:34.654363] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-30T20:00:34.796772] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T20:00:35.454405] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-30T20:00:36.232838] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T20:00:36.254358] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-30T20:00:37.018079] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T20:00:37.054402] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-30T20:00:37.357000] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T20:00:37.854346] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-30T20:00:38.432306] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T20:00:38.654362] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-30T20:00:38.831832] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T20:00:39.454382] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-30T20:00:39.899474] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:00:40.254405] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-30T20:00:40.297944] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T20:00:41.054414] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-30T20:00:41.826753] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T20:00:41.836411] [INFO ] [REMOTE ] MSDL: Full fetch complete (54858 records). [2025-09-30T20:00:41.836668] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-30T20:00:41.859877] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-30T20:00:42.275792] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-30T20:00:42.276073] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-30T20:00:42.277028] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-30T20:00:42.277221] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-30T20:00:42.279127] [DEBUG] [LOCAL ] MSDL: Trimmed 54858 records to 38162 (keeping 200 days of data) [2025-09-30T20:00:42.395186] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T20:00:42.560458] [DEBUG] [LOCAL ] MSDL: Primary data saved (38162 records). [2025-09-30T20:00:42.560614] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-30T20:00:42.560781] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSDL took 33.0s. Estimated remaining: 2h 3m 20s. Rate: 7.8 symbols/min [2025-09-30T20:00:42.656787] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-30T20:00:42.813237] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:00:42.826338] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:42.827113] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-30T20:00:42.827181] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-30T20:00:42.827342] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-30T20:00:42.827397] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-30T20:00:42.827490] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-30T20:00:42.827534] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-30T20:00:43.254855] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:43.454409] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-30T20:00:44.207679] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T20:00:44.254358] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-30T20:00:44.377772] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:00:44.382800] [INFO ] [REMOTE ] MSGS: Full fetch complete (22929 records). [2025-09-30T20:00:44.382940] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-30T20:00:44.795005] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-30T20:00:44.795105] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-30T20:00:44.795673] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-30T20:00:44.795759] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-30T20:00:44.796469] [DEBUG] [LOCAL ] MSGS: Trimmed 22929 records to 17162 (keeping 200 days of data) [2025-09-30T20:00:44.904169] [DEBUG] [LOCAL ] MSGS: Primary data saved (17162 records). [2025-09-30T20:00:44.904325] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-30T20:00:44.904408] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGS took 27.1s. Estimated remaining: 2h 3m 9s. Rate: 7.8 symbols/min [2025-09-30T20:00:45.060905] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-30T20:00:45.091328] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:45.131607] [DEBUG] [LOCAL ] MSM: Loaded 35446 existing records from primary storage. [2025-09-30T20:00:45.131987] [INFO ] [MAIN ] MSM: Loaded 35446 existing records. [2025-09-30T20:00:45.319536] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:45.319844] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-30T20:00:45.319895] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-30T20:00:45.320422] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-30T20:00:45.320493] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-30T20:00:45.722325] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:45.854402] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-30T20:00:46.039888] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T20:00:46.056059] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:00:46.056507] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-30T20:00:46.056724] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:00:46.056790] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-30T20:00:46.056828] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:00:46.056866] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-30T20:00:46.056923] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-30T20:00:46.056958] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-30T20:00:46.056999] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-30T20:00:46.057046] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSIF took 3.5s. Estimated remaining: 2h 2m 57s. Rate: 7.8 symbols/min [2025-09-30T20:00:46.250444] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:46.269561] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T20:00:46.345208] [DEBUG] [LOCAL ] MT: Loaded 50612 existing records from primary storage. [2025-09-30T20:00:46.345592] [INFO ] [MAIN ] MT: Loaded 50612 existing records. [2025-09-30T20:00:46.543700] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:46.543968] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-30T20:00:46.544028] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-30T20:00:46.545222] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-30T20:00:46.545287] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-30T20:00:46.654343] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-30T20:00:46.932763] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:47.454366] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-30T20:00:47.834986] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T20:00:47.842170] [INFO ] [REMOTE ] MSGE: Full fetch complete (40102 records). [2025-09-30T20:00:47.842326] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-30T20:00:48.260417] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-30T20:00:48.271344] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-30T20:00:48.272276] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-30T20:00:48.273141] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-30T20:00:48.273207] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-30T20:00:48.274292] [DEBUG] [LOCAL ] MSGE: Trimmed 40102 records to 26818 (keeping 200 days of data) [2025-09-30T20:00:48.449065] [DEBUG] [LOCAL ] MSGE: Primary data saved (26818 records). [2025-09-30T20:00:48.449219] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-30T20:00:48.449326] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSGE took 34.0s. Estimated remaining: 2h 2m 46s. Rate: 7.8 symbols/min [2025-09-30T20:00:48.658886] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:48.697431] [DEBUG] [LOCAL ] MTAL: Loaded 36514 existing records from primary storage. [2025-09-30T20:00:48.697795] [INFO ] [MAIN ] MTAL: Loaded 36514 existing records. [2025-09-30T20:00:48.917772] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:00:48.918076] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-30T20:00:48.918154] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-30T20:00:48.919683] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-30T20:00:48.919753] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-30T20:00:49.055711] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-30T20:00:49.404823] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:00:49.439455] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T20:00:49.472423] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T20:00:49.854370] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-30T20:00:50.654377] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-30T20:00:50.748193] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T20:00:51.454420] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-30T20:00:51.626855] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T20:00:52.146504] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:00:52.254363] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-30T20:00:52.959549] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T20:00:53.054416] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-30T20:00:53.854335] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-30T20:00:54.015096] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T20:00:54.080423] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:00:54.654409] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-30T20:00:54.846153] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T20:00:55.454380] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-30T20:00:56.210111] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T20:00:56.254329] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-30T20:00:56.507051] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T20:00:57.054364] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-30T20:00:57.469150] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T20:00:57.854373] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-30T20:00:58.654331] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-30T20:00:58.839479] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:00:58.848404] [INFO ] [REMOTE ] MSI: Full fetch complete (58424 records). [2025-09-30T20:00:58.848701] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-30T20:00:59.262887] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-30T20:00:59.262967] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-30T20:00:59.263834] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-30T20:00:59.263901] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-30T20:00:59.265199] [DEBUG] [LOCAL ] MSI: Trimmed 58424 records to 40284 (keeping 200 days of data) [2025-09-30T20:00:59.410027] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:00:59.483116] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-30T20:00:59.564823] [DEBUG] [LOCAL ] MSI: Primary data saved (40284 records). [2025-09-30T20:00:59.564963] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-30T20:00:59.565084] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSI took 30.4s. Estimated remaining: 2h 2m 40s. Rate: 7.8 symbols/min [2025-09-30T20:00:59.759440] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:00:59.794098] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T20:00:59.858506] [DEBUG] [LOCAL ] MTB: Loaded 46781 existing records from primary storage. [2025-09-30T20:00:59.858962] [INFO ] [MAIN ] MTB: Loaded 46781 existing records. [2025-09-30T20:01:00.087938] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:00.088204] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-30T20:01:00.088254] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-30T20:01:00.089028] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-30T20:01:00.089091] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-30T20:01:00.257729] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-30T20:01:00.519485] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:00.737451] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T20:01:01.054379] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-30T20:01:01.854406] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-30T20:01:02.174170] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T20:01:02.550544] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T20:01:02.654370] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-30T20:01:03.284366] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:01:03.454413] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-30T20:01:04.254376] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-30T20:01:04.509977] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T20:01:04.885157] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T20:01:05.054332] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-30T20:01:05.285401] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T20:01:05.854368] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-30T20:01:06.235237] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:01:06.654407] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-30T20:01:07.285011] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T20:01:07.454396] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-30T20:01:07.997611] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T20:01:08.254372] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-30T20:01:08.764736] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:01:09.054414] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-30T20:01:09.854421] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-30T20:01:10.087015] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T20:01:10.654429] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-30T20:01:10.740593] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T20:01:11.379199] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T20:01:11.454411] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-30T20:01:12.254333] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-30T20:01:12.367158] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T20:01:12.617636] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T20:01:13.054372] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-30T20:01:13.849450] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:01:13.857455] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-30T20:01:13.859293] [INFO ] [REMOTE ] MTAL: Full fetch complete (47386 records). [2025-09-30T20:01:13.859388] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-30T20:01:14.353968] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-30T20:01:14.354205] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-30T20:01:14.355314] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-30T20:01:14.355402] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-30T20:01:14.357123] [DEBUG] [LOCAL ] MTAL: Trimmed 47386 records to 36463 (keeping 200 days of data) [2025-09-30T20:01:14.502763] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T20:01:14.641419] [DEBUG] [LOCAL ] MTAL: Primary data saved (36463 records). [2025-09-30T20:01:14.641590] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-30T20:01:14.641715] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 26.2s. Estimated remaining: 2h 2m 38s. Rate: 7.8 symbols/min [2025-09-30T20:01:14.659472] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-30T20:01:14.846764] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:14.865511] [DEBUG] [LOCAL ] MTD: Loaded 15072 existing records from primary storage. [2025-09-30T20:01:14.865797] [INFO ] [MAIN ] MTD: Loaded 15072 existing records. [2025-09-30T20:01:15.059725] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:15.060013] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-30T20:01:15.060072] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-30T20:01:15.060495] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-30T20:01:15.060555] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-30T20:01:15.456161] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-30T20:01:15.467717] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:15.498076] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:01:15.587864] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:01:16.254365] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-30T20:01:17.054376] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-30T20:01:17.267874] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T20:01:17.603421] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T20:01:17.614465] [INFO ] [REMOTE ] MT: Full fetch complete (73468 records). [2025-09-30T20:01:17.614625] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-30T20:01:17.861696] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-30T20:01:18.032235] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-30T20:01:18.032330] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-30T20:01:18.033458] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-30T20:01:18.033567] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-30T20:01:18.036806] [DEBUG] [LOCAL ] MT: Trimmed 73468 records to 50609 (keeping 200 days of data) [2025-09-30T20:01:18.375480] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T20:01:18.386411] [INFO ] [REMOTE ] MSM: Full fetch complete (52082 records). [2025-09-30T20:01:18.387171] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-30T20:01:18.621150] [DEBUG] [LOCAL ] MT: Primary data saved (50609 records). [2025-09-30T20:01:18.661573] [INFO ] [MAIN ] MT: Full history saved. [2025-09-30T20:01:18.661942] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MT took 32.6s. Estimated remaining: 2h 2m 27s. Rate: 7.8 symbols/min [2025-09-30T20:01:18.661339] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-30T20:01:19.052532] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-30T20:01:19.055828] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:19.056032] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-30T20:01:19.054047] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T20:01:19.057048] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-30T20:01:19.057322] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-30T20:01:19.062827] [DEBUG] [LOCAL ] MSM: Trimmed 52082 records to 35459 (keeping 200 days of data) [2025-09-30T20:01:19.212495] [DEBUG] [LOCAL ] MTDR: Loaded 51558 existing records from primary storage. [2025-09-30T20:01:19.213726] [INFO ] [MAIN ] MTDR: Loaded 51558 existing records. [2025-09-30T20:01:19.429967] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:19.431472] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-30T20:01:19.431840] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-30T20:01:19.433554] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-30T20:01:19.433631] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-30T20:01:19.459908] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-30T20:01:19.959420] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:19.968901] [DEBUG] [LOCAL ] MSM: Primary data saved (35459 records). [2025-09-30T20:01:19.969012] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-30T20:01:19.970951] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MSM took 35.1s. Estimated remaining: 2h 2m 15s. Rate: 7.8 symbols/min [2025-09-30T20:01:20.176391] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:20.241327] [DEBUG] [LOCAL ] MTG: Loaded 51299 existing records from primary storage. [2025-09-30T20:01:20.241695] [INFO ] [MAIN ] MTG: Loaded 51299 existing records. [2025-09-30T20:01:20.259940] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-30T20:01:20.466591] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:20.467108] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-30T20:01:20.467307] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-30T20:01:20.468257] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-30T20:01:20.468348] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-30T20:01:20.746526] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T20:01:20.820294] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T20:01:20.951230] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:21.054364] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-30T20:01:21.853401] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:01:21.862723] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-30T20:01:22.654361] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-30T20:01:22.727782] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T20:01:23.455526] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-30T20:01:23.455452] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:01:24.265439] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-30T20:01:24.271272] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T20:01:25.054383] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-30T20:01:25.192462] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T20:01:25.854430] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-30T20:01:25.939950] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T20:01:25.975886] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T20:01:26.654454] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-30T20:01:27.454385] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-30T20:01:27.570841] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T20:01:27.621192] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T20:01:28.254407] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-30T20:01:29.054399] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-30T20:01:29.342778] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T20:01:29.854389] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-30T20:01:29.991561] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T20:01:30.366700] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T20:01:30.654408] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-30T20:01:30.698324] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:01:31.454407] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-30T20:01:32.254475] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-30T20:01:32.383962] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T20:01:33.054346] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-30T20:01:33.181704] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:01:33.257396] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:01:33.854382] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-30T20:01:34.654321] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-30T20:01:34.769708] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T20:01:34.779754] [INFO ] [REMOTE ] MTB: Full fetch complete (68221 records). [2025-09-30T20:01:34.779922] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-30T20:01:35.020431] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T20:01:35.236516] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-30T20:01:35.236610] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-30T20:01:35.237708] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-30T20:01:35.237784] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-30T20:01:35.239391] [DEBUG] [LOCAL ] MTB: Trimmed 68221 records to 46728 (keeping 200 days of data) [2025-09-30T20:01:35.471034] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-30T20:01:35.559472] [DEBUG] [LOCAL ] MTB: Primary data saved (46728 records). [2025-09-30T20:01:35.559625] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-30T20:01:35.559757] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTB took 36.0s. Estimated remaining: 2h 2m 13s. Rate: 7.8 symbols/min [2025-09-30T20:01:35.761600] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:35.808879] [DEBUG] [LOCAL ] MTH: Loaded 43822 existing records from primary storage. [2025-09-30T20:01:35.809268] [INFO ] [MAIN ] MTH: Loaded 43822 existing records. [2025-09-30T20:01:36.005739] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:36.005948] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-30T20:01:36.005998] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-30T20:01:36.006741] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-30T20:01:36.006806] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-30T20:01:36.259745] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-30T20:01:36.416595] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:36.453538] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:01:36.947350] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T20:01:37.001115] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T20:01:37.054400] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-30T20:01:37.854384] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-30T20:01:38.654378] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-30T20:01:38.885080] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T20:01:38.898308] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T20:01:38.901932] [INFO ] [REMOTE ] MTD: Full fetch complete (20952 records). [2025-09-30T20:01:38.902053] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-30T20:01:39.322854] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-30T20:01:39.322938] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-30T20:01:39.323450] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-30T20:01:39.323514] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-30T20:01:39.324198] [DEBUG] [LOCAL ] MTD: Trimmed 20952 records to 15091 (keeping 200 days of data) [2025-09-30T20:01:39.423912] [DEBUG] [LOCAL ] MTD: Primary data saved (15091 records). [2025-09-30T20:01:39.424068] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-30T20:01:39.424196] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTD took 24.8s. Estimated remaining: 2h 2m 3s. Rate: 7.8 symbols/min [2025-09-30T20:01:39.462826] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-30T20:01:39.626033] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:39.673674] [DEBUG] [LOCAL ] MTN: Loaded 38902 existing records from primary storage. [2025-09-30T20:01:39.674002] [INFO ] [MAIN ] MTN: Loaded 38902 existing records. [2025-09-30T20:01:39.901748] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:39.902005] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-30T20:01:39.902091] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-30T20:01:39.902980] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-30T20:01:39.903048] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-30T20:01:40.049091] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T20:01:40.263348] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-30T20:01:40.354871] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:41.054391] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-30T20:01:41.274225] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T20:01:41.649541] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T20:01:41.854410] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-30T20:01:42.654385] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-30T20:01:42.779474] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T20:01:43.070360] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T20:01:43.454417] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-30T20:01:44.208801] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T20:01:44.254408] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-30T20:01:44.893110] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T20:01:45.054388] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-30T20:01:45.854379] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-30T20:01:45.920993] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T20:01:46.063471] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:01:46.654404] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-30T20:01:47.461068] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-30T20:01:47.483183] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T20:01:48.254336] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-30T20:01:48.405870] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:01:49.054388] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-30T20:01:49.221978] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T20:01:49.854333] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-30T20:01:50.082838] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T20:01:50.654375] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-30T20:01:50.804027] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:01:51.454399] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-30T20:01:51.562130] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:01:52.082576] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T20:01:52.254378] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-30T20:01:53.030353] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T20:01:53.042136] [INFO ] [REMOTE ] MTG: Full fetch complete (74016 records). [2025-09-30T20:01:53.042282] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-30T20:01:53.059569] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-30T20:01:53.505039] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-30T20:01:53.505161] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-30T20:01:53.506492] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-30T20:01:53.506794] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-30T20:01:53.509022] [DEBUG] [LOCAL ] MTG: Trimmed 74016 records to 51280 (keeping 200 days of data) [2025-09-30T20:01:53.854443] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-30T20:01:53.874821] [DEBUG] [LOCAL ] MTG: Primary data saved (51280 records). [2025-09-30T20:01:53.874988] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-30T20:01:53.878211] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 33.9s. Estimated remaining: 2h 1m 60s. Rate: 7.8 symbols/min [2025-09-30T20:01:54.087297] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:54.087673] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-30T20:01:54.087873] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-30T20:01:54.088058] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-30T20:01:54.088133] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-30T20:01:54.088229] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-30T20:01:54.088290] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-30T20:01:54.432610] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T20:01:54.540375] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:54.654324] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-30T20:01:55.070755] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T20:01:55.106123] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T20:01:55.340211] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T20:01:55.454371] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-30T20:01:56.254400] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-30T20:01:56.954877] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T20:01:56.966753] [INFO ] [REMOTE ] MTDR: Full fetch complete (73483 records). [2025-09-30T20:01:56.966922] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-30T20:01:57.059790] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-30T20:01:57.416151] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-30T20:01:57.416266] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-30T20:01:57.417501] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-30T20:01:57.417694] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-30T20:01:57.419814] [DEBUG] [LOCAL ] MTDR: Trimmed 73483 records to 51570 (keeping 200 days of data) [2025-09-30T20:01:57.513988] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T20:01:57.552507] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T20:01:57.794135] [DEBUG] [LOCAL ] MTDR: Primary data saved (51570 records). [2025-09-30T20:01:57.794284] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-30T20:01:57.794374] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTDR took 39.1s. Estimated remaining: 2h 1m 49s. Rate: 7.8 symbols/min [2025-09-30T20:01:57.859537] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-30T20:01:57.997974] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:01:58.021160] [DEBUG] [LOCAL ] MTRN: Loaded 18039 existing records from primary storage. [2025-09-30T20:01:58.021426] [INFO ] [MAIN ] MTRN: Loaded 18039 existing records. [2025-09-30T20:01:58.230889] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:01:58.231384] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-30T20:01:58.231455] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-30T20:01:58.232089] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-30T20:01:58.232151] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-30T20:01:58.624549] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:01:58.654437] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-30T20:01:58.998481] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T20:01:59.402505] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:01:59.454391] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-30T20:01:59.814548] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T20:02:00.254374] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-30T20:02:00.624935] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-30T20:02:01.054383] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-30T20:02:01.854385] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-30T20:02:02.146778] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-30T20:02:02.637442] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T20:02:02.654309] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-30T20:02:03.454412] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-30T20:02:04.221590] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T20:02:04.221369] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T20:02:04.254328] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-30T20:02:05.054376] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-30T20:02:05.863682] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-30T20:02:05.869094] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T20:02:05.887593] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T20:02:06.654412] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-30T20:02:07.246096] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T20:02:07.290125] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T20:02:07.454406] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-30T20:02:08.254418] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-30T20:02:09.054387] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-30T20:02:09.102778] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T20:02:09.114103] [INFO ] [REMOTE ] MTH: Full fetch complete (63083 records). [2025-09-30T20:02:09.114311] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-30T20:02:09.625540] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-30T20:02:09.625791] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-30T20:02:09.627614] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-30T20:02:09.628228] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-30T20:02:09.631742] [DEBUG] [LOCAL ] MTH: Trimmed 63083 records to 43700 (keeping 200 days of data) [2025-09-30T20:02:09.758628] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T20:02:09.869716] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-30T20:02:09.956040] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:02:09.990307] [DEBUG] [LOCAL ] MTH: Primary data saved (43700 records). [2025-09-30T20:02:09.990457] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-30T20:02:09.990603] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTH took 34.4s. Estimated remaining: 2h 1m 45s. Rate: 7.8 symbols/min [2025-09-30T20:02:10.197764] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:10.234226] [DEBUG] [LOCAL ] MTUS: Loaded 28394 existing records from primary storage. [2025-09-30T20:02:10.234576] [INFO ] [MAIN ] MTUS: Loaded 28394 existing records. [2025-09-30T20:02:10.438151] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:10.438403] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-30T20:02:10.438458] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-30T20:02:10.438834] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-30T20:02:10.438914] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-30T20:02:10.670419] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-30T20:02:10.872096] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:11.454398] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-30T20:02:11.710679] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T20:02:11.720920] [INFO ] [REMOTE ] MTN: Full fetch complete (56079 records). [2025-09-30T20:02:11.721046] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-30T20:02:11.878824] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:02:11.933349] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T20:02:12.184560] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-30T20:02:12.184690] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-30T20:02:12.185717] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-30T20:02:12.185786] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-30T20:02:12.187113] [DEBUG] [LOCAL ] MTN: Trimmed 56079 records to 39006 (keeping 200 days of data) [2025-09-30T20:02:12.256793] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-30T20:02:12.457315] [DEBUG] [LOCAL ] MTN: Primary data saved (39006 records). [2025-09-30T20:02:12.457469] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-30T20:02:12.457554] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTN took 33.0s. Estimated remaining: 2h 1m 34s. Rate: 7.8 symbols/min [2025-09-30T20:02:12.644369] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:12.666037] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-30T20:02:12.678519] [DEBUG] [LOCAL ] MTW: Loaded 26431 existing records from primary storage. [2025-09-30T20:02:12.678850] [INFO ] [MAIN ] MTW: Loaded 26431 existing records. [2025-09-30T20:02:12.899436] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:12.899744] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-30T20:02:12.899799] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-30T20:02:12.900142] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-30T20:02:12.900202] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-30T20:02:13.059487] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-30T20:02:13.291525] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:13.854358] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-30T20:02:14.316309] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-30T20:02:14.317360] [INFO ] [REMOTE ] MTR: Full fetch complete (2544 records). [2025-09-30T20:02:14.317435] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-30T20:02:14.548179] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:02:14.548469] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:02:14.548630] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:02:14.548840] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-30T20:02:14.548957] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-30T20:02:14.549154] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-30T20:02:14.549266] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-30T20:02:14.549489] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTR took 20.7s. Estimated remaining: 2h 1m 22s. Rate: 7.8 symbols/min [2025-09-30T20:02:14.612949] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T20:02:14.659459] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-30T20:02:14.796708] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:14.833108] [DEBUG] [LOCAL ] MTX: Loaded 22808 existing records from primary storage. [2025-09-30T20:02:14.833422] [INFO ] [MAIN ] MTX: Loaded 22808 existing records. [2025-09-30T20:02:15.059202] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:15.059421] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-30T20:02:15.059470] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-30T20:02:15.059892] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-30T20:02:15.059952] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-30T20:02:15.459595] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:15.459723] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-30T20:02:15.917270] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T20:02:16.254363] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-30T20:02:16.619166] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:02:17.054366] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-30T20:02:17.588052] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T20:02:17.854359] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-30T20:02:18.131863] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T20:02:18.654476] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-30T20:02:18.864691] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T20:02:19.337532] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T20:02:19.454474] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-30T20:02:20.254427] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-30T20:02:20.560084] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:02:21.054374] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-30T20:02:21.314759] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T20:02:21.854383] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-30T20:02:22.223309] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T20:02:22.654397] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-30T20:02:23.095142] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T20:02:23.454400] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-30T20:02:23.711073] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:02:24.254380] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-30T20:02:24.802250] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T20:02:25.054395] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-30T20:02:25.415692] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T20:02:25.854372] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-30T20:02:26.258547] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T20:02:26.654525] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-30T20:02:27.197914] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T20:02:27.454400] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-30T20:02:27.940129] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T20:02:28.102997] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T20:02:28.254384] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-30T20:02:29.054395] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-30T20:02:29.422437] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:02:29.854365] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-30T20:02:29.940339] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:02:29.944723] [INFO ] [REMOTE ] MTRN: Full fetch complete (23493 records). [2025-09-30T20:02:29.944835] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-30T20:02:30.350797] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-30T20:02:30.350884] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-30T20:02:30.351440] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-30T20:02:30.351535] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-30T20:02:30.352370] [DEBUG] [LOCAL ] MTRN: Trimmed 23493 records to 17990 (keeping 200 days of data) [2025-09-30T20:02:30.473427] [DEBUG] [LOCAL ] MTRN: Primary data saved (17990 records). [2025-09-30T20:02:30.473581] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-30T20:02:30.473688] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTRN took 32.7s. Estimated remaining: 2h 1m 20s. Rate: 7.8 symbols/min [2025-09-30T20:02:30.658742] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:30.656697] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-30T20:02:30.716627] [DEBUG] [LOCAL ] MTZ: Loaded 43082 existing records from primary storage. [2025-09-30T20:02:30.717103] [INFO ] [MAIN ] MTZ: Loaded 43082 existing records. [2025-09-30T20:02:30.919551] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:30.919964] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-30T20:02:30.920102] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-30T20:02:30.920891] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-30T20:02:30.920952] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-30T20:02:31.267880] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:02:31.353791] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:31.454357] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-30T20:02:32.152160] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T20:02:32.254397] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-30T20:02:32.772187] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T20:02:33.054392] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-30T20:02:33.815040] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T20:02:33.854373] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-30T20:02:34.110938] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T20:02:34.654341] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-30T20:02:34.834186] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T20:02:35.454375] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-30T20:02:35.885840] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T20:02:36.254368] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-30T20:02:36.595291] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T20:02:37.054422] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-30T20:02:37.854341] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-30T20:02:37.896571] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T20:02:38.387078] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T20:02:38.654368] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-30T20:02:38.796368] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T20:02:39.454416] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-30T20:02:40.140421] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T20:02:40.254340] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-30T20:02:40.634823] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T20:02:41.054380] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-30T20:02:41.737894] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T20:02:41.854341] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-30T20:02:42.349198] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T20:02:42.354086] [INFO ] [REMOTE ] MTX: Full fetch complete (31220 records). [2025-09-30T20:02:42.354237] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-30T20:02:42.659511] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-30T20:02:42.776368] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-30T20:02:42.776453] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-30T20:02:42.777401] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-30T20:02:42.777469] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-30T20:02:42.778500] [DEBUG] [LOCAL ] MTX: Trimmed 31220 records to 22798 (keeping 200 days of data) [2025-09-30T20:02:42.933787] [DEBUG] [LOCAL ] MTX: Primary data saved (22798 records). [2025-09-30T20:02:42.933927] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-30T20:02:42.934009] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTX took 28.4s. Estimated remaining: 2h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T20:02:43.153493] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:43.191065] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T20:02:43.200193] [DEBUG] [LOCAL ] MUA: Loaded 12245 existing records from primary storage. [2025-09-30T20:02:43.207069] [INFO ] [MAIN ] MUA: Loaded 12245 existing records. [2025-09-30T20:02:43.414729] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:43.415052] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-30T20:02:43.415111] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-30T20:02:43.415488] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-30T20:02:43.415572] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-30T20:02:43.460529] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-30T20:02:43.844166] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:44.210702] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:02:44.254406] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-30T20:02:45.054351] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-30T20:02:45.153627] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T20:02:45.594350] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T20:02:45.600273] [INFO ] [REMOTE ] MTW: Full fetch complete (38361 records). [2025-09-30T20:02:45.600444] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-30T20:02:45.857040] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-30T20:02:46.017756] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:02:46.110635] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-30T20:02:46.110766] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-30T20:02:46.111907] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-30T20:02:46.111980] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-30T20:02:46.113233] [DEBUG] [LOCAL ] MTW: Trimmed 38361 records to 26443 (keeping 200 days of data) [2025-09-30T20:02:46.281534] [DEBUG] [LOCAL ] MTW: Primary data saved (26443 records). [2025-09-30T20:02:46.281706] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-30T20:02:46.281806] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTW took 33.8s. Estimated remaining: 2h 1m 5s. Rate: 7.8 symbols/min [2025-09-30T20:02:46.482969] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:46.505392] [DEBUG] [LOCAL ] MUC: Loaded 20497 existing records from primary storage. [2025-09-30T20:02:46.505688] [INFO ] [MAIN ] MUC: Loaded 20497 existing records. [2025-09-30T20:02:46.655208] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-30T20:02:46.716213] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:46.716629] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-30T20:02:46.716783] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-30T20:02:46.717733] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-30T20:02:46.717797] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-30T20:02:47.019311] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T20:02:47.191243] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:47.454427] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-30T20:02:47.661422] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T20:02:48.254378] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-30T20:02:49.041455] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T20:02:49.054927] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-30T20:02:49.358274] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T20:02:49.854385] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-30T20:02:50.491305] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T20:02:50.654409] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-30T20:02:50.774315] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:02:51.454380] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-30T20:02:51.869129] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T20:02:51.875182] [INFO ] [REMOTE ] MTUS: Full fetch complete (42449 records). [2025-09-30T20:02:51.875337] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-30T20:02:52.258561] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-30T20:02:52.344496] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-30T20:02:52.344933] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-30T20:02:52.345965] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-30T20:02:52.346034] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-30T20:02:52.348110] [DEBUG] [LOCAL ] MTUS: Trimmed 42449 records to 28314 (keeping 200 days of data) [2025-09-30T20:02:52.528784] [DEBUG] [LOCAL ] MTUS: Primary data saved (28314 records). [2025-09-30T20:02:52.529013] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-30T20:02:52.529179] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTUS took 42.5s. Estimated remaining: 2h 0m 56s. Rate: 7.8 symbols/min [2025-09-30T20:02:52.660864] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:02:52.742069] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:02:52.756412] [DEBUG] [LOCAL ] MUE: Loaded 11961 existing records from primary storage. [2025-09-30T20:02:52.756639] [INFO ] [MAIN ] MUE: Loaded 11961 existing records. [2025-09-30T20:02:52.960813] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:02:52.961073] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-30T20:02:52.961125] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-30T20:02:52.961526] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-30T20:02:52.961588] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-30T20:02:53.061802] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-30T20:02:53.360617] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:02:53.399339] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T20:02:53.854387] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-30T20:02:54.654411] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-30T20:02:54.761965] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T20:02:54.945679] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T20:02:55.454397] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-30T20:02:55.572072] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:02:56.254423] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-30T20:02:56.965370] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T20:02:56.989079] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T20:02:57.054357] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-30T20:02:57.780521] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T20:02:57.854401] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-30T20:02:58.654340] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-30T20:02:58.802080] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T20:02:59.454354] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-30T20:02:59.587232] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:03:00.226440] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T20:03:00.254323] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-30T20:03:01.062334] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-30T20:03:01.065139] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T20:03:01.788992] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T20:03:01.854387] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-30T20:03:02.654348] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-30T20:03:02.784535] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:03:02.789105] [INFO ] [REMOTE ] MUA: Full fetch complete (18751 records). [2025-09-30T20:03:02.789257] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-30T20:03:03.221376] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-30T20:03:03.221459] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-30T20:03:03.221938] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-30T20:03:03.222004] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-30T20:03:03.222700] [DEBUG] [LOCAL ] MUA: Trimmed 18751 records to 12248 (keeping 200 days of data) [2025-09-30T20:03:03.302159] [DEBUG] [LOCAL ] MUA: Primary data saved (12248 records). [2025-09-30T20:03:03.302304] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-30T20:03:03.302408] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 20.4s. Estimated remaining: 2h 0m 51s. Rate: 7.8 symbols/min [2025-09-30T20:03:03.470089] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-30T20:03:03.512844] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:03.581059] [DEBUG] [LOCAL ] MUFG: Loaded 52580 existing records from primary storage. [2025-09-30T20:03:03.581410] [INFO ] [MAIN ] MUFG: Loaded 52580 existing records. [2025-09-30T20:03:03.789382] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:03.789682] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-30T20:03:03.789745] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-30T20:03:03.790349] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-30T20:03:03.790410] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-30T20:03:04.219748] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:04.254324] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-30T20:03:04.328120] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:03:04.425683] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T20:03:04.435961] [INFO ] [REMOTE ] MTZ: Full fetch complete (63324 records). [2025-09-30T20:03:04.436117] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-30T20:03:04.871634] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-30T20:03:04.871752] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-30T20:03:04.872716] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-30T20:03:04.872787] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-30T20:03:04.874338] [DEBUG] [LOCAL ] MTZ: Trimmed 63324 records to 43080 (keeping 200 days of data) [2025-09-30T20:03:05.062388] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-30T20:03:05.168997] [DEBUG] [LOCAL ] MTZ: Primary data saved (43080 records). [2025-09-30T20:03:05.169153] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-30T20:03:05.169257] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MTZ took 34.7s. Estimated remaining: 2h 0m 39s. Rate: 7.8 symbols/min [2025-09-30T20:03:05.378785] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:05.402539] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T20:03:05.413506] [DEBUG] [LOCAL ] MUJ: Loaded 13159 existing records from primary storage. [2025-09-30T20:03:05.413787] [INFO ] [MAIN ] MUJ: Loaded 13159 existing records. [2025-09-30T20:03:05.617880] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:05.618167] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-30T20:03:05.618283] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-30T20:03:05.618727] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-30T20:03:05.618791] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-30T20:03:05.864757] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-30T20:03:06.065341] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:06.654379] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-30T20:03:06.790618] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T20:03:07.010050] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T20:03:07.454359] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-30T20:03:07.685888] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T20:03:08.254392] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-30T20:03:09.054376] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-30T20:03:09.064317] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T20:03:09.146047] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T20:03:09.854377] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-30T20:03:10.038467] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T20:03:10.654380] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-30T20:03:11.445844] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:03:11.460925] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-30T20:03:11.493257] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:03:12.254585] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-30T20:03:12.440936] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:03:13.054359] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-30T20:03:13.342293] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T20:03:13.597881] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T20:03:13.854392] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-30T20:03:14.654357] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-30T20:03:15.454378] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-30T20:03:15.741527] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T20:03:15.814003] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T20:03:16.224976] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T20:03:16.254404] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-30T20:03:17.054404] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-30T20:03:17.854331] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-30T20:03:18.099661] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T20:03:18.170913] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T20:03:18.365723] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T20:03:18.654381] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-30T20:03:19.454405] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-30T20:03:19.916509] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T20:03:19.925845] [INFO ] [REMOTE ] MUC: Full fetch complete (30389 records). [2025-09-30T20:03:19.926058] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-30T20:03:20.259475] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-30T20:03:20.348473] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-30T20:03:20.348556] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-30T20:03:20.349181] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-30T20:03:20.349246] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-30T20:03:20.350034] [DEBUG] [LOCAL ] MUC: Trimmed 30389 records to 20622 (keeping 200 days of data) [2025-09-30T20:03:20.457112] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T20:03:20.504212] [DEBUG] [LOCAL ] MUC: Primary data saved (20622 records). [2025-09-30T20:03:20.504355] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-30T20:03:20.504438] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUC took 34.2s. Estimated remaining: 2h 0m 36s. Rate: 7.8 symbols/min [2025-09-30T20:03:20.690636] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:20.750847] [DEBUG] [LOCAL ] MUR: Loaded 52928 existing records from primary storage. [2025-09-30T20:03:20.751214] [INFO ] [MAIN ] MUR: Loaded 52928 existing records. [2025-09-30T20:03:20.952060] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:20.952280] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-30T20:03:20.952328] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-30T20:03:20.953258] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-30T20:03:20.953321] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-30T20:03:21.060207] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-30T20:03:21.192815] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T20:03:21.401558] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:21.854413] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-30T20:03:22.654393] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-30T20:03:23.034208] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T20:03:23.454408] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-30T20:03:23.552268] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T20:03:23.587103] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:03:24.062514] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T20:03:24.254361] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-30T20:03:25.054411] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-30T20:03:25.854374] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-30T20:03:26.155559] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T20:03:26.654363] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-30T20:03:26.782791] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T20:03:26.820024] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T20:03:27.454379] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-30T20:03:27.586023] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:03:28.254402] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-30T20:03:28.391127] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T20:03:29.054442] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-30T20:03:29.854380] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-30T20:03:29.967772] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T20:03:29.970743] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T20:03:29.983959] [INFO ] [REMOTE ] MUE: Full fetch complete (16152 records). [2025-09-30T20:03:29.984491] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-30T20:03:30.430839] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-30T20:03:30.430934] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-30T20:03:30.431352] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-30T20:03:30.431415] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-30T20:03:30.432300] [DEBUG] [LOCAL ] MUE: Trimmed 16152 records to 11929 (keeping 200 days of data) [2025-09-30T20:03:30.509183] [DEBUG] [LOCAL ] MUE: Primary data saved (11929 records). [2025-09-30T20:03:30.509336] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-30T20:03:30.509426] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUE took 38.0s. Estimated remaining: 2h 0m 30s. Rate: 7.8 symbols/min [2025-09-30T20:03:30.662027] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-30T20:03:30.701109] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:30.717928] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T20:03:30.722428] [INFO ] [REMOTE ] MUJ: Full fetch complete (20349 records). [2025-09-30T20:03:30.722538] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-30T20:03:30.920370] [DEBUG] [LOCAL ] MUSA: Loaded 24753 existing records from primary storage. [2025-09-30T20:03:30.978797] [INFO ] [MAIN ] MUSA: Loaded 24753 existing records. [2025-09-30T20:03:31.408241] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-30T20:03:31.415510] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:31.415595] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-30T20:03:31.416082] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-30T20:03:31.416153] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-30T20:03:31.416770] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-30T20:03:31.416885] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-30T20:03:31.417132] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-30T20:03:31.417562] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-30T20:03:31.456610] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-30T20:03:31.456524] [DEBUG] [LOCAL ] MUJ: Trimmed 20349 records to 13216 (keeping 200 days of data) [2025-09-30T20:03:31.942352] [DEBUG] [LOCAL ] MUJ: Primary data saved (13216 records). [2025-09-30T20:03:31.948999] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-30T20:03:31.948519] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:31.949472] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUJ took 26.8s. Estimated remaining: 2h 0m 18s. Rate: 7.8 symbols/min [2025-09-30T20:03:32.151636] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:32.151991] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-30T20:03:32.152055] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-30T20:03:32.152174] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-30T20:03:32.152218] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-30T20:03:32.152261] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-30T20:03:32.152294] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-30T20:03:32.262020] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-30T20:03:32.572412] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:32.604717] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T20:03:33.054357] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-30T20:03:33.293532] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-30T20:03:33.309518] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T20:03:33.445846] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T20:03:33.854356] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-30T20:03:34.077548] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:03:34.077933] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-30T20:03:34.078057] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:03:34.078137] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-30T20:03:34.078176] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:03:34.078216] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-30T20:03:34.078274] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-30T20:03:34.078309] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-30T20:03:34.078370] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-30T20:03:34.078443] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUSE took 2.1s. Estimated remaining: 2h 0m 7s. Rate: 7.8 symbols/min [2025-09-30T20:03:34.261227] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:34.307860] [DEBUG] [LOCAL ] MUX: Loaded 42714 existing records from primary storage. [2025-09-30T20:03:34.308418] [INFO ] [MAIN ] MUX: Loaded 42714 existing records. [2025-09-30T20:03:34.536290] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:34.536541] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-30T20:03:34.536608] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-30T20:03:34.537066] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-30T20:03:34.537128] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-30T20:03:34.659529] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-30T20:03:34.937930] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:35.454403] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-30T20:03:36.254328] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-30T20:03:36.440371] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:03:37.054509] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-30T20:03:37.226907] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T20:03:37.443983] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T20:03:37.854407] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-30T20:03:38.226700] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T20:03:38.654374] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-30T20:03:39.454387] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-30T20:03:39.720202] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T20:03:40.266995] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-30T20:03:40.273498] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T20:03:40.285946] [INFO ] [REMOTE ] MUFG: Full fetch complete (75509 records). [2025-09-30T20:03:40.286147] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-30T20:03:40.753579] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-30T20:03:40.753725] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-30T20:03:40.754788] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-30T20:03:40.754960] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-30T20:03:40.775755] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T20:03:40.787759] [DEBUG] [LOCAL ] MUFG: Trimmed 75509 records to 52571 (keeping 200 days of data) [2025-09-30T20:03:41.054502] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-30T20:03:41.139835] [DEBUG] [LOCAL ] MUFG: Primary data saved (52571 records). [2025-09-30T20:03:41.139989] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-30T20:03:41.141756] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUFG took 37.8s. Estimated remaining: 1h 59m 59s. Rate: 7.8 symbols/min [2025-09-30T20:03:41.326317] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:41.350338] [DEBUG] [LOCAL ] MVF: Loaded 12865 existing records from primary storage. [2025-09-30T20:03:41.350585] [INFO ] [MAIN ] MVF: Loaded 12865 existing records. [2025-09-30T20:03:41.538253] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:41.538533] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-30T20:03:41.538616] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-30T20:03:41.538918] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-30T20:03:41.538994] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-30T20:03:41.859451] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-30T20:03:41.956134] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:42.135883] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T20:03:42.527824] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T20:03:42.654402] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-30T20:03:42.965621] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T20:03:43.454383] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-30T20:03:43.832784] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:03:44.254408] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-30T20:03:44.992881] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T20:03:45.054402] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-30T20:03:45.221702] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T20:03:45.854403] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-30T20:03:46.417371] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T20:03:46.654403] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-30T20:03:46.841388] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T20:03:47.454393] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-30T20:03:47.502730] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T20:03:48.240309] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T20:03:48.254315] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-30T20:03:48.898768] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:03:49.054385] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-30T20:03:49.854396] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-30T20:03:50.654388] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-30T20:03:50.870802] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T20:03:50.938831] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T20:03:50.950555] [INFO ] [REMOTE ] MUR: Full fetch complete (76463 records). [2025-09-30T20:03:50.950736] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-30T20:03:51.380746] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-30T20:03:51.380837] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-30T20:03:51.382213] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-30T20:03:51.382314] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-30T20:03:51.384520] [DEBUG] [LOCAL ] MUR: Trimmed 76463 records to 52925 (keeping 200 days of data) [2025-09-30T20:03:51.479503] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-30T20:03:51.738180] [DEBUG] [LOCAL ] MUR: Primary data saved (52925 records). [2025-09-30T20:03:51.738396] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-30T20:03:51.738501] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUR took 31.2s. Estimated remaining: 1h 59m 53s. Rate: 7.8 symbols/min [2025-09-30T20:03:51.928120] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:51.953254] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:03:51.964409] [DEBUG] [LOCAL ] MVO: Loaded 9024 existing records from primary storage. [2025-09-30T20:03:51.964912] [INFO ] [MAIN ] MVO: Loaded 9024 existing records. [2025-09-30T20:03:52.156521] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:52.156811] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-30T20:03:52.156873] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-30T20:03:52.157086] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-30T20:03:52.157145] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-30T20:03:52.259481] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-30T20:03:52.554240] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:53.054345] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-30T20:03:53.097863] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T20:03:53.503302] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T20:03:53.854388] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-30T20:03:53.961324] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:03:54.654372] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-30T20:03:55.179292] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T20:03:55.416692] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:03:55.454377] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-30T20:03:56.254388] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-30T20:03:56.358464] [DEBUG] [REMOTE ] MUX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T20:03:56.358825] [WARN ] [REMOTE ] MUX: No data returned for month 2025-04 [2025-09-30T20:03:56.358920] [FATAL] [REMOTE ] MUX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:03:56.359493] [FATAL] [MAIN ] MUX: Failed to fetch primary data. [2025-09-30T20:03:56.359794] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:03:56.359897] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-30T20:03:56.360027] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-09-30T20:03:56.360097] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-09-30T20:03:56.360418] [DEBUG] [LOCAL ] MUX: Deleted derivative data file. [2025-09-30T20:03:56.360532] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 22.3s. Estimated remaining: 1h 59m 44s. Rate: 7.8 symbols/min [2025-09-30T20:03:56.602757] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:03:56.611637] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:03:56.627250] [DEBUG] [LOCAL ] MVT: Loaded 10243 existing records from primary storage. [2025-09-30T20:03:56.627528] [INFO ] [MAIN ] MVT: Loaded 10243 existing records. [2025-09-30T20:03:56.841710] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:03:56.842461] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-30T20:03:56.842540] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-30T20:03:56.842943] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-30T20:03:56.843041] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-30T20:03:57.059571] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-30T20:03:57.258881] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:03:57.854348] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-30T20:03:57.988695] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:03:58.654339] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-30T20:03:59.052192] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T20:03:59.192478] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T20:03:59.454357] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-30T20:04:00.254376] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-30T20:04:00.800834] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T20:04:00.806244] [INFO ] [REMOTE ] MUSA: Full fetch complete (35186 records). [2025-09-30T20:04:00.806369] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-30T20:04:01.056358] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-30T20:04:01.240696] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-30T20:04:01.245492] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-30T20:04:01.249933] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-30T20:04:01.250614] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-30T20:04:01.250960] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T20:04:01.255519] [DEBUG] [LOCAL ] MUSA: Trimmed 35186 records to 24760 (keeping 200 days of data) [2025-09-30T20:04:01.432745] [DEBUG] [LOCAL ] MUSA: Primary data saved (24760 records). [2025-09-30T20:04:01.432898] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-30T20:04:01.433008] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MUSA took 30.9s. Estimated remaining: 1h 59m 34s. Rate: 7.8 symbols/min [2025-09-30T20:04:01.854427] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-30T20:04:01.959960] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T20:04:02.654392] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-30T20:04:02.773631] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:04:03.299816] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T20:04:03.454503] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-30T20:04:04.254376] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-30T20:04:04.355380] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:04:04.792907] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-30T20:04:05.054354] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-30T20:04:05.759547] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T20:04:05.854365] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-30T20:04:06.654360] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-30T20:04:06.674932] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:04:07.394793] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:04:07.454392] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-30T20:04:08.254403] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-30T20:04:08.265061] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T20:04:08.924134] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T20:04:09.054445] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-30T20:04:09.764048] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T20:04:09.854370] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-30T20:04:10.654438] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-30T20:04:10.689243] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:04:10.691794] [INFO ] [REMOTE ] MVO: Full fetch complete (14408 records). [2025-09-30T20:04:10.691920] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-30T20:04:11.114348] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-30T20:04:11.114507] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-30T20:04:11.115120] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-30T20:04:11.115247] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-30T20:04:11.115959] [DEBUG] [LOCAL ] MVO: Trimmed 14408 records to 8990 (keeping 200 days of data) [2025-09-30T20:04:11.178521] [DEBUG] [LOCAL ] MVO: Primary data saved (8990 records). [2025-09-30T20:04:11.178699] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-30T20:04:11.178837] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVO took 19.4s. Estimated remaining: 1h 59m 28s. Rate: 7.8 symbols/min [2025-09-30T20:04:11.454471] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-30T20:04:11.525257] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T20:04:11.959327] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T20:04:12.254397] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-30T20:04:13.054375] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-30T20:04:13.280150] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T20:04:13.283968] [INFO ] [REMOTE ] MVF: Full fetch complete (19097 records). [2025-09-30T20:04:13.284063] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-30T20:04:13.698785] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-30T20:04:13.698927] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-30T20:04:13.699431] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-30T20:04:13.699497] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-30T20:04:13.701032] [DEBUG] [LOCAL ] MVF: Trimmed 19097 records to 12938 (keeping 200 days of data) [2025-09-30T20:04:13.780296] [DEBUG] [LOCAL ] MVF: Primary data saved (12938 records). [2025-09-30T20:04:13.780452] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-30T20:04:13.780681] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVF took 32.6s. Estimated remaining: 1h 59m 17s. Rate: 7.8 symbols/min [2025-09-30T20:04:13.805861] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T20:04:13.854380] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-30T20:04:14.582057] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T20:04:14.654381] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-30T20:04:15.418614] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T20:04:15.454363] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-30T20:04:16.362131] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T20:04:16.365042] [INFO ] [REMOTE ] MVT: Full fetch complete (14577 records). [2025-09-30T20:04:16.365135] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-30T20:04:16.788332] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-30T20:04:16.788467] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-30T20:04:16.788948] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-30T20:04:16.789017] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-30T20:04:16.789858] [DEBUG] [LOCAL ] MVT: Trimmed 14577 records to 10215 (keeping 200 days of data) [2025-09-30T20:04:16.856823] [DEBUG] [LOCAL ] MVT: Primary data saved (10215 records). [2025-09-30T20:04:16.856971] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-30T20:04:16.857096] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MVT took 20.5s. Estimated remaining: 1h 59m 6s. Rate: 7.8 symbols/min [2025-09-30T20:04:17.556952] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:17.590737] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:17.627470] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-30T20:04:17.655975] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-30T20:04:17.656333] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-30T20:04:17.656422] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-30T20:04:17.656539] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-30T20:04:17.656622] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-30T20:04:17.655868] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:17.663053] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:17.790705] [DEBUG] [LOCAL ] MXF: Loaded 5828 existing records from primary storage. [2025-09-30T20:04:17.791216] [INFO ] [MAIN ] MXF: Loaded 5828 existing records. [2025-09-30T20:04:18.078133] [DEBUG] [LOCAL ] MWA: Loaded 46764 existing records from primary storage. [2025-09-30T20:04:18.061240] [DEBUG] [LOCAL ] MX: Loaded 22922 existing records from primary storage. [2025-09-30T20:04:18.121005] [INFO ] [MAIN ] MWA: Loaded 46764 existing records. [2025-09-30T20:04:18.121320] [INFO ] [MAIN ] MX: Loaded 22922 existing records. [2025-09-30T20:04:18.410276] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:18.543268] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-30T20:04:18.578803] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-30T20:04:18.645668] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-30T20:04:18.671428] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:18.661604] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:18.667873] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-30T20:04:18.714766] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-30T20:04:18.721231] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-30T20:04:18.742195] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-30T20:04:18.839982] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-30T20:04:18.824093] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:18.866836] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-30T20:04:18.867082] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-30T20:04:18.867397] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-30T20:04:18.903867] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-30T20:04:18.937633] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-30T20:04:19.457864] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T20:04:19.505206] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-30T20:04:19.794019] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:19.830962] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-30T20:04:20.033024] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:20.043615] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-30T20:04:20.101019] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:20.101372] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-30T20:04:20.268763] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T20:04:20.270150] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-30T20:04:20.720032] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-30T20:04:20.783969] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:04:21.054409] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-30T20:04:21.079329] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T20:04:21.497834] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T20:04:21.797725] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T20:04:21.854414] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-30T20:04:22.654404] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-30T20:04:22.773947] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T20:04:23.299753] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:04:23.454386] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-30T20:04:24.254409] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-30T20:04:24.537149] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T20:04:24.911525] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T20:04:25.054379] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-30T20:04:25.511563] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-30T20:04:25.854358] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-30T20:04:26.654385] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-30T20:04:27.408526] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:04:27.454362] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-30T20:04:27.835706] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:04:28.254376] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-30T20:04:28.906130] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T20:04:29.056224] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-30T20:04:29.058418] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T20:04:29.854391] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-30T20:04:30.654336] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-30T20:04:30.890864] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T20:04:30.951473] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-30T20:04:30.952551] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T20:04:31.454365] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-30T20:04:31.815300] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-30T20:04:32.254379] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-30T20:04:33.014355] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:04:33.054393] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-30T20:04:33.854425] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-30T20:04:34.654346] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-30T20:04:34.761716] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:04:35.046289] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T20:04:35.454376] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-30T20:04:35.768115] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-30T20:04:36.254364] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-30T20:04:37.054514] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-30T20:04:37.854463] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-30T20:04:37.982367] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T20:04:38.368300] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (4.51 seconds). [2025-09-30T20:04:38.414864] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T20:04:38.441430] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T20:04:38.442913] [INFO ] [REMOTE ] MXE: Full fetch complete (2664 records). [2025-09-30T20:04:38.443324] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-30T20:04:38.636376] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T20:04:38.636737] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:04:38.636809] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:04:38.636890] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-30T20:04:38.636972] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-30T20:04:38.637012] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-30T20:04:38.637052] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-30T20:04:38.637130] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 21.8s. Estimated remaining: 1h 59m 8s. Rate: 7.8 symbols/min [2025-09-30T20:04:38.659517] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-30T20:04:38.819313] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:38.837177] [DEBUG] [LOCAL ] MYD: Loaded 13769 existing records from primary storage. [2025-09-30T20:04:38.837405] [INFO ] [MAIN ] MYD: Loaded 13769 existing records. [2025-09-30T20:04:39.020752] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:39.020974] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-30T20:04:39.021020] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-30T20:04:39.021277] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-30T20:04:39.021335] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-30T20:04:39.403632] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:39.454359] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-30T20:04:39.925712] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T20:04:40.254385] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-30T20:04:40.532743] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T20:04:41.054382] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-30T20:04:41.107928] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T20:04:41.854337] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-30T20:04:42.184632] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:04:42.287465] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T20:04:42.654407] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-30T20:04:43.454399] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-30T20:04:44.254609] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-30T20:04:44.254488] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T20:04:44.847577] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T20:04:44.878518] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T20:04:45.054419] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-30T20:04:45.854338] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-30T20:04:46.342179] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T20:04:46.654335] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-30T20:04:46.837682] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:04:47.457395] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-30T20:04:47.458481] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T20:04:48.254343] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-30T20:04:48.610591] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T20:04:48.615994] [INFO ] [REMOTE ] MX: Full fetch complete (31883 records). [2025-09-30T20:04:48.616131] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-30T20:04:49.038803] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-30T20:04:49.038924] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-30T20:04:49.039696] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-30T20:04:49.039786] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-30T20:04:49.040863] [DEBUG] [LOCAL ] MX: Trimmed 31883 records to 22873 (keeping 200 days of data) [2025-09-30T20:04:49.094446] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-30T20:04:49.191272] [DEBUG] [LOCAL ] MX: Primary data saved (22873 records). [2025-09-30T20:04:49.191429] [INFO ] [MAIN ] MX: Full history saved. [2025-09-30T20:04:49.191555] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MX took 32.3s. Estimated remaining: 1h 59m 2s. Rate: 7.8 symbols/min [2025-09-30T20:04:49.314346] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:04:49.393850] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:49.426682] [DEBUG] [LOCAL ] MYE: Loaded 24717 existing records from primary storage. [2025-09-30T20:04:49.426972] [INFO ] [MAIN ] MYE: Loaded 24717 existing records. [2025-09-30T20:04:49.617922] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:49.618210] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-30T20:04:49.618266] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-30T20:04:49.618725] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-30T20:04:49.618802] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-30T20:04:49.859573] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-30T20:04:50.005812] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:50.470024] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-30T20:04:50.471342] [INFO ] [REMOTE ] MXF: Full fetch complete (10276 records). [2025-09-30T20:04:50.471418] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-30T20:04:50.664206] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-30T20:04:50.873787] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-30T20:04:50.874007] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-30T20:04:50.874318] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-30T20:04:50.874394] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-30T20:04:50.875129] [DEBUG] [LOCAL ] MXF: Trimmed 10276 records to 5795 (keeping 200 days of data) [2025-09-30T20:04:50.927810] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T20:04:50.946169] [INFO ] [REMOTE ] MWA: Full fetch complete (67746 records). [2025-09-30T20:04:50.947528] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-30T20:04:50.955744] [DEBUG] [LOCAL ] MXF: Primary data saved (5795 records). [2025-09-30T20:04:50.998887] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-30T20:04:51.012456] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MXF took 34.2s. Estimated remaining: 1h 58m 50s. Rate: 7.8 symbols/min [2025-09-30T20:04:51.367524] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:51.461032] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-30T20:04:51.602638] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-30T20:04:51.603878] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-30T20:04:51.604313] [DEBUG] [LOCAL ] MYI: Loaded 19380 existing records from primary storage. [2025-09-30T20:04:51.605575] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-30T20:04:51.605962] [INFO ] [MAIN ] MYI: Loaded 19380 existing records. [2025-09-30T20:04:51.605708] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-30T20:04:51.727242] [DEBUG] [LOCAL ] MWA: Trimmed 67746 records to 46658 (keeping 200 days of data) [2025-09-30T20:04:51.932380] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:51.933804] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-30T20:04:51.935962] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-30T20:04:51.940839] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-30T20:04:51.941845] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-30T20:04:52.253120] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:04:52.292872] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-30T20:04:52.411139] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:52.423600] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T20:04:52.612146] [DEBUG] [LOCAL ] MWA: Primary data saved (46658 records). [2025-09-30T20:04:52.612362] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-30T20:04:52.612550] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MWA took 35.8s. Estimated remaining: 1h 58m 39s. Rate: 7.8 symbols/min [2025-09-30T20:04:52.798040] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:04:52.810969] [DEBUG] [LOCAL ] MYN: Loaded 10052 existing records from primary storage. [2025-09-30T20:04:52.811194] [INFO ] [MAIN ] MYN: Loaded 10052 existing records. [2025-09-30T20:04:52.998174] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:04:52.998436] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-30T20:04:52.998490] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-30T20:04:52.998779] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-30T20:04:52.998838] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-30T20:04:53.065624] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-30T20:04:53.389740] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:04:53.462822] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T20:04:53.818285] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T20:04:53.854370] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-30T20:04:54.654382] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-30T20:04:54.737223] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:04:55.453773] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T20:04:55.457502] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-30T20:04:56.254334] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-30T20:04:56.635087] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T20:04:57.054319] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-30T20:04:57.125831] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:04:57.854352] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-30T20:04:58.063427] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T20:04:58.654378] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-30T20:04:59.158829] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T20:04:59.454370] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-30T20:04:59.677285] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T20:05:00.254329] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-30T20:05:00.361811] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T20:05:01.054353] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-30T20:05:01.618245] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T20:05:01.637362] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T20:05:01.854369] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-30T20:05:02.654360] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-30T20:05:02.770911] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T20:05:03.454363] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-30T20:05:03.850496] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T20:05:04.254370] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-30T20:05:04.434586] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T20:05:05.054378] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-30T20:05:05.390012] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T20:05:05.636190] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T20:05:05.854378] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-30T20:05:06.659554] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-30T20:05:06.663253] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T20:05:06.669440] [INFO ] [REMOTE ] MYD: Full fetch complete (20791 records). [2025-09-30T20:05:06.669582] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-30T20:05:07.087159] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-30T20:05:07.087248] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-30T20:05:07.087757] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-30T20:05:07.087823] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-30T20:05:07.088685] [DEBUG] [LOCAL ] MYD: Trimmed 20791 records to 13710 (keeping 200 days of data) [2025-09-30T20:05:07.185680] [DEBUG] [LOCAL ] MYD: Primary data saved (13710 records). [2025-09-30T20:05:07.185833] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-30T20:05:07.185920] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYD took 28.5s. Estimated remaining: 1h 58m 36s. Rate: 7.8 symbols/min [2025-09-30T20:05:07.385766] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:07.450493] [DEBUG] [LOCAL ] NABL: Loaded 39507 existing records from primary storage. [2025-09-30T20:05:07.450872] [INFO ] [MAIN ] NABL: Loaded 39507 existing records. [2025-09-30T20:05:07.462504] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-30T20:05:07.670669] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:07.671214] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-30T20:05:07.671316] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-30T20:05:07.671636] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-30T20:05:07.671748] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-30T20:05:07.833225] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T20:05:08.093154] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:08.254392] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-30T20:05:08.635357] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T20:05:09.054430] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-30T20:05:09.428072] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T20:05:09.854328] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-30T20:05:10.248052] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:05:10.654325] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-30T20:05:10.947451] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T20:05:11.454395] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-30T20:05:12.068570] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T20:05:12.074220] [INFO ] [REMOTE ] MYE: Full fetch complete (36648 records). [2025-09-30T20:05:12.074354] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-30T20:05:12.269876] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-30T20:05:12.500197] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-30T20:05:12.500283] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-30T20:05:12.501140] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-30T20:05:12.501208] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-30T20:05:12.502144] [DEBUG] [LOCAL ] MYE: Trimmed 36648 records to 24623 (keeping 200 days of data) [2025-09-30T20:05:12.666072] [DEBUG] [LOCAL ] MYE: Primary data saved (24623 records). [2025-09-30T20:05:12.666205] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-30T20:05:12.666299] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 23.5s. Estimated remaining: 1h 58m 26s. Rate: 7.8 symbols/min [2025-09-30T20:05:12.854972] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:12.863248] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T20:05:12.887020] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:05:12.916117] [DEBUG] [LOCAL ] NAC: Loaded 24774 existing records from primary storage. [2025-09-30T20:05:12.916438] [INFO ] [MAIN ] NAC: Loaded 24774 existing records. [2025-09-30T20:05:13.059562] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-30T20:05:13.139727] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:13.139942] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-30T20:05:13.139996] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-30T20:05:13.140277] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-30T20:05:13.140340] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-30T20:05:13.527170] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:13.854430] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-30T20:05:14.067717] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:05:14.654449] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-30T20:05:15.188784] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T20:05:15.454405] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-30T20:05:16.020419] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T20:05:16.254403] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-30T20:05:16.290494] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T20:05:17.054399] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-30T20:05:17.167448] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:05:17.631430] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T20:05:17.854388] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-30T20:05:18.654400] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-30T20:05:19.155769] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T20:05:19.399242] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T20:05:19.454405] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-30T20:05:20.254379] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-30T20:05:20.473533] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T20:05:21.054419] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-30T20:05:21.395310] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T20:05:21.854406] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-30T20:05:22.271847] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T20:05:22.654373] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-30T20:05:22.875862] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T20:05:23.454332] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-30T20:05:23.524973] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:05:23.528589] [INFO ] [REMOTE ] MYN: Full fetch complete (15466 records). [2025-09-30T20:05:23.528721] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-30T20:05:24.095226] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-30T20:05:24.095306] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-30T20:05:24.095691] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-30T20:05:24.095755] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-30T20:05:24.096263] [DEBUG] [LOCAL ] MYN: Trimmed 15466 records to 10002 (keeping 200 days of data) [2025-09-30T20:05:24.161622] [DEBUG] [LOCAL ] MYN: Primary data saved (10002 records). [2025-09-30T20:05:24.161803] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-30T20:05:24.161901] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYN took 31.5s. Estimated remaining: 1h 58m 21s. Rate: 7.8 symbols/min [2025-09-30T20:05:24.260179] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-30T20:05:24.355328] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:24.394578] [DEBUG] [LOCAL ] NAD: Loaded 33881 existing records from primary storage. [2025-09-30T20:05:24.394890] [INFO ] [MAIN ] NAD: Loaded 33881 existing records. [2025-09-30T20:05:24.586436] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:24.602560] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-30T20:05:24.603313] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-30T20:05:24.604188] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T20:05:24.610298] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-30T20:05:24.610680] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-30T20:05:24.987121] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:25.054382] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-30T20:05:25.764332] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T20:05:25.854353] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-30T20:05:25.978300] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:05:26.654361] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-30T20:05:26.810239] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T20:05:27.454394] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-30T20:05:28.226785] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T20:05:28.254368] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-30T20:05:28.626703] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T20:05:29.054413] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-30T20:05:29.623618] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T20:05:29.854404] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-30T20:05:30.492879] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T20:05:30.654343] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-30T20:05:31.444598] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T20:05:31.454305] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-30T20:05:31.901062] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:05:32.254400] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-30T20:05:33.054341] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-30T20:05:33.250323] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T20:05:33.854401] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-30T20:05:34.013353] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-30T20:05:34.065370] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T20:05:34.654405] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-30T20:05:35.190023] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T20:05:35.395937] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T20:05:35.400936] [INFO ] [REMOTE ] MYI: Full fetch complete (29390 records). [2025-09-30T20:05:35.401025] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-30T20:05:35.459488] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-30T20:05:35.841469] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-30T20:05:35.841559] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-30T20:05:35.842247] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-30T20:05:35.842310] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-30T20:05:35.844088] [DEBUG] [LOCAL ] MYI: Trimmed 29390 records to 19335 (keeping 200 days of data) [2025-09-30T20:05:35.988030] [DEBUG] [LOCAL ] MYI: Primary data saved (19335 records). [2025-09-30T20:05:35.988184] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-30T20:05:35.988270] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. MYI took 45.0s. Estimated remaining: 1h 58m 16s. Rate: 7.8 symbols/min [2025-09-30T20:05:36.177112] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:36.190508] [DEBUG] [LOCAL ] NAN: Loaded 8966 existing records from primary storage. [2025-09-30T20:05:36.190810] [INFO ] [MAIN ] NAN: Loaded 8966 existing records. [2025-09-30T20:05:36.264104] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-30T20:05:36.413862] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:36.414079] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-30T20:05:36.414128] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-30T20:05:36.414335] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-30T20:05:36.414394] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-30T20:05:36.828274] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:36.852956] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T20:05:36.861754] [INFO ] [REMOTE ] NABL: Full fetch complete (56672 records). [2025-09-30T20:05:36.861908] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-30T20:05:37.069688] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-30T20:05:37.317051] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-30T20:05:37.317184] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-30T20:05:37.318285] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-30T20:05:37.318361] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-30T20:05:37.319935] [DEBUG] [LOCAL ] NABL: Trimmed 56672 records to 39395 (keeping 200 days of data) [2025-09-30T20:05:37.575122] [DEBUG] [LOCAL ] NABL: Primary data saved (39395 records). [2025-09-30T20:05:37.575280] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-30T20:05:37.576263] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NABL took 30.4s. Estimated remaining: 1h 58m 5s. Rate: 7.8 symbols/min [2025-09-30T20:05:37.769360] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:37.811307] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T20:05:37.856455] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-30T20:05:37.859067] [DEBUG] [LOCAL ] NAT: Loaded 49122 existing records from primary storage. [2025-09-30T20:05:37.859565] [INFO ] [MAIN ] NAT: Loaded 49122 existing records. [2025-09-30T20:05:38.062359] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:38.062633] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-30T20:05:38.062726] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-30T20:05:38.063205] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-30T20:05:38.063264] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-30T20:05:38.454593] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:38.654364] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-30T20:05:38.936378] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T20:05:39.050071] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T20:05:39.454378] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-30T20:05:40.254334] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-30T20:05:40.475728] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T20:05:40.556104] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T20:05:40.852563] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T20:05:41.054367] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-30T20:05:41.854381] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-30T20:05:41.948567] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T20:05:42.654401] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-30T20:05:43.454363] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-30T20:05:43.598745] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T20:05:44.027393] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:05:44.138938] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T20:05:44.254368] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-30T20:05:45.054382] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-30T20:05:45.854339] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-30T20:05:45.894385] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:05:45.955733] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T20:05:46.423939] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T20:05:46.654394] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-30T20:05:47.454375] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-30T20:05:47.793828] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T20:05:47.800416] [INFO ] [REMOTE ] NAC: Full fetch complete (36462 records). [2025-09-30T20:05:47.800542] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-30T20:05:48.210185] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-30T20:05:48.210290] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-30T20:05:48.211068] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-30T20:05:48.211167] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-30T20:05:48.212476] [DEBUG] [LOCAL ] NAC: Trimmed 36462 records to 24873 (keeping 200 days of data) [2025-09-30T20:05:48.271230] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-30T20:05:48.386888] [DEBUG] [LOCAL ] NAC: Primary data saved (24873 records). [2025-09-30T20:05:48.387063] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-30T20:05:48.387184] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAC took 35.7s. Estimated remaining: 1h 57m 59s. Rate: 7.8 symbols/min [2025-09-30T20:05:48.639920] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:48.675797] [DEBUG] [LOCAL ] NATL: Loaded 32751 existing records from primary storage. [2025-09-30T20:05:48.676132] [INFO ] [MAIN ] NATL: Loaded 32751 existing records. [2025-09-30T20:05:48.880504] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:48.880790] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-30T20:05:48.880852] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-30T20:05:48.881198] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-30T20:05:48.881287] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-30T20:05:49.056509] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-30T20:05:49.308497] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:49.342813] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T20:05:49.653843] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T20:05:49.854350] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-30T20:05:49.990224] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T20:05:50.654384] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-30T20:05:50.910315] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T20:05:51.454359] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-30T20:05:52.254341] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-30T20:05:52.367235] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:05:52.416705] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:05:52.664421] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T20:05:53.054350] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-30T20:05:53.854367] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-30T20:05:53.872241] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T20:05:54.654342] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-30T20:05:54.734025] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T20:05:55.454356] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-30T20:05:56.083235] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T20:05:56.254354] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-30T20:05:56.536521] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T20:05:57.054361] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-30T20:05:57.739788] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T20:05:57.748054] [INFO ] [REMOTE ] NAD: Full fetch complete (49968 records). [2025-09-30T20:05:57.748241] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-30T20:05:57.864780] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-30T20:05:57.880351] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T20:05:58.213423] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-30T20:05:58.213524] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-30T20:05:58.214352] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-30T20:05:58.214417] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-30T20:05:58.215607] [DEBUG] [LOCAL ] NAD: Trimmed 49968 records to 33896 (keeping 200 days of data) [2025-09-30T20:05:58.442344] [DEBUG] [LOCAL ] NAD: Primary data saved (33896 records). [2025-09-30T20:05:58.442509] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-30T20:05:58.442626] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAD took 34.3s. Estimated remaining: 1h 57m 53s. Rate: 7.8 symbols/min [2025-09-30T20:05:58.641993] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:05:58.648772] [DEBUG] [LOCAL ] NAZ: Loaded 2642 existing records from primary storage. [2025-09-30T20:05:58.649018] [INFO ] [MAIN ] NAZ: Loaded 2642 existing records. [2025-09-30T20:05:58.661331] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-30T20:05:58.861284] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:05:58.861497] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-30T20:05:58.861546] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-30T20:05:58.861790] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-30T20:05:58.861873] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-30T20:05:59.294332] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:05:59.317197] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T20:05:59.454354] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-30T20:06:00.121217] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T20:06:00.180431] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T20:06:00.182969] [INFO ] [REMOTE ] NAN: Full fetch complete (13935 records). [2025-09-30T20:06:00.183046] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-30T20:06:00.259563] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-30T20:06:00.568119] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-30T20:06:00.568250] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-30T20:06:00.568694] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-30T20:06:00.568773] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-30T20:06:00.569402] [DEBUG] [LOCAL ] NAN: Trimmed 13935 records to 8948 (keeping 200 days of data) [2025-09-30T20:06:00.632297] [DEBUG] [LOCAL ] NAN: Primary data saved (8948 records). [2025-09-30T20:06:00.632431] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-30T20:06:00.632515] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAN took 24.6s. Estimated remaining: 1h 57m 42s. Rate: 7.8 symbols/min [2025-09-30T20:06:00.820206] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:00.831699] [DEBUG] [LOCAL ] NBB: Loaded 8939 existing records from primary storage. [2025-09-30T20:06:00.831954] [INFO ] [MAIN ] NBB: Loaded 8939 existing records. [2025-09-30T20:06:01.021533] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:01.021828] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-30T20:06:01.021889] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-30T20:06:01.022091] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-30T20:06:01.022152] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-30T20:06:01.059478] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-30T20:06:01.418853] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:01.689032] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:06:01.780524] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T20:06:01.854362] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-30T20:06:02.654365] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-30T20:06:02.798791] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T20:06:03.454394] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-30T20:06:04.254353] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-30T20:06:04.335935] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T20:06:04.452624] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T20:06:05.054397] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-30T20:06:05.146277] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:06:05.854360] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-30T20:06:05.943625] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:06:06.654443] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-30T20:06:07.425354] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T20:06:07.454453] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-30T20:06:07.605285] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:06:08.254399] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-30T20:06:08.834314] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T20:06:08.834500] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:06:09.054371] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-30T20:06:09.854361] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-30T20:06:10.549126] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T20:06:10.654379] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-30T20:06:10.938872] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T20:06:11.454415] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-30T20:06:11.787215] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T20:06:12.254370] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-30T20:06:13.018696] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T20:06:13.054312] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-30T20:06:13.439113] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T20:06:13.451714] [INFO ] [REMOTE ] NAT: Full fetch complete (72123 records). [2025-09-30T20:06:13.451909] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-30T20:06:13.636947] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T20:06:13.863459] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-30T20:06:13.887902] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-30T20:06:13.888008] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-30T20:06:13.889127] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-30T20:06:13.889298] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-30T20:06:13.890790] [DEBUG] [LOCAL ] NAT: Trimmed 72123 records to 49129 (keeping 200 days of data) [2025-09-30T20:06:14.206992] [DEBUG] [LOCAL ] NAT: Primary data saved (49129 records). [2025-09-30T20:06:14.207138] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-30T20:06:14.208359] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAT took 36.6s. Estimated remaining: 1h 57m 38s. Rate: 7.8 symbols/min [2025-09-30T20:06:14.399530] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:14.426909] [DEBUG] [LOCAL ] NBHC: Loaded 23140 existing records from primary storage. [2025-09-30T20:06:14.427204] [INFO ] [MAIN ] NBHC: Loaded 23140 existing records. [2025-09-30T20:06:14.641565] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:14.642003] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-30T20:06:14.642147] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-30T20:06:14.642555] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-30T20:06:14.642666] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-30T20:06:14.664619] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-30T20:06:15.093163] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:15.358766] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T20:06:15.434411] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T20:06:15.445145] [INFO ] [REMOTE ] NATL: Full fetch complete (45560 records). [2025-09-30T20:06:15.445315] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-30T20:06:15.459541] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-30T20:06:15.928048] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-30T20:06:15.928142] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-30T20:06:15.928993] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-30T20:06:15.929061] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-30T20:06:15.932195] [DEBUG] [LOCAL ] NATL: Trimmed 45560 records to 32612 (keeping 200 days of data) [2025-09-30T20:06:16.152341] [DEBUG] [LOCAL ] NATL: Primary data saved (32612 records). [2025-09-30T20:06:16.152578] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-30T20:06:16.152756] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NATL took 27.8s. Estimated remaining: 1h 57m 26s. Rate: 7.8 symbols/min [2025-09-30T20:06:16.263295] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-30T20:06:16.348347] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:16.386175] [DEBUG] [LOCAL ] NBR: Loaded 34782 existing records from primary storage. [2025-09-30T20:06:16.386516] [INFO ] [MAIN ] NBR: Loaded 34782 existing records. [2025-09-30T20:06:16.611054] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:16.617611] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-30T20:06:16.618052] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-30T20:06:16.618942] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-30T20:06:16.618878] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:06:16.622994] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-30T20:06:16.998015] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T20:06:17.038531] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:17.054323] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-30T20:06:17.854409] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-30T20:06:18.341782] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T20:06:18.654340] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-30T20:06:18.960597] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:06:19.454384] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-30T20:06:19.539268] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T20:06:19.842740] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T20:06:20.254361] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-30T20:06:21.054366] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-30T20:06:21.234490] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T20:06:21.512590] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T20:06:21.854408] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-30T20:06:22.654320] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-30T20:06:22.900228] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T20:06:22.979298] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-30T20:06:23.454384] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-30T20:06:23.933077] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T20:06:24.254404] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-30T20:06:24.991947] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:06:25.054365] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-30T20:06:25.854359] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-30T20:06:26.203071] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T20:06:26.355722] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-30T20:06:26.357094] [INFO ] [REMOTE ] NAZ: Full fetch complete (4373 records). [2025-09-30T20:06:26.357168] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-30T20:06:26.659475] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-30T20:06:26.761315] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-30T20:06:26.761409] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-30T20:06:26.761618] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-30T20:06:26.761705] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-30T20:06:26.762117] [DEBUG] [LOCAL ] NAZ: Trimmed 4373 records to 2627 (keeping 200 days of data) [2025-09-30T20:06:26.780043] [DEBUG] [LOCAL ] NAZ: Primary data saved (2627 records). [2025-09-30T20:06:26.780131] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-30T20:06:26.780215] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NAZ took 28.3s. Estimated remaining: 1h 57m 20s. Rate: 7.8 symbols/min [2025-09-30T20:06:26.959573] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:26.986846] [DEBUG] [LOCAL ] NBXG: Loaded 22289 existing records from primary storage. [2025-09-30T20:06:26.987123] [INFO ] [MAIN ] NBXG: Loaded 22289 existing records. [2025-09-30T20:06:27.184563] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:27.184809] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-30T20:06:27.184861] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-30T20:06:27.185028] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-30T20:06:27.185069] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-30T20:06:27.459488] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-30T20:06:27.576029] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:27.925935] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T20:06:28.255492] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-30T20:06:28.258152] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T20:06:29.054404] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-30T20:06:29.267316] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:06:29.854981] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-30T20:06:29.857880] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T20:06:30.654365] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-30T20:06:31.290723] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T20:06:31.454334] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-30T20:06:31.498388] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T20:06:32.254334] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-30T20:06:32.507613] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T20:06:33.054372] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-30T20:06:33.303535] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T20:06:33.854386] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-30T20:06:34.187777] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:06:34.654330] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-30T20:06:34.750728] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T20:06:35.454356] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-30T20:06:36.122275] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T20:06:36.254399] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-30T20:06:36.678782] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T20:06:37.054390] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-30T20:06:37.145772] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:06:37.148326] [INFO ] [REMOTE ] NBB: Full fetch complete (13845 records). [2025-09-30T20:06:37.148409] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-30T20:06:37.562222] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-30T20:06:37.562328] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-30T20:06:37.562722] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-30T20:06:37.562797] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-30T20:06:37.563334] [DEBUG] [LOCAL ] NBB: Trimmed 13845 records to 9014 (keeping 200 days of data) [2025-09-30T20:06:37.625060] [DEBUG] [LOCAL ] NBB: Primary data saved (9014 records). [2025-09-30T20:06:37.625203] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-30T20:06:37.625303] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBB took 37.0s. Estimated remaining: 1h 57m 15s. Rate: 7.8 symbols/min [2025-09-30T20:06:37.807681] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:37.812463] [DEBUG] [LOCAL ] NC: Loaded 1913 existing records from primary storage. [2025-09-30T20:06:37.812707] [INFO ] [MAIN ] NC: Loaded 1913 existing records. [2025-09-30T20:06:37.859555] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-30T20:06:38.007603] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:38.007845] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-30T20:06:38.007913] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-30T20:06:38.008122] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-30T20:06:38.008181] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-30T20:06:38.415710] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:38.541210] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T20:06:38.654368] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-30T20:06:38.956408] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T20:06:39.454380] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-30T20:06:39.845915] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:06:40.254418] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-30T20:06:40.564207] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T20:06:40.903220] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T20:06:41.054357] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-30T20:06:41.854391] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-30T20:06:42.332169] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T20:06:42.338307] [INFO ] [REMOTE ] NBHC: Full fetch complete (32086 records). [2025-09-30T20:06:42.338484] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-30T20:06:42.442478] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T20:06:42.659539] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-30T20:06:42.777183] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-30T20:06:42.777279] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-30T20:06:42.778085] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-30T20:06:42.778152] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-30T20:06:42.779049] [DEBUG] [LOCAL ] NBHC: Trimmed 32086 records to 23162 (keeping 200 days of data) [2025-09-30T20:06:42.928980] [DEBUG] [LOCAL ] NBHC: Primary data saved (23162 records). [2025-09-30T20:06:42.929120] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-30T20:06:42.929218] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBHC took 28.7s. Estimated remaining: 1h 57m 6s. Rate: 7.8 symbols/min [2025-09-30T20:06:43.108789] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:43.119728] [DEBUG] [LOCAL ] NCA: Loaded 10176 existing records from primary storage. [2025-09-30T20:06:43.119923] [INFO ] [MAIN ] NCA: Loaded 10176 existing records. [2025-09-30T20:06:43.309864] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:43.310434] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-30T20:06:43.310512] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-30T20:06:43.310968] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-30T20:06:43.311038] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-30T20:06:43.459453] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-30T20:06:43.707021] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:43.993286] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:06:44.254401] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-30T20:06:44.710037] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T20:06:45.054394] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-30T20:06:45.854350] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-30T20:06:45.927091] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (3.27 seconds). [2025-09-30T20:06:46.137804] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T20:06:46.568160] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T20:06:46.654336] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-30T20:06:47.107065] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T20:06:47.454366] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-30T20:06:48.254373] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-30T20:06:48.574688] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T20:06:48.618068] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T20:06:49.054374] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-30T20:06:49.854334] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-30T20:06:50.167399] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T20:06:50.590525] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T20:06:50.654386] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-30T20:06:51.454360] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-30T20:06:51.698115] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:06:52.254365] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-30T20:06:52.365710] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:06:53.054360] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-30T20:06:53.349811] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T20:06:53.854362] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-30T20:06:54.192211] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T20:06:54.654380] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-30T20:06:54.946237] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T20:06:54.958813] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-30T20:06:55.454367] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-30T20:06:55.821886] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-30T20:06:56.254364] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-30T20:06:56.651855] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-30T20:06:56.652997] [INFO ] [REMOTE ] NC: Full fetch complete (2707 records). [2025-09-30T20:06:56.653084] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-30T20:06:57.058133] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-30T20:06:57.057902] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-30T20:06:57.058291] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-30T20:06:57.058471] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-30T20:06:57.059384] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-30T20:06:57.059987] [DEBUG] [LOCAL ] NC: Trimmed 2707 records to 1925 (keeping 200 days of data) [2025-09-30T20:06:57.076093] [DEBUG] [LOCAL ] NC: Primary data saved (1925 records). [2025-09-30T20:06:57.076248] [INFO ] [MAIN ] NC: Full history saved. [2025-09-30T20:06:57.076389] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 19.5s. Estimated remaining: 1h 57m 2s. Rate: 7.8 symbols/min [2025-09-30T20:06:57.265211] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:57.292374] [DEBUG] [LOCAL ] NCDL: Loaded 21474 existing records from primary storage. [2025-09-30T20:06:57.292708] [INFO ] [MAIN ] NCDL: Loaded 21474 existing records. [2025-09-30T20:06:57.500144] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:06:57.501159] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-30T20:06:57.501220] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-30T20:06:57.502130] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-30T20:06:57.502201] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-30T20:06:57.865548] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-30T20:06:57.895770] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T20:06:57.895374] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:06:58.654385] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-30T20:06:58.705303] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T20:06:58.710079] [INFO ] [REMOTE ] NBXG: Full fetch complete (32976 records). [2025-09-30T20:06:58.710219] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-30T20:06:59.235632] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-30T20:06:59.235795] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-30T20:06:59.237135] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-30T20:06:59.237314] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-30T20:06:59.238853] [DEBUG] [LOCAL ] NBXG: Trimmed 32976 records to 22277 (keeping 200 days of data) [2025-09-30T20:06:59.450207] [DEBUG] [LOCAL ] NBXG: Primary data saved (22277 records). [2025-09-30T20:06:59.450403] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-30T20:06:59.450534] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 32.7s. Estimated remaining: 1h 56m 51s. Rate: 7.8 symbols/min [2025-09-30T20:06:59.460816] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-30T20:06:59.731795] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:06:59.818321] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-30T20:06:59.818760] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-09-30T20:07:00.024576] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:00.024819] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-30T20:07:00.024869] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-30T20:07:00.025472] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-30T20:07:00.025534] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-30T20:07:00.254780] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-30T20:07:00.323569] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T20:07:00.433291] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T20:07:00.476913] [INFO ] [REMOTE ] NBR: Full fetch complete (49591 records). [2025-09-30T20:07:00.494673] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-30T20:07:00.501555] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:00.904234] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-30T20:07:00.904378] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-30T20:07:00.905509] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-30T20:07:00.905582] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-30T20:07:00.907028] [DEBUG] [LOCAL ] NBR: Trimmed 49591 records to 34709 (keeping 200 days of data) [2025-09-30T20:07:01.070083] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-30T20:07:01.127848] [DEBUG] [LOCAL ] NBR: Primary data saved (34709 records). [2025-09-30T20:07:01.128024] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-30T20:07:01.128180] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NBR took 45.0s. Estimated remaining: 1h 56m 39s. Rate: 7.8 symbols/min [2025-09-30T20:07:01.331777] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:01.347864] [DEBUG] [LOCAL ] NCV: Loaded 13489 existing records from primary storage. [2025-09-30T20:07:01.348108] [INFO ] [MAIN ] NCV: Loaded 13489 existing records. [2025-09-30T20:07:01.553758] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:01.554180] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-30T20:07:01.554308] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-30T20:07:01.554608] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-30T20:07:01.554705] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-30T20:07:01.843915] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:07:01.859440] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-30T20:07:01.910339] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:07:02.006082] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:02.654411] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-30T20:07:03.454389] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-30T20:07:03.815470] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:07:03.988089] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-30T20:07:04.254345] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-30T20:07:04.310002] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T20:07:05.054385] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-30T20:07:05.854517] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-30T20:07:06.186099] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T20:07:06.298758] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T20:07:06.654350] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-30T20:07:06.859909] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:07:07.454376] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-30T20:07:08.258188] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-30T20:07:08.264705] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T20:07:08.360039] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T20:07:08.988066] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T20:07:09.054372] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-30T20:07:09.854407] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-30T20:07:09.966701] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T20:07:10.654402] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-30T20:07:10.857294] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T20:07:11.454383] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-30T20:07:12.254356] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-30T20:07:12.406387] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T20:07:12.508470] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T20:07:13.034106] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T20:07:13.054313] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-30T20:07:13.845255] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T20:07:13.854367] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-30T20:07:14.649132] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T20:07:14.654310] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-30T20:07:15.454405] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-30T20:07:16.177141] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T20:07:16.180093] [INFO ] [REMOTE ] NCA: Full fetch complete (15596 records). [2025-09-30T20:07:16.180168] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-30T20:07:16.261593] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-30T20:07:16.583868] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-30T20:07:16.583956] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-30T20:07:16.584440] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-30T20:07:16.584483] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-30T20:07:16.585081] [DEBUG] [LOCAL ] NCA: Trimmed 15596 records to 10231 (keeping 200 days of data) [2025-09-30T20:07:16.660906] [DEBUG] [LOCAL ] NCA: Primary data saved (10231 records). [2025-09-30T20:07:16.661111] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-30T20:07:16.661256] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCA took 33.7s. Estimated remaining: 1h 56m 37s. Rate: 7.8 symbols/min [2025-09-30T20:07:16.857578] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:16.903624] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-30T20:07:16.921146] [DEBUG] [LOCAL ] NCZ: Loaded 11850 existing records from primary storage. [2025-09-30T20:07:16.921428] [INFO ] [MAIN ] NCZ: Loaded 11850 existing records. [2025-09-30T20:07:17.056863] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-30T20:07:17.116996] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:17.117516] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-30T20:07:17.117816] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-30T20:07:17.131624] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-30T20:07:17.132305] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T20:07:17.132575] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-30T20:07:17.512989] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:17.854386] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-30T20:07:17.945297] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T20:07:18.654382] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-30T20:07:19.105328] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T20:07:19.454380] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-30T20:07:20.254327] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-30T20:07:20.582885] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T20:07:20.802529] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-30T20:07:21.018726] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T20:07:21.054383] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-30T20:07:21.854332] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-30T20:07:21.976143] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:07:22.654359] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-30T20:07:23.454328] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-30T20:07:23.595706] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T20:07:23.954262] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-30T20:07:23.989793] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-30T20:07:24.254379] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-30T20:07:25.054356] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-30T20:07:25.244774] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:07:25.859487] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-30T20:07:25.872560] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T20:07:26.654339] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-30T20:07:26.803056] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T20:07:27.454342] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-30T20:07:27.523011] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T20:07:28.193031] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:07:28.254397] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-30T20:07:29.054356] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-30T20:07:29.281463] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T20:07:29.854335] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-30T20:07:29.959207] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:07:30.654429] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-30T20:07:30.971438] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T20:07:30.975060] [INFO ] [REMOTE ] NCV: Full fetch complete (22863 records). [2025-09-30T20:07:30.975139] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-30T20:07:31.372935] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-30T20:07:31.373022] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-30T20:07:31.373523] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-30T20:07:31.373611] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-30T20:07:31.374429] [DEBUG] [LOCAL ] NCV: Trimmed 22863 records to 13535 (keeping 200 days of data) [2025-09-30T20:07:31.447684] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T20:07:31.454697] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-30T20:07:31.477090] [DEBUG] [LOCAL ] NCV: Primary data saved (13535 records). [2025-09-30T20:07:31.477237] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-30T20:07:31.477326] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCV took 30.3s. Estimated remaining: 1h 56m 33s. Rate: 7.8 symbols/min [2025-09-30T20:07:31.667845] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:31.686137] [DEBUG] [LOCAL ] NDMO: Loaded 16873 existing records from primary storage. [2025-09-30T20:07:31.686372] [INFO ] [MAIN ] NDMO: Loaded 16873 existing records. [2025-09-30T20:07:31.874230] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:31.874450] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-30T20:07:31.874500] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-30T20:07:31.874792] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-30T20:07:31.874851] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-30T20:07:32.286607] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-30T20:07:32.291832] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:33.054328] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-30T20:07:33.198511] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T20:07:33.706083] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T20:07:33.854327] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-30T20:07:34.184822] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T20:07:34.654361] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-30T20:07:35.064275] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T20:07:35.068983] [INFO ] [REMOTE ] NCDL: Full fetch complete (32979 records). [2025-09-30T20:07:35.069083] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-30T20:07:35.460706] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-30T20:07:35.470517] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-30T20:07:35.470721] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-30T20:07:35.471415] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-30T20:07:35.471573] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-30T20:07:35.472609] [DEBUG] [LOCAL ] NCDL: Trimmed 32979 records to 21500 (keeping 200 days of data) [2025-09-30T20:07:35.629317] [DEBUG] [LOCAL ] NCDL: Primary data saved (21500 records). [2025-09-30T20:07:35.629517] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-30T20:07:35.630226] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCDL took 38.6s. Estimated remaining: 1h 56m 23s. Rate: 7.8 symbols/min [2025-09-30T20:07:35.630739] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:07:35.815415] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:35.880700] [DEBUG] [LOCAL ] NE: Loaded 52378 existing records from primary storage. [2025-09-30T20:07:35.881113] [INFO ] [MAIN ] NE: Loaded 52378 existing records. [2025-09-30T20:07:36.070056] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:36.070291] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-30T20:07:36.070340] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-30T20:07:36.070866] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-30T20:07:36.070930] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-30T20:07:36.263000] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-30T20:07:36.451489] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:37.054344] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-30T20:07:37.292897] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:07:37.483973] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-30T20:07:37.842208] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T20:07:37.845520] [INFO ] [REMOTE ] NCZ: Full fetch complete (21420 records). [2025-09-30T20:07:37.845629] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-30T20:07:37.859484] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-30T20:07:38.246421] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-30T20:07:38.246507] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-30T20:07:38.247037] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-30T20:07:38.247103] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-30T20:07:38.247890] [DEBUG] [LOCAL ] NCZ: Trimmed 21420 records to 11854 (keeping 200 days of data) [2025-09-30T20:07:38.327543] [DEBUG] [LOCAL ] NCZ: Primary data saved (11854 records). [2025-09-30T20:07:38.327728] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-30T20:07:38.327831] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 21.7s. Estimated remaining: 1h 56m 13s. Rate: 7.8 symbols/min [2025-09-30T20:07:38.525605] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:38.573604] [DEBUG] [LOCAL ] NEA: Loaded 35357 existing records from primary storage. [2025-09-30T20:07:38.573963] [INFO ] [MAIN ] NEA: Loaded 35357 existing records. [2025-09-30T20:07:38.661135] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-30T20:07:38.784053] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:38.784311] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-30T20:07:38.784363] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-30T20:07:38.785483] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-30T20:07:38.785546] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-30T20:07:39.195551] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:39.454397] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-30T20:07:39.614025] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T20:07:40.254359] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-30T20:07:40.716959] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T20:07:40.729351] [INFO ] [REMOTE ] NCLH: Full fetch complete (77809 records). [2025-09-30T20:07:40.729555] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-30T20:07:41.060170] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-30T20:07:41.186525] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T20:07:41.231442] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-30T20:07:41.232227] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-30T20:07:41.233350] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-30T20:07:41.233417] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-30T20:07:41.235209] [DEBUG] [LOCAL ] NCLH: Trimmed 77809 records to 53753 (keeping 200 days of data) [2025-09-30T20:07:41.582126] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-30T20:07:41.582273] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-30T20:07:41.582357] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NCLH took 42.1s. Estimated remaining: 1h 56m 2s. Rate: 7.8 symbols/min [2025-09-30T20:07:41.768440] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:41.826968] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-30T20:07:41.827291] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-09-30T20:07:41.859481] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-30T20:07:42.061451] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:42.065704] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T20:07:42.063415] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T20:07:42.063606] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-30T20:07:42.079750] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-30T20:07:42.081457] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-30T20:07:42.081523] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-30T20:07:42.451370] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:42.654356] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-30T20:07:43.058775] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T20:07:43.454357] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-30T20:07:44.254338] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-30T20:07:44.404393] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T20:07:44.805003] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T20:07:45.054354] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-30T20:07:45.283686] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T20:07:45.854390] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-30T20:07:46.654330] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-30T20:07:46.785462] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T20:07:47.346032] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T20:07:47.454404] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-30T20:07:47.566132] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:07:48.254380] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-30T20:07:49.015877] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T20:07:49.054353] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-30T20:07:49.461939] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T20:07:49.854371] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-30T20:07:50.654360] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-30T20:07:50.789800] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T20:07:51.454373] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-30T20:07:52.011803] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-30T20:07:52.064576] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T20:07:52.254418] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-30T20:07:52.480607] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T20:07:53.054364] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-30T20:07:53.854344] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-30T20:07:54.102154] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T20:07:54.152867] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T20:07:54.654366] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-30T20:07:55.454368] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-30T20:07:55.757869] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T20:07:55.826216] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:07:56.254348] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-30T20:07:56.599423] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T20:07:56.604100] [INFO ] [REMOTE ] NDMO: Full fetch complete (24947 records). [2025-09-30T20:07:56.604201] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-30T20:07:57.009393] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-30T20:07:57.009491] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-30T20:07:57.010109] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-30T20:07:57.010174] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-30T20:07:57.010870] [DEBUG] [LOCAL ] NDMO: Trimmed 24947 records to 16909 (keeping 200 days of data) [2025-09-30T20:07:57.055557] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-30T20:07:57.123222] [DEBUG] [LOCAL ] NDMO: Primary data saved (16909 records). [2025-09-30T20:07:57.123366] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-30T20:07:57.123454] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 25.6s. Estimated remaining: 1h 55m 59s. Rate: 7.8 symbols/min [2025-09-30T20:07:57.311049] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:07:57.364184] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-30T20:07:57.364541] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-09-30T20:07:57.554581] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:07:57.554845] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-30T20:07:57.554901] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-30T20:07:57.555415] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-30T20:07:57.555473] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-30T20:07:57.857142] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-30T20:07:57.950054] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:07:58.024045] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T20:07:58.418738] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T20:07:58.654381] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-30T20:07:59.454367] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-30T20:07:59.930511] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-30T20:08:00.254377] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-30T20:08:00.865342] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T20:08:01.054360] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-30T20:08:01.411196] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T20:08:01.493544] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T20:08:01.854356] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-30T20:08:02.654441] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-30T20:08:03.172482] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T20:08:03.454368] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-30T20:08:03.734419] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T20:08:03.775279] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T20:08:04.254412] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-30T20:08:04.974105] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:08:05.054397] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-30T20:08:05.854369] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-30T20:08:06.315637] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-30T20:08:06.661112] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-30T20:08:06.665997] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T20:08:06.674505] [INFO ] [REMOTE ] NEA: Full fetch complete (52246 records). [2025-09-30T20:08:06.674638] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-30T20:08:07.103841] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-30T20:08:07.103937] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-30T20:08:07.105073] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-30T20:08:07.105143] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-30T20:08:07.106559] [DEBUG] [LOCAL ] NEA: Trimmed 52246 records to 35427 (keeping 200 days of data) [2025-09-30T20:08:07.353876] [DEBUG] [LOCAL ] NEA: Primary data saved (35427 records). [2025-09-30T20:08:07.354052] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-30T20:08:07.354612] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 29.0s. Estimated remaining: 1h 55m 53s. Rate: 7.8 symbols/min [2025-09-30T20:08:07.454751] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-30T20:08:07.566883] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:07.633814] [DEBUG] [LOCAL ] NET: Loaded 53016 existing records from primary storage. [2025-09-30T20:08:07.634602] [INFO ] [MAIN ] NET: Loaded 53016 existing records. [2025-09-30T20:08:07.843053] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:07.843390] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-30T20:08:07.843465] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-30T20:08:07.844136] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-30T20:08:07.844216] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-30T20:08:08.052607] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T20:08:08.110477] [INFO ] [REMOTE ] NE: Full fetch complete (75466 records). [2025-09-30T20:08:08.167752] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-30T20:08:08.500773] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:08.549583] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-30T20:08:08.841966] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-30T20:08:08.842167] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-30T20:08:08.843458] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-30T20:08:08.843666] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-30T20:08:08.846095] [DEBUG] [LOCAL ] NE: Trimmed 75466 records to 52366 (keeping 200 days of data) [2025-09-30T20:08:08.983498] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-30T20:08:09.082238] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-30T20:08:09.241868] [DEBUG] [LOCAL ] NE: Primary data saved (52366 records). [2025-09-30T20:08:09.242001] [INFO ] [MAIN ] NE: Full history saved. [2025-09-30T20:08:09.242100] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NE took 33.6s. Estimated remaining: 1h 55m 42s. Rate: 7.8 symbols/min [2025-09-30T20:08:09.436282] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:09.448758] [DEBUG] [LOCAL ] NEU: Loaded 8230 existing records from primary storage. [2025-09-30T20:08:09.448992] [INFO ] [MAIN ] NEU: Loaded 8230 existing records. [2025-09-30T20:08:09.652636] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:09.652964] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-30T20:08:09.653079] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-30T20:08:09.653396] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-30T20:08:09.653457] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-30T20:08:10.024458] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-30T20:08:10.062221] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-30T20:08:10.131730] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:10.315279] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T20:08:10.654401] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-30T20:08:11.094168] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T20:08:11.291046] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T20:08:11.454362] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-30T20:08:12.100624] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:08:12.235386] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T20:08:12.254321] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-30T20:08:12.973242] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-30T20:08:13.054422] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-30T20:08:13.628901] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T20:08:13.854372] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-30T20:08:14.548175] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T20:08:14.654407] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-30T20:08:15.454371] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-30T20:08:16.254388] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-30T20:08:16.657462] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T20:08:16.898173] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T20:08:17.054334] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-30T20:08:17.449721] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T20:08:17.854379] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-30T20:08:18.654425] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-30T20:08:19.348926] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-30T20:08:19.360814] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-30T20:08:19.360982] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-30T20:08:19.464476] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-30T20:08:19.791248] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-30T20:08:19.791342] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-30T20:08:19.792397] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-30T20:08:19.792466] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-30T20:08:19.794160] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 53707 (keeping 200 days of data) [2025-09-30T20:08:20.158025] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-30T20:08:20.158264] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-30T20:08:20.158498] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 38.6s. Estimated remaining: 1h 55m 36s. Rate: 7.8 symbols/min [2025-09-30T20:08:20.294195] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-30T20:08:20.389143] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-30T20:08:20.421520] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:20.429605] [DEBUG] [LOCAL ] NEUE: Loaded 2207 existing records from primary storage. [2025-09-30T20:08:20.429896] [INFO ] [MAIN ] NEUE: Loaded 2207 existing records. [2025-09-30T20:08:20.649074] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:08:20.647992] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:20.649832] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-30T20:08:20.654943] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-30T20:08:20.655765] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-30T20:08:20.655961] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-30T20:08:21.033916] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-30T20:08:21.055879] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-30T20:08:21.144419] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:21.854385] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-30T20:08:21.890422] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T20:08:22.665119] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-30T20:08:22.672245] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-30T20:08:23.454881] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-30T20:08:23.497058] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T20:08:24.020310] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T20:08:24.254394] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-30T20:08:25.054337] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-30T20:08:25.147572] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:08:25.149947] [INFO ] [REMOTE ] NEU: Full fetch complete (10423 records). [2025-09-30T20:08:25.150031] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-30T20:08:25.569238] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-30T20:08:25.569473] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-30T20:08:25.569872] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-30T20:08:25.570074] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-30T20:08:25.592733] [DEBUG] [LOCAL ] NEU: Trimmed 10423 records to 8252 (keeping 200 days of data) [2025-09-30T20:08:25.629761] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-30T20:08:25.672369] [DEBUG] [LOCAL ] NEU: Primary data saved (8252 records). [2025-09-30T20:08:25.672498] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-30T20:08:25.672590] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEU took 16.4s. Estimated remaining: 1h 55m 27s. Rate: 7.8 symbols/min [2025-09-30T20:08:25.794751] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T20:08:25.867381] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-30T20:08:25.872493] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:25.891322] [DEBUG] [LOCAL ] NEXA: Loaded 4289 existing records from primary storage. [2025-09-30T20:08:25.892315] [INFO ] [MAIN ] NEXA: Loaded 4289 existing records. [2025-09-30T20:08:26.114461] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:26.114780] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-30T20:08:26.114851] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-30T20:08:26.115067] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-30T20:08:26.115151] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-30T20:08:26.497816] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T20:08:26.525727] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:26.654382] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-30T20:08:27.409731] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:08:27.454354] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-30T20:08:28.210628] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T20:08:28.254367] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-30T20:08:28.684742] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T20:08:29.054391] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-30T20:08:29.854377] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-30T20:08:30.470397] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T20:08:30.654356] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-30T20:08:31.118935] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T20:08:31.306483] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T20:08:31.454405] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-30T20:08:32.254364] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-30T20:08:32.646270] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T20:08:33.054381] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-30T20:08:33.538941] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T20:08:33.599972] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T20:08:33.854364] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-30T20:08:34.654371] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-30T20:08:35.093487] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T20:08:35.454371] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-30T20:08:35.902589] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T20:08:36.254363] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-30T20:08:36.439357] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-30T20:08:36.453893] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-30T20:08:36.454065] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-30T20:08:36.746133] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T20:08:36.901937] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-30T20:08:36.902050] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-30T20:08:36.903090] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-30T20:08:36.903157] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-30T20:08:36.904636] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 53708 (keeping 200 days of data) [2025-09-30T20:08:37.102386] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-30T20:08:37.279052] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-30T20:08:37.279238] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-30T20:08:37.279399] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEM took 40.2s. Estimated remaining: 1h 55m 22s. Rate: 7.8 symbols/min [2025-09-30T20:08:37.463688] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:37.502047] [DEBUG] [LOCAL ] NFG: Loaded 38473 existing records from primary storage. [2025-09-30T20:08:37.502343] [INFO ] [MAIN ] NFG: Loaded 38473 existing records. [2025-09-30T20:08:37.677203] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T20:08:37.709056] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:37.709530] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-30T20:08:37.709582] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-30T20:08:37.709892] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-30T20:08:37.709952] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-30T20:08:37.868301] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-30T20:08:38.105930] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:38.654387] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-30T20:08:39.090358] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T20:08:39.454363] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-30T20:08:40.076941] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T20:08:40.169733] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T20:08:40.254358] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-30T20:08:41.054384] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-30T20:08:41.624220] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T20:08:41.854357] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-30T20:08:42.406905] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T20:08:42.654366] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-30T20:08:43.292201] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T20:08:43.292009] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T20:08:43.454370] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-30T20:08:44.254392] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-30T20:08:44.720044] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T20:08:44.965859] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T20:08:45.054352] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-30T20:08:45.854342] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-30T20:08:45.977743] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:08:45.979880] [INFO ] [REMOTE ] NEXA: Full fetch complete (7601 records). [2025-09-30T20:08:45.979954] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-30T20:08:46.369208] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-30T20:08:46.369290] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-30T20:08:46.369515] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-30T20:08:46.369556] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-30T20:08:46.370024] [DEBUG] [LOCAL ] NEXA: Trimmed 7601 records to 4322 (keeping 200 days of data) [2025-09-30T20:08:46.394969] [DEBUG] [LOCAL ] NEXA: Primary data saved (4322 records). [2025-09-30T20:08:46.395087] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-30T20:08:46.395169] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEXA took 20.7s. Estimated remaining: 1h 55m 15s. Rate: 7.8 symbols/min [2025-09-30T20:08:46.581009] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:46.605868] [DEBUG] [LOCAL ] NFJ: Loaded 20308 existing records from primary storage. [2025-09-30T20:08:46.606218] [INFO ] [MAIN ] NFJ: Loaded 20308 existing records. [2025-09-30T20:08:46.659854] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-30T20:08:46.808206] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:46.808473] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-30T20:08:46.808548] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-30T20:08:46.808938] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-30T20:08:46.808997] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-30T20:08:47.189752] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:47.235095] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T20:08:47.236275] [INFO ] [REMOTE ] NEUE: Full fetch complete (4030 records). [2025-09-30T20:08:47.236353] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-30T20:08:47.459499] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-30T20:08:47.620926] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-30T20:08:47.621031] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-30T20:08:47.621247] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-30T20:08:47.621323] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-30T20:08:47.621760] [DEBUG] [LOCAL ] NEUE: Trimmed 4030 records to 2181 (keeping 200 days of data) [2025-09-30T20:08:47.637154] [DEBUG] [LOCAL ] NEUE: Primary data saved (2181 records). [2025-09-30T20:08:47.637286] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-30T20:08:47.637386] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEUE took 27.5s. Estimated remaining: 1h 55m 4s. Rate: 7.8 symbols/min [2025-09-30T20:08:47.823439] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:08:47.886894] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T20:08:47.913081] [DEBUG] [LOCAL ] NGG: Loaded 46169 existing records from primary storage. [2025-09-30T20:08:47.913395] [INFO ] [MAIN ] NGG: Loaded 46169 existing records. [2025-09-30T20:08:48.099864] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:08:48.100125] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-30T20:08:48.100174] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-30T20:08:48.100536] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-30T20:08:48.100631] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-30T20:08:48.261683] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-30T20:08:48.498031] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:08:48.710330] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T20:08:49.054367] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-30T20:08:49.854340] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-30T20:08:49.967493] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T20:08:50.137431] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:08:50.654356] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-30T20:08:51.393573] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T20:08:51.466041] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-30T20:08:51.490032] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T20:08:52.254361] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-30T20:08:52.561463] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T20:08:53.054362] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-30T20:08:53.859585] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-30T20:08:53.864603] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T20:08:54.654327] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-30T20:08:55.025320] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T20:08:55.114498] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T20:08:55.454351] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-30T20:08:55.926196] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T20:08:56.254367] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-30T20:08:56.637164] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T20:08:57.054368] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-30T20:08:57.854380] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-30T20:08:58.339498] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-30T20:08:58.603299] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T20:08:58.654307] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-30T20:08:58.933282] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T20:08:59.454385] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-30T20:09:00.184957] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T20:09:00.254348] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-30T20:09:01.054362] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-30T20:09:01.854494] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-30T20:09:02.078454] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-30T20:09:02.107168] [INFO ] [REMOTE ] NET: Full fetch complete (76820 records). [2025-09-30T20:09:02.107934] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-30T20:09:02.112393] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T20:09:02.213083] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T20:09:02.656718] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-30T20:09:02.778339] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-30T20:09:02.778454] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-30T20:09:02.779871] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-30T20:09:02.780062] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-30T20:09:02.782041] [DEBUG] [LOCAL ] NET: Trimmed 76820 records to 52998 (keeping 200 days of data) [2025-09-30T20:09:02.922582] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T20:09:03.155441] [DEBUG] [LOCAL ] NET: Primary data saved (52998 records). [2025-09-30T20:09:03.155624] [INFO ] [MAIN ] NET: Full history saved. [2025-09-30T20:09:03.157249] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NET took 55.8s. Estimated remaining: 1h 55m 1s. Rate: 7.8 symbols/min [2025-09-30T20:09:03.345906] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:03.377178] [DEBUG] [LOCAL ] NGL: Loaded 30336 existing records from primary storage. [2025-09-30T20:09:03.377492] [INFO ] [MAIN ] NGL: Loaded 30336 existing records. [2025-09-30T20:09:03.460112] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-30T20:09:03.575958] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:03.576206] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-30T20:09:03.576256] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-30T20:09:03.576711] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-30T20:09:03.576840] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-30T20:09:03.950443] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:04.254329] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-30T20:09:04.442375] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T20:09:04.485496] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T20:09:05.054398] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-30T20:09:05.555986] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T20:09:05.706871] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T20:09:05.854364] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-30T20:09:06.654362] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-30T20:09:06.842038] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T20:09:07.454362] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-30T20:09:08.254336] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-30T20:09:08.301528] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T20:09:08.511232] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:09:09.054371] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-30T20:09:09.273039] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T20:09:09.854374] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-30T20:09:10.372062] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T20:09:10.654334] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-30T20:09:10.959436] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T20:09:10.966259] [INFO ] [REMOTE ] NFJ: Full fetch complete (30558 records). [2025-09-30T20:09:10.966393] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-30T20:09:11.362026] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-30T20:09:11.362106] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-30T20:09:11.362847] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-30T20:09:11.362915] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-30T20:09:11.363670] [DEBUG] [LOCAL ] NFJ: Trimmed 30558 records to 20367 (keeping 200 days of data) [2025-09-30T20:09:11.455241] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-30T20:09:11.499288] [DEBUG] [LOCAL ] NFJ: Primary data saved (20367 records). [2025-09-30T20:09:11.499431] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-30T20:09:11.499551] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFJ took 25.1s. Estimated remaining: 1h 54m 53s. Rate: 7.8 symbols/min [2025-09-30T20:09:11.696382] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:11.709674] [DEBUG] [LOCAL ] NGS: Loaded 11523 existing records from primary storage. [2025-09-30T20:09:11.709927] [INFO ] [MAIN ] NGS: Loaded 11523 existing records. [2025-09-30T20:09:11.923882] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:11.934951] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-30T20:09:11.935277] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-30T20:09:11.936882] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T20:09:11.943678] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-30T20:09:11.944148] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-30T20:09:12.259478] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-30T20:09:12.350825] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:13.056725] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-30T20:09:13.059558] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:09:13.068390] [INFO ] [REMOTE ] NFG: Full fetch complete (56818 records). [2025-09-30T20:09:13.068531] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-30T20:09:13.514845] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-30T20:09:13.515027] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-30T20:09:13.516143] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-30T20:09:13.516287] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-30T20:09:13.518016] [DEBUG] [LOCAL ] NFG: Trimmed 56818 records to 38473 (keeping 200 days of data) [2025-09-30T20:09:13.645975] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T20:09:13.811055] [DEBUG] [LOCAL ] NFG: Primary data saved (38473 records). [2025-09-30T20:09:13.811203] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-30T20:09:13.811285] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NFG took 36.5s. Estimated remaining: 1h 54m 42s. Rate: 7.8 symbols/min [2025-09-30T20:09:13.859468] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-30T20:09:14.000329] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:14.024347] [DEBUG] [LOCAL ] NGVC: Loaded 22321 existing records from primary storage. [2025-09-30T20:09:14.024621] [INFO ] [MAIN ] NGVC: Loaded 22321 existing records. [2025-09-30T20:09:14.230990] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:14.232098] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-30T20:09:14.232160] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-30T20:09:14.233051] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-30T20:09:14.233117] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-30T20:09:14.483198] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:09:14.650539] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:14.654319] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-30T20:09:15.454383] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-30T20:09:15.606975] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:09:15.645157] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T20:09:16.254329] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-30T20:09:16.269558] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T20:09:17.054379] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-30T20:09:17.795694] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T20:09:17.854319] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-30T20:09:17.928997] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T20:09:18.654404] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-30T20:09:18.838103] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:09:19.454370] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-30T20:09:20.254371] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-30T20:09:20.420731] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T20:09:20.441923] [INFO ] [REMOTE ] NGG: Full fetch complete (66447 records). [2025-09-30T20:09:20.443114] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T20:09:20.442672] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-30T20:09:20.865062] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-30T20:09:20.865146] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-30T20:09:20.866164] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-30T20:09:20.866231] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-30T20:09:20.867685] [DEBUG] [LOCAL ] NGG: Trimmed 66447 records to 46203 (keeping 200 days of data) [2025-09-30T20:09:21.059962] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-30T20:09:21.164999] [DEBUG] [LOCAL ] NGG: Primary data saved (46203 records). [2025-09-30T20:09:21.165135] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-30T20:09:21.165219] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGG took 33.5s. Estimated remaining: 1h 54m 35s. Rate: 7.8 symbols/min [2025-09-30T20:09:21.286018] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T20:09:21.854345] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-30T20:09:22.100865] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T20:09:22.654406] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-30T20:09:23.221772] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T20:09:23.454427] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-30T20:09:23.634730] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:09:24.254414] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-30T20:09:24.623541] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T20:09:24.788235] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:09:25.054377] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-30T20:09:25.854349] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-30T20:09:25.997583] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T20:09:26.654400] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-30T20:09:26.833179] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T20:09:27.454384] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-30T20:09:27.661902] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:09:28.254425] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-30T20:09:28.884816] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T20:09:28.892153] [INFO ] [REMOTE ] NGL: Full fetch complete (41204 records). [2025-09-30T20:09:28.892324] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-30T20:09:29.062546] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-30T20:09:29.312329] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-30T20:09:29.312410] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-30T20:09:29.313151] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-30T20:09:29.313215] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-30T20:09:29.315448] [DEBUG] [LOCAL ] NGL: Trimmed 41204 records to 30329 (keeping 200 days of data) [2025-09-30T20:09:29.388829] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T20:09:29.525906] [DEBUG] [LOCAL ] NGL: Primary data saved (30329 records). [2025-09-30T20:09:29.526072] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-30T20:09:29.526671] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGL took 26.4s. Estimated remaining: 1h 54m 27s. Rate: 7.8 symbols/min [2025-09-30T20:09:29.854381] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-30T20:09:30.284371] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T20:09:30.654404] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-30T20:09:30.711605] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T20:09:31.454375] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-30T20:09:31.920597] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T20:09:32.061408] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T20:09:32.254357] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-30T20:09:33.014079] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T20:09:33.054352] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-30T20:09:33.854422] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-30T20:09:34.401793] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T20:09:34.654392] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-30T20:09:35.194224] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T20:09:35.197057] [INFO ] [REMOTE ] NGS: Full fetch complete (17251 records). [2025-09-30T20:09:35.197147] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-30T20:09:35.639576] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-30T20:09:35.639718] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-30T20:09:35.640162] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-30T20:09:35.640271] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-30T20:09:35.656022] [DEBUG] [LOCAL ] NGS: Trimmed 17251 records to 11524 (keeping 200 days of data) [2025-09-30T20:09:35.657749] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T20:09:35.699152] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-30T20:09:35.743094] [DEBUG] [LOCAL ] NGS: Primary data saved (11524 records). [2025-09-30T20:09:35.743252] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-30T20:09:35.743356] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGS took 24.2s. Estimated remaining: 1h 54m 19s. Rate: 7.8 symbols/min [2025-09-30T20:09:36.957296] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T20:09:36.962620] [INFO ] [REMOTE ] NGVC: Full fetch complete (30478 records). [2025-09-30T20:09:36.962753] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-30T20:09:37.365786] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-30T20:09:37.365871] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-30T20:09:37.366566] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-30T20:09:37.366614] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-30T20:09:37.367450] [DEBUG] [LOCAL ] NGVC: Trimmed 30478 records to 22357 (keeping 200 days of data) [2025-09-30T20:09:37.516056] [DEBUG] [LOCAL ] NGVC: Primary data saved (22357 records). [2025-09-30T20:09:37.516189] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-30T20:09:37.516275] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVC took 23.7s. Estimated remaining: 1h 54m 7s. Rate: 7.8 symbols/min [2025-09-30T20:09:38.274827] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:38.316629] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:38.315677] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:38.353736] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:09:38.363244] [DEBUG] [LOCAL ] NIC: Loaded 8914 existing records from primary storage. [2025-09-30T20:09:38.363626] [INFO ] [MAIN ] NIC: Loaded 8914 existing records. [2025-09-30T20:09:38.511328] [DEBUG] [LOCAL ] NGVT: Loaded 24102 existing records from primary storage. [2025-09-30T20:09:38.536473] [INFO ] [MAIN ] NGVT: Loaded 24102 existing records. [2025-09-30T20:09:38.552637] [DEBUG] [LOCAL ] NHI: Loaded 21861 existing records from primary storage. [2025-09-30T20:09:38.630783] [INFO ] [MAIN ] NHI: Loaded 21861 existing records. [2025-09-30T20:09:38.735453] [DEBUG] [LOCAL ] NI: Loaded 53420 existing records from primary storage. [2025-09-30T20:09:38.729172] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:38.802033] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-30T20:09:38.801747] [INFO ] [MAIN ] NI: Loaded 53420 existing records. [2025-09-30T20:09:38.822792] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-30T20:09:38.932006] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-30T20:09:39.003259] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-30T20:09:39.218442] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:39.273490] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-30T20:09:39.364874] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-30T20:09:39.392560] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:39.398912] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-30T20:09:39.413149] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-30T20:09:39.412980] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-30T20:09:39.453388] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-30T20:09:39.458268] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-30T20:09:39.457935] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:09:39.491507] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-30T20:09:39.491391] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-30T20:09:39.521720] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-30T20:09:39.594743] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-30T20:09:39.618478] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-30T20:09:40.437908] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:40.501838] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-30T20:09:40.879013] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:40.928036] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:40.941612] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-30T20:09:40.945788] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-30T20:09:41.036342] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:09:41.036692] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-30T20:09:41.419866] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T20:09:41.421969] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-30T20:09:42.114942] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T20:09:42.120422] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-30T20:09:42.162387] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T20:09:42.167556] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-30T20:09:42.173994] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T20:09:42.176424] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-30T20:09:42.875951] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T20:09:42.887150] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-30T20:09:42.893501] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-30T20:09:43.279208] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T20:09:43.297405] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T20:09:43.454363] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-30T20:09:44.254329] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-30T20:09:44.383139] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T20:09:44.547623] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T20:09:45.054336] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-30T20:09:45.158481] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:09:45.854357] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-30T20:09:46.654366] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-30T20:09:46.813043] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T20:09:46.875935] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T20:09:47.454355] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-30T20:09:47.739187] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T20:09:48.206968] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T20:09:48.254315] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-30T20:09:49.018494] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T20:09:49.054336] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-30T20:09:49.854359] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-30T20:09:50.664621] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-30T20:09:50.687267] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T20:09:51.021772] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T20:09:51.454392] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-30T20:09:51.568705] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T20:09:52.254362] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-30T20:09:52.925966] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T20:09:53.054336] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-30T20:09:53.343455] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T20:09:53.854360] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-30T20:09:54.161313] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T20:09:54.654411] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-30T20:09:54.727517] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T20:09:55.454416] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-30T20:09:55.832229] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:09:56.254357] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-30T20:09:56.443502] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T20:09:57.054369] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-30T20:09:57.082838] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T20:09:57.854352] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-30T20:09:58.148181] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T20:09:58.594772] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T20:09:58.654412] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-30T20:09:59.454398] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-30T20:09:59.889127] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T20:10:00.254391] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-30T20:10:00.545477] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T20:10:01.054346] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-30T20:10:01.343073] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T20:10:01.854414] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-30T20:10:02.654361] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-30T20:10:03.071299] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-30T20:10:03.071992] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T20:10:03.454357] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-30T20:10:04.108088] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T20:10:04.113623] [INFO ] [REMOTE ] NHI: Full fetch complete (31566 records). [2025-09-30T20:10:04.113789] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-30T20:10:04.259479] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-30T20:10:04.514163] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-30T20:10:04.514345] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-30T20:10:04.515135] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-30T20:10:04.515204] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-30T20:10:04.517429] [DEBUG] [LOCAL ] NHI: Trimmed 31566 records to 21859 (keeping 200 days of data) [2025-09-30T20:10:04.676828] [DEBUG] [LOCAL ] NHI: Primary data saved (21859 records). [2025-09-30T20:10:04.677080] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-30T20:10:04.677322] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NHI took 27.2s. Estimated remaining: 1h 54m 11s. Rate: 7.8 symbols/min [2025-09-30T20:10:04.871597] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:04.887180] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T20:10:04.893194] [INFO ] [REMOTE ] NGVT: Full fetch complete (34411 records). [2025-09-30T20:10:04.893323] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-30T20:10:05.016040] [DEBUG] [LOCAL ] NIE: Loaded 11756 existing records from primary storage. [2025-09-30T20:10:05.026976] [INFO ] [MAIN ] NIE: Loaded 11756 existing records. [2025-09-30T20:10:05.089674] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-30T20:10:05.429754] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:05.454062] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-30T20:10:05.448718] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T20:10:05.464735] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-30T20:10:05.518521] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-30T20:10:05.501842] [INFO ] [REMOTE ] NIC: Full fetch complete (12185 records). [2025-09-30T20:10:05.520757] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-30T20:10:05.531426] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-30T20:10:05.539685] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-30T20:10:05.560700] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-30T20:10:05.631196] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-30T20:10:05.675109] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-30T20:10:05.762164] [DEBUG] [LOCAL ] NGVT: Trimmed 34411 records to 24100 (keeping 200 days of data) [2025-09-30T20:10:06.427588] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-30T20:10:06.443839] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-30T20:10:06.465917] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-30T20:10:06.484012] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-30T20:10:06.510493] [DEBUG] [LOCAL ] NGVT: Primary data saved (24100 records). [2025-09-30T20:10:06.509314] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:06.511124] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-30T20:10:06.511542] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-30T20:10:06.512574] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NGVT took 29.0s. Estimated remaining: 1h 54m 0s. Rate: 7.8 symbols/min [2025-09-30T20:10:06.512731] [DEBUG] [LOCAL ] NIC: Trimmed 12185 records to 8968 (keeping 200 days of data) [2025-09-30T20:10:06.744767] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:06.755141] [DEBUG] [LOCAL ] NIM: Loaded 4102 existing records from primary storage. [2025-09-30T20:10:06.755911] [INFO ] [MAIN ] NIM: Loaded 4102 existing records. [2025-09-30T20:10:06.881046] [DEBUG] [LOCAL ] NIC: Primary data saved (8968 records). [2025-09-30T20:10:06.896929] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-30T20:10:06.920268] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIC took 29.4s. Estimated remaining: 1h 53m 48s. Rate: 7.8 symbols/min [2025-09-30T20:10:06.966209] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:07.026490] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-30T20:10:07.051934] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-30T20:10:07.082015] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-30T20:10:07.090238] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-30T20:10:07.268028] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:07.347128] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T20:10:07.355740] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-30T20:10:07.399398] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-30T20:10:07.463802] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-30T20:10:07.578271] [DEBUG] [LOCAL ] NINE: Loaded 28246 existing records from primary storage. [2025-09-30T20:10:07.594807] [INFO ] [MAIN ] NINE: Loaded 28246 existing records. [2025-09-30T20:10:07.775351] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:07.856080] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:07.856292] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-30T20:10:07.856341] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-30T20:10:07.856620] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-30T20:10:07.856721] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-30T20:10:08.229797] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:08.254306] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-30T20:10:08.445600] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T20:10:09.054432] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-30T20:10:09.389474] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T20:10:09.403396] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T20:10:09.587299] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:10:09.854361] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-30T20:10:10.654374] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-30T20:10:10.858003] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T20:10:11.454411] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-30T20:10:12.254334] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-30T20:10:12.452415] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T20:10:13.019220] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:10:13.054356] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-30T20:10:13.245024] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T20:10:13.854336] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-30T20:10:13.979445] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:10:14.654404] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-30T20:10:15.185213] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T20:10:15.454384] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-30T20:10:16.254383] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-30T20:10:16.648900] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T20:10:16.661438] [INFO ] [REMOTE ] NI: Full fetch complete (77266 records). [2025-09-30T20:10:16.661628] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-30T20:10:17.010736] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T20:10:17.060833] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-30T20:10:17.124470] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-30T20:10:17.124610] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-30T20:10:17.125864] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-30T20:10:17.125949] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-30T20:10:17.134319] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T20:10:17.138032] [DEBUG] [LOCAL ] NI: Trimmed 77266 records to 53419 (keeping 200 days of data) [2025-09-30T20:10:17.510441] [DEBUG] [LOCAL ] NI: Primary data saved (53419 records). [2025-09-30T20:10:17.510670] [INFO ] [MAIN ] NI: Full history saved. [2025-09-30T20:10:17.510786] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 40.0s. Estimated remaining: 1h 53m 42s. Rate: 7.8 symbols/min [2025-09-30T20:10:17.712408] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:17.715510] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:10:17.772138] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-30T20:10:17.772501] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-09-30T20:10:17.859495] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-30T20:10:17.971605] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:17.971910] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-30T20:10:17.971966] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-30T20:10:17.972254] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-30T20:10:17.972323] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-30T20:10:18.369717] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:18.377501] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T20:10:18.654362] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-30T20:10:19.342907] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T20:10:19.454409] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-30T20:10:20.254401] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-30T20:10:20.836752] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T20:10:20.851020] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T20:10:21.054377] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-30T20:10:21.854385] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-30T20:10:21.880951] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T20:10:22.654364] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-30T20:10:23.454417] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-30T20:10:23.552347] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:10:24.254341] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-30T20:10:24.361723] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-30T20:10:24.621688] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:10:24.728859] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T20:10:25.054401] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-30T20:10:25.854394] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-30T20:10:26.060264] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T20:10:26.063306] [INFO ] [REMOTE ] NIE: Full fetch complete (16532 records). [2025-09-30T20:10:26.063390] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-30T20:10:26.452399] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-30T20:10:26.452516] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-30T20:10:26.452918] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-30T20:10:26.452982] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-30T20:10:26.453740] [DEBUG] [LOCAL ] NIE: Trimmed 16532 records to 11782 (keeping 200 days of data) [2025-09-30T20:10:26.532027] [DEBUG] [LOCAL ] NIE: Primary data saved (11782 records). [2025-09-30T20:10:26.532183] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-30T20:10:26.532273] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 21.9s. Estimated remaining: 1h 53m 35s. Rate: 7.8 symbols/min [2025-09-30T20:10:26.659531] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-30T20:10:26.726815] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:26.727106] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-30T20:10:26.727189] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-30T20:10:26.727317] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-30T20:10:26.727360] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-30T20:10:26.727465] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-30T20:10:26.727515] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-30T20:10:27.116292] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:27.454357] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-30T20:10:27.658898] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:10:27.659300] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-30T20:10:27.659384] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:10:27.659440] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-30T20:10:27.659480] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:10:27.659550] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-30T20:10:27.659737] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-30T20:10:27.659810] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-30T20:10:27.659907] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-30T20:10:27.660008] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIQ took 1.1s. Estimated remaining: 1h 53m 24s. Rate: 7.8 symbols/min [2025-09-30T20:10:27.865034] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:27.906095] [DEBUG] [LOCAL ] NJR: Loaded 38049 existing records from primary storage. [2025-09-30T20:10:27.906445] [INFO ] [MAIN ] NJR: Loaded 38049 existing records. [2025-09-30T20:10:28.115482] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:28.115969] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-30T20:10:28.116109] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-30T20:10:28.116525] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-30T20:10:28.116589] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-30T20:10:28.269140] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-30T20:10:28.581304] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:28.584024] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-30T20:10:28.617861] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T20:10:28.896196] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T20:10:29.054369] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-30T20:10:29.854385] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-30T20:10:30.465444] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T20:10:30.654369] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-30T20:10:31.069422] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T20:10:31.174366] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T20:10:31.454371] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-30T20:10:32.254361] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-30T20:10:32.701479] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T20:10:32.827277] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T20:10:33.054367] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-30T20:10:33.854371] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-30T20:10:34.511753] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T20:10:34.654358] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-30T20:10:35.109839] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T20:10:35.115193] [INFO ] [REMOTE ] NINE: Full fetch complete (44023 records). [2025-09-30T20:10:35.115302] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-30T20:10:35.469448] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-30T20:10:35.536861] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-30T20:10:35.537027] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-30T20:10:35.537819] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-30T20:10:35.537884] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-30T20:10:35.538927] [DEBUG] [LOCAL ] NINE: Trimmed 44023 records to 28273 (keeping 200 days of data) [2025-09-30T20:10:35.714526] [DEBUG] [LOCAL ] NINE: Primary data saved (28273 records). [2025-09-30T20:10:35.714699] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-30T20:10:35.714841] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NINE took 28.8s. Estimated remaining: 1h 53m 16s. Rate: 7.8 symbols/min [2025-09-30T20:10:35.900608] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:35.900843] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-30T20:10:35.900888] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-30T20:10:35.901013] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-30T20:10:35.901055] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-30T20:10:35.901101] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-30T20:10:35.901141] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-30T20:10:36.078870] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T20:10:36.259513] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-30T20:10:36.303294] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:36.748137] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-30T20:10:36.749339] [INFO ] [REMOTE ] NIM: Full fetch complete (6814 records). [2025-09-30T20:10:36.749413] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-30T20:10:37.057821] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-30T20:10:37.159926] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-30T20:10:37.203206] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-30T20:10:37.203302] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-30T20:10:37.203528] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-30T20:10:37.203569] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-30T20:10:37.204099] [DEBUG] [LOCAL ] NIM: Trimmed 6814 records to 4105 (keeping 200 days of data) [2025-09-30T20:10:37.233143] [DEBUG] [LOCAL ] NIM: Primary data saved (4105 records). [2025-09-30T20:10:37.233320] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-30T20:10:37.233463] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIM took 30.7s. Estimated remaining: 1h 53m 5s. Rate: 7.8 symbols/min [2025-09-30T20:10:37.415945] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:10:37.432666] [DEBUG] [LOCAL ] NKX: Loaded 13526 existing records from primary storage. [2025-09-30T20:10:37.432919] [INFO ] [MAIN ] NKX: Loaded 13526 existing records. [2025-09-30T20:10:37.661771] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:10:37.662030] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-30T20:10:37.662101] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-30T20:10:37.662444] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-30T20:10:37.662519] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-30T20:10:37.859542] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-30T20:10:38.127802] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:10:38.226740] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T20:10:38.654399] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-30T20:10:39.454356] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-30T20:10:40.076821] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T20:10:40.254371] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-30T20:10:40.516613] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-30T20:10:41.054382] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-30T20:10:41.683931] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:10:41.854361] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-30T20:10:42.011823] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:10:42.052506] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-30T20:10:42.654363] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-30T20:10:43.066528] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T20:10:43.454357] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-30T20:10:43.480954] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T20:10:44.254380] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-30T20:10:44.900792] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T20:10:45.020019] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T20:10:45.054333] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-30T20:10:45.854350] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-30T20:10:45.893293] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T20:10:46.654410] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-30T20:10:47.454387] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-30T20:10:48.203579] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-30T20:10:48.254411] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-30T20:10:48.278225] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:10:48.836856] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T20:10:49.054355] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-30T20:10:49.563437] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:10:49.579753] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T20:10:49.854367] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-30T20:10:50.654358] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-30T20:10:51.454369] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-30T20:10:52.254345] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-30T20:10:52.375960] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-30T20:10:52.519527] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T20:10:53.063088] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-30T20:10:53.068811] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-30T20:10:53.114202] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T20:10:53.854389] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-30T20:10:54.654388] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-30T20:10:54.773284] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:10:55.335962] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-30T20:10:55.454366] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-30T20:10:56.254386] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-30T20:10:57.054371] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-30T20:10:57.074511] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T20:10:57.192590] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-30T20:10:57.704247] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T20:10:57.854375] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-30T20:10:58.654356] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-30T20:10:58.840578] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:10:58.859058] [INFO ] [REMOTE ] NJR: Full fetch complete (54591 records). [2025-09-30T20:10:58.859766] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-30T20:10:58.860269] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T20:10:58.912008] [INFO ] [REMOTE ] NKX: Full fetch complete (19477 records). [2025-09-30T20:10:58.946701] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-30T20:10:59.459310] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-30T20:10:59.703233] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-30T20:10:59.713942] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-30T20:10:59.732323] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-30T20:10:59.746912] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-30T20:10:59.746675] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-30T20:10:59.747126] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-30T20:10:59.747884] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-30T20:10:59.748319] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-30T20:10:59.749318] [DEBUG] [LOCAL ] NJR: Trimmed 54591 records to 38069 (keeping 200 days of data) [2025-09-30T20:10:59.751233] [DEBUG] [LOCAL ] NKX: Trimmed 19477 records to 13662 (keeping 200 days of data) [2025-09-30T20:10:59.956942] [DEBUG] [LOCAL ] NKX: Primary data saved (13662 records). [2025-09-30T20:10:59.957927] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-30T20:10:59.958139] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NKX took 22.7s. Estimated remaining: 1h 53m 6s. Rate: 7.8 symbols/min [2025-09-30T20:11:00.173116] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:00.174668] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-30T20:11:00.175272] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-30T20:11:00.176445] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-30T20:11:00.177036] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-30T20:11:00.177617] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-30T20:11:00.177702] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-30T20:11:00.667999] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:00.672002] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-30T20:11:00.707190] [DEBUG] [LOCAL ] NJR: Primary data saved (38069 records). [2025-09-30T20:11:00.707412] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-30T20:11:00.707568] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NJR took 33.0s. Estimated remaining: 1h 52m 54s. Rate: 7.8 symbols/min [2025-09-30T20:11:00.892234] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:00.906474] [DEBUG] [LOCAL ] NLOP: Loaded 11780 existing records from primary storage. [2025-09-30T20:11:00.906756] [INFO ] [MAIN ] NLOP: Loaded 11780 existing records. [2025-09-30T20:11:01.097750] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:01.098101] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-30T20:11:01.098230] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-30T20:11:01.098585] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-30T20:11:01.098677] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-30T20:11:01.366889] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T20:11:01.391800] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-30T20:11:01.545567] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:01.601777] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-30T20:11:01.657721] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T20:11:01.854386] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-30T20:11:02.158933] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T20:11:02.654389] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-30T20:11:03.454394] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-30T20:11:04.254404] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-30T20:11:04.296502] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T20:11:04.664661] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-30T20:11:04.676390] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-30T20:11:04.676580] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-30T20:11:05.058890] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-30T20:11:05.121262] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-30T20:11:05.121377] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-30T20:11:05.122633] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-30T20:11:05.122750] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-30T20:11:05.124562] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-09-30T20:11:05.227464] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T20:11:05.397426] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-30T20:11:05.532932] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-30T20:11:05.533165] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-30T20:11:05.533327] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NIO took 48.0s. Estimated remaining: 1h 52m 45s. Rate: 7.8 symbols/min [2025-09-30T20:11:05.740829] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T20:11:05.745123] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:05.807312] [DEBUG] [LOCAL ] NLY: Loaded 53580 existing records from primary storage. [2025-09-30T20:11:05.807673] [INFO ] [MAIN ] NLY: Loaded 53580 existing records. [2025-09-30T20:11:05.864115] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-30T20:11:06.001727] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:06.001967] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-30T20:11:06.002017] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-30T20:11:06.002437] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-30T20:11:06.002516] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-30T20:11:06.398781] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:06.654390] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-30T20:11:07.454356] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-30T20:11:08.132906] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T20:11:08.254352] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-30T20:11:08.375218] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-30T20:11:08.519801] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T20:11:08.861113] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T20:11:09.054429] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-30T20:11:09.854389] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-30T20:11:10.453604] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:11:10.654364] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-30T20:11:11.288532] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T20:11:11.454405] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-30T20:11:11.602207] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-30T20:11:12.090413] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T20:11:12.254403] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-30T20:11:12.841457] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T20:11:13.054385] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-30T20:11:13.854813] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-30T20:11:13.856045] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T20:11:14.654465] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-30T20:11:15.454351] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-30T20:11:15.473470] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T20:11:16.063200] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-30T20:11:16.254404] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-30T20:11:17.054369] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-30T20:11:17.432437] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T20:11:17.854327] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-30T20:11:18.006717] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T20:11:18.654426] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-30T20:11:18.699495] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T20:11:18.713693] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-30T20:11:18.713913] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-30T20:11:18.940509] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T20:11:18.941378] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:11:18.941456] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:11:18.941546] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-30T20:11:18.941715] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-30T20:11:18.941777] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-30T20:11:18.941843] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-30T20:11:18.941960] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NKE took 43.2s. Estimated remaining: 1h 52m 41s. Rate: 7.8 symbols/min [2025-09-30T20:11:19.148692] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:19.165386] [DEBUG] [LOCAL ] NMAI: Loaded 12900 existing records from primary storage. [2025-09-30T20:11:19.165633] [INFO ] [MAIN ] NMAI: Loaded 12900 existing records. [2025-09-30T20:11:19.379835] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:19.380677] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-30T20:11:19.380840] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-30T20:11:19.381372] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-30T20:11:19.389355] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-30T20:11:19.389698] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T20:11:19.458395] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-30T20:11:19.856497] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T20:11:19.862333] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:20.225581] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T20:11:20.227237] [INFO ] [REMOTE ] NL: Full fetch complete (6880 records). [2025-09-30T20:11:20.227343] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-30T20:11:20.259574] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-30T20:11:20.435414] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:11:20.435673] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:11:20.435747] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:11:20.435822] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-30T20:11:20.435923] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-30T20:11:20.436170] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-30T20:11:20.436243] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-30T20:11:20.436367] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NL took 20.5s. Estimated remaining: 1h 52m 29s. Rate: 7.8 symbols/min [2025-09-30T20:11:20.622723] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:20.622899] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-30T20:11:20.622938] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-30T20:11:20.623052] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-30T20:11:20.623127] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-30T20:11:20.623193] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-30T20:11:20.623229] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-30T20:11:21.030154] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:21.054337] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-30T20:11:21.142983] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T20:11:21.854327] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-30T20:11:22.009062] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:11:22.654368] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-30T20:11:23.018055] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:11:23.018416] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-30T20:11:23.018529] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:11:23.018591] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-30T20:11:23.018630] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:11:23.018745] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-30T20:11:23.018817] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-30T20:11:23.018885] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-30T20:11:23.018952] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-30T20:11:23.019027] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAX took 2.6s. Estimated remaining: 1h 52m 19s. Rate: 7.8 symbols/min [2025-09-30T20:11:23.196531] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:23.217143] [DEBUG] [LOCAL ] NMCO: Loaded 16721 existing records from primary storage. [2025-09-30T20:11:23.217423] [INFO ] [MAIN ] NMCO: Loaded 16721 existing records. [2025-09-30T20:11:23.423039] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:23.423310] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-30T20:11:23.423442] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-30T20:11:23.423888] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-30T20:11:23.424009] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-30T20:11:23.459100] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-30T20:11:23.808308] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T20:11:23.891003] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:24.254381] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-30T20:11:24.443598] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:11:25.054357] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-30T20:11:25.831137] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T20:11:25.854318] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-30T20:11:26.266639] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T20:11:26.654405] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-30T20:11:26.875598] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T20:11:27.454417] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-30T20:11:27.790948] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T20:11:28.246327] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:11:28.254310] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-30T20:11:29.054375] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-30T20:11:29.085023] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T20:11:29.854388] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-30T20:11:29.863031] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T20:11:30.654351] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-30T20:11:30.833302] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:11:31.454338] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-30T20:11:31.606109] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:11:32.254380] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-30T20:11:32.375438] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:11:33.054411] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-30T20:11:33.298048] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T20:11:33.301698] [INFO ] [REMOTE ] NLOP: Full fetch complete (17756 records). [2025-09-30T20:11:33.301809] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-30T20:11:33.745938] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-30T20:11:33.745390] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-30T20:11:33.750565] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-30T20:11:33.752203] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-30T20:11:33.752315] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-30T20:11:33.753047] [DEBUG] [LOCAL ] NLOP: Trimmed 17756 records to 11771 (keeping 200 days of data) [2025-09-30T20:11:33.834513] [DEBUG] [LOCAL ] NLOP: Primary data saved (11771 records). [2025-09-30T20:11:33.834691] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-30T20:11:33.834796] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NLOP took 33.1s. Estimated remaining: 1h 52m 13s. Rate: 7.8 symbols/min [2025-09-30T20:11:33.859478] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-30T20:11:34.105708] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:34.117560] [DEBUG] [LOCAL ] NMG: Loaded 8008 existing records from primary storage. [2025-09-30T20:11:34.117889] [INFO ] [MAIN ] NMG: Loaded 8008 existing records. [2025-09-30T20:11:34.307571] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:34.307845] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-30T20:11:34.307975] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-30T20:11:34.308259] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-30T20:11:34.308317] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-30T20:11:34.666078] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-30T20:11:34.714118] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:34.856433] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T20:11:35.454375] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-30T20:11:36.254342] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-30T20:11:36.535428] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T20:11:36.587363] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T20:11:37.054358] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-30T20:11:37.089983] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T20:11:37.854396] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-30T20:11:37.869937] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T20:11:38.654354] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-30T20:11:38.794557] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T20:11:39.454401] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-30T20:11:40.061934] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T20:11:40.254424] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-30T20:11:40.538813] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T20:11:41.054405] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-30T20:11:41.269544] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T20:11:41.273140] [INFO ] [REMOTE ] NMAI: Full fetch complete (19976 records). [2025-09-30T20:11:41.273234] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-30T20:11:41.669320] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-30T20:11:41.669399] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-30T20:11:41.669843] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-30T20:11:41.669906] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-30T20:11:41.670459] [DEBUG] [LOCAL ] NMAI: Trimmed 19976 records to 12913 (keeping 200 days of data) [2025-09-30T20:11:41.753408] [DEBUG] [LOCAL ] NMAI: Primary data saved (12913 records). [2025-09-30T20:11:41.753555] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-30T20:11:41.753659] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMAI took 22.8s. Estimated remaining: 1h 52m 5s. Rate: 7.8 symbols/min [2025-09-30T20:11:41.859562] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-30T20:11:41.941891] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:41.949435] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-09-30T20:11:41.949632] [INFO ] [MAIN ] NMI: Loaded 4049 existing records. [2025-09-30T20:11:42.141800] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:42.142024] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-30T20:11:42.142073] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-30T20:11:42.142459] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-30T20:11:42.142535] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-30T20:11:42.584975] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:42.590866] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T20:11:42.654363] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-30T20:11:43.092254] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T20:11:43.360272] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T20:11:43.454348] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-30T20:11:44.254363] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-30T20:11:45.054353] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-30T20:11:45.198214] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T20:11:45.300966] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T20:11:45.460317] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T20:11:45.854360] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-30T20:11:46.654333] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-30T20:11:46.807965] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T20:11:46.987662] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T20:11:47.454350] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-30T20:11:47.988574] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T20:11:48.254356] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-30T20:11:48.887624] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T20:11:49.054353] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-30T20:11:49.646437] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T20:11:49.854368] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-30T20:11:50.654345] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-30T20:11:50.764798] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T20:11:51.454353] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-30T20:11:52.187908] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T20:11:52.254390] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-30T20:11:52.780298] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T20:11:52.793372] [INFO ] [REMOTE ] NLY: Full fetch complete (77568 records). [2025-09-30T20:11:52.793595] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-30T20:11:53.060968] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-30T20:11:53.231063] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-30T20:11:53.231150] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-30T20:11:53.232214] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-30T20:11:53.232287] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-30T20:11:53.233892] [DEBUG] [LOCAL ] NLY: Trimmed 77568 records to 53581 (keeping 200 days of data) [2025-09-30T20:11:53.310051] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T20:11:53.340376] [INFO ] [REMOTE ] NMG: Full fetch complete (13298 records). [2025-09-30T20:11:53.341136] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-30T20:11:53.791687] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-30T20:11:53.792246] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-30T20:11:53.793172] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-30T20:11:53.793252] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-30T20:11:53.798398] [DEBUG] [LOCAL ] NMG: Trimmed 13298 records to 8131 (keeping 200 days of data) [2025-09-30T20:11:53.854970] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-30T20:11:53.860988] [DEBUG] [LOCAL ] NMG: Primary data saved (8131 records). [2025-09-30T20:11:53.861873] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-30T20:11:53.862750] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMG took 20.0s. Estimated remaining: 1h 52m 0s. Rate: 7.8 symbols/min [2025-09-30T20:11:54.163131] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:54.164029] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T20:11:54.190267] [DEBUG] [LOCAL ] NMM: Loaded 14289 existing records from primary storage. [2025-09-30T20:11:54.190789] [INFO ] [MAIN ] NMM: Loaded 14289 existing records. [2025-09-30T20:11:54.397174] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:54.399278] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-30T20:11:54.399430] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-30T20:11:54.400894] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-30T20:11:54.401446] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-30T20:11:54.511221] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T20:11:54.656685] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-30T20:11:54.894564] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:54.943693] [DEBUG] [LOCAL ] NLY: Primary data saved (53581 records). [2025-09-30T20:11:54.943857] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-30T20:11:54.943948] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NLY took 49.4s. Estimated remaining: 1h 51m 49s. Rate: 7.8 symbols/min [2025-09-30T20:11:55.114027] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T20:11:55.156170] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:11:55.194520] [DEBUG] [LOCAL ] NMR: Loaded 34961 existing records from primary storage. [2025-09-30T20:11:55.194862] [INFO ] [MAIN ] NMR: Loaded 34961 existing records. [2025-09-30T20:11:55.387619] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:11:55.387865] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-30T20:11:55.387921] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-30T20:11:55.388912] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-30T20:11:55.388975] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-30T20:11:55.459454] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-30T20:11:55.792298] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:11:56.090154] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T20:11:56.254372] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-30T20:11:56.829256] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T20:11:57.054355] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-30T20:11:57.854359] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-30T20:11:58.013680] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T20:11:58.654322] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-30T20:11:58.890388] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T20:11:59.454347] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-30T20:11:59.832791] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T20:11:59.837167] [INFO ] [REMOTE ] NMCO: Full fetch complete (24349 records). [2025-09-30T20:11:59.837267] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-30T20:12:00.247680] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-30T20:12:00.247773] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-30T20:12:00.248399] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-30T20:12:00.248464] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-30T20:12:00.249355] [DEBUG] [LOCAL ] NMCO: Trimmed 24349 records to 16715 (keeping 200 days of data) [2025-09-30T20:12:00.293861] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-30T20:12:00.362885] [DEBUG] [LOCAL ] NMCO: Primary data saved (16715 records). [2025-09-30T20:12:00.363045] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-30T20:12:00.363138] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMCO took 37.3s. Estimated remaining: 1h 51m 40s. Rate: 7.8 symbols/min [2025-09-30T20:12:00.565598] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:00.572196] [DEBUG] [LOCAL ] NMS: Loaded 2854 existing records from primary storage. [2025-09-30T20:12:00.572571] [INFO ] [MAIN ] NMS: Loaded 2854 existing records. [2025-09-30T20:12:00.816045] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:00.816515] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-30T20:12:00.817317] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-30T20:12:00.817523] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-30T20:12:00.817583] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-30T20:12:01.060206] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-30T20:12:01.102097] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T20:12:01.300748] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:01.302784] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T20:12:01.709818] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:12:01.854367] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-30T20:12:02.654389] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-30T20:12:02.894235] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T20:12:03.454402] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-30T20:12:04.006392] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T20:12:04.254383] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-30T20:12:04.514457] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T20:12:04.732418] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T20:12:05.054381] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-30T20:12:05.854377] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-30T20:12:06.157246] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T20:12:06.322759] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T20:12:06.654395] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-30T20:12:07.337624] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T20:12:07.454360] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-30T20:12:08.254363] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-30T20:12:08.386855] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T20:12:08.985895] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T20:12:09.054389] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-30T20:12:09.753851] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T20:12:09.755366] [INFO ] [REMOTE ] NMI: Full fetch complete (6113 records). [2025-09-30T20:12:09.755440] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-30T20:12:09.859561] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-30T20:12:10.162970] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-30T20:12:10.163055] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-30T20:12:10.163244] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-30T20:12:10.163285] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-30T20:12:10.163820] [DEBUG] [LOCAL ] NMI: Trimmed 6113 records to 4052 (keeping 200 days of data) [2025-09-30T20:12:10.189568] [DEBUG] [LOCAL ] NMI: Primary data saved (4052 records). [2025-09-30T20:12:10.189742] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-30T20:12:10.189842] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMI took 28.4s. Estimated remaining: 1h 51m 33s. Rate: 7.8 symbols/min [2025-09-30T20:12:10.374295] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:10.379895] [DEBUG] [LOCAL ] NMT: Loaded 2846 existing records from primary storage. [2025-09-30T20:12:10.380103] [INFO ] [MAIN ] NMT: Loaded 2846 existing records. [2025-09-30T20:12:10.574450] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:10.574733] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-30T20:12:10.574813] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-30T20:12:10.575028] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-30T20:12:10.575092] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-30T20:12:10.657187] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-30T20:12:10.899422] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:12:11.006783] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:11.096997] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T20:12:11.454352] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-30T20:12:12.254421] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-30T20:12:12.287242] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T20:12:12.868812] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T20:12:13.054377] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-30T20:12:13.528138] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T20:12:13.854396] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-30T20:12:14.469468] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T20:12:14.654395] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-30T20:12:15.149516] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T20:12:15.454355] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-30T20:12:16.110782] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T20:12:16.254369] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-30T20:12:16.941576] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T20:12:17.054372] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-30T20:12:17.810707] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T20:12:17.814366] [INFO ] [REMOTE ] NMM: Full fetch complete (22158 records). [2025-09-30T20:12:17.814503] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-30T20:12:17.859547] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-30T20:12:18.211859] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-30T20:12:18.211974] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-30T20:12:18.212532] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-30T20:12:18.212624] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-30T20:12:18.213327] [DEBUG] [LOCAL ] NMM: Trimmed 22158 records to 14348 (keeping 200 days of data) [2025-09-30T20:12:18.308077] [DEBUG] [LOCAL ] NMM: Primary data saved (14348 records). [2025-09-30T20:12:18.308276] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-30T20:12:18.308392] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMM took 24.4s. Estimated remaining: 1h 51m 26s. Rate: 7.8 symbols/min [2025-09-30T20:12:18.429874] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T20:12:18.509513] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:18.532693] [DEBUG] [LOCAL ] NMZ: Loaded 21748 existing records from primary storage. [2025-09-30T20:12:18.532963] [INFO ] [MAIN ] NMZ: Loaded 21748 existing records. [2025-09-30T20:12:18.659535] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-30T20:12:18.730624] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:18.731006] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-30T20:12:18.731056] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-30T20:12:18.731704] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-30T20:12:18.731765] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-30T20:12:19.139615] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:19.242043] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T20:12:19.454366] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-30T20:12:19.888490] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T20:12:20.254369] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-30T20:12:20.798334] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T20:12:21.054359] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-30T20:12:21.639750] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T20:12:21.641147] [INFO ] [REMOTE ] NMS: Full fetch complete (4035 records). [2025-09-30T20:12:21.641244] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-30T20:12:21.859520] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-30T20:12:22.032022] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-30T20:12:22.032117] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-30T20:12:22.032265] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-30T20:12:22.032305] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-30T20:12:22.032680] [DEBUG] [LOCAL ] NMS: Trimmed 4035 records to 2855 (keeping 200 days of data) [2025-09-30T20:12:22.050841] [DEBUG] [LOCAL ] NMS: Primary data saved (2855 records). [2025-09-30T20:12:22.050938] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-30T20:12:22.051015] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMS took 21.7s. Estimated remaining: 1h 51m 16s. Rate: 7.8 symbols/min [2025-09-30T20:12:22.244450] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:22.256494] [DEBUG] [LOCAL ] NNI: Loaded 10094 existing records from primary storage. [2025-09-30T20:12:22.256749] [INFO ] [MAIN ] NNI: Loaded 10094 existing records. [2025-09-30T20:12:22.448597] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:22.448837] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-30T20:12:22.448887] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-30T20:12:22.449300] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-30T20:12:22.449361] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-30T20:12:22.660536] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-30T20:12:22.854009] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:23.088690] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T20:12:23.089792] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T20:12:23.454404] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-30T20:12:24.254360] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-30T20:12:24.577327] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:12:25.054381] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-30T20:12:25.072464] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T20:12:25.637576] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-30T20:12:25.854359] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-30T20:12:26.463466] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T20:12:26.654390] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-30T20:12:27.454355] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-30T20:12:27.681937] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:12:27.808060] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-30T20:12:28.254344] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-30T20:12:29.054390] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-30T20:12:29.532964] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T20:12:29.620346] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T20:12:29.854357] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-30T20:12:30.333263] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T20:12:30.654367] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-30T20:12:31.048980] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T20:12:31.454393] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-30T20:12:32.160581] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T20:12:32.254389] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-30T20:12:32.719375] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T20:12:33.054358] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-30T20:12:33.854386] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-30T20:12:34.261097] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T20:12:34.654373] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-30T20:12:35.290586] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T20:12:35.459384] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-30T20:12:35.464439] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T20:12:36.101079] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T20:12:36.102589] [INFO ] [REMOTE ] NMT: Full fetch complete (4144 records). [2025-09-30T20:12:36.102693] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-30T20:12:36.259495] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-30T20:12:36.494956] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-30T20:12:36.495041] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-30T20:12:36.495202] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-30T20:12:36.495287] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-30T20:12:36.495707] [DEBUG] [LOCAL ] NMT: Trimmed 4144 records to 2851 (keeping 200 days of data) [2025-09-30T20:12:36.513466] [DEBUG] [LOCAL ] NMT: Primary data saved (2851 records). [2025-09-30T20:12:36.513565] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-30T20:12:36.513669] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMT took 26.3s. Estimated remaining: 1h 51m 12s. Rate: 7.8 symbols/min [2025-09-30T20:12:36.690600] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:36.747457] [DEBUG] [LOCAL ] NNN: Loaded 48364 existing records from primary storage. [2025-09-30T20:12:36.747857] [INFO ] [MAIN ] NNN: Loaded 48364 existing records. [2025-09-30T20:12:36.965780] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:36.966004] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-30T20:12:36.966054] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-30T20:12:36.966381] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-30T20:12:36.966472] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-30T20:12:37.064074] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-30T20:12:37.357249] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:37.370637] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:12:37.857212] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-30T20:12:37.858304] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T20:12:38.654383] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-30T20:12:38.911925] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T20:12:39.434194] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T20:12:39.454367] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-30T20:12:40.254366] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-30T20:12:40.410324] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T20:12:41.054338] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-30T20:12:41.304975] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T20:12:41.854360] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-30T20:12:42.622185] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T20:12:42.654316] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-30T20:12:43.073923] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T20:12:43.079168] [INFO ] [REMOTE ] NMZ: Full fetch complete (31983 records). [2025-09-30T20:12:43.079259] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-30T20:12:43.455057] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-30T20:12:43.490323] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-30T20:12:43.490423] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-30T20:12:43.491145] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-30T20:12:43.491210] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-30T20:12:43.492159] [DEBUG] [LOCAL ] NMZ: Trimmed 31983 records to 21758 (keeping 200 days of data) [2025-09-30T20:12:43.634908] [DEBUG] [LOCAL ] NMZ: Primary data saved (21758 records). [2025-09-30T20:12:43.635053] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-30T20:12:43.635137] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NMZ took 25.3s. Estimated remaining: 1h 51m 4s. Rate: 7.8 symbols/min [2025-09-30T20:12:43.815207] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:43.824217] [DEBUG] [LOCAL ] NNY: Loaded 5683 existing records from primary storage. [2025-09-30T20:12:43.824437] [INFO ] [MAIN ] NNY: Loaded 5683 existing records. [2025-09-30T20:12:44.016106] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:44.016323] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-30T20:12:44.016373] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-30T20:12:44.016570] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-30T20:12:44.016631] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-30T20:12:44.258842] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-30T20:12:44.414838] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:44.441799] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T20:12:45.054356] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-30T20:12:45.089070] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T20:12:45.158043] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:12:45.818802] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:12:45.854359] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-30T20:12:46.654355] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-30T20:12:47.256814] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T20:12:47.291876] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T20:12:47.454360] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-30T20:12:48.099216] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T20:12:48.254358] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-30T20:12:49.054405] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-30T20:12:49.292946] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:12:49.854390] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-30T20:12:49.975820] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:12:50.654387] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-30T20:12:51.011517] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T20:12:51.454348] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-30T20:12:51.482762] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T20:12:52.254373] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-30T20:12:53.054329] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-30T20:12:53.244776] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T20:12:53.551101] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T20:12:53.854357] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-30T20:12:54.154768] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T20:12:54.159481] [INFO ] [REMOTE ] NNI: Full fetch complete (12830 records). [2025-09-30T20:12:54.159684] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-30T20:12:54.498389] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:12:54.590290] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-30T20:12:54.590409] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-30T20:12:54.591134] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-30T20:12:54.591207] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-30T20:12:54.591911] [DEBUG] [LOCAL ] NNI: Trimmed 12830 records to 10155 (keeping 200 days of data) [2025-09-30T20:12:54.654578] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-30T20:12:54.666686] [DEBUG] [LOCAL ] NNI: Primary data saved (10155 records). [2025-09-30T20:12:54.666874] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-30T20:12:54.666980] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 32.6s. Estimated remaining: 1h 50m 58s. Rate: 7.8 symbols/min [2025-09-30T20:12:54.850468] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:54.871225] [DEBUG] [LOCAL ] NOA: Loaded 16234 existing records from primary storage. [2025-09-30T20:12:54.871496] [INFO ] [MAIN ] NOA: Loaded 16234 existing records. [2025-09-30T20:12:55.052791] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:55.053000] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-30T20:12:55.053047] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-30T20:12:55.053301] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-30T20:12:55.053360] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-30T20:12:55.439083] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:12:55.442230] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:12:55.454375] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-30T20:12:56.038437] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T20:12:56.254375] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-30T20:12:57.054355] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-30T20:12:57.854360] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-30T20:12:57.954559] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T20:12:58.274449] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T20:12:58.282819] [INFO ] [REMOTE ] NMR: Full fetch complete (50432 records). [2025-09-30T20:12:58.282967] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-30T20:12:58.579524] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T20:12:58.659482] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-30T20:12:58.712273] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-30T20:12:58.712364] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-30T20:12:58.713276] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-30T20:12:58.713344] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-30T20:12:58.714666] [DEBUG] [LOCAL ] NMR: Trimmed 50432 records to 34990 (keeping 200 days of data) [2025-09-30T20:12:58.922609] [DEBUG] [LOCAL ] NMR: Primary data saved (34990 records). [2025-09-30T20:12:58.922799] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-30T20:12:58.922937] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NMR took 1m 4s. Estimated remaining: 1h 50m 49s. Rate: 7.8 symbols/min [2025-09-30T20:12:59.104703] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:12:59.127910] [DEBUG] [LOCAL ] NOAH: Loaded 20185 existing records from primary storage. [2025-09-30T20:12:59.128256] [INFO ] [MAIN ] NOAH: Loaded 20185 existing records. [2025-09-30T20:12:59.314596] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:12:59.314882] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-30T20:12:59.314932] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-30T20:12:59.315396] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-30T20:12:59.315454] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-30T20:12:59.463208] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-30T20:12:59.622615] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T20:12:59.715176] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:00.254347] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-30T20:13:01.054382] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-30T20:13:01.310157] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T20:13:01.602329] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T20:13:01.854340] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-30T20:13:01.864291] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T20:13:02.654380] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-30T20:13:03.278760] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T20:13:03.454347] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-30T20:13:03.600035] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T20:13:04.247274] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T20:13:04.249463] [INFO ] [REMOTE ] NNY: Full fetch complete (8838 records). [2025-09-30T20:13:04.249542] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-30T20:13:04.261448] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-30T20:13:04.669717] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-30T20:13:04.669815] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-30T20:13:04.670100] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-30T20:13:04.670150] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-30T20:13:04.670721] [DEBUG] [LOCAL ] NNY: Trimmed 8838 records to 5692 (keeping 200 days of data) [2025-09-30T20:13:04.717302] [DEBUG] [LOCAL ] NNY: Primary data saved (5692 records). [2025-09-30T20:13:04.717418] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-30T20:13:04.717506] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NNY took 21.1s. Estimated remaining: 1h 50m 40s. Rate: 7.8 symbols/min [2025-09-30T20:13:04.902042] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:04.951156] [DEBUG] [LOCAL ] NOC: Loaded 42285 existing records from primary storage. [2025-09-30T20:13:04.951496] [INFO ] [MAIN ] NOC: Loaded 42285 existing records. [2025-09-30T20:13:05.059593] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-30T20:13:05.157050] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:05.157322] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-30T20:13:05.157371] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-30T20:13:05.157700] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-30T20:13:05.157766] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-30T20:13:05.556912] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:05.854355] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-30T20:13:05.933493] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T20:13:05.993182] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T20:13:06.654386] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-30T20:13:06.792536] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:13:07.454405] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-30T20:13:07.497563] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T20:13:08.254383] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-30T20:13:09.029910] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T20:13:09.054311] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-30T20:13:09.167126] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:13:09.854363] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-30T20:13:10.654354] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-30T20:13:10.794327] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T20:13:10.866110] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T20:13:11.454364] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-30T20:13:11.658321] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T20:13:12.254405] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-30T20:13:13.054323] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-30T20:13:13.166182] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T20:13:13.854414] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-30T20:13:14.053749] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T20:13:14.087761] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T20:13:14.654397] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-30T20:13:15.454353] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-30T20:13:15.644186] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T20:13:16.254326] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-30T20:13:16.322149] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T20:13:16.447075] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T20:13:17.054392] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-30T20:13:17.854347] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-30T20:13:17.983291] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T20:13:18.157729] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T20:13:18.654377] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-30T20:13:19.324576] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T20:13:19.335104] [INFO ] [REMOTE ] NNN: Full fetch complete (70267 records). [2025-09-30T20:13:19.335312] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-30T20:13:19.455909] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-30T20:13:19.513700] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:13:19.777549] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-30T20:13:19.777660] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-30T20:13:19.779027] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-30T20:13:19.779102] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-30T20:13:19.780557] [DEBUG] [LOCAL ] NNN: Trimmed 70267 records to 48365 (keeping 200 days of data) [2025-09-30T20:13:20.102543] [DEBUG] [LOCAL ] NNN: Primary data saved (48365 records). [2025-09-30T20:13:20.102711] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-30T20:13:20.102894] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NNN took 43.6s. Estimated remaining: 1h 50m 36s. Rate: 7.8 symbols/min [2025-09-30T20:13:20.259532] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-30T20:13:20.285506] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:20.346425] [DEBUG] [LOCAL ] NOG: Loaded 51168 existing records from primary storage. [2025-09-30T20:13:20.346859] [INFO ] [MAIN ] NOG: Loaded 51168 existing records. [2025-09-30T20:13:20.491431] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:13:20.581709] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:20.582021] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-30T20:13:20.582096] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-30T20:13:20.582609] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-30T20:13:20.582737] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-30T20:13:20.989242] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:21.054337] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-30T20:13:21.421627] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T20:13:21.854391] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-30T20:13:22.654345] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-30T20:13:22.756685] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T20:13:22.783187] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T20:13:23.454416] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-30T20:13:23.654167] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T20:13:24.254376] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-30T20:13:25.054464] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-30T20:13:25.148768] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T20:13:25.618579] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T20:13:25.854402] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-30T20:13:25.894480] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T20:13:26.654373] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-30T20:13:27.454375] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-30T20:13:27.472853] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T20:13:27.476731] [INFO ] [REMOTE ] NOA: Full fetch complete (21852 records). [2025-09-30T20:13:27.476852] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-30T20:13:27.770597] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T20:13:27.924137] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-30T20:13:27.924222] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-30T20:13:27.924766] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-30T20:13:27.924834] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-30T20:13:27.925567] [DEBUG] [LOCAL ] NOA: Trimmed 21852 records to 16200 (keeping 200 days of data) [2025-09-30T20:13:28.030875] [DEBUG] [LOCAL ] NOA: Primary data saved (16200 records). [2025-09-30T20:13:28.031083] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-30T20:13:28.031194] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOA took 33.4s. Estimated remaining: 1h 50m 29s. Rate: 7.8 symbols/min [2025-09-30T20:13:28.228451] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:28.254401] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-30T20:13:28.294130] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-30T20:13:28.294498] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-09-30T20:13:28.485616] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:28.485892] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-30T20:13:28.485976] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-30T20:13:28.486549] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-30T20:13:28.486613] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-30T20:13:28.880076] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:29.054417] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-30T20:13:29.190668] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T20:13:29.232956] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T20:13:29.854358] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-30T20:13:30.654355] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-30T20:13:31.002604] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T20:13:31.454341] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-30T20:13:31.668680] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T20:13:32.189103] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T20:13:32.254307] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-30T20:13:33.054362] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-30T20:13:33.589793] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-30T20:13:33.854341] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-30T20:13:34.053525] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:13:34.179724] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T20:13:34.654379] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-30T20:13:35.454361] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-30T20:13:35.898259] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T20:13:36.254368] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-30T20:13:36.368195] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T20:13:36.376288] [INFO ] [REMOTE ] NOC: Full fetch complete (61991 records). [2025-09-30T20:13:36.376420] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-30T20:13:36.810193] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-30T20:13:36.810302] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-30T20:13:36.811523] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-30T20:13:36.811600] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-30T20:13:36.813015] [DEBUG] [LOCAL ] NOC: Trimmed 61991 records to 42237 (keeping 200 days of data) [2025-09-30T20:13:37.054539] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-30T20:13:37.100106] [DEBUG] [LOCAL ] NOC: Primary data saved (42237 records). [2025-09-30T20:13:37.100253] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-30T20:13:37.100345] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOC took 32.4s. Estimated remaining: 1h 50m 22s. Rate: 7.8 symbols/min [2025-09-30T20:13:37.288265] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T20:13:37.326799] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:37.327685] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-30T20:13:37.327749] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-30T20:13:37.327878] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-30T20:13:37.327954] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-30T20:13:37.328020] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-30T20:13:37.328057] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-30T20:13:37.632721] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T20:13:37.651060] [INFO ] [REMOTE ] NOAH: Full fetch complete (28597 records). [2025-09-30T20:13:37.672076] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-30T20:13:37.825483] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:37.859500] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-30T20:13:38.201060] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-30T20:13:38.201199] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-30T20:13:38.202028] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-30T20:13:38.202094] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-30T20:13:38.202990] [DEBUG] [LOCAL ] NOAH: Trimmed 28597 records to 20279 (keeping 200 days of data) [2025-09-30T20:13:38.337972] [DEBUG] [LOCAL ] NOAH: Primary data saved (20279 records). [2025-09-30T20:13:38.338130] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-30T20:13:38.338238] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOAH took 39.4s. Estimated remaining: 1h 50m 11s. Rate: 7.8 symbols/min [2025-09-30T20:13:38.531846] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:38.585138] [DEBUG] [LOCAL ] NOMD: Loaded 41391 existing records from primary storage. [2025-09-30T20:13:38.585440] [INFO ] [MAIN ] NOMD: Loaded 41391 existing records. [2025-09-30T20:13:38.659759] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-30T20:13:38.802261] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:38.802468] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-30T20:13:38.802518] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-30T20:13:38.802967] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-30T20:13:38.803027] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-30T20:13:39.205665] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:39.209400] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T20:13:39.307019] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-30T20:13:39.454315] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-30T20:13:39.639681] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T20:13:39.814525] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-30T20:13:40.254363] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-30T20:13:41.054391] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-30T20:13:41.808553] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:13:41.854419] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-30T20:13:42.484513] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:13:42.654366] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-30T20:13:43.122969] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T20:13:43.184604] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T20:13:43.454346] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-30T20:13:43.853417] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T20:13:44.254375] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-30T20:13:45.054383] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-30T20:13:45.854417] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-30T20:13:46.455262] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T20:13:46.461694] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-30T20:13:46.533184] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:13:46.654366] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-30T20:13:47.454352] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-30T20:13:47.667178] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:13:48.254358] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-30T20:13:49.054424] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-30T20:13:49.547048] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T20:13:49.581154] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T20:13:49.811602] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T20:13:49.826776] [INFO ] [REMOTE ] NOG: Full fetch complete (73813 records). [2025-09-30T20:13:49.826906] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-30T20:13:49.859462] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-30T20:13:50.311391] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-30T20:13:50.311213] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T20:13:50.312738] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-30T20:13:50.313869] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-30T20:13:50.313960] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-30T20:13:50.315396] [DEBUG] [LOCAL ] NOG: Trimmed 73813 records to 51183 (keeping 200 days of data) [2025-09-30T20:13:50.654442] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-30T20:13:50.656823] [DEBUG] [LOCAL ] NOG: Primary data saved (51183 records). [2025-09-30T20:13:50.658359] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-30T20:13:50.658487] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOG took 30.6s. Estimated remaining: 1h 50m 6s. Rate: 7.8 symbols/min [2025-09-30T20:13:50.856900] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:50.903104] [DEBUG] [LOCAL ] NOTE: Loaded 42302 existing records from primary storage. [2025-09-30T20:13:50.903543] [INFO ] [MAIN ] NOTE: Loaded 42302 existing records. [2025-09-30T20:13:51.095477] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:51.095895] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-30T20:13:51.095955] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-30T20:13:51.096803] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-30T20:13:51.096881] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-30T20:13:51.459128] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-30T20:13:51.483555] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:52.188510] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T20:13:52.219591] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T20:13:52.254354] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-30T20:13:52.679332] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T20:13:53.054397] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-30T20:13:53.854548] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-30T20:13:54.641553] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T20:13:54.654319] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-30T20:13:55.454357] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-30T20:13:55.859173] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T20:13:55.948098] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T20:13:56.254367] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-30T20:13:57.054342] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-30T20:13:57.377508] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T20:13:57.460270] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T20:13:57.582599] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T20:13:57.583612] [INFO ] [REMOTE ] NOM: Full fetch complete (1613 records). [2025-09-30T20:13:57.583732] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-30T20:13:57.783753] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-30T20:13:57.783973] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:13:57.784045] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:13:57.784118] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-30T20:13:57.784185] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-30T20:13:57.784223] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-30T20:13:57.784278] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-30T20:13:57.784360] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOM took 20.7s. Estimated remaining: 1h 49m 58s. Rate: 7.8 symbols/min [2025-09-30T20:13:57.859565] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-30T20:13:57.972113] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:13:58.040519] [DEBUG] [LOCAL ] NOV: Loaded 53181 existing records from primary storage. [2025-09-30T20:13:58.040880] [INFO ] [MAIN ] NOV: Loaded 53181 existing records. [2025-09-30T20:13:58.226905] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:13:58.227143] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-30T20:13:58.227190] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-30T20:13:58.228179] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-30T20:13:58.228240] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-30T20:13:58.611618] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:13:58.654359] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-30T20:13:59.454361] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-30T20:14:00.254388] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-30T20:14:00.312558] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-30T20:14:00.389983] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T20:14:01.054353] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-30T20:14:01.372004] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T20:14:01.791556] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T20:14:01.854403] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-30T20:14:02.654324] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-30T20:14:02.915848] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T20:14:03.454350] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-30T20:14:03.524259] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T20:14:04.148189] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T20:14:04.254343] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-30T20:14:05.054380] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-30T20:14:05.784396] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-30T20:14:05.796698] [INFO ] [REMOTE ] NOK: Full fetch complete (77636 records). [2025-09-30T20:14:05.797097] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-30T20:14:05.867676] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-30T20:14:06.282264] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-30T20:14:06.282552] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-30T20:14:06.283901] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-30T20:14:06.284488] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-30T20:14:06.285979] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T20:14:06.297756] [INFO ] [REMOTE ] NOMD: Full fetch complete (59052 records). [2025-09-30T20:14:06.298298] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-30T20:14:06.298602] [DEBUG] [LOCAL ] NOK: Trimmed 77636 records to 53621 (keeping 200 days of data) [2025-09-30T20:14:06.846366] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-30T20:14:06.847689] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-30T20:14:06.849563] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-30T20:14:06.850292] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-30T20:14:06.882857] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T20:14:06.881791] [DEBUG] [LOCAL ] NOMD: Trimmed 59052 records to 41446 (keeping 200 days of data) [2025-09-30T20:14:06.896472] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-30T20:14:07.373543] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-09-30T20:14:07.375711] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-30T20:14:07.375856] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOK took 39.3s. Estimated remaining: 1h 49m 51s. Rate: 7.8 symbols/min [2025-09-30T20:14:07.498030] [DEBUG] [LOCAL ] NOMD: Primary data saved (41446 records). [2025-09-30T20:14:07.502356] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-30T20:14:07.502508] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOMD took 29.2s. Estimated remaining: 1h 49m 39s. Rate: 7.8 symbols/min [2025-09-30T20:14:07.638059] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:07.784246] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:07.784553] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-30T20:14:07.784673] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-30T20:14:07.784900] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-30T20:14:07.794482] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-30T20:14:07.810967] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-30T20:14:07.811243] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-30T20:14:07.871226] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T20:14:07.992871] [DEBUG] [LOCAL ] NOW: Loaded 48581 existing records from primary storage. [2025-09-30T20:14:07.976339] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-30T20:14:08.034785] [INFO ] [MAIN ] NOW: Loaded 48581 existing records. [2025-09-30T20:14:08.446917] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:08.471005] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-30T20:14:08.470465] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:08.472592] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-30T20:14:08.472697] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-30T20:14:08.473272] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-30T20:14:08.473336] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-30T20:14:08.791003] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:14:08.804387] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-30T20:14:08.830241] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:14:08.834603] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-30T20:14:08.861437] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:14:08.861923] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-30T20:14:08.878451] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-30T20:14:08.878566] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-30T20:14:08.884021] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-30T20:14:08.889920] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NPB took 1.4s. Estimated remaining: 1h 49m 28s. Rate: 7.8 symbols/min [2025-09-30T20:14:08.929691] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:09.066346] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-30T20:14:09.115370] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-30T20:14:09.209224] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:09.232747] [DEBUG] [LOCAL ] NPCT: Loaded 16956 existing records from primary storage. [2025-09-30T20:14:09.233030] [INFO ] [MAIN ] NPCT: Loaded 16956 existing records. [2025-09-30T20:14:09.431300] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:09.431603] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-30T20:14:09.431687] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-30T20:14:09.432130] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-30T20:14:09.432191] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-30T20:14:09.841600] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:09.859517] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-30T20:14:09.873089] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T20:14:10.654381] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-30T20:14:11.115376] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-30T20:14:11.221849] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T20:14:11.454363] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-30T20:14:11.567043] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T20:14:12.254397] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-30T20:14:13.054329] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-30T20:14:13.284621] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T20:14:13.404230] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T20:14:13.854380] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-30T20:14:14.654381] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-30T20:14:14.815865] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T20:14:14.913345] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T20:14:15.454363] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-30T20:14:15.481174] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:14:16.254382] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-30T20:14:17.054353] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-30T20:14:17.173430] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T20:14:17.228761] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T20:14:17.854371] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-30T20:14:18.637694] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T20:14:18.654307] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-30T20:14:18.896833] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T20:14:19.454370] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-30T20:14:20.254335] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-30T20:14:20.478937] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T20:14:20.723945] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-30T20:14:21.054367] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-30T20:14:21.809418] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T20:14:21.854383] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-30T20:14:22.654395] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-30T20:14:23.283331] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T20:14:23.376049] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-30T20:14:23.454367] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-30T20:14:24.254391] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-30T20:14:24.431330] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T20:14:25.054348] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-30T20:14:25.369766] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T20:14:25.854383] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-30T20:14:26.352699] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T20:14:26.654419] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-30T20:14:26.797988] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T20:14:27.449113] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T20:14:27.459579] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-30T20:14:27.875105] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T20:14:28.254380] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-30T20:14:28.874070] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T20:14:28.880735] [INFO ] [REMOTE ] NOTE: Full fetch complete (63873 records). [2025-09-30T20:14:28.880962] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-30T20:14:29.060684] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-30T20:14:29.314339] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-30T20:14:29.314429] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-30T20:14:29.315490] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-30T20:14:29.315586] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-30T20:14:29.316996] [DEBUG] [LOCAL ] NOTE: Trimmed 63873 records to 42067 (keeping 200 days of data) [2025-09-30T20:14:29.573957] [DEBUG] [LOCAL ] NOTE: Primary data saved (42067 records). [2025-09-30T20:14:29.574089] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-30T20:14:29.574171] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOTE took 38.9s. Estimated remaining: 1h 49m 27s. Rate: 7.8 symbols/min [2025-09-30T20:14:29.854330] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-30T20:14:30.167979] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T20:14:30.210271] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T20:14:30.225070] [INFO ] [REMOTE ] NOV: Full fetch complete (76992 records). [2025-09-30T20:14:30.225269] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-30T20:14:30.665189] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-30T20:14:30.697159] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-30T20:14:30.697247] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-30T20:14:30.698543] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-30T20:14:30.698668] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-30T20:14:30.700606] [DEBUG] [LOCAL ] NOV: Trimmed 76992 records to 53180 (keeping 200 days of data) [2025-09-30T20:14:31.127956] [DEBUG] [LOCAL ] NOV: Primary data saved (53180 records). [2025-09-30T20:14:31.128161] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-30T20:14:31.128323] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOV took 33.3s. Estimated remaining: 1h 49m 16s. Rate: 7.8 symbols/min [2025-09-30T20:14:31.537252] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T20:14:31.546727] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-30T20:14:31.689497] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T20:14:32.254366] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-30T20:14:33.372605] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T20:14:33.377545] [INFO ] [REMOTE ] NPCT: Full fetch complete (25299 records). [2025-09-30T20:14:33.377782] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-30T20:14:33.779486] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-30T20:14:33.779666] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-30T20:14:33.780829] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-30T20:14:33.781002] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-30T20:14:33.797773] [DEBUG] [LOCAL ] NPCT: Trimmed 25299 records to 16978 (keeping 200 days of data) [2025-09-30T20:14:33.813838] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-30T20:14:33.889850] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-30T20:14:33.948522] [DEBUG] [LOCAL ] NPCT: Primary data saved (16978 records). [2025-09-30T20:14:33.948712] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-30T20:14:33.948815] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPCT took 25.1s. Estimated remaining: 1h 49m 6s. Rate: 7.8 symbols/min [2025-09-30T20:14:36.052901] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T20:14:36.064972] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-30T20:14:38.166924] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T20:14:38.180255] [INFO ] [REMOTE ] NOW: Full fetch complete (70712 records). [2025-09-30T20:14:38.180456] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-30T20:14:38.847235] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-30T20:14:38.847326] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-30T20:14:38.848487] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-30T20:14:38.848584] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-30T20:14:38.850459] [DEBUG] [LOCAL ] NOW: Trimmed 70712 records to 48554 (keeping 200 days of data) [2025-09-30T20:14:39.187185] [DEBUG] [LOCAL ] NOW: Primary data saved (48554 records). [2025-09-30T20:14:39.187332] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-30T20:14:39.187445] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NOW took 31.8s. Estimated remaining: 1h 48m 57s. Rate: 7.8 symbols/min [2025-09-30T20:14:39.938822] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:39.927585] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:39.962078] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:39.987219] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:39.987516] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-30T20:14:39.988040] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-30T20:14:39.988160] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-30T20:14:39.988203] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-30T20:14:39.988243] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-30T20:14:39.988274] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-30T20:14:40.103475] [DEBUG] [LOCAL ] NPK: Loaded 7996 existing records from primary storage. [2025-09-30T20:14:40.128839] [DEBUG] [LOCAL ] NPO: Loaded 12875 existing records from primary storage. [2025-09-30T20:14:40.129069] [INFO ] [MAIN ] NPO: Loaded 12875 existing records. [2025-09-30T20:14:40.128351] [INFO ] [MAIN ] NPK: Loaded 7996 existing records. [2025-09-30T20:14:40.206378] [DEBUG] [LOCAL ] NPFD: Loaded 9726 existing records from primary storage. [2025-09-30T20:14:40.278246] [INFO ] [MAIN ] NPFD: Loaded 9726 existing records. [2025-09-30T20:14:40.885627] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:40.984560] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:40.992768] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-30T20:14:41.016745] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:41.037330] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:41.037493] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-30T20:14:41.038025] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-30T20:14:41.037614] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-30T20:14:41.037974] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-30T20:14:41.037889] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-30T20:14:41.038336] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-30T20:14:41.038556] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-30T20:14:41.038609] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-30T20:14:41.038707] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-30T20:14:41.039718] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-30T20:14:41.039838] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-30T20:14:41.039943] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-30T20:14:42.160832] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:42.212357] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-30T20:14:42.212047] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T20:14:42.249542] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:42.283294] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-30T20:14:42.283551] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-30T20:14:42.282754] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:42.285484] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-30T20:14:42.925905] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T20:14:42.930123] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-30T20:14:43.026753] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T20:14:43.029056] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-30T20:14:43.372974] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:14:43.376822] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-30T20:14:43.612333] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T20:14:43.613334] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:14:43.624730] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-30T20:14:43.625124] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-30T20:14:43.683772] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T20:14:43.686419] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-30T20:14:44.181093] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T20:14:44.184218] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-30T20:14:44.240841] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T20:14:44.254310] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-30T20:14:44.426035] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T20:14:44.600765] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T20:14:44.852046] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T20:14:44.926818] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T20:14:45.054380] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-30T20:14:45.854380] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-30T20:14:45.920763] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:14:46.629366] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T20:14:46.654370] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-30T20:14:47.249455] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:14:47.454332] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-30T20:14:48.008370] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T20:14:48.254368] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-30T20:14:49.021789] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T20:14:49.054350] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-30T20:14:49.854375] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-30T20:14:49.973874] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:14:50.654403] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-30T20:14:50.765133] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T20:14:51.029002] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T20:14:51.454361] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-30T20:14:52.254387] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-30T20:14:52.386390] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:14:53.054343] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-30T20:14:53.272034] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T20:14:53.854409] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-30T20:14:53.937889] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T20:14:54.583371] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T20:14:54.654365] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-30T20:14:55.294539] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T20:14:55.296433] [INFO ] [REMOTE ] NPK: Full fetch complete (10819 records). [2025-09-30T20:14:55.296508] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-30T20:14:55.459525] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-30T20:14:55.703683] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-30T20:14:55.703777] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-30T20:14:55.704068] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-30T20:14:55.704111] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-30T20:14:55.704605] [DEBUG] [LOCAL ] NPK: Trimmed 10819 records to 8008 (keeping 200 days of data) [2025-09-30T20:14:55.754588] [DEBUG] [LOCAL ] NPK: Primary data saved (8008 records). [2025-09-30T20:14:55.754794] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-30T20:14:55.754888] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPK took 16.6s. Estimated remaining: 1h 48m 54s. Rate: 7.8 symbols/min [2025-09-30T20:14:55.955140] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:14:55.963471] [DEBUG] [LOCAL ] NPV: Loaded 5045 existing records from primary storage. [2025-09-30T20:14:55.963730] [INFO ] [MAIN ] NPV: Loaded 5045 existing records. [2025-09-30T20:14:56.145917] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T20:14:56.171811] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:14:56.172033] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-30T20:14:56.172083] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-30T20:14:56.172430] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-30T20:14:56.172519] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-30T20:14:56.259559] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-30T20:14:56.571800] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:14:57.054364] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-30T20:14:57.664743] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:14:57.795004] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T20:14:57.854336] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-30T20:14:58.660284] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-30T20:14:58.664881] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T20:14:59.454366] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-30T20:14:59.659029] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T20:14:59.662066] [INFO ] [REMOTE ] NPFD: Full fetch complete (14865 records). [2025-09-30T20:14:59.662176] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-30T20:15:00.052076] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-30T20:15:00.055936] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-30T20:15:00.056296] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-30T20:15:00.056435] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T20:15:00.056591] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-30T20:15:00.058780] [DEBUG] [LOCAL ] NPFD: Trimmed 14865 records to 9812 (keeping 200 days of data) [2025-09-30T20:15:00.122457] [DEBUG] [LOCAL ] NPFD: Primary data saved (9812 records). [2025-09-30T20:15:00.122601] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-30T20:15:00.122741] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPFD took 20.9s. Estimated remaining: 1h 48m 45s. Rate: 7.8 symbols/min [2025-09-30T20:15:00.259483] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-30T20:15:00.321043] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:00.366535] [DEBUG] [LOCAL ] NPWR: Loaded 43014 existing records from primary storage. [2025-09-30T20:15:00.366934] [INFO ] [MAIN ] NPWR: Loaded 43014 existing records. [2025-09-30T20:15:00.566592] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:00.566862] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-30T20:15:00.566914] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-30T20:15:00.567362] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-30T20:15:00.567423] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-30T20:15:00.956234] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:01.054411] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-30T20:15:01.302896] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T20:15:01.854348] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-30T20:15:01.880639] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T20:15:02.654410] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-30T20:15:03.363070] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T20:15:03.423557] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T20:15:03.454318] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-30T20:15:04.254412] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-30T20:15:04.620382] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T20:15:04.623919] [INFO ] [REMOTE ] NPO: Full fetch complete (18020 records). [2025-09-30T20:15:04.624002] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-30T20:15:05.035341] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-30T20:15:05.035423] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-30T20:15:05.035880] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-30T20:15:05.035943] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-30T20:15:05.036709] [DEBUG] [LOCAL ] NPO: Trimmed 18020 records to 12939 (keeping 200 days of data) [2025-09-30T20:15:05.075470] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-30T20:15:05.126212] [DEBUG] [LOCAL ] NPO: Primary data saved (12939 records). [2025-09-30T20:15:05.126350] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-30T20:15:05.126436] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 25.9s. Estimated remaining: 1h 48m 35s. Rate: 7.8 symbols/min [2025-09-30T20:15:05.318988] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:05.332099] [DEBUG] [LOCAL ] NQP: Loaded 9279 existing records from primary storage. [2025-09-30T20:15:05.332336] [INFO ] [MAIN ] NQP: Loaded 9279 existing records. [2025-09-30T20:15:05.525759] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:05.526033] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-30T20:15:05.526093] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-30T20:15:05.526388] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-30T20:15:05.526448] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-30T20:15:05.709805] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T20:15:05.859145] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-30T20:15:05.970397] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T20:15:05.976878] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:06.654405] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-30T20:15:07.454377] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-30T20:15:07.689337] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T20:15:08.133089] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T20:15:08.156057] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T20:15:08.254368] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-30T20:15:09.054404] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-30T20:15:09.733495] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T20:15:09.854371] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-30T20:15:09.960952] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T20:15:10.654420] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-30T20:15:11.285947] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T20:15:11.406578] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:15:11.454371] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-30T20:15:12.254378] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-30T20:15:12.703706] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:15:13.054373] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-30T20:15:13.497246] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T20:15:13.785062] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T20:15:13.854334] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-30T20:15:14.654330] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-30T20:15:15.454417] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-30T20:15:15.459287] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:15:15.467764] [INFO ] [REMOTE ] NPKI: Full fetch complete (53972 records). [2025-09-30T20:15:15.467961] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-30T20:15:15.683969] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-30T20:15:15.684927] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:15:15.685028] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:15:15.685125] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-30T20:15:15.685223] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-30T20:15:15.685285] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-30T20:15:15.685373] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-30T20:15:15.685508] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPKI took 36.5s. Estimated remaining: 1h 48m 29s. Rate: 7.8 symbols/min [2025-09-30T20:15:15.876951] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:15.917234] [DEBUG] [LOCAL ] NRDY: Loaded 32658 existing records from primary storage. [2025-09-30T20:15:15.917544] [INFO ] [MAIN ] NRDY: Loaded 32658 existing records. [2025-09-30T20:15:16.123205] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:16.123757] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-30T20:15:16.123832] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-30T20:15:16.124459] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-30T20:15:16.124521] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-30T20:15:16.256882] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-30T20:15:16.260708] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T20:15:16.592164] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:16.594091] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T20:15:16.878231] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T20:15:17.054410] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-30T20:15:17.708391] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T20:15:17.854351] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-30T20:15:18.654375] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-30T20:15:18.671127] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:15:19.454389] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-30T20:15:20.058081] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:15:20.254392] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-30T20:15:20.865168] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T20:15:21.029815] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T20:15:21.054379] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-30T20:15:21.656454] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T20:15:21.854404] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-30T20:15:22.655727] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-30T20:15:22.658479] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T20:15:22.660833] [INFO ] [REMOTE ] NPV: Full fetch complete (6956 records). [2025-09-30T20:15:22.660922] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-30T20:15:23.072869] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-30T20:15:23.072957] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-30T20:15:23.073145] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-30T20:15:23.073184] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-30T20:15:23.073583] [DEBUG] [LOCAL ] NPV: Trimmed 6956 records to 5075 (keeping 200 days of data) [2025-09-30T20:15:23.105077] [DEBUG] [LOCAL ] NPV: Primary data saved (5075 records). [2025-09-30T20:15:23.105209] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-30T20:15:23.105331] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPV took 27.4s. Estimated remaining: 1h 48m 21s. Rate: 7.8 symbols/min [2025-09-30T20:15:23.281459] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:23.293182] [DEBUG] [LOCAL ] NREF: Loaded 7859 existing records from primary storage. [2025-09-30T20:15:23.293409] [INFO ] [MAIN ] NREF: Loaded 7859 existing records. [2025-09-30T20:15:23.456004] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-30T20:15:23.488952] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:23.489210] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-30T20:15:23.489263] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-30T20:15:23.489572] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-30T20:15:23.489632] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-30T20:15:23.923476] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:24.137307] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:15:24.254347] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-30T20:15:24.821680] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:15:25.054373] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-30T20:15:25.443528] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T20:15:25.842460] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:15:25.854314] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-30T20:15:26.584250] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T20:15:26.654427] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-30T20:15:27.403216] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T20:15:27.454392] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-30T20:15:28.254390] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-30T20:15:29.054380] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-30T20:15:29.175904] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T20:15:29.725004] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T20:15:29.845111] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T20:15:29.854306] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-30T20:15:30.654395] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-30T20:15:30.740223] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T20:15:31.454455] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-30T20:15:32.189778] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T20:15:32.254330] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-30T20:15:32.374219] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T20:15:32.656524] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-30T20:15:33.054392] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-30T20:15:33.854367] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-30T20:15:33.947119] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:15:33.950778] [INFO ] [REMOTE ] NQP: Full fetch complete (13509 records). [2025-09-30T20:15:33.950903] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-30T20:15:34.379812] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-30T20:15:34.379904] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-30T20:15:34.380255] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-30T20:15:34.380318] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-30T20:15:34.380886] [DEBUG] [LOCAL ] NQP: Trimmed 13509 records to 9297 (keeping 200 days of data) [2025-09-30T20:15:34.444461] [DEBUG] [LOCAL ] NQP: Primary data saved (9297 records). [2025-09-30T20:15:34.444609] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-30T20:15:34.444772] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NQP took 29.3s. Estimated remaining: 1h 48m 16s. Rate: 7.8 symbols/min [2025-09-30T20:15:34.640694] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:34.640898] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-30T20:15:34.640946] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-30T20:15:34.641116] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-30T20:15:34.641188] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-30T20:15:34.641254] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-30T20:15:34.641315] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-30T20:15:34.663324] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-30T20:15:35.059093] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:35.432944] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T20:15:35.454308] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-30T20:15:36.156389] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T20:15:36.254352] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-30T20:15:37.054340] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-30T20:15:37.085094] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T20:15:37.093852] [INFO ] [REMOTE ] NPWR: Full fetch complete (59298 records). [2025-09-30T20:15:37.094005] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-30T20:15:37.541589] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-30T20:15:37.541776] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-30T20:15:37.542795] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-30T20:15:37.542862] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-30T20:15:37.544211] [DEBUG] [LOCAL ] NPWR: Trimmed 59298 records to 42966 (keeping 200 days of data) [2025-09-30T20:15:37.651167] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T20:15:37.691492] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T20:15:37.854956] [DEBUG] [LOCAL ] NPWR: Primary data saved (42966 records). [2025-09-30T20:15:37.855099] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-30T20:15:37.854708] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-30T20:15:37.856274] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NPWR took 37.7s. Estimated remaining: 1h 48m 6s. Rate: 7.8 symbols/min [2025-09-30T20:15:38.044872] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:38.090183] [DEBUG] [LOCAL ] NRGV: Loaded 43174 existing records from primary storage. [2025-09-30T20:15:38.090548] [INFO ] [MAIN ] NRGV: Loaded 43174 existing records. [2025-09-30T20:15:38.337119] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:38.337332] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-30T20:15:38.337379] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-30T20:15:38.337759] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-30T20:15:38.337818] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-30T20:15:38.659442] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-30T20:15:38.717382] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:15:38.740456] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:39.454362] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-30T20:15:40.190364] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T20:15:40.191757] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T20:15:40.254318] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-30T20:15:41.054361] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-30T20:15:41.651836] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:15:41.854420] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-30T20:15:41.905942] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T20:15:42.654372] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-30T20:15:42.820313] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T20:15:43.454398] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-30T20:15:44.165402] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T20:15:44.254361] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-30T20:15:44.439953] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T20:15:45.054407] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-30T20:15:45.648879] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T20:15:45.854369] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-30T20:15:46.400858] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T20:15:46.654379] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-30T20:15:47.454405] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-30T20:15:47.602786] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T20:15:48.001310] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T20:15:48.009218] [INFO ] [REMOTE ] NRDY: Full fetch complete (51800 records). [2025-09-30T20:15:48.009397] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-30T20:15:48.259825] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-30T20:15:48.328395] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T20:15:48.442235] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-30T20:15:48.442315] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-30T20:15:48.443170] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-30T20:15:48.443237] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-30T20:15:48.444347] [DEBUG] [LOCAL ] NRDY: Trimmed 51800 records to 32735 (keeping 200 days of data) [2025-09-30T20:15:48.644813] [DEBUG] [LOCAL ] NRDY: Primary data saved (32735 records). [2025-09-30T20:15:48.644970] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-30T20:15:48.645063] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 33.0s. Estimated remaining: 1h 47m 60s. Rate: 7.8 symbols/min [2025-09-30T20:15:48.842835] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:48.863818] [DEBUG] [LOCAL ] NRK: Loaded 19832 existing records from primary storage. [2025-09-30T20:15:48.864121] [INFO ] [MAIN ] NRK: Loaded 19832 existing records. [2025-09-30T20:15:49.065604] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-30T20:15:49.072538] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:49.072799] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-30T20:15:49.072863] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-30T20:15:49.073214] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-30T20:15:49.073276] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-30T20:15:49.461509] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:49.854381] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-30T20:15:50.233101] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T20:15:50.552817] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T20:15:50.654377] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-30T20:15:50.733312] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T20:15:51.454376] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-30T20:15:51.747358] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T20:15:51.750037] [INFO ] [REMOTE ] NREF: Full fetch complete (10890 records). [2025-09-30T20:15:51.750130] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-30T20:15:52.173914] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-30T20:15:52.174016] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-30T20:15:52.174383] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-30T20:15:52.174458] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-30T20:15:52.175071] [DEBUG] [LOCAL ] NREF: Trimmed 10890 records to 7881 (keeping 200 days of data) [2025-09-30T20:15:52.228351] [DEBUG] [LOCAL ] NREF: Primary data saved (7881 records). [2025-09-30T20:15:52.228500] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-30T20:15:52.228586] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NREF took 29.1s. Estimated remaining: 1h 47m 50s. Rate: 7.8 symbols/min [2025-09-30T20:15:52.263499] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-30T20:15:52.429701] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:15:52.436576] [DEBUG] [LOCAL ] NRP: Loaded 4053 existing records from primary storage. [2025-09-30T20:15:52.436839] [INFO ] [MAIN ] NRP: Loaded 4053 existing records. [2025-09-30T20:15:52.639226] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:15:52.639520] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-30T20:15:52.639570] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-30T20:15:52.639794] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-30T20:15:52.639856] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-30T20:15:53.054568] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:15:53.054928] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-30T20:15:53.195700] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T20:15:53.448263] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T20:15:53.854390] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-30T20:15:54.464739] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T20:15:54.654363] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-30T20:15:54.938488] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:15:55.454397] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-30T20:15:55.881639] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T20:15:56.251000] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T20:15:56.255475] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-30T20:15:57.054370] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-30T20:15:57.176460] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T20:15:57.854406] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-30T20:15:58.513133] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T20:15:58.654383] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-30T20:15:58.929274] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T20:15:59.323432] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T20:15:59.454435] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-30T20:16:00.222802] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T20:16:00.254403] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-30T20:16:01.054409] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-30T20:16:01.179137] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T20:16:01.854378] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-30T20:16:01.966951] [DEBUG] [REMOTE ] NRGV: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-30T20:16:01.967361] [WARN ] [REMOTE ] NRGV: No data returned for month 2025-06 [2025-09-30T20:16:01.967510] [FATAL] [REMOTE ] NRGV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:16:01.967633] [FATAL] [MAIN ] NRGV: Failed to fetch primary data. [2025-09-30T20:16:01.967748] [WARN ] [MAIN ] NRGV: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:16:01.968070] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-30T20:16:01.968175] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-09-30T20:16:01.968242] [INFO ] [LOCAL ] NRGV: Starting deletion of derivative data. [2025-09-30T20:16:01.969486] [DEBUG] [LOCAL ] NRGV: Deleted derivative data file. [2025-09-30T20:16:01.969728] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 24.1s. Estimated remaining: 1h 47m 43s. Rate: 7.8 symbols/min [2025-09-30T20:16:02.200618] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:02.205880] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T20:16:02.223148] [DEBUG] [LOCAL ] NRT: Loaded 4946 existing records from primary storage. [2025-09-30T20:16:02.223389] [INFO ] [MAIN ] NRT: Loaded 4946 existing records. [2025-09-30T20:16:02.426970] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:02.427210] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-30T20:16:02.427259] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-30T20:16:02.427447] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-30T20:16:02.427507] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-30T20:16:02.659617] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-30T20:16:02.815946] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:03.430493] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T20:16:03.454321] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-30T20:16:04.193267] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T20:16:04.254363] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-30T20:16:05.010579] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T20:16:05.054359] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-30T20:16:05.760499] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T20:16:05.854384] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-30T20:16:06.467437] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T20:16:06.654389] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-30T20:16:07.454402] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-30T20:16:07.520269] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T20:16:08.254398] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-30T20:16:08.857391] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T20:16:09.054353] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-30T20:16:09.073989] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T20:16:09.580225] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T20:16:09.854378] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-30T20:16:10.654330] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-30T20:16:10.917725] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T20:16:11.245127] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T20:16:11.454400] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-30T20:16:12.254369] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-30T20:16:12.694969] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T20:16:12.716148] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T20:16:13.054420] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-30T20:16:13.854341] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-30T20:16:14.040737] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T20:16:14.510506] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T20:16:14.512086] [INFO ] [REMOTE ] NRP: Full fetch complete (6486 records). [2025-09-30T20:16:14.512211] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-30T20:16:14.659527] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-30T20:16:14.929528] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-30T20:16:14.929626] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-30T20:16:14.929859] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-30T20:16:14.929907] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-30T20:16:14.930434] [DEBUG] [LOCAL ] NRP: Trimmed 6486 records to 4059 (keeping 200 days of data) [2025-09-30T20:16:14.958397] [DEBUG] [LOCAL ] NRP: Primary data saved (4059 records). [2025-09-30T20:16:14.958528] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-30T20:16:14.958612] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRP took 22.7s. Estimated remaining: 1h 47m 38s. Rate: 7.8 symbols/min [2025-09-30T20:16:15.146497] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:15.155472] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-09-30T20:16:15.155766] [INFO ] [MAIN ] NRUC: Loaded 3083 existing records. [2025-09-30T20:16:15.352163] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:15.352522] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-30T20:16:15.352615] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-30T20:16:15.353023] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-30T20:16:15.353087] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-30T20:16:15.459588] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-30T20:16:15.772092] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:15.806074] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T20:16:16.254429] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-30T20:16:16.879662] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T20:16:17.054368] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-30T20:16:17.307408] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T20:16:17.854371] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-30T20:16:18.008546] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T20:16:18.020512] [INFO ] [REMOTE ] NRG: Full fetch complete (76180 records). [2025-09-30T20:16:18.020745] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-30T20:16:18.021743] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:16:18.021863] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:16:18.021914] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:16:18.021995] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-30T20:16:18.022084] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-30T20:16:18.022144] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-30T20:16:18.022192] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-30T20:16:18.022255] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRG took 43.6s. Estimated remaining: 1h 47m 28s. Rate: 7.8 symbols/min [2025-09-30T20:16:18.210573] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:18.262536] [DEBUG] [LOCAL ] NSA: Loaded 44760 existing records from primary storage. [2025-09-30T20:16:18.262901] [INFO ] [MAIN ] NSA: Loaded 44760 existing records. [2025-09-30T20:16:18.467060] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:18.468257] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-30T20:16:18.468323] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-30T20:16:18.469277] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-30T20:16:18.469349] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-30T20:16:18.588366] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T20:16:18.659155] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-30T20:16:18.892772] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:19.443698] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T20:16:19.454330] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-30T20:16:20.254382] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-30T20:16:21.054330] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-30T20:16:21.065903] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T20:16:21.091294] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T20:16:21.676788] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T20:16:21.854406] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-30T20:16:22.313917] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T20:16:22.654366] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-30T20:16:23.440767] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T20:16:23.454336] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-30T20:16:24.111037] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T20:16:24.254405] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-30T20:16:25.054407] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-30T20:16:25.827829] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:16:25.854311] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-30T20:16:26.305143] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T20:16:26.654384] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-30T20:16:26.896202] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T20:16:27.272251] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T20:16:27.454349] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-30T20:16:28.254363] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-30T20:16:28.869073] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:16:29.054338] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-30T20:16:29.405124] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T20:16:29.410377] [INFO ] [REMOTE ] NRK: Full fetch complete (27816 records). [2025-09-30T20:16:29.410502] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-30T20:16:29.817133] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-30T20:16:29.817211] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-30T20:16:29.817808] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-30T20:16:29.817870] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-30T20:16:29.819179] [DEBUG] [LOCAL ] NRK: Trimmed 27816 records to 19922 (keeping 200 days of data) [2025-09-30T20:16:29.872984] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-30T20:16:29.950670] [DEBUG] [LOCAL ] NRK: Primary data saved (19922 records). [2025-09-30T20:16:29.950825] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-30T20:16:29.950932] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRK took 41.3s. Estimated remaining: 1h 47m 23s. Rate: 7.8 symbols/min [2025-09-30T20:16:30.140356] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:30.140576] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-30T20:16:30.140661] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-30T20:16:30.140814] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-30T20:16:30.140861] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-30T20:16:30.140912] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-30T20:16:30.140951] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-30T20:16:30.450817] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T20:16:30.551201] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:30.578942] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T20:16:30.654360] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-30T20:16:31.454386] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-30T20:16:31.600860] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:16:31.900950] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T20:16:32.254369] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-30T20:16:33.054346] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-30T20:16:33.101345] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T20:16:33.854353] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-30T20:16:34.252161] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-30T20:16:34.654376] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-30T20:16:34.743167] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T20:16:35.454393] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-30T20:16:35.527957] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:16:36.254396] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-30T20:16:37.054376] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-30T20:16:37.143627] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T20:16:37.282876] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:16:37.854371] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-30T20:16:37.864805] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T20:16:38.654362] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-30T20:16:39.454378] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-30T20:16:39.548498] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T20:16:39.652377] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T20:16:40.254373] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-30T20:16:40.357463] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T20:16:40.360102] [INFO ] [REMOTE ] NRT: Full fetch complete (8039 records). [2025-09-30T20:16:40.360257] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-30T20:16:40.753339] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-30T20:16:40.753426] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-30T20:16:40.753683] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-30T20:16:40.753746] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-30T20:16:40.754165] [DEBUG] [LOCAL ] NRT: Trimmed 8039 records to 4961 (keeping 200 days of data) [2025-09-30T20:16:40.784659] [DEBUG] [LOCAL ] NRT: Primary data saved (4961 records). [2025-09-30T20:16:40.784778] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-30T20:16:40.784867] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRT took 38.8s. Estimated remaining: 1h 47m 17s. Rate: 7.8 symbols/min [2025-09-30T20:16:40.991613] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:41.032124] [DEBUG] [LOCAL ] NSP: Loaded 34896 existing records from primary storage. [2025-09-30T20:16:41.032575] [INFO ] [MAIN ] NSP: Loaded 34896 existing records. [2025-09-30T20:16:41.064583] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-30T20:16:41.248162] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:41.248838] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-30T20:16:41.248973] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-30T20:16:41.261706] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-30T20:16:41.279292] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-30T20:16:41.317498] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T20:16:41.852519] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:41.854463] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-30T20:16:42.652102] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T20:16:42.662625] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-30T20:16:42.812985] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:16:43.052601] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-30T20:16:43.454395] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-30T20:16:44.254366] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-30T20:16:45.054374] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-30T20:16:45.139024] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T20:16:45.187508] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T20:16:45.197528] [INFO ] [REMOTE ] NSA: Full fetch complete (61914 records). [2025-09-30T20:16:45.197710] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-30T20:16:45.641735] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-30T20:16:45.641839] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-30T20:16:45.642899] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-30T20:16:45.642969] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-30T20:16:45.644318] [DEBUG] [LOCAL ] NSA: Trimmed 61914 records to 44689 (keeping 200 days of data) [2025-09-30T20:16:45.864440] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-30T20:16:45.933432] [DEBUG] [LOCAL ] NSA: Primary data saved (44689 records). [2025-09-30T20:16:45.933582] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-30T20:16:45.933702] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 27.9s. Estimated remaining: 1h 47m 8s. Rate: 7.8 symbols/min [2025-09-30T20:16:46.116491] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:46.140455] [DEBUG] [LOCAL ] NTB: Loaded 20433 existing records from primary storage. [2025-09-30T20:16:46.140754] [INFO ] [MAIN ] NTB: Loaded 20433 existing records. [2025-09-30T20:16:46.360043] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T20:16:46.364829] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:46.372608] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-30T20:16:46.372737] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-30T20:16:46.373095] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-30T20:16:46.373158] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-30T20:16:46.501272] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T20:16:46.662341] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-30T20:16:46.789097] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:47.240029] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T20:16:47.241357] [INFO ] [REMOTE ] NRUC: Full fetch complete (5542 records). [2025-09-30T20:16:47.241429] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-30T20:16:47.461550] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-30T20:16:47.638915] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-30T20:16:47.638998] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-30T20:16:47.639173] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-30T20:16:47.639214] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-30T20:16:47.639590] [DEBUG] [LOCAL ] NRUC: Trimmed 5542 records to 3096 (keeping 200 days of data) [2025-09-30T20:16:47.659294] [DEBUG] [LOCAL ] NRUC: Primary data saved (3096 records). [2025-09-30T20:16:47.659372] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-30T20:16:47.659446] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NRUC took 32.7s. Estimated remaining: 1h 46m 57s. Rate: 7.8 symbols/min [2025-09-30T20:16:47.870696] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:47.870965] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-30T20:16:47.871060] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-30T20:16:47.871183] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-30T20:16:47.871227] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-30T20:16:47.871297] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-30T20:16:47.871366] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-30T20:16:48.269168] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:48.261999] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-30T20:16:48.408225] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:16:49.054377] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-30T20:16:49.196329] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:16:49.607664] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T20:16:49.854377] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-30T20:16:50.491955] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T20:16:50.654391] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-30T20:16:51.454401] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-30T20:16:52.005908] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T20:16:52.061251] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T20:16:52.254372] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-30T20:16:53.054367] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-30T20:16:53.419522] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T20:16:53.854373] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-30T20:16:54.408927] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T20:16:54.603386] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T20:16:54.654344] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-30T20:16:55.454354] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-30T20:16:56.233831] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T20:16:56.254311] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-30T20:16:56.295447] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T20:16:57.054390] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-30T20:16:57.768365] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T20:16:57.854340] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-30T20:16:57.936885] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T20:16:57.947851] [INFO ] [REMOTE ] NSC: Full fetch complete (70666 records). [2025-09-30T20:16:57.948065] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-30T20:16:57.948867] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:16:57.948960] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:16:57.949006] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:16:57.949051] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-30T20:16:57.949189] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-30T20:16:57.949264] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-30T20:16:57.949315] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-30T20:16:57.949390] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 28.0s. Estimated remaining: 1h 46m 51s. Rate: 7.8 symbols/min [2025-09-30T20:16:58.134944] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:16:58.207001] [DEBUG] [LOCAL ] NTR: Loaded 52580 existing records from primary storage. [2025-09-30T20:16:58.207340] [INFO ] [MAIN ] NTR: Loaded 52580 existing records. [2025-09-30T20:16:58.401408] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:16:58.401619] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-30T20:16:58.401697] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-30T20:16:58.402346] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-30T20:16:58.402407] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-30T20:16:58.663517] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-30T20:16:58.794797] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:16:59.065698] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:16:59.454417] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-30T20:16:59.900858] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T20:17:00.254387] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-30T20:17:01.054366] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-30T20:17:01.144732] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T20:17:01.838771] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T20:17:01.854320] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-30T20:17:02.501625] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T20:17:02.654376] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-30T20:17:03.345413] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T20:17:03.454406] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-30T20:17:03.658203] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T20:17:03.972523] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T20:17:04.254400] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-30T20:17:05.054339] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-30T20:17:05.299689] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T20:17:05.854383] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-30T20:17:06.654359] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-30T20:17:06.909302] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T20:17:06.990016] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T20:17:07.454435] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-30T20:17:07.706041] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T20:17:08.027257] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T20:17:08.254383] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-30T20:17:09.054365] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-30T20:17:09.854356] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-30T20:17:09.973149] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T20:17:10.110480] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T20:17:10.388044] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T20:17:10.654398] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-30T20:17:11.454386] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-30T20:17:11.738392] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T20:17:11.743245] [INFO ] [REMOTE ] NTB: Full fetch complete (30703 records). [2025-09-30T20:17:11.743377] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-30T20:17:12.143492] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-30T20:17:12.143612] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-30T20:17:12.144387] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-30T20:17:12.144456] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-30T20:17:12.145323] [DEBUG] [LOCAL ] NTB: Trimmed 30703 records to 20264 (keeping 200 days of data) [2025-09-30T20:17:12.254591] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-30T20:17:12.273751] [DEBUG] [LOCAL ] NTB: Primary data saved (20264 records). [2025-09-30T20:17:12.273868] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-30T20:17:12.273945] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 26.3s. Estimated remaining: 1h 46m 47s. Rate: 7.8 symbols/min [2025-09-30T20:17:12.454955] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:12.503303] [DEBUG] [LOCAL ] NTST: Loaded 43486 existing records from primary storage. [2025-09-30T20:17:12.503668] [INFO ] [MAIN ] NTST: Loaded 43486 existing records. [2025-09-30T20:17:12.695493] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:12.695752] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-30T20:17:12.695806] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-30T20:17:12.696198] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-30T20:17:12.696256] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-30T20:17:12.926562] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T20:17:13.083180] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-30T20:17:13.119165] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:13.256904] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:17:13.636157] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T20:17:13.636927] [INFO ] [REMOTE ] NTEST: Full fetch complete (1987 records). [2025-09-30T20:17:13.637001] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-30T20:17:13.857638] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-30T20:17:13.857759] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-30T20:17:13.858015] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:17:13.858913] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:17:13.859045] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-30T20:17:13.859141] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-30T20:17:13.859198] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-30T20:17:13.859243] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-30T20:17:13.859302] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTEST took 26.2s. Estimated remaining: 1h 46m 36s. Rate: 7.8 symbols/min [2025-09-30T20:17:14.050099] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:14.123733] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-30T20:17:14.124086] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-30T20:17:14.318925] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:14.319208] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-30T20:17:14.319272] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-30T20:17:14.319787] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-30T20:17:14.319848] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-30T20:17:14.659512] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-30T20:17:14.702243] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:15.454397] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-30T20:17:15.600615] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T20:17:16.244441] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T20:17:16.254313] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-30T20:17:17.054441] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-30T20:17:17.740038] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-30T20:17:17.779185] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T20:17:17.854400] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-30T20:17:18.654372] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-30T20:17:18.921872] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T20:17:19.374298] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T20:17:19.454369] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-30T20:17:20.254379] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-30T20:17:21.054403] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-30T20:17:21.233949] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T20:17:21.558454] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T20:17:21.593733] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T20:17:21.602010] [INFO ] [REMOTE ] NSP: Full fetch complete (49629 records). [2025-09-30T20:17:21.602117] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-30T20:17:21.859462] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-30T20:17:22.023012] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-30T20:17:22.023096] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-30T20:17:22.024037] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-30T20:17:22.024107] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-30T20:17:22.025364] [DEBUG] [LOCAL ] NSP: Trimmed 49629 records to 34943 (keeping 200 days of data) [2025-09-30T20:17:22.254059] [DEBUG] [LOCAL ] NSP: Primary data saved (34943 records). [2025-09-30T20:17:22.254245] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-30T20:17:22.254341] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NSP took 41.5s. Estimated remaining: 1h 46m 28s. Rate: 7.8 symbols/min [2025-09-30T20:17:22.440580] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:22.441003] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-30T20:17:22.441072] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-30T20:17:22.441217] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-30T20:17:22.441320] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-30T20:17:22.441572] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-30T20:17:22.441625] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-30T20:17:22.572879] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T20:17:22.674490] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-30T20:17:22.877677] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:23.454411] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-30T20:17:24.152485] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-30T20:17:24.217209] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T20:17:24.254339] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-30T20:17:24.330941] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:17:25.054361] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-30T20:17:25.843305] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T20:17:25.854307] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-30T20:17:25.976455] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T20:17:26.654361] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-30T20:17:27.128908] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T20:17:27.454398] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-30T20:17:27.520064] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:17:28.254436] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-30T20:17:29.054374] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-30T20:17:29.649151] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T20:17:29.725173] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-30T20:17:29.854364] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-30T20:17:30.023551] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T20:17:30.654361] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-30T20:17:31.454377] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-30T20:17:32.077380] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-30T20:17:32.147705] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T20:17:32.254378] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-30T20:17:32.384114] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:17:33.054355] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-30T20:17:33.678010] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T20:17:33.854371] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-30T20:17:34.241260] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T20:17:34.654389] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-30T20:17:35.454334] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-30T20:17:35.560505] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T20:17:35.649466] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T20:17:36.254380] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-30T20:17:37.059681] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-30T20:17:37.075735] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T20:17:37.302025] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T20:17:37.854426] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-30T20:17:38.375331] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T20:17:38.654371] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-30T20:17:38.785067] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:17:39.454401] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-30T20:17:40.254372] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-30T20:17:40.719980] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T20:17:40.730388] [INFO ] [REMOTE ] NTST: Full fetch complete (60976 records). [2025-09-30T20:17:40.730541] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-30T20:17:41.054773] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-30T20:17:41.194601] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-30T20:17:41.206267] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-30T20:17:41.207363] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T20:17:41.210307] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-30T20:17:41.220619] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-30T20:17:41.221627] [INFO ] [REMOTE ] NUE: Full fetch complete (74525 records). [2025-09-30T20:17:41.221821] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-30T20:17:41.223217] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:17:41.223369] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:17:41.223577] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:17:41.223715] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-30T20:17:41.223823] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-30T20:17:41.223980] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-30T20:17:41.224447] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-30T20:17:41.224571] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NUE took 19.0s. Estimated remaining: 1h 46m 27s. Rate: 7.8 symbols/min [2025-09-30T20:17:41.224771] [DEBUG] [LOCAL ] NTST: Trimmed 60976 records to 43461 (keeping 200 days of data) [2025-09-30T20:17:41.574747] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:41.612688] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T20:17:41.764935] [DEBUG] [LOCAL ] NUS: Loaded 36394 existing records from primary storage. [2025-09-30T20:17:41.765992] [INFO ] [MAIN ] NUS: Loaded 36394 existing records. [2025-09-30T20:17:41.855200] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-30T20:17:42.010337] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:42.011846] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-30T20:17:42.011931] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-30T20:17:42.013157] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-30T20:17:42.013707] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-30T20:17:42.419518] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:42.451907] [DEBUG] [LOCAL ] NTST: Primary data saved (43461 records). [2025-09-30T20:17:42.452089] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-30T20:17:42.452255] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NTST took 30.2s. Estimated remaining: 1h 46m 15s. Rate: 7.8 symbols/min [2025-09-30T20:17:42.630411] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:42.657853] [DEBUG] [LOCAL ] NUV: Loaded 23326 existing records from primary storage. [2025-09-30T20:17:42.657340] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-30T20:17:42.659139] [INFO ] [MAIN ] NUV: Loaded 23326 existing records. [2025-09-30T20:17:42.848518] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:42.848891] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-30T20:17:42.848953] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-30T20:17:42.849279] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-30T20:17:42.849339] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-30T20:17:43.249850] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:43.454410] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-30T20:17:43.593674] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-30T20:17:43.663707] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T20:17:43.678071] [INFO ] [REMOTE ] NTR: Full fetch complete (76305 records). [2025-09-30T20:17:43.678297] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-30T20:17:44.085479] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:17:44.149487] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-30T20:17:44.149597] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-30T20:17:44.151051] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-30T20:17:44.151123] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-30T20:17:44.152817] [DEBUG] [LOCAL ] NTR: Trimmed 76305 records to 52573 (keeping 200 days of data) [2025-09-30T20:17:44.255152] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-30T20:17:44.536046] [DEBUG] [LOCAL ] NTR: Primary data saved (52573 records). [2025-09-30T20:17:44.536206] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-30T20:17:44.536347] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NTR took 46.6s. Estimated remaining: 1h 46m 5s. Rate: 7.8 symbols/min [2025-09-30T20:17:44.739797] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:44.778203] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T20:17:44.823110] [DEBUG] [LOCAL ] NUVB: Loaded 51242 existing records from primary storage. [2025-09-30T20:17:44.823455] [INFO ] [MAIN ] NUVB: Loaded 51242 existing records. [2025-09-30T20:17:45.056735] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:45.057302] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-30T20:17:45.056876] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-30T20:17:45.058557] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-30T20:17:45.059135] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-30T20:17:45.059206] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-30T20:17:45.451616] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:45.694102] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T20:17:45.854386] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-30T20:17:46.654378] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-30T20:17:47.091726] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T20:17:47.268960] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T20:17:47.454404] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-30T20:17:48.262360] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-30T20:17:48.268431] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T20:17:49.054326] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-30T20:17:49.253627] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T20:17:49.265204] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-30T20:17:49.265364] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-30T20:17:49.494474] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T20:17:49.724552] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-30T20:17:49.724666] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-30T20:17:49.725807] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-30T20:17:49.725875] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-30T20:17:49.727599] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-30T20:17:49.854550] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-30T20:17:50.089091] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-30T20:17:50.089273] [INFO ] [MAIN ] NU: Full history saved. [2025-09-30T20:17:50.089366] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NU took 36.2s. Estimated remaining: 1h 45m 56s. Rate: 7.8 symbols/min [2025-09-30T20:17:50.304860] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:17:50.314509] [DEBUG] [LOCAL ] NUW: Loaded 7406 existing records from primary storage. [2025-09-30T20:17:50.314759] [INFO ] [MAIN ] NUW: Loaded 7406 existing records. [2025-09-30T20:17:50.536515] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:17:50.536789] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-30T20:17:50.536857] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-30T20:17:50.537241] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-30T20:17:50.537314] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-30T20:17:50.670058] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-30T20:17:50.691565] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T20:17:50.971920] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:17:51.454419] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-30T20:17:51.517318] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T20:17:51.866079] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T20:17:52.254389] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-30T20:17:52.820224] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T20:17:53.054367] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-30T20:17:53.065506] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T20:17:53.854405] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-30T20:17:54.232087] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:17:54.654395] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-30T20:17:55.455792] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T20:17:55.455940] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-30T20:17:56.036901] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T20:17:56.254359] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-30T20:17:57.054343] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-30T20:17:57.237452] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T20:17:57.854373] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-30T20:17:57.886756] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T20:17:58.012289] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T20:17:58.654376] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-30T20:17:59.454363] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-30T20:17:59.520011] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T20:17:59.772178] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T20:18:00.254393] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-30T20:18:00.287331] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:18:01.054353] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-30T20:18:01.368751] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:18:01.854415] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-30T20:18:02.654342] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-30T20:18:02.852957] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T20:18:02.880769] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:18:03.454386] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-30T20:18:03.561414] [DEBUG] [REMOTE ] NUW: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T20:18:03.561892] [WARN ] [REMOTE ] NUW: No data returned for month 2025-04 [2025-09-30T20:18:03.562482] [FATAL] [REMOTE ] NUW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:18:03.562757] [FATAL] [MAIN ] NUW: Failed to fetch primary data. [2025-09-30T20:18:03.562836] [WARN ] [MAIN ] NUW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:18:03.562931] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-30T20:18:03.563046] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-09-30T20:18:03.563089] [INFO ] [LOCAL ] NUW: Starting deletion of derivative data. [2025-09-30T20:18:03.563750] [DEBUG] [LOCAL ] NUW: Deleted derivative data file. [2025-09-30T20:18:03.563916] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 13.5s. Estimated remaining: 1h 45m 51s. Rate: 7.8 symbols/min [2025-09-30T20:18:03.767483] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:03.796220] [DEBUG] [LOCAL ] NVG: Loaded 27366 existing records from primary storage. [2025-09-30T20:18:03.796516] [INFO ] [MAIN ] NVG: Loaded 27366 existing records. [2025-09-30T20:18:03.999573] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:04.000232] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-30T20:18:04.000407] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-30T20:18:04.020635] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-30T20:18:04.020867] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-30T20:18:04.028027] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T20:18:04.259767] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-30T20:18:04.435032] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:05.054413] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-30T20:18:05.854381] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-30T20:18:06.005349] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T20:18:06.400276] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T20:18:06.654417] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-30T20:18:07.371396] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T20:18:07.454358] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-30T20:18:07.797299] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T20:18:08.254390] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-30T20:18:08.542157] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T20:18:09.054405] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-30T20:18:09.854388] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-30T20:18:10.193025] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T20:18:10.194605] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T20:18:10.654445] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-30T20:18:11.104561] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T20:18:11.454343] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-30T20:18:11.851067] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T20:18:12.254366] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-30T20:18:13.054386] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-30T20:18:13.084129] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T20:18:13.092749] [INFO ] [REMOTE ] NUS: Full fetch complete (53920 records). [2025-09-30T20:18:13.092904] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-30T20:18:13.555569] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T20:18:13.583903] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-30T20:18:13.584238] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-30T20:18:13.584140] [INFO ] [REMOTE ] NUV: Full fetch complete (34356 records). [2025-09-30T20:18:13.585585] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-30T20:18:13.585768] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-30T20:18:13.586093] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-30T20:18:13.682949] [DEBUG] [LOCAL ] NUS: Trimmed 53920 records to 36380 (keeping 200 days of data) [2025-09-30T20:18:13.854976] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-30T20:18:14.132500] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-30T20:18:14.134111] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-30T20:18:14.135344] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-30T20:18:14.135806] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-30T20:18:14.143119] [DEBUG] [LOCAL ] NUV: Trimmed 34356 records to 23385 (keeping 200 days of data) [2025-09-30T20:18:14.393009] [DEBUG] [LOCAL ] NUV: Primary data saved (23385 records). [2025-09-30T20:18:14.393406] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-30T20:18:14.393518] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUV took 31.9s. Estimated remaining: 1h 45m 45s. Rate: 7.8 symbols/min [2025-09-30T20:18:14.608632] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:14.631611] [DEBUG] [LOCAL ] NUS: Primary data saved (36380 records). [2025-09-30T20:18:14.631804] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-30T20:18:14.631938] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUS took 33.4s. Estimated remaining: 1h 45m 34s. Rate: 7.8 symbols/min [2025-09-30T20:18:14.785850] [DEBUG] [LOCAL ] NVGS: Loaded 30869 existing records from primary storage. [2025-09-30T20:18:14.807462] [INFO ] [MAIN ] NVGS: Loaded 30869 existing records. [2025-09-30T20:18:14.996621] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:15.098570] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:15.099480] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-30T20:18:15.099603] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-30T20:18:15.100564] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-30T20:18:15.100682] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-30T20:18:15.207727] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T20:18:15.253830] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-30T20:18:15.316719] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:18:15.458507] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-30T20:18:15.488968] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-30T20:18:15.560856] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-30T20:18:15.897231] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:15.931303] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:15.931568] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-30T20:18:15.931625] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-30T20:18:15.932218] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-30T20:18:15.932279] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-30T20:18:16.259550] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-30T20:18:16.335790] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:17.010525] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T20:18:17.054336] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-30T20:18:17.451750] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T20:18:17.499191] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T20:18:17.514990] [INFO ] [REMOTE ] NUVB: Full fetch complete (72736 records). [2025-09-30T20:18:17.515182] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-30T20:18:17.855753] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-30T20:18:17.964755] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-30T20:18:17.964861] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-30T20:18:17.966015] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-30T20:18:17.966083] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-30T20:18:17.967710] [DEBUG] [LOCAL ] NUVB: Trimmed 72736 records to 51245 (keeping 200 days of data) [2025-09-30T20:18:18.280119] [DEBUG] [LOCAL ] NUVB: Primary data saved (51245 records). [2025-09-30T20:18:18.280298] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-30T20:18:18.280451] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NUVB took 33.7s. Estimated remaining: 1h 45m 24s. Rate: 7.8 symbols/min [2025-09-30T20:18:18.470069] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:18.493450] [DEBUG] [LOCAL ] NVR: Loaded 18774 existing records from primary storage. [2025-09-30T20:18:18.493747] [INFO ] [MAIN ] NVR: Loaded 18774 existing records. [2025-09-30T20:18:18.659759] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-30T20:18:18.712952] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:18.714290] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-30T20:18:18.714343] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-30T20:18:18.714632] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-30T20:18:18.714721] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-30T20:18:19.067197] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T20:18:19.146136] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:19.454415] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-30T20:18:19.621256] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-30T20:18:19.926987] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T20:18:20.254363] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-30T20:18:20.391211] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T20:18:21.054359] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-30T20:18:21.633030] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T20:18:21.854361] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-30T20:18:22.536347] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T20:18:22.654370] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-30T20:18:23.456826] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-30T20:18:23.463837] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T20:18:23.585038] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-30T20:18:24.254368] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-30T20:18:24.721753] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T20:18:25.054377] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-30T20:18:25.854393] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-30T20:18:26.321936] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T20:18:26.362838] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T20:18:26.654397] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-30T20:18:27.146143] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T20:18:27.340959] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T20:18:27.454412] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-30T20:18:28.254389] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-30T20:18:28.318934] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:18:29.054369] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-30T20:18:29.480792] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T20:18:29.854373] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-30T20:18:30.654377] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-30T20:18:31.247225] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T20:18:31.255540] [INFO ] [REMOTE ] NVG: Full fetch complete (40806 records). [2025-09-30T20:18:31.255712] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-30T20:18:31.454583] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-30T20:18:31.469097] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T20:18:31.781378] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-30T20:18:31.781545] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-30T20:18:31.782639] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-30T20:18:31.782745] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-30T20:18:31.783922] [DEBUG] [LOCAL ] NVG: Trimmed 40806 records to 27446 (keeping 200 days of data) [2025-09-30T20:18:31.914555] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-30T20:18:32.020026] [DEBUG] [LOCAL ] NVG: Primary data saved (27446 records). [2025-09-30T20:18:32.020188] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-30T20:18:32.020288] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVG took 28.5s. Estimated remaining: 1h 45m 19s. Rate: 7.8 symbols/min [2025-09-30T20:18:32.216474] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:32.261829] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-30T20:18:32.265610] [DEBUG] [LOCAL ] NVRI: Loaded 38743 existing records from primary storage. [2025-09-30T20:18:32.266081] [INFO ] [MAIN ] NVRI: Loaded 38743 existing records. [2025-09-30T20:18:32.472408] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:32.472708] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-30T20:18:32.472776] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-30T20:18:32.473234] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-30T20:18:32.473296] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-30T20:18:32.921486] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:33.022124] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T20:18:33.046370] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T20:18:33.054311] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-30T20:18:33.783276] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T20:18:33.854409] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-30T20:18:34.654362] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-30T20:18:35.260760] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T20:18:35.454382] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-30T20:18:36.113561] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T20:18:36.254399] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-30T20:18:36.894101] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T20:18:37.054328] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-30T20:18:37.257071] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-30T20:18:37.854397] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-30T20:18:38.651727] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T20:18:38.659827] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-30T20:18:38.959408] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-30T20:18:38.963866] [INFO ] [REMOTE ] NVR: Full fetch complete (29549 records). [2025-09-30T20:18:38.963984] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-30T20:18:38.965976] [FATAL] [VALIDATOR ] NVR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:18:38.966073] [FATAL] [MAIN ] NVR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:18:38.966122] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:18:38.966165] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-30T20:18:38.966226] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-09-30T20:18:38.966263] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-09-30T20:18:38.966592] [DEBUG] [LOCAL ] NVR: Deleted derivative data file. [2025-09-30T20:18:38.966717] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 20.7s. Estimated remaining: 1h 45m 11s. Rate: 7.8 symbols/min [2025-09-30T20:18:39.164468] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:39.231715] [DEBUG] [LOCAL ] NVS: Loaded 51549 existing records from primary storage. [2025-09-30T20:18:39.232070] [INFO ] [MAIN ] NVS: Loaded 51549 existing records. [2025-09-30T20:18:39.425828] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:39.426042] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-30T20:18:39.426091] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-30T20:18:39.426893] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-30T20:18:39.426953] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-30T20:18:39.459558] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-30T20:18:39.828625] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:40.254356] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-30T20:18:40.635295] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-30T20:18:41.031708] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T20:18:41.054313] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-30T20:18:41.854342] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-30T20:18:41.938624] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T20:18:42.534404] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:18:42.654410] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-30T20:18:42.795566] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T20:18:43.454362] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-30T20:18:44.254414] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-30T20:18:44.626901] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T20:18:44.632053] [INFO ] [REMOTE ] NVGS: Full fetch complete (41449 records). [2025-09-30T20:18:44.632152] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-30T20:18:45.060121] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-30T20:18:45.093931] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-30T20:18:45.094076] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-30T20:18:45.095003] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-30T20:18:45.095088] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-30T20:18:45.096421] [DEBUG] [LOCAL ] NVGS: Trimmed 41449 records to 30770 (keeping 200 days of data) [2025-09-30T20:18:45.225778] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-30T20:18:45.343029] [DEBUG] [LOCAL ] NVGS: Primary data saved (30770 records). [2025-09-30T20:18:45.343158] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-30T20:18:45.343247] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVGS took 30.9s. Estimated remaining: 1h 45m 3s. Rate: 7.8 symbols/min [2025-09-30T20:18:45.553886] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:45.616890] [DEBUG] [LOCAL ] NVST: Loaded 51609 existing records from primary storage. [2025-09-30T20:18:45.617287] [INFO ] [MAIN ] NVST: Loaded 51609 existing records. [2025-09-30T20:18:45.835692] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:45.836005] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-30T20:18:45.836083] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-30T20:18:45.836700] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-30T20:18:45.836762] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-30T20:18:45.869600] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-30T20:18:46.246901] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:18:46.279450] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T20:18:46.460617] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T20:18:46.654343] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-30T20:18:47.454409] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-30T20:18:48.220028] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T20:18:48.254357] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-30T20:18:48.722160] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-30T20:18:48.796291] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T20:18:49.054363] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-30T20:18:49.340620] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T20:18:49.854385] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-30T20:18:50.654377] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-30T20:18:51.126722] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T20:18:51.454449] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-30T20:18:51.982926] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T20:18:52.028160] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-09-30T20:18:52.254410] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-30T20:18:52.838416] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T20:18:53.054397] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-30T20:18:53.854380] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-30T20:18:54.278277] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T20:18:54.337098] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T20:18:54.654385] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-30T20:18:55.258483] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T20:18:55.454363] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-30T20:18:56.019545] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T20:18:56.254377] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-30T20:18:57.054396] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-30T20:18:57.854337] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-30T20:18:57.909164] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T20:18:57.946471] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-30T20:18:57.947519] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T20:18:57.947825] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-30T20:18:58.381454] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-30T20:18:58.381547] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-30T20:18:58.382725] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-30T20:18:58.382798] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-30T20:18:58.384470] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-09-30T20:18:58.658036] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-30T20:18:58.747758] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T20:18:58.785706] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-30T20:18:58.785875] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-30T20:18:58.785971] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVO took 44.2s. Estimated remaining: 1h 44m 58s. Rate: 7.8 symbols/min [2025-09-30T20:18:58.968027] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:18:59.024489] [DEBUG] [LOCAL ] NVT: Loaded 51518 existing records from primary storage. [2025-09-30T20:18:59.024888] [INFO ] [MAIN ] NVT: Loaded 51518 existing records. [2025-09-30T20:18:59.217445] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:18:59.217787] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-30T20:18:59.217935] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-30T20:18:59.218612] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-30T20:18:59.218872] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-30T20:18:59.459671] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-30T20:18:59.599059] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T20:18:59.697871] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:00.266892] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-30T20:19:00.273506] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T20:19:00.283623] [INFO ] [REMOTE ] NVRI: Full fetch complete (55809 records). [2025-09-30T20:19:00.283871] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-30T20:19:00.713071] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-30T20:19:00.713163] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-30T20:19:00.714149] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-30T20:19:00.714217] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-30T20:19:00.715482] [DEBUG] [LOCAL ] NVRI: Trimmed 55809 records to 38693 (keeping 200 days of data) [2025-09-30T20:19:00.955130] [DEBUG] [LOCAL ] NVRI: Primary data saved (38693 records). [2025-09-30T20:19:00.955302] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-30T20:19:00.955416] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVRI took 28.9s. Estimated remaining: 1h 44m 48s. Rate: 7.8 symbols/min [2025-09-30T20:19:01.059566] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-30T20:19:01.167822] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:01.237708] [DEBUG] [LOCAL ] NWG: Loaded 51537 existing records from primary storage. [2025-09-30T20:19:01.238081] [INFO ] [MAIN ] NWG: Loaded 51537 existing records. [2025-09-30T20:19:01.439722] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:01.440194] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-30T20:19:01.440464] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-30T20:19:01.441227] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-30T20:19:01.441296] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-30T20:19:01.594987] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T20:19:01.856720] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-30T20:19:01.942033] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:01.975806] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T20:19:02.654376] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-30T20:19:02.820921] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T20:19:03.454385] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-30T20:19:03.748134] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T20:19:04.107988] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T20:19:04.254376] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-30T20:19:04.923471] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T20:19:05.054392] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-30T20:19:05.854334] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-30T20:19:06.025254] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T20:19:06.654412] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-30T20:19:06.871502] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T20:19:07.311160] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T20:19:07.454398] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-30T20:19:08.203215] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:19:08.254411] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-30T20:19:09.054379] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-30T20:19:09.435941] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T20:19:09.854369] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-30T20:19:10.008299] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T20:19:10.618751] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T20:19:10.654366] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-30T20:19:11.454352] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-30T20:19:11.617376] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T20:19:12.254402] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-30T20:19:12.550782] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T20:19:13.054344] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-30T20:19:13.167539] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T20:19:13.854369] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-30T20:19:14.144595] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T20:19:14.561385] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T20:19:14.654375] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-30T20:19:15.418790] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T20:19:15.454361] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-30T20:19:16.254400] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-30T20:19:16.490393] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T20:19:16.502244] [INFO ] [REMOTE ] NVS: Full fetch complete (74795 records). [2025-09-30T20:19:16.502447] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-30T20:19:16.946861] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-30T20:19:16.946995] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-30T20:19:16.948254] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-30T20:19:16.948322] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-30T20:19:16.950379] [DEBUG] [LOCAL ] NVS: Trimmed 74795 records to 51548 (keeping 200 days of data) [2025-09-30T20:19:17.054586] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-30T20:19:17.117048] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T20:19:17.338529] [DEBUG] [LOCAL ] NVS: Primary data saved (51548 records). [2025-09-30T20:19:17.338713] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-30T20:19:17.338811] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVS took 38.4s. Estimated remaining: 1h 44m 45s. Rate: 7.8 symbols/min [2025-09-30T20:19:17.524755] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:17.550904] [DEBUG] [LOCAL ] NWN: Loaded 26774 existing records from primary storage. [2025-09-30T20:19:17.551174] [INFO ] [MAIN ] NWN: Loaded 26774 existing records. [2025-09-30T20:19:17.769548] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:17.769860] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-30T20:19:17.769917] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-30T20:19:17.770210] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-30T20:19:17.770270] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-30T20:19:17.860198] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-30T20:19:18.209676] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:18.245285] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T20:19:18.257088] [INFO ] [REMOTE ] NVST: Full fetch complete (74088 records). [2025-09-30T20:19:18.257338] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-30T20:19:18.660892] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-30T20:19:18.666317] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-30T20:19:18.666456] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-30T20:19:18.668253] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-30T20:19:18.668498] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-30T20:19:18.670738] [DEBUG] [LOCAL ] NVST: Trimmed 74088 records to 51607 (keeping 200 days of data) [2025-09-30T20:19:19.023380] [DEBUG] [LOCAL ] NVST: Primary data saved (51607 records). [2025-09-30T20:19:19.023630] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-30T20:19:19.023814] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVST took 33.7s. Estimated remaining: 1h 44m 34s. Rate: 7.8 symbols/min [2025-09-30T20:19:19.210395] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:19.250491] [DEBUG] [LOCAL ] NX: Loaded 33165 existing records from primary storage. [2025-09-30T20:19:19.251095] [INFO ] [MAIN ] NX: Loaded 33165 existing records. [2025-09-30T20:19:19.501721] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:19.505771] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-30T20:19:19.506094] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-30T20:19:19.517769] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-30T20:19:19.518847] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-30T20:19:19.518937] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-30T20:19:19.525134] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-30T20:19:19.803174] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T20:19:19.940257] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:19.975524] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-30T20:19:20.254395] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-30T20:19:21.054388] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-30T20:19:21.446750] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T20:19:21.605144] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T20:19:21.854572] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-30T20:19:22.600827] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T20:19:22.654362] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-30T20:19:23.454341] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-30T20:19:23.779296] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T20:19:24.016434] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T20:19:24.254356] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-30T20:19:24.970249] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T20:19:25.054341] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-30T20:19:25.198994] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T20:19:25.854381] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-30T20:19:26.654419] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-30T20:19:26.869098] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T20:19:27.262805] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T20:19:27.454393] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-30T20:19:28.254342] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-30T20:19:28.648069] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T20:19:29.054366] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-30T20:19:29.169659] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T20:19:29.181491] [INFO ] [REMOTE ] NVT: Full fetch complete (74541 records). [2025-09-30T20:19:29.181685] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-30T20:19:29.668567] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-30T20:19:29.668869] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-30T20:19:29.670129] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-30T20:19:29.670216] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-30T20:19:29.688305] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T20:19:29.695003] [DEBUG] [LOCAL ] NVT: Trimmed 74541 records to 51509 (keeping 200 days of data) [2025-09-30T20:19:29.855769] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-30T20:19:30.067022] [DEBUG] [LOCAL ] NVT: Primary data saved (51509 records). [2025-09-30T20:19:30.067684] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-30T20:19:30.067945] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVT took 31.3s. Estimated remaining: 1h 44m 28s. Rate: 7.8 symbols/min [2025-09-30T20:19:30.264241] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:30.274749] [DEBUG] [LOCAL ] NXC: Loaded 4221 existing records from primary storage. [2025-09-30T20:19:30.274985] [INFO ] [MAIN ] NXC: Loaded 4221 existing records. [2025-09-30T20:19:30.501628] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:30.501967] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-30T20:19:30.502019] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-30T20:19:30.502287] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-30T20:19:30.502382] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-30T20:19:30.657877] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-30T20:19:31.007855] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:31.014455] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T20:19:31.025831] [INFO ] [REMOTE ] NWG: Full fetch complete (73323 records). [2025-09-30T20:19:31.026049] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-30T20:19:31.474867] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-30T20:19:31.480167] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-30T20:19:31.480261] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-30T20:19:31.481567] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-30T20:19:31.481807] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-30T20:19:31.503519] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T20:19:31.511632] [DEBUG] [LOCAL ] NWG: Trimmed 73323 records to 51523 (keeping 200 days of data) [2025-09-30T20:19:31.852284] [DEBUG] [LOCAL ] NWG: Primary data saved (51523 records). [2025-09-30T20:19:31.852439] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-30T20:19:31.852575] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWG took 30.9s. Estimated remaining: 1h 44m 17s. Rate: 7.8 symbols/min [2025-09-30T20:19:32.195045] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T20:19:32.241403] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T20:19:32.254323] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-30T20:19:33.054417] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-30T20:19:33.490032] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T20:19:33.593923] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T20:19:33.854430] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-30T20:19:34.654428] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-30T20:19:35.227184] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:19:35.297121] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T20:19:35.454379] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-30T20:19:36.254446] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-30T20:19:36.872168] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T20:19:37.054403] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-30T20:19:37.357415] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T20:19:37.854392] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-30T20:19:38.495022] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:19:38.654431] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-30T20:19:38.688055] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T20:19:39.454382] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-30T20:19:39.831316] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:19:40.158464] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T20:19:40.254369] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-30T20:19:40.961551] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T20:19:41.054372] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-30T20:19:41.710380] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T20:19:41.854364] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-30T20:19:42.466596] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T20:19:42.654405] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-30T20:19:43.454424] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-30T20:19:44.042803] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T20:19:44.151104] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T20:19:44.254364] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-30T20:19:45.054383] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-30T20:19:45.720634] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T20:19:45.722638] [INFO ] [REMOTE ] NXC: Full fetch complete (5984 records). [2025-09-30T20:19:45.722846] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-30T20:19:45.859109] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-30T20:19:46.181907] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T20:19:46.207430] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-30T20:19:46.207723] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-30T20:19:46.208046] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-30T20:19:46.208145] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-30T20:19:46.208264] [INFO ] [REMOTE ] NX: Full fetch complete (48547 records). [2025-09-30T20:19:46.208476] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-30T20:19:46.209036] [DEBUG] [LOCAL ] NXC: Trimmed 5984 records to 4191 (keeping 200 days of data) [2025-09-30T20:19:46.462432] [DEBUG] [LOCAL ] NXC: Primary data saved (4191 records). [2025-09-30T20:19:46.506241] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-30T20:19:46.540983] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NXC took 16.5s. Estimated remaining: 1h 44m 13s. Rate: 7.8 symbols/min [2025-09-30T20:19:46.691594] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-30T20:19:46.691711] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-30T20:19:46.692512] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-30T20:19:46.692555] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-30T20:19:46.694530] [DEBUG] [LOCAL ] NX: Trimmed 48547 records to 33148 (keeping 200 days of data) [2025-09-30T20:19:46.916398] [DEBUG] [LOCAL ] NX: Primary data saved (33148 records). [2025-09-30T20:19:46.916564] [INFO ] [MAIN ] NX: Full history saved. [2025-09-30T20:19:46.916755] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NX took 27.9s. Estimated remaining: 1h 44m 1s. Rate: 7.8 symbols/min [2025-09-30T20:19:47.331681] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T20:19:47.339193] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-30T20:19:48.635258] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T20:19:48.641761] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-30T20:19:49.832330] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T20:19:49.838370] [INFO ] [REMOTE ] NWN: Full fetch complete (37208 records). [2025-09-30T20:19:49.838529] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-30T20:19:50.272925] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-30T20:19:50.273021] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-30T20:19:50.273773] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-30T20:19:50.273837] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-30T20:19:50.274930] [DEBUG] [LOCAL ] NWN: Trimmed 37208 records to 26736 (keeping 200 days of data) [2025-09-30T20:19:50.458565] [DEBUG] [LOCAL ] NWN: Primary data saved (26736 records). [2025-09-30T20:19:50.458756] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-30T20:19:50.458877] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NWN took 33.1s. Estimated remaining: 1h 43m 52s. Rate: 7.8 symbols/min [2025-09-30T20:19:51.219833] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:51.313196] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:51.340772] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:51.365358] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:51.367124] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-30T20:19:51.367579] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-30T20:19:51.368386] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-30T20:19:51.368447] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-30T20:19:51.368521] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-30T20:19:51.368578] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-30T20:19:51.469205] [DEBUG] [LOCAL ] NXG: Loaded 10411 existing records from primary storage. [2025-09-30T20:19:51.480692] [DEBUG] [LOCAL ] NXDT: Loaded 16219 existing records from primary storage. [2025-09-30T20:19:51.505256] [INFO ] [MAIN ] NXDT: Loaded 16219 existing records. [2025-09-30T20:19:51.505118] [INFO ] [MAIN ] NXG: Loaded 10411 existing records. [2025-09-30T20:19:51.969388] [DEBUG] [LOCAL ] NXE: Loaded 52987 existing records from primary storage. [2025-09-30T20:19:52.055482] [INFO ] [MAIN ] NXE: Loaded 52987 existing records. [2025-09-30T20:19:52.248515] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:52.217417] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:52.286986] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-30T20:19:52.292388] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-30T20:19:52.302990] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-30T20:19:52.377794] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-30T20:19:52.340215] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-30T20:19:52.381398] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-30T20:19:52.386800] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-30T20:19:52.390373] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:52.425515] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-30T20:19:52.450105] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-30T20:19:52.715140] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:52.754392] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-30T20:19:52.838331] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-30T20:19:52.886158] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-30T20:19:52.880962] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:19:52.896722] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-30T20:19:52.930097] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-30T20:19:52.989612] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:19:53.080329] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-30T20:19:53.084702] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:19:53.084823] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-30T20:19:53.084909] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-30T20:19:53.084971] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-30T20:19:53.085081] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-30T20:19:53.085173] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXDR took 2.6s. Estimated remaining: 1h 43m 41s. Rate: 7.8 symbols/min [2025-09-30T20:19:53.520557] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:53.579400] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-30T20:19:53.764186] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:19:53.860888] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:53.879852] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-30T20:19:53.992981] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:53.993501] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-30T20:19:54.000583] [DEBUG] [LOCAL ] NXJ: Loaded 14931 existing records from primary storage. [2025-09-30T20:19:54.001053] [INFO ] [MAIN ] NXJ: Loaded 14931 existing records. [2025-09-30T20:19:54.207814] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:19:54.208048] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-30T20:19:54.208100] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-30T20:19:54.208334] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-30T20:19:54.208394] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-30T20:19:54.622245] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:19:54.622606] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-30T20:19:54.647659] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T20:19:54.650588] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-30T20:19:54.834102] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:19:54.839520] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-30T20:19:55.444622] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T20:19:55.447178] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-30T20:19:55.668602] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T20:19:55.701207] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-30T20:19:55.708211] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T20:19:55.721055] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-30T20:19:55.932688] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T20:19:55.966408] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T20:19:56.254401] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-30T20:19:56.783479] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:19:57.054377] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-30T20:19:57.312084] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:19:57.361599] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T20:19:57.854394] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-30T20:19:57.952007] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T20:19:58.654426] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-30T20:19:59.348598] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T20:19:59.454446] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-30T20:19:59.695901] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T20:20:00.084013] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T20:20:00.254406] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-30T20:20:01.054382] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-30T20:20:01.854512] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-30T20:20:02.340680] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T20:20:02.654406] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-30T20:20:03.039309] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T20:20:03.454393] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-30T20:20:03.922970] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T20:20:04.071002] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (3.02 seconds). [2025-09-30T20:20:04.254360] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-30T20:20:04.301446] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T20:20:05.054394] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-30T20:20:05.854363] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-30T20:20:05.955301] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:20:06.288387] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T20:20:06.654405] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-30T20:20:06.828948] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T20:20:07.369149] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T20:20:07.454382] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-30T20:20:08.145005] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T20:20:08.148195] [INFO ] [REMOTE ] NXG: Full fetch complete (14418 records). [2025-09-30T20:20:08.148278] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-30T20:20:08.259555] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-30T20:20:08.577533] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-30T20:20:08.577685] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-30T20:20:08.578103] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-30T20:20:08.578188] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-30T20:20:08.579046] [DEBUG] [LOCAL ] NXG: Trimmed 14418 records to 10416 (keeping 200 days of data) [2025-09-30T20:20:08.650856] [DEBUG] [LOCAL ] NXG: Primary data saved (10416 records). [2025-09-30T20:20:08.651005] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-30T20:20:08.651095] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXG took 18.2s. Estimated remaining: 1h 43m 38s. Rate: 7.8 symbols/min [2025-09-30T20:20:08.873117] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:08.878735] [DEBUG] [LOCAL ] NXN: Loaded 2325 existing records from primary storage. [2025-09-30T20:20:08.879220] [INFO ] [MAIN ] NXN: Loaded 2325 existing records. [2025-09-30T20:20:09.056345] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-30T20:20:09.088110] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:20:09.088456] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-30T20:20:09.088516] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-30T20:20:09.088904] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-30T20:20:09.088964] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-30T20:20:09.491415] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:09.854374] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-30T20:20:10.269731] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T20:20:10.300589] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T20:20:10.654406] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-30T20:20:10.998352] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T20:20:11.454404] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-30T20:20:11.898755] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T20:20:12.254394] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-30T20:20:13.054407] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-30T20:20:13.344587] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T20:20:13.424847] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T20:20:13.854367] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-30T20:20:14.164876] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T20:20:14.654393] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-30T20:20:15.454354] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-30T20:20:15.710785] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T20:20:15.905488] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T20:20:16.105464] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T20:20:16.254359] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-30T20:20:17.054364] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-30T20:20:17.854361] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-30T20:20:18.044766] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T20:20:18.160477] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T20:20:18.654377] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-30T20:20:18.844589] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T20:20:18.848397] [INFO ] [REMOTE ] NXJ: Full fetch complete (21034 records). [2025-09-30T20:20:18.848605] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-30T20:20:19.226753] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-30T20:20:19.226845] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-30T20:20:19.227307] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-30T20:20:19.227409] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-30T20:20:19.228106] [DEBUG] [LOCAL ] NXJ: Trimmed 21034 records to 14895 (keeping 200 days of data) [2025-09-30T20:20:19.322104] [DEBUG] [LOCAL ] NXJ: Primary data saved (14895 records). [2025-09-30T20:20:19.322252] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-30T20:20:19.322337] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXJ took 26.2s. Estimated remaining: 1h 43m 32s. Rate: 7.8 symbols/min [2025-09-30T20:20:19.459431] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-30T20:20:19.514507] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:19.529681] [DEBUG] [LOCAL ] NXP: Loaded 12362 existing records from primary storage. [2025-09-30T20:20:19.529922] [INFO ] [MAIN ] NXP: Loaded 12362 existing records. [2025-09-30T20:20:19.732353] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T20:20:19.736840] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:20:19.741545] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-30T20:20:19.741608] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-30T20:20:19.741865] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-30T20:20:19.741936] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-30T20:20:20.121578] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:20.254359] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-30T20:20:20.834189] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:20:21.054551] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-30T20:20:21.408969] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T20:20:21.421392] [INFO ] [REMOTE ] NXE: Full fetch complete (76678 records). [2025-09-30T20:20:21.421675] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-30T20:20:21.812677] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:20:21.869232] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-30T20:20:21.955891] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-30T20:20:21.955987] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-30T20:20:21.957136] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-30T20:20:21.957209] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-30T20:20:21.964095] [DEBUG] [LOCAL ] NXE: Trimmed 76678 records to 52986 (keeping 200 days of data) [2025-09-30T20:20:22.293218] [DEBUG] [LOCAL ] NXE: Primary data saved (52986 records). [2025-09-30T20:20:22.293367] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-30T20:20:22.293455] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXE took 31.8s. Estimated remaining: 1h 43m 21s. Rate: 7.8 symbols/min [2025-09-30T20:20:22.489398] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:22.514901] [DEBUG] [LOCAL ] NXRT: Loaded 19043 existing records from primary storage. [2025-09-30T20:20:22.515268] [INFO ] [MAIN ] NXRT: Loaded 19043 existing records. [2025-09-30T20:20:22.659770] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-30T20:20:22.722796] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:20:22.723228] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-30T20:20:22.723280] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-30T20:20:22.723739] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-30T20:20:22.723801] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-30T20:20:23.118801] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T20:20:23.160960] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:23.417621] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:20:23.454364] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-30T20:20:24.149447] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T20:20:24.154323] [INFO ] [REMOTE ] NXDT: Full fetch complete (25472 records). [2025-09-30T20:20:24.154701] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-30T20:20:24.259485] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-30T20:20:24.595140] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-30T20:20:24.595223] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-30T20:20:24.595827] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-30T20:20:24.595892] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-30T20:20:24.596844] [DEBUG] [LOCAL ] NXDT: Trimmed 25472 records to 16164 (keeping 200 days of data) [2025-09-30T20:20:24.702739] [DEBUG] [LOCAL ] NXDT: Primary data saved (16164 records). [2025-09-30T20:20:24.702920] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-30T20:20:24.703014] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXDT took 34.2s. Estimated remaining: 1h 43m 11s. Rate: 7.8 symbols/min [2025-09-30T20:20:24.881578] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:24.881803] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-30T20:20:24.881856] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-30T20:20:24.881968] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-30T20:20:24.882010] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-30T20:20:24.882052] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-30T20:20:24.882086] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-30T20:20:25.056859] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-30T20:20:25.276237] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:25.276785] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T20:20:25.854359] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-30T20:20:25.949245] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:20:26.287682] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-30T20:20:26.654389] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-30T20:20:27.454340] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-30T20:20:27.484807] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:20:28.035918] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:20:28.254380] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-30T20:20:28.869547] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T20:20:29.054404] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-30T20:20:29.854325] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-30T20:20:30.159735] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T20:20:30.400462] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T20:20:30.654383] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-30T20:20:31.454349] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-30T20:20:31.690800] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T20:20:31.982183] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:20:32.254425] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-30T20:20:32.690556] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T20:20:33.054416] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-30T20:20:33.552984] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T20:20:33.854423] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-30T20:20:34.379469] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T20:20:34.654414] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-30T20:20:35.454333] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-30T20:20:35.576762] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:20:36.254356] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-30T20:20:36.311511] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:20:36.900386] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:20:37.054414] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-30T20:20:37.579772] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T20:20:37.854367] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-30T20:20:38.414012] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T20:20:38.654397] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-30T20:20:39.219482] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T20:20:39.454373] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-30T20:20:39.786268] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T20:20:40.254376] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-30T20:20:41.054375] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-30T20:20:41.101391] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T20:20:41.497800] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T20:20:41.854389] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-30T20:20:42.654383] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-30T20:20:42.945030] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T20:20:43.071687] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T20:20:43.454375] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-30T20:20:44.254348] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-30T20:20:44.640844] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T20:20:44.800527] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T20:20:44.801581] [INFO ] [REMOTE ] NXN: Full fetch complete (3670 records). [2025-09-30T20:20:44.801693] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-30T20:20:45.059572] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-30T20:20:45.198758] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-30T20:20:45.198867] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-30T20:20:45.199022] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-30T20:20:45.199063] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-30T20:20:45.199520] [DEBUG] [LOCAL ] NXN: Trimmed 3670 records to 2330 (keeping 200 days of data) [2025-09-30T20:20:45.214902] [DEBUG] [LOCAL ] NXN: Primary data saved (2330 records). [2025-09-30T20:20:45.215041] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-30T20:20:45.215169] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXN took 36.6s. Estimated remaining: 1h 43m 10s. Rate: 7.8 symbols/min [2025-09-30T20:20:45.407125] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:45.469431] [DEBUG] [LOCAL ] NYT: Loaded 49852 existing records from primary storage. [2025-09-30T20:20:45.469781] [INFO ] [MAIN ] NYT: Loaded 49852 existing records. [2025-09-30T20:20:45.661786] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:20:45.662052] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-30T20:20:45.662150] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-30T20:20:45.662506] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-30T20:20:45.662566] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-30T20:20:45.858972] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-30T20:20:46.068493] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:46.079918] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T20:20:46.486498] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T20:20:46.654356] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-30T20:20:47.454401] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-30T20:20:47.547724] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T20:20:47.968387] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-30T20:20:47.969457] [INFO ] [REMOTE ] NYC: Full fetch complete (1914 records). [2025-09-30T20:20:47.969533] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-30T20:20:48.182084] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-30T20:20:48.182289] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:20:48.182362] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:20:48.182439] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-30T20:20:48.182512] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-30T20:20:48.182551] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-30T20:20:48.182594] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-30T20:20:48.182683] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NYC took 23.5s. Estimated remaining: 1h 42m 60s. Rate: 7.8 symbols/min [2025-09-30T20:20:48.259500] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-30T20:20:48.387861] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:48.436504] [DEBUG] [LOCAL ] NZF: Loaded 28963 existing records from primary storage. [2025-09-30T20:20:48.436927] [INFO ] [MAIN ] NZF: Loaded 28963 existing records. [2025-09-30T20:20:48.680857] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:20:48.681102] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-30T20:20:48.681154] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-30T20:20:48.681604] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-30T20:20:48.681739] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-30T20:20:49.059550] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-30T20:20:49.100594] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:49.854427] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-30T20:20:50.027277] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T20:20:50.031178] [INFO ] [REMOTE ] NXP: Full fetch complete (16770 records). [2025-09-30T20:20:50.031322] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-30T20:20:50.379959] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-30T20:20:50.483497] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-30T20:20:50.483579] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-30T20:20:50.484014] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-30T20:20:50.484100] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-30T20:20:50.484807] [DEBUG] [LOCAL ] NXP: Trimmed 16770 records to 12397 (keeping 200 days of data) [2025-09-30T20:20:50.567169] [DEBUG] [LOCAL ] NXP: Primary data saved (12397 records). [2025-09-30T20:20:50.567310] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-30T20:20:50.567395] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXP took 31.2s. Estimated remaining: 1h 42m 49s. Rate: 7.8 symbols/min [2025-09-30T20:20:50.659464] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-30T20:20:50.764811] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:20:50.765132] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-30T20:20:50.765189] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-30T20:20:50.765307] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-30T20:20:50.765351] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-30T20:20:50.765395] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-30T20:20:50.765429] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-30T20:20:51.039356] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T20:20:51.232051] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:20:51.454395] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-30T20:20:52.027813] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T20:20:52.082858] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T20:20:52.254370] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-30T20:20:53.054345] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-30T20:20:53.343725] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T20:20:53.854394] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-30T20:20:54.543432] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:20:54.654375] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-30T20:20:55.454366] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-30T20:20:55.718158] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T20:20:55.900388] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T20:20:56.254374] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-30T20:20:57.054384] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-30T20:20:57.100902] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T20:20:57.159194] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:20:57.854334] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-30T20:20:57.964099] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T20:20:58.654498] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-30T20:20:59.454347] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-30T20:20:59.501546] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T20:20:59.506687] [INFO ] [REMOTE ] NXRT: Full fetch complete (25381 records). [2025-09-30T20:20:59.506815] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-30T20:20:59.941935] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-30T20:21:00.027793] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-30T20:21:00.027940] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-30T20:21:00.028534] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-30T20:21:00.028591] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-30T20:21:00.029411] [DEBUG] [LOCAL ] NXRT: Trimmed 25381 records to 19076 (keeping 200 days of data) [2025-09-30T20:21:00.157586] [DEBUG] [LOCAL ] NXRT: Primary data saved (19076 records). [2025-09-30T20:21:00.157789] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-30T20:21:00.157924] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NXRT took 37.9s. Estimated remaining: 1h 42m 43s. Rate: 7.8 symbols/min [2025-09-30T20:21:00.259736] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-30T20:21:00.358893] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:00.419673] [DEBUG] [LOCAL ] OBDC: Loaded 51654 existing records from primary storage. [2025-09-30T20:21:00.420002] [INFO ] [MAIN ] OBDC: Loaded 51654 existing records. [2025-09-30T20:21:00.632224] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:00.632447] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-30T20:21:00.632501] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-30T20:21:00.633130] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-30T20:21:00.633193] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-30T20:21:01.055385] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T20:21:01.061133] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-30T20:21:01.101309] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:01.700234] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T20:21:01.791333] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T20:21:01.854407] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-30T20:21:02.654357] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-30T20:21:02.895127] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T20:21:03.454420] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-30T20:21:04.254409] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-30T20:21:04.527911] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T20:21:05.054394] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-30T20:21:05.344977] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T20:21:05.622542] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T20:21:05.756986] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T20:21:05.854380] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-30T20:21:06.654415] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-30T20:21:07.454359] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-30T20:21:07.702879] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T20:21:08.254406] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-30T20:21:08.488787] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T20:21:08.644628] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T20:21:08.841480] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T20:21:09.054362] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-30T20:21:09.854386] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-30T20:21:10.398445] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T20:21:10.654376] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-30T20:21:11.454426] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-30T20:21:11.616039] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T20:21:11.674498] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T20:21:12.254375] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-30T20:21:13.054337] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-30T20:21:13.174118] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T20:21:13.223766] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T20:21:13.854359] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-30T20:21:14.637788] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T20:21:14.654320] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-30T20:21:15.273575] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T20:21:15.393763] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T20:21:15.454359] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-30T20:21:16.254367] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-30T20:21:16.347913] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T20:21:17.054397] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-30T20:21:17.594371] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T20:21:17.605629] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-09-30T20:21:17.605853] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-30T20:21:17.606978] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:21:17.607073] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:21:17.607137] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:21:17.607224] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-30T20:21:17.607349] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-30T20:21:17.607420] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-30T20:21:17.607504] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-30T20:21:17.607606] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. O took 27.0s. Estimated remaining: 1h 42m 40s. Rate: 7.8 symbols/min [2025-09-30T20:21:17.798387] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:17.817077] [DEBUG] [LOCAL ] OBK: Loaded 16211 existing records from primary storage. [2025-09-30T20:21:17.817374] [INFO ] [MAIN ] OBK: Loaded 16211 existing records. [2025-09-30T20:21:17.859515] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-30T20:21:18.039213] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:18.039774] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-30T20:21:18.039878] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-30T20:21:18.040418] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-30T20:21:18.040559] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-30T20:21:18.523417] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:18.526819] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-30T20:21:18.654390] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-30T20:21:19.336245] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T20:21:19.454376] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-30T20:21:20.011111] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T20:21:20.018435] [INFO ] [REMOTE ] NZF: Full fetch complete (43360 records). [2025-09-30T20:21:20.018694] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-30T20:21:20.258956] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-30T20:21:20.484012] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T20:21:20.507580] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-30T20:21:20.507729] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-30T20:21:20.508631] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-30T20:21:20.508738] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-30T20:21:20.510034] [DEBUG] [LOCAL ] NZF: Trimmed 43360 records to 28940 (keeping 200 days of data) [2025-09-30T20:21:20.709696] [DEBUG] [LOCAL ] NZF: Primary data saved (28940 records). [2025-09-30T20:21:20.709850] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-30T20:21:20.709937] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. NZF took 32.5s. Estimated remaining: 1h 42m 30s. Rate: 7.8 symbols/min [2025-09-30T20:21:20.893042] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:20.893289] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-09-30T20:21:20.893347] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-09-30T20:21:20.893466] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-30T20:21:20.893517] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-30T20:21:20.893563] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-09-30T20:21:20.893595] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-30T20:21:21.059484] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-30T20:21:21.366082] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:21.854338] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-30T20:21:22.205891] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T20:21:22.240696] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T20:21:22.654425] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-30T20:21:23.371820] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T20:21:23.416689] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:21:23.454399] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-30T20:21:24.254398] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-30T20:21:24.999536] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T20:21:25.054399] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-30T20:21:25.845998] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T20:21:25.861559] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-30T20:21:25.867059] [INFO ] [REMOTE ] NYT: Full fetch complete (72092 records). [2025-09-30T20:21:25.867268] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-30T20:21:26.576835] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-30T20:21:26.577115] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-30T20:21:26.578947] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-30T20:21:26.579121] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-30T20:21:26.581098] [DEBUG] [LOCAL ] NYT: Trimmed 72092 records to 49842 (keeping 200 days of data) [2025-09-30T20:21:26.680196] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-30T20:21:26.860382] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T20:21:26.971042] [DEBUG] [LOCAL ] NYT: Primary data saved (49842 records). [2025-09-30T20:21:26.971232] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-30T20:21:26.971334] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. NYT took 41.8s. Estimated remaining: 1h 42m 22s. Rate: 7.8 symbols/min [2025-09-30T20:21:27.161888] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:27.173361] [DEBUG] [LOCAL ] OCFT: Loaded 8542 existing records from primary storage. [2025-09-30T20:21:27.173600] [INFO ] [MAIN ] OCFT: Loaded 8542 existing records. [2025-09-30T20:21:27.377638] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:27.378185] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-30T20:21:27.378243] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-30T20:21:27.378570] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-30T20:21:27.378686] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-30T20:21:27.458305] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-30T20:21:27.745440] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T20:21:27.841710] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T20:21:27.840027] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:28.254395] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-30T20:21:28.887789] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T20:21:29.054345] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-30T20:21:29.110559] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T20:21:29.506904] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T20:21:29.854365] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-30T20:21:30.654384] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-30T20:21:30.758830] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:21:31.454392] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-30T20:21:31.898603] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T20:21:32.254424] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-30T20:21:33.060098] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-30T20:21:33.084522] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T20:21:33.371713] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T20:21:33.854399] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-30T20:21:34.654415] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-30T20:21:35.195414] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-30T20:21:35.427014] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T20:21:35.454412] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-30T20:21:35.676864] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T20:21:36.254360] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-30T20:21:36.310602] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:21:37.054405] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-30T20:21:37.273769] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T20:21:37.854396] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-30T20:21:38.524952] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T20:21:38.654388] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-30T20:21:39.051131] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T20:21:39.454406] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-30T20:21:40.254381] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-30T20:21:40.643150] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T20:21:40.655278] [INFO ] [REMOTE ] OBDC: Full fetch complete (74943 records). [2025-09-30T20:21:40.655541] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-30T20:21:41.056619] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-30T20:21:41.101609] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-30T20:21:41.103030] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-30T20:21:41.104524] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-30T20:21:41.104808] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-30T20:21:41.137214] [DEBUG] [LOCAL ] OBDC: Trimmed 74943 records to 51656 (keeping 200 days of data) [2025-09-30T20:21:41.141681] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T20:21:41.462159] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T20:21:41.607033] [DEBUG] [LOCAL ] OBDC: Primary data saved (51656 records). [2025-09-30T20:21:41.608062] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-30T20:21:41.608421] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OBDC took 41.5s. Estimated remaining: 1h 42m 17s. Rate: 7.8 symbols/min [2025-09-30T20:21:41.770074] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T20:21:41.828797] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:41.842331] [DEBUG] [LOCAL ] ODC: Loaded 8441 existing records from primary storage. [2025-09-30T20:21:41.842631] [INFO ] [MAIN ] ODC: Loaded 8441 existing records. [2025-09-30T20:21:41.859712] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-30T20:21:42.063892] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:42.064188] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-30T20:21:42.064255] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-30T20:21:42.064543] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-30T20:21:42.064603] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-30T20:21:42.479920] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:42.654407] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-30T20:21:43.454340] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-30T20:21:43.522425] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T20:21:43.545295] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T20:21:44.254395] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-30T20:21:44.520161] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T20:21:45.019101] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T20:21:45.054369] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-30T20:21:45.778559] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T20:21:45.854564] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-30T20:21:46.654394] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-30T20:21:47.434230] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T20:21:47.454317] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-30T20:21:47.504157] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T20:21:48.254328] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-30T20:21:48.330307] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:21:48.791526] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T20:21:49.054393] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-30T20:21:49.854394] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-30T20:21:50.214987] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T20:21:50.219592] [INFO ] [REMOTE ] OBK: Full fetch complete (23880 records). [2025-09-30T20:21:50.219733] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-30T20:21:50.664043] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-30T20:21:50.680246] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-30T20:21:50.680364] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-30T20:21:50.681001] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-30T20:21:50.681072] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-30T20:21:50.682493] [DEBUG] [LOCAL ] OBK: Trimmed 23880 records to 16175 (keeping 200 days of data) [2025-09-30T20:21:50.804221] [DEBUG] [LOCAL ] OBK: Primary data saved (16175 records). [2025-09-30T20:21:50.804619] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-30T20:21:50.804814] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OBK took 33.2s. Estimated remaining: 1h 42m 11s. Rate: 7.8 symbols/min [2025-09-30T20:21:51.015310] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:51.047280] [DEBUG] [LOCAL ] ODV: Loaded 26437 existing records from primary storage. [2025-09-30T20:21:51.047555] [INFO ] [MAIN ] ODV: Loaded 26437 existing records. [2025-09-30T20:21:51.259501] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:51.261048] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-30T20:21:51.261236] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-30T20:21:51.261726] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-30T20:21:51.261846] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-30T20:21:51.432741] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T20:21:51.454617] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-30T20:21:51.589664] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:21:51.829564] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:52.165723] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T20:21:52.167590] [INFO ] [REMOTE ] OCFT: Full fetch complete (11767 records). [2025-09-30T20:21:52.167699] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-30T20:21:52.259691] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-30T20:21:52.580754] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-30T20:21:52.580836] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-30T20:21:52.581107] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-30T20:21:52.581145] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-30T20:21:52.581837] [DEBUG] [LOCAL ] OCFT: Trimmed 11767 records to 8374 (keeping 200 days of data) [2025-09-30T20:21:52.629474] [DEBUG] [LOCAL ] OCFT: Primary data saved (8374 records). [2025-09-30T20:21:52.629594] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-30T20:21:52.629740] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OCFT took 25.7s. Estimated remaining: 1h 41m 60s. Rate: 7.8 symbols/min [2025-09-30T20:21:52.812730] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:52.862854] [DEBUG] [LOCAL ] OEC: Loaded 37066 existing records from primary storage. [2025-09-30T20:21:52.863201] [INFO ] [MAIN ] OEC: Loaded 37066 existing records. [2025-09-30T20:21:53.064185] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-30T20:21:53.071115] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:53.072491] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-30T20:21:53.072545] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-30T20:21:53.072948] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-30T20:21:53.073009] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-30T20:21:53.480175] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:53.854395] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-30T20:21:54.054362] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:21:54.066410] [INFO ] [REMOTE ] OC: Full fetch complete (64165 records). [2025-09-30T20:21:54.066701] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-30T20:21:54.435358] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T20:21:54.550463] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T20:21:54.550253] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-30T20:21:54.552994] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-30T20:21:54.554289] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-30T20:21:54.554366] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-30T20:21:54.556222] [DEBUG] [LOCAL ] OC: Trimmed 64165 records to 44563 (keeping 200 days of data) [2025-09-30T20:21:54.665818] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-30T20:21:54.911772] [DEBUG] [LOCAL ] OC: Primary data saved (44563 records). [2025-09-30T20:21:54.911951] [INFO ] [MAIN ] OC: Full history saved. [2025-09-30T20:21:54.912112] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. OC took 34.2s. Estimated remaining: 1h 41m 49s. Rate: 7.8 symbols/min [2025-09-30T20:21:55.127049] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:21:55.156246] [DEBUG] [LOCAL ] OFG: Loaded 21736 existing records from primary storage. [2025-09-30T20:21:55.156531] [INFO ] [MAIN ] OFG: Loaded 21736 existing records. [2025-09-30T20:21:55.396522] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:21:55.397732] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-30T20:21:55.397811] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-30T20:21:55.398100] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-30T20:21:55.398159] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-30T20:21:55.459435] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-30T20:21:55.749074] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T20:21:55.826877] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:21:56.254385] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-30T20:21:56.994410] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T20:21:57.054384] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-30T20:21:57.476257] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T20:21:57.854395] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-30T20:21:58.521014] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:21:58.654375] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-30T20:21:58.679591] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T20:21:59.454374] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-30T20:22:00.161810] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T20:22:00.254410] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-30T20:22:00.266979] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T20:22:01.054375] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-30T20:22:01.773967] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T20:22:01.859541] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-30T20:22:01.876157] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T20:22:02.654364] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-30T20:22:03.337200] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:22:03.454355] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-30T20:22:03.489124] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T20:22:04.254331] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-30T20:22:04.493743] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T20:22:05.054370] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-30T20:22:05.828346] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T20:22:05.854302] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-30T20:22:06.255744] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T20:22:06.654363] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-30T20:22:07.454435] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-30T20:22:07.510754] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T20:22:07.909536] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T20:22:08.254403] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-30T20:22:08.523270] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T20:22:09.054427] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-30T20:22:09.379036] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T20:22:09.854408] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-30T20:22:09.907701] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T20:22:09.910633] [INFO ] [REMOTE ] ODC: Full fetch complete (10927 records). [2025-09-30T20:22:09.910763] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-30T20:22:10.365607] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-30T20:22:10.365736] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-30T20:22:10.366211] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-30T20:22:10.366295] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-30T20:22:10.367120] [DEBUG] [LOCAL ] ODC: Trimmed 10927 records to 8422 (keeping 200 days of data) [2025-09-30T20:22:10.428106] [DEBUG] [LOCAL ] ODC: Primary data saved (8422 records). [2025-09-30T20:22:10.428278] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-30T20:22:10.428398] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. ODC took 28.8s. Estimated remaining: 1h 41m 46s. Rate: 7.8 symbols/min [2025-09-30T20:22:10.645527] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:10.645775] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-09-30T20:22:10.645834] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-09-30T20:22:10.645952] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-30T20:22:10.646006] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-30T20:22:10.646076] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-09-30T20:22:10.646113] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-30T20:22:10.659562] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-30T20:22:11.095534] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:11.454446] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-30T20:22:11.494530] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T20:22:11.799503] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T20:22:12.254368] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-30T20:22:13.054396] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-30T20:22:13.187737] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T20:22:13.833139] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T20:22:13.854339] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-30T20:22:14.264344] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T20:22:14.654342] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-30T20:22:15.045787] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T20:22:15.454359] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-30T20:22:16.114731] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T20:22:16.254392] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-30T20:22:16.580907] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:22:17.054389] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-30T20:22:17.560612] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:22:17.843039] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T20:22:17.854331] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-30T20:22:18.654379] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-30T20:22:18.964859] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T20:22:19.454422] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-30T20:22:20.120701] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T20:22:20.254387] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-30T20:22:21.043846] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T20:22:21.051728] [INFO ] [REMOTE ] OEC: Full fetch complete (52731 records). [2025-09-30T20:22:21.051862] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-30T20:22:21.064195] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-30T20:22:21.475365] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T20:22:21.521857] [INFO ] [REMOTE ] OFG: Full fetch complete (34327 records). [2025-09-30T20:22:21.523537] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-30T20:22:21.600828] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-30T20:22:21.629804] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-30T20:22:21.673190] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-30T20:22:21.682865] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-30T20:22:21.744245] [DEBUG] [LOCAL ] OEC: Trimmed 52731 records to 37119 (keeping 200 days of data) [2025-09-30T20:22:21.917987] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-30T20:22:22.128094] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-30T20:22:22.128792] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-30T20:22:22.129869] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-30T20:22:22.130229] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-30T20:22:22.133270] [DEBUG] [LOCAL ] OFG: Trimmed 34327 records to 21598 (keeping 200 days of data) [2025-09-30T20:22:22.316931] [DEBUG] [LOCAL ] OFG: Primary data saved (21598 records). [2025-09-30T20:22:22.318591] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-30T20:22:22.318782] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 27.4s. Estimated remaining: 1h 41m 40s. Rate: 7.8 symbols/min [2025-09-30T20:22:22.656111] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:22.734865] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T20:22:22.735091] [DEBUG] [LOCAL ] OEC: Primary data saved (37119 records). [2025-09-30T20:22:22.744232] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-30T20:22:22.744507] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OEC took 30.1s. Estimated remaining: 1h 41m 29s. Rate: 7.8 symbols/min [2025-09-30T20:22:22.749935] [INFO ] [REMOTE ] ODV: Full fetch complete (32722 records). [2025-09-30T20:22:22.757822] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-30T20:22:22.966785] [DEBUG] [LOCAL ] OGN: Loaded 53096 existing records from primary storage. [2025-09-30T20:22:23.003416] [INFO ] [MAIN ] OGN: Loaded 53096 existing records. [2025-09-30T20:22:23.236131] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:23.613856] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:22:23.654768] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-30T20:22:23.689694] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-30T20:22:23.690139] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-30T20:22:23.689821] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-30T20:22:23.702344] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-30T20:22:23.702513] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-30T20:22:23.703281] [DEBUG] [LOCAL ] OGS: Loaded 34112 existing records from primary storage. [2025-09-30T20:22:23.703442] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-30T20:22:23.703596] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-30T20:22:23.704187] [INFO ] [MAIN ] OGS: Loaded 34112 existing records. [2025-09-30T20:22:23.785862] [DEBUG] [LOCAL ] ODV: Trimmed 32722 records to 26643 (keeping 200 days of data) [2025-09-30T20:22:24.291399] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:22:24.311998] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-30T20:22:24.338557] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-30T20:22:24.353075] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-30T20:22:24.427428] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-30T20:22:24.444402] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-30T20:22:24.473176] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-30T20:22:24.541204] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:24.549721] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-30T20:22:25.026292] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:25.028093] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-30T20:22:25.031212] [DEBUG] [LOCAL ] ODV: Primary data saved (26643 records). [2025-09-30T20:22:25.031442] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-30T20:22:25.031631] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. ODV took 34.2s. Estimated remaining: 1h 41m 18s. Rate: 7.8 symbols/min [2025-09-30T20:22:25.232959] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:25.285081] [DEBUG] [LOCAL ] OHI: Loaded 52015 existing records from primary storage. [2025-09-30T20:22:25.285475] [INFO ] [MAIN ] OHI: Loaded 52015 existing records. [2025-09-30T20:22:25.485111] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:22:25.485357] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-30T20:22:25.485406] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-30T20:22:25.485912] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-30T20:22:25.485974] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-30T20:22:25.891547] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:25.892035] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-30T20:22:26.138799] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T20:22:26.147854] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-30T20:22:26.449678] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T20:22:26.514889] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T20:22:26.654612] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-30T20:22:27.454361] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-30T20:22:27.625340] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T20:22:27.747339] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T20:22:28.254417] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-30T20:22:28.496519] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T20:22:28.558414] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T20:22:29.054402] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-30T20:22:29.831609] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T20:22:29.854346] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-30T20:22:30.654327] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-30T20:22:30.909779] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T20:22:31.221920] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T20:22:31.454384] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-30T20:22:32.254351] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-30T20:22:32.335140] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T20:22:32.903557] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T20:22:33.054414] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-30T20:22:33.854340] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-30T20:22:33.951998] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T20:22:34.654411] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-30T20:22:34.868519] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T20:22:35.396257] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T20:22:35.454388] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-30T20:22:36.085019] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:22:36.254355] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-30T20:22:37.054424] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-30T20:22:37.502027] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-30T20:22:37.854397] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-30T20:22:37.984717] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T20:22:38.498454] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T20:22:38.654475] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-30T20:22:39.437102] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T20:22:39.454366] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-30T20:22:40.222602] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T20:22:40.254334] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-30T20:22:40.873372] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T20:22:41.054396] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-30T20:22:41.854336] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-30T20:22:42.045837] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T20:22:42.474400] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T20:22:42.654373] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-30T20:22:43.401586] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:22:43.454335] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-30T20:22:44.254366] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-30T20:22:44.595397] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T20:22:44.628272] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T20:22:45.054414] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-30T20:22:45.854344] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-30T20:22:46.176877] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T20:22:46.584278] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T20:22:46.591748] [INFO ] [REMOTE ] OGS: Full fetch complete (48037 records). [2025-09-30T20:22:46.591925] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-30T20:22:46.664906] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-30T20:22:47.028803] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-30T20:22:47.028903] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-30T20:22:47.029754] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-30T20:22:47.029818] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-30T20:22:47.030996] [DEBUG] [LOCAL ] OGS: Trimmed 48037 records to 34179 (keeping 200 days of data) [2025-09-30T20:22:47.276058] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T20:22:47.312521] [DEBUG] [LOCAL ] OGS: Primary data saved (34179 records). [2025-09-30T20:22:47.312720] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-30T20:22:47.312821] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 24.6s. Estimated remaining: 1h 41m 18s. Rate: 7.8 symbols/min [2025-09-30T20:22:47.463632] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-30T20:22:47.498534] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:47.549328] [DEBUG] [LOCAL ] OI: Loaded 47163 existing records from primary storage. [2025-09-30T20:22:47.549683] [INFO ] [MAIN ] OI: Loaded 47163 existing records. [2025-09-30T20:22:47.737635] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:22:47.737973] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-30T20:22:47.738042] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-30T20:22:47.741543] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-30T20:22:47.741609] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-30T20:22:48.124858] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:48.254372] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-30T20:22:48.545865] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T20:22:49.056550] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-30T20:22:49.063862] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T20:22:49.854016] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:22:49.863247] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-30T20:22:49.865881] [INFO ] [REMOTE ] OGE: Full fetch complete (66714 records). [2025-09-30T20:22:49.865983] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-30T20:22:50.309121] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-30T20:22:50.309217] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-30T20:22:50.310223] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-30T20:22:50.310359] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-30T20:22:50.311834] [DEBUG] [LOCAL ] OGE: Trimmed 66714 records to 46316 (keeping 200 days of data) [2025-09-30T20:22:50.615181] [DEBUG] [LOCAL ] OGE: Primary data saved (46316 records). [2025-09-30T20:22:50.615379] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-30T20:22:50.615475] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGE took 40.2s. Estimated remaining: 1h 41m 8s. Rate: 7.8 symbols/min [2025-09-30T20:22:50.671501] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-30T20:22:50.824011] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:22:50.856549] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T20:22:50.878157] [DEBUG] [LOCAL ] OIA: Loaded 13902 existing records from primary storage. [2025-09-30T20:22:50.878440] [INFO ] [MAIN ] OIA: Loaded 13902 existing records. [2025-09-30T20:22:51.078602] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:22:51.078898] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-30T20:22:51.078949] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-30T20:22:51.079238] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-30T20:22:51.079298] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-30T20:22:51.459515] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-30T20:22:51.490008] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:22:51.903600] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T20:22:52.254340] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-30T20:22:52.519754] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T20:22:53.054359] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-30T20:22:53.854374] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-30T20:23:05.484867] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (13.23 seconds). [2025-09-30T20:23:05.490459] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-30T20:23:05.598896] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (12.54 seconds). [2025-09-30T20:23:05.615517] [INFO ] [REMOTE ] OHI: Full fetch complete (75108 records). [2025-09-30T20:23:05.615763] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-30T20:23:06.114471] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-30T20:23:06.115032] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-30T20:23:06.116393] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-30T20:23:06.116623] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-30T20:23:06.119402] [DEBUG] [LOCAL ] OHI: Trimmed 75108 records to 51989 (keeping 200 days of data) [2025-09-30T20:23:06.284771] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (12.43 seconds). [2025-09-30T20:23:06.300777] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (14.84 seconds). [2025-09-30T20:23:06.317217] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-30T20:23:06.325556] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-30T20:23:06.570869] [DEBUG] [LOCAL ] OHI: Primary data saved (51989 records). [2025-09-30T20:23:06.571067] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-30T20:23:06.571177] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OHI took 41.5s. Estimated remaining: 1h 41m 5s. Rate: 7.8 symbols/min [2025-09-30T20:23:06.635698] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:23:06.697005] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-30T20:23:06.787556] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:06.835724] [DEBUG] [LOCAL ] OII: Loaded 42631 existing records from primary storage. [2025-09-30T20:23:06.836059] [INFO ] [MAIN ] OII: Loaded 42631 existing records. [2025-09-30T20:23:07.030851] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:07.031075] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-30T20:23:07.031126] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-30T20:23:07.031563] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-30T20:23:07.031624] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-30T20:23:07.436702] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:07.437128] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-30T20:23:07.768121] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T20:23:07.772388] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-30T20:23:07.933712] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T20:23:07.943812] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-30T20:23:08.051489] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T20:23:08.063721] [INFO ] [REMOTE ] OGN: Full fetch complete (76814 records). [2025-09-30T20:23:08.063900] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-30T20:23:08.513099] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-30T20:23:08.513192] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-30T20:23:08.514322] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-30T20:23:08.514390] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-30T20:23:08.515927] [DEBUG] [LOCAL ] OGN: Trimmed 76814 records to 53097 (keeping 200 days of data) [2025-09-30T20:23:08.776425] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T20:23:08.788539] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-30T20:23:08.804176] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:23:08.811900] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-30T20:23:08.929757] [DEBUG] [LOCAL ] OGN: Primary data saved (53097 records). [2025-09-30T20:23:08.930015] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-30T20:23:08.930134] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OGN took 46.6s. Estimated remaining: 1h 40m 54s. Rate: 7.8 symbols/min [2025-09-30T20:23:09.115419] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:09.155816] [DEBUG] [LOCAL ] OIS: Loaded 40448 existing records from primary storage. [2025-09-30T20:23:09.156187] [INFO ] [MAIN ] OIS: Loaded 40448 existing records. [2025-09-30T20:23:09.354059] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:09.354286] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-30T20:23:09.354341] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-30T20:23:09.355629] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-30T20:23:09.355725] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-30T20:23:09.775084] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:09.775574] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-30T20:23:09.816803] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T20:23:09.828200] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T20:23:09.832508] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-30T20:23:09.832869] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-30T20:23:10.327639] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T20:23:10.336863] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-30T20:23:10.851919] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T20:23:10.854591] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-30T20:23:11.223042] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T20:23:11.231061] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-30T20:23:11.904834] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T20:23:11.910839] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-30T20:23:11.995336] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T20:23:12.023409] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-30T20:23:12.517629] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-30T20:23:12.556588] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-30T20:23:12.567564] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T20:23:12.580419] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-30T20:23:12.759307] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T20:23:12.763235] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-30T20:23:13.645588] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T20:23:13.656766] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-30T20:23:13.857065] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T20:23:13.865514] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-30T20:23:14.046072] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T20:23:14.054012] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-30T20:23:14.195670] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T20:23:14.206150] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-30T20:23:14.923403] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T20:23:14.927325] [INFO ] [REMOTE ] OIA: Full fetch complete (21291 records). [2025-09-30T20:23:14.927432] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-30T20:23:15.340786] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-30T20:23:15.340995] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-30T20:23:15.341552] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-30T20:23:15.341688] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-30T20:23:15.343561] [DEBUG] [LOCAL ] OIA: Trimmed 21291 records to 13804 (keeping 200 days of data) [2025-09-30T20:23:15.445023] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T20:23:15.465310] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-30T20:23:15.483928] [DEBUG] [LOCAL ] OIA: Primary data saved (13804 records). [2025-09-30T20:23:15.484082] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-30T20:23:15.484191] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIA took 24.9s. Estimated remaining: 1h 40m 46s. Rate: 7.8 symbols/min [2025-09-30T20:23:15.705674] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:15.734086] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T20:23:15.744058] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-30T20:23:15.794447] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-30T20:23:15.795060] [INFO ] [MAIN ] OKE: Loaded 53536 existing records. [2025-09-30T20:23:15.937252] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T20:23:15.966566] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-30T20:23:16.043833] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:16.044088] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-30T20:23:16.044161] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-30T20:23:16.045452] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-30T20:23:16.045554] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-30T20:23:16.457537] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:16.458133] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-30T20:23:16.967154] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T20:23:17.056285] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-30T20:23:17.062332] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T20:23:17.348677] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T20:23:17.683306] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T20:23:17.854367] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-30T20:23:18.171094] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:23:18.654365] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-30T20:23:19.412934] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T20:23:19.454338] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-30T20:23:20.254405] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-30T20:23:20.559627] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T20:23:20.973511] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T20:23:21.054409] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-30T20:23:21.854399] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-30T20:23:21.934974] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T20:23:22.359915] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:23:22.654368] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-30T20:23:22.743972] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:23:23.454398] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-30T20:23:24.193699] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T20:23:24.203858] [INFO ] [REMOTE ] OI: Full fetch complete (68143 records). [2025-09-30T20:23:24.204031] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-30T20:23:24.259589] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-30T20:23:24.681628] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-30T20:23:24.681814] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-30T20:23:24.682900] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-30T20:23:24.682966] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-30T20:23:24.685239] [DEBUG] [LOCAL ] OI: Trimmed 68143 records to 47157 (keeping 200 days of data) [2025-09-30T20:23:24.937544] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T20:23:25.014942] [DEBUG] [LOCAL ] OI: Primary data saved (47157 records). [2025-09-30T20:23:25.015090] [INFO ] [MAIN ] OI: Full history saved. [2025-09-30T20:23:25.015176] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OI took 37.7s. Estimated remaining: 1h 40m 39s. Rate: 7.8 symbols/min [2025-09-30T20:23:25.059433] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-30T20:23:25.210343] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:25.210511] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-30T20:23:25.210550] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-30T20:23:25.210689] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-30T20:23:25.210744] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-30T20:23:25.210788] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-30T20:23:25.210822] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-30T20:23:25.619282] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:25.854410] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-30T20:23:25.970155] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T20:23:26.322114] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T20:23:26.536102] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T20:23:26.544545] [INFO ] [REMOTE ] OIS: Full fetch complete (57085 records). [2025-09-30T20:23:26.544754] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-30T20:23:26.659471] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-30T20:23:27.024265] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-30T20:23:27.024451] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-30T20:23:27.025505] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-30T20:23:27.025575] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-30T20:23:27.026937] [DEBUG] [LOCAL ] OIS: Trimmed 57085 records to 40448 (keeping 200 days of data) [2025-09-30T20:23:27.269082] [DEBUG] [LOCAL ] OIS: Primary data saved (40448 records). [2025-09-30T20:23:27.269213] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-30T20:23:27.269293] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OIS took 18.3s. Estimated remaining: 1h 40m 29s. Rate: 7.8 symbols/min [2025-09-30T20:23:27.458695] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:27.458816] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-30T20:23:27.514064] [DEBUG] [LOCAL ] OLN: Loaded 51761 existing records from primary storage. [2025-09-30T20:23:27.514430] [INFO ] [MAIN ] OLN: Loaded 51761 existing records. [2025-09-30T20:23:27.711955] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:27.712207] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-30T20:23:27.712297] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-30T20:23:27.713561] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-30T20:23:27.713626] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-30T20:23:28.125735] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:28.254344] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-30T20:23:29.055846] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-30T20:23:29.059168] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:23:29.068894] [INFO ] [REMOTE ] OII: Full fetch complete (61899 records). [2025-09-30T20:23:29.069052] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-30T20:23:29.482790] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-30T20:23:29.556732] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-30T20:23:29.557429] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-30T20:23:29.558557] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-30T20:23:29.559466] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-30T20:23:29.562928] [DEBUG] [LOCAL ] OII: Trimmed 61899 records to 42500 (keeping 200 days of data) [2025-09-30T20:23:29.696269] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T20:23:29.759386] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T20:23:29.878579] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-30T20:23:29.939016] [DEBUG] [LOCAL ] OII: Primary data saved (42500 records). [2025-09-30T20:23:29.939312] [INFO ] [MAIN ] OII: Full history saved. [2025-09-30T20:23:29.939456] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OII took 23.4s. Estimated remaining: 1h 40m 19s. Rate: 7.8 symbols/min [2025-09-30T20:23:30.134946] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:30.148928] [DEBUG] [LOCAL ] OLP: Loaded 9852 existing records from primary storage. [2025-09-30T20:23:30.149198] [INFO ] [MAIN ] OLP: Loaded 9852 existing records. [2025-09-30T20:23:30.367849] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:30.368487] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-30T20:23:30.368752] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-30T20:23:30.369272] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-30T20:23:30.369334] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-30T20:23:30.659456] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-30T20:23:30.866887] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:30.870305] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:23:31.454404] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-30T20:23:32.254385] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-30T20:23:32.307568] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T20:23:32.444517] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T20:23:33.054364] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-30T20:23:33.212690] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T20:23:33.854396] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-30T20:23:34.597044] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T20:23:34.625075] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T20:23:34.654350] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-30T20:23:35.454330] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-30T20:23:35.523158] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:23:36.254390] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-30T20:23:36.341766] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:23:37.054419] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-30T20:23:37.854385] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-30T20:23:37.896251] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T20:23:38.517411] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T20:23:38.654361] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-30T20:23:39.338596] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-30T20:23:39.454353] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-30T20:23:39.536725] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T20:23:40.254385] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-30T20:23:41.054578] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-30T20:23:41.058132] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T20:23:41.719513] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T20:23:41.854377] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-30T20:23:42.078008] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-30T20:23:42.654387] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-30T20:23:42.686736] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T20:23:43.454380] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-30T20:23:44.254421] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-30T20:23:44.799777] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T20:23:45.054330] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-30T20:23:45.185665] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:23:45.283034] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T20:23:45.854394] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-30T20:23:46.654362] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-30T20:23:47.347113] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T20:23:47.454372] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-30T20:23:47.740770] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T20:23:48.254336] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-30T20:23:48.328246] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T20:23:49.054379] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-30T20:23:49.173522] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:23:49.189788] [INFO ] [REMOTE ] OKE: Full fetch complete (77098 records). [2025-09-30T20:23:49.190025] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-30T20:23:49.191345] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:23:49.191508] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:23:49.191587] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:23:49.191694] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-30T20:23:49.191778] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-09-30T20:23:49.191819] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-09-30T20:23:49.192698] [DEBUG] [LOCAL ] OKE: Deleted derivative data file. [2025-09-30T20:23:49.192809] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OKE took 33.7s. Estimated remaining: 1h 40m 17s. Rate: 7.8 symbols/min [2025-09-30T20:23:49.395688] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:49.462411] [DEBUG] [LOCAL ] OMC: Loaded 53288 existing records from primary storage. [2025-09-30T20:23:49.463021] [INFO ] [MAIN ] OMC: Loaded 53288 existing records. [2025-09-30T20:23:49.695876] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:49.696217] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-30T20:23:49.696295] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-30T20:23:49.698216] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-30T20:23:49.698277] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-30T20:23:49.862884] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-30T20:23:50.098760] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:50.108554] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T20:23:50.112032] [INFO ] [REMOTE ] OLP: Full fetch complete (14157 records). [2025-09-30T20:23:50.112129] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-30T20:23:50.525391] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-30T20:23:50.525490] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-30T20:23:50.525877] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-30T20:23:50.525958] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-30T20:23:50.526933] [DEBUG] [LOCAL ] OLP: Trimmed 14157 records to 9868 (keeping 200 days of data) [2025-09-30T20:23:50.612440] [DEBUG] [LOCAL ] OLP: Primary data saved (9868 records). [2025-09-30T20:23:50.612612] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-30T20:23:50.612791] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 20.7s. Estimated remaining: 1h 40m 6s. Rate: 7.8 symbols/min [2025-09-30T20:23:50.661491] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-30T20:23:50.813514] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:23:50.862147] [DEBUG] [LOCAL ] OMF: Loaded 46132 existing records from primary storage. [2025-09-30T20:23:50.862547] [INFO ] [MAIN ] OMF: Loaded 46132 existing records. [2025-09-30T20:23:51.079007] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:23:51.079272] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-30T20:23:51.079330] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-30T20:23:51.080544] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-30T20:23:51.080627] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-30T20:23:51.510597] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:23:51.511185] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-30T20:23:51.618228] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:23:51.668633] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T20:23:51.761263] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (6.71 seconds). [2025-09-30T20:23:52.254328] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-30T20:23:53.054348] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-30T20:23:53.190057] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:23:53.244072] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T20:23:53.854386] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-30T20:23:54.654357] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-30T20:23:54.907569] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T20:23:55.454355] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-30T20:23:55.842610] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-30T20:23:56.254375] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-30T20:23:56.432102] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T20:23:56.543862] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T20:23:57.054355] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-30T20:23:57.854363] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-30T20:23:57.988121] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:23:58.654399] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-30T20:23:59.275832] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T20:23:59.425040] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T20:23:59.454349] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-30T20:24:00.254389] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-30T20:24:01.054415] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-30T20:24:01.226283] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T20:24:01.239174] [INFO ] [REMOTE ] OLN: Full fetch complete (74640 records). [2025-09-30T20:24:01.239359] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-30T20:24:01.768019] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-30T20:24:01.768164] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-30T20:24:01.769477] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-30T20:24:01.770446] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-30T20:24:01.808349] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:24:01.821279] [DEBUG] [LOCAL ] OLN: Trimmed 74640 records to 51761 (keeping 200 days of data) [2025-09-30T20:24:01.891065] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-30T20:24:02.083464] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T20:24:02.142598] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (5.89 seconds). [2025-09-30T20:24:02.327467] [DEBUG] [LOCAL ] OLN: Primary data saved (51761 records). [2025-09-30T20:24:02.327627] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-30T20:24:02.327804] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OLN took 35.1s. Estimated remaining: 1h 40m 0s. Rate: 7.8 symbols/min [2025-09-30T20:24:02.523351] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:02.579319] [DEBUG] [LOCAL ] OMI: Loaded 45834 existing records from primary storage. [2025-09-30T20:24:02.579716] [INFO ] [MAIN ] OMI: Loaded 45834 existing records. [2025-09-30T20:24:02.663698] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-30T20:24:02.789584] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:02.789893] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-30T20:24:02.789948] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-30T20:24:02.790980] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-30T20:24:02.791063] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-30T20:24:03.205139] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:03.454422] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-30T20:24:03.573962] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T20:24:04.254412] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-30T20:24:04.982195] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-30T20:24:05.054328] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-30T20:24:05.082446] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T20:24:05.607738] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T20:24:05.854370] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-30T20:24:06.032185] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T20:24:06.654408] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-30T20:24:07.223983] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T20:24:07.454358] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-30T20:24:08.254377] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-30T20:24:08.423541] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T20:24:08.534741] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:24:09.054379] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-30T20:24:09.854429] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-30T20:24:10.654369] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-30T20:24:10.816599] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-30T20:24:10.894297] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T20:24:11.454480] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-30T20:24:11.531099] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T20:24:11.543383] [INFO ] [REMOTE ] OMC: Full fetch complete (76592 records). [2025-09-30T20:24:11.543579] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-30T20:24:11.544789] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:24:11.544905] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:24:11.545006] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:24:11.545082] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-30T20:24:11.545164] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-09-30T20:24:11.545219] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-09-30T20:24:11.545925] [DEBUG] [LOCAL ] OMC: Deleted derivative data file. [2025-09-30T20:24:11.546046] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 22.4s. Estimated remaining: 1h 39m 53s. Rate: 7.8 symbols/min [2025-09-30T20:24:11.767315] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:11.818080] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T20:24:11.837381] [DEBUG] [LOCAL ] ONIT: Loaded 7730 existing records from primary storage. [2025-09-30T20:24:11.838257] [INFO ] [MAIN ] ONIT: Loaded 7730 existing records. [2025-09-30T20:24:12.054679] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:12.055060] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-30T20:24:12.055181] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-30T20:24:12.055490] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-30T20:24:12.055552] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-30T20:24:12.254888] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-30T20:24:12.507087] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:12.543042] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T20:24:12.554558] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-30T20:24:12.554806] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-30T20:24:12.555626] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:24:12.555744] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:24:12.555789] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:24:12.555855] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-30T20:24:12.555922] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-30T20:24:12.555964] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-30T20:24:12.556067] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-30T20:24:12.556146] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OKLO took 47.5s. Estimated remaining: 1h 39m 42s. Rate: 7.8 symbols/min [2025-09-30T20:24:12.744417] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:12.780449] [DEBUG] [LOCAL ] ONL: Loaded 30907 existing records from primary storage. [2025-09-30T20:24:12.780771] [INFO ] [MAIN ] ONL: Loaded 30907 existing records. [2025-09-30T20:24:12.973105] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:12.973304] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-30T20:24:12.973369] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-30T20:24:12.974217] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-30T20:24:12.974281] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-30T20:24:13.060695] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-30T20:24:13.395565] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:13.864835] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-30T20:24:13.872497] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T20:24:14.654402] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-30T20:24:14.664799] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T20:24:14.835055] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T20:24:15.454421] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-30T20:24:16.254376] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-30T20:24:16.533460] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T20:24:16.780719] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-30T20:24:16.891943] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T20:24:17.054385] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-30T20:24:17.854402] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-30T20:24:18.283823] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T20:24:18.634585] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T20:24:18.654355] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-30T20:24:19.454363] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-30T20:24:19.479679] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:24:20.254377] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-30T20:24:20.556853] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T20:24:21.054420] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-30T20:24:21.854417] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-30T20:24:21.920146] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T20:24:22.137784] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:24:22.654389] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-30T20:24:23.454432] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-30T20:24:23.609539] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T20:24:24.019196] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T20:24:24.254443] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-30T20:24:24.340851] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T20:24:25.056158] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-30T20:24:25.692415] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T20:24:25.821277] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T20:24:25.854390] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-30T20:24:26.654380] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-30T20:24:26.906109] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T20:24:27.454363] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-30T20:24:28.229291] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T20:24:28.254352] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-30T20:24:29.056149] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-30T20:24:29.059324] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:24:29.069558] [INFO ] [REMOTE ] OMF: Full fetch complete (66806 records). [2025-09-30T20:24:29.069816] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-30T20:24:29.564139] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-30T20:24:29.564253] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-30T20:24:29.565333] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-30T20:24:29.565417] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-30T20:24:29.567361] [DEBUG] [LOCAL ] OMF: Trimmed 66806 records to 46163 (keeping 200 days of data) [2025-09-30T20:24:29.857826] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-30T20:24:29.884461] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T20:24:29.958815] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T20:24:29.968298] [DEBUG] [LOCAL ] OMF: Primary data saved (46163 records). [2025-09-30T20:24:29.968459] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-30T20:24:29.968579] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMF took 39.4s. Estimated remaining: 1h 39m 39s. Rate: 7.8 symbols/min [2025-09-30T20:24:30.166947] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:30.224828] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-09-30T20:24:30.225227] [INFO ] [MAIN ] ONON: Loaded 53612 existing records. [2025-09-30T20:24:30.421167] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:30.421435] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-30T20:24:30.421508] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-30T20:24:30.422747] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-30T20:24:30.422813] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-30T20:24:30.659556] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-30T20:24:30.878832] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:31.454389] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-30T20:24:31.552103] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T20:24:31.571087] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T20:24:31.573742] [INFO ] [REMOTE ] ONIT: Full fetch complete (11120 records). [2025-09-30T20:24:31.573826] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-30T20:24:31.975552] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-30T20:24:31.975694] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-30T20:24:31.976071] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-30T20:24:31.976154] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-30T20:24:31.976715] [DEBUG] [LOCAL ] ONIT: Trimmed 11120 records to 7735 (keeping 200 days of data) [2025-09-30T20:24:32.023538] [DEBUG] [LOCAL ] ONIT: Primary data saved (7735 records). [2025-09-30T20:24:32.023720] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-30T20:24:32.023847] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONIT took 20.5s. Estimated remaining: 1h 39m 29s. Rate: 7.8 symbols/min [2025-09-30T20:24:32.237967] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:32.261872] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-30T20:24:32.265059] [DEBUG] [LOCAL ] ONTF: Loaded 22638 existing records from primary storage. [2025-09-30T20:24:32.265523] [INFO ] [MAIN ] ONTF: Loaded 22638 existing records. [2025-09-30T20:24:32.465793] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:32.466054] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-30T20:24:32.466110] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-30T20:24:32.466694] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-30T20:24:32.466788] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-30T20:24:32.860090] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:33.054397] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-30T20:24:33.534132] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T20:24:33.634104] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T20:24:33.854518] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-30T20:24:34.654360] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-30T20:24:34.835926] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T20:24:34.847601] [INFO ] [REMOTE ] OMI: Full fetch complete (64228 records). [2025-09-30T20:24:34.847807] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-30T20:24:35.237490] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T20:24:35.342700] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-30T20:24:35.343038] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-30T20:24:35.344114] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-30T20:24:35.344184] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-30T20:24:35.345769] [DEBUG] [LOCAL ] OMI: Trimmed 64228 records to 45815 (keeping 200 days of data) [2025-09-30T20:24:35.454444] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-30T20:24:35.635429] [DEBUG] [LOCAL ] OMI: Primary data saved (45815 records). [2025-09-30T20:24:35.635608] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-30T20:24:35.635734] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. OMI took 33.3s. Estimated remaining: 1h 39m 19s. Rate: 7.8 symbols/min [2025-09-30T20:24:35.841258] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:24:35.904846] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T20:24:35.917688] [DEBUG] [LOCAL ] ONTO: Loaded 46628 existing records from primary storage. [2025-09-30T20:24:35.918437] [INFO ] [MAIN ] ONTO: Loaded 46628 existing records. [2025-09-30T20:24:36.116155] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:24:36.116720] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-30T20:24:36.116780] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-30T20:24:36.118383] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-30T20:24:36.118446] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-30T20:24:36.259473] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-30T20:24:36.533137] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:24:37.054361] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-30T20:24:37.375551] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:24:37.424350] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T20:24:37.854361] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-30T20:24:38.625874] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T20:24:38.654563] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-30T20:24:39.454384] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-30T20:24:39.525567] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T20:24:39.545539] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T20:24:40.254379] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-30T20:24:41.054340] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-30T20:24:41.557100] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T20:24:41.807494] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:24:41.854372] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-30T20:24:42.541678] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:24:42.654338] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-30T20:24:42.777186] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T20:24:43.454345] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-30T20:24:43.843135] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T20:24:44.254394] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-30T20:24:44.831615] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T20:24:45.054387] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-30T20:24:45.375700] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T20:24:45.854400] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-30T20:24:46.654325] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-30T20:24:46.676228] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T20:24:46.773249] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T20:24:47.454548] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-30T20:24:48.254336] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-30T20:24:48.603595] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T20:24:48.637776] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:24:49.054356] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-30T20:24:49.854328] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-30T20:24:50.172586] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T20:24:50.230537] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T20:24:50.654372] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-30T20:24:51.454348] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-30T20:24:51.562991] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:24:51.803745] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T20:24:52.254371] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-30T20:24:53.054352] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-30T20:24:53.389427] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T20:24:53.424365] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T20:24:53.429968] [INFO ] [REMOTE ] ONL: Full fetch complete (43295 records). [2025-09-30T20:24:53.430140] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-30T20:24:53.854413] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-30T20:24:53.894060] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-30T20:24:53.894287] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-30T20:24:53.895369] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-30T20:24:53.895436] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-30T20:24:53.896609] [DEBUG] [LOCAL ] ONL: Trimmed 43295 records to 30730 (keeping 200 days of data) [2025-09-30T20:24:54.088607] [DEBUG] [LOCAL ] ONL: Primary data saved (30730 records). [2025-09-30T20:24:54.088784] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-30T20:24:54.088931] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONL took 41.5s. Estimated remaining: 1h 39m 17s. Rate: 7.8 symbols/min [2025-09-30T20:24:54.654376] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-30T20:24:55.033366] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T20:24:55.068232] [INFO ] [REMOTE ] ONTF: Full fetch complete (31520 records). [2025-09-30T20:24:55.068426] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-30T20:24:55.117684] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-30T20:24:55.463497] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-30T20:24:55.523195] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-30T20:24:55.523330] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-30T20:24:55.524075] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-30T20:24:55.524147] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-30T20:24:55.525416] [DEBUG] [LOCAL ] ONTF: Trimmed 31520 records to 22578 (keeping 200 days of data) [2025-09-30T20:24:55.674213] [DEBUG] [LOCAL ] ONTF: Primary data saved (22578 records). [2025-09-30T20:24:55.674384] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-30T20:24:55.674523] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 23.7s. Estimated remaining: 1h 39m 6s. Rate: 7.8 symbols/min [2025-09-30T20:24:56.353088] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T20:24:56.364598] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-30T20:24:57.675385] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-30T20:24:57.692119] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-30T20:24:58.055762] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T20:24:58.073285] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-30T20:24:59.753508] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T20:24:59.765808] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-30T20:24:59.877099] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T20:24:59.889518] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-30T20:25:01.648328] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T20:25:01.661963] [INFO ] [REMOTE ] ONTO: Full fetch complete (65872 records). [2025-09-30T20:25:01.662162] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-30T20:25:02.134957] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-30T20:25:02.135176] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-30T20:25:02.136378] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-30T20:25:02.136535] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-30T20:25:02.138815] [DEBUG] [LOCAL ] ONTO: Trimmed 65872 records to 46658 (keeping 200 days of data) [2025-09-30T20:25:02.281398] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T20:25:02.298297] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-30T20:25:02.516781] [DEBUG] [LOCAL ] ONTO: Primary data saved (46658 records). [2025-09-30T20:25:02.516947] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-30T20:25:02.517068] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 26.9s. Estimated remaining: 1h 38m 58s. Rate: 7.8 symbols/min [2025-09-30T20:25:04.496305] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T20:25:04.510220] [INFO ] [REMOTE ] ONON: Full fetch complete (77570 records). [2025-09-30T20:25:04.510377] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-30T20:25:04.973354] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-30T20:25:04.973445] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-30T20:25:04.974565] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-30T20:25:04.974635] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-30T20:25:04.976361] [DEBUG] [LOCAL ] ONON: Trimmed 77570 records to 53612 (keeping 200 days of data) [2025-09-30T20:25:05.332912] [DEBUG] [LOCAL ] ONON: Primary data saved (53612 records). [2025-09-30T20:25:05.333071] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-30T20:25:05.333168] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONON took 35.4s. Estimated remaining: 1h 38m 48s. Rate: 7.8 symbols/min [2025-09-30T20:25:06.029671] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:06.044945] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:06.179235] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:06.185844] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:06.212390] [DEBUG] [LOCAL ] OPP: Loaded 11581 existing records from primary storage. [2025-09-30T20:25:06.219783] [INFO ] [MAIN ] OPP: Loaded 11581 existing records. [2025-09-30T20:25:06.225664] [DEBUG] [LOCAL ] OOMA: Loaded 18881 existing records from primary storage. [2025-09-30T20:25:06.263411] [DEBUG] [LOCAL ] OPAD: Loaded 21052 existing records from primary storage. [2025-09-30T20:25:06.252491] [INFO ] [MAIN ] OOMA: Loaded 18881 existing records. [2025-09-30T20:25:06.333122] [INFO ] [MAIN ] OPAD: Loaded 21052 existing records. [2025-09-30T20:25:06.714464] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:06.726518] [DEBUG] [LOCAL ] OPFI: Loaded 46507 existing records from primary storage. [2025-09-30T20:25:06.742474] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-30T20:25:06.758182] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-30T20:25:06.792008] [INFO ] [MAIN ] OPFI: Loaded 46507 existing records. [2025-09-30T20:25:06.813929] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-30T20:25:06.814111] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-30T20:25:06.915697] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:06.982327] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-30T20:25:06.955966] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:06.982558] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-30T20:25:07.009537] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-30T20:25:07.042540] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-30T20:25:07.106902] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-30T20:25:07.112209] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-30T20:25:07.156889] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-30T20:25:07.178139] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-30T20:25:07.356927] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:07.494881] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-30T20:25:07.584542] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-30T20:25:07.627205] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-30T20:25:07.775212] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-30T20:25:08.302147] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:08.326155] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-30T20:25:08.532034] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:08.568518] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-30T20:25:08.646909] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:08.668820] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-30T20:25:08.850599] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:08.851020] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-30T20:25:09.247317] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T20:25:09.252150] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-30T20:25:09.496005] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T20:25:09.499527] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-30T20:25:09.609105] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T20:25:09.613947] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-30T20:25:10.136751] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T20:25:10.139033] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-30T20:25:10.153927] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T20:25:10.157200] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-30T20:25:10.332339] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T20:25:10.340826] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-30T20:25:10.513859] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T20:25:10.519903] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-30T20:25:10.672209] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T20:25:10.675308] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-30T20:25:10.818173] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T20:25:10.820895] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-30T20:25:11.313879] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T20:25:11.363031] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T20:25:11.454364] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-30T20:25:11.531596] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:25:12.049180] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T20:25:12.258598] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-30T20:25:12.265980] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T20:25:13.054520] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-30T20:25:13.270254] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:25:13.854329] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-30T20:25:14.654443] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-30T20:25:14.691394] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:25:15.023895] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T20:25:15.454462] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-30T20:25:15.518301] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:25:16.172541] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T20:25:16.254392] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-30T20:25:16.897233] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T20:25:17.054448] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-30T20:25:17.854436] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-30T20:25:18.002154] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T20:25:18.654394] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-30T20:25:19.454412] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-30T20:25:19.817620] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T20:25:19.881886] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T20:25:20.254398] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-30T20:25:20.368821] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T20:25:21.054409] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-30T20:25:21.332072] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T20:25:21.854368] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-30T20:25:22.004295] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T20:25:22.007626] [INFO ] [REMOTE ] OPP: Full fetch complete (17522 records). [2025-09-30T20:25:22.007773] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-30T20:25:22.446415] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-30T20:25:22.446525] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-30T20:25:22.447017] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-30T20:25:22.447085] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-30T20:25:22.447787] [DEBUG] [LOCAL ] OPP: Trimmed 17522 records to 11643 (keeping 200 days of data) [2025-09-30T20:25:22.531800] [DEBUG] [LOCAL ] OPP: Primary data saved (11643 records). [2025-09-30T20:25:22.531988] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-30T20:25:22.532087] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 17.2s. Estimated remaining: 1h 38m 45s. Rate: 7.8 symbols/min [2025-09-30T20:25:22.659518] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-30T20:25:22.724142] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:22.724321] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-30T20:25:22.724360] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-30T20:25:22.724473] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-30T20:25:22.724516] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-30T20:25:22.724560] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-30T20:25:22.724592] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-30T20:25:23.122822] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:23.228103] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T20:25:23.454418] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-30T20:25:24.194231] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-30T20:25:24.254467] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-30T20:25:24.766819] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:25:25.054406] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-30T20:25:25.854332] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-30T20:25:25.981921] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T20:25:26.004422] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T20:25:26.654369] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-30T20:25:26.766087] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T20:25:27.454424] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-30T20:25:27.738922] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T20:25:28.254410] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-30T20:25:28.967004] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T20:25:29.054345] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-30T20:25:29.257459] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T20:25:29.854436] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-30T20:25:30.533057] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T20:25:30.590005] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T20:25:30.654397] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-30T20:25:31.454425] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-30T20:25:32.096855] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T20:25:32.254417] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-30T20:25:32.648293] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:25:33.054390] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-30T20:25:33.854360] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-30T20:25:34.201063] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T20:25:34.206443] [INFO ] [REMOTE ] OOMA: Full fetch complete (25915 records). [2025-09-30T20:25:34.206632] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-30T20:25:34.672842] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-30T20:25:34.675601] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-30T20:25:34.703160] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-30T20:25:34.703312] [INFO ] [REMOTE ] OPAD: Full fetch complete (24468 records). [2025-09-30T20:25:34.703448] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-30T20:25:34.703510] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-30T20:25:34.704378] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-30T20:25:34.704483] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-30T20:25:34.786303] [DEBUG] [LOCAL ] OOMA: Trimmed 25915 records to 18846 (keeping 200 days of data) [2025-09-30T20:25:35.235773] [DEBUG] [LOCAL ] OOMA: Primary data saved (18846 records). [2025-09-30T20:25:35.263787] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-30T20:25:35.265533] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-30T20:25:35.265455] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OOMA took 29.9s. Estimated remaining: 1h 38m 40s. Rate: 7.8 symbols/min [2025-09-30T20:25:35.270888] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-30T20:25:35.279260] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-30T20:25:35.305626] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-30T20:25:35.365898] [DEBUG] [LOCAL ] OPAD: Trimmed 24468 records to 21396 (keeping 200 days of data) [2025-09-30T20:25:35.492571] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T20:25:35.557354] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-30T20:25:35.580908] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:35.639472] [DEBUG] [LOCAL ] OPAD: Primary data saved (21396 records). [2025-09-30T20:25:35.639825] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-30T20:25:35.639967] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPAD took 30.3s. Estimated remaining: 1h 38m 28s. Rate: 7.8 symbols/min [2025-09-30T20:25:35.808817] [DEBUG] [LOCAL ] OR: Loaded 46068 existing records from primary storage. [2025-09-30T20:25:35.809855] [INFO ] [MAIN ] OR: Loaded 46068 existing records. [2025-09-30T20:25:36.003721] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:36.043381] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-30T20:25:36.181521] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:36.181852] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-30T20:25:36.181906] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-30T20:25:36.182950] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-30T20:25:36.183051] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-30T20:25:36.267085] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-30T20:25:36.331495] [DEBUG] [LOCAL ] ORA: Loaded 32437 existing records from primary storage. [2025-09-30T20:25:36.338014] [INFO ] [MAIN ] ORA: Loaded 32437 existing records. [2025-09-30T20:25:36.751610] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T20:25:36.784956] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:36.803270] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-30T20:25:36.819338] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-30T20:25:36.843848] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-30T20:25:36.876636] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:36.876734] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-30T20:25:37.058922] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-30T20:25:37.286347] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:37.854378] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-30T20:25:38.024961] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T20:25:38.133134] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T20:25:38.143415] [INFO ] [REMOTE ] OPFI: Full fetch complete (67806 records). [2025-09-30T20:25:38.143563] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-30T20:25:38.565025] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-30T20:25:38.565127] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-30T20:25:38.566240] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-30T20:25:38.566316] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-30T20:25:38.568132] [DEBUG] [LOCAL ] OPFI: Trimmed 67806 records to 46477 (keeping 200 days of data) [2025-09-30T20:25:38.661921] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-30T20:25:38.883125] [DEBUG] [LOCAL ] OPFI: Primary data saved (46477 records). [2025-09-30T20:25:38.883929] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-30T20:25:38.884203] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 33.5s. Estimated remaining: 1h 38m 18s. Rate: 7.8 symbols/min [2025-09-30T20:25:39.078473] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:39.140992] [DEBUG] [LOCAL ] ORC: Loaded 52330 existing records from primary storage. [2025-09-30T20:25:39.141356] [INFO ] [MAIN ] ORC: Loaded 52330 existing records. [2025-09-30T20:25:39.357118] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:25:39.357537] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-30T20:25:39.357600] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-30T20:25:39.359183] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-30T20:25:39.359250] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-30T20:25:39.458813] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-30T20:25:39.611199] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T20:25:39.636146] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T20:25:39.864214] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:40.254363] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-30T20:25:41.054387] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-30T20:25:41.196746] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T20:25:41.663433] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T20:25:41.854369] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-30T20:25:41.917991] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T20:25:42.654379] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-30T20:25:43.056176] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T20:25:43.454367] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-30T20:25:43.979503] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T20:25:44.254351] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-30T20:25:45.054398] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-30T20:25:45.420051] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T20:25:45.720015] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T20:25:45.854332] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-30T20:25:46.264036] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T20:25:46.654422] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-30T20:25:47.454335] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-30T20:25:47.477474] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T20:25:48.035262] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T20:25:48.254405] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-30T20:25:48.754714] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T20:25:49.054338] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-30T20:25:49.236076] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T20:25:49.854382] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-30T20:25:50.602757] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T20:25:50.654408] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-30T20:25:51.463142] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-30T20:25:51.484163] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T20:25:51.523005] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:25:51.526018] [INFO ] [REMOTE ] OPY: Full fetch complete (10011 records). [2025-09-30T20:25:51.526154] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-30T20:25:51.754233] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:25:51.754530] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:25:51.754604] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:25:51.754717] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-30T20:25:51.754798] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-30T20:25:51.754839] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-30T20:25:51.754881] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-30T20:25:51.754943] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OPY took 29.2s. Estimated remaining: 1h 38m 13s. Rate: 7.8 symbols/min [2025-09-30T20:25:51.941170] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:25:51.941365] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-30T20:25:51.941469] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-30T20:25:51.941600] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-30T20:25:51.941671] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-30T20:25:51.941747] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-30T20:25:51.941784] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-30T20:25:52.259463] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-30T20:25:52.337996] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:25:52.776082] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T20:25:53.054439] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-30T20:25:53.871104] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-30T20:25:53.906208] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T20:25:54.324138] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T20:25:54.654402] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-30T20:25:55.393371] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T20:25:55.454400] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-30T20:25:56.254363] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-30T20:25:56.918244] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-30T20:25:57.054366] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-30T20:25:57.197346] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T20:25:57.452690] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-30T20:25:57.839893] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T20:25:57.854301] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-30T20:25:58.654372] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-30T20:25:59.454370] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-30T20:25:59.605828] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:26:00.245120] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T20:26:00.256044] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-30T20:26:00.341690] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T20:26:01.054714] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-30T20:26:01.702543] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T20:26:01.854445] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-30T20:26:02.054063] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T20:26:02.654334] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-30T20:26:02.776975] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:26:03.454586] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-30T20:26:04.254332] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-30T20:26:04.402117] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T20:26:04.973833] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T20:26:04.982262] [INFO ] [REMOTE ] ORA: Full fetch complete (49314 records). [2025-09-30T20:26:04.982568] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-30T20:26:05.064007] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-30T20:26:05.458823] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T20:26:05.475929] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-30T20:26:05.488451] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-30T20:26:05.490069] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-30T20:26:05.490186] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-30T20:26:05.492019] [DEBUG] [LOCAL ] ORA: Trimmed 49314 records to 32445 (keeping 200 days of data) [2025-09-30T20:26:05.734013] [DEBUG] [LOCAL ] ORA: Primary data saved (32445 records). [2025-09-30T20:26:05.734276] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-30T20:26:05.734554] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 30.1s. Estimated remaining: 1h 38m 9s. Rate: 7.8 symbols/min [2025-09-30T20:26:05.860821] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-30T20:26:05.957446] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:05.957705] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-30T20:26:05.957774] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-30T20:26:05.957951] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-30T20:26:05.957999] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-30T20:26:05.958042] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-30T20:26:05.958094] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-30T20:26:06.397438] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:06.654415] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-30T20:26:07.343433] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T20:26:07.454343] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-30T20:26:07.661263] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T20:26:07.700907] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T20:26:08.254341] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-30T20:26:09.054336] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-30T20:26:09.173058] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:26:09.506330] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-30T20:26:09.854375] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-30T20:26:10.502962] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T20:26:10.654422] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-30T20:26:10.819145] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T20:26:11.317963] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T20:26:11.330805] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-30T20:26:11.331034] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-30T20:26:11.333789] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:26:11.333965] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:26:11.334012] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:26:11.334065] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-30T20:26:11.334193] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-30T20:26:11.334303] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-30T20:26:11.334382] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-30T20:26:11.334492] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORCL took 19.6s. Estimated remaining: 1h 37m 60s. Rate: 7.8 symbols/min [2025-09-30T20:26:11.459528] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-30T20:26:11.617464] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:11.660013] [DEBUG] [LOCAL ] ORN: Loaded 31200 existing records from primary storage. [2025-09-30T20:26:11.660405] [INFO ] [MAIN ] ORN: Loaded 31200 existing records. [2025-09-30T20:26:11.874396] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:26:11.874720] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-30T20:26:11.874817] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-30T20:26:11.875155] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-30T20:26:11.875220] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-30T20:26:12.259502] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-30T20:26:12.341876] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:13.054416] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-30T20:26:13.618402] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-30T20:26:13.633616] [INFO ] [REMOTE ] ORC: Full fetch complete (75304 records). [2025-09-30T20:26:13.634044] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-30T20:26:13.880960] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-30T20:26:14.120672] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T20:26:14.152461] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-30T20:26:14.152772] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-30T20:26:14.154590] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-30T20:26:14.154707] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-30T20:26:14.173575] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T20:26:14.181388] [DEBUG] [LOCAL ] ORC: Trimmed 75304 records to 52357 (keeping 200 days of data) [2025-09-30T20:26:14.530740] [DEBUG] [LOCAL ] ORC: Primary data saved (52357 records). [2025-09-30T20:26:14.530909] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-30T20:26:14.531031] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORC took 35.6s. Estimated remaining: 1h 37m 50s. Rate: 7.8 symbols/min [2025-09-30T20:26:14.660381] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-30T20:26:14.744929] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:14.822424] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-30T20:26:14.822849] [INFO ] [MAIN ] OSCR: Loaded 53722 existing records. [2025-09-30T20:26:15.106622] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:26:15.106896] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-30T20:26:15.106950] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-30T20:26:15.108268] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-30T20:26:15.108335] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-30T20:26:15.459610] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-30T20:26:15.582285] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:15.614808] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T20:26:16.001676] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T20:26:16.254365] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-30T20:26:17.061792] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-30T20:26:17.065567] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T20:26:17.854355] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-30T20:26:18.353963] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T20:26:18.366264] [INFO ] [REMOTE ] OR: Full fetch complete (65331 records). [2025-09-30T20:26:18.366483] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-30T20:26:18.659753] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-30T20:26:18.849870] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-30T20:26:18.850104] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-30T20:26:18.851368] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-30T20:26:18.851571] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-30T20:26:18.853743] [DEBUG] [LOCAL ] OR: Trimmed 65331 records to 46074 (keeping 200 days of data) [2025-09-30T20:26:19.015896] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T20:26:19.207887] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T20:26:19.283345] [DEBUG] [LOCAL ] OR: Primary data saved (46074 records). [2025-09-30T20:26:19.283579] [INFO ] [MAIN ] OR: Full history saved. [2025-09-30T20:26:19.283768] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. OR took 44.0s. Estimated remaining: 1h 37m 41s. Rate: 7.8 symbols/min [2025-09-30T20:26:19.459470] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-30T20:26:19.513226] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:19.513410] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-30T20:26:19.513470] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-30T20:26:19.513580] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-30T20:26:19.513635] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-30T20:26:19.513729] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-30T20:26:19.513770] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-30T20:26:19.934873] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:20.162704] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T20:26:20.254394] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-30T20:26:20.927695] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T20:26:21.054385] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-30T20:26:21.689620] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T20:26:21.854377] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-30T20:26:22.465629] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T20:26:22.654418] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-30T20:26:23.454394] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-30T20:26:23.816671] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T20:26:24.081184] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T20:26:24.254432] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-30T20:26:24.972908] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T20:26:25.054376] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-30T20:26:25.854366] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-30T20:26:26.146504] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T20:26:26.654457] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-30T20:26:26.815253] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T20:26:26.881628] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T20:26:27.454398] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-30T20:26:28.254361] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-30T20:26:28.710917] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T20:26:29.039046] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T20:26:29.054299] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-30T20:26:29.854408] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-30T20:26:29.994442] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T20:26:30.281715] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T20:26:30.654379] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-30T20:26:31.217699] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T20:26:31.454358] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-30T20:26:32.254371] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-30T20:26:32.425633] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T20:26:32.491972] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T20:26:33.054372] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-30T20:26:33.854362] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-30T20:26:34.001630] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T20:26:34.654369] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-30T20:26:35.131394] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-30T20:26:35.224715] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:26:35.454380] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-30T20:26:36.126425] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T20:26:36.133604] [INFO ] [REMOTE ] ORN: Full fetch complete (45622 records). [2025-09-30T20:26:36.133802] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-30T20:26:36.257744] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-30T20:26:36.616879] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-30T20:26:36.617009] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-30T20:26:36.618345] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-30T20:26:36.618446] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-30T20:26:36.619732] [DEBUG] [LOCAL ] ORN: Trimmed 45622 records to 31091 (keeping 200 days of data) [2025-09-30T20:26:36.816115] [DEBUG] [LOCAL ] ORN: Primary data saved (31091 records). [2025-09-30T20:26:36.816254] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-30T20:26:36.816354] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORN took 25.5s. Estimated remaining: 1h 37m 38s. Rate: 7.8 symbols/min [2025-09-30T20:26:37.025103] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:37.025366] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-30T20:26:37.025467] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-30T20:26:37.025633] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-30T20:26:37.025725] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-30T20:26:37.025919] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-30T20:26:37.026003] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-30T20:26:37.066441] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-30T20:26:37.183278] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T20:26:37.501029] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:37.854363] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-30T20:26:37.882552] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T20:26:38.167458] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:26:38.167898] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-30T20:26:38.168003] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:26:38.168053] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-30T20:26:38.168089] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:26:38.168131] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-30T20:26:38.168188] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-30T20:26:38.168224] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-30T20:26:38.168264] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-30T20:26:38.168356] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OTF took 1.4s. Estimated remaining: 1h 37m 27s. Rate: 7.8 symbols/min [2025-09-30T20:26:38.349723] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:38.349890] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-09-30T20:26:38.349927] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-09-30T20:26:38.350037] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-30T20:26:38.350078] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-30T20:26:38.350118] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-09-30T20:26:38.350149] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-30T20:26:38.659472] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-30T20:26:38.730297] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:39.426923] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-30T20:26:39.454364] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-30T20:26:40.254394] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-30T20:26:40.760299] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T20:26:41.054379] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-30T20:26:41.681676] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T20:26:41.854358] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-30T20:26:42.021010] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T20:26:42.309315] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-09-30T20:26:42.654420] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-30T20:26:43.457876] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-30T20:26:43.463563] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T20:26:43.474416] [INFO ] [REMOTE ] ORI: Full fetch complete (70193 records). [2025-09-30T20:26:43.474553] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-30T20:26:43.686919] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:26:43.688736] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:26:43.688851] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:26:43.688957] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-30T20:26:43.689045] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-30T20:26:43.689104] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-30T20:26:43.689150] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-30T20:26:43.689256] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. ORI took 38.0s. Estimated remaining: 1h 37m 19s. Rate: 7.8 symbols/min [2025-09-30T20:26:43.872991] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:43.927793] [DEBUG] [LOCAL ] OUT: Loaded 47841 existing records from primary storage. [2025-09-30T20:26:43.928181] [INFO ] [MAIN ] OUT: Loaded 47841 existing records. [2025-09-30T20:26:44.128789] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:26:44.129191] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-30T20:26:44.129324] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-30T20:26:44.131425] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-30T20:26:44.131493] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-30T20:26:44.257791] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-30T20:26:44.611246] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:44.614156] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T20:26:45.056544] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-30T20:26:45.062837] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T20:26:45.854394] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-30T20:26:46.265480] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-30T20:26:46.659508] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-30T20:26:46.677687] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:26:46.796950] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T20:26:46.806515] [INFO ] [REMOTE ] OSK: Full fetch complete (61328 records). [2025-09-30T20:26:46.806737] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-30T20:26:47.020743] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:26:47.021461] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:26:47.021552] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:26:47.021687] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-30T20:26:47.021772] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-30T20:26:47.021813] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-30T20:26:47.021855] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-30T20:26:47.021930] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSK took 27.7s. Estimated remaining: 1h 37m 9s. Rate: 7.8 symbols/min [2025-09-30T20:26:47.209950] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:47.278216] [DEBUG] [LOCAL ] OVV: Loaded 53519 existing records from primary storage. [2025-09-30T20:26:47.278612] [INFO ] [MAIN ] OVV: Loaded 53519 existing records. [2025-09-30T20:26:47.478102] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-30T20:26:47.485754] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:26:47.486045] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-30T20:26:47.486100] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-30T20:26:47.486553] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-30T20:26:47.486613] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-30T20:26:47.871900] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:48.254420] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-30T20:26:49.054377] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-30T20:26:49.171617] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T20:26:49.219745] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T20:26:49.300622] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-30T20:26:49.854397] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-30T20:26:50.637051] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T20:26:50.654306] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-30T20:26:51.454411] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-30T20:26:52.220829] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-30T20:26:52.233013] [INFO ] [REMOTE ] OSCR: Full fetch complete (77491 records). [2025-09-30T20:26:52.233172] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-30T20:26:52.269142] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-30T20:26:52.682509] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-30T20:26:52.682793] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-30T20:26:52.684114] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-30T20:26:52.684232] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-30T20:26:52.713811] [DEBUG] [LOCAL ] OSCR: Trimmed 77491 records to 53722 (keeping 200 days of data) [2025-09-30T20:26:52.734424] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-30T20:26:53.058415] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-30T20:26:53.126775] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T20:26:53.160340] [DEBUG] [LOCAL ] OSCR: Primary data saved (53722 records). [2025-09-30T20:26:53.160533] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-30T20:26:53.160673] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OSCR took 38.6s. Estimated remaining: 1h 37m 0s. Rate: 7.8 symbols/min [2025-09-30T20:26:53.356813] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:26:53.394768] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T20:26:53.471283] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-30T20:26:53.471685] [INFO ] [MAIN ] OWL: Loaded 53555 existing records. [2025-09-30T20:26:53.699623] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:26:53.699885] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-30T20:26:53.699934] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-30T20:26:53.700558] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-30T20:26:53.700619] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-30T20:26:53.862995] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-30T20:26:54.094182] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:26:54.654378] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-30T20:26:54.920852] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T20:26:55.087251] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-30T20:26:55.454411] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-30T20:26:55.675911] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T20:26:56.254361] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-30T20:26:57.007306] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T20:26:57.054377] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-30T20:26:57.854463] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-30T20:26:58.121022] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T20:26:58.659493] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-30T20:26:58.676636] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T20:26:59.326410] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T20:26:59.454367] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-30T20:27:00.254401] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-30T20:27:00.637399] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T20:27:01.054339] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-30T20:27:01.255562] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T20:27:01.854398] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-30T20:27:02.083728] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T20:27:02.654324] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-30T20:27:02.780043] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:27:02.962849] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T20:27:03.454432] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-30T20:27:04.254400] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-30T20:27:04.623767] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T20:27:05.054381] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-30T20:27:05.146015] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T20:27:05.236780] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T20:27:05.854411] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-30T20:27:06.654361] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-30T20:27:07.113533] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T20:27:07.390997] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T20:27:07.454317] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-30T20:27:07.643498] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T20:27:08.254379] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-30T20:27:08.876458] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T20:27:08.889204] [INFO ] [REMOTE ] OTIS: Full fetch complete (75499 records). [2025-09-30T20:27:08.889389] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-30T20:27:08.890353] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:27:08.890493] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:27:08.890538] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:27:08.890579] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-30T20:27:08.890639] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-09-30T20:27:08.890727] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-09-30T20:27:08.890775] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-09-30T20:27:08.890840] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OTIS took 30.7s. Estimated remaining: 1h 36m 56s. Rate: 7.8 symbols/min [2025-09-30T20:27:09.057588] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-30T20:27:09.081882] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:09.092635] [DEBUG] [LOCAL ] OWLT: Loaded 8898 existing records from primary storage. [2025-09-30T20:27:09.092904] [INFO ] [MAIN ] OWLT: Loaded 8898 existing records. [2025-09-30T20:27:09.290911] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:09.291200] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-30T20:27:09.291377] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-30T20:27:09.291607] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-30T20:27:09.291727] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-30T20:27:09.722013] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:09.724722] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-30T20:27:09.854365] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-30T20:27:10.437266] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T20:27:10.620453] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T20:27:10.654368] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-30T20:27:11.454381] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-30T20:27:12.139257] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T20:27:12.234246] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T20:27:12.254323] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-30T20:27:13.054362] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-30T20:27:13.854417] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-30T20:27:14.328723] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T20:27:14.329080] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T20:27:14.346046] [INFO ] [REMOTE ] OVV: Full fetch complete (77318 records). [2025-09-30T20:27:14.346309] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-30T20:27:14.659438] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-30T20:27:14.832219] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-30T20:27:14.832328] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-30T20:27:14.833751] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-30T20:27:14.833912] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-30T20:27:14.835768] [DEBUG] [LOCAL ] OVV: Trimmed 77318 records to 53519 (keeping 200 days of data) [2025-09-30T20:27:14.981541] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T20:27:15.249134] [DEBUG] [LOCAL ] OVV: Primary data saved (53519 records). [2025-09-30T20:27:15.249311] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-30T20:27:15.249406] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OVV took 28.2s. Estimated remaining: 1h 36m 48s. Rate: 7.8 symbols/min [2025-09-30T20:27:15.439478] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:15.461304] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-30T20:27:15.476699] [DEBUG] [LOCAL ] OXM: Loaded 33382 existing records from primary storage. [2025-09-30T20:27:15.477050] [INFO ] [MAIN ] OXM: Loaded 33382 existing records. [2025-09-30T20:27:15.672818] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:15.673076] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-30T20:27:15.673132] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-30T20:27:15.673770] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-30T20:27:15.673831] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-30T20:27:16.056861] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:16.254347] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-30T20:27:16.434180] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T20:27:16.810445] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T20:27:17.054374] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-30T20:27:17.495778] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T20:27:17.803020] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T20:27:17.854342] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-30T20:27:18.535047] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T20:27:18.654346] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-30T20:27:19.454377] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-30T20:27:19.874552] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T20:27:20.254386] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-30T20:27:21.054534] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-30T20:27:21.208098] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:27:21.854524] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-30T20:27:21.938593] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T20:27:22.019854] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T20:27:22.654379] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-30T20:27:23.454350] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-30T20:27:23.803847] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T20:27:24.254490] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-30T20:27:24.365735] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T20:27:24.366830] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T20:27:24.380858] [INFO ] [REMOTE ] OUT: Full fetch complete (68955 records). [2025-09-30T20:27:24.381002] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-30T20:27:24.816858] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-30T20:27:24.816964] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-30T20:27:24.818118] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-30T20:27:24.818189] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-30T20:27:24.819561] [DEBUG] [LOCAL ] OUT: Trimmed 68955 records to 47822 (keeping 200 days of data) [2025-09-30T20:27:25.056893] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-30T20:27:25.150744] [DEBUG] [LOCAL ] OUT: Primary data saved (47822 records). [2025-09-30T20:27:25.150924] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-30T20:27:25.151065] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OUT took 41.5s. Estimated remaining: 1h 36m 41s. Rate: 7.8 symbols/min [2025-09-30T20:27:25.351063] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:25.351303] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-30T20:27:25.351477] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-30T20:27:25.351690] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-30T20:27:25.351846] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-30T20:27:25.351918] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-30T20:27:25.352069] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-30T20:27:25.478638] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T20:27:25.812929] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:25.854360] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-30T20:27:26.654336] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-30T20:27:26.979565] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T20:27:27.009728] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T20:27:27.451680] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T20:27:27.454467] [INFO ] [REMOTE ] OWLT: Full fetch complete (11583 records). [2025-09-30T20:27:27.454721] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-30T20:27:27.454336] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-30T20:27:27.845687] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-30T20:27:27.845785] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-30T20:27:27.846081] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-30T20:27:27.846126] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-30T20:27:27.846845] [DEBUG] [LOCAL ] OWLT: Trimmed 11583 records to 8831 (keeping 200 days of data) [2025-09-30T20:27:27.901979] [DEBUG] [LOCAL ] OWLT: Primary data saved (8831 records). [2025-09-30T20:27:27.902130] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-30T20:27:27.902218] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWLT took 19.0s. Estimated remaining: 1h 36m 31s. Rate: 7.8 symbols/min [2025-09-30T20:27:28.124526] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:28.208902] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-30T20:27:28.209339] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-30T20:27:28.259552] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-30T20:27:28.517421] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:28.517712] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-30T20:27:28.517781] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-30T20:27:28.519459] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-30T20:27:28.519536] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-30T20:27:29.063626] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-30T20:27:29.111363] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:29.137822] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T20:27:29.200379] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T20:27:29.854364] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-30T20:27:30.654361] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-30T20:27:31.091764] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T20:27:31.104229] [INFO ] [REMOTE ] OWL: Full fetch complete (77529 records). [2025-09-30T20:27:31.104435] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-30T20:27:31.458418] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-30T20:27:31.578549] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-30T20:27:31.580614] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T20:27:31.580951] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-30T20:27:31.590775] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-30T20:27:31.591523] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-30T20:27:31.593442] [DEBUG] [LOCAL ] OWL: Trimmed 77529 records to 53555 (keeping 200 days of data) [2025-09-30T20:27:31.729954] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:27:31.999144] [DEBUG] [LOCAL ] OWL: Primary data saved (53555 records). [2025-09-30T20:27:31.999328] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-30T20:27:31.999448] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OWL took 38.8s. Estimated remaining: 1h 36m 22s. Rate: 7.8 symbols/min [2025-09-30T20:27:32.179443] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:32.196623] [DEBUG] [LOCAL ] PAC: Loaded 11581 existing records from primary storage. [2025-09-30T20:27:32.196907] [INFO ] [MAIN ] PAC: Loaded 11581 existing records. [2025-09-30T20:27:32.262709] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-30T20:27:32.386993] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:32.387240] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-30T20:27:32.387350] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-30T20:27:32.387872] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-30T20:27:32.387937] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-30T20:27:32.799527] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:33.054378] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-30T20:27:33.189778] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:27:33.273902] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T20:27:33.854369] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-30T20:27:34.169208] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T20:27:34.654360] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-30T20:27:34.808024] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T20:27:35.454358] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-30T20:27:35.589027] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T20:27:36.254377] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-30T20:27:36.890223] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T20:27:37.054399] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-30T20:27:37.854382] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-30T20:27:38.026892] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T20:27:38.088446] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T20:27:38.654393] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-30T20:27:38.810214] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T20:27:39.454349] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-30T20:27:40.007152] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T20:27:40.254362] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-30T20:27:40.404826] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T20:27:40.785186] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:27:41.054402] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-30T20:27:41.854354] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-30T20:27:42.343758] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T20:27:42.654371] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-30T20:27:42.739335] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:27:43.299953] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:27:43.454374] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-30T20:27:44.254360] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-30T20:27:44.321702] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T20:27:45.054345] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-30T20:27:45.453319] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T20:27:45.854330] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-30T20:27:45.915960] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T20:27:46.654402] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-30T20:27:47.454337] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-30T20:27:47.535222] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T20:27:47.787097] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T20:27:48.254334] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-30T20:27:48.400772] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:27:49.054368] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-30T20:27:49.854364] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-30T20:27:50.416957] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T20:27:50.574904] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T20:27:50.583439] [INFO ] [REMOTE ] OXM: Full fetch complete (46232 records). [2025-09-30T20:27:50.583744] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-30T20:27:50.659045] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-30T20:27:50.674826] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T20:27:51.029133] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-30T20:27:51.029255] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-30T20:27:51.030220] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-30T20:27:51.030298] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-30T20:27:51.031538] [DEBUG] [LOCAL ] OXM: Trimmed 46232 records to 33295 (keeping 200 days of data) [2025-09-30T20:27:51.259452] [DEBUG] [LOCAL ] OXM: Primary data saved (33295 records). [2025-09-30T20:27:51.259892] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-30T20:27:51.260149] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXM took 36.0s. Estimated remaining: 1h 36m 20s. Rate: 7.8 symbols/min [2025-09-30T20:27:51.451973] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:51.454336] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-30T20:27:51.489853] [DEBUG] [LOCAL ] PACK: Loaded 31769 existing records from primary storage. [2025-09-30T20:27:51.490219] [INFO ] [MAIN ] PACK: Loaded 31769 existing records. [2025-09-30T20:27:51.697258] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:51.697768] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-30T20:27:51.697989] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-30T20:27:51.698499] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-30T20:27:51.698578] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-30T20:27:51.865065] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T20:27:51.922243] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-09-30T20:27:51.940252] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-30T20:27:52.036411] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:27:52.067903] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:27:52.080595] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:27:52.086417] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-30T20:27:52.112627] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-30T20:27:52.147073] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-30T20:27:52.172903] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-30T20:27:52.172762] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:52.173065] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. OXY took 27.0s. Estimated remaining: 1h 36m 9s. Rate: 7.8 symbols/min [2025-09-30T20:27:52.259481] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-30T20:27:52.362971] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:27:52.404279] [DEBUG] [LOCAL ] PACS: Loaded 34371 existing records from primary storage. [2025-09-30T20:27:52.404607] [INFO ] [MAIN ] PACS: Loaded 34371 existing records. [2025-09-30T20:27:52.602627] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:27:52.602877] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-30T20:27:52.602926] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-30T20:27:52.603636] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-30T20:27:52.603732] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-30T20:27:53.002061] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:27:53.054319] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-30T20:27:53.297149] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T20:27:53.439636] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T20:27:53.854366] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-30T20:27:54.465005] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T20:27:54.633991] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T20:27:54.654343] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-30T20:27:55.454409] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-30T20:27:55.738810] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:27:56.254402] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-30T20:27:57.054413] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-30T20:27:57.547898] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T20:27:57.580005] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T20:27:57.854381] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-30T20:27:57.968462] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T20:27:58.654353] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-30T20:27:59.454373] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-30T20:27:59.545757] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T20:27:59.797254] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T20:28:00.254357] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-30T20:28:00.493219] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T20:28:01.054362] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-30T20:28:01.854337] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-30T20:28:01.990387] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T20:28:01.993257] [INFO ] [REMOTE ] PAC: Full fetch complete (16489 records). [2025-09-30T20:28:01.993336] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-30T20:28:02.467923] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-30T20:28:02.470230] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-30T20:28:02.470110] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T20:28:02.471132] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-30T20:28:02.483298] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-30T20:28:02.484816] [DEBUG] [LOCAL ] PAC: Trimmed 16489 records to 11555 (keeping 200 days of data) [2025-09-30T20:28:02.581713] [DEBUG] [LOCAL ] PAC: Primary data saved (11555 records). [2025-09-30T20:28:02.582041] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-30T20:28:02.582551] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAC took 30.6s. Estimated remaining: 1h 36m 2s. Rate: 7.8 symbols/min [2025-09-30T20:28:02.659559] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-30T20:28:02.796933] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:02.825892] [DEBUG] [LOCAL ] PAG: Loaded 21760 existing records from primary storage. [2025-09-30T20:28:02.826203] [INFO ] [MAIN ] PAG: Loaded 21760 existing records. [2025-09-30T20:28:03.022801] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:03.023397] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-30T20:28:03.023485] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-30T20:28:03.024189] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-30T20:28:03.024252] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-30T20:28:03.451247] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T20:28:03.465391] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:03.461680] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-30T20:28:04.254368] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-30T20:28:04.953599] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T20:28:05.040908] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T20:28:05.053615] [INFO ] [REMOTE ] PAAS: Full fetch complete (77388 records). [2025-09-30T20:28:05.053872] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-30T20:28:05.054393] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-30T20:28:05.467781] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T20:28:05.600506] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-30T20:28:05.600665] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-30T20:28:05.603376] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-30T20:28:05.603517] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-30T20:28:05.606238] [DEBUG] [LOCAL ] PAAS: Trimmed 77388 records to 53603 (keeping 200 days of data) [2025-09-30T20:28:05.855503] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-30T20:28:05.980046] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-30T20:28:05.980191] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-30T20:28:05.980399] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAAS took 38.1s. Estimated remaining: 1h 35m 53s. Rate: 7.8 symbols/min [2025-09-30T20:28:06.187587] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:06.251778] [DEBUG] [LOCAL ] PAGS: Loaded 52691 existing records from primary storage. [2025-09-30T20:28:06.252231] [INFO ] [MAIN ] PAGS: Loaded 52691 existing records. [2025-09-30T20:28:06.475793] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:06.476136] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-30T20:28:06.476365] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-30T20:28:06.477628] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-30T20:28:06.477745] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-30T20:28:06.679624] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-30T20:28:06.766591] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:28:07.025825] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T20:28:07.031283] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:07.454414] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-30T20:28:07.924569] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T20:28:08.195569] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T20:28:08.254414] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-30T20:28:09.054369] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-30T20:28:09.644223] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T20:28:09.854353] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-30T20:28:10.219132] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T20:28:10.654405] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-30T20:28:11.283820] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T20:28:11.454414] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-30T20:28:11.826979] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T20:28:12.254376] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-30T20:28:12.923814] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T20:28:13.054411] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-30T20:28:13.687689] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T20:28:13.854435] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-30T20:28:14.654400] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-30T20:28:14.898454] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T20:28:14.961934] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T20:28:15.454363] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-30T20:28:15.982626] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T20:28:16.254405] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-30T20:28:17.054417] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-30T20:28:17.056007] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:28:17.066741] [INFO ] [REMOTE ] PACS: Full fetch complete (50813 records). [2025-09-30T20:28:17.066856] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-30T20:28:17.489091] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-30T20:28:17.489383] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-30T20:28:17.490372] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-30T20:28:17.511995] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-30T20:28:17.513884] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T20:28:17.523386] [DEBUG] [LOCAL ] PACS: Trimmed 50813 records to 34461 (keeping 200 days of data) [2025-09-30T20:28:17.738062] [DEBUG] [LOCAL ] PACS: Primary data saved (34461 records). [2025-09-30T20:28:17.738287] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-30T20:28:17.738431] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACS took 25.6s. Estimated remaining: 1h 35m 47s. Rate: 7.8 symbols/min [2025-09-30T20:28:17.859585] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-30T20:28:17.941716] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:17.948623] [DEBUG] [LOCAL ] PAI: Loaded 2720 existing records from primary storage. [2025-09-30T20:28:17.948909] [INFO ] [MAIN ] PAI: Loaded 2720 existing records. [2025-09-30T20:28:18.157477] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:18.157716] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-30T20:28:18.157779] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-30T20:28:18.158024] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-30T20:28:18.158085] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-30T20:28:18.561025] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:18.654320] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-30T20:28:18.853704] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T20:28:19.356998] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T20:28:19.365334] [INFO ] [REMOTE ] PACK: Full fetch complete (43783 records). [2025-09-30T20:28:19.365508] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-30T20:28:19.463967] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-30T20:28:19.788297] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-30T20:28:19.788521] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-30T20:28:19.789486] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-30T20:28:19.789590] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-30T20:28:19.797821] [DEBUG] [LOCAL ] PACK: Trimmed 43783 records to 31771 (keeping 200 days of data) [2025-09-30T20:28:19.811556] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T20:28:20.006414] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T20:28:20.024444] [DEBUG] [LOCAL ] PACK: Primary data saved (31771 records). [2025-09-30T20:28:20.024576] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-30T20:28:20.024818] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PACK took 28.8s. Estimated remaining: 1h 35m 37s. Rate: 7.8 symbols/min [2025-09-30T20:28:20.209052] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:20.209282] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-30T20:28:20.209358] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-30T20:28:20.209472] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-30T20:28:20.209515] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-30T20:28:20.209558] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-30T20:28:20.209592] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-30T20:28:20.259530] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-30T20:28:20.751064] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:21.054408] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-30T20:28:21.409851] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T20:28:21.456202] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-30T20:28:21.854403] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-30T20:28:22.654412] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-30T20:28:22.911024] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:28:22.911351] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-30T20:28:22.911445] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:28:22.911492] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-30T20:28:22.911526] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:28:22.911589] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-30T20:28:22.911700] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-30T20:28:22.911756] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-30T20:28:22.911798] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-30T20:28:22.911852] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 2.9s. Estimated remaining: 1h 35m 27s. Rate: 7.8 symbols/min [2025-09-30T20:28:23.103684] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:23.119329] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T20:28:23.152183] [DEBUG] [LOCAL ] PAM: Loaded 28012 existing records from primary storage. [2025-09-30T20:28:23.152479] [INFO ] [MAIN ] PAM: Loaded 28012 existing records. [2025-09-30T20:28:23.355284] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:23.355497] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-30T20:28:23.355546] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-30T20:28:23.355960] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-30T20:28:23.356020] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-30T20:28:23.460046] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-30T20:28:23.742133] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:24.254360] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-30T20:28:24.779505] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:28:24.797379] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T20:28:25.054349] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-30T20:28:25.763724] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T20:28:25.854377] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-30T20:28:26.476415] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T20:28:26.654409] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-30T20:28:27.213404] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T20:28:27.454367] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-30T20:28:28.254368] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-30T20:28:29.054443] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-30T20:28:29.206429] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T20:28:29.263781] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T20:28:29.854363] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-30T20:28:30.394347] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T20:28:30.654335] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-30T20:28:31.038476] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T20:28:31.042956] [INFO ] [REMOTE ] PAG: Full fetch complete (30196 records). [2025-09-30T20:28:31.043074] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-30T20:28:31.466718] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-30T20:28:31.482003] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-30T20:28:31.482109] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-30T20:28:31.483971] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-30T20:28:31.484074] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-30T20:28:31.485205] [DEBUG] [LOCAL ] PAG: Trimmed 30196 records to 21779 (keeping 200 days of data) [2025-09-30T20:28:31.641240] [DEBUG] [LOCAL ] PAG: Primary data saved (21779 records). [2025-09-30T20:28:31.641385] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-30T20:28:31.641487] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAG took 29.1s. Estimated remaining: 1h 35m 20s. Rate: 7.8 symbols/min [2025-09-30T20:28:31.842307] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:31.887244] [DEBUG] [LOCAL ] PAR: Loaded 32589 existing records from primary storage. [2025-09-30T20:28:31.887579] [INFO ] [MAIN ] PAR: Loaded 32589 existing records. [2025-09-30T20:28:32.112275] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:32.112802] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:28:32.116004] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-30T20:28:32.116300] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-30T20:28:32.117164] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-30T20:28:32.117244] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-30T20:28:32.266395] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-30T20:28:32.300680] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T20:28:32.593488] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:32.758786] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T20:28:33.054369] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-30T20:28:33.854372] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-30T20:28:34.450001] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T20:28:34.654359] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-30T20:28:35.169291] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T20:28:35.307429] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T20:28:35.454407] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-30T20:28:36.108577] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T20:28:36.110270] [INFO ] [REMOTE ] PAI: Full fetch complete (4121 records). [2025-09-30T20:28:36.110392] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-30T20:28:36.265168] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-30T20:28:36.522209] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-30T20:28:36.522302] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-30T20:28:36.522541] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-30T20:28:36.522603] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-30T20:28:36.523039] [DEBUG] [LOCAL ] PAI: Trimmed 4121 records to 2692 (keeping 200 days of data) [2025-09-30T20:28:36.541141] [DEBUG] [LOCAL ] PAI: Primary data saved (2692 records). [2025-09-30T20:28:36.541273] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-30T20:28:36.541369] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAI took 18.8s. Estimated remaining: 1h 35m 11s. Rate: 7.8 symbols/min [2025-09-30T20:28:36.725602] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:36.785061] [DEBUG] [LOCAL ] PARR: Loaded 48354 existing records from primary storage. [2025-09-30T20:28:36.785389] [INFO ] [MAIN ] PARR: Loaded 48354 existing records. [2025-09-30T20:28:36.998982] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:36.999276] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-30T20:28:36.999378] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-30T20:28:37.000204] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-30T20:28:37.000269] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-30T20:28:37.059513] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-30T20:28:37.407273] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:37.749853] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T20:28:37.854379] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-30T20:28:38.654414] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-30T20:28:38.956468] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T20:28:39.389270] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T20:28:39.454412] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-30T20:28:39.475098] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T20:28:40.254379] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-30T20:28:40.959447] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T20:28:41.054398] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-30T20:28:41.248886] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:28:41.854388] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-30T20:28:42.661031] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-30T20:28:42.679449] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T20:28:43.454359] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-30T20:28:43.638442] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T20:28:43.700858] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T20:28:44.254431] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-30T20:28:45.017980] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T20:28:45.054336] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-30T20:28:45.571554] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T20:28:45.854362] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-30T20:28:46.606227] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T20:28:46.654345] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-30T20:28:47.454404] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-30T20:28:47.608510] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T20:28:48.237566] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T20:28:48.254300] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-30T20:28:48.931219] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T20:28:49.054434] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-30T20:28:49.541864] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T20:28:49.854372] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-30T20:28:50.654347] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-30T20:28:50.789480] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T20:28:51.454364] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-30T20:28:51.544144] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T20:28:52.184142] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T20:28:52.192473] [INFO ] [REMOTE ] PAM: Full fetch complete (42062 records). [2025-09-30T20:28:52.192625] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-30T20:28:52.266224] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-30T20:28:52.646227] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T20:28:52.648838] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-30T20:28:52.654911] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-30T20:28:52.656268] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-30T20:28:52.656362] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-30T20:28:52.657705] [DEBUG] [LOCAL ] PAM: Trimmed 42062 records to 28078 (keeping 200 days of data) [2025-09-30T20:28:52.838614] [DEBUG] [LOCAL ] PAM: Primary data saved (28078 records). [2025-09-30T20:28:52.838788] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-30T20:28:52.838900] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 29.9s. Estimated remaining: 1h 35m 7s. Rate: 7.8 symbols/min [2025-09-30T20:28:53.033926] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:53.054383] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-30T20:28:53.106935] [DEBUG] [LOCAL ] PATH: Loaded 53677 existing records from primary storage. [2025-09-30T20:28:53.107290] [INFO ] [MAIN ] PATH: Loaded 53677 existing records. [2025-09-30T20:28:53.301448] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:53.301719] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-30T20:28:53.301777] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-30T20:28:53.302489] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-30T20:28:53.302554] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-30T20:28:53.673908] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:53.854329] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-30T20:28:54.121878] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T20:28:54.162573] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T20:28:54.654366] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-30T20:28:55.454362] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-30T20:28:55.555907] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T20:28:56.254352] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-30T20:28:56.546548] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T20:28:56.558479] [INFO ] [REMOTE ] PAGS: Full fetch complete (76329 records). [2025-09-30T20:28:56.558681] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-30T20:28:56.994385] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-30T20:28:56.994488] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-30T20:28:56.995794] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-30T20:28:56.995881] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-30T20:28:56.998260] [DEBUG] [LOCAL ] PAGS: Trimmed 76329 records to 52710 (keeping 200 days of data) [2025-09-30T20:28:57.058425] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-30T20:28:57.334158] [DEBUG] [LOCAL ] PAGS: Primary data saved (52710 records). [2025-09-30T20:28:57.334302] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-30T20:28:57.334389] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAGS took 51.4s. Estimated remaining: 1h 34m 58s. Rate: 7.8 symbols/min [2025-09-30T20:28:57.517413] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:28:57.546335] [DEBUG] [LOCAL ] PAXS: Loaded 20778 existing records from primary storage. [2025-09-30T20:28:57.546612] [INFO ] [MAIN ] PAXS: Loaded 20778 existing records. [2025-09-30T20:28:57.745774] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:28:57.746483] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-30T20:28:57.746965] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-30T20:28:57.747600] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-30T20:28:57.747745] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-30T20:28:57.873809] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T20:28:57.926895] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-30T20:28:58.111412] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-30T20:28:58.246431] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:28:58.654399] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-30T20:28:58.812204] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:28:59.454403] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-30T20:28:59.512726] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T20:29:00.254378] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-30T20:29:01.015822] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T20:29:01.054333] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-30T20:29:01.140157] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-30T20:29:01.854335] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-30T20:29:01.964211] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T20:29:02.020422] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T20:29:02.654394] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-30T20:29:03.454331] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-30T20:29:03.837400] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:29:04.091396] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T20:29:04.254369] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-30T20:29:04.484068] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-30T20:29:05.054403] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-30T20:29:05.854452] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-30T20:29:06.042298] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:29:06.055732] [INFO ] [REMOTE ] PARR: Full fetch complete (68768 records). [2025-09-30T20:29:06.055929] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-30T20:29:06.209049] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T20:29:06.659588] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-30T20:29:06.752706] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-30T20:29:06.752813] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-30T20:29:06.753900] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-30T20:29:06.753966] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-30T20:29:06.755854] [DEBUG] [LOCAL ] PARR: Trimmed 68768 records to 48332 (keeping 200 days of data) [2025-09-30T20:29:07.075719] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T20:29:07.096348] [DEBUG] [LOCAL ] PARR: Primary data saved (48332 records). [2025-09-30T20:29:07.096513] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-30T20:29:07.096629] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PARR took 30.6s. Estimated remaining: 1h 34m 51s. Rate: 7.8 symbols/min [2025-09-30T20:29:07.290094] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:07.331590] [DEBUG] [LOCAL ] PAY: Loaded 38117 existing records from primary storage. [2025-09-30T20:29:07.331921] [INFO ] [MAIN ] PAY: Loaded 38117 existing records. [2025-09-30T20:29:07.459520] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-30T20:29:07.530172] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:07.530385] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-30T20:29:07.530436] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-30T20:29:07.530985] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-30T20:29:07.531047] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-30T20:29:07.918105] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:08.254380] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-30T20:29:08.308833] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T20:29:09.054423] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-30T20:29:09.659291] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:29:09.854336] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-30T20:29:09.985776] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-30T20:29:10.665337] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-30T20:29:10.670958] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T20:29:10.680334] [INFO ] [REMOTE ] PAR: Full fetch complete (47570 records). [2025-09-30T20:29:10.680487] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-30T20:29:11.100899] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-30T20:29:11.101076] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-30T20:29:11.102045] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-30T20:29:11.102146] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-30T20:29:11.103362] [DEBUG] [LOCAL ] PAR: Trimmed 47570 records to 32688 (keeping 200 days of data) [2025-09-30T20:29:11.232639] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T20:29:11.340786] [DEBUG] [LOCAL ] PAR: Primary data saved (32688 records). [2025-09-30T20:29:11.340932] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-30T20:29:11.341017] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAR took 39.7s. Estimated remaining: 1h 34m 42s. Rate: 7.8 symbols/min [2025-09-30T20:29:11.459573] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-30T20:29:11.521781] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:11.567755] [DEBUG] [LOCAL ] PAYC: Loaded 36232 existing records from primary storage. [2025-09-30T20:29:11.568190] [INFO ] [MAIN ] PAYC: Loaded 36232 existing records. [2025-09-30T20:29:11.769988] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:11.770339] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-30T20:29:11.770396] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-30T20:29:11.771207] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-30T20:29:11.771458] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-30T20:29:12.193429] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:12.254372] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-30T20:29:12.812608] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-30T20:29:12.933841] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T20:29:13.054373] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-30T20:29:13.408898] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T20:29:13.854359] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-30T20:29:14.654358] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-30T20:29:15.068466] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T20:29:15.450073] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T20:29:15.457508] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-30T20:29:15.534586] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T20:29:16.254335] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-30T20:29:16.571003] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:29:16.761847] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T20:29:17.054382] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-30T20:29:17.854364] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-30T20:29:18.654349] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-30T20:29:19.454344] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-30T20:29:19.523592] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-30T20:29:19.565015] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T20:29:19.988689] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T20:29:20.254367] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-30T20:29:20.302003] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T20:29:21.054340] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-30T20:29:21.330757] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T20:29:21.854368] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-30T20:29:22.654405] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-30T20:29:22.903736] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T20:29:22.908282] [INFO ] [REMOTE ] PAXS: Full fetch complete (31061 records). [2025-09-30T20:29:22.908407] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-30T20:29:23.335418] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-30T20:29:23.335670] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-30T20:29:23.336861] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-30T20:29:23.337144] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-30T20:29:23.338780] [DEBUG] [LOCAL ] PAXS: Trimmed 31061 records to 20871 (keeping 200 days of data) [2025-09-30T20:29:23.464148] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-30T20:29:23.470786] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T20:29:23.525032] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:29:23.565874] [DEBUG] [LOCAL ] PAXS: Primary data saved (20871 records). [2025-09-30T20:29:23.566034] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-30T20:29:23.566139] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAXS took 26.2s. Estimated remaining: 1h 34m 36s. Rate: 7.8 symbols/min [2025-09-30T20:29:23.766606] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:23.819237] [DEBUG] [LOCAL ] PB: Loaded 41341 existing records from primary storage. [2025-09-30T20:29:23.819695] [INFO ] [MAIN ] PB: Loaded 41341 existing records. [2025-09-30T20:29:24.020986] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:24.021315] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-30T20:29:24.021385] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-30T20:29:24.022114] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-30T20:29:24.022175] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-30T20:29:24.261349] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-30T20:29:24.423614] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:24.991052] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T20:29:25.054342] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-30T20:29:25.177256] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:29:25.854388] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-30T20:29:26.655731] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-30T20:29:26.661795] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T20:29:27.401752] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T20:29:27.454327] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-30T20:29:27.487127] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T20:29:28.254360] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-30T20:29:28.996518] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T20:29:29.054370] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-30T20:29:29.849950] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T20:29:29.860404] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-30T20:29:30.654373] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-30T20:29:30.782280] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T20:29:31.151166] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T20:29:31.454405] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-30T20:29:31.862008] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T20:29:32.260615] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-30T20:29:32.267078] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T20:29:33.054418] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-30T20:29:33.862504] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-30T20:29:33.881947] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T20:29:34.654372] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-30T20:29:35.337103] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T20:29:35.454359] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-30T20:29:35.596428] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-30T20:29:35.611519] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-09-30T20:29:35.611796] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-30T20:29:36.107064] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-30T20:29:36.107287] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-30T20:29:36.108580] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-30T20:29:36.108706] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-30T20:29:36.136636] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T20:29:36.145856] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 53677 (keeping 200 days of data) [2025-09-30T20:29:36.178932] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T20:29:36.273975] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-30T20:29:36.538906] [DEBUG] [LOCAL ] PATH: Primary data saved (53677 records). [2025-09-30T20:29:36.539086] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-30T20:29:36.539179] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PATH took 43.7s. Estimated remaining: 1h 34m 31s. Rate: 7.8 symbols/min [2025-09-30T20:29:36.735394] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:36.789772] [DEBUG] [LOCAL ] PBA: Loaded 48910 existing records from primary storage. [2025-09-30T20:29:36.790185] [INFO ] [MAIN ] PBA: Loaded 48910 existing records. [2025-09-30T20:29:36.977975] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:36.978476] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-30T20:29:36.978597] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-30T20:29:36.979413] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-30T20:29:36.979480] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-30T20:29:37.063951] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-30T20:29:37.330906] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T20:29:37.361748] [INFO ] [REMOTE ] PAYC: Full fetch complete (52735 records). [2025-09-30T20:29:37.383568] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-30T20:29:37.404353] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:29:37.428382] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:29:37.432897] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:37.432980] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:29:37.433418] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-30T20:29:37.433512] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-09-30T20:29:37.433555] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-09-30T20:29:37.434041] [DEBUG] [LOCAL ] PAYC: Deleted derivative data file. [2025-09-30T20:29:37.434159] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAYC took 26.1s. Estimated remaining: 1h 34m 20s. Rate: 7.8 symbols/min [2025-09-30T20:29:37.631138] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:37.690174] [DEBUG] [LOCAL ] PBF: Loaded 53095 existing records from primary storage. [2025-09-30T20:29:37.690577] [INFO ] [MAIN ] PBF: Loaded 53095 existing records. [2025-09-30T20:29:37.855776] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-30T20:29:37.881972] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:37.882284] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-30T20:29:37.882337] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-30T20:29:37.883058] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-30T20:29:37.883120] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-30T20:29:38.275238] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:38.654374] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-30T20:29:38.751625] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T20:29:39.454419] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-30T20:29:39.632194] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:29:40.097962] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T20:29:40.254380] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-30T20:29:41.054463] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-30T20:29:41.284357] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T20:29:41.854359] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-30T20:29:41.893071] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T20:29:42.654357] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-30T20:29:42.709494] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T20:29:43.454366] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-30T20:29:43.529125] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T20:29:43.538133] [INFO ] [REMOTE ] PAY: Full fetch complete (53277 records). [2025-09-30T20:29:43.538298] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-30T20:29:43.960626] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-30T20:29:43.960795] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-30T20:29:43.961790] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-30T20:29:43.961876] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-30T20:29:43.963567] [DEBUG] [LOCAL ] PAY: Trimmed 53277 records to 38045 (keeping 200 days of data) [2025-09-30T20:29:44.095722] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T20:29:44.239907] [DEBUG] [LOCAL ] PAY: Primary data saved (38045 records). [2025-09-30T20:29:44.240068] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-30T20:29:44.240175] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAY took 37.1s. Estimated remaining: 1h 34m 12s. Rate: 7.8 symbols/min [2025-09-30T20:29:44.261750] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-30T20:29:44.464377] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:29:44.500377] [DEBUG] [LOCAL ] PBH: Loaded 31703 existing records from primary storage. [2025-09-30T20:29:44.500718] [INFO ] [MAIN ] PBH: Loaded 31703 existing records. [2025-09-30T20:29:44.688769] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:29:44.688986] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-30T20:29:44.689038] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-30T20:29:44.689683] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-30T20:29:44.689748] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-30T20:29:45.070255] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-30T20:29:45.076010] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:29:45.110348] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T20:29:45.854331] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-30T20:29:45.906411] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T20:29:46.654315] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-30T20:29:46.775511] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T20:29:47.459479] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-30T20:29:47.476962] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T20:29:48.254396] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-30T20:29:48.702041] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T20:29:48.909148] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T20:29:49.054359] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-30T20:29:49.854343] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-30T20:29:49.950986] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T20:29:49.961048] [INFO ] [REMOTE ] PB: Full fetch complete (58383 records). [2025-09-30T20:29:49.961225] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-30T20:29:50.392578] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-30T20:29:50.392702] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-30T20:29:50.393813] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-30T20:29:50.393894] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-30T20:29:50.395273] [DEBUG] [LOCAL ] PB: Trimmed 58383 records to 41405 (keeping 200 days of data) [2025-09-30T20:29:50.654418] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-30T20:29:50.681056] [DEBUG] [LOCAL ] PB: Primary data saved (41405 records). [2025-09-30T20:29:50.681227] [INFO ] [MAIN ] PB: Full history saved. [2025-09-30T20:29:50.681369] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PB took 27.1s. Estimated remaining: 1h 34m 4s. Rate: 7.8 symbols/min [2025-09-30T20:29:51.008459] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T20:29:51.022478] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T20:29:51.454370] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-30T20:29:52.254344] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-30T20:29:52.633690] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T20:29:52.668216] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T20:29:53.054386] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-30T20:29:53.863440] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-30T20:29:53.869197] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T20:29:54.481205] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:29:54.654374] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-30T20:29:55.161546] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T20:29:55.454343] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-30T20:29:56.254437] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-30T20:29:56.312269] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T20:29:56.698411] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T20:29:57.054410] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-30T20:29:57.854363] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-30T20:29:57.946323] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T20:29:58.569729] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T20:29:58.654390] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-30T20:29:59.454383] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-30T20:29:59.650418] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T20:30:00.254404] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-30T20:30:00.438047] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:30:00.506017] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T20:30:01.054385] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-30T20:30:01.854425] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-30T20:30:02.151159] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T20:30:02.654345] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-30T20:30:02.738509] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T20:30:02.751346] [INFO ] [REMOTE ] PBF: Full fetch complete (76593 records). [2025-09-30T20:30:02.751520] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-30T20:30:03.198876] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T20:30:03.271838] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-30T20:30:03.271959] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-30T20:30:03.273594] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-30T20:30:03.273722] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-30T20:30:03.278920] [DEBUG] [LOCAL ] PBF: Trimmed 76593 records to 53115 (keeping 200 days of data) [2025-09-30T20:30:03.480032] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-30T20:30:03.649972] [DEBUG] [LOCAL ] PBF: Primary data saved (53115 records). [2025-09-30T20:30:03.650123] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-30T20:30:03.650269] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBF took 26.2s. Estimated remaining: 1h 33m 58s. Rate: 7.8 symbols/min [2025-09-30T20:30:04.527686] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T20:30:04.542928] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-30T20:30:04.839988] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T20:30:05.054387] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-30T20:30:06.276071] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T20:30:06.288781] [INFO ] [REMOTE ] PBA: Full fetch complete (71410 records). [2025-09-30T20:30:06.288911] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-30T20:30:06.734859] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-30T20:30:06.735087] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-30T20:30:06.736310] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-30T20:30:06.736549] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-30T20:30:06.738455] [DEBUG] [LOCAL ] PBA: Trimmed 71410 records to 48873 (keeping 200 days of data) [2025-09-30T20:30:06.867914] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T20:30:06.883077] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-30T20:30:07.102602] [DEBUG] [LOCAL ] PBA: Primary data saved (48873 records). [2025-09-30T20:30:07.102789] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-30T20:30:07.102885] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBA took 30.6s. Estimated remaining: 1h 33m 49s. Rate: 7.8 symbols/min [2025-09-30T20:30:08.586790] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T20:30:08.595485] [INFO ] [REMOTE ] PBH: Full fetch complete (43282 records). [2025-09-30T20:30:08.595685] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-30T20:30:09.050926] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-30T20:30:09.051021] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-30T20:30:09.051937] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-30T20:30:09.052011] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-30T20:30:09.053197] [DEBUG] [LOCAL ] PBH: Trimmed 43282 records to 31774 (keeping 200 days of data) [2025-09-30T20:30:09.263267] [DEBUG] [LOCAL ] PBH: Primary data saved (31774 records). [2025-09-30T20:30:09.263443] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-30T20:30:09.263631] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBH took 25.0s. Estimated remaining: 1h 33m 39s. Rate: 7.8 symbols/min [2025-09-30T20:30:10.035141] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:10.071804] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:10.120082] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:10.141511] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:10.158171] [DEBUG] [LOCAL ] PCF: Loaded 8692 existing records from primary storage. [2025-09-30T20:30:10.158431] [INFO ] [MAIN ] PCF: Loaded 8692 existing records. [2025-09-30T20:30:10.229161] [DEBUG] [LOCAL ] PBT: Loaded 17219 existing records from primary storage. [2025-09-30T20:30:10.250467] [INFO ] [MAIN ] PBT: Loaded 17219 existing records. [2025-09-30T20:30:10.571282] [DEBUG] [LOCAL ] PBI: Loaded 50003 existing records from primary storage. [2025-09-30T20:30:10.646084] [DEBUG] [LOCAL ] PBR: Loaded 53712 existing records from primary storage. [2025-09-30T20:30:10.654996] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:10.655441] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-30T20:30:10.645962] [INFO ] [MAIN ] PBI: Loaded 50003 existing records. [2025-09-30T20:30:10.660880] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-30T20:30:10.655125] [INFO ] [MAIN ] PBR: Loaded 53712 existing records. [2025-09-30T20:30:10.685518] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:10.707732] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-30T20:30:10.740493] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-30T20:30:10.778421] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-30T20:30:10.788829] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-30T20:30:10.894726] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-30T20:30:10.931022] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-30T20:30:11.357748] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:11.385052] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:11.416293] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-30T20:30:11.400771] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-30T20:30:11.466526] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-30T20:30:11.523263] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-30T20:30:11.610667] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-30T20:30:11.610727] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-30T20:30:11.630142] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-30T20:30:11.650638] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-30T20:30:12.203207] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:12.268792] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-30T20:30:12.400866] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:12.463980] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-30T20:30:12.790779] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:12.796446] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-30T20:30:12.796155] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:12.796756] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-30T20:30:13.563556] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T20:30:13.569135] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-30T20:30:13.647453] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T20:30:13.652008] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-30T20:30:14.293476] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T20:30:14.297199] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-30T20:30:14.628165] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T20:30:14.639063] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-30T20:30:14.728969] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T20:30:14.733460] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-30T20:30:15.038358] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T20:30:15.050932] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-30T20:30:15.067576] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T20:30:15.071225] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-30T20:30:15.447707] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:30:15.454294] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-30T20:30:15.898111] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:30:16.254390] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-30T20:30:16.323283] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:30:16.396709] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T20:30:16.963428] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T20:30:17.025580] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T20:30:17.054314] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-30T20:30:17.854364] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-30T20:30:17.966873] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:30:18.654344] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-30T20:30:18.866286] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:30:19.454366] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-30T20:30:20.254351] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-30T20:30:20.409753] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T20:30:21.054323] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-30T20:30:21.438665] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T20:30:21.624134] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T20:30:21.628156] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-30T20:30:21.854375] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-30T20:30:22.654355] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-30T20:30:23.454373] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-30T20:30:23.788924] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:30:23.976215] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T20:30:24.254372] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-30T20:30:24.932778] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T20:30:25.054331] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-30T20:30:25.070462] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T20:30:25.854361] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-30T20:30:26.654348] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-30T20:30:26.743210] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T20:30:27.454391] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-30T20:30:27.501082] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T20:30:27.981854] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T20:30:28.254359] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-30T20:30:29.054323] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-30T20:30:29.329691] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T20:30:29.402288] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T20:30:29.854355] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-30T20:30:30.654346] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-30T20:30:30.840056] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T20:30:30.844558] [INFO ] [REMOTE ] PBT: Full fetch complete (25294 records). [2025-09-30T20:30:30.844719] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-30T20:30:31.272984] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-30T20:30:31.273266] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-30T20:30:31.273852] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-30T20:30:31.273964] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-30T20:30:31.318220] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-30T20:30:31.321012] [DEBUG] [LOCAL ] PBT: Trimmed 25294 records to 17222 (keeping 200 days of data) [2025-09-30T20:30:31.320835] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T20:30:31.448281] [DEBUG] [LOCAL ] PBT: Primary data saved (17222 records). [2025-09-30T20:30:31.448450] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-30T20:30:31.448543] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PBT took 22.2s. Estimated remaining: 1h 33m 38s. Rate: 7.8 symbols/min [2025-09-30T20:30:31.460770] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-30T20:30:31.679383] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:31.679684] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-30T20:30:31.679748] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-30T20:30:31.679921] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-30T20:30:31.679979] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-30T20:30:31.680027] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-30T20:30:31.680075] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-30T20:30:32.090866] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:32.254388] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-30T20:30:33.054401] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-30T20:30:33.278393] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T20:30:33.854384] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-30T20:30:34.096372] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T20:30:34.100608] [INFO ] [REMOTE ] PCF: Full fetch complete (14196 records). [2025-09-30T20:30:34.100743] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-30T20:30:34.511794] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-30T20:30:34.511934] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-30T20:30:34.512513] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-30T20:30:34.512628] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-30T20:30:34.513524] [DEBUG] [LOCAL ] PCF: Trimmed 14196 records to 8853 (keeping 200 days of data) [2025-09-30T20:30:34.593581] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-30T20:30:34.618371] [DEBUG] [LOCAL ] PCF: Primary data saved (8853 records). [2025-09-30T20:30:34.618565] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-30T20:30:34.618699] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PCF took 25.4s. Estimated remaining: 1h 33m 28s. Rate: 7.8 symbols/min [2025-09-30T20:30:34.662204] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-30T20:30:34.827018] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:34.839587] [DEBUG] [LOCAL ] PCM: Loaded 6781 existing records from primary storage. [2025-09-30T20:30:34.839877] [INFO ] [MAIN ] PCM: Loaded 6781 existing records. [2025-09-30T20:30:35.029023] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:35.029242] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-30T20:30:35.029294] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-30T20:30:35.029552] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-30T20:30:35.029611] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-30T20:30:35.419769] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:35.454324] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-30T20:30:35.586172] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T20:30:35.683768] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T20:30:36.254417] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-30T20:30:37.054436] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-30T20:30:37.124841] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T20:30:37.694416] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-30T20:30:37.854382] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-30T20:30:38.654435] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-30T20:30:38.820239] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T20:30:39.454422] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-30T20:30:39.565625] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:30:39.790826] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T20:30:40.254420] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-30T20:30:41.054338] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-30T20:30:41.574673] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T20:30:41.586737] [INFO ] [REMOTE ] PBI: Full fetch complete (72052 records). [2025-09-30T20:30:41.586931] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-30T20:30:41.856819] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-30T20:30:42.034610] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-30T20:30:42.035126] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-30T20:30:42.036910] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-30T20:30:42.037271] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-30T20:30:42.074713] [DEBUG] [LOCAL ] PBI: Trimmed 72052 records to 49983 (keeping 200 days of data) [2025-09-30T20:30:42.079222] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T20:30:42.230403] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T20:30:42.245473] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-30T20:30:42.246333] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-30T20:30:42.660621] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-30T20:30:42.719476] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-30T20:30:42.720892] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-30T20:30:42.719972] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T20:30:42.723114] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-30T20:30:42.723678] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-30T20:30:42.734519] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 53712 (keeping 200 days of data) [2025-09-30T20:30:43.182300] [DEBUG] [LOCAL ] PBI: Primary data saved (49983 records). [2025-09-30T20:30:43.186376] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-30T20:30:43.190069] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBI took 33.9s. Estimated remaining: 1h 33m 21s. Rate: 7.8 symbols/min [2025-09-30T20:30:43.456524] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-30T20:30:43.463154] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:43.485622] [DEBUG] [LOCAL ] PBR: Primary data saved (53712 records). [2025-09-30T20:30:43.486070] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-30T20:30:43.486201] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 34.2s. Estimated remaining: 1h 33m 10s. Rate: 7.8 symbols/min [2025-09-30T20:30:43.639350] [DEBUG] [LOCAL ] PCN: Loaded 24404 existing records from primary storage. [2025-09-30T20:30:43.676615] [INFO ] [MAIN ] PCN: Loaded 24404 existing records. [2025-09-30T20:30:43.696232] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:43.742343] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-09-30T20:30:43.770293] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-09-30T20:30:43.788347] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-30T20:30:43.805940] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-30T20:30:43.839872] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-09-30T20:30:43.913706] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-30T20:30:43.928575] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:43.964236] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-30T20:30:43.966847] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T20:30:44.000102] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-30T20:30:44.022530] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-30T20:30:44.022773] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-30T20:30:44.264538] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-30T20:30:44.685284] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T20:30:44.869500] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:44.892567] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:45.054338] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-30T20:30:45.331194] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T20:30:45.854367] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-30T20:30:45.918091] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T20:30:46.654369] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-30T20:30:46.769869] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T20:30:47.454382] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-30T20:30:47.549117] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T20:30:48.254402] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-30T20:30:48.289005] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:30:49.054374] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-30T20:30:49.272030] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T20:30:49.854359] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-30T20:30:50.267832] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T20:30:50.654332] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-30T20:30:50.840816] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T20:30:51.454380] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-30T20:30:51.491346] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T20:30:52.224404] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T20:30:52.254351] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-30T20:30:53.054379] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-30T20:30:53.436331] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:30:53.794735] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T20:30:53.854483] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-30T20:30:54.654419] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-30T20:30:54.782275] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:30:54.794427] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-30T20:30:54.794634] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-30T20:30:54.795828] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:30:54.795983] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:30:54.796059] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:30:54.796149] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-30T20:30:54.796236] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-30T20:30:54.796288] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-30T20:30:54.796388] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-30T20:30:54.796497] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCG took 23.3s. Estimated remaining: 1h 33m 3s. Rate: 7.8 symbols/min [2025-09-30T20:30:55.051284] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:30:55.066377] [DEBUG] [LOCAL ] PCQ: Loaded 12253 existing records from primary storage. [2025-09-30T20:30:55.066667] [INFO ] [MAIN ] PCQ: Loaded 12253 existing records. [2025-09-30T20:30:55.270122] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:30:55.270360] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-30T20:30:55.270437] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-30T20:30:55.270798] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-30T20:30:55.270859] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-30T20:30:55.461268] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-30T20:30:55.693416] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:30:55.961432] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T20:30:56.254375] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-30T20:30:57.054368] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-30T20:30:57.071274] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T20:30:57.276494] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T20:30:57.854346] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-30T20:30:58.142419] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T20:30:58.654379] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-30T20:30:59.443767] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T20:30:59.454319] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-30T20:30:59.924474] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T20:31:00.254432] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-30T20:31:01.054349] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-30T20:31:01.096529] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:31:01.167440] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T20:31:01.854396] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-30T20:31:02.276509] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T20:31:02.398843] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T20:31:02.654365] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-30T20:31:03.454404] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-30T20:31:03.944096] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T20:31:04.254389] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-30T20:31:04.369134] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:31:05.054390] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-30T20:31:05.475750] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T20:31:05.854376] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-30T20:31:06.654385] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-30T20:31:06.733622] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:31:06.823535] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T20:31:07.451023] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T20:31:07.454297] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-30T20:31:08.254385] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-30T20:31:08.303104] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T20:31:08.305969] [INFO ] [REMOTE ] PCM: Full fetch complete (10416 records). [2025-09-30T20:31:08.306048] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-30T20:31:08.715750] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-30T20:31:08.715830] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-30T20:31:08.716103] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-30T20:31:08.716148] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-30T20:31:08.716587] [DEBUG] [LOCAL ] PCM: Trimmed 10416 records to 6787 (keeping 200 days of data) [2025-09-30T20:31:08.758942] [DEBUG] [LOCAL ] PCM: Primary data saved (6787 records). [2025-09-30T20:31:08.759056] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-30T20:31:08.759144] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCM took 34.1s. Estimated remaining: 1h 32m 59s. Rate: 7.8 symbols/min [2025-09-30T20:31:08.944444] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:09.007425] [DEBUG] [LOCAL ] PD: Loaded 47885 existing records from primary storage. [2025-09-30T20:31:09.007822] [INFO ] [MAIN ] PD: Loaded 47885 existing records. [2025-09-30T20:31:09.066243] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-30T20:31:09.246709] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:31:09.247109] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-30T20:31:09.247242] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-30T20:31:09.248172] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-30T20:31:09.248249] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-30T20:31:09.387229] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T20:31:09.756270] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:09.854323] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-30T20:31:10.346291] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T20:31:10.352718] [INFO ] [REMOTE ] PCN: Full fetch complete (34040 records). [2025-09-30T20:31:10.352846] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-30T20:31:10.659503] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-30T20:31:10.800970] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-30T20:31:10.801047] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-30T20:31:10.801837] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-30T20:31:10.801904] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-30T20:31:10.802776] [DEBUG] [LOCAL ] PCN: Trimmed 34040 records to 24445 (keeping 200 days of data) [2025-09-30T20:31:10.963313] [DEBUG] [LOCAL ] PCN: Primary data saved (24445 records). [2025-09-30T20:31:10.963449] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-30T20:31:10.963533] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 27.8s. Estimated remaining: 1h 32m 48s. Rate: 7.8 symbols/min [2025-09-30T20:31:11.162272] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:11.162505] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-30T20:31:11.162555] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-30T20:31:11.162731] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-30T20:31:11.162782] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-30T20:31:11.162837] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-30T20:31:11.162882] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-30T20:31:11.464332] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-30T20:31:11.573369] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:11.605513] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T20:31:11.636868] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T20:31:12.254366] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-30T20:31:13.054399] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-30T20:31:13.168000] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T20:31:13.316420] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T20:31:13.854378] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-30T20:31:14.188846] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-30T20:31:14.663058] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-30T20:31:14.670021] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T20:31:15.454372] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-30T20:31:16.254367] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-30T20:31:16.332114] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T20:31:16.420915] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T20:31:17.054372] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-30T20:31:17.347477] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-30T20:31:17.742118] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T20:31:17.854370] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-30T20:31:18.654359] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-30T20:31:19.340855] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T20:31:19.386098] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T20:31:19.454372] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-30T20:31:20.254368] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-30T20:31:20.733761] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T20:31:20.778252] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-30T20:31:21.054364] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-30T20:31:21.854366] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-30T20:31:22.118129] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:31:22.654352] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-30T20:31:23.454360] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-30T20:31:23.679911] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T20:31:24.038162] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-30T20:31:24.254363] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-30T20:31:24.370690] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T20:31:25.054361] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-30T20:31:25.837710] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T20:31:25.841376] [INFO ] [REMOTE ] PCQ: Full fetch complete (17594 records). [2025-09-30T20:31:25.841454] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-30T20:31:25.864218] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-30T20:31:26.258209] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-30T20:31:26.258431] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-30T20:31:26.259025] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-30T20:31:26.259228] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-30T20:31:26.260305] [DEBUG] [LOCAL ] PCQ: Trimmed 17594 records to 12294 (keeping 200 days of data) [2025-09-30T20:31:26.356241] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T20:31:26.390298] [DEBUG] [LOCAL ] PCQ: Primary data saved (12294 records). [2025-09-30T20:31:26.390458] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-30T20:31:26.390549] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 31.6s. Estimated remaining: 1h 32m 44s. Rate: 7.8 symbols/min [2025-09-30T20:31:26.587477] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:26.650988] [DEBUG] [LOCAL ] PDI: Loaded 50108 existing records from primary storage. [2025-09-30T20:31:26.651352] [INFO ] [MAIN ] PDI: Loaded 50108 existing records. [2025-09-30T20:31:26.662673] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-30T20:31:26.856457] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:31:26.856722] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-30T20:31:26.856784] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-30T20:31:26.857569] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-30T20:31:26.857632] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-30T20:31:27.175134] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-30T20:31:27.260291] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:27.454350] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-30T20:31:27.621325] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T20:31:28.254393] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-30T20:31:29.054324] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-30T20:31:29.256910] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T20:31:29.456674] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-30T20:31:29.854343] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-30T20:31:29.991111] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T20:31:30.370472] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T20:31:30.654402] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-30T20:31:31.454366] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-30T20:31:31.839209] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-30T20:31:32.254333] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-30T20:31:32.429356] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T20:31:33.054364] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-30T20:31:33.854347] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-30T20:31:33.974634] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T20:31:34.654391] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-30T20:31:35.126830] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T20:31:35.449688] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:31:35.459585] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-30T20:31:35.461723] [INFO ] [REMOTE ] PCOR: Full fetch complete (69609 records). [2025-09-30T20:31:35.461830] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-30T20:31:35.898511] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T20:31:35.898390] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-30T20:31:35.899403] [INFO ] [REMOTE ] PDCC: Full fetch complete (1344 records). [2025-09-30T20:31:35.899526] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-30T20:31:35.899595] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-30T20:31:35.936084] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-30T20:31:35.962085] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-30T20:31:36.016587] [DEBUG] [LOCAL ] PCOR: Trimmed 69609 records to 48025 (keeping 200 days of data) [2025-09-30T20:31:36.170374] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-30T20:31:36.198032] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:31:36.198413] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:31:36.199049] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-30T20:31:36.199540] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-30T20:31:36.203068] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-30T20:31:36.205287] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-30T20:31:36.206567] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PDCC took 25.2s. Estimated remaining: 1h 32m 37s. Rate: 7.8 symbols/min [2025-09-30T20:31:36.257403] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-30T20:31:36.448382] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:36.659904] [DEBUG] [LOCAL ] PDM: Loaded 39713 existing records from primary storage. [2025-09-30T20:31:36.664162] [INFO ] [MAIN ] PDM: Loaded 39713 existing records. [2025-09-30T20:31:36.712792] [DEBUG] [LOCAL ] PCOR: Primary data saved (48025 records). [2025-09-30T20:31:36.718161] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-30T20:31:36.730878] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PCOR took 53.2s. Estimated remaining: 1h 32m 27s. Rate: 7.8 symbols/min [2025-09-30T20:31:36.931245] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-30T20:31:37.020919] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:31:37.022128] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-30T20:31:37.022409] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-30T20:31:37.023394] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-30T20:31:37.029129] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-30T20:31:37.062549] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-30T20:31:37.230591] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:37.518987] [DEBUG] [LOCAL ] PDO: Loaded 31451 existing records from primary storage. [2025-09-30T20:31:37.541728] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:37.541992] [INFO ] [MAIN ] PDO: Loaded 31451 existing records. [2025-09-30T20:31:37.736476] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:31:37.736904] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-30T20:31:37.736966] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-30T20:31:37.737368] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-30T20:31:37.737425] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-30T20:31:37.859493] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-30T20:31:38.136532] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:38.171612] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T20:31:38.183262] [INFO ] [REMOTE ] PD: Full fetch complete (67642 records). [2025-09-30T20:31:38.183430] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-30T20:31:38.619321] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-30T20:31:38.619419] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-30T20:31:38.620510] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-30T20:31:38.620578] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-30T20:31:38.622111] [DEBUG] [LOCAL ] PD: Trimmed 67642 records to 47886 (keeping 200 days of data) [2025-09-30T20:31:38.676261] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-30T20:31:38.954583] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T20:31:38.955920] [DEBUG] [LOCAL ] PD: Primary data saved (47886 records). [2025-09-30T20:31:38.960066] [INFO ] [MAIN ] PD: Full history saved. [2025-09-30T20:31:38.967009] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PD took 30.2s. Estimated remaining: 1h 32m 16s. Rate: 7.8 symbols/min [2025-09-30T20:31:39.149798] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:31:39.172989] [DEBUG] [LOCAL ] PDS: Loaded 17807 existing records from primary storage. [2025-09-30T20:31:39.173284] [INFO ] [MAIN ] PDS: Loaded 17807 existing records. [2025-09-30T20:31:39.357290] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:31:39.357588] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-30T20:31:39.357765] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-30T20:31:39.366283] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-30T20:31:39.371570] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-30T20:31:39.453840] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:31:39.459631] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-30T20:31:39.760249] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:31:39.989474] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T20:31:40.254413] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-30T20:31:41.054356] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-30T20:31:41.280237] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T20:31:41.636343] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T20:31:41.698059] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T20:31:41.854387] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-30T20:31:42.654401] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-30T20:31:43.239166] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T20:31:43.454384] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-30T20:31:44.254376] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-30T20:31:44.269957] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T20:31:44.603417] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T20:31:45.054376] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-30T20:31:45.837330] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T20:31:45.854322] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-30T20:31:46.027551] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T20:31:46.654386] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-30T20:31:47.454398] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-30T20:31:47.498814] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T20:31:48.254355] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-30T20:31:48.519319] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T20:31:49.009933] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T20:31:49.054394] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-30T20:31:49.289120] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:31:49.854364] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-30T20:31:50.186252] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T20:31:50.654390] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-30T20:31:51.454371] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-30T20:31:51.827440] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T20:31:51.863490] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:31:52.254404] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-30T20:31:52.903148] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T20:31:53.054375] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-30T20:31:53.849915] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T20:31:53.859707] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-30T20:31:54.370972] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T20:31:54.654413] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-30T20:31:55.454402] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-30T20:31:55.739768] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:31:56.230192] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T20:31:56.254361] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-30T20:31:56.608981] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T20:31:57.054362] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-30T20:31:57.854327] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-30T20:31:58.071335] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T20:31:58.068778] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T20:31:58.654414] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-30T20:31:59.383340] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T20:31:59.458842] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-30T20:31:59.463016] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T20:32:00.254383] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-30T20:32:00.913814] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T20:32:01.054341] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-30T20:32:01.142003] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T20:32:01.854356] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-30T20:32:02.654423] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-30T20:32:02.752543] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T20:32:02.848581] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:32:02.870785] [INFO ] [REMOTE ] PDI: Full fetch complete (73013 records). [2025-09-30T20:32:02.871097] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-30T20:32:03.456309] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-30T20:32:03.516096] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-30T20:32:03.516223] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-30T20:32:03.518471] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-30T20:32:03.518613] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-30T20:32:03.520389] [DEBUG] [LOCAL ] PDI: Trimmed 73013 records to 50069 (keeping 200 days of data) [2025-09-30T20:32:03.919225] [DEBUG] [LOCAL ] PDI: Primary data saved (50069 records). [2025-09-30T20:32:03.919387] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-30T20:32:03.919601] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDI took 37.5s. Estimated remaining: 1h 32m 16s. Rate: 7.8 symbols/min [2025-09-30T20:32:04.158427] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:04.188467] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T20:32:04.211750] [DEBUG] [LOCAL ] PDT: Loaded 17301 existing records from primary storage. [2025-09-30T20:32:04.212045] [INFO ] [MAIN ] PDT: Loaded 17301 existing records. [2025-09-30T20:32:04.260930] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-30T20:32:04.475880] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:04.476210] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-30T20:32:04.476298] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-30T20:32:04.476895] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-30T20:32:04.476986] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-30T20:32:04.908494] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:04.959834] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T20:32:05.054385] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-30T20:32:05.285412] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T20:32:05.289110] [INFO ] [REMOTE ] PDS: Full fetch complete (25571 records). [2025-09-30T20:32:05.289249] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-30T20:32:05.736377] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-30T20:32:05.736516] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-30T20:32:05.737175] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-30T20:32:05.737242] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-30T20:32:05.738303] [DEBUG] [LOCAL ] PDS: Trimmed 25571 records to 17707 (keeping 200 days of data) [2025-09-30T20:32:05.854413] [DEBUG] [LOCAL ] PDS: Primary data saved (17707 records). [2025-09-30T20:32:05.854832] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-30T20:32:05.854550] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-30T20:32:05.855067] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDS took 26.9s. Estimated remaining: 1h 32m 6s. Rate: 7.8 symbols/min [2025-09-30T20:32:06.096225] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:06.124291] [DEBUG] [LOCAL ] PDX: Loaded 14358 existing records from primary storage. [2025-09-30T20:32:06.124584] [INFO ] [MAIN ] PDX: Loaded 14358 existing records. [2025-09-30T20:32:06.281842] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T20:32:06.321020] [INFO ] [REMOTE ] PDO: Full fetch complete (47704 records). [2025-09-30T20:32:06.344364] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-30T20:32:06.433742] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:06.477919] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-30T20:32:06.505756] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-30T20:32:06.516081] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-30T20:32:06.526934] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-30T20:32:06.677624] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-30T20:32:07.169147] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-30T20:32:07.169295] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-30T20:32:07.170193] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-30T20:32:07.176003] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-30T20:32:07.242622] [DEBUG] [LOCAL ] PDO: Trimmed 47704 records to 31349 (keeping 200 days of data) [2025-09-30T20:32:07.267172] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:07.393534] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T20:32:07.405176] [INFO ] [REMOTE ] PDM: Full fetch complete (57330 records). [2025-09-30T20:32:07.405906] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-30T20:32:07.456425] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-30T20:32:07.838489] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:32:07.971853] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-30T20:32:07.975422] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-30T20:32:07.976599] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-30T20:32:08.005559] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-30T20:32:08.029380] [DEBUG] [LOCAL ] PDM: Trimmed 57330 records to 39613 (keeping 200 days of data) [2025-09-30T20:32:08.143397] [DEBUG] [LOCAL ] PDO: Primary data saved (31349 records). [2025-09-30T20:32:08.144432] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-30T20:32:08.144556] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDO took 31.4s. Estimated remaining: 1h 31m 56s. Rate: 7.8 symbols/min [2025-09-30T20:32:08.262560] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-30T20:32:08.356894] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:08.512230] [DEBUG] [LOCAL ] PEB: Loaded 50664 existing records from primary storage. [2025-09-30T20:32:08.514694] [INFO ] [MAIN ] PEB: Loaded 50664 existing records. [2025-09-30T20:32:08.638263] [DEBUG] [LOCAL ] PDM: Primary data saved (39613 records). [2025-09-30T20:32:08.643164] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-30T20:32:08.643395] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDM took 32.4s. Estimated remaining: 1h 31m 45s. Rate: 7.8 symbols/min [2025-09-30T20:32:08.824577] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:08.865491] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T20:32:08.865861] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-30T20:32:08.873326] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-30T20:32:08.895178] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-30T20:32:08.900397] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-30T20:32:08.982502] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:09.025877] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-30T20:32:09.026131] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-30T20:32:09.046886] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-30T20:32:09.059476] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-30T20:32:09.064836] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-30T20:32:09.088561] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-30T20:32:09.089047] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-30T20:32:09.407184] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T20:32:09.619021] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:09.825297] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:09.854378] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-30T20:32:10.546496] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:32:10.654380] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-30T20:32:11.248261] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T20:32:11.454345] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-30T20:32:11.687198] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:32:12.254370] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-30T20:32:12.923442] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:32:13.054364] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-30T20:32:13.468958] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:32:13.835705] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T20:32:13.854308] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-30T20:32:14.654377] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-30T20:32:14.797963] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:32:15.454372] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-30T20:32:15.829923] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T20:32:16.254372] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-30T20:32:17.054404] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-30T20:32:17.110982] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T20:32:17.156051] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:32:17.863933] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-30T20:32:17.866259] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T20:32:18.654350] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-30T20:32:18.772985] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T20:32:19.454390] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-30T20:32:20.099735] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T20:32:20.254338] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-30T20:32:20.522950] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T20:32:21.054346] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-30T20:32:21.234989] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T20:32:21.854369] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-30T20:32:22.654333] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-30T20:32:22.902293] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T20:32:22.989343] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T20:32:23.454326] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-30T20:32:23.777554] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T20:32:24.254447] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-30T20:32:24.271303] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T20:32:25.054338] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-30T20:32:25.192042] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T20:32:25.854338] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-30T20:32:25.893577] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T20:32:26.654374] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-30T20:32:27.454339] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-30T20:32:27.586208] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T20:32:27.614454] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T20:32:28.254344] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-30T20:32:28.517545] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:32:29.054373] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-30T20:32:29.854358] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-30T20:32:30.095841] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T20:32:30.187157] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:32:30.654376] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-30T20:32:30.900431] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T20:32:30.904462] [INFO ] [REMOTE ] PDT: Full fetch complete (25191 records). [2025-09-30T20:32:30.904556] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-30T20:32:31.323312] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-30T20:32:31.323481] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-30T20:32:31.324049] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-30T20:32:31.324165] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-30T20:32:31.325028] [DEBUG] [LOCAL ] PDT: Trimmed 25191 records to 17328 (keeping 200 days of data) [2025-09-30T20:32:31.437985] [DEBUG] [LOCAL ] PDT: Primary data saved (17328 records). [2025-09-30T20:32:31.438142] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-30T20:32:31.438245] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDT took 27.5s. Estimated remaining: 1h 31m 44s. Rate: 7.8 symbols/min [2025-09-30T20:32:31.460155] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-30T20:32:31.633828] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:31.667760] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T20:32:31.709799] [DEBUG] [LOCAL ] PEN: Loaded 30229 existing records from primary storage. [2025-09-30T20:32:31.710080] [INFO ] [MAIN ] PEN: Loaded 30229 existing records. [2025-09-30T20:32:31.901148] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:31.901416] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-30T20:32:31.901465] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-30T20:32:31.902023] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-30T20:32:31.902097] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-30T20:32:32.262964] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-30T20:32:32.308157] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:33.054340] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-30T20:32:33.218750] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T20:32:33.600120] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-30T20:32:33.854402] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-30T20:32:33.988368] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:32:34.654409] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-30T20:32:34.955259] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T20:32:35.454382] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-30T20:32:35.669381] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T20:32:35.672577] [INFO ] [REMOTE ] PDX: Full fetch complete (24595 records). [2025-09-30T20:32:35.672711] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-30T20:32:36.059813] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-30T20:32:36.059899] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-30T20:32:36.060458] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-30T20:32:36.060523] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-30T20:32:36.061387] [DEBUG] [LOCAL ] PDX: Trimmed 24595 records to 14361 (keeping 200 days of data) [2025-09-30T20:32:36.157977] [DEBUG] [LOCAL ] PDX: Primary data saved (14361 records). [2025-09-30T20:32:36.158153] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-30T20:32:36.158302] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PDX took 30.3s. Estimated remaining: 1h 31m 35s. Rate: 7.8 symbols/min [2025-09-30T20:32:36.261581] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-30T20:32:36.341480] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:36.355609] [DEBUG] [LOCAL ] PEO: Loaded 10930 existing records from primary storage. [2025-09-30T20:32:36.355904] [INFO ] [MAIN ] PEO: Loaded 10930 existing records. [2025-09-30T20:32:36.544876] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:36.545178] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-30T20:32:36.545263] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-30T20:32:36.545563] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-30T20:32:36.545622] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-30T20:32:36.930073] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:37.003222] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:32:37.054325] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-30T20:32:37.256358] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T20:32:37.695990] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T20:32:37.854360] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-30T20:32:38.654389] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-30T20:32:38.838435] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:32:39.454366] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-30T20:32:40.254370] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-30T20:32:40.274986] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:32:40.402167] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:32:41.054342] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-30T20:32:41.260282] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T20:32:41.854445] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-30T20:32:42.471311] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T20:32:42.482408] [INFO ] [REMOTE ] PEB: Full fetch complete (72806 records). [2025-09-30T20:32:42.482583] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-30T20:32:42.670726] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-30T20:32:42.944428] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-30T20:32:42.944854] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-30T20:32:42.946335] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-30T20:32:42.946454] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-30T20:32:42.948629] [DEBUG] [LOCAL ] PEB: Trimmed 72806 records to 50648 (keeping 200 days of data) [2025-09-30T20:32:43.279444] [DEBUG] [LOCAL ] PEB: Primary data saved (50648 records). [2025-09-30T20:32:43.279599] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-30T20:32:43.279717] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 35.1s. Estimated remaining: 1h 31m 27s. Rate: 7.8 symbols/min [2025-09-30T20:32:43.468400] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-30T20:32:43.468327] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T20:32:43.496903] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:43.519739] [DEBUG] [LOCAL ] PERF: Loaded 14019 existing records from primary storage. [2025-09-30T20:32:43.520290] [INFO ] [MAIN ] PERF: Loaded 14019 existing records. [2025-09-30T20:32:43.716376] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T20:32:43.729712] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:43.732449] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-30T20:32:43.732528] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-30T20:32:43.733324] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-30T20:32:43.733390] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-30T20:32:44.134509] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:44.254327] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-30T20:32:44.395568] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:32:44.409767] [INFO ] [REMOTE ] PEG: Full fetch complete (76291 records). [2025-09-30T20:32:44.409915] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-30T20:32:44.410796] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:32:44.410881] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:32:44.410924] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:32:44.410988] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-30T20:32:44.411053] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-30T20:32:44.411089] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-30T20:32:44.411155] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-30T20:32:44.411236] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEG took 35.8s. Estimated remaining: 1h 31m 17s. Rate: 7.8 symbols/min [2025-09-30T20:32:44.595265] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:44.595451] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-30T20:32:44.595512] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-30T20:32:44.595629] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-30T20:32:44.595707] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-30T20:32:44.595762] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-30T20:32:44.595796] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-30T20:32:44.998223] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:45.054358] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-30T20:32:45.345712] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T20:32:45.854373] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-30T20:32:46.361686] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T20:32:46.654385] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-30T20:32:46.948599] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T20:32:47.454379] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-30T20:32:47.745036] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:32:47.745359] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-30T20:32:47.745453] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:32:47.745501] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-30T20:32:47.745584] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:32:47.745707] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-30T20:32:47.745786] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-30T20:32:47.745825] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-30T20:32:47.745866] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-30T20:32:47.745914] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEW took 3.3s. Estimated remaining: 1h 31m 7s. Rate: 7.8 symbols/min [2025-09-30T20:32:47.933197] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:32:47.940878] [DEBUG] [LOCAL ] PFD: Loaded 5130 existing records from primary storage. [2025-09-30T20:32:47.941067] [INFO ] [MAIN ] PFD: Loaded 5130 existing records. [2025-09-30T20:32:48.178471] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:32:48.178844] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-30T20:32:48.178971] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-30T20:32:48.179485] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-30T20:32:48.179582] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-30T20:32:48.259249] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-30T20:32:48.538389] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:32:48.607239] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:32:49.001964] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T20:32:49.054409] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-30T20:32:49.760430] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T20:32:49.854410] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-30T20:32:50.501370] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:32:50.654363] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-30T20:32:51.454387] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-30T20:32:51.847319] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T20:32:51.976337] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T20:32:52.254402] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-30T20:32:53.054377] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-30T20:32:53.695676] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T20:32:53.854350] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-30T20:32:53.976829] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T20:32:54.459263] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T20:32:54.654395] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-30T20:32:55.382310] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T20:32:55.454445] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-30T20:32:56.143248] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T20:32:56.254332] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-30T20:32:57.054358] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-30T20:32:57.099964] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T20:32:57.854364] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-30T20:32:57.962580] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T20:32:58.448500] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T20:32:58.654395] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-30T20:32:59.454355] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-30T20:32:59.743410] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T20:33:00.254387] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-30T20:33:00.954670] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T20:33:01.054360] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-30T20:33:01.435836] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:33:01.854356] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-30T20:33:01.977512] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T20:33:02.547259] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T20:33:02.654376] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-30T20:33:03.305723] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:33:03.454394] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-30T20:33:04.254382] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-30T20:33:04.520823] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T20:33:05.054363] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-30T20:33:05.720041] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T20:33:05.850708] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T20:33:05.854295] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-30T20:33:06.572894] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T20:33:06.654376] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-30T20:33:07.425095] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T20:33:07.427240] [INFO ] [REMOTE ] PFD: Full fetch complete (7456 records). [2025-09-30T20:33:07.427336] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-30T20:33:07.460730] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-30T20:33:07.829076] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-30T20:33:07.829226] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-30T20:33:07.829532] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-30T20:33:07.829592] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-30T20:33:07.830043] [DEBUG] [LOCAL ] PFD: Trimmed 7456 records to 5139 (keeping 200 days of data) [2025-09-30T20:33:07.863093] [DEBUG] [LOCAL ] PFD: Primary data saved (5139 records). [2025-09-30T20:33:07.863232] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-30T20:33:07.863318] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PFD took 20.1s. Estimated remaining: 1h 31m 5s. Rate: 7.8 symbols/min [2025-09-30T20:33:08.059447] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:08.059844] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-30T20:33:08.059907] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-30T20:33:08.060060] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-30T20:33:08.060118] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-30T20:33:08.060257] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-30T20:33:08.060321] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-30T20:33:08.258256] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-30T20:33:08.508169] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:08.563919] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T20:33:09.054394] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-30T20:33:09.562313] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T20:33:09.854409] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-30T20:33:09.872914] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T20:33:09.876253] [INFO ] [REMOTE ] PERF: Full fetch complete (21843 records). [2025-09-30T20:33:09.876391] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-30T20:33:10.266942] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-30T20:33:10.267028] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-30T20:33:10.267541] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-30T20:33:10.267584] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-30T20:33:10.268325] [DEBUG] [LOCAL ] PERF: Trimmed 21843 records to 14022 (keeping 200 days of data) [2025-09-30T20:33:10.353306] [DEBUG] [LOCAL ] PERF: Primary data saved (14022 records). [2025-09-30T20:33:10.353452] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-30T20:33:10.353550] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PERF took 27.1s. Estimated remaining: 1h 30m 55s. Rate: 7.8 symbols/min [2025-09-30T20:33:10.557626] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:10.623681] [DEBUG] [LOCAL ] PFGC: Loaded 46839 existing records from primary storage. [2025-09-30T20:33:10.624113] [INFO ] [MAIN ] PFGC: Loaded 46839 existing records. [2025-09-30T20:33:10.659438] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-30T20:33:10.856119] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:10.856351] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-30T20:33:10.856420] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-30T20:33:10.857400] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-30T20:33:10.857578] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-30T20:33:10.995303] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T20:33:11.039879] [INFO ] [REMOTE ] PEN: Full fetch complete (44147 records). [2025-09-30T20:33:11.055229] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-30T20:33:11.465800] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-30T20:33:11.489569] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:11.717633] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-30T20:33:11.717804] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-30T20:33:11.726854] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-30T20:33:11.727465] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-30T20:33:11.727369] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T20:33:11.732442] [DEBUG] [LOCAL ] PEN: Trimmed 44147 records to 30150 (keeping 200 days of data) [2025-09-30T20:33:11.732286] [INFO ] [REMOTE ] PEO: Full fetch complete (16374 records). [2025-09-30T20:33:11.732758] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-30T20:33:12.267430] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-30T20:33:12.282795] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-30T20:33:12.285926] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-30T20:33:12.289761] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-30T20:33:12.292236] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-30T20:33:12.344754] [DEBUG] [LOCAL ] PEO: Trimmed 16374 records to 11004 (keeping 200 days of data) [2025-09-30T20:33:12.431362] [DEBUG] [LOCAL ] PEN: Primary data saved (30150 records). [2025-09-30T20:33:12.434559] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-30T20:33:12.436856] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PEN took 41.0s. Estimated remaining: 1h 30m 45s. Rate: 7.8 symbols/min [2025-09-30T20:33:12.527402] [DEBUG] [LOCAL ] PEO: Primary data saved (11004 records). [2025-09-30T20:33:12.563377] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-30T20:33:12.564076] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PEO took 36.4s. Estimated remaining: 1h 30m 34s. Rate: 7.8 symbols/min [2025-09-30T20:33:12.572000] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T20:33:12.814509] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:12.897565] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:12.901856] [DEBUG] [LOCAL ] PFH: Loaded 6838 existing records from primary storage. [2025-09-30T20:33:12.902220] [INFO ] [MAIN ] PFH: Loaded 6838 existing records. [2025-09-30T20:33:13.030421] [DEBUG] [LOCAL ] PFL: Loaded 13656 existing records from primary storage. [2025-09-30T20:33:13.052261] [INFO ] [MAIN ] PFL: Loaded 13656 existing records. [2025-09-30T20:33:13.065937] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-30T20:33:13.160037] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:13.183317] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-30T20:33:13.195840] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-30T20:33:13.201280] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-30T20:33:13.224919] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-30T20:33:13.445544] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:13.461253] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-30T20:33:13.473848] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-30T20:33:13.497255] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-30T20:33:13.514210] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-30T20:33:14.015584] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:14.031739] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-30T20:33:14.189515] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:14.216141] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T20:33:14.258994] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T20:33:14.654355] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-30T20:33:14.910197] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:33:15.422270] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T20:33:15.454313] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-30T20:33:16.254321] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-30T20:33:16.385223] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T20:33:17.054364] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-30T20:33:17.855692] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-30T20:33:17.875132] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T20:33:17.976140] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:33:18.654364] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-30T20:33:18.902096] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T20:33:19.454356] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-30T20:33:19.933336] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T20:33:20.254331] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-30T20:33:20.477368] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T20:33:20.830906] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:33:21.054375] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-30T20:33:21.854403] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-30T20:33:22.477203] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T20:33:22.654367] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-30T20:33:22.802616] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T20:33:23.454338] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-30T20:33:23.716750] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T20:33:24.254365] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-30T20:33:24.439447] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:33:24.755409] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T20:33:25.054399] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-30T20:33:25.854422] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-30T20:33:25.922939] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:33:26.654390] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-30T20:33:27.454348] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-30T20:33:27.543693] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T20:33:27.655450] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T20:33:28.254345] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-30T20:33:28.315493] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:33:29.054408] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-30T20:33:29.854352] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-30T20:33:29.950877] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:33:30.072573] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T20:33:30.643352] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:33:30.654299] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-30T20:33:31.454370] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-30T20:33:31.471192] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T20:33:32.254371] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-30T20:33:32.431623] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T20:33:33.054427] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-30T20:33:33.155086] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:33:33.584751] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T20:33:33.854360] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-30T20:33:34.654376] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-30T20:33:34.932139] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T20:33:35.454391] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-30T20:33:35.486518] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T20:33:36.254341] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-30T20:33:36.525459] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T20:33:36.529133] [INFO ] [REMOTE ] PFL: Full fetch complete (20112 records). [2025-09-30T20:33:36.529209] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-30T20:33:36.934803] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-30T20:33:36.934927] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-30T20:33:36.935428] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-30T20:33:36.935493] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-30T20:33:36.936727] [DEBUG] [LOCAL ] PFL: Trimmed 20112 records to 13601 (keeping 200 days of data) [2025-09-30T20:33:37.023992] [DEBUG] [LOCAL ] PFL: Primary data saved (13601 records). [2025-09-30T20:33:37.024157] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-30T20:33:37.024281] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFL took 24.4s. Estimated remaining: 1h 30m 33s. Rate: 7.8 symbols/min [2025-09-30T20:33:37.059613] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-30T20:33:37.244672] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:37.277957] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T20:33:37.334245] [DEBUG] [LOCAL ] PFLT: Loaded 43669 existing records from primary storage. [2025-09-30T20:33:37.334637] [INFO ] [MAIN ] PFLT: Loaded 43669 existing records. [2025-09-30T20:33:37.529246] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:37.529541] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-30T20:33:37.529598] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-30T20:33:37.529961] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-30T20:33:37.530021] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-30T20:33:37.771857] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T20:33:37.859627] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-30T20:33:37.949351] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:38.654407] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-30T20:33:39.456901] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-30T20:33:39.457961] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T20:33:39.487078] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T20:33:40.254389] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-30T20:33:41.054387] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-30T20:33:41.187605] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T20:33:41.854403] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-30T20:33:41.995048] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T20:33:42.006551] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-30T20:33:42.006757] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-30T20:33:42.007696] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:33:42.007793] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:33:42.007871] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:33:42.007943] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-30T20:33:42.008012] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-30T20:33:42.008050] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-30T20:33:42.008090] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-30T20:33:42.008152] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFE took 34.1s. Estimated remaining: 1h 30m 24s. Rate: 7.8 symbols/min [2025-09-30T20:33:42.225900] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T20:33:42.229490] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:42.265259] [DEBUG] [LOCAL ] PFN: Loaded 21645 existing records from primary storage. [2025-09-30T20:33:42.265534] [INFO ] [MAIN ] PFN: Loaded 21645 existing records. [2025-09-30T20:33:42.382782] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T20:33:42.405757] [INFO ] [REMOTE ] PFH: Full fetch complete (10599 records). [2025-09-30T20:33:42.416189] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-30T20:33:42.564604] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:42.589828] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-30T20:33:42.590033] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-30T20:33:42.601344] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-30T20:33:42.611929] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-30T20:33:42.660392] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-30T20:33:43.212105] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-30T20:33:43.234106] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-30T20:33:43.237694] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-30T20:33:43.237781] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-30T20:33:43.254917] [DEBUG] [LOCAL ] PFH: Trimmed 10599 records to 6818 (keeping 200 days of data) [2025-09-30T20:33:43.368861] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:43.384695] [DEBUG] [LOCAL ] PFH: Primary data saved (6818 records). [2025-09-30T20:33:43.384883] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-30T20:33:43.384993] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFH took 30.9s. Estimated remaining: 1h 30m 14s. Rate: 7.8 symbols/min [2025-09-30T20:33:43.459566] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-30T20:33:43.614850] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:43.623289] [DEBUG] [LOCAL ] PFO: Loaded 5913 existing records from primary storage. [2025-09-30T20:33:43.623549] [INFO ] [MAIN ] PFO: Loaded 5913 existing records. [2025-09-30T20:33:43.838784] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:43.839034] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-30T20:33:43.839083] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-30T20:33:43.839327] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-30T20:33:43.839386] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-30T20:33:44.217371] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:44.254392] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-30T20:33:44.534103] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-30T20:33:44.767773] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T20:33:45.054408] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-30T20:33:45.854341] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-30T20:33:46.088640] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T20:33:46.197831] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T20:33:46.654393] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-30T20:33:47.214545] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T20:33:47.289236] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T20:33:47.454383] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-30T20:33:48.254404] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-30T20:33:49.054420] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-30T20:33:49.099634] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T20:33:49.316184] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:33:49.854366] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-30T20:33:50.654352] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-30T20:33:50.866069] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T20:33:50.876254] [INFO ] [REMOTE ] PFGC: Full fetch complete (67194 records). [2025-09-30T20:33:50.876392] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-30T20:33:51.359024] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-30T20:33:51.359113] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-30T20:33:51.360202] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-30T20:33:51.360272] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-30T20:33:51.361724] [DEBUG] [LOCAL ] PFGC: Trimmed 67194 records to 46820 (keeping 200 days of data) [2025-09-30T20:33:51.463352] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-30T20:33:51.665329] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T20:33:51.691614] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T20:33:51.770951] [DEBUG] [LOCAL ] PFGC: Primary data saved (46820 records). [2025-09-30T20:33:51.771107] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-30T20:33:51.771219] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFGC took 41.4s. Estimated remaining: 1h 30m 7s. Rate: 7.8 symbols/min [2025-09-30T20:33:51.958345] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-30T20:33:51.962052] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:33:52.003218] [DEBUG] [LOCAL ] PFS: Loaded 35575 existing records from primary storage. [2025-09-30T20:33:52.003499] [INFO ] [MAIN ] PFS: Loaded 35575 existing records. [2025-09-30T20:33:52.212755] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:33:52.212958] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-30T20:33:52.213006] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-30T20:33:52.213448] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-30T20:33:52.213507] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-30T20:33:52.259567] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-30T20:33:52.599985] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:33:53.054378] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-30T20:33:53.854394] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-30T20:33:54.224125] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T20:33:54.654410] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-30T20:33:55.245796] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T20:33:55.454407] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-30T20:33:55.840768] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-30T20:33:55.937973] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T20:33:56.095378] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T20:33:56.254435] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-30T20:33:57.054360] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-30T20:33:57.841838] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T20:33:57.854304] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-30T20:33:58.654439] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-30T20:33:58.701277] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T20:33:59.203259] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T20:33:59.261345] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T20:33:59.454384] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-30T20:34:00.254387] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-30T20:34:01.054406] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-30T20:34:01.132144] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T20:34:01.808336] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T20:34:01.854406] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-30T20:34:02.166143] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T20:34:02.654364] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-30T20:34:03.454325] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-30T20:34:03.829074] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:34:03.878393] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T20:34:04.254411] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-30T20:34:05.054408] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-30T20:34:05.511032] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-30T20:34:05.718813] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T20:34:05.804382] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T20:34:05.854380] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-30T20:34:06.654417] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-30T20:34:07.086447] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T20:34:07.454383] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-30T20:34:08.254334] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-30T20:34:08.490886] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T20:34:08.508064] [INFO ] [REMOTE ] PFLT: Full fetch complete (63672 records). [2025-09-30T20:34:08.508300] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-30T20:34:08.879192] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T20:34:08.972024] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-30T20:34:08.972131] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-30T20:34:08.973200] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-30T20:34:08.973277] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-30T20:34:08.974805] [DEBUG] [LOCAL ] PFLT: Trimmed 63672 records to 43709 (keeping 200 days of data) [2025-09-30T20:34:09.067782] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-30T20:34:09.272727] [DEBUG] [LOCAL ] PFLT: Primary data saved (43709 records). [2025-09-30T20:34:09.273037] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-30T20:34:09.273361] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFLT took 32.2s. Estimated remaining: 1h 30m 3s. Rate: 7.8 symbols/min [2025-09-30T20:34:09.479472] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:09.519971] [DEBUG] [LOCAL ] PFSI: Loaded 28694 existing records from primary storage. [2025-09-30T20:34:09.520272] [INFO ] [MAIN ] PFSI: Loaded 28694 existing records. [2025-09-30T20:34:09.739496] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:34:09.739950] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-30T20:34:09.740042] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-30T20:34:09.741172] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-30T20:34:09.741255] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-30T20:34:09.866306] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-30T20:34:09.914817] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T20:34:10.192370] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:10.565363] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T20:34:10.566085] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T20:34:10.573801] [INFO ] [REMOTE ] PFN: Full fetch complete (30876 records). [2025-09-30T20:34:10.573935] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-30T20:34:10.659426] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-30T20:34:10.982776] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-30T20:34:10.982890] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-30T20:34:10.983735] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-30T20:34:10.983800] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-30T20:34:10.984747] [DEBUG] [LOCAL ] PFN: Trimmed 30876 records to 21730 (keeping 200 days of data) [2025-09-30T20:34:11.132150] [DEBUG] [LOCAL ] PFN: Primary data saved (21730 records). [2025-09-30T20:34:11.132296] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-30T20:34:11.132387] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFN took 29.1s. Estimated remaining: 1h 29m 53s. Rate: 7.8 symbols/min [2025-09-30T20:34:11.316585] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:11.316802] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-30T20:34:11.316848] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-30T20:34:11.316963] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-30T20:34:11.317005] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-30T20:34:11.317048] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-30T20:34:11.317088] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-30T20:34:11.459530] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-30T20:34:11.732578] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:12.063130] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:34:12.254362] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-30T20:34:12.816141] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T20:34:13.054372] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-30T20:34:13.260279] [DEBUG] [REMOTE ] PFO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-30T20:34:13.260632] [WARN ] [REMOTE ] PFO: No data returned for month 2025-07 [2025-09-30T20:34:13.260758] [FATAL] [REMOTE ] PFO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:34:13.260876] [FATAL] [MAIN ] PFO: Failed to fetch primary data. [2025-09-30T20:34:13.260950] [WARN ] [MAIN ] PFO: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:34:13.261023] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-30T20:34:13.261114] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-09-30T20:34:13.261172] [INFO ] [LOCAL ] PFO: Starting deletion of derivative data. [2025-09-30T20:34:13.261815] [DEBUG] [LOCAL ] PFO: Deleted derivative data file. [2025-09-30T20:34:13.261926] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFO took 29.9s. Estimated remaining: 1h 29m 43s. Rate: 7.8 symbols/min [2025-09-30T20:34:13.447720] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:13.455513] [DEBUG] [LOCAL ] PGP: Loaded 5454 existing records from primary storage. [2025-09-30T20:34:13.455772] [INFO ] [MAIN ] PGP: Loaded 5454 existing records. [2025-09-30T20:34:13.652057] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:34:13.652341] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-30T20:34:13.652398] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-30T20:34:13.652758] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-30T20:34:13.652830] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-30T20:34:13.856667] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-30T20:34:13.935313] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T20:34:14.102362] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:14.654357] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-30T20:34:14.898990] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T20:34:15.454384] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-30T20:34:16.008229] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T20:34:16.254371] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-30T20:34:16.943617] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:34:17.054335] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-30T20:34:17.077270] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T20:34:17.854420] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-30T20:34:18.517234] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T20:34:18.533447] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T20:34:18.654385] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-30T20:34:19.454318] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-30T20:34:19.647700] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T20:34:20.254370] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-30T20:34:21.017895] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T20:34:21.027571] [INFO ] [REMOTE ] PFS: Full fetch complete (51715 records). [2025-09-30T20:34:21.027826] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-30T20:34:21.059714] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-30T20:34:21.446076] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-30T20:34:21.446165] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-30T20:34:21.447006] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-30T20:34:21.447082] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-30T20:34:21.452594] [DEBUG] [LOCAL ] PFS: Trimmed 51715 records to 35582 (keeping 200 days of data) [2025-09-30T20:34:21.697715] [DEBUG] [LOCAL ] PFS: Primary data saved (35582 records). [2025-09-30T20:34:21.698046] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-30T20:34:21.698198] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 29.9s. Estimated remaining: 1h 29m 35s. Rate: 7.8 symbols/min [2025-09-30T20:34:21.846494] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T20:34:21.857042] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-30T20:34:21.918730] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:21.919670] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-30T20:34:21.919731] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-30T20:34:21.919865] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-30T20:34:21.919946] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-30T20:34:21.920017] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-30T20:34:21.920056] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-30T20:34:22.321700] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:22.362098] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T20:34:22.563884] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:34:22.654382] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-30T20:34:23.405375] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T20:34:23.454348] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-30T20:34:24.254343] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-30T20:34:24.335690] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T20:34:24.911487] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T20:34:25.054377] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-30T20:34:25.854411] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-30T20:34:25.889510] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T20:34:26.654414] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-30T20:34:27.369959] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T20:34:27.417235] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T20:34:27.454356] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-30T20:34:28.254383] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-30T20:34:28.687498] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T20:34:28.834703] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T20:34:29.054446] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-30T20:34:29.854370] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-30T20:34:30.381009] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T20:34:30.654339] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-30T20:34:30.866299] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T20:34:31.421844] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T20:34:31.454352] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-30T20:34:32.254378] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-30T20:34:33.055784] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-30T20:34:33.058339] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T20:34:33.288411] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:34:33.547669] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T20:34:33.854372] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-30T20:34:34.654405] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-30T20:34:34.839806] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T20:34:35.454373] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-30T20:34:36.033031] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T20:34:36.178037] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T20:34:36.254406] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-30T20:34:36.889054] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T20:34:37.054562] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-30T20:34:37.854370] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-30T20:34:38.373803] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T20:34:38.386877] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T20:34:38.654369] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-30T20:34:39.454364] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-30T20:34:39.515581] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T20:34:39.517493] [INFO ] [REMOTE ] PGP: Full fetch complete (7821 records). [2025-09-30T20:34:39.517598] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-30T20:34:39.905058] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-30T20:34:39.905159] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-30T20:34:39.905523] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-30T20:34:39.905624] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-30T20:34:39.906153] [DEBUG] [LOCAL ] PGP: Trimmed 7821 records to 5471 (keeping 200 days of data) [2025-09-30T20:34:39.941114] [DEBUG] [LOCAL ] PGP: Primary data saved (5471 records). [2025-09-30T20:34:39.941316] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-30T20:34:39.941430] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PGP took 26.7s. Estimated remaining: 1h 29m 32s. Rate: 7.8 symbols/min [2025-09-30T20:34:40.128750] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:40.165707] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T20:34:40.226584] [DEBUG] [LOCAL ] PGRE: Loaded 46603 existing records from primary storage. [2025-09-30T20:34:40.226986] [INFO ] [MAIN ] PGRE: Loaded 46603 existing records. [2025-09-30T20:34:40.259537] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-30T20:34:40.421405] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:34:40.421715] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-30T20:34:40.421774] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-30T20:34:40.422586] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-30T20:34:40.422689] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-30T20:34:40.802752] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:41.054335] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-30T20:34:41.183109] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T20:34:41.854435] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-30T20:34:42.501979] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T20:34:42.513774] [INFO ] [REMOTE ] PFSI: Full fetch complete (40814 records). [2025-09-30T20:34:42.514020] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-30T20:34:42.659464] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-30T20:34:42.960143] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-30T20:34:42.960288] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-30T20:34:42.961204] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-30T20:34:42.961289] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-30T20:34:42.962690] [DEBUG] [LOCAL ] PFSI: Trimmed 40814 records to 28610 (keeping 200 days of data) [2025-09-30T20:34:43.095937] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T20:34:43.110735] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-30T20:34:43.113873] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-30T20:34:43.115296] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:34:43.115861] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:34:43.116690] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:34:43.117488] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-30T20:34:43.118140] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-30T20:34:43.118214] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-30T20:34:43.118298] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-30T20:34:43.118398] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 32.0s. Estimated remaining: 1h 29m 23s. Rate: 7.8 symbols/min [2025-09-30T20:34:43.309526] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:43.321997] [DEBUG] [LOCAL ] PGZ: Loaded 5422 existing records from primary storage. [2025-09-30T20:34:43.323043] [INFO ] [MAIN ] PGZ: Loaded 5422 existing records. [2025-09-30T20:34:43.459521] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-30T20:34:43.542580] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:34:43.543720] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-30T20:34:43.546868] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-30T20:34:43.547185] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-30T20:34:43.569073] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-30T20:34:43.966940] [DEBUG] [LOCAL ] PFSI: Primary data saved (28610 records). [2025-09-30T20:34:43.995840] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-30T20:34:44.000365] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:44.000600] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PFSI took 34.7s. Estimated remaining: 1h 29m 12s. Rate: 7.8 symbols/min [2025-09-30T20:34:44.197749] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:34:44.223152] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T20:34:44.259940] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-30T20:34:44.278311] [DEBUG] [LOCAL ] PH: Loaded 38362 existing records from primary storage. [2025-09-30T20:34:44.278839] [INFO ] [MAIN ] PH: Loaded 38362 existing records. [2025-09-30T20:34:44.468465] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:34:44.468917] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-30T20:34:44.469027] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-30T20:34:44.480743] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-30T20:34:44.485961] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-30T20:34:44.576985] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T20:34:44.885323] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T20:34:44.918538] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:34:45.054352] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-30T20:34:45.854385] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-30T20:34:45.878820] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T20:34:46.654394] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-30T20:34:47.400409] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:34:47.454988] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T20:34:47.454367] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-30T20:34:48.254388] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-30T20:34:48.493990] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T20:34:48.887335] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T20:34:49.054362] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-30T20:34:49.782151] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T20:34:49.854405] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-30T20:34:50.654365] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-30T20:34:50.902056] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T20:34:51.454378] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-30T20:34:52.239358] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T20:34:52.254300] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-30T20:34:52.295636] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T20:34:53.054402] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-30T20:34:53.608329] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T20:34:53.854391] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-30T20:34:54.100689] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T20:34:54.654330] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-30T20:34:54.834918] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T20:34:55.391394] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:34:55.454365] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-30T20:34:56.254375] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-30T20:34:56.296142] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T20:34:57.054353] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-30T20:34:57.846876] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T20:34:57.862517] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-30T20:34:57.891032] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T20:34:58.654335] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-30T20:34:58.752204] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T20:34:59.364859] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T20:34:59.454400] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-30T20:35:00.182131] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T20:35:00.254342] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-30T20:35:01.054364] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-30T20:35:01.854333] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-30T20:35:01.924228] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:35:01.938869] [INFO ] [REMOTE ] PGR: Full fetch complete (76197 records). [2025-09-30T20:35:01.939074] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-30T20:35:01.940110] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:35:01.940215] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:35:01.940281] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:35:01.940351] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-30T20:35:01.940417] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-30T20:35:01.940475] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-30T20:35:01.940576] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-30T20:35:01.940694] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGR took 40.2s. Estimated remaining: 1h 29m 9s. Rate: 7.8 symbols/min [2025-09-30T20:35:02.176209] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:02.178703] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T20:35:02.200095] [DEBUG] [LOCAL ] PHD: Loaded 10144 existing records from primary storage. [2025-09-30T20:35:02.200345] [INFO ] [MAIN ] PHD: Loaded 10144 existing records. [2025-09-30T20:35:02.394139] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:02.394342] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-30T20:35:02.394390] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-30T20:35:02.394827] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-30T20:35:02.394888] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-30T20:35:02.658253] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-30T20:35:02.675179] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T20:35:02.706545] [INFO ] [REMOTE ] PGZ: Full fetch complete (9032 records). [2025-09-30T20:35:02.720907] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-30T20:35:02.957045] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:03.291964] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-30T20:35:03.292044] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-30T20:35:03.292288] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-30T20:35:03.292329] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-30T20:35:03.292800] [DEBUG] [LOCAL ] PGZ: Trimmed 9032 records to 5450 (keeping 200 days of data) [2025-09-30T20:35:03.328371] [DEBUG] [LOCAL ] PGZ: Primary data saved (5450 records). [2025-09-30T20:35:03.328692] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-30T20:35:03.328992] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGZ took 20.2s. Estimated remaining: 1h 28m 58s. Rate: 7.8 symbols/min [2025-09-30T20:35:03.454365] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-30T20:35:03.523308] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T20:35:04.254406] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-30T20:35:04.509788] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T20:35:05.054353] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-30T20:35:05.854352] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-30T20:35:06.044543] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T20:35:06.077959] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T20:35:06.654368] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-30T20:35:06.799497] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:35:07.360538] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:35:07.454357] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-30T20:35:08.254349] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-30T20:35:08.294161] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T20:35:09.054356] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-30T20:35:09.267171] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T20:35:09.854399] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-30T20:35:10.127295] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-30T20:35:10.654365] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-30T20:35:11.055070] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T20:35:11.454350] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-30T20:35:11.555051] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T20:35:12.254360] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-30T20:35:13.054427] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-30T20:35:13.099556] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T20:35:13.164973] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T20:35:13.854364] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-30T20:35:13.954947] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T20:35:14.654372] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-30T20:35:15.007545] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T20:35:15.178706] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T20:35:15.185617] [INFO ] [REMOTE ] PH: Full fetch complete (56241 records). [2025-09-30T20:35:15.185776] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-30T20:35:15.186498] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:35:15.186617] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:35:15.186703] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:35:15.186758] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-30T20:35:15.186821] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-09-30T20:35:15.186858] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-09-30T20:35:15.187318] [DEBUG] [LOCAL ] PH: Deleted derivative data file. [2025-09-30T20:35:15.187464] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PH took 31.2s. Estimated remaining: 1h 28m 52s. Rate: 7.8 symbols/min [2025-09-30T20:35:15.454379] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-30T20:35:16.254364] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-30T20:35:16.302202] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T20:35:17.054615] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-30T20:35:17.946185] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T20:35:17.957623] [INFO ] [REMOTE ] PGRE: Full fetch complete (63753 records). [2025-09-30T20:35:17.957829] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-30T20:35:18.355623] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T20:35:18.401368] [INFO ] [REMOTE ] PHD: Full fetch complete (14532 records). [2025-09-30T20:35:18.422906] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-30T20:35:18.531749] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-30T20:35:18.544741] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-30T20:35:18.562567] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-30T20:35:18.574723] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-30T20:35:18.636254] [DEBUG] [LOCAL ] PGRE: Trimmed 63753 records to 46650 (keeping 200 days of data) [2025-09-30T20:35:18.962267] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-30T20:35:18.963282] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-30T20:35:18.964095] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-30T20:35:18.964443] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-30T20:35:18.968395] [DEBUG] [LOCAL ] PHD: Trimmed 14532 records to 10332 (keeping 200 days of data) [2025-09-30T20:35:19.137430] [DEBUG] [LOCAL ] PHD: Primary data saved (10332 records). [2025-09-30T20:35:19.138861] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-30T20:35:19.139221] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PHD took 17.2s. Estimated remaining: 1h 28m 43s. Rate: 7.8 symbols/min [2025-09-30T20:35:19.206612] [DEBUG] [LOCAL ] PGRE: Primary data saved (46650 records). [2025-09-30T20:35:19.206807] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-30T20:35:19.206898] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PGRE took 39.3s. Estimated remaining: 1h 28m 32s. Rate: 7.8 symbols/min [2025-09-30T20:35:19.789279] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:19.857361] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:19.979855] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:20.002576] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:20.010480] [DEBUG] [LOCAL ] PHI: Loaded 14967 existing records from primary storage. [2025-09-30T20:35:20.017536] [INFO ] [MAIN ] PHI: Loaded 14967 existing records. [2025-09-30T20:35:20.094983] [DEBUG] [LOCAL ] PHK: Loaded 26245 existing records from primary storage. [2025-09-30T20:35:20.123345] [INFO ] [MAIN ] PHK: Loaded 26245 existing records. [2025-09-30T20:35:20.379828] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:20.380934] [DEBUG] [LOCAL ] PHIN: Loaded 32759 existing records from primary storage. [2025-09-30T20:35:20.382319] [INFO ] [MAIN ] PHIN: Loaded 32759 existing records. [2025-09-30T20:35:20.381324] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-30T20:35:20.431583] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-30T20:35:20.491128] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-30T20:35:20.537610] [DEBUG] [LOCAL ] PHG: Loaded 46113 existing records from primary storage. [2025-09-30T20:35:20.521511] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:20.538232] [INFO ] [MAIN ] PHG: Loaded 46113 existing records. [2025-09-30T20:35:20.538111] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-30T20:35:20.539767] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-30T20:35:20.572296] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-30T20:35:20.690880] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-30T20:35:20.701467] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-30T20:35:21.094790] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:21.163544] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:21.163762] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-30T20:35:21.189814] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-30T20:35:21.231280] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-30T20:35:21.235158] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-30T20:35:21.262393] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-30T20:35:21.269278] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-30T20:35:21.269418] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-30T20:35:21.263122] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-30T20:35:22.014903] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:22.196012] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-30T20:35:22.222470] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:22.270383] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-30T20:35:22.528812] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:22.545416] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-30T20:35:22.569302] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:22.570734] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-30T20:35:23.699471] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:35:23.703421] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-30T20:35:23.802742] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T20:35:23.810897] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-30T20:35:23.841011] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T20:35:23.847345] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-30T20:35:24.589635] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:35:24.592870] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-30T20:35:24.921026] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-30T20:35:24.931469] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-30T20:35:25.286595] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T20:35:25.293920] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-30T20:35:25.304276] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:35:25.326604] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T20:35:25.854421] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-30T20:35:26.534175] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T20:35:26.654343] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-30T20:35:26.683848] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T20:35:26.937595] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T20:35:27.454364] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-30T20:35:28.248800] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:35:28.259220] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-30T20:35:28.726553] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T20:35:29.054397] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-30T20:35:29.854334] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-30T20:35:30.027974] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T20:35:30.654377] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-30T20:35:30.821763] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T20:35:31.322522] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T20:35:31.454370] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-30T20:35:31.735065] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T20:35:32.254390] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-30T20:35:32.817609] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T20:35:33.054333] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-30T20:35:33.432132] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T20:35:33.854412] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-30T20:35:34.133299] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T20:35:34.654410] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-30T20:35:34.949242] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T20:35:35.454377] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-30T20:35:36.116333] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:35:36.254395] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-30T20:35:36.717320] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T20:35:37.054426] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-30T20:35:37.765527] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T20:35:37.854389] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-30T20:35:38.347169] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T20:35:38.654407] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-30T20:35:38.855172] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T20:35:39.454412] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-30T20:35:40.254434] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-30T20:35:40.499100] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T20:35:41.001638] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T20:35:41.008596] [INFO ] [REMOTE ] PHK: Full fetch complete (39378 records). [2025-09-30T20:35:41.008804] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-30T20:35:41.066724] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-30T20:35:41.415898] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-30T20:35:41.416044] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-30T20:35:41.416920] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-30T20:35:41.416985] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-30T20:35:41.418034] [DEBUG] [LOCAL ] PHK: Trimmed 39378 records to 26275 (keeping 200 days of data) [2025-09-30T20:35:41.583871] [DEBUG] [LOCAL ] PHK: Primary data saved (26275 records). [2025-09-30T20:35:41.584005] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-30T20:35:41.584123] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHK took 22.4s. Estimated remaining: 1h 28m 31s. Rate: 7.8 symbols/min [2025-09-30T20:35:41.776354] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:41.783888] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-30T20:35:41.795617] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-30T20:35:41.795859] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-30T20:35:41.796280] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-30T20:35:41.796829] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-30T20:35:41.797928] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:35:41.797115] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-30T20:35:41.860088] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-30T20:35:42.204995] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:42.654432] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-30T20:35:42.790759] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T20:35:43.313320] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T20:35:43.330706] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T20:35:43.454369] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-30T20:35:44.254403] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-30T20:35:44.319782] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T20:35:45.054390] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-30T20:35:45.854354] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-30T20:35:46.069352] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T20:35:46.125192] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T20:35:46.654396] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-30T20:35:47.049167] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:35:47.454405] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-30T20:35:48.055760] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T20:35:48.098900] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T20:35:48.254401] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-30T20:35:49.054358] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-30T20:35:49.207157] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T20:35:49.854404] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-30T20:35:50.473579] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T20:35:50.480874] [INFO ] [REMOTE ] PHIN: Full fetch complete (48155 records). [2025-09-30T20:35:50.481020] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-30T20:35:50.661546] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-30T20:35:51.055217] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-30T20:35:51.055330] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-30T20:35:51.056600] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-30T20:35:51.056714] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-30T20:35:51.079207] [DEBUG] [LOCAL ] PHIN: Trimmed 48155 records to 32689 (keeping 200 days of data) [2025-09-30T20:35:51.079073] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T20:35:51.087212] [INFO ] [REMOTE ] PHI: Full fetch complete (20898 records). [2025-09-30T20:35:51.087360] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-30T20:35:51.458902] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-30T20:35:51.794257] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T20:35:52.066793] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-30T20:35:52.067481] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-30T20:35:52.068684] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-30T20:35:52.069019] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-30T20:35:52.072254] [DEBUG] [LOCAL ] PHI: Trimmed 20898 records to 14996 (keeping 200 days of data) [2025-09-30T20:35:52.169445] [DEBUG] [LOCAL ] PHIN: Primary data saved (32689 records). [2025-09-30T20:35:52.171236] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-30T20:35:52.172140] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 32.9s. Estimated remaining: 1h 28m 24s. Rate: 7.8 symbols/min [2025-09-30T20:35:52.256403] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-30T20:35:52.392382] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:52.408517] [DEBUG] [LOCAL ] PHI: Primary data saved (14996 records). [2025-09-30T20:35:52.408703] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-30T20:35:52.408810] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHI took 33.2s. Estimated remaining: 1h 28m 13s. Rate: 7.8 symbols/min [2025-09-30T20:35:52.633546] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:52.635254] [DEBUG] [LOCAL ] PHR: Loaded 37457 existing records from primary storage. [2025-09-30T20:35:52.635832] [INFO ] [MAIN ] PHR: Loaded 37457 existing records. [2025-09-30T20:35:52.856565] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:52.856924] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-30T20:35:52.856983] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-30T20:35:52.858023] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-30T20:35:52.858162] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-30T20:35:53.030483] [DEBUG] [LOCAL ] PII: Loaded 49021 existing records from primary storage. [2025-09-30T20:35:53.065463] [INFO ] [MAIN ] PII: Loaded 49021 existing records. [2025-09-30T20:35:53.469327] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:53.496546] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-30T20:35:53.529218] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:53.530074] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-30T20:35:53.530279] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-30T20:35:53.540265] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-30T20:35:53.562558] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-30T20:35:53.564092] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T20:35:53.692070] [INFO ] [REMOTE ] PHG: Full fetch complete (65786 records). [2025-09-30T20:35:53.704110] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-30T20:35:53.711328] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T20:35:53.874770] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-30T20:35:54.364328] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:54.549762] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-30T20:35:54.549879] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-30T20:35:54.550846] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-30T20:35:54.550935] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-30T20:35:54.553054] [DEBUG] [LOCAL ] PHG: Trimmed 65786 records to 46099 (keeping 200 days of data) [2025-09-30T20:35:54.655282] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-30T20:35:54.889065] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:35:54.913050] [DEBUG] [LOCAL ] PHG: Primary data saved (46099 records). [2025-09-30T20:35:54.913347] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-30T20:35:54.913499] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 35.7s. Estimated remaining: 1h 28m 4s. Rate: 7.8 symbols/min [2025-09-30T20:35:55.010321] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T20:35:55.128239] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:35:55.137270] [DEBUG] [LOCAL ] PIM: Loaded 4773 existing records from primary storage. [2025-09-30T20:35:55.137533] [INFO ] [MAIN ] PIM: Loaded 4773 existing records. [2025-09-30T20:35:55.334147] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:35:55.334426] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-30T20:35:55.334484] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-30T20:35:55.334770] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-30T20:35:55.334830] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-30T20:35:55.459492] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-30T20:35:55.749287] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:35:56.254370] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-30T20:35:56.310769] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:35:56.573258] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:35:56.850231] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:35:57.054380] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-30T20:35:57.854380] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-30T20:35:58.368738] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T20:35:58.654351] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-30T20:35:59.322042] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:35:59.454366] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-30T20:36:00.163084] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T20:36:00.254365] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-30T20:36:00.546544] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T20:36:01.054373] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-30T20:36:01.238766] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T20:36:01.854365] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-30T20:36:02.559085] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T20:36:02.654362] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-30T20:36:02.741449] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:36:03.454360] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-30T20:36:04.130342] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T20:36:04.158611] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T20:36:04.254362] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-30T20:36:05.054328] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-30T20:36:05.185860] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T20:36:05.854362] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-30T20:36:06.545970] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T20:36:06.654334] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-30T20:36:06.737327] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T20:36:07.454362] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-30T20:36:08.091113] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:36:08.254342] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-30T20:36:08.369545] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T20:36:08.700566] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T20:36:09.054375] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-30T20:36:09.854318] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-30T20:36:09.886870] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:36:09.898488] [INFO ] [REMOTE ] PHM: Full fetch complete (74631 records). [2025-09-30T20:36:09.898680] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-30T20:36:09.899761] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:36:09.899857] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:36:09.899904] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:36:09.899947] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-30T20:36:09.900025] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-30T20:36:09.900084] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-30T20:36:09.900147] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-30T20:36:09.900250] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHM took 28.3s. Estimated remaining: 1h 27m 59s. Rate: 7.8 symbols/min [2025-09-30T20:36:10.103366] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:10.122351] [DEBUG] [LOCAL ] PINE: Loaded 14067 existing records from primary storage. [2025-09-30T20:36:10.122615] [INFO ] [MAIN ] PINE: Loaded 14067 existing records. [2025-09-30T20:36:10.327185] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:10.327399] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-30T20:36:10.327448] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-30T20:36:10.328430] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-30T20:36:10.328520] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-30T20:36:10.659498] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-30T20:36:10.719630] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:11.211561] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T20:36:11.378020] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T20:36:11.454377] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-30T20:36:12.254378] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-30T20:36:12.914061] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T20:36:13.054367] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-30T20:36:13.693842] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T20:36:13.794964] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T20:36:13.854374] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-30T20:36:14.654413] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-30T20:36:15.230229] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T20:36:15.454398] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-30T20:36:15.676415] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T20:36:16.254393] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-30T20:36:17.054292] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T20:36:17.054381] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-30T20:36:17.646333] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T20:36:17.854345] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-30T20:36:18.236925] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T20:36:18.654413] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-30T20:36:19.454330] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-30T20:36:19.511771] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T20:36:19.549293] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T20:36:19.559296] [INFO ] [REMOTE ] PHR: Full fetch complete (52410 records). [2025-09-30T20:36:19.559471] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-30T20:36:19.963821] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-30T20:36:19.963919] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-30T20:36:19.964885] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-30T20:36:19.964957] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-30T20:36:19.966198] [DEBUG] [LOCAL ] PHR: Trimmed 52410 records to 37388 (keeping 200 days of data) [2025-09-30T20:36:20.196173] [DEBUG] [LOCAL ] PHR: Primary data saved (37388 records). [2025-09-30T20:36:20.196323] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-30T20:36:20.196414] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHR took 28.0s. Estimated remaining: 1h 27m 52s. Rate: 7.8 symbols/min [2025-09-30T20:36:20.265032] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-30T20:36:20.383393] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:20.441602] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-30T20:36:20.441987] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-30T20:36:20.631197] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:20.631491] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-30T20:36:20.631547] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-30T20:36:20.632496] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-30T20:36:20.632560] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-30T20:36:21.035910] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:21.054363] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-30T20:36:21.091408] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T20:36:21.200747] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:36:21.854445] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-30T20:36:21.886859] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:36:21.889532] [INFO ] [REMOTE ] PIM: Full fetch complete (6580 records). [2025-09-30T20:36:21.889631] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-30T20:36:22.281230] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-30T20:36:22.281315] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-30T20:36:22.281532] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-30T20:36:22.281604] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-30T20:36:22.282036] [DEBUG] [LOCAL ] PIM: Trimmed 6580 records to 4790 (keeping 200 days of data) [2025-09-30T20:36:22.310539] [DEBUG] [LOCAL ] PIM: Primary data saved (4790 records). [2025-09-30T20:36:22.310685] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-30T20:36:22.310818] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PIM took 27.4s. Estimated remaining: 1h 27m 42s. Rate: 7.8 symbols/min [2025-09-30T20:36:22.496944] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:22.515630] [DEBUG] [LOCAL ] PIPR: Loaded 14914 existing records from primary storage. [2025-09-30T20:36:22.515937] [INFO ] [MAIN ] PIPR: Loaded 14914 existing records. [2025-09-30T20:36:22.659684] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-30T20:36:22.744151] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:22.744520] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-30T20:36:22.744585] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-30T20:36:22.745186] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-30T20:36:22.745269] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-30T20:36:22.957353] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T20:36:23.166840] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:23.454366] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-30T20:36:24.254336] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-30T20:36:24.300867] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T20:36:24.416019] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T20:36:25.054408] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-30T20:36:25.854447] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-30T20:36:26.586269] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-30T20:36:26.654456] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-30T20:36:26.805108] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T20:36:26.819907] [INFO ] [REMOTE ] PII: Full fetch complete (71128 records). [2025-09-30T20:36:26.820077] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-30T20:36:26.971329] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T20:36:27.264291] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-30T20:36:27.264395] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-30T20:36:27.265535] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-30T20:36:27.265610] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-30T20:36:27.267240] [DEBUG] [LOCAL ] PII: Trimmed 71128 records to 48956 (keeping 200 days of data) [2025-09-30T20:36:27.456416] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-30T20:36:27.592126] [DEBUG] [LOCAL ] PII: Primary data saved (48956 records). [2025-09-30T20:36:27.592275] [INFO ] [MAIN ] PII: Full history saved. [2025-09-30T20:36:27.592422] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 35.2s. Estimated remaining: 1h 27m 34s. Rate: 7.8 symbols/min [2025-09-30T20:36:27.782171] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:27.807749] [DEBUG] [LOCAL ] PJT: Loaded 21931 existing records from primary storage. [2025-09-30T20:36:27.808059] [INFO ] [MAIN ] PJT: Loaded 21931 existing records. [2025-09-30T20:36:27.996320] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:27.996531] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-30T20:36:27.996581] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-30T20:36:27.997095] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-30T20:36:27.997159] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-30T20:36:28.255499] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-30T20:36:28.399081] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:28.435336] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T20:36:28.651576] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T20:36:28.901080] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:36:29.054385] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-30T20:36:29.854389] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-30T20:36:30.326853] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T20:36:30.654417] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-30T20:36:31.454393] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-30T20:36:31.603832] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:36:31.825823] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T20:36:32.254381] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-30T20:36:32.443373] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T20:36:33.054383] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-30T20:36:33.854382] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-30T20:36:34.282482] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T20:36:34.305485] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T20:36:34.654365] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-30T20:36:34.672200] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T20:36:35.454390] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-30T20:36:35.925918] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T20:36:36.254341] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-30T20:36:36.407238] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T20:36:37.054398] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-30T20:36:37.467032] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:36:37.854365] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-30T20:36:38.364756] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:36:38.654431] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-30T20:36:39.275356] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T20:36:39.454377] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-30T20:36:39.803989] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T20:36:40.254343] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-30T20:36:40.345778] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T20:36:41.054387] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-30T20:36:41.854429] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-30T20:36:42.009162] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:36:42.142943] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T20:36:42.654382] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-30T20:36:42.920142] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T20:36:43.447336] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T20:36:43.454333] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-30T20:36:44.254416] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-30T20:36:44.696569] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T20:36:45.054376] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-30T20:36:45.854326] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-30T20:36:46.087797] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T20:36:46.426491] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T20:36:46.654387] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-30T20:36:46.990731] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T20:36:47.454410] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-30T20:36:48.254364] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-30T20:36:48.529414] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T20:36:48.533079] [INFO ] [REMOTE ] PINE: Full fetch complete (21078 records). [2025-09-30T20:36:48.533352] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-30T20:36:48.663466] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T20:36:49.011931] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-30T20:36:49.012122] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-30T20:36:49.012599] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-30T20:36:49.012704] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-30T20:36:49.014244] [DEBUG] [LOCAL ] PINE: Trimmed 21078 records to 14075 (keeping 200 days of data) [2025-09-30T20:36:49.063314] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-30T20:36:49.072349] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T20:36:49.125084] [DEBUG] [LOCAL ] PINE: Primary data saved (14075 records). [2025-09-30T20:36:49.125224] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-30T20:36:49.125307] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 39.2s. Estimated remaining: 1h 27m 31s. Rate: 7.8 symbols/min [2025-09-30T20:36:49.303520] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:49.366046] [DEBUG] [LOCAL ] PK: Loaded 52830 existing records from primary storage. [2025-09-30T20:36:49.366380] [INFO ] [MAIN ] PK: Loaded 52830 existing records. [2025-09-30T20:36:49.562833] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:49.563189] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-30T20:36:49.563251] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-30T20:36:49.563726] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-30T20:36:49.563808] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-30T20:36:49.863188] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-30T20:36:49.960437] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:50.654349] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-30T20:36:50.994815] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T20:36:50.999153] [INFO ] [REMOTE ] PJT: Full fetch complete (31927 records). [2025-09-30T20:36:50.999293] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-30T20:36:51.441126] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-30T20:36:51.441287] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-30T20:36:51.442095] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-30T20:36:51.442183] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-30T20:36:51.444998] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-30T20:36:51.456907] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-30T20:36:51.458289] [DEBUG] [LOCAL ] PJT: Trimmed 31927 records to 21762 (keeping 200 days of data) [2025-09-30T20:36:51.604457] [DEBUG] [LOCAL ] PJT: Primary data saved (21762 records). [2025-09-30T20:36:51.604595] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-30T20:36:51.604721] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PJT took 24.0s. Estimated remaining: 1h 27m 22s. Rate: 7.8 symbols/min [2025-09-30T20:36:51.796532] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:51.808859] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T20:36:51.829272] [DEBUG] [LOCAL ] PKE: Loaded 12743 existing records from primary storage. [2025-09-30T20:36:51.829538] [INFO ] [MAIN ] PKE: Loaded 12743 existing records. [2025-09-30T20:36:52.022263] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:52.022531] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-30T20:36:52.022587] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-30T20:36:52.022906] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-30T20:36:52.022974] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-30T20:36:52.259569] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-30T20:36:52.406007] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:53.054426] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-30T20:36:53.389380] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T20:36:53.492912] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T20:36:53.496504] [INFO ] [REMOTE ] PIPR: Full fetch complete (20451 records). [2025-09-30T20:36:53.496633] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-30T20:36:53.863719] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-30T20:36:53.913962] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-30T20:36:53.914079] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-30T20:36:53.914637] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-30T20:36:53.914731] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-30T20:36:53.915524] [DEBUG] [LOCAL ] PIPR: Trimmed 20451 records to 14870 (keeping 200 days of data) [2025-09-30T20:36:54.016304] [DEBUG] [LOCAL ] PIPR: Primary data saved (14870 records). [2025-09-30T20:36:54.016482] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-30T20:36:54.016610] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PIPR took 31.7s. Estimated remaining: 1h 27m 12s. Rate: 7.8 symbols/min [2025-09-30T20:36:54.290775] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:36:54.339296] [DEBUG] [LOCAL ] PKG: Loaded 39062 existing records from primary storage. [2025-09-30T20:36:54.339730] [INFO ] [MAIN ] PKG: Loaded 39062 existing records. [2025-09-30T20:36:54.536950] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:36:54.537225] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-30T20:36:54.537277] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-30T20:36:54.538258] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-30T20:36:54.538325] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-30T20:36:54.659569] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-30T20:36:54.957489] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:36:55.183517] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T20:36:55.434166] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:36:55.454318] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-30T20:36:55.884979] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T20:36:56.254369] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-30T20:36:56.993856] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T20:36:57.054364] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-30T20:36:57.102515] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T20:36:57.854358] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-30T20:36:58.459698] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T20:36:58.654367] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-30T20:36:59.182862] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T20:36:59.198495] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-30T20:36:59.198694] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-30T20:36:59.459539] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-30T20:36:59.525944] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:36:59.660356] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-30T20:36:59.660447] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-30T20:36:59.661606] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-30T20:36:59.661700] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-30T20:36:59.663375] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 53693 (keeping 200 days of data) [2025-09-30T20:37:00.015708] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-30T20:37:00.015881] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-30T20:37:00.016008] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PINS took 39.8s. Estimated remaining: 1h 27m 3s. Rate: 7.8 symbols/min [2025-09-30T20:37:00.212443] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:00.235173] [DEBUG] [LOCAL ] PKST: Loaded 18985 existing records from primary storage. [2025-09-30T20:37:00.235449] [INFO ] [MAIN ] PKST: Loaded 18985 existing records. [2025-09-30T20:37:00.259559] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-30T20:37:00.463103] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:00.478081] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-30T20:37:00.478822] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-30T20:37:00.479677] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T20:37:00.487282] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-30T20:37:00.488210] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-30T20:37:00.900269] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:01.054346] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-30T20:37:01.267930] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:37:01.854334] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-30T20:37:01.964619] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T20:37:02.365213] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-30T20:37:02.654366] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-30T20:37:03.454345] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-30T20:37:03.556389] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:37:04.254371] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-30T20:37:05.054347] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-30T20:37:05.116738] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:37:05.854376] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-30T20:37:06.231440] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T20:37:06.292780] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T20:37:06.654386] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-30T20:37:07.067022] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T20:37:07.454378] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-30T20:37:07.716533] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:37:08.254368] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-30T20:37:08.643447] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T20:37:09.054369] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-30T20:37:09.350403] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T20:37:09.354131] [INFO ] [REMOTE ] PKE: Full fetch complete (17184 records). [2025-09-30T20:37:09.354211] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-30T20:37:09.766037] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-30T20:37:09.766191] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-30T20:37:09.766612] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-30T20:37:09.767572] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-30T20:37:09.768429] [DEBUG] [LOCAL ] PKE: Trimmed 17184 records to 12852 (keeping 200 days of data) [2025-09-30T20:37:09.851503] [DEBUG] [LOCAL ] PKE: Primary data saved (12852 records). [2025-09-30T20:37:09.851684] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-30T20:37:09.851803] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 18.2s. Estimated remaining: 1h 26m 57s. Rate: 7.8 symbols/min [2025-09-30T20:37:09.857211] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-30T20:37:10.068807] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T20:37:10.102230] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:10.126676] [DEBUG] [LOCAL ] PKX: Loaded 24464 existing records from primary storage. [2025-09-30T20:37:10.126973] [INFO ] [MAIN ] PKX: Loaded 24464 existing records. [2025-09-30T20:37:10.325843] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:10.326076] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-30T20:37:10.326125] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-30T20:37:10.327037] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-30T20:37:10.327101] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-30T20:37:10.665633] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-30T20:37:10.710767] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:11.454389] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-30T20:37:11.749785] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T20:37:11.792263] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T20:37:12.254338] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-30T20:37:12.369532] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:37:13.054346] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-30T20:37:13.181707] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T20:37:13.854367] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-30T20:37:14.402842] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T20:37:14.470273] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T20:37:14.654391] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-30T20:37:15.454369] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-30T20:37:15.512514] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T20:37:16.254364] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-30T20:37:16.682365] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T20:37:17.054413] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-30T20:37:17.520008] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T20:37:17.854352] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-30T20:37:18.338163] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T20:37:18.654351] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-30T20:37:18.783032] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T20:37:19.454371] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-30T20:37:19.718979] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T20:37:20.254351] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-30T20:37:20.487401] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T20:37:21.054377] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-30T20:37:21.854365] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-30T20:37:22.015007] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T20:37:22.112069] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T20:37:22.654384] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-30T20:37:23.182934] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T20:37:23.213003] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T20:37:23.220996] [INFO ] [REMOTE ] PKG: Full fetch complete (57383 records). [2025-09-30T20:37:23.221130] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-30T20:37:23.221823] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:37:23.221917] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:37:23.221963] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:37:23.222012] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-30T20:37:23.222073] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-09-30T20:37:23.222110] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-09-30T20:37:23.222661] [DEBUG] [LOCAL ] PKG: Deleted derivative data file. [2025-09-30T20:37:23.222763] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 29.2s. Estimated remaining: 1h 26m 51s. Rate: 7.8 symbols/min [2025-09-30T20:37:23.416288] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:23.455357] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-30T20:37:23.483498] [DEBUG] [LOCAL ] PL: Loaded 53119 existing records from primary storage. [2025-09-30T20:37:23.483915] [INFO ] [MAIN ] PL: Loaded 53119 existing records. [2025-09-30T20:37:23.689773] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:23.690001] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-30T20:37:23.690052] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-30T20:37:23.691292] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-30T20:37:23.691358] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-30T20:37:24.111947] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:24.254399] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-30T20:37:25.054398] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-30T20:37:25.299240] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T20:37:25.351885] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T20:37:25.854364] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-30T20:37:26.290113] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T20:37:26.654400] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-30T20:37:27.454365] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-30T20:37:27.795559] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T20:37:28.254359] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-30T20:37:28.652545] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T20:37:28.650488] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T20:37:28.669555] [INFO ] [REMOTE ] PKST: Full fetch complete (29630 records). [2025-09-30T20:37:28.669732] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-30T20:37:29.058034] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-30T20:37:29.058335] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-30T20:37:29.059240] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-30T20:37:29.059996] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-30T20:37:29.060075] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-30T20:37:29.061052] [DEBUG] [LOCAL ] PKST: Trimmed 29630 records to 18879 (keeping 200 days of data) [2025-09-30T20:37:29.181184] [DEBUG] [LOCAL ] PKST: Primary data saved (18879 records). [2025-09-30T20:37:29.181332] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-30T20:37:29.181420] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 29.2s. Estimated remaining: 1h 26m 43s. Rate: 7.8 symbols/min [2025-09-30T20:37:29.368583] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:29.425132] [DEBUG] [LOCAL ] PLD: Loaded 53437 existing records from primary storage. [2025-09-30T20:37:29.425466] [INFO ] [MAIN ] PLD: Loaded 53437 existing records. [2025-09-30T20:37:29.619067] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:29.619301] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-30T20:37:29.619360] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-30T20:37:29.620948] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-30T20:37:29.621027] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-30T20:37:29.857151] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-30T20:37:30.028554] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:30.132217] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T20:37:30.660294] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-30T20:37:30.678948] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T20:37:31.454417] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-30T20:37:32.008507] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-30T20:37:32.260234] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-30T20:37:32.282375] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T20:37:32.294478] [INFO ] [REMOTE ] PK: Full fetch complete (76368 records). [2025-09-30T20:37:32.294624] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-30T20:37:32.760131] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-30T20:37:32.767770] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-30T20:37:32.779864] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T20:37:32.779054] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-30T20:37:32.785396] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-30T20:37:32.787937] [DEBUG] [LOCAL ] PK: Trimmed 76368 records to 52824 (keeping 200 days of data) [2025-09-30T20:37:33.085856] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-30T20:37:33.134858] [DEBUG] [LOCAL ] PK: Primary data saved (52824 records). [2025-09-30T20:37:33.134985] [INFO ] [MAIN ] PK: Full history saved. [2025-09-30T20:37:33.135071] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PK took 44.0s. Estimated remaining: 1h 26m 34s. Rate: 7.8 symbols/min [2025-09-30T20:37:33.327773] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:33.377058] [DEBUG] [LOCAL ] PLNT: Loaded 48343 existing records from primary storage. [2025-09-30T20:37:33.377387] [INFO ] [MAIN ] PLNT: Loaded 48343 existing records. [2025-09-30T20:37:33.581723] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:33.581967] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-30T20:37:33.582026] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-30T20:37:33.583120] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-30T20:37:33.583184] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-30T20:37:33.856176] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-30T20:37:33.978298] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:34.020530] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T20:37:34.376566] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-30T20:37:34.654353] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-30T20:37:34.816296] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T20:37:35.454419] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-30T20:37:36.261814] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-30T20:37:36.293160] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T20:37:36.410804] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T20:37:37.054380] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-30T20:37:37.854350] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-30T20:37:37.968467] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T20:37:38.316283] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T20:37:38.654373] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-30T20:37:39.454336] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-30T20:37:39.654385] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:37:40.254307] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-30T20:37:40.288776] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:37:40.375863] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T20:37:41.054397] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-30T20:37:41.854380] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-30T20:37:42.189151] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T20:37:42.402102] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-30T20:37:42.503335] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T20:37:42.654363] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-30T20:37:43.259293] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T20:37:43.454365] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-30T20:37:44.254382] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-30T20:37:45.054336] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-30T20:37:45.139762] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T20:37:45.183808] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T20:37:45.854394] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-30T20:37:46.654350] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-30T20:37:47.454322] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-30T20:37:47.485661] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-30T20:37:47.533537] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T20:37:47.538759] [INFO ] [REMOTE ] PKX: Full fetch complete (37135 records). [2025-09-30T20:37:47.538873] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-30T20:37:47.884390] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T20:37:47.986047] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-30T20:37:47.986129] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-30T20:37:47.986955] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-30T20:37:47.987020] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-30T20:37:47.987944] [DEBUG] [LOCAL ] PKX: Trimmed 37135 records to 24346 (keeping 200 days of data) [2025-09-30T20:37:48.144237] [DEBUG] [LOCAL ] PKX: Primary data saved (24346 records). [2025-09-30T20:37:48.144387] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-30T20:37:48.144477] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 38.3s. Estimated remaining: 1h 26m 29s. Rate: 7.8 symbols/min [2025-09-30T20:37:48.259458] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-30T20:37:48.387830] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:48.408526] [DEBUG] [LOCAL ] PLOW: Loaded 20412 existing records from primary storage. [2025-09-30T20:37:48.408800] [INFO ] [MAIN ] PLOW: Loaded 20412 existing records. [2025-09-30T20:37:48.610698] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:48.610963] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-30T20:37:48.611015] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-30T20:37:48.611573] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-30T20:37:48.611633] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-30T20:37:48.776444] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T20:37:49.065579] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-30T20:37:49.071930] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:49.854352] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-30T20:37:50.104508] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T20:37:50.160554] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T20:37:50.654373] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-30T20:37:51.454375] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-30T20:37:51.911830] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T20:37:52.096184] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-30T20:37:52.152925] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T20:37:52.254369] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-30T20:37:53.054329] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-30T20:37:53.125785] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:37:53.138918] [INFO ] [REMOTE ] PLD: Full fetch complete (76992 records). [2025-09-30T20:37:53.139104] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-30T20:37:53.140144] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:37:53.140268] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:37:53.140350] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:37:53.140451] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-30T20:37:53.140543] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-09-30T20:37:53.140587] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-09-30T20:37:53.141094] [DEBUG] [LOCAL ] PLD: Deleted derivative data file. [2025-09-30T20:37:53.141198] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLD took 24.0s. Estimated remaining: 1h 26m 20s. Rate: 7.8 symbols/min [2025-09-30T20:37:53.335127] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:37:53.372068] [DEBUG] [LOCAL ] PLYM: Loaded 33468 existing records from primary storage. [2025-09-30T20:37:53.372376] [INFO ] [MAIN ] PLYM: Loaded 33468 existing records. [2025-09-30T20:37:53.564041] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:37:53.564265] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-30T20:37:53.564317] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-30T20:37:53.565176] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-30T20:37:53.565237] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-30T20:37:53.859470] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-30T20:37:53.991985] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:37:53.993467] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:37:54.654359] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-30T20:37:55.412178] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:37:55.454395] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-30T20:37:56.171710] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-30T20:37:56.254328] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-30T20:37:56.548380] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T20:37:57.054371] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-30T20:37:57.854331] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-30T20:37:58.044451] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T20:37:58.431323] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T20:37:58.654353] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-30T20:37:59.454363] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-30T20:38:00.254353] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-30T20:38:00.311633] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-30T20:38:00.323422] [INFO ] [REMOTE ] PL: Full fetch complete (76951 records). [2025-09-30T20:38:00.323591] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-30T20:38:00.657616] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T20:38:00.815285] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-30T20:38:00.815431] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-30T20:38:00.816703] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-30T20:38:00.816791] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-30T20:38:00.818619] [DEBUG] [LOCAL ] PL: Trimmed 76951 records to 53131 (keeping 200 days of data) [2025-09-30T20:38:00.921456] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:38:01.054372] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-30T20:38:01.168877] [DEBUG] [LOCAL ] PL: Primary data saved (53131 records). [2025-09-30T20:38:01.169143] [INFO ] [MAIN ] PL: Full history saved. [2025-09-30T20:38:01.169273] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PL took 37.9s. Estimated remaining: 1h 26m 13s. Rate: 7.8 symbols/min [2025-09-30T20:38:01.365072] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:01.365361] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-30T20:38:01.365467] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-30T20:38:01.383602] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T20:38:01.382738] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-30T20:38:01.390839] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-30T20:38:01.391422] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-30T20:38:01.391482] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-30T20:38:01.841042] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:01.854306] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-30T20:38:02.371574] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T20:38:02.422229] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T20:38:02.654350] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-30T20:38:03.454328] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-30T20:38:03.565082] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T20:38:04.254401] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-30T20:38:04.759492] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T20:38:05.054385] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-30T20:38:05.265719] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:38:05.854367] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-30T20:38:06.654357] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-30T20:38:06.834631] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T20:38:07.372763] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T20:38:07.378304] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T20:38:07.454355] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-30T20:38:08.254333] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-30T20:38:08.588009] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:38:09.054376] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-30T20:38:09.712537] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T20:38:09.854394] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-30T20:38:10.399102] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T20:38:10.654395] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-30T20:38:10.870712] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T20:38:11.454418] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-30T20:38:11.768747] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T20:38:12.254327] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-30T20:38:12.474060] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T20:38:13.054378] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-30T20:38:13.854373] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-30T20:38:13.946106] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:38:13.988365] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T20:38:14.654335] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-30T20:38:14.970730] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T20:38:15.454424] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-30T20:38:15.590920] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T20:38:16.254379] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-30T20:38:16.321183] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:38:16.334340] [INFO ] [REMOTE ] PLNT: Full fetch complete (70305 records). [2025-09-30T20:38:16.334528] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-30T20:38:16.756547] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-30T20:38:16.756693] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-30T20:38:16.757833] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-30T20:38:16.757938] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-30T20:38:16.760570] [DEBUG] [LOCAL ] PLNT: Trimmed 70305 records to 48308 (keeping 200 days of data) [2025-09-30T20:38:17.054805] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-30T20:38:17.065575] [DEBUG] [LOCAL ] PLNT: Primary data saved (48308 records). [2025-09-30T20:38:17.065710] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-30T20:38:17.065812] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLNT took 43.9s. Estimated remaining: 1h 26m 8s. Rate: 7.8 symbols/min [2025-09-30T20:38:17.260145] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:17.281920] [DEBUG] [LOCAL ] PML: Loaded 20988 existing records from primary storage. [2025-09-30T20:38:17.282222] [INFO ] [MAIN ] PML: Loaded 20988 existing records. [2025-09-30T20:38:17.478963] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:38:17.479293] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-30T20:38:17.479348] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-30T20:38:17.479911] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-30T20:38:17.479972] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-30T20:38:17.772927] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T20:38:17.856459] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-30T20:38:17.914285] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:17.925919] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:38:17.929851] [INFO ] [REMOTE ] PLOW: Full fetch complete (28731 records). [2025-09-30T20:38:17.929971] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-30T20:38:18.320135] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-30T20:38:18.320219] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-30T20:38:18.320928] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-30T20:38:18.321017] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-30T20:38:18.321868] [DEBUG] [LOCAL ] PLOW: Trimmed 28731 records to 20380 (keeping 200 days of data) [2025-09-30T20:38:18.459343] [DEBUG] [LOCAL ] PLOW: Primary data saved (20380 records). [2025-09-30T20:38:18.459464] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-30T20:38:18.459597] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLOW took 30.3s. Estimated remaining: 1h 25m 58s. Rate: 7.8 symbols/min [2025-09-30T20:38:18.644130] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:18.655327] [DEBUG] [LOCAL ] PMM: Loaded 10617 existing records from primary storage. [2025-09-30T20:38:18.655045] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-30T20:38:18.656415] [INFO ] [MAIN ] PMM: Loaded 10617 existing records. [2025-09-30T20:38:18.854600] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:38:18.855214] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-30T20:38:18.855326] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-30T20:38:18.856001] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-30T20:38:18.856070] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-30T20:38:19.230293] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:19.402415] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:38:19.454376] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-30T20:38:19.929784] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T20:38:20.254396] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-30T20:38:20.709289] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T20:38:21.054375] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-30T20:38:21.570609] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T20:38:21.854409] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-30T20:38:21.946560] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:38:21.957738] [INFO ] [REMOTE ] PM: Full fetch complete (77312 records). [2025-09-30T20:38:21.957926] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-30T20:38:21.958729] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:38:21.958878] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:38:21.958948] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:38:21.959023] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-30T20:38:21.959091] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-30T20:38:21.959130] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-30T20:38:21.959185] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-30T20:38:21.959280] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PM took 20.8s. Estimated remaining: 1h 25m 49s. Rate: 7.8 symbols/min [2025-09-30T20:38:22.144434] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:22.156775] [DEBUG] [LOCAL ] PMO: Loaded 10477 existing records from primary storage. [2025-09-30T20:38:22.157078] [INFO ] [MAIN ] PMO: Loaded 10477 existing records. [2025-09-30T20:38:22.350049] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:38:22.350343] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-30T20:38:22.350403] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-30T20:38:22.350832] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-30T20:38:22.350893] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-30T20:38:22.659512] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-30T20:38:22.783158] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:22.935689] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:38:23.454353] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-30T20:38:24.254341] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-30T20:38:24.451575] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T20:38:24.756042] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T20:38:25.054356] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-30T20:38:25.189274] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:38:25.854376] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-30T20:38:26.149409] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T20:38:26.654396] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-30T20:38:27.056689] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T20:38:27.454410] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-30T20:38:27.775872] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:38:28.254436] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-30T20:38:28.381699] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:38:29.054399] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-30T20:38:29.854333] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-30T20:38:29.887586] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T20:38:29.897192] [INFO ] [REMOTE ] PLYM: Full fetch complete (46888 records). [2025-09-30T20:38:29.897361] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-30T20:38:30.126449] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T20:38:30.333883] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-30T20:38:30.333973] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-30T20:38:30.334793] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-30T20:38:30.334868] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-30T20:38:30.336846] [DEBUG] [LOCAL ] PLYM: Trimmed 46888 records to 33413 (keeping 200 days of data) [2025-09-30T20:38:30.561350] [DEBUG] [LOCAL ] PLYM: Primary data saved (33413 records). [2025-09-30T20:38:30.561503] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-30T20:38:30.561632] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PLYM took 37.4s. Estimated remaining: 1h 25m 41s. Rate: 7.8 symbols/min [2025-09-30T20:38:30.660592] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-30T20:38:30.752463] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:30.798978] [DEBUG] [LOCAL ] PMT: Loaded 40058 existing records from primary storage. [2025-09-30T20:38:30.799320] [INFO ] [MAIN ] PMT: Loaded 40058 existing records. [2025-09-30T20:38:30.973168] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T20:38:31.015840] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:38:31.016423] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-30T20:38:31.016485] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-30T20:38:31.018087] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-30T20:38:31.018198] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-30T20:38:31.411999] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:31.454332] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-30T20:38:31.584226] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:38:32.254349] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-30T20:38:32.481343] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:38:33.054407] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-30T20:38:33.080462] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T20:38:33.854366] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-30T20:38:34.140733] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T20:38:34.654313] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-30T20:38:35.050737] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T20:38:35.454396] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-30T20:38:35.496740] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T20:38:36.256330] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T20:38:36.254931] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-30T20:38:37.059060] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-30T20:38:37.062055] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T20:38:37.854335] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-30T20:38:37.892728] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T20:38:38.654383] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-30T20:38:39.454369] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-30T20:38:39.533632] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T20:38:39.719289] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T20:38:40.254396] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-30T20:38:40.273980] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T20:38:41.054400] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-30T20:38:41.386470] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:38:41.854356] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-30T20:38:41.916536] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T20:38:41.919341] [INFO ] [REMOTE ] PMM: Full fetch complete (18289 records). [2025-09-30T20:38:41.919461] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-30T20:38:42.349913] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-30T20:38:42.350001] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-30T20:38:42.350496] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-30T20:38:42.350562] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-30T20:38:42.351291] [DEBUG] [LOCAL ] PMM: Trimmed 18289 records to 10685 (keeping 200 days of data) [2025-09-30T20:38:42.425180] [DEBUG] [LOCAL ] PMM: Primary data saved (10685 records). [2025-09-30T20:38:42.425333] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-30T20:38:42.425441] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 24.0s. Estimated remaining: 1h 25m 35s. Rate: 7.8 symbols/min [2025-09-30T20:38:42.650843] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:42.651178] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-30T20:38:42.651264] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-30T20:38:42.651476] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-30T20:38:42.651553] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-30T20:38:42.651637] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-30T20:38:42.651743] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-30T20:38:42.664029] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-30T20:38:43.036785] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:43.391738] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T20:38:43.454343] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-30T20:38:43.720088] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:38:44.254363] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-30T20:38:44.680166] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T20:38:45.054388] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-30T20:38:45.550782] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T20:38:45.557474] [INFO ] [REMOTE ] PML: Full fetch complete (29940 records). [2025-09-30T20:38:45.557673] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-30T20:38:45.857887] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-30T20:38:45.984990] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-30T20:38:45.985576] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-30T20:38:45.985410] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:38:45.989117] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-30T20:38:45.989702] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-30T20:38:45.991171] [DEBUG] [LOCAL ] PML: Trimmed 29940 records to 21122 (keeping 200 days of data) [2025-09-30T20:38:46.137455] [DEBUG] [LOCAL ] PML: Primary data saved (21122 records). [2025-09-30T20:38:46.137677] [INFO ] [MAIN ] PML: Full history saved. [2025-09-30T20:38:46.137938] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PML took 29.1s. Estimated remaining: 1h 25m 26s. Rate: 7.8 symbols/min [2025-09-30T20:38:46.321849] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:46.322064] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-30T20:38:46.322120] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-30T20:38:46.322237] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-30T20:38:46.322280] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-30T20:38:46.322323] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-30T20:38:46.322356] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-30T20:38:46.431434] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T20:38:46.659568] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-30T20:38:46.702251] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:47.076002] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-30T20:38:47.454399] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-30T20:38:47.932457] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T20:38:48.254371] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-30T20:38:48.517191] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:38:48.517492] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-30T20:38:48.517601] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:38:48.517698] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-30T20:38:48.517766] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:38:48.517838] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-30T20:38:48.517940] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-30T20:38:48.517985] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-30T20:38:48.518083] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-30T20:38:48.518157] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTV took 2.4s. Estimated remaining: 1h 25m 16s. Rate: 7.8 symbols/min [2025-09-30T20:38:48.715249] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:48.715458] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-30T20:38:48.715515] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-30T20:38:48.715660] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-30T20:38:48.715730] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-30T20:38:48.715799] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-30T20:38:48.715835] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-30T20:38:49.064481] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-30T20:38:49.099141] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:49.514845] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T20:38:49.854366] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-30T20:38:50.121723] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:38:50.122071] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-30T20:38:50.122174] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:38:50.122233] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-30T20:38:50.122321] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:38:50.122393] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-30T20:38:50.122457] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-30T20:38:50.122493] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-30T20:38:50.122532] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-30T20:38:50.122578] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 25m 6s. Rate: 7.8 symbols/min [2025-09-30T20:38:50.309678] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:50.309890] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-30T20:38:50.309953] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-30T20:38:50.310074] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-30T20:38:50.310122] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-30T20:38:50.310173] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-30T20:38:50.310208] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-30T20:38:50.661522] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-30T20:38:50.706967] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:51.454421] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-30T20:38:51.511020] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T20:38:51.948374] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T20:38:52.254386] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-30T20:38:52.878165] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T20:38:53.054382] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-30T20:38:53.453783] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T20:38:53.854367] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-30T20:38:54.292017] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T20:38:54.654355] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-30T20:38:55.087668] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T20:38:55.454388] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-30T20:38:56.254361] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-30T20:38:56.272621] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T20:38:56.275273] [INFO ] [REMOTE ] PMO: Full fetch complete (17347 records). [2025-09-30T20:38:56.275397] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-30T20:38:56.682187] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T20:38:56.695899] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-30T20:38:56.696003] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-30T20:38:56.696486] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-30T20:38:56.696579] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-30T20:38:56.697284] [DEBUG] [LOCAL ] PMO: Trimmed 17347 records to 10528 (keeping 200 days of data) [2025-09-30T20:38:56.766629] [DEBUG] [LOCAL ] PMO: Primary data saved (10528 records). [2025-09-30T20:38:56.766817] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-30T20:38:56.766953] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMO took 34.8s. Estimated remaining: 1h 24m 58s. Rate: 7.8 symbols/min [2025-09-30T20:38:56.960782] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:38:56.970329] [DEBUG] [LOCAL ] PNI: Loaded 6771 existing records from primary storage. [2025-09-30T20:38:56.970551] [INFO ] [MAIN ] PNI: Loaded 6771 existing records. [2025-09-30T20:38:57.059508] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-30T20:38:57.173105] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:38:57.173353] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-30T20:38:57.173416] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-30T20:38:57.173819] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-30T20:38:57.173901] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-30T20:38:57.639098] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:38:57.854372] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-30T20:38:57.938132] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:38:58.570574] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T20:38:58.654352] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-30T20:38:59.222124] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T20:38:59.454370] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-30T20:39:00.254371] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-30T20:39:00.396748] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:39:00.708725] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T20:39:00.709521] [INFO ] [REMOTE ] PMTU: Full fetch complete (1230 records). [2025-09-30T20:39:00.709589] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-30T20:39:00.905459] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-30T20:39:00.905681] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:39:00.905743] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:39:00.905814] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-30T20:39:00.905922] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-30T20:39:00.905966] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-30T20:39:00.906025] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-30T20:39:00.906129] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTU took 18.5s. Estimated remaining: 1h 24m 49s. Rate: 7.8 symbols/min [2025-09-30T20:39:01.061257] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-30T20:39:01.099139] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:01.137296] [DEBUG] [LOCAL ] PNNT: Loaded 32747 existing records from primary storage. [2025-09-30T20:39:01.137620] [INFO ] [MAIN ] PNNT: Loaded 32747 existing records. [2025-09-30T20:39:01.338381] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:39:01.338594] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-30T20:39:01.338662] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-30T20:39:01.339726] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-30T20:39:01.339787] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-30T20:39:01.827183] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:01.854352] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-30T20:39:02.654333] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-30T20:39:02.738855] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T20:39:03.454390] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-30T20:39:03.469624] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:39:03.516442] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:39:04.254375] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-30T20:39:04.527462] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T20:39:05.054372] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-30T20:39:05.752572] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T20:39:05.854346] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-30T20:39:05.936403] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:39:06.654375] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-30T20:39:07.159532] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T20:39:07.454415] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-30T20:39:07.622115] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T20:39:08.098399] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:39:08.254382] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-30T20:39:09.054327] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-30T20:39:09.128494] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T20:39:09.854373] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-30T20:39:09.952257] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T20:39:10.654361] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-30T20:39:11.386559] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T20:39:11.387418] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T20:39:11.454365] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-30T20:39:12.254397] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-30T20:39:13.059959] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-30T20:39:13.071281] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T20:39:13.144382] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:39:13.740690] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T20:39:13.854348] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-30T20:39:14.654390] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-30T20:39:15.323866] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T20:39:15.454422] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-30T20:39:15.533942] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T20:39:16.254393] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-30T20:39:17.054372] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-30T20:39:17.331885] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:39:17.352913] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T20:39:17.711850] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T20:39:17.854363] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-30T20:39:18.654372] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-30T20:39:18.672719] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T20:39:19.454414] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-30T20:39:20.160789] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T20:39:20.254352] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-30T20:39:21.054354] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-30T20:39:21.173111] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T20:39:21.588959] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T20:39:21.751212] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T20:39:21.854339] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-30T20:39:22.654399] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-30T20:39:23.164087] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-30T20:39:23.174540] [INFO ] [REMOTE ] PNC: Full fetch complete (75109 records). [2025-09-30T20:39:23.174710] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-30T20:39:23.175460] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:39:23.175589] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:39:23.175633] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:39:23.175726] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-30T20:39:23.175817] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-30T20:39:23.175876] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-30T20:39:23.175922] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-30T20:39:23.175980] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNC took 33.1s. Estimated remaining: 1h 24m 47s. Rate: 7.8 symbols/min [2025-09-30T20:39:23.358084] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:23.358324] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-30T20:39:23.358405] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-30T20:39:23.358752] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-30T20:39:23.358987] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-30T20:39:23.359201] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-30T20:39:23.359270] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-30T20:39:23.459213] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-30T20:39:23.487419] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T20:39:23.551379] [INFO ] [REMOTE ] PNNT: Full fetch complete (47354 records). [2025-09-30T20:39:23.567569] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-30T20:39:23.980631] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:24.259996] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-30T20:39:24.280561] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-30T20:39:24.280703] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-30T20:39:24.281592] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-30T20:39:24.281681] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-30T20:39:24.283514] [DEBUG] [LOCAL ] PNNT: Trimmed 47354 records to 32785 (keeping 200 days of data) [2025-09-30T20:39:24.379745] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:39:24.384562] [INFO ] [REMOTE ] PNI: Full fetch complete (9929 records). [2025-09-30T20:39:24.386686] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-30T20:39:24.829821] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-30T20:39:24.830485] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-30T20:39:24.831433] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-30T20:39:24.831806] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-30T20:39:24.835947] [DEBUG] [LOCAL ] PNI: Trimmed 9929 records to 6775 (keeping 200 days of data) [2025-09-30T20:39:24.940831] [DEBUG] [LOCAL ] PNI: Primary data saved (6775 records). [2025-09-30T20:39:24.941576] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-30T20:39:24.941981] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 28.2s. Estimated remaining: 1h 24m 37s. Rate: 7.8 symbols/min [2025-09-30T20:39:25.057696] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-30T20:39:25.150003] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:25.161367] [DEBUG] [LOCAL ] PNNT: Primary data saved (32785 records). [2025-09-30T20:39:25.161569] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-30T20:39:25.161782] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 24.3s. Estimated remaining: 1h 24m 26s. Rate: 7.8 symbols/min [2025-09-30T20:39:25.382739] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:25.402330] [DEBUG] [LOCAL ] PNW: Loaded 45786 existing records from primary storage. [2025-09-30T20:39:25.402944] [INFO ] [MAIN ] PNW: Loaded 45786 existing records. [2025-09-30T20:39:25.630803] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:39:25.631123] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-30T20:39:25.631185] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-30T20:39:25.632579] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-30T20:39:25.632677] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-30T20:39:25.754762] [DEBUG] [LOCAL ] POR: Loaded 46997 existing records from primary storage. [2025-09-30T20:39:25.798949] [INFO ] [MAIN ] POR: Loaded 46997 existing records. [2025-09-30T20:39:26.080084] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T20:39:26.138475] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-30T20:39:26.334873] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:39:26.369907] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:26.365944] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-30T20:39:26.370384] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-30T20:39:26.381107] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-30T20:39:26.398775] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-30T20:39:26.469180] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T20:39:26.664957] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-30T20:39:26.829070] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:27.454345] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-30T20:39:27.854341] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T20:39:27.937593] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T20:39:28.013026] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-30T20:39:28.254370] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-30T20:39:29.054340] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-30T20:39:29.106622] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T20:39:29.759402] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:39:29.854367] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-30T20:39:30.654351] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-30T20:39:30.738751] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T20:39:31.454358] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-30T20:39:32.254364] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-30T20:39:32.291799] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T20:39:32.362796] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T20:39:33.054401] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-30T20:39:33.211684] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T20:39:33.612844] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T20:39:33.854374] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-30T20:39:34.654377] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-30T20:39:34.747467] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T20:39:35.454334] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-30T20:39:35.733400] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T20:39:36.131249] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T20:39:36.254410] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-30T20:39:37.054359] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-30T20:39:37.854917] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T20:39:37.855211] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-30T20:39:37.960282] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T20:39:38.654382] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-30T20:39:38.792840] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T20:39:39.454431] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-30T20:39:40.211558] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T20:39:40.226340] [INFO ] [REMOTE ] PMT: Full fetch complete (58317 records). [2025-09-30T20:39:40.226522] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-30T20:39:40.260027] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-30T20:39:40.501305] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T20:39:40.736727] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-30T20:39:40.736834] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-30T20:39:40.737921] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-30T20:39:40.737991] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-30T20:39:40.739378] [DEBUG] [LOCAL ] PMT: Trimmed 58317 records to 40156 (keeping 200 days of data) [2025-09-30T20:39:40.996284] [DEBUG] [LOCAL ] PMT: Primary data saved (40156 records). [2025-09-30T20:39:40.996418] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-30T20:39:40.996501] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PMT took 1m 10s. Estimated remaining: 1h 24m 22s. Rate: 7.8 symbols/min [2025-09-30T20:39:41.064204] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-30T20:39:41.189106] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:41.230987] [DEBUG] [LOCAL ] POST: Loaded 38818 existing records from primary storage. [2025-09-30T20:39:41.231328] [INFO ] [MAIN ] POST: Loaded 38818 existing records. [2025-09-30T20:39:41.421109] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:39:41.421390] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-30T20:39:41.421439] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-30T20:39:41.422548] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-30T20:39:41.422612] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-30T20:39:41.803228] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:41.854314] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-30T20:39:41.985769] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:39:42.034596] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T20:39:42.654375] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-30T20:39:43.136619] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T20:39:43.454400] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-30T20:39:43.525494] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T20:39:44.254371] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-30T20:39:45.054342] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-30T20:39:45.166471] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T20:39:45.203917] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T20:39:45.854389] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-30T20:39:46.503842] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T20:39:46.524769] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:39:46.533426] [INFO ] [REMOTE ] PNR: Full fetch complete (68875 records). [2025-09-30T20:39:46.534349] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-30T20:39:46.535270] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:39:46.535365] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:39:46.535412] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:39:46.535454] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-30T20:39:46.535515] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-30T20:39:46.535552] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-30T20:39:46.535596] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-30T20:39:46.535696] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNR took 23.4s. Estimated remaining: 1h 24m 13s. Rate: 7.8 symbols/min [2025-09-30T20:39:46.659436] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-30T20:39:46.732887] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:46.791426] [DEBUG] [LOCAL ] PPG: Loaded 50704 existing records from primary storage. [2025-09-30T20:39:46.791795] [INFO ] [MAIN ] PPG: Loaded 50704 existing records. [2025-09-30T20:39:46.977040] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:39:46.977271] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-30T20:39:46.977320] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-30T20:39:46.978669] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-30T20:39:46.978731] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-30T20:39:47.396663] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:47.454366] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-30T20:39:47.891050] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T20:39:48.162753] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T20:39:48.254395] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-30T20:39:49.054369] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-30T20:39:49.854332] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-30T20:39:49.920450] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T20:39:50.258328] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T20:39:50.267844] [INFO ] [REMOTE ] PNW: Full fetch complete (65736 records). [2025-09-30T20:39:50.268031] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-30T20:39:50.268748] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:39:50.268841] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:39:50.268886] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:39:50.268929] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-30T20:39:50.268989] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-09-30T20:39:50.269025] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-09-30T20:39:50.269595] [DEBUG] [LOCAL ] PNW: Deleted derivative data file. [2025-09-30T20:39:50.269725] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 25.3s. Estimated remaining: 1h 24m 4s. Rate: 7.8 symbols/min [2025-09-30T20:39:50.471729] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:39:50.472000] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-30T20:39:50.472072] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-30T20:39:50.472229] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-30T20:39:50.472300] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-30T20:39:50.472385] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-30T20:39:50.472462] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-30T20:39:50.659076] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-30T20:39:50.929858] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:39:50.963689] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:39:51.454365] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-30T20:39:52.254336] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-30T20:39:52.306139] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T20:39:52.404404] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T20:39:53.054368] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-30T20:39:53.655464] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T20:39:53.854365] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-30T20:39:54.388329] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T20:39:54.654361] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-30T20:39:54.730135] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T20:39:55.454385] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-30T20:39:56.136375] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T20:39:56.254351] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-30T20:39:56.979772] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T20:39:57.054357] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-30T20:39:57.854357] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-30T20:39:57.887694] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T20:39:57.963964] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:39:58.654355] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-30T20:39:59.351798] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T20:39:59.454395] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-30T20:39:59.543714] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T20:40:00.105779] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T20:40:00.254369] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-30T20:40:01.054406] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-30T20:40:01.859537] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-30T20:40:01.882696] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T20:40:02.010240] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T20:40:02.445784] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T20:40:02.654376] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-30T20:40:03.347982] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T20:40:03.454407] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-30T20:40:04.254404] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-30T20:40:05.014409] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T20:40:05.054326] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-30T20:40:05.480223] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T20:40:05.854361] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-30T20:40:05.997358] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T20:40:06.654389] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-30T20:40:07.464990] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-30T20:40:07.473241] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T20:40:07.557172] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:40:08.254401] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-30T20:40:08.598788] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:40:09.054357] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-30T20:40:09.232870] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T20:40:09.854350] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-30T20:40:10.534924] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T20:40:10.579028] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:40:10.654383] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-30T20:40:11.454321] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-30T20:40:11.658041] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T20:40:12.254346] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-30T20:40:12.325229] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:40:12.335501] [INFO ] [REMOTE ] PPG: Full fetch complete (73387 records). [2025-09-30T20:40:12.335631] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-30T20:40:12.336333] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:40:12.336429] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:40:12.336472] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:40:12.336511] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-30T20:40:12.336568] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-09-30T20:40:12.336602] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-09-30T20:40:12.337123] [DEBUG] [LOCAL ] PPG: Deleted derivative data file. [2025-09-30T20:40:12.337217] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. PPG took 25.8s. Estimated remaining: 1h 24m 2s. Rate: 7.8 symbols/min [2025-09-30T20:40:12.515944] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:12.535741] [DEBUG] [LOCAL ] PPT: Loaded 19892 existing records from primary storage. [2025-09-30T20:40:12.536007] [INFO ] [MAIN ] PPT: Loaded 19892 existing records. [2025-09-30T20:40:12.724756] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:12.724989] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-30T20:40:12.725041] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-30T20:40:12.725594] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-30T20:40:12.725688] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-30T20:40:13.060428] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-30T20:40:13.102612] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:13.854377] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-30T20:40:13.951561] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T20:40:13.969905] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T20:40:13.981566] [INFO ] [REMOTE ] PPL: Full fetch complete (77027 records). [2025-09-30T20:40:13.981757] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-30T20:40:13.982509] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:40:13.982603] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:40:13.982672] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:40:13.982742] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-30T20:40:13.982803] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-30T20:40:13.982838] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-30T20:40:13.982877] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-30T20:40:13.982934] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPL took 23.7s. Estimated remaining: 1h 23m 52s. Rate: 7.8 symbols/min [2025-09-30T20:40:14.654385] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-30T20:40:15.399306] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T20:40:15.454386] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-30T20:40:16.254369] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-30T20:40:16.427523] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T20:40:16.439234] [INFO ] [REMOTE ] POR: Full fetch complete (68389 records). [2025-09-30T20:40:16.439394] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-30T20:40:16.573806] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:40:16.897844] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-30T20:40:16.897957] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-30T20:40:16.898990] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-30T20:40:16.899091] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-30T20:40:16.900661] [DEBUG] [LOCAL ] POR: Trimmed 68389 records to 47013 (keeping 200 days of data) [2025-09-30T20:40:17.091110] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-30T20:40:17.207416] [DEBUG] [LOCAL ] POR: Primary data saved (47013 records). [2025-09-30T20:40:17.207554] [INFO ] [MAIN ] POR: Full history saved. [2025-09-30T20:40:17.207639] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. POR took 52.0s. Estimated remaining: 1h 23m 42s. Rate: 7.8 symbols/min [2025-09-30T20:40:17.936790] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T20:40:17.946539] [INFO ] [REMOTE ] POST: Full fetch complete (55935 records). [2025-09-30T20:40:17.946697] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-30T20:40:18.097069] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:40:18.147040] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-30T20:40:18.392580] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-30T20:40:18.392733] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-30T20:40:18.393668] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-30T20:40:18.393732] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-30T20:40:18.395005] [DEBUG] [LOCAL ] POST: Trimmed 55935 records to 38818 (keeping 200 days of data) [2025-09-30T20:40:18.643383] [DEBUG] [LOCAL ] POST: Primary data saved (38818 records). [2025-09-30T20:40:18.643541] [INFO ] [MAIN ] POST: Full history saved. [2025-09-30T20:40:18.643632] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. POST took 37.6s. Estimated remaining: 1h 23m 32s. Rate: 7.8 symbols/min [2025-09-30T20:40:19.333796] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T20:40:19.339164] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-30T20:40:20.548175] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T20:40:20.553243] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-30T20:40:21.684856] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T20:40:21.691002] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-30T20:40:22.627991] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T20:40:22.633414] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-30T20:40:23.679428] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T20:40:23.685596] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-30T20:40:24.759882] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T20:40:24.764380] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-30T20:40:25.888332] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T20:40:25.893032] [INFO ] [REMOTE ] PPT: Full fetch complete (29291 records). [2025-09-30T20:40:25.893125] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-30T20:40:26.295118] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-30T20:40:26.295215] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-30T20:40:26.295854] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-30T20:40:26.295916] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-30T20:40:26.296666] [DEBUG] [LOCAL ] PPT: Trimmed 29291 records to 20144 (keeping 200 days of data) [2025-09-30T20:40:26.421513] [DEBUG] [LOCAL ] PPT: Primary data saved (20144 records). [2025-09-30T20:40:26.421722] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-30T20:40:26.421814] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPT took 14.1s. Estimated remaining: 1h 23m 25s. Rate: 7.8 symbols/min [2025-09-30T20:40:27.231092] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:27.237742] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-30T20:40:27.237628] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:27.238959] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:27.260106] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:27.256301] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-30T20:40:27.261464] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-30T20:40:27.261565] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-30T20:40:27.261669] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-30T20:40:27.261982] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-30T20:40:27.572150] [DEBUG] [LOCAL ] PRA: Loaded 34933 existing records from primary storage. [2025-09-30T20:40:27.594726] [DEBUG] [LOCAL ] PRG: Loaded 29834 existing records from primary storage. [2025-09-30T20:40:27.608091] [INFO ] [MAIN ] PRA: Loaded 34933 existing records. [2025-09-30T20:40:27.613972] [INFO ] [MAIN ] PRG: Loaded 29834 existing records. [2025-09-30T20:40:27.807449] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-30T20:40:27.868681] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-30T20:40:28.190149] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:28.284972] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-30T20:40:28.328540] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:28.362916] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:28.363130] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-30T20:40:28.363442] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-30T20:40:28.374439] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-30T20:40:28.379846] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-30T20:40:28.411354] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-30T20:40:28.410691] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-30T20:40:28.449039] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:28.449291] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-30T20:40:28.449403] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-30T20:40:28.427353] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-30T20:40:28.454823] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-30T20:40:28.495340] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-30T20:40:28.519753] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-30T20:40:29.071386] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T20:40:29.146955] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-30T20:40:29.655543] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:29.720889] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-30T20:40:29.714209] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:29.750837] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-30T20:40:29.757600] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:29.758323] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-30T20:40:29.871783] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T20:40:29.873056] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-30T20:40:30.505058] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T20:40:30.506385] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-30T20:40:30.959680] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T20:40:30.962129] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-30T20:40:30.985860] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T20:40:30.995407] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-30T20:40:31.254083] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T20:40:31.261165] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-30T20:40:31.607062] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T20:40:31.620326] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-30T20:40:31.627061] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T20:40:32.154588] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T20:40:32.254365] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-30T20:40:32.385576] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:40:33.054389] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-30T20:40:33.371570] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T20:40:33.566000] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T20:40:33.854350] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-30T20:40:34.604063] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T20:40:34.654367] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-30T20:40:35.454398] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-30T20:40:35.729869] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T20:40:36.067417] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:40:36.254370] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-30T20:40:36.890135] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T20:40:37.054382] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-30T20:40:37.240511] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T20:40:37.545334] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T20:40:37.854356] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-30T20:40:38.451695] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T20:40:38.654400] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-30T20:40:39.454364] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-30T20:40:40.254373] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-30T20:40:40.844996] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T20:40:41.054368] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-30T20:40:41.111712] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T20:40:41.262491] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-30T20:40:41.854414] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-30T20:40:42.176821] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T20:40:42.411399] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T20:40:42.412466] [INFO ] [REMOTE ] PRCS: Full fetch complete (3828 records). [2025-09-30T20:40:42.412539] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-30T20:40:42.613391] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T20:40:42.613617] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:40:42.613707] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:40:42.613824] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-30T20:40:42.613914] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-30T20:40:42.614007] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-30T20:40:42.614075] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-30T20:40:42.614168] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 16.2s. Estimated remaining: 1h 23m 20s. Rate: 7.8 symbols/min [2025-09-30T20:40:42.659507] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-30T20:40:42.792993] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:42.837664] [DEBUG] [LOCAL ] PRGO: Loaded 46914 existing records from primary storage. [2025-09-30T20:40:42.838023] [INFO ] [MAIN ] PRGO: Loaded 46914 existing records. [2025-09-30T20:40:43.020378] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:43.020606] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-30T20:40:43.020683] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-30T20:40:43.022028] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-30T20:40:43.022091] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-30T20:40:43.394619] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:43.454376] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-30T20:40:44.250555] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T20:40:44.257387] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-30T20:40:44.968504] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T20:40:45.054436] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-30T20:40:45.854359] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-30T20:40:46.240371] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T20:40:46.441514] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T20:40:46.654373] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-30T20:40:47.454394] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-30T20:40:47.750903] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T20:40:47.989252] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T20:40:48.254366] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-30T20:40:49.054370] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-30T20:40:49.293769] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T20:40:49.854377] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-30T20:40:49.905057] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T20:40:49.991608] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T20:40:50.654361] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-30T20:40:51.454363] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-30T20:40:51.678313] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T20:40:51.748278] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T20:40:52.254351] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-30T20:40:52.997747] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T20:40:53.054410] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-30T20:40:53.536465] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T20:40:53.544842] [INFO ] [REMOTE ] PRG: Full fetch complete (44203 records). [2025-09-30T20:40:53.545065] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-30T20:40:53.859629] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-30T20:40:53.970858] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-30T20:40:53.970949] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-30T20:40:53.971768] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-30T20:40:53.971845] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-30T20:40:53.972883] [DEBUG] [LOCAL ] PRG: Trimmed 44203 records to 29789 (keeping 200 days of data) [2025-09-30T20:40:54.170375] [DEBUG] [LOCAL ] PRG: Primary data saved (29789 records). [2025-09-30T20:40:54.170531] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-30T20:40:54.170708] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRG took 27.7s. Estimated remaining: 1h 23m 14s. Rate: 7.8 symbols/min [2025-09-30T20:40:54.356599] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:54.364215] [DEBUG] [LOCAL ] PRH: Loaded 4770 existing records from primary storage. [2025-09-30T20:40:54.364422] [INFO ] [MAIN ] PRH: Loaded 4770 existing records. [2025-09-30T20:40:54.577227] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:40:54.582549] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:54.589423] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-30T20:40:54.589601] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-30T20:40:54.590229] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-30T20:40:54.590290] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-30T20:40:54.659456] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-30T20:40:54.967232] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:55.454392] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-30T20:40:55.874995] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T20:40:55.904982] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T20:40:55.911395] [INFO ] [REMOTE ] PRA: Full fetch complete (43511 records). [2025-09-30T20:40:55.911517] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-30T20:40:56.259475] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-30T20:40:56.347139] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-30T20:40:56.347217] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-30T20:40:56.348097] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-30T20:40:56.348163] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-30T20:40:56.349297] [DEBUG] [LOCAL ] PRA: Trimmed 43511 records to 34973 (keeping 200 days of data) [2025-09-30T20:40:56.567590] [DEBUG] [LOCAL ] PRA: Primary data saved (34973 records). [2025-09-30T20:40:56.567775] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-30T20:40:56.567924] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRA took 30.1s. Estimated remaining: 1h 23m 4s. Rate: 7.8 symbols/min [2025-09-30T20:40:56.760830] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:40:56.786269] [DEBUG] [LOCAL ] PRI: Loaded 18275 existing records from primary storage. [2025-09-30T20:40:56.786574] [INFO ] [MAIN ] PRI: Loaded 18275 existing records. [2025-09-30T20:40:56.978475] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:40:56.978894] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-30T20:40:56.978967] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-30T20:40:56.979385] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-30T20:40:56.979445] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-30T20:40:57.064010] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-30T20:40:57.399496] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T20:40:57.405454] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:40:57.854330] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-30T20:40:57.962011] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T20:40:58.014383] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:40:58.654403] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-30T20:40:58.683018] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T20:40:59.303737] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:40:59.454415] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-30T20:41:00.254351] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-30T20:41:00.344525] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:41:01.054409] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-30T20:41:01.854470] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-30T20:41:02.115547] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:41:02.201491] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T20:41:02.213677] [INFO ] [REMOTE ] PR: Full fetch complete (77596 records). [2025-09-30T20:41:02.213856] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-30T20:41:02.661103] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-30T20:41:02.673460] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-30T20:41:02.678005] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-30T20:41:02.677838] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:41:02.683295] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-30T20:41:02.683538] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-30T20:41:02.685699] [DEBUG] [LOCAL ] PR: Trimmed 77596 records to 53610 (keeping 200 days of data) [2025-09-30T20:41:03.032096] [DEBUG] [LOCAL ] PR: Primary data saved (53610 records). [2025-09-30T20:41:03.032240] [INFO ] [MAIN ] PR: Full history saved. [2025-09-30T20:41:03.032372] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PR took 36.6s. Estimated remaining: 1h 22m 56s. Rate: 7.8 symbols/min [2025-09-30T20:41:03.212043] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:03.257378] [DEBUG] [LOCAL ] PRIM: Loaded 44317 existing records from primary storage. [2025-09-30T20:41:03.257736] [INFO ] [MAIN ] PRIM: Loaded 44317 existing records. [2025-09-30T20:41:03.447874] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:03.448112] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-30T20:41:03.448165] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-30T20:41:03.448672] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-30T20:41:03.448734] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-30T20:41:03.460476] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-30T20:41:03.845864] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:03.860226] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T20:41:04.226083] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T20:41:04.254447] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-30T20:41:05.054382] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-30T20:41:05.266109] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:41:05.854382] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-30T20:41:05.871880] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:41:06.654401] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-30T20:41:07.454334] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-30T20:41:07.656518] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:41:07.906301] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T20:41:08.213318] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T20:41:08.254367] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-30T20:41:09.054395] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-30T20:41:09.803141] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T20:41:09.854356] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-30T20:41:10.500698] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T20:41:10.654363] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-30T20:41:11.112529] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T20:41:11.454415] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-30T20:41:12.166058] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T20:41:12.254360] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-30T20:41:12.292205] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:41:13.054404] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-30T20:41:13.854422] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-30T20:41:13.933381] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T20:41:14.356970] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:41:14.522467] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T20:41:14.654377] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-30T20:41:15.206632] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T20:41:15.208627] [INFO ] [REMOTE ] PRH: Full fetch complete (7605 records). [2025-09-30T20:41:15.208857] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-30T20:41:15.464785] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-30T20:41:15.604852] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-30T20:41:15.605001] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-30T20:41:15.605262] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-30T20:41:15.605330] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-30T20:41:15.605859] [DEBUG] [LOCAL ] PRH: Trimmed 7605 records to 4774 (keeping 200 days of data) [2025-09-30T20:41:15.635833] [DEBUG] [LOCAL ] PRH: Primary data saved (4774 records). [2025-09-30T20:41:15.635941] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-30T20:41:15.636078] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRH took 21.5s. Estimated remaining: 1h 22m 50s. Rate: 7.8 symbols/min [2025-09-30T20:41:15.822446] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:15.873483] [DEBUG] [LOCAL ] PRKS: Loaded 42559 existing records from primary storage. [2025-09-30T20:41:15.873892] [INFO ] [MAIN ] PRKS: Loaded 42559 existing records. [2025-09-30T20:41:16.072948] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:16.073169] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-30T20:41:16.073219] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-30T20:41:16.073829] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-30T20:41:16.073911] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-30T20:41:16.259185] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-30T20:41:16.468725] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:17.054385] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-30T20:41:17.176320] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T20:41:17.464684] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T20:41:17.854390] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-30T20:41:18.654400] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-30T20:41:18.864785] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T20:41:18.981963] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:41:19.454409] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-30T20:41:20.256813] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-30T20:41:20.262294] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T20:41:20.688674] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T20:41:21.054358] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-30T20:41:21.377387] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T20:41:21.854389] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-30T20:41:22.654410] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-30T20:41:22.790549] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T20:41:22.825982] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T20:41:22.830587] [INFO ] [REMOTE ] PRI: Full fetch complete (25739 records). [2025-09-30T20:41:22.830773] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-30T20:41:23.292443] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-30T20:41:23.292556] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-30T20:41:23.293234] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-30T20:41:23.293303] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-30T20:41:23.294334] [DEBUG] [LOCAL ] PRI: Trimmed 25739 records to 18278 (keeping 200 days of data) [2025-09-30T20:41:23.454720] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-30T20:41:23.474002] [DEBUG] [LOCAL ] PRI: Primary data saved (18278 records). [2025-09-30T20:41:23.474227] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-30T20:41:23.474341] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 26.9s. Estimated remaining: 1h 22m 43s. Rate: 7.8 symbols/min [2025-09-30T20:41:23.772923] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:23.817471] [DEBUG] [LOCAL ] PRLB: Loaded 20527 existing records from primary storage. [2025-09-30T20:41:23.817832] [INFO ] [MAIN ] PRLB: Loaded 20527 existing records. [2025-09-30T20:41:24.171895] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:24.187917] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-30T20:41:24.188311] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-30T20:41:24.191048] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T20:41:24.202432] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-30T20:41:24.203592] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-30T20:41:24.259609] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-30T20:41:24.640707] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:24.733906] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T20:41:25.054409] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-30T20:41:25.854344] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-30T20:41:26.116509] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T20:41:26.155803] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T20:41:26.654406] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-30T20:41:27.394825] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:41:27.454417] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-30T20:41:27.948666] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T20:41:28.254342] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-30T20:41:28.579709] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T20:41:29.054440] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-30T20:41:29.854377] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-30T20:41:30.065700] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T20:41:30.077990] [INFO ] [REMOTE ] PRGO: Full fetch complete (68398 records). [2025-09-30T20:41:30.078167] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-30T20:41:30.527314] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-30T20:41:30.527393] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-30T20:41:30.528516] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-30T20:41:30.528606] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-30T20:41:30.530175] [DEBUG] [LOCAL ] PRGO: Trimmed 68398 records to 46912 (keeping 200 days of data) [2025-09-30T20:41:30.654442] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-30T20:41:30.898571] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T20:41:30.923610] [DEBUG] [LOCAL ] PRGO: Primary data saved (46912 records). [2025-09-30T20:41:30.923824] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-30T20:41:30.923971] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRGO took 48.3s. Estimated remaining: 1h 22m 35s. Rate: 7.8 symbols/min [2025-09-30T20:41:31.125318] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:31.195395] [DEBUG] [LOCAL ] PRM: Loaded 44611 existing records from primary storage. [2025-09-30T20:41:31.206817] [INFO ] [MAIN ] PRM: Loaded 44611 existing records. [2025-09-30T20:41:31.214544] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T20:41:31.438454] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:31.438815] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-30T20:41:31.438884] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-30T20:41:31.439586] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-30T20:41:31.439702] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-30T20:41:31.462793] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-30T20:41:31.848060] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:31.864029] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T20:41:32.254375] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-30T20:41:33.054355] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-30T20:41:33.302877] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T20:41:33.683322] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T20:41:33.854367] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-30T20:41:34.392936] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T20:41:34.654354] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-30T20:41:35.454376] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-30T20:41:35.610160] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T20:41:35.619948] [INFO ] [REMOTE ] PRIM: Full fetch complete (63386 records). [2025-09-30T20:41:35.620079] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-30T20:41:36.044091] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-30T20:41:36.044276] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-30T20:41:36.045344] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-30T20:41:36.045411] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-30T20:41:36.046812] [DEBUG] [LOCAL ] PRIM: Trimmed 63386 records to 44341 (keeping 200 days of data) [2025-09-30T20:41:36.202902] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T20:41:36.281468] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-30T20:41:36.385857] [DEBUG] [LOCAL ] PRIM: Primary data saved (44341 records). [2025-09-30T20:41:36.385998] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-30T20:41:36.386126] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 33.4s. Estimated remaining: 1h 22m 26s. Rate: 7.8 symbols/min [2025-09-30T20:41:36.573807] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:36.639017] [DEBUG] [LOCAL ] PRMB: Loaded 53145 existing records from primary storage. [2025-09-30T20:41:36.639393] [INFO ] [MAIN ] PRMB: Loaded 53145 existing records. [2025-09-30T20:41:36.846289] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:36.846568] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-30T20:41:36.846631] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-30T20:41:36.860458] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-30T20:41:36.862876] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-30T20:41:36.869525] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T20:41:37.062902] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-30T20:41:37.270286] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:37.622580] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T20:41:37.854357] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-30T20:41:38.268623] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T20:41:38.654366] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-30T20:41:39.454337] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-30T20:41:39.726875] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T20:41:40.067254] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T20:41:40.254380] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-30T20:41:41.054342] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-30T20:41:41.175388] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T20:41:41.854323] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-30T20:41:41.883897] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T20:41:42.234408] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:41:42.654380] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-30T20:41:43.225606] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T20:41:43.454353] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-30T20:41:43.739564] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T20:41:44.254364] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-30T20:41:44.677788] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T20:41:45.054343] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-30T20:41:45.219514] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T20:41:45.854397] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-30T20:41:46.654351] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-30T20:41:46.907289] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T20:41:47.425161] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T20:41:47.454316] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-30T20:41:48.030117] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T20:41:48.254403] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-30T20:41:48.990060] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:41:49.054345] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-30T20:41:49.297767] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T20:41:49.302204] [INFO ] [REMOTE ] PRLB: Full fetch complete (30730 records). [2025-09-30T20:41:49.302398] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-30T20:41:49.735801] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-30T20:41:49.735947] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-30T20:41:49.736751] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-30T20:41:49.736861] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-30T20:41:49.737915] [DEBUG] [LOCAL ] PRLB: Trimmed 30730 records to 20503 (keeping 200 days of data) [2025-09-30T20:41:49.854533] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-30T20:41:49.865834] [DEBUG] [LOCAL ] PRLB: Primary data saved (20503 records). [2025-09-30T20:41:49.865977] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-30T20:41:49.866099] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRLB took 26.4s. Estimated remaining: 1h 22m 21s. Rate: 7.8 symbols/min [2025-09-30T20:41:50.066363] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:50.116231] [DEBUG] [LOCAL ] PRO: Loaded 38051 existing records from primary storage. [2025-09-30T20:41:50.116562] [INFO ] [MAIN ] PRO: Loaded 38051 existing records. [2025-09-30T20:41:50.327992] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:50.329041] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-30T20:41:50.329104] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-30T20:41:50.330200] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-30T20:41:50.330288] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-30T20:41:50.657070] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-30T20:41:50.727123] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:50.808494] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T20:41:51.055020] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T20:41:51.454358] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-30T20:41:52.254366] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-30T20:41:52.454765] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T20:41:53.059484] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-30T20:41:53.073053] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T20:41:53.835803] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T20:41:53.845828] [INFO ] [REMOTE ] PRKS: Full fetch complete (61161 records). [2025-09-30T20:41:53.846002] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-30T20:41:53.860406] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-30T20:41:54.288228] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-30T20:41:54.288325] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-30T20:41:54.289371] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-30T20:41:54.289442] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-30T20:41:54.290871] [DEBUG] [LOCAL ] PRKS: Trimmed 61161 records to 42482 (keeping 200 days of data) [2025-09-30T20:41:54.562836] [DEBUG] [LOCAL ] PRKS: Primary data saved (42482 records). [2025-09-30T20:41:54.562990] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-30T20:41:54.563099] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRKS took 38.9s. Estimated remaining: 1h 22m 12s. Rate: 7.8 symbols/min [2025-09-30T20:41:54.654593] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-30T20:41:54.780996] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:54.781351] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-30T20:41:54.781478] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-30T20:41:54.781745] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-30T20:41:54.781799] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-30T20:41:54.781846] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-30T20:41:54.781880] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-30T20:41:55.216519] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:55.220116] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T20:41:55.334340] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T20:41:55.454411] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-30T20:41:55.702409] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:41:55.702763] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-30T20:41:55.702857] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:41:55.702905] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-30T20:41:55.702944] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:41:55.703012] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-30T20:41:55.703080] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-30T20:41:55.703117] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-30T20:41:55.703158] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-30T20:41:55.703207] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRSU took 1.1s. Estimated remaining: 1h 22m 2s. Rate: 7.8 symbols/min [2025-09-30T20:41:55.893447] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:55.904243] [DEBUG] [LOCAL ] PRT: Loaded 5310 existing records from primary storage. [2025-09-30T20:41:55.904499] [INFO ] [MAIN ] PRT: Loaded 5310 existing records. [2025-09-30T20:41:56.113884] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:56.114230] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-30T20:41:56.114487] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-30T20:41:56.123791] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-30T20:41:56.129720] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-30T20:41:56.187532] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T20:41:56.258816] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-30T20:41:56.262785] [INFO ] [REMOTE ] PRM: Full fetch complete (64433 records). [2025-09-30T20:41:56.262975] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-30T20:41:56.920462] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:57.020610] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-30T20:41:57.020737] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-30T20:41:57.021790] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-30T20:41:57.021860] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-30T20:41:57.023296] [DEBUG] [LOCAL ] PRM: Trimmed 64433 records to 44640 (keeping 200 days of data) [2025-09-30T20:41:57.073300] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-30T20:41:57.305054] [DEBUG] [LOCAL ] PRM: Primary data saved (44640 records). [2025-09-30T20:41:57.305223] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-30T20:41:57.305329] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRM took 26.4s. Estimated remaining: 1h 21m 52s. Rate: 7.8 symbols/min [2025-09-30T20:41:57.485868] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:41:57.551071] [DEBUG] [LOCAL ] PRU: Loaded 51419 existing records from primary storage. [2025-09-30T20:41:57.551467] [INFO ] [MAIN ] PRU: Loaded 51419 existing records. [2025-09-30T20:41:57.758449] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:41:57.758882] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-30T20:41:57.758947] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-30T20:41:57.760005] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-30T20:41:57.760068] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-30T20:41:57.857203] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-30T20:41:58.097488] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T20:41:58.171720] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:41:58.654337] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-30T20:41:58.743672] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T20:41:58.977913] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T20:41:59.454413] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-30T20:42:00.056812] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T20:42:00.207235] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T20:42:00.254412] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-30T20:42:01.054375] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-30T20:42:01.278408] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T20:42:01.854431] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-30T20:42:02.471597] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T20:42:02.654368] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-30T20:42:03.454605] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-30T20:42:03.535512] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T20:42:03.678371] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T20:42:04.254365] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-30T20:42:04.832575] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:42:05.054363] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-30T20:42:05.254766] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:42:05.854404] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-30T20:42:05.879931] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:42:06.654362] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-30T20:42:06.722706] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:42:07.335862] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T20:42:07.454398] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-30T20:42:08.094417] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T20:42:08.254374] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-30T20:42:08.922020] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T20:42:09.054365] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-30T20:42:09.736380] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T20:42:09.854398] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-30T20:42:10.654398] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-30T20:42:10.861951] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T20:42:11.454434] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-30T20:42:11.713545] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T20:42:12.254406] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-30T20:42:12.444531] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:42:12.924325] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T20:42:13.054357] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-30T20:42:13.823268] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T20:42:13.825356] [INFO ] [REMOTE ] PRT: Full fetch complete (9141 records). [2025-09-30T20:42:13.825430] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-30T20:42:13.859476] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-30T20:42:14.244930] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-30T20:42:14.245017] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-30T20:42:14.245263] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-30T20:42:14.245304] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-30T20:42:14.245816] [DEBUG] [LOCAL ] PRT: Trimmed 9141 records to 5302 (keeping 200 days of data) [2025-09-30T20:42:14.280550] [DEBUG] [LOCAL ] PRT: Primary data saved (5302 records). [2025-09-30T20:42:14.280729] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-30T20:42:14.280829] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 18.6s. Estimated remaining: 1h 21m 48s. Rate: 7.8 symbols/min [2025-09-30T20:42:14.522083] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:14.522291] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-30T20:42:14.522349] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-30T20:42:14.522461] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-30T20:42:14.522504] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-30T20:42:14.522546] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-30T20:42:14.522579] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-30T20:42:14.659440] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-30T20:42:14.930598] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:14.964298] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T20:42:15.454406] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-30T20:42:16.199587] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T20:42:16.228815] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T20:42:16.254389] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-30T20:42:17.054410] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-30T20:42:17.844517] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T20:42:17.855464] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-30T20:42:18.654328] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-30T20:42:18.754550] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:42:18.831193] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T20:42:19.454410] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-30T20:42:19.887133] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T20:42:19.955702] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T20:42:20.254401] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-30T20:42:20.857278] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T20:42:21.054400] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-30T20:42:21.854438] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-30T20:42:22.315184] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T20:42:22.324295] [INFO ] [REMOTE ] PRO: Full fetch complete (51851 records). [2025-09-30T20:42:22.324409] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-30T20:42:22.658964] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-30T20:42:22.760106] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-30T20:42:22.760239] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-30T20:42:22.761533] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-30T20:42:22.761636] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-30T20:42:22.763557] [DEBUG] [LOCAL ] PRO: Trimmed 51851 records to 38163 (keeping 200 days of data) [2025-09-30T20:42:22.798963] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T20:42:23.047608] [DEBUG] [LOCAL ] PRO: Primary data saved (38163 records). [2025-09-30T20:42:23.047794] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-30T20:42:23.047932] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRO took 33.2s. Estimated remaining: 1h 21m 40s. Rate: 7.8 symbols/min [2025-09-30T20:42:23.155967] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T20:42:23.234610] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:23.285554] [DEBUG] [LOCAL ] PSA: Loaded 41781 existing records from primary storage. [2025-09-30T20:42:23.285898] [INFO ] [MAIN ] PSA: Loaded 41781 existing records. [2025-09-30T20:42:23.459774] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-30T20:42:23.485329] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:23.485638] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-30T20:42:23.485727] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-30T20:42:23.486372] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-30T20:42:23.486461] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-30T20:42:23.909969] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:24.254358] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-30T20:42:24.667275] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-30T20:42:25.054416] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-30T20:42:25.506535] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T20:42:25.543490] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T20:42:25.854354] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-30T20:42:26.654392] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-30T20:42:27.429930] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T20:42:27.454371] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-30T20:42:27.626458] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T20:42:27.637429] [INFO ] [REMOTE ] PRU: Full fetch complete (73920 records). [2025-09-30T20:42:27.637599] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-30T20:42:27.638554] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:42:27.638700] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:42:27.638775] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:42:27.638859] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-30T20:42:27.638950] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-09-30T20:42:27.638995] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-09-30T20:42:27.639516] [DEBUG] [LOCAL ] PRU: Deleted derivative data file. [2025-09-30T20:42:27.639615] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRU took 30.3s. Estimated remaining: 1h 21m 32s. Rate: 7.8 symbols/min [2025-09-30T20:42:27.835771] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:27.846124] [DEBUG] [LOCAL ] PSBD: Loaded 7045 existing records from primary storage. [2025-09-30T20:42:27.846349] [INFO ] [MAIN ] PSBD: Loaded 7045 existing records. [2025-09-30T20:42:28.049102] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:28.049564] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-30T20:42:28.049626] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-30T20:42:28.049945] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-30T20:42:28.050013] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-30T20:42:28.263676] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-30T20:42:28.440762] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:29.054334] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-30T20:42:29.208291] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T20:42:29.253421] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T20:42:29.266894] [INFO ] [REMOTE ] PRMB: Full fetch complete (76067 records). [2025-09-30T20:42:29.267074] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-30T20:42:29.719164] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-30T20:42:29.719276] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-30T20:42:29.720354] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-30T20:42:29.720462] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-30T20:42:29.722031] [DEBUG] [LOCAL ] PRMB: Trimmed 76067 records to 53145 (keeping 200 days of data) [2025-09-30T20:42:29.838726] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T20:42:29.854367] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-30T20:42:30.077948] [DEBUG] [LOCAL ] PRMB: Primary data saved (53145 records). [2025-09-30T20:42:30.078101] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-30T20:42:30.078213] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRMB took 53.7s. Estimated remaining: 1h 21m 22s. Rate: 7.8 symbols/min [2025-09-30T20:42:30.265626] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:30.279917] [DEBUG] [LOCAL ] PSF: Loaded 6845 existing records from primary storage. [2025-09-30T20:42:30.280235] [INFO ] [MAIN ] PSF: Loaded 6845 existing records. [2025-09-30T20:42:30.392907] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-30T20:42:30.478334] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:30.478581] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-30T20:42:30.478631] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-30T20:42:30.479002] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-30T20:42:30.479064] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-30T20:42:30.680858] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-30T20:42:30.882992] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:31.454340] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-30T20:42:31.581419] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T20:42:31.838777] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-30T20:42:32.254386] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-30T20:42:33.054342] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-30T20:42:33.287058] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T20:42:33.854365] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-30T20:42:33.905112] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:42:34.508108] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:42:34.654370] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-30T20:42:35.464295] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-30T20:42:35.469886] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:42:36.254363] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-30T20:42:36.511604] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T20:42:36.912140] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T20:42:37.054357] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-30T20:42:37.761271] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T20:42:37.854360] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-30T20:42:38.639029] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T20:42:38.654360] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-30T20:42:39.454392] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-30T20:42:39.496378] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:42:40.254365] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-30T20:42:40.360872] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:42:41.054372] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-30T20:42:41.261631] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T20:42:41.492225] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T20:42:41.854361] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-30T20:42:42.547145] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T20:42:42.654429] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-30T20:42:43.167100] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-30T20:42:43.454379] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-30T20:42:44.190402] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:42:44.254354] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-30T20:42:44.963389] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T20:42:45.054377] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-30T20:42:45.721609] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T20:42:45.854369] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-30T20:42:46.609375] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T20:42:46.654331] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-30T20:42:46.980622] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-30T20:42:47.454399] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-30T20:42:48.254380] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-30T20:42:48.287491] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:42:48.290171] [INFO ] [REMOTE ] PSF: Full fetch complete (9911 records). [2025-09-30T20:42:48.290247] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-30T20:42:48.707332] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-30T20:42:48.707438] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-30T20:42:48.707765] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-30T20:42:48.707826] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-30T20:42:48.708312] [DEBUG] [LOCAL ] PSF: Trimmed 9911 records to 6917 (keeping 200 days of data) [2025-09-30T20:42:48.751506] [DEBUG] [LOCAL ] PSF: Primary data saved (6917 records). [2025-09-30T20:42:48.751672] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-30T20:42:48.751777] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSF took 18.7s. Estimated remaining: 1h 21m 18s. Rate: 7.8 symbols/min [2025-09-30T20:42:48.953813] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:48.988271] [DEBUG] [LOCAL ] PSFE: Loaded 30137 existing records from primary storage. [2025-09-30T20:42:48.988696] [INFO ] [MAIN ] PSFE: Loaded 30137 existing records. [2025-09-30T20:42:49.058977] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-30T20:42:49.203927] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:42:49.218477] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:49.227924] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-30T20:42:49.228164] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-30T20:42:49.229096] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-30T20:42:49.229162] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-30T20:42:49.554910] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T20:42:49.637630] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:49.854386] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-30T20:42:50.241313] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T20:42:50.654367] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-30T20:42:51.030372] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-30T20:42:51.031267] [INFO ] [REMOTE ] PRVS: Full fetch complete (1275 records). [2025-09-30T20:42:51.031341] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-30T20:42:51.031741] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:42:51.031850] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:42:51.031984] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:42:51.032097] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-30T20:42:51.032197] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-30T20:42:51.032255] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-30T20:42:51.032316] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-30T20:42:51.032394] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PRVS took 36.8s. Estimated remaining: 1h 21m 9s. Rate: 7.8 symbols/min [2025-09-30T20:42:51.215390] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:51.266014] [DEBUG] [LOCAL ] PSN: Loaded 46058 existing records from primary storage. [2025-09-30T20:42:51.266404] [INFO ] [MAIN ] PSN: Loaded 46058 existing records. [2025-09-30T20:42:51.459839] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:51.456161] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-30T20:42:51.461118] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-30T20:42:51.461184] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-30T20:42:51.462090] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-30T20:42:51.462154] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-30T20:42:51.859667] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:52.254364] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-30T20:42:52.351016] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:42:52.360611] [INFO ] [REMOTE ] PSA: Full fetch complete (59007 records). [2025-09-30T20:42:52.360850] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-30T20:42:52.361710] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:42:52.361800] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:42:52.361848] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:42:52.361918] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-30T20:42:52.362028] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-09-30T20:42:52.362090] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-09-30T20:42:52.362523] [DEBUG] [LOCAL ] PSA: Deleted derivative data file. [2025-09-30T20:42:52.362636] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 29.3s. Estimated remaining: 1h 20m 59s. Rate: 7.8 symbols/min [2025-09-30T20:42:52.561267] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:42:52.603175] [DEBUG] [LOCAL ] PSO: Loaded 37066 existing records from primary storage. [2025-09-30T20:42:52.603543] [INFO ] [MAIN ] PSO: Loaded 37066 existing records. [2025-09-30T20:42:52.805613] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:42:52.805898] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-30T20:42:52.805957] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-30T20:42:52.806936] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-30T20:42:52.806998] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-30T20:42:53.062775] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-30T20:42:53.187715] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:42:53.671688] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T20:42:53.854380] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-30T20:42:54.494506] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:42:54.521754] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T20:42:54.654360] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-30T20:42:55.454385] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-30T20:42:55.874127] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T20:42:56.254388] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-30T20:42:56.833190] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T20:42:57.054375] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-30T20:42:57.849206] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:42:57.855163] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-30T20:42:58.042991] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T20:42:58.629311] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T20:42:58.654324] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-30T20:42:59.454374] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-30T20:42:59.487141] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T20:43:00.254416] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-30T20:43:01.054413] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-30T20:43:01.139025] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T20:43:01.180796] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T20:43:01.854422] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-30T20:43:02.538551] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:43:02.654416] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-30T20:43:03.291724] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T20:43:03.457546] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-30T20:43:03.459952] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T20:43:03.463674] [INFO ] [REMOTE ] PSBD: Full fetch complete (9413 records). [2025-09-30T20:43:03.463795] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-30T20:43:03.909495] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-30T20:43:03.909597] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-30T20:43:03.909921] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-30T20:43:03.910020] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-30T20:43:03.910594] [DEBUG] [LOCAL ] PSBD: Trimmed 9413 records to 7055 (keeping 200 days of data) [2025-09-30T20:43:03.967928] [DEBUG] [LOCAL ] PSBD: Primary data saved (7055 records). [2025-09-30T20:43:03.968113] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-30T20:43:03.968286] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSBD took 36.3s. Estimated remaining: 1h 20m 52s. Rate: 7.8 symbols/min [2025-09-30T20:43:04.173699] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:04.210752] [DEBUG] [LOCAL ] PSQH: Loaded 34827 existing records from primary storage. [2025-09-30T20:43:04.211120] [INFO ] [MAIN ] PSQH: Loaded 34827 existing records. [2025-09-30T20:43:04.259606] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-30T20:43:04.443713] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:04.444218] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-30T20:43:04.444293] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-30T20:43:04.445157] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-30T20:43:04.445220] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-30T20:43:04.850909] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:04.917772] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T20:43:05.054356] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-30T20:43:05.723728] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:43:05.854411] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-30T20:43:06.229329] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:43:06.654386] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-30T20:43:07.454383] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-30T20:43:07.824593] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T20:43:07.939437] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T20:43:08.254376] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-30T20:43:08.507607] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T20:43:09.054403] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-30T20:43:09.652869] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T20:43:09.854350] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-30T20:43:10.654364] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-30T20:43:10.827953] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T20:43:11.454438] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-30T20:43:11.567303] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T20:43:11.773325] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T20:43:12.254378] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-30T20:43:12.707681] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:43:13.054349] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-30T20:43:13.788386] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T20:43:13.854400] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-30T20:43:14.654393] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-30T20:43:14.692358] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T20:43:15.449530] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T20:43:15.458598] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-30T20:43:16.079017] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T20:43:16.254380] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-30T20:43:17.054440] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-30T20:43:17.155038] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T20:43:17.464798] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T20:43:17.476284] [INFO ] [REMOTE ] PSFE: Full fetch complete (43013 records). [2025-09-30T20:43:17.476544] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-30T20:43:17.859482] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-30T20:43:17.933851] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-30T20:43:17.933940] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-30T20:43:17.934763] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-30T20:43:17.934827] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-30T20:43:17.935991] [DEBUG] [LOCAL ] PSFE: Trimmed 43013 records to 30067 (keeping 200 days of data) [2025-09-30T20:43:18.124891] [DEBUG] [LOCAL ] PSFE: Primary data saved (30067 records). [2025-09-30T20:43:18.125030] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-30T20:43:18.125195] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSFE took 29.4s. Estimated remaining: 1h 20m 47s. Rate: 7.8 symbols/min [2025-09-30T20:43:18.310411] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:18.362504] [DEBUG] [LOCAL ] PSTG: Loaded 52845 existing records from primary storage. [2025-09-30T20:43:18.362882] [INFO ] [MAIN ] PSTG: Loaded 52845 existing records. [2025-09-30T20:43:18.560538] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:18.561122] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-30T20:43:18.561296] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-30T20:43:18.612074] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-30T20:43:18.625769] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-30T20:43:18.660196] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-30T20:43:18.632492] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T20:43:19.019087] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:19.454340] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-30T20:43:19.507323] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T20:43:20.159727] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T20:43:20.254371] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-30T20:43:21.054391] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-30T20:43:21.096583] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T20:43:21.659184] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T20:43:21.854365] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-30T20:43:22.654367] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-30T20:43:23.119737] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T20:43:23.175475] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T20:43:23.454361] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-30T20:43:24.254391] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-30T20:43:24.380973] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T20:43:24.518350] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:43:25.054341] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-30T20:43:25.846751] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T20:43:25.860030] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-30T20:43:26.654406] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-30T20:43:26.740729] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T20:43:27.307002] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T20:43:27.314782] [INFO ] [REMOTE ] PSO: Full fetch complete (51864 records). [2025-09-30T20:43:27.314916] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-30T20:43:27.466728] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-30T20:43:27.758722] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-30T20:43:27.758809] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-30T20:43:27.759746] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-30T20:43:27.759810] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-30T20:43:27.760952] [DEBUG] [LOCAL ] PSO: Trimmed 51864 records to 37006 (keeping 200 days of data) [2025-09-30T20:43:28.015927] [DEBUG] [LOCAL ] PSO: Primary data saved (37006 records). [2025-09-30T20:43:28.016173] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-30T20:43:28.016296] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSO took 35.7s. Estimated remaining: 1h 20m 40s. Rate: 7.8 symbols/min [2025-09-30T20:43:28.198930] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:28.218758] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T20:43:28.241789] [DEBUG] [LOCAL ] PSTL: Loaded 20077 existing records from primary storage. [2025-09-30T20:43:28.242071] [INFO ] [MAIN ] PSTL: Loaded 20077 existing records. [2025-09-30T20:43:28.264154] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-30T20:43:28.437882] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:28.438114] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-30T20:43:28.438175] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-30T20:43:28.438833] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-30T20:43:28.438893] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-30T20:43:28.827135] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:29.054346] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-30T20:43:29.341066] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T20:43:29.854389] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-30T20:43:29.893709] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T20:43:29.905183] [INFO ] [REMOTE ] PSN: Full fetch complete (66916 records). [2025-09-30T20:43:29.905356] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-30T20:43:30.263185] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T20:43:30.364625] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-30T20:43:30.364756] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-30T20:43:30.365880] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-30T20:43:30.365950] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-30T20:43:30.367420] [DEBUG] [LOCAL ] PSN: Trimmed 66916 records to 46029 (keeping 200 days of data) [2025-09-30T20:43:30.651902] [DEBUG] [LOCAL ] PSN: Primary data saved (46029 records). [2025-09-30T20:43:30.652043] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-30T20:43:30.652162] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSN took 39.6s. Estimated remaining: 1h 20m 31s. Rate: 7.8 symbols/min [2025-09-30T20:43:30.664609] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-30T20:43:30.836485] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:30.898484] [DEBUG] [LOCAL ] PSX: Loaded 53131 existing records from primary storage. [2025-09-30T20:43:30.898834] [INFO ] [MAIN ] PSX: Loaded 53131 existing records. [2025-09-30T20:43:31.089884] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:31.090140] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-30T20:43:31.090192] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-30T20:43:31.090828] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-30T20:43:31.090893] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-30T20:43:31.419674] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T20:43:31.459431] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-30T20:43:31.523075] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:32.254341] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-30T20:43:32.592147] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T20:43:32.632702] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T20:43:33.054383] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-30T20:43:33.854374] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-30T20:43:34.043273] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:43:34.052736] [INFO ] [REMOTE ] PSQH: Full fetch complete (53698 records). [2025-09-30T20:43:34.052870] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-30T20:43:34.228725] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T20:43:34.532002] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-30T20:43:34.532093] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-30T20:43:34.533005] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-30T20:43:34.533137] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-30T20:43:34.535843] [DEBUG] [LOCAL ] PSQH: Trimmed 53698 records to 34894 (keeping 200 days of data) [2025-09-30T20:43:34.654902] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-30T20:43:34.758438] [DEBUG] [LOCAL ] PSQH: Primary data saved (34894 records). [2025-09-30T20:43:34.758593] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-30T20:43:34.758720] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSQH took 30.8s. Estimated remaining: 1h 20m 22s. Rate: 7.8 symbols/min [2025-09-30T20:43:34.951686] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:34.973219] [DEBUG] [LOCAL ] PTA: Loaded 14948 existing records from primary storage. [2025-09-30T20:43:34.973467] [INFO ] [MAIN ] PTA: Loaded 14948 existing records. [2025-09-30T20:43:35.162471] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:35.162736] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-30T20:43:35.162796] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-30T20:43:35.163094] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-30T20:43:35.163154] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-30T20:43:35.456940] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-30T20:43:35.613365] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:35.649014] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T20:43:35.769161] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T20:43:36.254358] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-30T20:43:36.727306] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T20:43:37.054386] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-30T20:43:37.694568] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T20:43:37.854356] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-30T20:43:37.914693] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T20:43:38.654377] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-30T20:43:39.461554] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-30T20:43:39.486061] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T20:43:39.531425] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T20:43:40.254371] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-30T20:43:40.612107] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:43:41.054369] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-30T20:43:41.854413] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-30T20:43:42.145846] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T20:43:42.223723] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T20:43:42.654393] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-30T20:43:42.850999] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T20:43:43.454338] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-30T20:43:43.832456] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:43:44.256281] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-30T20:43:44.258885] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T20:43:45.054358] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-30T20:43:45.854371] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-30T20:43:46.231428] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T20:43:46.255256] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T20:43:46.654362] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-30T20:43:46.762109] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:43:47.454399] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-30T20:43:48.254421] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-30T20:43:48.289385] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:43:48.411965] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T20:43:49.054340] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-30T20:43:49.373423] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T20:43:49.854347] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-30T20:43:50.010740] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T20:43:50.654377] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-30T20:43:50.916139] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T20:43:51.454376] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-30T20:43:51.538487] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T20:43:52.108888] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T20:43:52.254346] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-30T20:43:53.054394] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-30T20:43:53.854371] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-30T20:43:53.894877] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T20:43:54.244121] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T20:43:54.256520] [INFO ] [REMOTE ] PSTG: Full fetch complete (76541 records). [2025-09-30T20:43:54.256762] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-30T20:43:54.659783] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-30T20:43:54.716275] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-30T20:43:54.719839] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-30T20:43:54.721089] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-30T20:43:54.721718] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T20:43:54.721977] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-30T20:43:54.727249] [DEBUG] [LOCAL ] PSTG: Trimmed 76541 records to 52841 (keeping 200 days of data) [2025-09-30T20:43:55.084709] [DEBUG] [LOCAL ] PSTG: Primary data saved (52841 records). [2025-09-30T20:43:55.084888] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-30T20:43:55.085016] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTG took 37.0s. Estimated remaining: 1h 20m 18s. Rate: 7.8 symbols/min [2025-09-30T20:43:55.268662] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:55.310240] [DEBUG] [LOCAL ] PTY: Loaded 37300 existing records from primary storage. [2025-09-30T20:43:55.310539] [INFO ] [MAIN ] PTY: Loaded 37300 existing records. [2025-09-30T20:43:55.463876] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-30T20:43:55.508994] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:55.509396] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-30T20:43:55.509475] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-30T20:43:55.510585] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-30T20:43:55.510681] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-30T20:43:55.888400] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:55.923799] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T20:43:56.254325] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-30T20:43:56.411297] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T20:43:57.054356] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-30T20:43:57.854366] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-30T20:43:58.033973] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T20:43:58.158140] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T20:43:58.163169] [INFO ] [REMOTE ] PSTL: Full fetch complete (29630 records). [2025-09-30T20:43:58.163281] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-30T20:43:58.592156] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-30T20:43:58.592364] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-30T20:43:58.593477] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-30T20:43:58.593737] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-30T20:43:58.594871] [DEBUG] [LOCAL ] PSTL: Trimmed 29630 records to 20068 (keeping 200 days of data) [2025-09-30T20:43:58.657471] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-30T20:43:58.725051] [DEBUG] [LOCAL ] PSTL: Primary data saved (20068 records). [2025-09-30T20:43:58.725494] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-30T20:43:58.725747] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTL took 30.7s. Estimated remaining: 1h 20m 9s. Rate: 7.8 symbols/min [2025-09-30T20:43:58.927175] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:43:58.961682] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T20:43:59.014703] [DEBUG] [LOCAL ] PUK: Loaded 44780 existing records from primary storage. [2025-09-30T20:43:59.015012] [INFO ] [MAIN ] PUK: Loaded 44780 existing records. [2025-09-30T20:43:59.201353] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:43:59.201556] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-30T20:43:59.201605] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-30T20:43:59.202595] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-30T20:43:59.202690] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-30T20:43:59.460177] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-30T20:43:59.611931] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:43:59.747326] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T20:44:00.051024] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T20:44:00.062244] [INFO ] [REMOTE ] PSX: Full fetch complete (76671 records). [2025-09-30T20:44:00.062377] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-30T20:44:00.066772] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:44:00.066888] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:44:00.066933] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:44:00.066976] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-30T20:44:00.067034] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-09-30T20:44:00.067071] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-09-30T20:44:00.067622] [DEBUG] [LOCAL ] PSX: Deleted derivative data file. [2025-09-30T20:44:00.067780] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 29.4s. Estimated remaining: 1h 19m 59s. Rate: 7.8 symbols/min [2025-09-30T20:44:00.248923] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:00.254415] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-30T20:44:00.300410] [DEBUG] [LOCAL ] PUMP: Loaded 49364 existing records from primary storage. [2025-09-30T20:44:00.300789] [INFO ] [MAIN ] PUMP: Loaded 49364 existing records. [2025-09-30T20:44:00.493067] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:00.493311] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-30T20:44:00.493362] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-30T20:44:00.494499] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-30T20:44:00.494565] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-30T20:44:01.011614] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:01.054346] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-30T20:44:01.854361] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-30T20:44:02.116952] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T20:44:02.654331] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-30T20:44:02.769794] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:44:02.773841] [INFO ] [REMOTE ] PTA: Full fetch complete (23366 records). [2025-09-30T20:44:02.773937] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-30T20:44:03.092350] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T20:44:03.224731] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-30T20:44:03.224824] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-30T20:44:03.225331] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-30T20:44:03.225393] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-30T20:44:03.226196] [DEBUG] [LOCAL ] PTA: Trimmed 23366 records to 14822 (keeping 200 days of data) [2025-09-30T20:44:03.321266] [DEBUG] [LOCAL ] PTA: Primary data saved (14822 records). [2025-09-30T20:44:03.321413] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-30T20:44:03.321499] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTA took 28.6s. Estimated remaining: 1h 19m 50s. Rate: 7.8 symbols/min [2025-09-30T20:44:03.468748] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-30T20:44:03.504422] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:03.565360] [DEBUG] [LOCAL ] PVH: Loaded 50416 existing records from primary storage. [2025-09-30T20:44:03.565753] [INFO ] [MAIN ] PVH: Loaded 50416 existing records. [2025-09-30T20:44:03.800625] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:03.800852] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-30T20:44:03.800897] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-30T20:44:03.801956] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-30T20:44:03.802017] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-30T20:44:04.195896] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:04.222569] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:44:04.254330] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-30T20:44:05.051564] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T20:44:05.061124] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-30T20:44:05.859469] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-30T20:44:05.871102] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T20:44:06.654341] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-30T20:44:06.777378] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T20:44:07.085070] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T20:44:07.454431] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-30T20:44:08.077957] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T20:44:08.254376] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-30T20:44:09.054444] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-30T20:44:09.266894] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T20:44:09.818078] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T20:44:09.854358] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-30T20:44:10.478869] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T20:44:10.654367] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-30T20:44:11.454424] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-30T20:44:11.496409] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T20:44:12.254386] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-30T20:44:12.391275] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T20:44:13.054377] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-30T20:44:13.288668] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T20:44:13.660043] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T20:44:13.854379] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-30T20:44:14.462131] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:44:14.654393] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-30T20:44:15.452434] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T20:44:15.459866] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-30T20:44:16.003687] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T20:44:16.254422] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-30T20:44:17.054338] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-30T20:44:17.399249] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T20:44:17.854332] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-30T20:44:18.049784] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T20:44:18.654338] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-30T20:44:18.812780] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T20:44:19.454321] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-30T20:44:19.985823] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T20:44:20.027523] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:44:20.254365] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-30T20:44:20.944608] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T20:44:21.054419] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-30T20:44:21.854494] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-30T20:44:22.075082] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T20:44:22.240558] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T20:44:22.654384] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-30T20:44:23.409381] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T20:44:23.454414] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-30T20:44:23.817473] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T20:44:24.254410] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-30T20:44:25.054331] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-30T20:44:25.388222] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-30T20:44:25.854358] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-30T20:44:25.926858] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T20:44:26.341451] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T20:44:26.654385] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-30T20:44:27.419900] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T20:44:27.454399] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-30T20:44:28.022448] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T20:44:28.031338] [INFO ] [REMOTE ] PTY: Full fetch complete (53844 records). [2025-09-30T20:44:28.031556] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-30T20:44:28.260216] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-30T20:44:28.477692] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-30T20:44:28.477797] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-30T20:44:28.478929] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-30T20:44:28.479007] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-30T20:44:28.480293] [DEBUG] [LOCAL ] PTY: Trimmed 53844 records to 37302 (keeping 200 days of data) [2025-09-30T20:44:28.730217] [DEBUG] [LOCAL ] PTY: Primary data saved (37302 records). [2025-09-30T20:44:28.730372] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-30T20:44:28.730517] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PTY took 33.6s. Estimated remaining: 1h 19m 49s. Rate: 7.8 symbols/min [2025-09-30T20:44:28.922843] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:28.930013] [DEBUG] [LOCAL ] PVL: Loaded 4750 existing records from primary storage. [2025-09-30T20:44:28.930226] [INFO ] [MAIN ] PVL: Loaded 4750 existing records. [2025-09-30T20:44:29.059459] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-30T20:44:29.138363] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:29.138787] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-30T20:44:29.138857] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-30T20:44:29.139260] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-30T20:44:29.139451] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-30T20:44:29.307086] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T20:44:29.355380] [INFO ] [REMOTE ] PUK: Full fetch complete (65199 records). [2025-09-30T20:44:29.383761] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-30T20:44:29.836812] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:29.864636] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-30T20:44:30.109771] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-30T20:44:30.109897] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-30T20:44:30.110997] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-30T20:44:30.111168] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-30T20:44:30.123849] [DEBUG] [LOCAL ] PUK: Trimmed 65199 records to 44765 (keeping 200 days of data) [2025-09-30T20:44:30.147751] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T20:44:30.452587] [DEBUG] [LOCAL ] PUK: Primary data saved (44765 records). [2025-09-30T20:44:30.452763] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-30T20:44:30.452860] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUK took 31.7s. Estimated remaining: 1h 19m 39s. Rate: 7.8 symbols/min [2025-09-30T20:44:30.657118] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:30.655286] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-30T20:44:30.710166] [DEBUG] [LOCAL ] PWR: Loaded 47204 existing records from primary storage. [2025-09-30T20:44:30.710554] [INFO ] [MAIN ] PWR: Loaded 47204 existing records. [2025-09-30T20:44:30.922491] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T20:44:30.922164] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:30.925953] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-30T20:44:30.926144] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-30T20:44:30.927329] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-30T20:44:30.927396] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-30T20:44:31.163923] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T20:44:31.367211] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:31.454364] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-30T20:44:32.255183] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-30T20:44:32.255107] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:44:32.267338] [INFO ] [REMOTE ] PVH: Full fetch complete (70729 records). [2025-09-30T20:44:32.267476] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-30T20:44:32.713822] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-30T20:44:32.713956] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-30T20:44:32.715158] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-30T20:44:32.715230] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-30T20:44:32.716938] [DEBUG] [LOCAL ] PVH: Trimmed 70729 records to 50414 (keeping 200 days of data) [2025-09-30T20:44:33.054781] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-30T20:44:33.056516] [DEBUG] [LOCAL ] PVH: Primary data saved (50414 records). [2025-09-30T20:44:33.058000] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-30T20:44:33.058218] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVH took 29.7s. Estimated remaining: 1h 19m 29s. Rate: 7.8 symbols/min [2025-09-30T20:44:33.182846] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T20:44:33.300137] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T20:44:33.328740] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:33.385751] [DEBUG] [LOCAL ] PX: Loaded 34549 existing records from primary storage. [2025-09-30T20:44:33.386086] [INFO ] [MAIN ] PX: Loaded 34549 existing records. [2025-09-30T20:44:33.593073] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:33.593325] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-30T20:44:33.593388] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-30T20:44:33.594110] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-30T20:44:33.594173] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-30T20:44:33.859548] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-30T20:44:34.028593] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:34.060428] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T20:44:34.654378] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-30T20:44:35.454362] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-30T20:44:35.642832] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T20:44:35.655151] [INFO ] [REMOTE ] PUMP: Full fetch complete (71839 records). [2025-09-30T20:44:35.655343] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-30T20:44:36.119859] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-30T20:44:36.119958] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-30T20:44:36.121141] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-30T20:44:36.121211] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-30T20:44:36.123837] [DEBUG] [LOCAL ] PUMP: Trimmed 71839 records to 49391 (keeping 200 days of data) [2025-09-30T20:44:36.304060] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-30T20:44:36.452255] [DEBUG] [LOCAL ] PUMP: Primary data saved (49391 records). [2025-09-30T20:44:36.452855] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-30T20:44:36.452980] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PUMP took 36.4s. Estimated remaining: 1h 19m 20s. Rate: 7.8 symbols/min [2025-09-30T20:44:36.640606] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:36.640862] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-30T20:44:36.640935] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-30T20:44:36.641242] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-30T20:44:36.641289] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-30T20:44:36.651674] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-30T20:44:36.656894] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-30T20:44:36.754754] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T20:44:37.062847] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-30T20:44:37.099717] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:37.176836] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T20:44:37.854536] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-30T20:44:38.066195] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T20:44:38.615031] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T20:44:38.654333] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-30T20:44:39.269463] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T20:44:39.460167] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-30T20:44:39.463086] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (4.81 seconds). [2025-09-30T20:44:40.123056] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T20:44:40.254351] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-30T20:44:40.837595] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T20:44:41.054387] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-30T20:44:41.854387] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-30T20:44:42.449102] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T20:44:42.579607] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T20:44:42.654404] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-30T20:44:43.454355] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-30T20:44:43.529976] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T20:44:44.254378] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-30T20:44:45.054398] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-30T20:44:45.594606] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-30T20:44:45.846240] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:44:45.854371] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-30T20:44:46.219194] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-30T20:44:46.654329] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-30T20:44:47.318282] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:44:47.454381] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-30T20:44:48.254387] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-30T20:44:48.358333] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:44:49.054408] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-30T20:44:49.296252] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-30T20:44:49.502932] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T20:44:49.779019] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T20:44:49.854411] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-30T20:44:50.288184] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T20:44:50.654403] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-30T20:44:51.220357] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T20:44:51.222039] [INFO ] [REMOTE ] PVL: Full fetch complete (7544 records). [2025-09-30T20:44:51.222115] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-30T20:44:51.459616] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-30T20:44:51.633932] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-30T20:44:51.634035] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-30T20:44:51.634255] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-30T20:44:51.634297] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-30T20:44:51.634827] [DEBUG] [LOCAL ] PVL: Trimmed 7544 records to 4765 (keeping 200 days of data) [2025-09-30T20:44:51.664492] [DEBUG] [LOCAL ] PVL: Primary data saved (4765 records). [2025-09-30T20:44:51.664621] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-30T20:44:51.664741] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PVL took 22.9s. Estimated remaining: 1h 19m 15s. Rate: 7.8 symbols/min [2025-09-30T20:44:51.850794] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:44:51.884707] [DEBUG] [LOCAL ] QD: Loaded 28038 existing records from primary storage. [2025-09-30T20:44:51.885038] [INFO ] [MAIN ] QD: Loaded 28038 existing records. [2025-09-30T20:44:52.081416] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:44:52.081681] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-30T20:44:52.081742] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-30T20:44:52.082270] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-30T20:44:52.082331] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-30T20:44:52.261202] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-30T20:44:52.497096] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:44:53.012072] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T20:44:53.054324] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-30T20:44:53.262406] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T20:44:53.854386] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-30T20:44:54.384595] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T20:44:54.654403] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-30T20:44:55.397682] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:44:55.447200] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T20:44:55.454346] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-30T20:44:56.254364] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-30T20:44:56.927327] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T20:44:57.054365] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-30T20:44:57.854391] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-30T20:44:58.526160] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T20:44:58.654386] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-30T20:44:58.972550] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-30T20:44:59.178135] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T20:44:59.454338] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-30T20:44:59.515950] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T20:45:00.254350] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-30T20:45:00.459856] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T20:45:01.054373] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-30T20:45:01.854361] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-30T20:45:02.329990] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T20:45:02.654365] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-30T20:45:03.084206] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-30T20:45:03.454393] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-30T20:45:03.531255] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T20:45:03.541201] [INFO ] [REMOTE ] PWR: Full fetch complete (68708 records). [2025-09-30T20:45:03.541378] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-30T20:45:03.542239] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:45:03.542359] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:45:03.542434] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:45:03.542532] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-30T20:45:03.542632] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-09-30T20:45:03.542719] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-09-30T20:45:03.543227] [DEBUG] [LOCAL ] PWR: Deleted derivative data file. [2025-09-30T20:45:03.543343] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PWR took 33.1s. Estimated remaining: 1h 19m 9s. Rate: 7.8 symbols/min [2025-09-30T20:45:03.745400] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:03.767483] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T20:45:03.826997] [DEBUG] [LOCAL ] QGEN: Loaded 49070 existing records from primary storage. [2025-09-30T20:45:03.827362] [INFO ] [MAIN ] QGEN: Loaded 49070 existing records. [2025-09-30T20:45:04.010190] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:04.010404] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-30T20:45:04.010451] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-30T20:45:04.010937] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-30T20:45:04.010997] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-30T20:45:04.261494] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-30T20:45:04.402418] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:05.054413] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-30T20:45:05.689198] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T20:45:05.696131] [INFO ] [REMOTE ] PX: Full fetch complete (50943 records). [2025-09-30T20:45:05.696285] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-30T20:45:05.864474] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-30T20:45:06.130596] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-30T20:45:06.130836] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-30T20:45:06.132000] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-30T20:45:06.132072] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-30T20:45:06.133351] [DEBUG] [LOCAL ] PX: Trimmed 50943 records to 34583 (keeping 200 days of data) [2025-09-30T20:45:06.428419] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-30T20:45:06.458307] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:45:06.480872] [DEBUG] [LOCAL ] PX: Primary data saved (34583 records). [2025-09-30T20:45:06.481016] [INFO ] [MAIN ] PX: Full history saved. [2025-09-30T20:45:06.481097] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. PX took 33.4s. Estimated remaining: 1h 18m 59s. Rate: 7.8 symbols/min [2025-09-30T20:45:06.678236] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:06.656813] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-30T20:45:06.743573] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-30T20:45:06.743977] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-30T20:45:06.939257] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:06.939546] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-30T20:45:06.939596] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-30T20:45:06.940404] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-30T20:45:06.940497] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-30T20:45:07.273171] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T20:45:07.366461] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:07.454376] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-30T20:45:08.254396] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-30T20:45:08.620234] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T20:45:09.054403] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-30T20:45:09.252627] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-30T20:45:09.854395] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-30T20:45:09.976483] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T20:45:10.545948] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T20:45:10.654362] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-30T20:45:11.454376] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-30T20:45:12.254345] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-30T20:45:12.359790] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T20:45:12.474688] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-30T20:45:12.706997] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T20:45:12.714004] [INFO ] [REMOTE ] QD: Full fetch complete (40409 records). [2025-09-30T20:45:12.714215] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-30T20:45:13.065111] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-30T20:45:13.130807] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-30T20:45:13.130904] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-30T20:45:13.132006] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-30T20:45:13.132087] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-30T20:45:13.133381] [DEBUG] [LOCAL ] QD: Trimmed 40409 records to 27991 (keeping 200 days of data) [2025-09-30T20:45:13.313822] [DEBUG] [LOCAL ] QD: Primary data saved (27991 records). [2025-09-30T20:45:13.313969] [INFO ] [MAIN ] QD: Full history saved. [2025-09-30T20:45:13.314092] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 21.6s. Estimated remaining: 1h 18m 51s. Rate: 7.8 symbols/min [2025-09-30T20:45:13.506952] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:13.579817] [DEBUG] [LOCAL ] QSR: Loaded 52403 existing records from primary storage. [2025-09-30T20:45:13.580171] [INFO ] [MAIN ] QSR: Loaded 52403 existing records. [2025-09-30T20:45:13.799214] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:13.799531] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-30T20:45:13.799582] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-30T20:45:13.800181] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-30T20:45:13.800243] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-30T20:45:13.866571] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-30T20:45:14.319235] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:14.654429] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-30T20:45:14.757146] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-30T20:45:14.819256] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T20:45:15.454422] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-30T20:45:16.254365] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-30T20:45:16.361742] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T20:45:16.519606] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-30T20:45:17.054399] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-30T20:45:17.854422] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-30T20:45:18.106737] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T20:45:18.237747] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-30T20:45:18.654370] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-30T20:45:18.970182] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T20:45:19.454428] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-30T20:45:19.644696] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T20:45:20.254371] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-30T20:45:21.054369] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-30T20:45:21.451441] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-30T20:45:21.499634] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T20:45:21.854407] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-30T20:45:21.965069] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T20:45:22.428182] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T20:45:22.444174] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-30T20:45:22.444434] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-30T20:45:22.445571] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:45:22.445688] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:45:22.445760] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:45:22.445844] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-30T20:45:22.445942] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-30T20:45:22.446001] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-30T20:45:22.446072] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-30T20:45:22.446189] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QBTS took 46.0s. Estimated remaining: 1h 18m 44s. Rate: 7.8 symbols/min [2025-09-30T20:45:22.654391] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-30T20:45:22.973127] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T20:45:23.454427] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-30T20:45:24.254388] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-30T20:45:24.932028] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-30T20:45:25.028125] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T20:45:25.054358] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-30T20:45:25.854398] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-30T20:45:26.068904] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T20:45:26.654366] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-30T20:45:26.952790] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T20:45:27.454383] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-30T20:45:28.508971] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T20:45:28.523967] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-30T20:45:28.635181] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-30T20:45:29.054359] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-30T20:45:29.382734] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T20:45:29.854392] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-30T20:45:30.056835] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T20:45:30.654374] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-30T20:45:31.412028] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-30T20:45:31.455448] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-30T20:45:31.455364] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T20:45:31.942727] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T20:45:31.960321] [INFO ] [REMOTE ] QGEN: Full fetch complete (70114 records). [2025-09-30T20:45:31.960633] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-30T20:45:32.263007] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-30T20:45:32.430268] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-30T20:45:32.430428] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-30T20:45:32.431670] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-30T20:45:32.431768] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-30T20:45:32.433402] [DEBUG] [LOCAL ] QGEN: Trimmed 70114 records to 49069 (keeping 200 days of data) [2025-09-30T20:45:32.754433] [DEBUG] [LOCAL ] QGEN: Primary data saved (49069 records). [2025-09-30T20:45:32.754587] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-30T20:45:32.754795] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QGEN took 29.2s. Estimated remaining: 1h 18m 38s. Rate: 7.8 symbols/min [2025-09-30T20:45:34.274567] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T20:45:34.287827] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-30T20:45:34.328453] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T20:45:34.342486] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-30T20:45:36.102930] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T20:45:36.115049] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-30T20:45:36.977033] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-30T20:45:36.989141] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-30T20:45:38.084118] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T20:45:38.096681] [INFO ] [REMOTE ] QSR: Full fetch complete (75827 records). [2025-09-30T20:45:38.096910] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-30T20:45:38.530590] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-30T20:45:38.530709] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-30T20:45:38.531837] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-30T20:45:38.531944] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-30T20:45:38.533527] [DEBUG] [LOCAL ] QSR: Trimmed 75827 records to 52419 (keeping 200 days of data) [2025-09-30T20:45:38.894569] [DEBUG] [LOCAL ] QSR: Primary data saved (52419 records). [2025-09-30T20:45:38.894759] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-30T20:45:38.894909] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 25.6s. Estimated remaining: 1h 18m 29s. Rate: 7.8 symbols/min [2025-09-30T20:45:39.528380] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-30T20:45:39.540459] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-30T20:45:39.540669] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-30T20:45:39.950973] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-30T20:45:39.951065] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-30T20:45:39.952175] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-30T20:45:39.952255] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-30T20:45:39.953941] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 53743 (keeping 200 days of data) [2025-09-30T20:45:40.306849] [DEBUG] [LOCAL ] QS: Primary data saved (53743 records). [2025-09-30T20:45:40.307065] [INFO ] [MAIN ] QS: Full history saved. [2025-09-30T20:45:40.307202] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QS took 33.8s. Estimated remaining: 1h 18m 19s. Rate: 7.8 symbols/min [2025-09-30T20:45:41.121931] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:41.105586] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:41.120627] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:41.146922] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:41.160731] [DEBUG] [LOCAL ] QVCD: Loaded 4498 existing records from primary storage. [2025-09-30T20:45:41.161163] [INFO ] [MAIN ] QVCD: Loaded 4498 existing records. [2025-09-30T20:45:41.190396] [DEBUG] [LOCAL ] QVCC: Loaded 8934 existing records from primary storage. [2025-09-30T20:45:41.237281] [INFO ] [MAIN ] QVCC: Loaded 8934 existing records. [2025-09-30T20:45:41.395202] [DEBUG] [LOCAL ] QUAD: Loaded 23399 existing records from primary storage. [2025-09-30T20:45:41.412976] [INFO ] [MAIN ] QUAD: Loaded 23399 existing records. [2025-09-30T20:45:41.469489] [DEBUG] [LOCAL ] QTWO: Loaded 38996 existing records from primary storage. [2025-09-30T20:45:41.533026] [INFO ] [MAIN ] QTWO: Loaded 38996 existing records. [2025-09-30T20:45:41.761365] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:41.834181] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-30T20:45:41.878043] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:41.870834] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-30T20:45:41.913674] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-30T20:45:41.934439] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-30T20:45:41.939717] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-30T20:45:41.963952] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-30T20:45:41.993016] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-30T20:45:42.031040] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-30T20:45:42.088120] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:42.313447] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:42.283712] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-30T20:45:42.324166] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-30T20:45:42.324280] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-30T20:45:42.343794] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-30T20:45:42.354383] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-30T20:45:42.364882] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-30T20:45:42.375205] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-30T20:45:42.451090] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-30T20:45:43.528503] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:43.565875] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-30T20:45:43.625978] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:43.676455] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-30T20:45:43.791027] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:43.802566] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-30T20:45:43.914251] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:43.914628] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-30T20:45:44.536496] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T20:45:44.538381] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-30T20:45:44.966338] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T20:45:44.968242] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-30T20:45:45.071560] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:45:45.074255] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-30T20:45:45.301140] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T20:45:45.307464] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-30T20:45:45.462138] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:45:45.471267] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-30T20:45:45.508011] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T20:45:45.509320] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-30T20:45:45.666779] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T20:45:45.669299] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-30T20:45:46.072534] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T20:45:46.074391] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-30T20:45:46.484399] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:45:46.505063] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-30T20:45:46.506423] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T20:45:46.654378] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-30T20:45:46.743964] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T20:45:47.128952] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T20:45:47.355878] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:45:47.454329] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-30T20:45:47.750899] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T20:45:48.242468] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:45:48.254333] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-30T20:45:49.054410] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-30T20:45:49.088491] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T20:45:49.831034] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T20:45:49.854368] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-30T20:45:50.571078] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T20:45:50.654382] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-30T20:45:51.454431] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-30T20:45:52.019883] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T20:45:52.244687] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:45:52.254311] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-30T20:45:53.054396] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-30T20:45:53.860154] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-30T20:45:53.863104] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T20:45:53.905867] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T20:45:54.654403] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-30T20:45:55.068812] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T20:45:55.137153] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T20:45:55.454383] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-30T20:45:56.254356] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-30T20:45:56.800914] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T20:45:56.801554] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T20:45:56.809908] [INFO ] [REMOTE ] QVCD: Full fetch complete (6204 records). [2025-09-30T20:45:56.810375] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-30T20:45:57.061605] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-30T20:45:57.214696] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-30T20:45:57.214802] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-30T20:45:57.215016] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-30T20:45:57.215087] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-30T20:45:57.215510] [DEBUG] [LOCAL ] QVCD: Trimmed 6204 records to 4494 (keeping 200 days of data) [2025-09-30T20:45:57.244022] [DEBUG] [LOCAL ] QVCD: Primary data saved (4494 records). [2025-09-30T20:45:57.244160] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-30T20:45:57.244267] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 16.9s. Estimated remaining: 1h 18m 15s. Rate: 7.8 symbols/min [2025-09-30T20:45:57.430006] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:45:57.493190] [DEBUG] [LOCAL ] QXO: Loaded 53206 existing records from primary storage. [2025-09-30T20:45:57.493545] [INFO ] [MAIN ] QXO: Loaded 53206 existing records. [2025-09-30T20:45:57.696308] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:45:57.702224] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-30T20:45:57.703006] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T20:45:57.702803] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-30T20:45:57.706226] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-30T20:45:57.706335] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-30T20:45:57.859438] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-30T20:45:58.112944] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:45:58.654387] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-30T20:45:59.316258] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T20:45:59.454382] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-30T20:46:00.264672] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-30T20:46:00.285951] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T20:46:00.574918] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T20:46:01.054444] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-30T20:46:01.854357] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-30T20:46:01.891241] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T20:46:01.958483] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T20:46:02.654411] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-30T20:46:03.454380] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-30T20:46:03.520537] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T20:46:03.779106] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T20:46:04.254367] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-30T20:46:05.001112] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T20:46:05.054409] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-30T20:46:05.854344] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-30T20:46:06.034395] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T20:46:06.654393] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-30T20:46:06.679326] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T20:46:06.683542] [INFO ] [REMOTE ] QVCC: Full fetch complete (12053 records). [2025-09-30T20:46:06.683954] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-30T20:46:06.741878] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T20:46:07.316895] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-30T20:46:07.317084] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-30T20:46:07.317783] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-30T20:46:07.317897] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-30T20:46:07.319226] [DEBUG] [LOCAL ] QVCC: Trimmed 12053 records to 8910 (keeping 200 days of data) [2025-09-30T20:46:07.412908] [DEBUG] [LOCAL ] QVCC: Primary data saved (8910 records). [2025-09-30T20:46:07.413092] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-30T20:46:07.413231] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 27.1s. Estimated remaining: 1h 18m 8s. Rate: 7.8 symbols/min [2025-09-30T20:46:07.468839] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-30T20:46:07.645014] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:07.680341] [DEBUG] [LOCAL ] R: Loaded 29166 existing records from primary storage. [2025-09-30T20:46:07.680638] [INFO ] [MAIN ] R: Loaded 29166 existing records. [2025-09-30T20:46:07.880140] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:07.880395] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-30T20:46:07.880449] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-30T20:46:07.881147] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-30T20:46:07.881220] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-30T20:46:08.258210] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-30T20:46:08.299715] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:08.627630] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T20:46:08.708323] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T20:46:09.054410] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-30T20:46:09.312670] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T20:46:09.854387] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-30T20:46:10.654379] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-30T20:46:11.454389] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-30T20:46:11.513218] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-30T20:46:11.587635] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T20:46:12.125872] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T20:46:12.218931] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T20:46:12.224242] [INFO ] [REMOTE ] QUAD: Full fetch complete (34491 records). [2025-09-30T20:46:12.224364] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-30T20:46:12.259467] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-30T20:46:12.710804] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-30T20:46:12.710936] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-30T20:46:12.711771] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-30T20:46:12.711840] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-30T20:46:12.712922] [DEBUG] [LOCAL ] QUAD: Trimmed 34491 records to 23347 (keeping 200 days of data) [2025-09-30T20:46:12.859096] [DEBUG] [LOCAL ] QUAD: Primary data saved (23347 records). [2025-09-30T20:46:12.859230] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-30T20:46:12.859313] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 32.6s. Estimated remaining: 1h 17m 60s. Rate: 7.8 symbols/min [2025-09-30T20:46:13.050078] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:13.054345] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-30T20:46:13.077686] [DEBUG] [LOCAL ] RA: Loaded 21729 existing records from primary storage. [2025-09-30T20:46:13.077993] [INFO ] [MAIN ] RA: Loaded 21729 existing records. [2025-09-30T20:46:13.281079] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:13.281374] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-30T20:46:13.281434] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-30T20:46:13.281886] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-30T20:46:13.281948] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-30T20:46:13.749079] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:13.779507] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T20:46:13.854380] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-30T20:46:14.654377] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-30T20:46:14.964808] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T20:46:15.325361] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T20:46:15.454384] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-30T20:46:16.254407] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-30T20:46:16.303957] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T20:46:17.015776] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T20:46:17.027025] [INFO ] [REMOTE ] QTWO: Full fetch complete (57241 records). [2025-09-30T20:46:17.027254] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-30T20:46:17.063093] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-30T20:46:17.465260] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-30T20:46:17.465381] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-30T20:46:17.466764] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-30T20:46:17.466846] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-30T20:46:17.471103] [DEBUG] [LOCAL ] QTWO: Trimmed 57241 records to 38997 (keeping 200 days of data) [2025-09-30T20:46:17.739380] [DEBUG] [LOCAL ] QTWO: Primary data saved (38997 records). [2025-09-30T20:46:17.739587] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-30T20:46:17.739751] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QTWO took 37.4s. Estimated remaining: 1h 17m 51s. Rate: 7.8 symbols/min [2025-09-30T20:46:17.860225] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-30T20:46:17.956799] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:17.999703] [DEBUG] [LOCAL ] RACE: Loaded 32637 existing records from primary storage. [2025-09-30T20:46:18.000120] [INFO ] [MAIN ] RACE: Loaded 32637 existing records. [2025-09-30T20:46:18.229311] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:18.229633] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-30T20:46:18.229827] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-30T20:46:18.230572] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-30T20:46:18.230675] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-30T20:46:18.386839] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-30T20:46:18.661500] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-30T20:46:18.686403] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:18.713744] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T20:46:19.090127] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T20:46:19.454356] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-30T20:46:20.254370] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-30T20:46:20.654901] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T20:46:21.018108] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T20:46:21.054330] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-30T20:46:21.132431] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T20:46:21.854356] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-30T20:46:22.654332] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-30T20:46:23.106304] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-30T20:46:23.139148] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T20:46:23.454377] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-30T20:46:23.733760] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T20:46:24.254372] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-30T20:46:24.433729] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T20:46:25.054353] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-30T20:46:25.854366] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-30T20:46:26.372201] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T20:46:26.390683] [INFO ] [REMOTE ] QXO: Full fetch complete (75532 records). [2025-09-30T20:46:26.390860] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-30T20:46:26.660378] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-30T20:46:26.762698] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:46:26.875105] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T20:46:26.873934] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-30T20:46:26.881289] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-30T20:46:26.882940] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-30T20:46:26.883015] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-30T20:46:26.884408] [DEBUG] [LOCAL ] QXO: Trimmed 75532 records to 53245 (keeping 200 days of data) [2025-09-30T20:46:27.219423] [DEBUG] [LOCAL ] QXO: Primary data saved (53245 records). [2025-09-30T20:46:27.219611] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-30T20:46:27.219744] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 30.0s. Estimated remaining: 1h 17m 44s. Rate: 7.8 symbols/min [2025-09-30T20:46:27.411469] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:27.451128] [DEBUG] [LOCAL ] RAMP: Loaded 37464 existing records from primary storage. [2025-09-30T20:46:27.451453] [INFO ] [MAIN ] RAMP: Loaded 37464 existing records. [2025-09-30T20:46:27.463753] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-30T20:46:27.656333] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:27.656630] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-30T20:46:27.656938] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-30T20:46:27.657451] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-30T20:46:27.657517] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-30T20:46:28.062945] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T20:46:28.084806] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:28.254359] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-30T20:46:29.047772] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T20:46:29.054314] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-30T20:46:29.693955] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T20:46:29.854352] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-30T20:46:30.219446] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T20:46:30.654347] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-30T20:46:31.463712] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-30T20:46:31.468589] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T20:46:31.652696] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T20:46:32.254380] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-30T20:46:32.773309] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:46:33.054407] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-30T20:46:33.377293] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T20:46:33.854358] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-30T20:46:34.189437] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T20:46:34.654395] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-30T20:46:35.454345] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-30T20:46:35.667961] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T20:46:36.069859] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T20:46:36.254356] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-30T20:46:36.415902] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T20:46:37.054513] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-30T20:46:37.345329] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T20:46:37.350311] [INFO ] [REMOTE ] RA: Full fetch complete (32017 records). [2025-09-30T20:46:37.350416] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-30T20:46:37.759449] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-30T20:46:37.759547] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-30T20:46:37.760297] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-30T20:46:37.760366] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-30T20:46:37.761365] [DEBUG] [LOCAL ] RA: Trimmed 32017 records to 21757 (keeping 200 days of data) [2025-09-30T20:46:37.856734] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-30T20:46:37.907031] [DEBUG] [LOCAL ] RA: Primary data saved (21757 records). [2025-09-30T20:46:37.907188] [INFO ] [MAIN ] RA: Full history saved. [2025-09-30T20:46:37.907280] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 25.0s. Estimated remaining: 1h 17m 37s. Rate: 7.8 symbols/min [2025-09-30T20:46:38.098087] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:38.148276] [DEBUG] [LOCAL ] RBA: Loaded 45859 existing records from primary storage. [2025-09-30T20:46:38.148618] [INFO ] [MAIN ] RBA: Loaded 45859 existing records. [2025-09-30T20:46:38.345327] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:38.345544] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-30T20:46:38.345591] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-30T20:46:38.346131] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-30T20:46:38.346191] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-30T20:46:38.654632] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-30T20:46:38.747884] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:38.800499] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T20:46:39.003500] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T20:46:39.454410] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-30T20:46:39.996785] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T20:46:40.004211] [INFO ] [REMOTE ] R: Full fetch complete (42207 records). [2025-09-30T20:46:40.004396] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-30T20:46:40.259494] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-30T20:46:40.415184] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-30T20:46:40.415275] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-30T20:46:40.416159] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-30T20:46:40.416226] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-30T20:46:40.417277] [DEBUG] [LOCAL ] R: Trimmed 42207 records to 29054 (keeping 200 days of data) [2025-09-30T20:46:40.631424] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T20:46:40.657733] [DEBUG] [LOCAL ] R: Primary data saved (29054 records). [2025-09-30T20:46:40.657920] [INFO ] [MAIN ] R: Full history saved. [2025-09-30T20:46:40.658028] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. R took 33.2s. Estimated remaining: 1h 17m 28s. Rate: 7.8 symbols/min [2025-09-30T20:46:40.846597] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:40.867977] [DEBUG] [LOCAL ] RBC: Loaded 15132 existing records from primary storage. [2025-09-30T20:46:40.868250] [INFO ] [MAIN ] RBC: Loaded 15132 existing records. [2025-09-30T20:46:41.052447] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:41.052692] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-30T20:46:41.052753] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-30T20:46:41.053002] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-30T20:46:41.053063] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-30T20:46:41.065466] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-30T20:46:41.452720] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:41.854344] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-30T20:46:41.931921] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T20:46:42.390760] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T20:46:42.654402] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-30T20:46:42.819763] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T20:46:43.454430] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-30T20:46:43.778211] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T20:46:44.254392] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-30T20:46:44.823751] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T20:46:45.054395] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-30T20:46:45.425172] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T20:46:45.854336] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-30T20:46:46.088492] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T20:46:46.654368] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-30T20:46:47.454350] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-30T20:46:47.539720] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T20:46:47.680051] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:46:48.254394] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-30T20:46:48.564399] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T20:46:49.054414] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-30T20:46:49.854338] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-30T20:46:49.940015] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T20:46:50.287294] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T20:46:50.654376] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-30T20:46:51.453081] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T20:46:51.461629] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-30T20:46:52.254405] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-30T20:46:52.516687] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T20:46:52.554436] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T20:46:53.054369] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-30T20:46:53.513018] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T20:46:53.521749] [INFO ] [REMOTE ] RAMP: Full fetch complete (53336 records). [2025-09-30T20:46:53.521920] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-30T20:46:53.856130] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-30T20:46:53.969129] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-30T20:46:53.969249] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-30T20:46:53.970380] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-30T20:46:53.970614] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-30T20:46:53.987336] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:46:53.994381] [DEBUG] [LOCAL ] RAMP: Trimmed 53336 records to 37507 (keeping 200 days of data) [2025-09-30T20:46:54.238912] [DEBUG] [LOCAL ] RAMP: Primary data saved (37507 records). [2025-09-30T20:46:54.239164] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-30T20:46:54.239280] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RAMP took 27.0s. Estimated remaining: 1h 17m 22s. Rate: 7.8 symbols/min [2025-09-30T20:46:54.432367] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:54.492671] [DEBUG] [LOCAL ] RBLX: Loaded 53716 existing records from primary storage. [2025-09-30T20:46:54.493089] [INFO ] [MAIN ] RBLX: Loaded 53716 existing records. [2025-09-30T20:46:54.663816] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-30T20:46:54.709269] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:54.709500] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-30T20:46:54.709551] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-30T20:46:54.710400] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-30T20:46:54.710464] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-30T20:46:55.110096] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:55.459439] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-30T20:46:55.472223] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T20:46:55.524403] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:46:56.254367] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-30T20:46:57.054341] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-30T20:46:57.237578] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T20:46:57.761625] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T20:46:57.768966] [INFO ] [REMOTE ] RACE: Full fetch complete (47554 records). [2025-09-30T20:46:57.769129] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-30T20:46:57.859488] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-30T20:46:58.199332] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-30T20:46:58.199462] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-30T20:46:58.200379] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-30T20:46:58.200451] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-30T20:46:58.201757] [DEBUG] [LOCAL ] RACE: Trimmed 47554 records to 32575 (keeping 200 days of data) [2025-09-30T20:46:58.423398] [DEBUG] [LOCAL ] RACE: Primary data saved (32575 records). [2025-09-30T20:46:58.423544] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-30T20:46:58.423629] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RACE took 40.7s. Estimated remaining: 1h 17m 13s. Rate: 7.8 symbols/min [2025-09-30T20:46:58.633238] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:46:58.641020] [DEBUG] [LOCAL ] RBOT: Loaded 5172 existing records from primary storage. [2025-09-30T20:46:58.641265] [INFO ] [MAIN ] RBOT: Loaded 5172 existing records. [2025-09-30T20:46:58.666054] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-30T20:46:58.849232] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:46:58.849598] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-30T20:46:58.849675] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-30T20:46:58.849863] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-30T20:46:58.849956] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-30T20:46:59.284404] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:46:59.340024] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-30T20:46:59.454376] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-30T20:46:59.734767] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T20:46:59.797084] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:47:00.254395] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-30T20:47:00.355749] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T20:47:01.054397] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-30T20:47:01.603414] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T20:47:01.854373] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-30T20:47:02.094830] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T20:47:02.654364] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-30T20:47:03.454387] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-30T20:47:03.625974] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T20:47:03.757592] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T20:47:04.254371] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-30T20:47:05.054534] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-30T20:47:05.295622] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T20:47:05.614072] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T20:47:05.717455] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T20:47:05.854375] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-30T20:47:06.654364] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-30T20:47:07.274726] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T20:47:07.454486] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-30T20:47:08.239713] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-30T20:47:08.254302] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-30T20:47:09.054372] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-30T20:47:09.567117] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-30T20:47:09.854349] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-30T20:47:10.204429] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T20:47:10.208207] [INFO ] [REMOTE ] RBC: Full fetch complete (21824 records). [2025-09-30T20:47:10.208307] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-30T20:47:10.636791] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-30T20:47:10.636969] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-30T20:47:10.637563] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-30T20:47:10.637664] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-30T20:47:10.638689] [DEBUG] [LOCAL ] RBC: Trimmed 21824 records to 15117 (keeping 200 days of data) [2025-09-30T20:47:10.681460] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-30T20:47:10.748413] [DEBUG] [LOCAL ] RBC: Primary data saved (15117 records). [2025-09-30T20:47:10.748800] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-30T20:47:10.777158] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 30.1s. Estimated remaining: 1h 17m 7s. Rate: 7.8 symbols/min [2025-09-30T20:47:10.844412] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-30T20:47:11.012842] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:11.070353] [DEBUG] [LOCAL ] RBRK: Loaded 53123 existing records from primary storage. [2025-09-30T20:47:11.070736] [INFO ] [MAIN ] RBRK: Loaded 53123 existing records. [2025-09-30T20:47:11.266388] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:47:11.266663] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-30T20:47:11.266739] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-30T20:47:11.267450] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-30T20:47:11.267532] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-30T20:47:11.462411] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-30T20:47:11.590951] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T20:47:11.684618] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:11.713801] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T20:47:11.724263] [INFO ] [REMOTE ] RBA: Full fetch complete (65611 records). [2025-09-30T20:47:11.724401] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-30T20:47:12.154117] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-30T20:47:12.154202] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-30T20:47:12.155336] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-30T20:47:12.155404] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-30T20:47:12.156843] [DEBUG] [LOCAL ] RBA: Trimmed 65611 records to 45858 (keeping 200 days of data) [2025-09-30T20:47:12.256565] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-30T20:47:12.462495] [DEBUG] [LOCAL ] RBA: Primary data saved (45858 records). [2025-09-30T20:47:12.462671] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-30T20:47:12.462778] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 34.6s. Estimated remaining: 1h 16m 57s. Rate: 7.8 symbols/min [2025-09-30T20:47:12.640782] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:12.693919] [DEBUG] [LOCAL ] RC: Loaded 48910 existing records from primary storage. [2025-09-30T20:47:12.694282] [INFO ] [MAIN ] RC: Loaded 48910 existing records. [2025-09-30T20:47:12.859244] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:47:12.891744] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:47:12.891965] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-30T20:47:12.892014] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-30T20:47:12.892811] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-30T20:47:12.892871] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-30T20:47:13.056277] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-30T20:47:13.269413] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:13.697250] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T20:47:13.854349] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-30T20:47:14.654369] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-30T20:47:15.312245] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T20:47:15.430600] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-30T20:47:15.454392] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-30T20:47:16.254438] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-30T20:47:16.801394] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-30T20:47:17.054378] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-30T20:47:17.775943] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T20:47:17.854350] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-30T20:47:18.039064] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T20:47:18.251026] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T20:47:18.444916] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T20:47:18.654364] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-30T20:47:19.454352] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-30T20:47:20.254362] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-30T20:47:20.994517] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-30T20:47:21.054367] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-30T20:47:21.192790] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T20:47:21.854334] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-30T20:47:22.155110] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T20:47:22.654362] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-30T20:47:23.294826] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T20:47:23.454356] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-30T20:47:23.494162] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T20:47:23.496480] [INFO ] [REMOTE ] RBOT: Full fetch complete (8491 records). [2025-09-30T20:47:23.496582] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-30T20:47:23.928153] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T20:47:23.960755] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-30T20:47:23.964851] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-30T20:47:23.972419] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-30T20:47:23.972560] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-30T20:47:23.973189] [DEBUG] [LOCAL ] RBOT: Trimmed 8491 records to 5197 (keeping 200 days of data) [2025-09-30T20:47:24.004475] [DEBUG] [LOCAL ] RBOT: Primary data saved (5197 records). [2025-09-30T20:47:24.004616] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-30T20:47:24.004816] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 25.6s. Estimated remaining: 1h 16m 51s. Rate: 7.8 symbols/min [2025-09-30T20:47:24.186823] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:24.187014] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-30T20:47:24.187053] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-30T20:47:24.187201] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-30T20:47:24.187243] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-30T20:47:24.187285] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-30T20:47:24.187338] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-30T20:47:24.259557] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-30T20:47:24.584559] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:25.054332] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-30T20:47:25.321371] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T20:47:25.723160] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T20:47:25.854336] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-30T20:47:26.654361] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-30T20:47:26.852505] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-30T20:47:27.454348] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-30T20:47:27.876850] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T20:47:27.978195] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-30T20:47:28.255102] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T20:47:28.255176] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-30T20:47:29.054377] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-30T20:47:29.854339] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-30T20:47:30.246246] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T20:47:30.654406] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-30T20:47:31.383192] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T20:47:31.424379] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T20:47:31.464697] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-30T20:47:31.486706] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T20:47:31.499549] [INFO ] [REMOTE ] RBLX: Full fetch complete (77779 records). [2025-09-30T20:47:31.499789] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-30T20:47:31.928207] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-30T20:47:31.928299] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-30T20:47:31.929510] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-30T20:47:31.929580] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-30T20:47:31.931200] [DEBUG] [LOCAL ] RBLX: Trimmed 77779 records to 53716 (keeping 200 days of data) [2025-09-30T20:47:32.259316] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-30T20:47:32.290165] [DEBUG] [LOCAL ] RBLX: Primary data saved (53716 records). [2025-09-30T20:47:32.290323] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-30T20:47:32.290429] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 38.1s. Estimated remaining: 1h 16m 43s. Rate: 7.8 symbols/min [2025-09-30T20:47:32.481422] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:32.481638] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-30T20:47:32.481720] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-30T20:47:32.481841] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-30T20:47:32.481885] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-30T20:47:32.481929] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-30T20:47:32.481963] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-30T20:47:32.878545] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:33.054344] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-30T20:47:33.221440] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T20:47:33.475684] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T20:47:33.854332] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-30T20:47:34.374736] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T20:47:34.490099] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T20:47:34.654378] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-30T20:47:35.454410] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-30T20:47:36.254441] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-30T20:47:36.489006] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T20:47:36.957404] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T20:47:37.054327] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-30T20:47:37.418899] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-30T20:47:37.470201] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T20:47:37.854359] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-30T20:47:38.444486] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T20:47:38.654416] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-30T20:47:39.454364] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-30T20:47:39.979754] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:47:40.254341] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-30T20:47:40.435565] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:47:40.737972] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T20:47:41.054380] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-30T20:47:41.854368] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-30T20:47:42.288175] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T20:47:42.540746] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T20:47:42.551561] [INFO ] [REMOTE ] RC: Full fetch complete (70871 records). [2025-09-30T20:47:42.551802] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-30T20:47:42.659478] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-30T20:47:42.968867] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-30T20:47:42.968969] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-30T20:47:42.970016] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-30T20:47:42.970100] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-30T20:47:42.971625] [DEBUG] [LOCAL ] RC: Trimmed 70871 records to 48947 (keeping 200 days of data) [2025-09-30T20:47:43.273170] [DEBUG] [LOCAL ] RC: Primary data saved (48947 records). [2025-09-30T20:47:43.273324] [INFO ] [MAIN ] RC: Full history saved. [2025-09-30T20:47:43.273440] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RC took 30.8s. Estimated remaining: 1h 16m 37s. Rate: 7.8 symbols/min [2025-09-30T20:47:43.459475] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-30T20:47:43.462373] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:43.494445] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:47:43.535757] [DEBUG] [LOCAL ] RCI: Loaded 48607 existing records from primary storage. [2025-09-30T20:47:43.536218] [INFO ] [MAIN ] RCI: Loaded 48607 existing records. [2025-09-30T20:47:43.729327] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:47:43.729581] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-30T20:47:43.729660] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-30T20:47:43.730519] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-30T20:47:43.730579] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-30T20:47:44.099402] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:44.254374] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-30T20:47:44.980490] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T20:47:45.054374] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-30T20:47:45.352159] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T20:47:45.854357] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-30T20:47:46.383590] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T20:47:46.654403] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-30T20:47:46.684886] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T20:47:47.454362] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-30T20:47:47.870560] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T20:47:47.871533] [INFO ] [REMOTE ] RCB: Full fetch complete (3741 records). [2025-09-30T20:47:47.871612] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-30T20:47:48.099028] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T20:47:48.099373] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:47:48.099453] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:47:48.099526] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-30T20:47:48.099592] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-30T20:47:48.099675] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-30T20:47:48.099764] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-30T20:47:48.099845] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RCB took 24.1s. Estimated remaining: 1h 16m 28s. Rate: 7.8 symbols/min [2025-09-30T20:47:48.256129] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-30T20:47:48.282503] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:48.282898] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-30T20:47:48.283008] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-30T20:47:48.283167] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-30T20:47:48.283223] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-30T20:47:48.283268] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-30T20:47:48.283299] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-30T20:47:48.687352] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:48.754221] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T20:47:48.840761] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-30T20:47:49.054368] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-30T20:47:49.651415] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T20:47:49.854363] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-30T20:47:50.449248] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T20:47:50.654371] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-30T20:47:51.454371] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-30T20:47:52.074136] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T20:47:52.254369] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-30T20:47:52.993915] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T20:47:53.005429] [INFO ] [REMOTE ] RBRK: Full fetch complete (76526 records). [2025-09-30T20:47:53.005622] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-30T20:47:53.058677] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-30T20:47:53.126785] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:47:53.150674] [INFO ] [REMOTE ] RCD: Full fetch complete (6899 records). [2025-09-30T20:47:53.161029] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-30T20:47:53.611115] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-30T20:47:53.625771] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:47:53.679217] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-30T20:47:53.675097] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:47:53.679455] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-30T20:47:53.680789] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-30T20:47:53.681004] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-30T20:47:53.680899] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-30T20:47:53.681419] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-30T20:47:53.681486] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-30T20:47:53.681689] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-30T20:47:53.681802] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCD took 21.4s. Estimated remaining: 1h 16m 20s. Rate: 7.8 symbols/min [2025-09-30T20:47:53.769229] [DEBUG] [LOCAL ] RBRK: Trimmed 76526 records to 53132 (keeping 200 days of data) [2025-09-30T20:47:53.858756] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-30T20:47:54.000165] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:54.023978] [DEBUG] [LOCAL ] RCS: Loaded 11451 existing records from primary storage. [2025-09-30T20:47:54.025698] [INFO ] [MAIN ] RCS: Loaded 11451 existing records. [2025-09-30T20:47:54.232753] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:47:54.234238] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-30T20:47:54.250696] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-30T20:47:54.264908] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-30T20:47:54.265339] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-30T20:47:54.267828] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T20:47:54.655764] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-30T20:47:54.807217] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:54.911974] [DEBUG] [LOCAL ] RBRK: Primary data saved (53132 records). [2025-09-30T20:47:54.912119] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-30T20:47:54.912232] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RBRK took 44.1s. Estimated remaining: 1h 16m 10s. Rate: 7.8 symbols/min [2025-09-30T20:47:55.107780] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:47:55.154475] [DEBUG] [LOCAL ] RCUS: Loaded 42401 existing records from primary storage. [2025-09-30T20:47:55.154811] [INFO ] [MAIN ] RCUS: Loaded 42401 existing records. [2025-09-30T20:47:55.361538] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:47:55.361790] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-30T20:47:55.361841] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-30T20:47:55.362355] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-30T20:47:55.362427] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-30T20:47:55.466594] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-30T20:47:55.783506] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:47:55.842631] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T20:47:55.858325] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T20:47:56.254329] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-30T20:47:56.308504] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T20:47:57.054365] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-30T20:47:57.806406] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T20:47:57.854324] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-30T20:47:58.414588] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T20:47:58.654359] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-30T20:47:59.347245] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:47:59.454334] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-30T20:47:59.759747] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:48:00.254350] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-30T20:48:01.015603] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T20:48:01.054341] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-30T20:48:01.288661] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T20:48:01.854405] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-30T20:48:02.510661] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:48:02.654358] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-30T20:48:02.859775] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T20:48:03.454360] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-30T20:48:04.262039] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-30T20:48:04.281159] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T20:48:04.500580] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T20:48:05.054408] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-30T20:48:05.854402] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-30T20:48:05.937774] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T20:48:06.425213] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T20:48:06.654404] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-30T20:48:06.686737] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T20:48:07.454349] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-30T20:48:07.539932] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T20:48:08.254413] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-30T20:48:08.371192] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:48:09.054385] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-30T20:48:09.861418] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-30T20:48:09.878150] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T20:48:10.402611] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T20:48:10.654375] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-30T20:48:11.454353] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-30T20:48:12.061170] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T20:48:12.138636] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-30T20:48:12.254402] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-30T20:48:13.054342] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-30T20:48:13.179315] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:48:13.218633] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T20:48:13.854434] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-30T20:48:14.405877] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T20:48:14.654403] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-30T20:48:14.809178] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:48:15.454411] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-30T20:48:16.254375] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-30T20:48:17.054353] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-30T20:48:17.138404] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-30T20:48:17.282392] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T20:48:17.294025] [INFO ] [REMOTE ] RCL: Full fetch complete (75025 records). [2025-09-30T20:48:17.294248] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-30T20:48:17.295108] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:48:17.295210] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:48:17.295254] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:48:17.295296] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-30T20:48:17.295377] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-30T20:48:17.295434] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-30T20:48:17.295476] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-30T20:48:17.295539] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCL took 29.2s. Estimated remaining: 1h 16m 7s. Rate: 7.8 symbols/min [2025-09-30T20:48:17.479718] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:17.516613] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-30T20:48:17.598449] [DEBUG] [LOCAL ] RDDT: Loaded 53781 existing records from primary storage. [2025-09-30T20:48:17.598859] [INFO ] [MAIN ] RDDT: Loaded 53781 existing records. [2025-09-30T20:48:17.796302] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:17.796532] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-30T20:48:17.796580] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-30T20:48:17.797606] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-30T20:48:17.797714] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-30T20:48:17.854369] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-30T20:48:18.193485] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:18.385592] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T20:48:18.654402] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-30T20:48:19.343623] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T20:48:19.454383] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-30T20:48:20.254387] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-30T20:48:20.338299] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T20:48:21.064899] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-30T20:48:21.087364] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-30T20:48:21.788501] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T20:48:21.799974] [INFO ] [REMOTE ] RCUS: Full fetch complete (60168 records). [2025-09-30T20:48:21.800185] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-30T20:48:21.864117] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-30T20:48:22.174473] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T20:48:22.218093] [INFO ] [REMOTE ] RCS: Full fetch complete (19086 records). [2025-09-30T20:48:22.252562] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-30T20:48:22.255974] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-30T20:48:22.256166] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-30T20:48:22.257281] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-30T20:48:22.262940] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-30T20:48:22.367566] [DEBUG] [LOCAL ] RCUS: Trimmed 60168 records to 42393 (keeping 200 days of data) [2025-09-30T20:48:22.657287] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-30T20:48:22.765956] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-30T20:48:22.766350] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-30T20:48:22.766896] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-30T20:48:22.767529] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-30T20:48:22.773479] [DEBUG] [LOCAL ] RCS: Trimmed 19086 records to 11474 (keeping 200 days of data) [2025-09-30T20:48:22.941732] [DEBUG] [LOCAL ] RCS: Primary data saved (11474 records). [2025-09-30T20:48:22.945473] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-30T20:48:22.947437] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCS took 29.3s. Estimated remaining: 1h 15m 59s. Rate: 7.8 symbols/min [2025-09-30T20:48:23.172760] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:23.177536] [DEBUG] [LOCAL ] RCUS: Primary data saved (42393 records). [2025-09-30T20:48:23.177711] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-30T20:48:23.177818] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCUS took 28.3s. Estimated remaining: 1h 15m 49s. Rate: 7.8 symbols/min [2025-09-30T20:48:23.429124] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:23.450087] [DEBUG] [LOCAL ] RDN: Loaded 45150 existing records from primary storage. [2025-09-30T20:48:23.450487] [INFO ] [MAIN ] RDN: Loaded 45150 existing records. [2025-09-30T20:48:23.666322] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:23.666783] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-30T20:48:23.666885] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-30T20:48:23.667566] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-30T20:48:23.667707] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-30T20:48:23.803536] [DEBUG] [LOCAL ] RDW: Loaded 52017 existing records from primary storage. [2025-09-30T20:48:23.831507] [INFO ] [MAIN ] RDW: Loaded 52017 existing records. [2025-09-30T20:48:23.833967] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T20:48:23.933873] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-30T20:48:24.323579] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:24.358720] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-30T20:48:24.358632] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:24.359137] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-30T20:48:24.359985] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-30T20:48:24.360705] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-30T20:48:24.360769] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-30T20:48:24.805625] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:25.054365] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-30T20:48:25.175143] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-30T20:48:25.507829] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T20:48:25.854347] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-30T20:48:26.025227] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T20:48:26.654316] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-30T20:48:27.080127] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T20:48:27.454331] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-30T20:48:27.568806] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T20:48:28.254374] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-30T20:48:29.019862] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:48:29.054309] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-30T20:48:29.197798] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-30T20:48:29.655302] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T20:48:29.665935] [INFO ] [REMOTE ] RCI: Full fetch complete (70514 records). [2025-09-30T20:48:29.666098] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-30T20:48:29.870143] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-30T20:48:30.133596] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-30T20:48:30.133716] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-30T20:48:30.134750] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-30T20:48:30.134871] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-30T20:48:30.136422] [DEBUG] [LOCAL ] RCI: Trimmed 70514 records to 48628 (keeping 200 days of data) [2025-09-30T20:48:30.464610] [DEBUG] [LOCAL ] RCI: Primary data saved (48628 records). [2025-09-30T20:48:30.464860] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-30T20:48:30.464976] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RCI took 47.2s. Estimated remaining: 1h 15m 41s. Rate: 7.8 symbols/min [2025-09-30T20:48:30.658873] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-30T20:48:30.660600] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:30.694936] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:48:30.751010] [DEBUG] [LOCAL ] RDY: Loaded 46769 existing records from primary storage. [2025-09-30T20:48:30.751353] [INFO ] [MAIN ] RDY: Loaded 46769 existing records. [2025-09-30T20:48:30.950630] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:30.950868] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-30T20:48:30.950917] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-30T20:48:30.951728] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-30T20:48:30.951793] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-30T20:48:31.362261] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:31.454421] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-30T20:48:32.254380] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-30T20:48:32.539081] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-30T20:48:32.695253] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T20:48:33.054317] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-30T20:48:33.251516] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:48:33.750525] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T20:48:33.854346] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-30T20:48:34.654392] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-30T20:48:35.454448] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-30T20:48:35.551933] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T20:48:35.996138] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-30T20:48:36.131212] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T20:48:36.254353] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-30T20:48:37.054355] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-30T20:48:37.244757] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T20:48:37.854397] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-30T20:48:38.138378] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T20:48:38.451827] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T20:48:38.654418] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-30T20:48:39.454355] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-30T20:48:40.229363] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-30T20:48:40.264359] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-30T20:48:40.270042] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T20:48:41.054365] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-30T20:48:41.129028] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T20:48:41.854376] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-30T20:48:42.310377] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T20:48:42.654327] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-30T20:48:42.755676] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T20:48:43.230843] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T20:48:43.454394] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-30T20:48:44.254401] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-30T20:48:44.731782] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T20:48:44.787768] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T20:48:45.054359] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-30T20:48:45.854413] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-30T20:48:46.009503] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T20:48:46.654432] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-30T20:48:46.704909] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T20:48:46.715154] [INFO ] [REMOTE ] RDN: Full fetch complete (65928 records). [2025-09-30T20:48:46.715414] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-30T20:48:47.129591] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-30T20:48:47.129712] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-30T20:48:47.130711] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-30T20:48:47.130776] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-30T20:48:47.132327] [DEBUG] [LOCAL ] RDN: Trimmed 65928 records to 45113 (keeping 200 days of data) [2025-09-30T20:48:47.433529] [DEBUG] [LOCAL ] RDN: Primary data saved (45113 records). [2025-09-30T20:48:47.433714] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-30T20:48:47.433814] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDN took 24.5s. Estimated remaining: 1h 15m 36s. Rate: 7.8 symbols/min [2025-09-30T20:48:47.468703] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-30T20:48:47.616322] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:47.673627] [DEBUG] [LOCAL ] RELX: Loaded 47858 existing records from primary storage. [2025-09-30T20:48:47.674027] [INFO ] [MAIN ] RELX: Loaded 47858 existing records. [2025-09-30T20:48:47.869983] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:47.870264] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-30T20:48:47.870382] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-30T20:48:47.871080] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-30T20:48:47.871150] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-30T20:48:48.271241] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:48.271815] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-30T20:48:48.302683] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T20:48:48.342520] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-30T20:48:49.054376] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-30T20:48:49.854343] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-30T20:48:49.885253] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T20:48:50.148045] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-30T20:48:50.654361] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-30T20:48:51.454407] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-30T20:48:51.565764] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T20:48:51.659637] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-30T20:48:52.254410] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-30T20:48:53.045848] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T20:48:53.054479] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-30T20:48:53.382342] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-30T20:48:53.854419] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-30T20:48:54.654349] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-30T20:48:54.728000] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-30T20:48:54.892942] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T20:48:55.173407] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T20:48:55.454379] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-30T20:48:56.254410] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-30T20:48:57.054402] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-30T20:48:57.292574] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-30T20:48:57.606309] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T20:48:57.617838] [INFO ] [REMOTE ] RDW: Full fetch complete (74690 records). [2025-09-30T20:48:57.618016] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-30T20:48:57.855950] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-30T20:48:58.053258] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-30T20:48:58.053410] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-30T20:48:58.054801] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-30T20:48:58.054901] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-30T20:48:58.082492] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T20:48:58.092444] [DEBUG] [LOCAL ] RDW: Trimmed 74690 records to 52028 (keeping 200 days of data) [2025-09-30T20:48:58.414422] [DEBUG] [LOCAL ] RDW: Primary data saved (52028 records). [2025-09-30T20:48:58.414570] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-30T20:48:58.414680] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDW took 35.2s. Estimated remaining: 1h 15m 29s. Rate: 7.8 symbols/min [2025-09-30T20:48:58.604742] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:48:58.634293] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T20:48:58.662948] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-30T20:48:58.682504] [DEBUG] [LOCAL ] RERE: Loaded 41027 existing records from primary storage. [2025-09-30T20:48:58.682847] [INFO ] [MAIN ] RERE: Loaded 41027 existing records. [2025-09-30T20:48:58.875957] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:48:58.876252] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-30T20:48:58.876308] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-30T20:48:58.876637] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-30T20:48:58.876728] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-30T20:48:59.255678] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:48:59.454382] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-30T20:49:00.254431] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-30T20:49:00.491855] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T20:49:00.768436] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-09-30T20:49:00.789485] [INFO ] [REMOTE ] RDDT: Full fetch complete (77887 records). [2025-09-30T20:49:00.789750] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-30T20:49:01.058114] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-30T20:49:01.304374] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T20:49:01.400615] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-30T20:49:01.400750] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-30T20:49:01.402009] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-30T20:49:01.402081] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-30T20:49:01.406715] [DEBUG] [LOCAL ] RDDT: Trimmed 77887 records to 53780 (keeping 200 days of data) [2025-09-30T20:49:01.556703] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T20:49:01.570733] [INFO ] [REMOTE ] RDY: Full fetch complete (68985 records). [2025-09-30T20:49:01.575772] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-30T20:49:01.859219] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-30T20:49:02.210128] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-30T20:49:02.210515] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-30T20:49:02.212100] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-30T20:49:02.212471] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-30T20:49:02.220754] [DEBUG] [LOCAL ] RDY: Trimmed 68985 records to 46821 (keeping 200 days of data) [2025-09-30T20:49:02.404949] [DEBUG] [LOCAL ] RDDT: Primary data saved (53780 records). [2025-09-30T20:49:02.405932] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-30T20:49:02.406299] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDDT took 45.1s. Estimated remaining: 1h 15m 21s. Rate: 7.8 symbols/min [2025-09-30T20:49:02.603297] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:02.756750] [DEBUG] [LOCAL ] RES: Loaded 47471 existing records from primary storage. [2025-09-30T20:49:02.757832] [INFO ] [MAIN ] RES: Loaded 47471 existing records. [2025-09-30T20:49:02.981193] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:02.982350] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-30T20:49:02.982622] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-30T20:49:02.984163] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-30T20:49:02.984537] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-30T20:49:03.246107] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-30T20:49:03.376830] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-30T20:49:03.410300] [DEBUG] [LOCAL ] RDY: Primary data saved (46821 records). [2025-09-30T20:49:03.410946] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-30T20:49:03.432770] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RDY took 33.0s. Estimated remaining: 1h 15m 11s. Rate: 7.8 symbols/min [2025-09-30T20:49:03.576131] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:03.577627] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T20:49:03.602207] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-30T20:49:03.732241] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:03.779293] [DEBUG] [LOCAL ] REVG: Loaded 40770 existing records from primary storage. [2025-09-30T20:49:03.779598] [INFO ] [MAIN ] REVG: Loaded 40770 existing records. [2025-09-30T20:49:03.979166] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:03.979396] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-30T20:49:03.979442] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-30T20:49:03.979994] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-30T20:49:03.980055] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-30T20:49:04.267462] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-30T20:49:04.360835] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:05.054390] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-30T20:49:05.130464] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T20:49:05.287748] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T20:49:05.843158] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T20:49:05.854316] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-30T20:49:06.419491] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T20:49:06.654369] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-30T20:49:07.342583] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T20:49:07.454399] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-30T20:49:07.804620] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:49:08.254394] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-30T20:49:09.054330] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-30T20:49:09.226097] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T20:49:09.837073] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T20:49:09.854311] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-30T20:49:10.654364] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-30T20:49:11.409664] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-30T20:49:11.454325] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-30T20:49:12.262067] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-30T20:49:12.264897] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-30T20:49:12.407213] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T20:49:13.054360] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-30T20:49:13.613399] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T20:49:13.854330] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-30T20:49:13.957606] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T20:49:14.484258] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T20:49:14.654357] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-30T20:49:15.454348] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-30T20:49:15.868698] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T20:49:15.879928] [INFO ] [REMOTE ] RELX: Full fetch complete (67251 records). [2025-09-30T20:49:15.880100] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-30T20:49:16.261832] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-30T20:49:16.326281] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-30T20:49:16.326385] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-30T20:49:16.327675] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-30T20:49:16.327747] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-30T20:49:16.329276] [DEBUG] [LOCAL ] RELX: Trimmed 67251 records to 47872 (keeping 200 days of data) [2025-09-30T20:49:16.633493] [DEBUG] [LOCAL ] RELX: Primary data saved (47872 records). [2025-09-30T20:49:16.633634] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-30T20:49:16.633767] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RELX took 29.2s. Estimated remaining: 1h 15m 5s. Rate: 7.8 symbols/min [2025-09-30T20:49:16.816152] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:16.833726] [DEBUG] [LOCAL ] REX: Loaded 14051 existing records from primary storage. [2025-09-30T20:49:16.834016] [INFO ] [MAIN ] REX: Loaded 14051 existing records. [2025-09-30T20:49:17.024752] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:17.025150] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-30T20:49:17.025258] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-30T20:49:17.025602] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-30T20:49:17.025764] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-30T20:49:17.190017] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-30T20:49:17.262488] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-30T20:49:17.452174] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:17.854365] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-30T20:49:18.284243] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-30T20:49:18.654365] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-30T20:49:18.849046] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-30T20:49:18.908965] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T20:49:19.454357] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-30T20:49:19.944078] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-30T20:49:20.254353] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-30T20:49:20.438558] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T20:49:20.549435] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T20:49:21.054336] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-30T20:49:21.397248] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T20:49:21.854371] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-30T20:49:22.654356] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-30T20:49:22.936165] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:49:23.022249] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T20:49:23.454361] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-30T20:49:23.589276] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T20:49:24.254358] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-30T20:49:25.052215] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:49:25.062031] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-30T20:49:25.064329] [INFO ] [REMOTE ] RERE: Full fetch complete (57403 records). [2025-09-30T20:49:25.064526] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-30T20:49:25.511124] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-30T20:49:25.511208] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-30T20:49:25.512227] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-30T20:49:25.512296] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-30T20:49:25.513884] [DEBUG] [LOCAL ] RERE: Trimmed 57403 records to 41062 (keeping 200 days of data) [2025-09-30T20:49:25.762835] [DEBUG] [LOCAL ] RERE: Primary data saved (41062 records). [2025-09-30T20:49:25.762958] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-30T20:49:25.763051] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RERE took 27.3s. Estimated remaining: 1h 14m 58s. Rate: 7.8 symbols/min [2025-09-30T20:49:25.862575] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-30T20:49:25.959623] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:26.024105] [DEBUG] [LOCAL ] REXR: Loaded 52096 existing records from primary storage. [2025-09-30T20:49:26.024475] [INFO ] [MAIN ] REXR: Loaded 52096 existing records. [2025-09-30T20:49:26.264350] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:26.278334] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T20:49:26.278474] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-30T20:49:26.290055] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-30T20:49:26.289669] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T20:49:26.295096] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-30T20:49:26.295194] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-30T20:49:26.662031] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-30T20:49:26.697042] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:27.454376] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-30T20:49:27.664261] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T20:49:27.743704] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T20:49:28.254395] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-30T20:49:29.054324] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-30T20:49:29.094562] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T20:49:29.506074] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T20:49:29.736109] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T20:49:29.854400] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-30T20:49:30.654387] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-30T20:49:31.375479] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:49:31.454431] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-30T20:49:32.254372] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-30T20:49:32.457467] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T20:49:32.967622] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T20:49:33.054339] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-30T20:49:33.122456] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T20:49:33.854401] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-30T20:49:34.504427] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T20:49:34.513721] [INFO ] [REMOTE ] REVG: Full fetch complete (58332 records). [2025-09-30T20:49:34.513855] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-30T20:49:34.665721] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-30T20:49:34.927673] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-30T20:49:34.927806] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-30T20:49:34.928843] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-30T20:49:34.928926] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-30T20:49:34.939514] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T20:49:34.943878] [DEBUG] [LOCAL ] REVG: Trimmed 58332 records to 40744 (keeping 200 days of data) [2025-09-30T20:49:35.216506] [DEBUG] [LOCAL ] REVG: Primary data saved (40744 records). [2025-09-30T20:49:35.216806] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-30T20:49:35.217066] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REVG took 31.8s. Estimated remaining: 1h 14m 50s. Rate: 7.8 symbols/min [2025-09-30T20:49:35.405499] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:35.459090] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-30T20:49:35.462066] [DEBUG] [LOCAL ] REZI: Loaded 46908 existing records from primary storage. [2025-09-30T20:49:35.462682] [INFO ] [MAIN ] REZI: Loaded 46908 existing records. [2025-09-30T20:49:35.676308] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:35.676608] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-30T20:49:35.676697] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-30T20:49:35.677484] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-30T20:49:35.677546] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-30T20:49:36.121765] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:36.254389] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-30T20:49:36.317371] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T20:49:37.054317] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-30T20:49:37.332899] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T20:49:37.816411] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T20:49:37.854350] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-30T20:49:38.654341] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-30T20:49:38.832211] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T20:49:38.843275] [INFO ] [REMOTE ] RES: Full fetch complete (68991 records). [2025-09-30T20:49:38.843513] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-30T20:49:39.302780] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-30T20:49:39.303035] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-30T20:49:39.304333] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-30T20:49:39.304531] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-30T20:49:39.306332] [DEBUG] [LOCAL ] RES: Trimmed 68991 records to 47433 (keeping 200 days of data) [2025-09-30T20:49:39.422856] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:49:39.454463] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-30T20:49:39.626472] [DEBUG] [LOCAL ] RES: Primary data saved (47433 records). [2025-09-30T20:49:39.626610] [INFO ] [MAIN ] RES: Full history saved. [2025-09-30T20:49:39.626760] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. RES took 37.2s. Estimated remaining: 1h 14m 42s. Rate: 7.8 symbols/min [2025-09-30T20:49:39.804783] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:39.868535] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-30T20:49:39.868889] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-30T20:49:40.062044] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:40.062435] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-30T20:49:40.062513] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-30T20:49:40.063103] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-30T20:49:40.063187] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-30T20:49:40.259072] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-30T20:49:40.450696] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:40.484209] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T20:49:41.054337] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-30T20:49:41.159052] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T20:49:41.211760] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:49:41.854358] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-30T20:49:42.654327] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-30T20:49:42.920701] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T20:49:43.454347] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-30T20:49:43.520506] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T20:49:43.762005] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T20:49:43.766099] [INFO ] [REMOTE ] REX: Full fetch complete (21082 records). [2025-09-30T20:49:43.766198] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-30T20:49:44.157088] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-30T20:49:44.157195] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-30T20:49:44.157733] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-30T20:49:44.157882] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-30T20:49:44.158846] [DEBUG] [LOCAL ] REX: Trimmed 21082 records to 14075 (keeping 200 days of data) [2025-09-30T20:49:44.254521] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-30T20:49:44.263010] [DEBUG] [LOCAL ] REX: Primary data saved (14075 records). [2025-09-30T20:49:44.263332] [INFO ] [MAIN ] REX: Full history saved. [2025-09-30T20:49:44.263449] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REX took 27.6s. Estimated remaining: 1h 14m 33s. Rate: 7.8 symbols/min [2025-09-30T20:49:44.444519] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:49:44.458637] [DEBUG] [LOCAL ] RFI: Loaded 10468 existing records from primary storage. [2025-09-30T20:49:44.458895] [INFO ] [MAIN ] RFI: Loaded 10468 existing records. [2025-09-30T20:49:44.671609] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:49:44.671869] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-30T20:49:44.671918] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-30T20:49:44.672134] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-30T20:49:44.672193] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-30T20:49:45.071554] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:49:45.071791] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-30T20:49:45.110760] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T20:49:45.668987] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T20:49:45.854386] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-30T20:49:45.952256] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:49:46.654362] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-30T20:49:46.956892] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T20:49:47.454330] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-30T20:49:47.499129] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T20:49:48.254380] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-30T20:49:49.054354] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-30T20:49:49.202634] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T20:49:49.854360] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-30T20:49:50.355863] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-30T20:49:50.474727] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T20:49:50.654364] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-30T20:49:50.760562] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T20:49:51.454364] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-30T20:49:52.247902] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T20:49:52.259537] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-30T20:49:52.479806] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T20:49:53.054407] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-30T20:49:53.822464] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T20:49:53.854384] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-30T20:49:54.017677] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T20:49:54.654333] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-30T20:49:54.727788] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T20:49:55.454330] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-30T20:49:55.598088] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T20:49:56.254354] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-30T20:49:56.877877] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T20:49:57.054354] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-30T20:49:57.196662] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T20:49:57.854394] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-30T20:49:58.654373] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-30T20:49:58.801894] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T20:49:59.078597] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T20:49:59.090158] [INFO ] [REMOTE ] REXR: Full fetch complete (75118 records). [2025-09-30T20:49:59.090359] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-30T20:49:59.464543] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-30T20:49:59.533264] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-30T20:49:59.533379] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-30T20:49:59.534749] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-30T20:49:59.534846] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-30T20:49:59.536589] [DEBUG] [LOCAL ] REXR: Trimmed 75118 records to 52091 (keeping 200 days of data) [2025-09-30T20:49:59.648055] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T20:49:59.900534] [DEBUG] [LOCAL ] REXR: Primary data saved (52091 records). [2025-09-30T20:49:59.900723] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-30T20:49:59.900887] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REXR took 34.1s. Estimated remaining: 1h 14m 28s. Rate: 7.8 symbols/min [2025-09-30T20:50:00.092754] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:00.104447] [DEBUG] [LOCAL ] RFL: Loaded 11077 existing records from primary storage. [2025-09-30T20:50:00.104710] [INFO ] [MAIN ] RFL: Loaded 11077 existing records. [2025-09-30T20:50:00.259552] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-30T20:50:00.307141] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:00.307902] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-30T20:50:00.312365] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-30T20:50:00.312926] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-30T20:50:00.313046] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-30T20:50:00.724247] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:00.760311] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T20:50:01.054324] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-30T20:50:01.148317] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T20:50:01.854408] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-30T20:50:02.064138] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T20:50:02.654370] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-30T20:50:03.338469] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T20:50:03.454357] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-30T20:50:03.699362] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T20:50:04.254320] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-30T20:50:04.379042] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T20:50:05.054392] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-30T20:50:05.177107] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T20:50:05.854327] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-30T20:50:05.963306] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T20:50:05.974723] [INFO ] [REMOTE ] RF: Full fetch complete (77236 records). [2025-09-30T20:50:05.974920] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-30T20:50:05.975877] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:50:05.976003] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:50:05.976050] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:50:05.976131] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-30T20:50:05.976221] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-09-30T20:50:05.976300] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-09-30T20:50:05.976975] [DEBUG] [LOCAL ] RF: Deleted derivative data file. [2025-09-30T20:50:05.977126] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RF took 26.4s. Estimated remaining: 1h 14m 20s. Rate: 7.8 symbols/min [2025-09-30T20:50:06.159389] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:06.166984] [DEBUG] [LOCAL ] RFM: Loaded 4158 existing records from primary storage. [2025-09-30T20:50:06.167234] [INFO ] [MAIN ] RFM: Loaded 4158 existing records. [2025-09-30T20:50:06.379412] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:06.379746] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-30T20:50:06.379823] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-30T20:50:06.380214] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-30T20:50:06.380291] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-30T20:50:06.658668] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-30T20:50:06.751804] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:50:06.788096] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:07.454339] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-30T20:50:08.254408] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-30T20:50:08.322731] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T20:50:08.481565] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T20:50:08.701315] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-30T20:50:09.054455] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-30T20:50:09.854413] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-30T20:50:10.654358] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-30T20:50:11.454371] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-30T20:50:11.980505] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-30T20:50:11.991513] [INFO ] [REMOTE ] REZI: Full fetch complete (65901 records). [2025-09-30T20:50:11.991686] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-30T20:50:12.459160] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-30T20:50:12.459329] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-30T20:50:12.460392] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-30T20:50:12.460460] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-30T20:50:12.461973] [DEBUG] [LOCAL ] REZI: Trimmed 65901 records to 46920 (keeping 200 days of data) [2025-09-30T20:50:12.750823] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-09-30T20:50:12.754343] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-30T20:50:12.765395] [DEBUG] [LOCAL ] REZI: Primary data saved (46920 records). [2025-09-30T20:50:12.765478] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-30T20:50:12.765568] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. REZI took 37.5s. Estimated remaining: 1h 14m 12s. Rate: 7.8 symbols/min [2025-09-30T20:50:12.877038] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-30T20:50:12.950998] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:12.962485] [DEBUG] [LOCAL ] RFMZ: Loaded 8794 existing records from primary storage. [2025-09-30T20:50:12.962775] [INFO ] [MAIN ] RFMZ: Loaded 8794 existing records. [2025-09-30T20:50:13.059454] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-30T20:50:13.159188] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:13.159430] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-30T20:50:13.159479] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-30T20:50:13.159722] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-30T20:50:13.159784] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-30T20:50:13.552325] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:13.756489] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T20:50:13.854339] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-30T20:50:13.978850] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:50:13.984708] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-30T20:50:14.654327] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-30T20:50:14.706731] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T20:50:15.454363] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-30T20:50:15.539575] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T20:50:15.542178] [INFO ] [REMOTE ] RFI: Full fetch complete (15786 records). [2025-09-30T20:50:15.542258] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-30T20:50:15.960613] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-30T20:50:15.960746] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-30T20:50:15.961152] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-30T20:50:15.961220] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-30T20:50:15.961887] [DEBUG] [LOCAL ] RFI: Trimmed 15786 records to 10454 (keeping 200 days of data) [2025-09-30T20:50:16.036252] [DEBUG] [LOCAL ] RFI: Primary data saved (10454 records). [2025-09-30T20:50:16.036405] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-30T20:50:16.036491] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFI took 31.8s. Estimated remaining: 1h 14m 2s. Rate: 7.8 symbols/min [2025-09-30T20:50:16.222931] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:16.258869] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-30T20:50:16.261799] [DEBUG] [LOCAL ] RGA: Loaded 29809 existing records from primary storage. [2025-09-30T20:50:16.262190] [INFO ] [MAIN ] RGA: Loaded 29809 existing records. [2025-09-30T20:50:16.472590] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:16.472987] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-30T20:50:16.473073] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-30T20:50:16.473959] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-30T20:50:16.474021] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-30T20:50:16.552093] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T20:50:16.891582] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:17.054370] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-30T20:50:17.796212] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T20:50:17.854347] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-30T20:50:18.359894] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T20:50:18.654370] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-30T20:50:19.107917] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:50:19.454363] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-30T20:50:20.254340] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-30T20:50:20.378671] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T20:50:20.401338] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T20:50:20.900898] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T20:50:21.054351] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-30T20:50:21.749693] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T20:50:21.854361] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-30T20:50:22.484340] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T20:50:22.654362] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-30T20:50:23.454360] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-30T20:50:24.254404] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-30T20:50:24.352248] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T20:50:24.571131] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T20:50:24.891627] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T20:50:25.054355] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-30T20:50:25.787494] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T20:50:25.789386] [INFO ] [REMOTE ] RFM: Full fetch complete (5902 records). [2025-09-30T20:50:25.789461] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-30T20:50:25.859454] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-30T20:50:26.186297] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-30T20:50:26.186390] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-30T20:50:26.186583] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-30T20:50:26.186667] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-30T20:50:26.187085] [DEBUG] [LOCAL ] RFM: Trimmed 5902 records to 4155 (keeping 200 days of data) [2025-09-30T20:50:26.215792] [DEBUG] [LOCAL ] RFM: Primary data saved (4155 records). [2025-09-30T20:50:26.215951] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-30T20:50:26.216115] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFM took 20.2s. Estimated remaining: 1h 13m 56s. Rate: 7.8 symbols/min [2025-09-30T20:50:26.397975] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:26.425718] [DEBUG] [LOCAL ] RGR: Loaded 20577 existing records from primary storage. [2025-09-30T20:50:26.425977] [INFO ] [MAIN ] RGR: Loaded 20577 existing records. [2025-09-30T20:50:26.631056] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T20:50:26.637125] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:26.637497] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-30T20:50:26.640574] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-30T20:50:26.641905] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-30T20:50:26.641985] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-30T20:50:26.659473] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-30T20:50:27.046777] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:27.454361] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-30T20:50:28.211683] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T20:50:28.245773] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:50:28.257492] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-30T20:50:29.054380] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-30T20:50:29.415924] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:50:29.854378] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-30T20:50:30.602586] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T20:50:30.654403] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-30T20:50:30.922125] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T20:50:31.454343] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-30T20:50:31.548613] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:50:32.254469] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-30T20:50:32.254403] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T20:50:33.054395] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-30T20:50:33.311455] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T20:50:33.854330] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-30T20:50:33.938172] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T20:50:34.654427] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-30T20:50:35.272012] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T20:50:35.433222] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T20:50:35.454314] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-30T20:50:36.254367] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-30T20:50:36.925834] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T20:50:37.053505] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T20:50:37.056880] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-30T20:50:37.854335] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-30T20:50:38.119621] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T20:50:38.124077] [INFO ] [REMOTE ] RFL: Full fetch complete (12926 records). [2025-09-30T20:50:38.124211] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-30T20:50:38.541759] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-30T20:50:38.541841] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-30T20:50:38.542163] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-30T20:50:38.542206] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-30T20:50:38.542794] [DEBUG] [LOCAL ] RFL: Trimmed 12926 records to 11125 (keeping 200 days of data) [2025-09-30T20:50:38.611849] [DEBUG] [LOCAL ] RFL: Primary data saved (11125 records). [2025-09-30T20:50:38.612016] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-30T20:50:38.612109] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFL took 38.7s. Estimated remaining: 1h 13m 49s. Rate: 7.8 symbols/min [2025-09-30T20:50:38.659720] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-30T20:50:38.800585] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:38.805176] [DEBUG] [LOCAL ] RGT: Loaded 2805 existing records from primary storage. [2025-09-30T20:50:38.805328] [INFO ] [MAIN ] RGT: Loaded 2805 existing records. [2025-09-30T20:50:39.057054] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:39.057670] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-30T20:50:39.057809] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-30T20:50:39.058068] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-30T20:50:39.058127] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-30T20:50:39.391506] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T20:50:39.457390] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-30T20:50:39.484397] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:39.769199] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T20:50:40.254369] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-30T20:50:40.264486] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T20:50:40.912157] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T20:50:41.054414] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-30T20:50:41.854377] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-30T20:50:42.218844] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T20:50:42.457713] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T20:50:42.654380] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-30T20:50:43.153614] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T20:50:43.454403] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-30T20:50:44.254390] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-30T20:50:44.497953] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T20:50:45.054378] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-30T20:50:45.130837] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T20:50:45.134006] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12776 records). [2025-09-30T20:50:45.134136] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-30T20:50:45.516199] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-30T20:50:45.516281] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-30T20:50:45.516577] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-30T20:50:45.516618] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-30T20:50:45.517216] [DEBUG] [LOCAL ] RFMZ: Trimmed 12776 records to 8740 (keeping 200 days of data) [2025-09-30T20:50:45.575266] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8740 records). [2025-09-30T20:50:45.575419] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-30T20:50:45.575523] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFMZ took 32.8s. Estimated remaining: 1h 13m 41s. Rate: 7.8 symbols/min [2025-09-30T20:50:45.854532] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-30T20:50:46.093402] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:50:46.654395] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-30T20:50:46.988161] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T20:50:47.254358] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T20:50:47.454363] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-30T20:50:48.254381] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-30T20:50:48.820062] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T20:50:49.054419] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-30T20:50:49.316790] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T20:50:49.702543] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T20:50:49.854381] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-30T20:50:50.654419] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-30T20:50:51.231983] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T20:50:51.238791] [INFO ] [REMOTE ] RGA: Full fetch complete (45530 records). [2025-09-30T20:50:51.238906] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-30T20:50:51.461216] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-30T20:50:51.707218] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-30T20:50:51.707306] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-30T20:50:51.708196] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-30T20:50:51.708296] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-30T20:50:51.709333] [DEBUG] [LOCAL ] RGA: Trimmed 45530 records to 29726 (keeping 200 days of data) [2025-09-30T20:50:51.845507] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:50:51.941258] [DEBUG] [LOCAL ] RGA: Primary data saved (29726 records). [2025-09-30T20:50:51.941413] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-30T20:50:51.941514] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGA took 35.9s. Estimated remaining: 1h 13m 33s. Rate: 7.8 symbols/min [2025-09-30T20:50:52.154623] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T20:50:52.254378] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-30T20:50:52.862183] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T20:50:53.054442] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-30T20:50:53.854412] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-30T20:50:54.356435] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T20:50:54.365386] [INFO ] [REMOTE ] RGR: Full fetch complete (28700 records). [2025-09-30T20:50:54.365579] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-30T20:50:54.497177] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T20:50:54.662870] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-30T20:50:54.801587] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-30T20:50:54.801691] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-30T20:50:54.802316] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-30T20:50:54.802378] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-30T20:50:54.803157] [DEBUG] [LOCAL ] RGR: Trimmed 28700 records to 20604 (keeping 200 days of data) [2025-09-30T20:50:54.939765] [DEBUG] [LOCAL ] RGR: Primary data saved (20604 records). [2025-09-30T20:50:54.939894] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-30T20:50:54.939976] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGR took 28.7s. Estimated remaining: 1h 13m 24s. Rate: 7.8 symbols/min [2025-09-30T20:50:55.213899] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T20:50:55.454418] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-30T20:50:55.975871] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T20:50:55.977100] [INFO ] [REMOTE ] RGT: Full fetch complete (4140 records). [2025-09-30T20:50:55.977196] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-30T20:50:56.397876] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-30T20:50:56.397972] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-30T20:50:56.398122] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-30T20:50:56.398165] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-30T20:50:56.398606] [DEBUG] [LOCAL ] RGT: Trimmed 4140 records to 2785 (keeping 200 days of data) [2025-09-30T20:50:56.415927] [DEBUG] [LOCAL ] RGT: Primary data saved (2785 records). [2025-09-30T20:50:56.416102] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-30T20:50:56.416195] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RGT took 17.8s. Estimated remaining: 1h 13m 14s. Rate: 7.8 symbols/min [2025-09-30T20:50:57.146998] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:57.145679] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:57.176114] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:57.265407] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:50:57.265921] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-30T20:50:57.265988] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-30T20:50:57.266102] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-30T20:50:57.266147] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-30T20:50:57.266195] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-30T20:50:57.266235] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-30T20:50:57.517473] [DEBUG] [LOCAL ] RHP: Loaded 41395 existing records from primary storage. [2025-09-30T20:50:57.544935] [INFO ] [MAIN ] RHP: Loaded 41395 existing records. [2025-09-30T20:50:57.555033] [DEBUG] [LOCAL ] RH: Loaded 47622 existing records from primary storage. [2025-09-30T20:50:57.635211] [INFO ] [MAIN ] RH: Loaded 47622 existing records. [2025-09-30T20:50:57.852694] [DEBUG] [LOCAL ] RHI: Loaded 49231 existing records from primary storage. [2025-09-30T20:50:57.947922] [INFO ] [MAIN ] RHI: Loaded 49231 existing records. [2025-09-30T20:50:58.252041] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:58.362176] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:58.382284] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-30T20:50:58.366570] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-30T20:50:58.441890] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-30T20:50:58.449872] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:58.462735] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-30T20:50:58.462982] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-30T20:50:58.494494] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:50:58.494663] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-30T20:50:58.494765] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-30T20:50:58.495481] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-30T20:50:58.495748] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-30T20:50:58.501006] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-30T20:50:58.530985] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-30T20:50:58.530903] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-30T20:50:58.596414] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-30T20:50:58.746333] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:50:58.880785] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-30T20:50:58.943715] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:50:59.054556] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-30T20:50:59.176365] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:50:59.328626] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-30T20:50:59.416262] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-30T20:50:59.477776] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-30T20:50:59.478405] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-30T20:50:59.484030] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 3.1s. Estimated remaining: 1h 13m 5s. Rate: 7.8 symbols/min [2025-09-30T20:50:59.840353] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:59.854939] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:59.846558] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:50:59.855689] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-30T20:50:59.856029] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-30T20:50:59.855295] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-30T20:50:59.938430] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:00.002422] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-09-30T20:51:00.002798] [INFO ] [MAIN ] RIG: Loaded 53670 existing records. [2025-09-30T20:51:00.196325] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:00.196548] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-30T20:51:00.196597] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-30T20:51:00.197210] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-30T20:51:00.197271] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-30T20:51:00.578990] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:00.579369] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-30T20:51:01.535076] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T20:51:01.543178] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-30T20:51:01.621801] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T20:51:01.632354] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-30T20:51:01.720722] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T20:51:01.854413] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-30T20:51:02.235353] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:51:02.654401] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-30T20:51:03.112894] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:51:03.454753] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-30T20:51:03.459775] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T20:51:03.514436] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T20:51:04.254372] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-30T20:51:04.646519] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T20:51:05.042432] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T20:51:05.054317] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-30T20:51:05.854374] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-30T20:51:05.986780] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T20:51:06.654365] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-30T20:51:06.828320] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T20:51:07.413497] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T20:51:07.454380] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-30T20:51:08.111864] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T20:51:08.254372] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-30T20:51:09.054396] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-30T20:51:09.574441] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T20:51:09.854343] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-30T20:51:10.268754] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T20:51:10.654335] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-30T20:51:10.845353] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T20:51:11.422142] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T20:51:11.454347] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-30T20:51:12.254335] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-30T20:51:12.365842] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T20:51:12.999464] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T20:51:13.054352] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-30T20:51:13.854340] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-30T20:51:14.022861] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T20:51:14.654394] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-30T20:51:15.194678] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T20:51:15.454376] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-30T20:51:15.628930] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T20:51:16.254387] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-30T20:51:16.300764] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T20:51:17.054418] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-30T20:51:17.318346] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T20:51:17.487622] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T20:51:17.854363] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-30T20:51:18.654353] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-30T20:51:19.071512] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T20:51:19.454335] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-30T20:51:19.791288] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T20:51:20.065319] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T20:51:20.254365] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-30T20:51:21.054360] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-30T20:51:21.593732] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-30T20:51:21.854396] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-30T20:51:22.079466] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T20:51:22.271236] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T20:51:22.654418] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-30T20:51:23.454343] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-30T20:51:23.620399] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T20:51:24.254373] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-30T20:51:24.516550] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T20:51:25.054402] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-30T20:51:25.224826] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T20:51:25.751528] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T20:51:25.854384] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-30T20:51:26.639592] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T20:51:26.649688] [INFO ] [REMOTE ] RH: Full fetch complete (65771 records). [2025-09-30T20:51:26.649822] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-30T20:51:26.662594] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-30T20:51:27.086790] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-30T20:51:27.086890] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-30T20:51:27.088187] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-30T20:51:27.088431] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-30T20:51:27.090038] [DEBUG] [LOCAL ] RH: Trimmed 65771 records to 47576 (keeping 200 days of data) [2025-09-30T20:51:27.404373] [DEBUG] [LOCAL ] RH: Primary data saved (47576 records). [2025-09-30T20:51:27.404596] [INFO ] [MAIN ] RH: Full history saved. [2025-09-30T20:51:27.404779] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RH took 31.0s. Estimated remaining: 1h 13m 4s. Rate: 7.8 symbols/min [2025-09-30T20:51:27.456407] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-30T20:51:27.590713] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T20:51:27.685246] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:27.749266] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-30T20:51:27.749757] [INFO ] [MAIN ] RIO: Loaded 53394 existing records. [2025-09-30T20:51:27.984917] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:27.985119] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-30T20:51:27.985167] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-30T20:51:27.986113] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-30T20:51:27.986174] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-30T20:51:28.266959] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-30T20:51:28.361899] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:28.851413] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T20:51:28.865553] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-30T20:51:28.865776] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-30T20:51:29.065858] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-30T20:51:29.318934] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-30T20:51:29.319149] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-30T20:51:29.320276] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-30T20:51:29.320356] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-30T20:51:29.352376] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T20:51:29.362765] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53670 (keeping 200 days of data) [2025-09-30T20:51:29.364208] [INFO ] [REMOTE ] RHI: Full fetch complete (70001 records). [2025-09-30T20:51:29.364305] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-30T20:51:29.918501] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T20:51:30.026987] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-30T20:51:30.038506] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-30T20:51:30.070625] [INFO ] [REMOTE ] RHP: Full fetch complete (58015 records). [2025-09-30T20:51:30.069382] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-30T20:51:30.071469] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-30T20:51:30.071975] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-30T20:51:30.173745] [DEBUG] [LOCAL ] RHI: Trimmed 70001 records to 49260 (keeping 200 days of data) [2025-09-30T20:51:30.662233] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-30T20:51:30.663523] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-30T20:51:30.664999] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-30T20:51:30.665619] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-30T20:51:30.672416] [DEBUG] [LOCAL ] RHP: Trimmed 58015 records to 41313 (keeping 200 days of data) [2025-09-30T20:51:31.037155] [DEBUG] [LOCAL ] RIG: Primary data saved (53670 records). [2025-09-30T20:51:31.041184] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-30T20:51:31.043482] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RIG took 31.5s. Estimated remaining: 1h 12m 55s. Rate: 7.8 symbols/min [2025-09-30T20:51:31.377962] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:31.488118] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-30T20:51:31.504804] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-30T20:51:31.516485] [DEBUG] [LOCAL ] RHP: Primary data saved (41313 records). [2025-09-30T20:51:31.516622] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-30T20:51:31.517284] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHP took 35.1s. Estimated remaining: 1h 12m 45s. Rate: 7.8 symbols/min [2025-09-30T20:51:31.531233] [DEBUG] [LOCAL ] RHI: Primary data saved (49260 records). [2025-09-30T20:51:31.531541] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-30T20:51:31.531887] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RHI took 35.1s. Estimated remaining: 1h 12m 35s. Rate: 7.8 symbols/min [2025-09-30T20:51:31.896518] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:31.828834] [DEBUG] [LOCAL ] RITM: Loaded 52816 existing records from primary storage. [2025-09-30T20:51:31.910007] [INFO ] [MAIN ] RITM: Loaded 52816 existing records. [2025-09-30T20:51:32.043200] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:32.200695] [DEBUG] [LOCAL ] RIV: Loaded 12068 existing records from primary storage. [2025-09-30T20:51:32.200140] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:32.201423] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-30T20:51:32.201552] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-30T20:51:32.201051] [INFO ] [MAIN ] RIV: Loaded 12068 existing records. [2025-09-30T20:51:32.213598] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-30T20:51:32.235927] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-30T20:51:32.416849] [DEBUG] [LOCAL ] RJF: Loaded 47030 existing records from primary storage. [2025-09-30T20:51:32.438277] [INFO ] [MAIN ] RJF: Loaded 47030 existing records. [2025-09-30T20:51:32.595569] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:32.606166] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-30T20:51:32.640388] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-30T20:51:32.684314] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-30T20:51:32.690999] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-30T20:51:33.058504] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:33.069319] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-30T20:51:33.101424] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-30T20:51:33.208368] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-30T20:51:33.290027] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-30T20:51:33.327819] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:33.380740] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-30T20:51:33.590757] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:33.607296] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-30T20:51:33.891431] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:33.891954] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-30T20:51:33.925902] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-30T20:51:33.938029] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-30T20:51:34.850275] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T20:51:34.854139] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-30T20:51:34.918757] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T20:51:34.929112] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-30T20:51:35.424830] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T20:51:35.454306] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-30T20:51:35.501113] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:51:35.818447] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T20:51:35.949904] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-30T20:51:36.254359] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-30T20:51:36.780891] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T20:51:36.913332] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T20:51:37.054382] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-30T20:51:37.854413] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-30T20:51:37.908143] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T20:51:38.498193] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:51:38.654385] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-30T20:51:39.454365] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-30T20:51:40.254377] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-30T20:51:40.363755] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T20:51:40.607611] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T20:51:41.054336] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-30T20:51:41.160796] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T20:51:41.854359] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-30T20:51:42.654339] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-30T20:51:42.726111] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T20:51:42.944043] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T20:51:43.454387] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-30T20:51:44.097410] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T20:51:44.254387] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-30T20:51:44.640266] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T20:51:44.707753] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T20:51:45.054363] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-30T20:51:45.854376] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-30T20:51:46.625618] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T20:51:46.656616] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-30T20:51:46.660522] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T20:51:47.454392] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-30T20:51:47.624097] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T20:51:48.254375] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-30T20:51:49.054347] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-30T20:51:49.465382] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T20:51:49.854375] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-30T20:51:49.975217] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T20:51:50.236788] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T20:51:50.462938] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T20:51:50.654397] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-30T20:51:51.454377] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-30T20:51:51.550631] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:51:52.254551] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-30T20:51:53.054328] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-30T20:51:53.186437] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:51:53.199386] [INFO ] [REMOTE ] RJF: Full fetch complete (68068 records). [2025-09-30T20:51:53.199561] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-30T20:51:53.202372] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:51:53.202502] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:51:53.202595] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:51:53.202704] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-30T20:51:53.202795] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-09-30T20:51:53.202854] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-09-30T20:51:53.203481] [DEBUG] [LOCAL ] RJF: Deleted derivative data file. [2025-09-30T20:51:53.203713] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RJF took 21.7s. Estimated remaining: 1h 12m 32s. Rate: 7.8 symbols/min [2025-09-30T20:51:53.424579] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:53.459782] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T20:51:53.522393] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-30T20:51:53.522837] [INFO ] [MAIN ] RKT: Loaded 53721 existing records. [2025-09-30T20:51:53.739892] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:53.740251] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-30T20:51:53.740338] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-30T20:51:53.741141] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-30T20:51:53.741237] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-30T20:51:53.857567] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-30T20:51:54.149490] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:51:54.654378] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-30T20:51:54.884601] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T20:51:54.969064] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T20:51:55.454453] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-30T20:51:56.254413] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-30T20:51:56.519617] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T20:51:56.998822] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T20:51:57.054368] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-30T20:51:57.854377] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-30T20:51:58.448924] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-30T20:51:58.634346] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T20:51:58.639793] [INFO ] [REMOTE ] RIV: Full fetch complete (17520 records). [2025-09-30T20:51:58.640052] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-30T20:51:58.662718] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-30T20:51:59.048609] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-30T20:51:59.048753] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-30T20:51:59.049234] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-30T20:51:59.049401] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-30T20:51:59.050237] [DEBUG] [LOCAL ] RIV: Trimmed 17520 records to 12159 (keeping 200 days of data) [2025-09-30T20:51:59.149000] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T20:51:59.175728] [DEBUG] [LOCAL ] RIV: Primary data saved (12159 records). [2025-09-30T20:51:59.175884] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-30T20:51:59.176043] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 27.6s. Estimated remaining: 1h 12m 23s. Rate: 7.8 symbols/min [2025-09-30T20:51:59.361355] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:51:59.411750] [DEBUG] [LOCAL ] RL: Loaded 41166 existing records from primary storage. [2025-09-30T20:51:59.412083] [INFO ] [MAIN ] RL: Loaded 41166 existing records. [2025-09-30T20:51:59.459534] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-30T20:51:59.614160] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:51:59.614515] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-30T20:51:59.614583] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-30T20:51:59.615178] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-30T20:51:59.615240] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-30T20:51:59.984902] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:00.254400] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-30T20:52:00.588600] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T20:52:01.059456] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-30T20:52:01.076819] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T20:52:01.854375] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-30T20:52:02.251140] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T20:52:02.654367] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-30T20:52:03.113165] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T20:52:03.125297] [INFO ] [REMOTE ] RIO: Full fetch complete (77353 records). [2025-09-30T20:52:03.125433] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-30T20:52:03.459590] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-30T20:52:03.557347] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-30T20:52:03.557440] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-30T20:52:03.558751] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-30T20:52:03.558844] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-30T20:52:03.560547] [DEBUG] [LOCAL ] RIO: Trimmed 77353 records to 53394 (keeping 200 days of data) [2025-09-30T20:52:03.924383] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T20:52:03.944121] [INFO ] [REMOTE ] RITM: Full fetch complete (76566 records). [2025-09-30T20:52:03.948901] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-30T20:52:03.953182] [DEBUG] [LOCAL ] RIO: Primary data saved (53394 records). [2025-09-30T20:52:03.953537] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-30T20:52:03.953692] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RIO took 36.5s. Estimated remaining: 1h 12m 15s. Rate: 7.8 symbols/min [2025-09-30T20:52:04.335518] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:04.622728] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-30T20:52:04.649558] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-30T20:52:04.651078] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-30T20:52:04.662925] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-30T20:52:04.680269] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T20:52:04.691573] [DEBUG] [LOCAL ] RLI: Loaded 33377 existing records from primary storage. [2025-09-30T20:52:04.693391] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T20:52:04.703951] [INFO ] [MAIN ] RLI: Loaded 33377 existing records. [2025-09-30T20:52:04.703602] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-30T20:52:04.788585] [DEBUG] [LOCAL ] RITM: Trimmed 76566 records to 52825 (keeping 200 days of data) [2025-09-30T20:52:05.009752] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:05.015458] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-30T20:52:05.016104] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-30T20:52:05.024159] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-30T20:52:05.024926] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-30T20:52:05.066594] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-30T20:52:05.565232] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:05.683664] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T20:52:05.714876] [DEBUG] [LOCAL ] RITM: Primary data saved (52825 records). [2025-09-30T20:52:05.715009] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-30T20:52:05.715127] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RITM took 34.7s. Estimated remaining: 1h 12m 5s. Rate: 7.8 symbols/min [2025-09-30T20:52:05.863905] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-30T20:52:05.900223] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:05.949408] [DEBUG] [LOCAL ] RLJ: Loaded 48129 existing records from primary storage. [2025-09-30T20:52:05.949770] [INFO ] [MAIN ] RLJ: Loaded 48129 existing records. [2025-09-30T20:52:06.140373] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:06.140611] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-30T20:52:06.140689] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-30T20:52:06.142059] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-30T20:52:06.142121] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-30T20:52:06.523942] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:06.654334] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-30T20:52:07.020528] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:52:07.203024] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T20:52:07.263963] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T20:52:07.454364] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-30T20:52:08.254327] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-30T20:52:08.305197] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:52:09.054394] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-30T20:52:09.854373] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-30T20:52:10.515256] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-30T20:52:10.633199] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T20:52:10.654374] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-30T20:52:11.309086] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T20:52:11.454363] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-30T20:52:12.040799] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T20:52:12.254376] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-30T20:52:12.461225] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T20:52:13.054363] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-30T20:52:13.854331] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-30T20:52:13.888293] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T20:52:14.654337] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-30T20:52:14.714250] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T20:52:15.379786] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T20:52:15.454387] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-30T20:52:16.254341] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-30T20:52:16.310413] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T20:52:16.743790] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T20:52:16.889007] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T20:52:17.054385] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-30T20:52:17.854373] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-30T20:52:18.654364] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-30T20:52:19.449176] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T20:52:19.454443] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-30T20:52:19.482700] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-30T20:52:20.254362] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-30T20:52:20.297995] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T20:52:20.490124] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T20:52:21.054355] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-30T20:52:21.557072] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:52:21.854327] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-30T20:52:21.884711] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T20:52:22.654401] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-30T20:52:22.756546] [DEBUG] [REMOTE ] RKT: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-30T20:52:22.756918] [WARN ] [REMOTE ] RKT: No data returned for month 2025-08 [2025-09-30T20:52:22.757043] [FATAL] [REMOTE ] RKT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:52:22.757150] [FATAL] [MAIN ] RKT: Failed to fetch primary data. [2025-09-30T20:52:22.757225] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:52:22.757300] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-30T20:52:22.757366] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-09-30T20:52:22.757405] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-09-30T20:52:22.757880] [DEBUG] [LOCAL ] RKT: Deleted derivative data file. [2025-09-30T20:52:22.757988] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RKT took 29.6s. Estimated remaining: 1h 12m 0s. Rate: 7.8 symbols/min [2025-09-30T20:52:22.950026] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:22.963822] [DEBUG] [LOCAL ] RLTY: Loaded 11119 existing records from primary storage. [2025-09-30T20:52:22.964076] [INFO ] [MAIN ] RLTY: Loaded 11119 existing records. [2025-09-30T20:52:23.175459] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:23.175931] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-30T20:52:23.176068] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-30T20:52:23.176483] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-30T20:52:23.176546] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-30T20:52:23.458717] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-30T20:52:23.505871] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T20:52:23.631063] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:24.254356] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-30T20:52:24.438250] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T20:52:25.054426] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-30T20:52:25.854334] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-30T20:52:25.884555] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:52:25.893121] [INFO ] [REMOTE ] RL: Full fetch complete (59609 records). [2025-09-30T20:52:25.893296] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-30T20:52:25.894180] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:52:25.894295] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:52:25.894340] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:52:25.894410] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-30T20:52:25.894481] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-09-30T20:52:25.894520] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-09-30T20:52:25.895067] [DEBUG] [LOCAL ] RL: Deleted derivative data file. [2025-09-30T20:52:25.895176] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 26.7s. Estimated remaining: 1h 11m 51s. Rate: 7.8 symbols/min [2025-09-30T20:52:26.099198] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:26.131563] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T20:52:26.182855] [DEBUG] [LOCAL ] RLX: Loaded 48326 existing records from primary storage. [2025-09-30T20:52:26.183212] [INFO ] [MAIN ] RLX: Loaded 48326 existing records. [2025-09-30T20:52:26.372027] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:26.372242] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-30T20:52:26.372290] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-30T20:52:26.373842] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-30T20:52:26.373908] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-30T20:52:26.657575] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-30T20:52:26.772184] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T20:52:26.801892] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:27.454403] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-30T20:52:28.254366] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-30T20:52:28.401269] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T20:52:29.054345] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-30T20:52:29.226209] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T20:52:29.270162] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T20:52:29.854396] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-30T20:52:30.335227] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T20:52:30.654382] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-30T20:52:31.329591] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:52:31.454370] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-30T20:52:32.254324] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-30T20:52:32.337336] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T20:52:32.501390] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T20:52:33.054389] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-30T20:52:33.842213] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T20:52:33.854308] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-30T20:52:34.654412] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-30T20:52:34.809439] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T20:52:35.219325] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T20:52:35.454359] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-30T20:52:36.178399] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T20:52:36.186313] [INFO ] [REMOTE ] RLI: Full fetch complete (46718 records). [2025-09-30T20:52:36.186462] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-30T20:52:36.262324] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-30T20:52:36.582739] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-30T20:52:36.582884] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-30T20:52:36.583752] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-30T20:52:36.583849] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-30T20:52:36.585025] [DEBUG] [LOCAL ] RLI: Trimmed 46718 records to 33400 (keeping 200 days of data) [2025-09-30T20:52:36.817966] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T20:52:36.843161] [DEBUG] [LOCAL ] RLI: Primary data saved (33400 records). [2025-09-30T20:52:36.843430] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-30T20:52:36.843765] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLI took 32.9s. Estimated remaining: 1h 11m 45s. Rate: 7.8 symbols/min [2025-09-30T20:52:36.924937] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T20:52:37.048335] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:37.054448] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-30T20:52:37.058829] [DEBUG] [LOCAL ] RM: Loaded 7558 existing records from primary storage. [2025-09-30T20:52:37.060341] [INFO ] [MAIN ] RM: Loaded 7558 existing records. [2025-09-30T20:52:37.251483] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:37.251784] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-30T20:52:37.251835] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-30T20:52:37.252179] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-30T20:52:37.252253] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-30T20:52:37.671599] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:37.854338] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-30T20:52:38.092761] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T20:52:38.654393] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-30T20:52:39.454362] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-30T20:52:39.626971] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T20:52:40.011720] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T20:52:40.022453] [INFO ] [REMOTE ] RLJ: Full fetch complete (69181 records). [2025-09-30T20:52:40.022634] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-30T20:52:40.264370] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-30T20:52:40.370413] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T20:52:40.463010] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-30T20:52:40.463193] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-30T20:52:40.464958] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-30T20:52:40.465033] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-30T20:52:40.467306] [DEBUG] [LOCAL ] RLJ: Trimmed 69181 records to 48102 (keeping 200 days of data) [2025-09-30T20:52:40.771306] [DEBUG] [LOCAL ] RLJ: Primary data saved (48102 records). [2025-09-30T20:52:40.771722] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-30T20:52:40.771836] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 35.1s. Estimated remaining: 1h 11m 36s. Rate: 7.8 symbols/min [2025-09-30T20:52:40.954925] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:40.976300] [DEBUG] [LOCAL ] RMAX: Loaded 21510 existing records from primary storage. [2025-09-30T20:52:40.976564] [INFO ] [MAIN ] RMAX: Loaded 21510 existing records. [2025-09-30T20:52:41.059583] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-30T20:52:41.171130] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:41.171392] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-30T20:52:41.171440] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-30T20:52:41.172358] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-30T20:52:41.172420] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-30T20:52:41.561424] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:41.854365] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-30T20:52:41.884251] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T20:52:42.126568] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T20:52:42.654404] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-30T20:52:42.929980] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T20:52:43.196349] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-30T20:52:43.454410] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-30T20:52:44.254354] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-30T20:52:44.326713] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T20:52:45.054375] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-30T20:52:45.703706] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:52:45.852757] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T20:52:45.861805] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-30T20:52:46.654332] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-30T20:52:46.790383] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:52:47.454420] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-30T20:52:48.046839] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T20:52:48.254453] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-30T20:52:48.379858] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:52:48.384929] [INFO ] [REMOTE ] RLTY: Full fetch complete (18075 records). [2025-09-30T20:52:48.385095] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-30T20:52:48.875734] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-30T20:52:48.875863] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-30T20:52:48.876454] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-30T20:52:48.876521] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-30T20:52:48.877306] [DEBUG] [LOCAL ] RLTY: Trimmed 18075 records to 11138 (keeping 200 days of data) [2025-09-30T20:52:48.962945] [DEBUG] [LOCAL ] RLTY: Primary data saved (11138 records). [2025-09-30T20:52:48.963098] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-30T20:52:48.963252] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLTY took 26.2s. Estimated remaining: 1h 11m 28s. Rate: 7.8 symbols/min [2025-09-30T20:52:49.059492] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-30T20:52:49.160224] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:52:49.212110] [DEBUG] [LOCAL ] RMD: Loaded 42059 existing records from primary storage. [2025-09-30T20:52:49.212463] [INFO ] [MAIN ] RMD: Loaded 42059 existing records. [2025-09-30T20:52:49.394163] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T20:52:49.434112] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:52:49.438772] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-30T20:52:49.438826] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-30T20:52:49.439860] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-30T20:52:49.439923] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-30T20:52:49.768702] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T20:52:49.859725] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-30T20:52:49.863711] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:52:50.654335] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-30T20:52:51.454429] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-30T20:52:51.468670] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T20:52:51.659546] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T20:52:52.254354] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-30T20:52:52.277970] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T20:52:53.054349] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-30T20:52:53.088109] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:52:53.854389] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-30T20:52:53.870352] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:52:54.654386] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-30T20:52:55.454335] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-30T20:52:55.506980] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T20:52:55.636501] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T20:52:56.254326] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-30T20:52:56.290968] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T20:52:57.025144] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T20:52:57.054380] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-30T20:52:57.844576] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T20:52:57.854296] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-30T20:52:58.651117] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T20:52:58.654296] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-30T20:52:59.454390] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-30T20:52:59.493462] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T20:52:59.495879] [INFO ] [REMOTE ] RM: Full fetch complete (11590 records). [2025-09-30T20:52:59.495962] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-30T20:52:59.888402] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-30T20:52:59.888596] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-30T20:52:59.888936] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-30T20:52:59.889044] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-30T20:52:59.889540] [DEBUG] [LOCAL ] RM: Trimmed 11590 records to 7611 (keeping 200 days of data) [2025-09-30T20:52:59.939080] [DEBUG] [LOCAL ] RM: Primary data saved (7611 records). [2025-09-30T20:52:59.939225] [INFO ] [MAIN ] RM: Full history saved. [2025-09-30T20:52:59.939316] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 23.1s. Estimated remaining: 1h 11m 21s. Rate: 7.8 symbols/min [2025-09-30T20:53:00.122329] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:00.150495] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T20:53:00.162870] [DEBUG] [LOCAL ] RMI: Loaded 4681 existing records from primary storage. [2025-09-30T20:53:00.163554] [INFO ] [MAIN ] RMI: Loaded 4681 existing records. [2025-09-30T20:53:00.259477] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-30T20:53:00.355211] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:00.355470] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-30T20:53:00.355523] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-30T20:53:00.355849] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-30T20:53:00.355911] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-30T20:53:00.738914] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:01.054361] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-30T20:53:01.491767] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T20:53:01.854339] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-30T20:53:01.932566] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:53:02.654366] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-30T20:53:02.969944] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T20:53:03.454361] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-30T20:53:03.545902] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T20:53:04.254328] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-30T20:53:04.547782] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T20:53:05.054374] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-30T20:53:05.116025] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T20:53:05.854402] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-30T20:53:06.218518] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T20:53:06.654377] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-30T20:53:07.454358] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-30T20:53:07.598312] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T20:53:07.610005] [INFO ] [REMOTE ] RLX: Full fetch complete (70341 records). [2025-09-30T20:53:07.610166] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-30T20:53:07.801960] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T20:53:08.064473] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-30T20:53:08.064721] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-30T20:53:08.065941] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-30T20:53:08.066012] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-30T20:53:08.067679] [DEBUG] [LOCAL ] RLX: Trimmed 70341 records to 48332 (keeping 200 days of data) [2025-09-30T20:53:08.257955] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-30T20:53:08.329017] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T20:53:08.404013] [DEBUG] [LOCAL ] RLX: Primary data saved (48332 records). [2025-09-30T20:53:08.404157] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-30T20:53:08.404245] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RLX took 42.5s. Estimated remaining: 1h 11m 14s. Rate: 7.8 symbols/min [2025-09-30T20:53:08.590046] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:08.602530] [DEBUG] [LOCAL ] RMM: Loaded 10536 existing records from primary storage. [2025-09-30T20:53:08.602787] [INFO ] [MAIN ] RMM: Loaded 10536 existing records. [2025-09-30T20:53:08.789387] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:08.789598] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-30T20:53:08.789667] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-30T20:53:08.790074] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-30T20:53:08.790135] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-30T20:53:09.063223] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-30T20:53:09.180875] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:09.664403] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T20:53:09.854348] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-30T20:53:10.088766] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T20:53:10.654331] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-30T20:53:10.942515] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T20:53:10.947758] [INFO ] [REMOTE ] RMAX: Full fetch complete (29741 records). [2025-09-30T20:53:10.947874] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-30T20:53:11.234995] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T20:53:11.351042] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-30T20:53:11.351130] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-30T20:53:11.351838] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-30T20:53:11.351908] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-30T20:53:11.352725] [DEBUG] [LOCAL ] RMAX: Trimmed 29741 records to 21475 (keeping 200 days of data) [2025-09-30T20:53:11.456167] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-30T20:53:11.487332] [DEBUG] [LOCAL ] RMAX: Primary data saved (21475 records). [2025-09-30T20:53:11.487479] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-30T20:53:11.487575] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMAX took 30.7s. Estimated remaining: 1h 11m 5s. Rate: 7.8 symbols/min [2025-09-30T20:53:11.667308] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:11.674224] [DEBUG] [LOCAL ] RMMZ: Loaded 4827 existing records from primary storage. [2025-09-30T20:53:11.674427] [INFO ] [MAIN ] RMMZ: Loaded 4827 existing records. [2025-09-30T20:53:11.870990] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:11.871208] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-30T20:53:11.871256] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-30T20:53:11.871514] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-30T20:53:11.871586] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-30T20:53:12.072633] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T20:53:12.253331] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:12.254357] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-30T20:53:12.947161] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T20:53:13.054363] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-30T20:53:13.845023] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T20:53:13.854324] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-30T20:53:14.654332] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-30T20:53:14.737441] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T20:53:15.213748] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T20:53:15.454359] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-30T20:53:16.254334] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-30T20:53:16.357171] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T20:53:17.058815] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-30T20:53:17.059992] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T20:53:17.854374] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-30T20:53:17.890414] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T20:53:17.899552] [INFO ] [REMOTE ] RMD: Full fetch complete (60862 records). [2025-09-30T20:53:17.899722] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-30T20:53:17.903021] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:53:17.903114] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:53:17.903159] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:53:17.903260] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-30T20:53:17.903345] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-09-30T20:53:17.903384] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-09-30T20:53:17.903883] [DEBUG] [LOCAL ] RMD: Deleted derivative data file. [2025-09-30T20:53:17.903986] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMD took 28.9s. Estimated remaining: 1h 10m 57s. Rate: 7.8 symbols/min [2025-09-30T20:53:18.091749] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:18.110455] [DEBUG] [LOCAL ] RMT: Loaded 17362 existing records from primary storage. [2025-09-30T20:53:18.110778] [INFO ] [MAIN ] RMT: Loaded 17362 existing records. [2025-09-30T20:53:18.302746] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:18.302953] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-30T20:53:18.302999] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-30T20:53:18.303450] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-30T20:53:18.303509] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-30T20:53:18.606957] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T20:53:18.669623] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-30T20:53:18.716773] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:19.454338] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-30T20:53:19.456685] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T20:53:20.083030] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T20:53:20.254436] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-30T20:53:21.054401] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-30T20:53:21.639010] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T20:53:21.854332] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-30T20:53:21.861205] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T20:53:22.407354] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T20:53:22.654353] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-30T20:53:23.280987] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T20:53:23.454371] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-30T20:53:24.104452] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T20:53:24.254402] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-30T20:53:25.054384] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-30T20:53:25.118277] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T20:53:25.740537] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T20:53:25.854360] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-30T20:53:26.655197] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-30T20:53:26.657086] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T20:53:27.410051] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T20:53:27.454369] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-30T20:53:28.074362] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T20:53:28.254366] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-30T20:53:28.950344] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T20:53:29.054379] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-30T20:53:29.716667] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T20:53:29.854404] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-30T20:53:30.618543] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T20:53:30.654326] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-30T20:53:31.265209] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-30T20:53:31.266757] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7102 records). [2025-09-30T20:53:31.266829] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-30T20:53:31.460792] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-30T20:53:31.657190] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-30T20:53:31.657279] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-30T20:53:31.657489] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-30T20:53:31.657529] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-30T20:53:31.658014] [DEBUG] [LOCAL ] RMMZ: Trimmed 7102 records to 4812 (keeping 200 days of data) [2025-09-30T20:53:31.688585] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4812 records). [2025-09-30T20:53:31.688728] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-30T20:53:31.688820] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMMZ took 20.2s. Estimated remaining: 1h 10m 51s. Rate: 7.8 symbols/min [2025-09-30T20:53:31.871637] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:31.921408] [DEBUG] [LOCAL ] RNG: Loaded 48025 existing records from primary storage. [2025-09-30T20:53:31.921782] [INFO ] [MAIN ] RNG: Loaded 48025 existing records. [2025-09-30T20:53:32.119630] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:32.120203] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-30T20:53:32.120313] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-30T20:53:32.121393] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-30T20:53:32.121455] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-30T20:53:32.242897] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T20:53:32.255807] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-30T20:53:32.266943] [INFO ] [REMOTE ] RMI: Full fetch complete (6319 records). [2025-09-30T20:53:32.293920] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-30T20:53:32.762035] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:32.967425] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-30T20:53:32.967511] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-30T20:53:32.967762] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-30T20:53:32.967826] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-30T20:53:32.968238] [DEBUG] [LOCAL ] RMI: Trimmed 6319 records to 4698 (keeping 200 days of data) [2025-09-30T20:53:32.999442] [DEBUG] [LOCAL ] RMI: Primary data saved (4698 records). [2025-09-30T20:53:32.999538] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-30T20:53:32.999621] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMI took 33.1s. Estimated remaining: 1h 10m 41s. Rate: 7.8 symbols/min [2025-09-30T20:53:33.065043] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-30T20:53:33.194008] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:33.215833] [DEBUG] [LOCAL ] RNGR: Loaded 20343 existing records from primary storage. [2025-09-30T20:53:33.216089] [INFO ] [MAIN ] RNGR: Loaded 20343 existing records. [2025-09-30T20:53:33.421693] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:33.423031] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T20:53:33.426358] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-30T20:53:33.426861] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-30T20:53:33.427583] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-30T20:53:33.427678] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-30T20:53:33.835170] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:33.854327] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-30T20:53:34.219096] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:53:34.654399] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-30T20:53:34.679772] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T20:53:35.144891] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T20:53:35.454371] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-30T20:53:36.254382] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-30T20:53:37.054376] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-30T20:53:37.117413] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T20:53:37.158564] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T20:53:37.705267] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T20:53:37.854367] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-30T20:53:38.654338] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-30T20:53:38.934799] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T20:53:39.454381] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-30T20:53:39.973586] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T20:53:40.254428] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-30T20:53:40.577780] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T20:53:41.054424] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-30T20:53:41.109416] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:53:41.854382] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-30T20:53:42.221053] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T20:53:42.654402] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-30T20:53:42.989209] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T20:53:43.458407] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-30T20:53:43.462124] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T20:53:44.254365] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-30T20:53:45.054326] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-30T20:53:45.153053] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T20:53:45.493901] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T20:53:45.785377] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T20:53:45.854356] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-30T20:53:46.547874] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T20:53:46.654405] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-30T20:53:47.454354] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-30T20:53:47.769258] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T20:53:48.254364] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-30T20:53:48.706636] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T20:53:48.947104] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T20:53:48.951148] [INFO ] [REMOTE ] RMM: Full fetch complete (15072 records). [2025-09-30T20:53:48.951281] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-30T20:53:49.059582] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-30T20:53:49.355745] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-30T20:53:49.355829] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-30T20:53:49.356207] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-30T20:53:49.356249] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-30T20:53:49.356871] [DEBUG] [LOCAL ] RMM: Trimmed 15072 records to 10526 (keeping 200 days of data) [2025-09-30T20:53:49.429678] [DEBUG] [LOCAL ] RMM: Primary data saved (10526 records). [2025-09-30T20:53:49.429866] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-30T20:53:49.429949] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMM took 41.0s. Estimated remaining: 1h 10m 36s. Rate: 7.8 symbols/min [2025-09-30T20:53:49.616279] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:49.616852] [DEBUG] [LOCAL ] RNP: No existing data file found in primary storage. [2025-09-30T20:53:49.616911] [WARN ] [MAIN ] RNP: No existing data found, performing full refresh instead. [2025-09-30T20:53:49.617076] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-30T20:53:49.617153] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-30T20:53:49.617232] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-09-30T20:53:49.617281] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-30T20:53:49.859898] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-30T20:53:50.015428] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:50.268895] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T20:53:50.654393] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-30T20:53:51.110730] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T20:53:51.454381] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-30T20:53:52.254401] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-30T20:53:52.469681] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T20:53:52.605684] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T20:53:53.054353] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-30T20:53:53.649907] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:53:53.854377] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-30T20:53:54.064273] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T20:53:54.654382] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-30T20:53:54.780624] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T20:53:55.454398] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-30T20:53:55.569723] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T20:53:55.573664] [INFO ] [REMOTE ] RMT: Full fetch complete (25483 records). [2025-09-30T20:53:55.573783] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-30T20:53:55.990440] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-30T20:53:55.990564] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-30T20:53:55.991300] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-30T20:53:55.991365] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-30T20:53:55.992131] [DEBUG] [LOCAL ] RMT: Trimmed 25483 records to 17334 (keeping 200 days of data) [2025-09-30T20:53:56.109202] [DEBUG] [LOCAL ] RMT: Primary data saved (17334 records). [2025-09-30T20:53:56.109343] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-30T20:53:56.109438] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 38.2s. Estimated remaining: 1h 10m 28s. Rate: 7.8 symbols/min [2025-09-30T20:53:56.269197] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-30T20:53:56.303994] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:56.340659] [DEBUG] [LOCAL ] RNR: Loaded 33947 existing records from primary storage. [2025-09-30T20:53:56.340999] [INFO ] [MAIN ] RNR: Loaded 33947 existing records. [2025-09-30T20:53:56.548490] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:56.548780] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-30T20:53:56.548939] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-30T20:53:56.550501] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-30T20:53:56.550565] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-30T20:53:56.698227] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T20:53:56.970061] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:53:57.054351] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-30T20:53:57.854357] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-30T20:53:57.993308] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T20:53:58.654333] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-30T20:53:58.683782] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T20:53:58.951555] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T20:53:58.956194] [INFO ] [REMOTE ] RNGR: Full fetch complete (28237 records). [2025-09-30T20:53:58.956295] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-30T20:53:59.359447] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-30T20:53:59.359530] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-30T20:53:59.360132] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-30T20:53:59.360194] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-30T20:53:59.361052] [DEBUG] [LOCAL ] RNGR: Trimmed 28237 records to 20354 (keeping 200 days of data) [2025-09-30T20:53:59.454381] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-30T20:53:59.498281] [DEBUG] [LOCAL ] RNGR: Primary data saved (20354 records). [2025-09-30T20:53:59.498420] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-30T20:53:59.498511] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNGR took 26.5s. Estimated remaining: 1h 10m 19s. Rate: 7.8 symbols/min [2025-09-30T20:53:59.658887] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T20:53:59.715063] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:53:59.755362] [DEBUG] [LOCAL ] RNST: Loaded 37044 existing records from primary storage. [2025-09-30T20:53:59.755800] [INFO ] [MAIN ] RNST: Loaded 37044 existing records. [2025-09-30T20:53:59.948590] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:53:59.948923] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-30T20:53:59.948981] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-30T20:53:59.949690] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-30T20:53:59.949756] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-30T20:54:00.262344] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-30T20:54:00.373074] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:01.054393] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-30T20:54:01.243625] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T20:54:01.738845] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T20:54:01.854401] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-30T20:54:02.143263] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T20:54:02.654370] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-30T20:54:03.250180] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T20:54:03.454360] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-30T20:54:03.887815] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T20:54:04.254388] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-30T20:54:05.054334] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-30T20:54:05.080383] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T20:54:05.747002] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T20:54:05.854393] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-30T20:54:06.230670] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:54:06.654394] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-30T20:54:06.844899] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T20:54:07.454362] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-30T20:54:08.168862] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T20:54:08.254355] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-30T20:54:08.856576] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T20:54:09.054370] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-30T20:54:09.773464] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T20:54:09.854378] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-30T20:54:10.237409] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T20:54:10.654386] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-30T20:54:11.374364] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T20:54:11.393750] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T20:54:11.454327] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-30T20:54:12.254380] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-30T20:54:12.514831] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T20:54:13.054388] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-30T20:54:13.435728] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:54:13.854376] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-30T20:54:14.471548] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T20:54:14.654342] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-30T20:54:14.893335] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T20:54:15.454325] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-30T20:54:16.254366] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-30T20:54:16.461874] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T20:54:17.012079] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T20:54:17.015851] [INFO ] [REMOTE ] RNP: Full fetch complete (23435 records). [2025-09-30T20:54:17.015973] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-30T20:54:17.065233] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-30T20:54:17.244252] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T20:54:17.467817] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-30T20:54:17.467934] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-30T20:54:17.468448] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-30T20:54:17.468520] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-30T20:54:17.469229] [DEBUG] [LOCAL ] RNP: Trimmed 23435 records to 15706 (keeping 200 days of data) [2025-09-30T20:54:17.573913] [DEBUG] [LOCAL ] RNP: Primary data saved (15706 records). [2025-09-30T20:54:17.574098] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-30T20:54:17.574220] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNP took 28.1s. Estimated remaining: 1h 10m 15s. Rate: 7.8 symbols/min [2025-09-30T20:54:17.753688] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:17.778953] [DEBUG] [LOCAL ] ROG: Loaded 23095 existing records from primary storage. [2025-09-30T20:54:17.779230] [INFO ] [MAIN ] ROG: Loaded 23095 existing records. [2025-09-30T20:54:17.860859] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-30T20:54:17.980930] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:17.981218] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-30T20:54:17.981281] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-30T20:54:17.981597] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-30T20:54:17.981719] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-30T20:54:18.394918] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:18.418718] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T20:54:18.654348] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-30T20:54:19.454397] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-30T20:54:19.741055] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T20:54:19.931930] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T20:54:20.254341] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-30T20:54:20.555819] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T20:54:21.054418] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-30T20:54:21.854369] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-30T20:54:22.000048] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T20:54:22.011008] [INFO ] [REMOTE ] RNG: Full fetch complete (69426 records). [2025-09-30T20:54:22.011286] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-30T20:54:22.484722] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-30T20:54:22.484960] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-30T20:54:22.486469] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-30T20:54:22.508033] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-30T20:54:22.510322] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T20:54:22.520415] [DEBUG] [LOCAL ] RNG: Trimmed 69426 records to 48009 (keeping 200 days of data) [2025-09-30T20:54:22.701218] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-30T20:54:22.827606] [DEBUG] [LOCAL ] RNG: Primary data saved (48009 records). [2025-09-30T20:54:22.827783] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-30T20:54:22.827933] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNG took 51.1s. Estimated remaining: 1h 10m 6s. Rate: 7.8 symbols/min [2025-09-30T20:54:23.025692] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:23.072906] [DEBUG] [LOCAL ] ROK: Loaded 43765 existing records from primary storage. [2025-09-30T20:54:23.073272] [INFO ] [MAIN ] ROK: Loaded 43765 existing records. [2025-09-30T20:54:23.280473] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T20:54:23.311363] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:23.312167] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-30T20:54:23.312257] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-30T20:54:23.313353] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-30T20:54:23.313459] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-30T20:54:23.459759] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-30T20:54:23.728808] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:23.755190] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T20:54:24.254414] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-30T20:54:24.390606] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T20:54:25.054361] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-30T20:54:25.113035] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T20:54:25.854361] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-30T20:54:26.170278] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T20:54:26.654395] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-30T20:54:26.902400] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T20:54:26.909208] [INFO ] [REMOTE ] RNR: Full fetch complete (51119 records). [2025-09-30T20:54:26.909354] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-30T20:54:27.335126] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-30T20:54:27.335245] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-30T20:54:27.336222] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-30T20:54:27.336312] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-30T20:54:27.337624] [DEBUG] [LOCAL ] RNR: Trimmed 51119 records to 33936 (keeping 200 days of data) [2025-09-30T20:54:27.454530] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-30T20:54:27.578784] [DEBUG] [LOCAL ] RNR: Primary data saved (33936 records). [2025-09-30T20:54:27.578945] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-30T20:54:27.579085] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 31.5s. Estimated remaining: 1h 9m 58s. Rate: 7.8 symbols/min [2025-09-30T20:54:27.762942] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:27.812846] [DEBUG] [LOCAL ] ROL: Loaded 50261 existing records from primary storage. [2025-09-30T20:54:27.813190] [INFO ] [MAIN ] ROL: Loaded 50261 existing records. [2025-09-30T20:54:28.021844] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:28.022911] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-30T20:54:28.023020] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-30T20:54:28.024308] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-30T20:54:28.024380] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-30T20:54:28.174141] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T20:54:28.225331] [INFO ] [REMOTE ] RNST: Full fetch complete (53104 records). [2025-09-30T20:54:28.248773] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-30T20:54:28.263889] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-30T20:54:28.649399] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:28.894986] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T20:54:28.937884] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-30T20:54:28.938461] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-30T20:54:28.939762] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-30T20:54:28.940244] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-30T20:54:28.941518] [DEBUG] [LOCAL ] RNST: Trimmed 53104 records to 37066 (keeping 200 days of data) [2025-09-30T20:54:29.054531] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-30T20:54:29.186500] [DEBUG] [LOCAL ] RNST: Primary data saved (37066 records). [2025-09-30T20:54:29.186671] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-30T20:54:29.186790] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. RNST took 29.7s. Estimated remaining: 1h 9m 48s. Rate: 7.8 symbols/min [2025-09-30T20:54:29.380755] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:29.428741] [DEBUG] [LOCAL ] RPM: Loaded 41277 existing records from primary storage. [2025-09-30T20:54:29.429146] [INFO ] [MAIN ] RPM: Loaded 41277 existing records. [2025-09-30T20:54:29.640548] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:29.642389] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T20:54:29.649007] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-30T20:54:29.649530] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-30T20:54:29.650949] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-30T20:54:29.651024] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-30T20:54:29.834198] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T20:54:29.855684] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-30T20:54:30.089023] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:30.654387] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-30T20:54:31.424291] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T20:54:31.454353] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-30T20:54:31.498171] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T20:54:32.254400] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-30T20:54:32.829368] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T20:54:33.063263] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-30T20:54:33.083296] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T20:54:33.854388] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-30T20:54:34.654368] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-30T20:54:34.772452] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T20:54:34.845868] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T20:54:35.465150] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-30T20:54:35.470559] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T20:54:36.254374] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-30T20:54:36.719764] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T20:54:37.054330] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-30T20:54:37.148637] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T20:54:37.854329] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-30T20:54:38.092447] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T20:54:38.654363] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-30T20:54:39.454406] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-30T20:54:39.543020] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T20:54:39.885721] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T20:54:40.254360] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-30T20:54:40.322598] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T20:54:41.054369] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-30T20:54:41.159152] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T20:54:41.854382] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-30T20:54:42.590569] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T20:54:42.654375] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-30T20:54:42.708118] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T20:54:43.454414] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-30T20:54:44.254374] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-30T20:54:44.325399] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T20:54:44.615744] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T20:54:45.054341] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-30T20:54:45.120796] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T20:54:45.854399] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-30T20:54:45.986927] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T20:54:46.579726] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T20:54:46.654374] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-30T20:54:47.454354] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-30T20:54:47.564571] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T20:54:48.254358] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-30T20:54:48.582499] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T20:54:49.066124] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-30T20:54:49.071806] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T20:54:49.854425] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-30T20:54:50.007401] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T20:54:50.654382] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-30T20:54:51.453511] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T20:54:51.462952] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-30T20:54:51.588187] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T20:54:52.077818] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-30T20:54:52.082296] [INFO ] [REMOTE ] ROG: Full fetch complete (30737 records). [2025-09-30T20:54:52.082410] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-30T20:54:52.265035] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-30T20:54:52.540629] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-30T20:54:52.540752] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-30T20:54:52.541503] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-30T20:54:52.541550] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-30T20:54:52.542409] [DEBUG] [LOCAL ] ROG: Trimmed 30737 records to 22976 (keeping 200 days of data) [2025-09-30T20:54:52.697288] [DEBUG] [LOCAL ] ROG: Primary data saved (22976 records). [2025-09-30T20:54:52.697440] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-30T20:54:52.697531] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROG took 35.1s. Estimated remaining: 1h 9m 45s. Rate: 7.8 symbols/min [2025-09-30T20:54:52.893328] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:52.914846] [DEBUG] [LOCAL ] RPT: Loaded 19317 existing records from primary storage. [2025-09-30T20:54:52.915159] [INFO ] [MAIN ] RPT: Loaded 19317 existing records. [2025-09-30T20:54:53.069227] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-30T20:54:53.116341] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:53.116818] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-30T20:54:53.116962] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-30T20:54:53.117622] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-30T20:54:53.117722] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-30T20:54:53.452022] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T20:54:53.548743] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:53.854361] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-30T20:54:54.310340] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T20:54:54.654388] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-30T20:54:54.726011] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:54:54.737148] [INFO ] [REMOTE ] ROL: Full fetch complete (72358 records). [2025-09-30T20:54:54.737333] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-30T20:54:54.738341] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:54:54.738449] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:54:54.738496] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:54:54.738565] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-30T20:54:54.738633] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-09-30T20:54:54.738709] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-09-30T20:54:54.739282] [DEBUG] [LOCAL ] ROL: Deleted derivative data file. [2025-09-30T20:54:54.739399] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROL took 27.2s. Estimated remaining: 1h 9m 36s. Rate: 7.8 symbols/min [2025-09-30T20:54:54.917541] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:54.949778] [DEBUG] [LOCAL ] RQI: Loaded 29133 existing records from primary storage. [2025-09-30T20:54:54.950055] [INFO ] [MAIN ] RQI: Loaded 29133 existing records. [2025-09-30T20:54:55.141914] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:55.142145] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-30T20:54:55.142193] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-30T20:54:55.142998] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-30T20:54:55.143058] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-30T20:54:55.459523] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-30T20:54:55.526435] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:55.775737] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T20:54:56.254364] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-30T20:54:57.013184] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T20:54:57.022619] [INFO ] [REMOTE ] RPM: Full fetch complete (59136 records). [2025-09-30T20:54:57.022789] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-30T20:54:57.058491] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-30T20:54:57.478237] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T20:54:57.478696] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-30T20:54:57.483860] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-30T20:54:57.485400] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-30T20:54:57.485504] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-30T20:54:57.487192] [DEBUG] [LOCAL ] RPM: Trimmed 59136 records to 41394 (keeping 200 days of data) [2025-09-30T20:54:57.766761] [DEBUG] [LOCAL ] RPM: Primary data saved (41394 records). [2025-09-30T20:54:57.766915] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-30T20:54:57.767013] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. RPM took 28.6s. Estimated remaining: 1h 9m 27s. Rate: 7.8 symbols/min [2025-09-30T20:54:57.859486] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-30T20:54:57.964093] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:58.018005] [DEBUG] [LOCAL ] RRC: Loaded 52775 existing records from primary storage. [2025-09-30T20:54:58.018389] [INFO ] [MAIN ] RRC: Loaded 52775 existing records. [2025-09-30T20:54:58.211325] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:58.211622] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-30T20:54:58.211721] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-30T20:54:58.212925] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-30T20:54:58.212990] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-30T20:54:58.641745] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:54:58.647040] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T20:54:58.654564] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-30T20:54:58.792264] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T20:54:58.800869] [INFO ] [REMOTE ] ROK: Full fetch complete (62946 records). [2025-09-30T20:54:58.801020] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-30T20:54:58.801701] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:54:58.801805] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:54:58.801850] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:54:58.801890] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-30T20:54:58.801950] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-09-30T20:54:58.801986] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-09-30T20:54:58.802400] [DEBUG] [LOCAL ] ROK: Deleted derivative data file. [2025-09-30T20:54:58.802498] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. ROK took 36.0s. Estimated remaining: 1h 9m 17s. Rate: 7.8 symbols/min [2025-09-30T20:54:58.982921] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:54:59.026969] [DEBUG] [LOCAL ] RRX: Loaded 41073 existing records from primary storage. [2025-09-30T20:54:59.027288] [INFO ] [MAIN ] RRX: Loaded 41073 existing records. [2025-09-30T20:54:59.211853] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:54:59.212087] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-30T20:54:59.212135] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-30T20:54:59.213112] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-30T20:54:59.213175] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-30T20:54:59.461473] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-30T20:54:59.633781] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:00.079057] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T20:55:00.222032] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T20:55:00.254317] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-30T20:55:01.054354] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-30T20:55:01.335290] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T20:55:01.854430] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-30T20:55:02.412056] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T20:55:02.654356] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-30T20:55:03.068888] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T20:55:03.454396] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-30T20:55:04.254363] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-30T20:55:04.279851] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T20:55:04.925284] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T20:55:05.054341] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-30T20:55:05.178391] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T20:55:05.854369] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-30T20:55:06.548701] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T20:55:06.654367] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-30T20:55:07.302346] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T20:55:07.328605] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T20:55:07.454366] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-30T20:55:08.254357] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-30T20:55:08.752200] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:55:09.054338] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-30T20:55:09.188245] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T20:55:09.854341] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-30T20:55:10.401068] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T20:55:10.537817] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T20:55:10.654363] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-30T20:55:11.454359] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-30T20:55:11.709639] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T20:55:12.254359] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-30T20:55:13.054321] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-30T20:55:13.089551] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T20:55:13.245175] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T20:55:13.249314] [INFO ] [REMOTE ] RPT: Full fetch complete (28513 records). [2025-09-30T20:55:13.249435] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-30T20:55:13.680832] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-30T20:55:13.680922] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-30T20:55:13.681618] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-30T20:55:13.681709] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-30T20:55:13.682871] [DEBUG] [LOCAL ] RPT: Trimmed 28513 records to 19160 (keeping 200 days of data) [2025-09-30T20:55:13.801942] [DEBUG] [LOCAL ] RPT: Primary data saved (19160 records). [2025-09-30T20:55:13.802091] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-30T20:55:13.802181] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPT took 21.1s. Estimated remaining: 1h 9m 11s. Rate: 7.8 symbols/min [2025-09-30T20:55:13.859501] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-30T20:55:14.026944] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:55:14.053550] [DEBUG] [LOCAL ] RS: Loaded 25466 existing records from primary storage. [2025-09-30T20:55:14.053857] [INFO ] [MAIN ] RS: Loaded 25466 existing records. [2025-09-30T20:55:14.255117] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:55:14.255363] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-30T20:55:14.255466] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-30T20:55:14.256180] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-30T20:55:14.256244] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-30T20:55:14.655335] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-30T20:55:14.681971] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:14.853863] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T20:55:15.454355] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-30T20:55:15.697124] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T20:55:15.748522] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T20:55:16.254387] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-30T20:55:16.941854] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T20:55:17.054421] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-30T20:55:17.708011] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T20:55:17.854391] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-30T20:55:18.489298] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T20:55:18.654399] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-30T20:55:19.278928] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T20:55:19.454399] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-30T20:55:19.802940] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T20:55:20.254389] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-30T20:55:20.931971] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T20:55:20.939898] [INFO ] [REMOTE ] RQI: Full fetch complete (43383 records). [2025-09-30T20:55:20.940046] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-30T20:55:21.059477] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-30T20:55:21.357123] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-30T20:55:21.357233] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-30T20:55:21.358189] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-30T20:55:21.358260] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-30T20:55:21.359474] [DEBUG] [LOCAL ] RQI: Trimmed 43383 records to 29124 (keeping 200 days of data) [2025-09-30T20:55:21.556393] [DEBUG] [LOCAL ] RQI: Primary data saved (29124 records). [2025-09-30T20:55:21.556570] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-30T20:55:21.556734] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 26.8s. Estimated remaining: 1h 9m 4s. Rate: 7.8 symbols/min [2025-09-30T20:55:21.802191] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:55:21.810024] [DEBUG] [LOCAL ] RSF: Loaded 4180 existing records from primary storage. [2025-09-30T20:55:21.810286] [INFO ] [MAIN ] RSF: Loaded 4180 existing records. [2025-09-30T20:55:21.863381] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-30T20:55:21.966003] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T20:55:22.052863] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:55:22.053101] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-30T20:55:22.053151] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-30T20:55:22.053524] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-30T20:55:22.053591] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-30T20:55:22.447092] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:22.654336] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-30T20:55:22.707664] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T20:55:23.454415] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-30T20:55:23.740130] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T20:55:24.169180] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T20:55:24.254395] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-30T20:55:25.054401] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-30T20:55:25.172296] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T20:55:25.847377] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T20:55:25.854302] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-30T20:55:26.654334] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-30T20:55:26.984613] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T20:55:27.018309] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T20:55:27.454380] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-30T20:55:28.263516] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-30T20:55:28.269375] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T20:55:29.042303] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T20:55:29.054593] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-30T20:55:29.536235] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T20:55:29.854379] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-30T20:55:30.654331] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-30T20:55:30.758039] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T20:55:31.136407] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T20:55:31.145469] [INFO ] [REMOTE ] RRX: Full fetch complete (58179 records). [2025-09-30T20:55:31.145606] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-30T20:55:31.275927] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T20:55:31.459567] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-30T20:55:31.589455] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-30T20:55:31.589551] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-30T20:55:31.590676] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-30T20:55:31.590746] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-30T20:55:31.592297] [DEBUG] [LOCAL ] RRX: Trimmed 58179 records to 41071 (keeping 200 days of data) [2025-09-30T20:55:31.875170] [DEBUG] [LOCAL ] RRX: Primary data saved (41071 records). [2025-09-30T20:55:31.875305] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-30T20:55:31.875388] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRX took 33.1s. Estimated remaining: 1h 8m 57s. Rate: 7.8 symbols/min [2025-09-30T20:55:32.077501] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:55:32.125902] [DEBUG] [LOCAL ] RSG: Loaded 47404 existing records from primary storage. [2025-09-30T20:55:32.126289] [INFO ] [MAIN ] RSG: Loaded 47404 existing records. [2025-09-30T20:55:32.259493] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-30T20:55:32.333991] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:55:32.334279] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-30T20:55:32.334365] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-30T20:55:32.335474] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-30T20:55:32.335545] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-30T20:55:32.823982] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:33.054339] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-30T20:55:33.260778] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T20:55:33.559284] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T20:55:33.822623] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T20:55:33.854357] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-30T20:55:34.654384] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-30T20:55:34.780482] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T20:55:35.454403] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-30T20:55:35.501686] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T20:55:36.004798] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T20:55:36.254389] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-30T20:55:37.054381] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-30T20:55:37.121426] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T20:55:37.854402] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-30T20:55:38.654374] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-30T20:55:39.024692] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T20:55:39.087245] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T20:55:39.093158] [INFO ] [REMOTE ] RS: Full fetch complete (39459 records). [2025-09-30T20:55:39.093339] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-30T20:55:39.459261] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-30T20:55:39.530961] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-30T20:55:39.531175] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-30T20:55:39.532225] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-30T20:55:39.532354] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-30T20:55:39.534001] [DEBUG] [LOCAL ] RS: Trimmed 39459 records to 25380 (keeping 200 days of data) [2025-09-30T20:55:39.698932] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T20:55:39.757314] [DEBUG] [LOCAL ] RS: Primary data saved (25380 records). [2025-09-30T20:55:39.757471] [INFO ] [MAIN ] RS: Full history saved. [2025-09-30T20:55:39.757564] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 26.0s. Estimated remaining: 1h 8m 49s. Rate: 7.8 symbols/min [2025-09-30T20:55:39.947265] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:55:39.993704] [DEBUG] [LOCAL ] RSI: Loaded 46865 existing records from primary storage. [2025-09-30T20:55:39.994049] [INFO ] [MAIN ] RSI: Loaded 46865 existing records. [2025-09-30T20:55:40.100879] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T20:55:40.196661] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:55:40.196935] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-30T20:55:40.197000] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-30T20:55:40.198068] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-30T20:55:40.198140] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-30T20:55:40.264145] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-30T20:55:40.587974] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:41.054372] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-30T20:55:41.677018] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T20:55:41.854351] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-30T20:55:42.009287] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T20:55:42.654401] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-30T20:55:43.454390] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-30T20:55:43.623164] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T20:55:44.116767] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T20:55:44.129347] [INFO ] [REMOTE ] RRC: Full fetch complete (76341 records). [2025-09-30T20:55:44.129520] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-30T20:55:44.233972] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T20:55:44.259442] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-30T20:55:44.604627] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-30T20:55:44.604749] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-30T20:55:44.605810] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-30T20:55:44.605877] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-30T20:55:44.607442] [DEBUG] [LOCAL ] RRC: Trimmed 76341 records to 52785 (keeping 200 days of data) [2025-09-30T20:55:44.948505] [DEBUG] [LOCAL ] RRC: Primary data saved (52785 records). [2025-09-30T20:55:44.948673] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-30T20:55:44.948780] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRC took 47.2s. Estimated remaining: 1h 8m 41s. Rate: 7.8 symbols/min [2025-09-30T20:55:45.056118] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-30T20:55:45.132199] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:55:45.165919] [DEBUG] [LOCAL ] RSKD: Loaded 33624 existing records from primary storage. [2025-09-30T20:55:45.166255] [INFO ] [MAIN ] RSKD: Loaded 33624 existing records. [2025-09-30T20:55:45.370521] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:55:45.370844] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-30T20:55:45.370908] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-30T20:55:45.371628] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-30T20:55:45.371746] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-30T20:55:45.787913] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:55:45.789032] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T20:55:45.824897] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T20:55:45.854315] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-30T20:55:46.654364] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-30T20:55:47.331359] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T20:55:47.454379] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-30T20:55:47.611334] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T20:55:48.254356] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-30T20:55:48.844535] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T20:55:49.054339] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-30T20:55:49.102513] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:55:49.764837] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T20:55:49.854379] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-30T20:55:50.654380] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-30T20:55:51.264186] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-30T20:55:51.265413] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T20:55:51.267357] [INFO ] [REMOTE ] RSF: Full fetch complete (5598 records). [2025-09-30T20:55:51.273778] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-30T20:55:51.457925] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-30T20:55:51.703902] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-30T20:55:51.704057] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-30T20:55:51.704249] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-30T20:55:51.704293] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-30T20:55:51.704739] [DEBUG] [LOCAL ] RSF: Trimmed 5598 records to 4187 (keeping 200 days of data) [2025-09-30T20:55:51.732285] [DEBUG] [LOCAL ] RSF: Primary data saved (4187 records). [2025-09-30T20:55:51.732430] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-30T20:55:51.732551] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSF took 30.2s. Estimated remaining: 1h 8m 33s. Rate: 7.8 symbols/min [2025-09-30T20:55:52.254394] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-30T20:55:52.893184] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T20:55:53.054378] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-30T20:55:53.854429] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-30T20:55:53.994345] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T20:55:54.177268] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T20:55:54.360382] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T20:55:54.654401] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-30T20:55:55.454412] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-30T20:55:55.496784] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T20:55:56.254377] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-30T20:55:56.828188] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T20:55:57.054346] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-30T20:55:57.854395] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-30T20:55:58.016480] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T20:55:58.087180] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T20:55:58.654408] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-30T20:55:58.743278] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T20:55:59.454363] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-30T20:56:00.254380] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-30T20:56:00.356388] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T20:56:00.397451] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T20:56:01.054368] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-30T20:56:01.836791] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T20:56:01.854312] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-30T20:56:02.654353] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-30T20:56:02.730244] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T20:56:03.158617] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T20:56:03.300293] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T20:56:03.454373] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-30T20:56:04.254326] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-30T20:56:04.321550] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T20:56:04.331241] [INFO ] [REMOTE ] RSG: Full fetch complete (67616 records). [2025-09-30T20:56:04.331362] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-30T20:56:04.332040] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:56:04.332129] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:56:04.332172] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:56:04.332237] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-30T20:56:04.332301] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-09-30T20:56:04.332338] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-09-30T20:56:04.332965] [DEBUG] [LOCAL ] RSG: Deleted derivative data file. [2025-09-30T20:56:04.333060] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 32.5s. Estimated remaining: 1h 8m 26s. Rate: 7.8 symbols/min [2025-09-30T20:56:05.054374] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-30T20:56:05.796907] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T20:56:05.854386] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-30T20:56:06.748489] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T20:56:06.759415] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-30T20:56:07.180339] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T20:56:07.187418] [INFO ] [REMOTE ] RSKD: Full fetch complete (48191 records). [2025-09-30T20:56:07.187582] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-30T20:56:07.672455] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-30T20:56:07.672563] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-30T20:56:07.673821] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-30T20:56:07.673926] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-30T20:56:07.675381] [DEBUG] [LOCAL ] RSKD: Trimmed 48191 records to 33520 (keeping 200 days of data) [2025-09-30T20:56:07.935423] [DEBUG] [LOCAL ] RSKD: Primary data saved (33520 records). [2025-09-30T20:56:07.935594] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-30T20:56:07.935710] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 23.0s. Estimated remaining: 1h 8m 18s. Rate: 7.8 symbols/min [2025-09-30T20:56:08.492067] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T20:56:08.503864] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-30T20:56:10.175379] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T20:56:10.185973] [INFO ] [REMOTE ] RSI: Full fetch complete (69348 records). [2025-09-30T20:56:10.186126] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-30T20:56:10.610397] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-30T20:56:10.610491] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-30T20:56:10.611668] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-30T20:56:10.611751] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-30T20:56:10.613234] [DEBUG] [LOCAL ] RSI: Trimmed 69348 records to 46868 (keeping 200 days of data) [2025-09-30T20:56:10.898424] [DEBUG] [LOCAL ] RSI: Primary data saved (46868 records). [2025-09-30T20:56:10.898602] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-30T20:56:10.898734] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 31.1s. Estimated remaining: 1h 8m 8s. Rate: 7.8 symbols/min [2025-09-30T20:56:11.464995] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:11.677363] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:11.651196] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:11.715904] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:11.732169] [DEBUG] [LOCAL ] RVT: Loaded 26812 existing records from primary storage. [2025-09-30T20:56:11.732880] [INFO ] [MAIN ] RVT: Loaded 26812 existing records. [2025-09-30T20:56:11.996956] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:12.013244] [DEBUG] [LOCAL ] RTO: Loaded 40007 existing records from primary storage. [2025-09-30T20:56:12.014967] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-30T20:56:12.031861] [INFO ] [MAIN ] RTO: Loaded 40007 existing records. [2025-09-30T20:56:12.037275] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-30T20:56:12.045709] [DEBUG] [LOCAL ] RVLV: Loaded 47658 existing records from primary storage. [2025-09-30T20:56:12.058468] [INFO ] [MAIN ] RVLV: Loaded 47658 existing records. [2025-09-30T20:56:12.058225] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-30T20:56:12.079800] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-30T20:56:12.289073] [DEBUG] [LOCAL ] RTX: Loaded 53708 existing records from primary storage. [2025-09-30T20:56:12.325365] [INFO ] [MAIN ] RTX: Loaded 53708 existing records. [2025-09-30T20:56:12.702736] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:12.724707] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-30T20:56:12.767238] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-30T20:56:12.741680] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:12.814744] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-30T20:56:12.830875] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-30T20:56:12.893234] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-30T20:56:12.893099] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-30T20:56:12.939722] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-30T20:56:12.968912] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-30T20:56:13.011227] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:13.065836] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-30T20:56:13.092010] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-30T20:56:13.221155] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-30T20:56:13.279669] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-30T20:56:13.475557] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:13.540954] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-30T20:56:14.156963] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:14.196726] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-30T20:56:14.342451] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:14.363806] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-30T20:56:14.441421] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:14.441870] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-30T20:56:15.294668] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T20:56:15.306515] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-30T20:56:15.331909] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T20:56:15.340626] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-30T20:56:15.367246] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T20:56:15.374073] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-30T20:56:15.791618] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T20:56:15.801464] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-30T20:56:16.210058] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T20:56:16.221299] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-30T20:56:16.642508] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T20:56:16.649592] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-30T20:56:16.803695] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T20:56:16.813361] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-30T20:56:17.045638] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T20:56:17.056585] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-30T20:56:17.289066] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T20:56:17.559285] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T20:56:17.854374] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-30T20:56:18.264361] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T20:56:18.380466] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T20:56:18.654408] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-30T20:56:19.268713] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T20:56:19.454348] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-30T20:56:20.254339] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-30T20:56:20.450308] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:56:20.832843] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T20:56:21.054408] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-30T20:56:21.633165] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T20:56:21.854413] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-30T20:56:21.975443] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T20:56:22.654363] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-30T20:56:23.454370] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-30T20:56:23.556419] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T20:56:23.598543] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T20:56:24.254942] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-30T20:56:24.381632] [DEBUG] [REMOTE ] RVLV: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T20:56:24.382082] [WARN ] [REMOTE ] RVLV: No data returned for month 2025-04 [2025-09-30T20:56:24.382198] [FATAL] [REMOTE ] RVLV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:56:24.382311] [FATAL] [MAIN ] RVLV: Failed to fetch primary data. [2025-09-30T20:56:24.382378] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:56:24.382454] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-30T20:56:24.382522] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-09-30T20:56:24.382560] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-09-30T20:56:24.382927] [DEBUG] [LOCAL ] RVLV: Deleted derivative data file. [2025-09-30T20:56:24.383049] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVLV took 13.5s. Estimated remaining: 1h 8m 2s. Rate: 7.8 symbols/min [2025-09-30T20:56:24.563806] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:24.620833] [DEBUG] [LOCAL ] RVTY: Loaded 47459 existing records from primary storage. [2025-09-30T20:56:24.621199] [INFO ] [MAIN ] RVTY: Loaded 47459 existing records. [2025-09-30T20:56:24.858017] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T20:56:24.863109] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:24.869717] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-30T20:56:24.869789] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-30T20:56:24.870965] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-30T20:56:24.871078] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-30T20:56:25.056049] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-30T20:56:25.293936] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:25.854388] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-30T20:56:26.137397] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T20:56:26.654405] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-30T20:56:27.161637] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T20:56:27.454398] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-30T20:56:27.904151] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T20:56:28.254397] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-30T20:56:28.652297] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T20:56:29.054333] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-30T20:56:29.083004] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T20:56:29.854374] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-30T20:56:30.304697] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T20:56:30.311323] [INFO ] [REMOTE ] RVT: Full fetch complete (39871 records). [2025-09-30T20:56:30.311459] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-30T20:56:30.656375] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-30T20:56:30.751245] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-30T20:56:30.751388] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-30T20:56:30.752456] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-30T20:56:30.752556] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-30T20:56:30.753930] [DEBUG] [LOCAL ] RVT: Trimmed 39871 records to 26728 (keeping 200 days of data) [2025-09-30T20:56:30.910452] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T20:56:30.984761] [DEBUG] [LOCAL ] RVT: Primary data saved (26728 records). [2025-09-30T20:56:30.984908] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-30T20:56:30.985053] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVT took 20.1s. Estimated remaining: 1h 7m 54s. Rate: 7.8 symbols/min [2025-09-30T20:56:31.175336] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:31.215914] [DEBUG] [LOCAL ] RWT: Loaded 40791 existing records from primary storage. [2025-09-30T20:56:31.216334] [INFO ] [MAIN ] RWT: Loaded 40791 existing records. [2025-09-30T20:56:31.421849] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:56:31.422073] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-30T20:56:31.422122] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-30T20:56:31.423113] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-30T20:56:31.423179] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-30T20:56:31.455481] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-30T20:56:31.857375] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:31.859702] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T20:56:32.254336] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-30T20:56:32.446050] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T20:56:33.054375] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-30T20:56:33.447094] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T20:56:33.854370] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-30T20:56:34.439353] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T20:56:34.654387] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-30T20:56:34.875319] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T20:56:35.454394] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-30T20:56:36.169380] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T20:56:36.254416] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-30T20:56:36.304613] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T20:56:37.054406] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-30T20:56:37.179386] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T20:56:37.854364] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-30T20:56:38.654367] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-30T20:56:38.761971] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T20:56:39.374948] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:56:39.454396] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-30T20:56:39.539035] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T20:56:40.254356] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-30T20:56:40.964327] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T20:56:41.054374] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-30T20:56:41.422287] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T20:56:41.431541] [INFO ] [REMOTE ] RTO: Full fetch complete (58479 records). [2025-09-30T20:56:41.431764] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-30T20:56:41.864564] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-30T20:56:41.886945] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-30T20:56:41.888169] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-30T20:56:41.889322] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-30T20:56:41.889669] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-30T20:56:41.891342] [DEBUG] [LOCAL ] RTO: Trimmed 58479 records to 40020 (keeping 200 days of data) [2025-09-30T20:56:42.041678] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T20:56:42.205818] [DEBUG] [LOCAL ] RTO: Primary data saved (40020 records). [2025-09-30T20:56:42.205949] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-30T20:56:42.206032] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTO took 31.3s. Estimated remaining: 1h 7m 48s. Rate: 7.8 symbols/min [2025-09-30T20:56:42.394533] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:42.394940] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-30T20:56:42.395031] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-30T20:56:42.395231] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-30T20:56:42.395306] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-30T20:56:42.395378] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-30T20:56:42.395418] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-30T20:56:42.655484] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-30T20:56:42.782733] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:42.816354] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T20:56:43.454360] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-30T20:56:44.062378] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T20:56:44.145736] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T20:56:44.254322] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-30T20:56:45.054371] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-30T20:56:45.609753] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T20:56:45.854333] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-30T20:56:46.047592] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T20:56:46.355292] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-30T20:56:46.367219] [INFO ] [REMOTE ] RTX: Full fetch complete (77344 records). [2025-09-30T20:56:46.367434] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-30T20:56:46.368407] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:56:46.368521] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:56:46.368567] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:56:46.368611] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-30T20:56:46.368696] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-09-30T20:56:46.368781] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-09-30T20:56:46.369134] [DEBUG] [LOCAL ] RTX: Deleted derivative data file. [2025-09-30T20:56:46.369245] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RTX took 35.4s. Estimated remaining: 1h 7m 39s. Rate: 7.8 symbols/min [2025-09-30T20:56:46.559614] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:56:46.559926] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-30T20:56:46.559982] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-30T20:56:46.560143] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-30T20:56:46.560198] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-30T20:56:46.560244] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-30T20:56:46.560277] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-30T20:56:46.659440] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-30T20:56:46.996234] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:56:47.454355] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-30T20:56:47.947013] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T20:56:48.099474] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:56:48.254362] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-30T20:56:49.054381] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-30T20:56:49.533094] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T20:56:49.770539] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T20:56:49.854356] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-30T20:56:50.659447] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-30T20:56:50.675125] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T20:56:51.168498] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T20:56:51.454375] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-30T20:56:51.942255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T20:56:52.254391] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-30T20:56:53.054428] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-30T20:56:53.434679] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-30T20:56:53.854346] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-30T20:56:54.130818] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T20:56:54.224971] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-30T20:56:54.654366] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-30T20:56:55.454351] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-30T20:56:55.519006] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T20:56:55.750243] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-30T20:56:56.254403] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-30T20:56:56.616597] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T20:56:57.054367] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-30T20:56:57.854359] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-30T20:56:58.398556] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T20:56:58.654370] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-30T20:56:58.724499] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T20:56:59.303078] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T20:56:59.454403] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-30T20:57:00.118227] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T20:57:00.119372] [INFO ] [REMOTE ] RWTN: Full fetch complete (3126 records). [2025-09-30T20:57:00.119465] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-30T20:57:00.259443] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-30T20:57:00.320703] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T20:57:00.321085] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:57:00.321192] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:57:00.321291] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-30T20:57:00.321372] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-30T20:57:00.321424] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-30T20:57:00.321507] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-30T20:57:00.321613] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTN took 18.1s. Estimated remaining: 1h 7m 33s. Rate: 7.8 symbols/min [2025-09-30T20:57:00.506690] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:00.506880] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-30T20:57:00.506923] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-30T20:57:00.507041] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-30T20:57:00.507085] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-30T20:57:00.507128] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-30T20:57:00.507166] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-30T20:57:00.907447] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:01.054345] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-30T20:57:01.158359] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T20:57:01.172217] [INFO ] [REMOTE ] RVTY: Full fetch complete (66246 records). [2025-09-30T20:57:01.172398] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-30T20:57:01.173080] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T20:57:01.173166] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:57:01.173209] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:57:01.173266] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-30T20:57:01.173362] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-09-30T20:57:01.173421] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-09-30T20:57:01.173914] [DEBUG] [LOCAL ] RVTY: Deleted derivative data file. [2025-09-30T20:57:01.174042] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RVTY took 36.8s. Estimated remaining: 1h 7m 23s. Rate: 7.8 symbols/min [2025-09-30T20:57:01.375777] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:01.411033] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T20:57:01.430225] [DEBUG] [LOCAL ] RXO: Loaded 47788 existing records from primary storage. [2025-09-30T20:57:01.430556] [INFO ] [MAIN ] RXO: Loaded 47788 existing records. [2025-09-30T20:57:01.625814] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:01.626021] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-30T20:57:01.626070] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-30T20:57:01.627029] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-30T20:57:01.627091] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-30T20:57:01.859702] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-30T20:57:02.032139] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:02.423702] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T20:57:02.654343] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-30T20:57:03.454361] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-30T20:57:03.949284] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T20:57:04.022499] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T20:57:04.254367] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-30T20:57:05.054363] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-30T20:57:05.854329] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-30T20:57:06.041950] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T20:57:06.051780] [INFO ] [REMOTE ] RWT: Full fetch complete (58875 records). [2025-09-30T20:57:06.051949] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-30T20:57:06.404427] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T20:57:06.509362] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-30T20:57:06.509565] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-30T20:57:06.510552] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-30T20:57:06.510748] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-30T20:57:06.520382] [DEBUG] [LOCAL ] RWT: Trimmed 58875 records to 40864 (keeping 200 days of data) [2025-09-30T20:57:06.536717] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T20:57:06.654329] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-30T20:57:06.805126] [DEBUG] [LOCAL ] RWT: Primary data saved (40864 records). [2025-09-30T20:57:06.805268] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-30T20:57:06.805372] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWT took 35.8s. Estimated remaining: 1h 7m 15s. Rate: 7.8 symbols/min [2025-09-30T20:57:06.997612] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:07.046564] [DEBUG] [LOCAL ] RY: Loaded 47856 existing records from primary storage. [2025-09-30T20:57:07.046911] [INFO ] [MAIN ] RY: Loaded 47856 existing records. [2025-09-30T20:57:07.169796] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T20:57:07.257379] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:07.257593] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-30T20:57:07.257666] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-30T20:57:07.258909] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-30T20:57:07.258970] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-30T20:57:07.459500] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-30T20:57:07.650826] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:08.254376] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-30T20:57:09.054355] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-30T20:57:09.182724] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T20:57:09.333626] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T20:57:09.334042] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-30T20:57:09.334117] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:57:09.334158] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-30T20:57:09.334191] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:57:09.334228] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-30T20:57:09.334287] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-30T20:57:09.334323] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-30T20:57:09.334363] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-30T20:57:09.334409] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTP took 9.0s. Estimated remaining: 1h 7m 6s. Rate: 7.8 symbols/min [2025-09-30T20:57:09.536860] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:09.570362] [DEBUG] [LOCAL ] RYAM: Loaded 35124 existing records from primary storage. [2025-09-30T20:57:09.570680] [INFO ] [MAIN ] RYAM: Loaded 35124 existing records. [2025-09-30T20:57:09.775016] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:09.775443] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-30T20:57:09.775500] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-30T20:57:09.776325] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-30T20:57:09.776402] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-30T20:57:09.859457] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-30T20:57:10.165245] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T20:57:10.236509] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:10.654358] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-30T20:57:11.435371] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T20:57:11.454332] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-30T20:57:11.951383] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T20:57:12.254365] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-30T20:57:13.054320] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-30T20:57:13.158391] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T20:57:13.188198] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T20:57:13.854350] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-30T20:57:14.654333] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-30T20:57:14.692390] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:57:15.190801] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T20:57:15.319597] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T20:57:15.454398] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-30T20:57:16.254389] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-30T20:57:17.054380] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-30T20:57:17.237880] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T20:57:17.854364] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-30T20:57:17.928437] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T20:57:18.533537] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T20:57:18.654342] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-30T20:57:19.454397] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-30T20:57:19.728429] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T20:57:19.903160] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T20:57:20.254403] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-30T20:57:20.854789] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T20:57:21.054382] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-30T20:57:21.854370] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-30T20:57:21.969397] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T20:57:22.209285] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T20:57:22.654365] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-30T20:57:23.454397] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-30T20:57:23.511484] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T20:57:23.947492] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T20:57:24.254394] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-30T20:57:24.843372] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T20:57:24.921339] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T20:57:24.923038] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-30T20:57:24.923110] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-30T20:57:25.059488] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-30T20:57:25.119473] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T20:57:25.119680] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:57:25.119750] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:57:25.119821] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-30T20:57:25.119884] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-30T20:57:25.119920] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-30T20:57:25.119959] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-30T20:57:25.120015] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RWTO took 38.8s. Estimated remaining: 1h 7m 1s. Rate: 7.8 symbols/min [2025-09-30T20:57:25.306719] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:25.367770] [DEBUG] [LOCAL ] RYAN: Loaded 44405 existing records from primary storage. [2025-09-30T20:57:25.368187] [INFO ] [MAIN ] RYAN: Loaded 44405 existing records. [2025-09-30T20:57:25.556071] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:25.556306] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-30T20:57:25.556353] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-30T20:57:25.557238] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-30T20:57:25.557299] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-30T20:57:25.863638] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-30T20:57:25.954804] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:26.654446] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-30T20:57:26.882838] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T20:57:27.454440] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-30T20:57:27.588595] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T20:57:27.600395] [INFO ] [REMOTE ] RXO: Full fetch complete (68292 records). [2025-09-30T20:57:27.600664] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-30T20:57:28.171071] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-30T20:57:28.171326] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-30T20:57:28.172859] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-30T20:57:28.173094] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-30T20:57:28.175267] [DEBUG] [LOCAL ] RXO: Trimmed 68292 records to 47822 (keeping 200 days of data) [2025-09-30T20:57:28.262900] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-30T20:57:28.321772] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T20:57:28.569781] [DEBUG] [LOCAL ] RXO: Primary data saved (47822 records). [2025-09-30T20:57:28.569947] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-30T20:57:28.570041] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RXO took 27.4s. Estimated remaining: 1h 6m 52s. Rate: 7.8 symbols/min [2025-09-30T20:57:28.797776] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:28.820453] [DEBUG] [LOCAL ] RYI: Loaded 21503 existing records from primary storage. [2025-09-30T20:57:28.821041] [INFO ] [MAIN ] RYI: Loaded 21503 existing records. [2025-09-30T20:57:29.043130] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:29.051856] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-30T20:57:29.052533] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-30T20:57:29.053320] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T20:57:29.061071] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-30T20:57:29.063843] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-30T20:57:29.063995] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-30T20:57:29.468708] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:29.694597] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T20:57:29.854360] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-30T20:57:30.391151] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T20:57:30.654372] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-30T20:57:31.014497] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T20:57:31.454367] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-30T20:57:31.957086] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:57:32.254386] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-30T20:57:32.701694] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T20:57:33.054353] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-30T20:57:33.855687] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-30T20:57:33.858444] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T20:57:34.654398] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-30T20:57:34.733980] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T20:57:34.745309] [INFO ] [REMOTE ] RY: Full fetch complete (68652 records). [2025-09-30T20:57:34.745507] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-30T20:57:35.211615] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-30T20:57:35.211816] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-30T20:57:35.213051] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-30T20:57:35.213263] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-30T20:57:35.231614] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T20:57:35.238069] [DEBUG] [LOCAL ] RY: Trimmed 68652 records to 47856 (keeping 200 days of data) [2025-09-30T20:57:35.472742] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-30T20:57:35.571367] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T20:57:35.592499] [DEBUG] [LOCAL ] RY: Primary data saved (47856 records). [2025-09-30T20:57:35.592661] [INFO ] [MAIN ] RY: Full history saved. [2025-09-30T20:57:35.592778] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RY took 28.8s. Estimated remaining: 1h 6m 44s. Rate: 7.8 symbols/min [2025-09-30T20:57:35.770916] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:35.820717] [DEBUG] [LOCAL ] RYN: Loaded 45587 existing records from primary storage. [2025-09-30T20:57:35.821040] [INFO ] [MAIN ] RYN: Loaded 45587 existing records. [2025-09-30T20:57:36.016263] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:36.016546] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-30T20:57:36.016601] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-30T20:57:36.017795] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-30T20:57:36.017891] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-30T20:57:36.259494] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-30T20:57:36.411076] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:36.797234] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T20:57:37.054407] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-30T20:57:37.486058] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T20:57:37.854382] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-30T20:57:38.654331] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-30T20:57:38.685306] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T20:57:38.981131] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T20:57:39.454369] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-30T20:57:40.178437] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T20:57:40.254392] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-30T20:57:40.871067] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T20:57:41.054380] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-30T20:57:41.454472] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T20:57:41.854372] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-30T20:57:42.654387] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-30T20:57:42.698160] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T20:57:43.213947] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T20:57:43.454326] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-30T20:57:43.606632] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:57:44.254400] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-30T20:57:45.054375] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-30T20:57:45.084972] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T20:57:45.854356] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-30T20:57:45.902530] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T20:57:46.244956] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T20:57:46.253372] [INFO ] [REMOTE ] RYAM: Full fetch complete (48958 records). [2025-09-30T20:57:46.253524] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-30T20:57:46.660140] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-30T20:57:46.674071] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-30T20:57:46.674140] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-30T20:57:46.675119] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-30T20:57:46.675293] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-30T20:57:46.676752] [DEBUG] [LOCAL ] RYAM: Trimmed 48958 records to 35067 (keeping 200 days of data) [2025-09-30T20:57:46.892857] [DEBUG] [LOCAL ] RYAM: Primary data saved (35067 records). [2025-09-30T20:57:46.893022] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-30T20:57:46.893132] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAM took 37.6s. Estimated remaining: 1h 6m 37s. Rate: 7.8 symbols/min [2025-09-30T20:57:47.083554] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:47.091058] [DEBUG] [LOCAL ] RZB: Loaded 6216 existing records from primary storage. [2025-09-30T20:57:47.091259] [INFO ] [MAIN ] RZB: Loaded 6216 existing records. [2025-09-30T20:57:47.288084] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:47.288283] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-30T20:57:47.288328] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-30T20:57:47.288606] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-30T20:57:47.288694] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-30T20:57:47.462077] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-30T20:57:47.691636] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:47.715127] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T20:57:47.828923] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T20:57:48.254394] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-30T20:57:49.054442] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-30T20:57:49.145320] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T20:57:49.475788] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T20:57:49.766719] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T20:57:49.854372] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-30T20:57:50.654362] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-30T20:57:51.454340] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-30T20:57:51.541560] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T20:57:52.254340] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-30T20:57:52.286704] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T20:57:52.597331] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T20:57:53.054335] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-30T20:57:53.854349] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-30T20:57:54.019183] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T20:57:54.142241] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T20:57:54.147914] [INFO ] [REMOTE ] RYI: Full fetch complete (32313 records). [2025-09-30T20:57:54.148036] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-30T20:57:54.580044] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-30T20:57:54.580124] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-30T20:57:54.580860] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-30T20:57:54.580923] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-30T20:57:54.582096] [DEBUG] [LOCAL ] RYI: Trimmed 32313 records to 21507 (keeping 200 days of data) [2025-09-30T20:57:54.671837] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-30T20:57:54.722742] [DEBUG] [LOCAL ] RYI: Primary data saved (21507 records). [2025-09-30T20:57:54.722887] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-30T20:57:54.722999] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 26.2s. Estimated remaining: 1h 6m 29s. Rate: 7.8 symbols/min [2025-09-30T20:57:54.967298] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:57:54.977844] [DEBUG] [LOCAL ] RZC: Loaded 6776 existing records from primary storage. [2025-09-30T20:57:54.978134] [INFO ] [MAIN ] RZC: Loaded 6776 existing records. [2025-09-30T20:57:55.242256] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:57:55.242831] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-30T20:57:55.242920] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-30T20:57:55.243612] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-30T20:57:55.243737] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-30T20:57:55.409326] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T20:57:55.425715] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T20:57:55.459496] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-30T20:57:55.786278] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:57:56.254393] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-30T20:57:56.921149] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T20:57:57.054337] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-30T20:57:57.241227] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T20:57:57.658892] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T20:57:57.854392] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-30T20:57:58.654377] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-30T20:57:58.740296] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T20:57:59.297620] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T20:57:59.454389] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-30T20:58:00.111750] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T20:58:00.254373] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-30T20:58:01.054360] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-30T20:58:01.730961] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T20:58:01.854336] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-30T20:58:01.975731] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T20:58:02.654346] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-30T20:58:02.962391] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:58:03.454376] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-30T20:58:04.095555] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T20:58:04.265530] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-30T20:58:04.271814] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T20:58:04.282167] [INFO ] [REMOTE ] RYN: Full fetch complete (64875 records). [2025-09-30T20:58:04.282321] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-30T20:58:04.688947] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-30T20:58:04.689035] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-30T20:58:04.690025] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-30T20:58:04.690146] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-30T20:58:04.691522] [DEBUG] [LOCAL ] RYN: Trimmed 64875 records to 45615 (keeping 200 days of data) [2025-09-30T20:58:04.788870] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T20:58:05.000360] [DEBUG] [LOCAL ] RYN: Primary data saved (45615 records). [2025-09-30T20:58:05.000493] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-30T20:58:05.000574] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYN took 29.4s. Estimated remaining: 1h 6m 22s. Rate: 7.8 symbols/min [2025-09-30T20:58:05.059453] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-30T20:58:05.188986] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:05.243220] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-09-30T20:58:05.243557] [INFO ] [MAIN ] S: Loaded 53535 existing records. [2025-09-30T20:58:05.460168] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:05.460517] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-30T20:58:05.460594] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-30T20:58:05.461672] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-30T20:58:05.461732] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-30T20:58:05.842892] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:05.854320] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-30T20:58:06.654322] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-30T20:58:06.936114] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T20:58:06.947563] [INFO ] [REMOTE ] RYAN: Full fetch complete (63818 records). [2025-09-30T20:58:06.947743] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-30T20:58:07.155903] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T20:58:07.387622] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-30T20:58:07.387744] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-30T20:58:07.388844] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-30T20:58:07.388912] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-30T20:58:07.390311] [DEBUG] [LOCAL ] RYAN: Trimmed 63818 records to 44426 (keeping 200 days of data) [2025-09-30T20:58:07.462072] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-30T20:58:07.692984] [DEBUG] [LOCAL ] RYAN: Primary data saved (44426 records). [2025-09-30T20:58:07.693133] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-30T20:58:07.693236] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RYAN took 42.6s. Estimated remaining: 1h 6m 13s. Rate: 7.8 symbols/min [2025-09-30T20:58:07.894315] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:07.938587] [DEBUG] [LOCAL ] SA: Loaded 43225 existing records from primary storage. [2025-09-30T20:58:07.938963] [INFO ] [MAIN ] SA: Loaded 43225 existing records. [2025-09-30T20:58:08.149544] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T20:58:08.149243] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:08.152565] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-30T20:58:08.152777] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-30T20:58:08.152279] [INFO ] [REMOTE ] RZB: Full fetch complete (8685 records). [2025-09-30T20:58:08.153182] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-30T20:58:08.159465] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-30T20:58:08.159569] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-30T20:58:08.263293] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-30T20:58:08.871671] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (3.02 seconds). [2025-09-30T20:58:09.029586] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:09.060517] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-30T20:58:09.060180] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-30T20:58:09.060721] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-30T20:58:09.061906] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-30T20:58:09.061979] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-30T20:58:09.062415] [DEBUG] [LOCAL ] RZB: Trimmed 8685 records to 6225 (keeping 200 days of data) [2025-09-30T20:58:09.103901] [DEBUG] [LOCAL ] RZB: Primary data saved (6225 records). [2025-09-30T20:58:09.104027] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-30T20:58:09.104122] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZB took 22.2s. Estimated remaining: 1h 6m 4s. Rate: 7.8 symbols/min [2025-09-30T20:58:09.207853] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T20:58:09.295448] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:09.305379] [DEBUG] [LOCAL ] SABA: Loaded 9189 existing records from primary storage. [2025-09-30T20:58:09.305639] [INFO ] [MAIN ] SABA: Loaded 9189 existing records. [2025-09-30T20:58:09.493983] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:09.494255] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-30T20:58:09.494362] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-30T20:58:09.494768] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-30T20:58:09.494830] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-30T20:58:09.865477] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-30T20:58:09.872514] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:10.516205] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T20:58:10.654394] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-30T20:58:10.674153] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T20:58:11.454417] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-30T20:58:12.056634] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T20:58:12.254389] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-30T20:58:12.787360] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-30T20:58:13.012330] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T20:58:13.054409] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-30T20:58:13.854384] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-30T20:58:14.605345] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T20:58:14.632818] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T20:58:14.654327] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-30T20:58:15.454409] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-30T20:58:16.254331] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-30T20:58:16.342085] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T20:58:17.054383] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-30T20:58:17.098090] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T20:58:17.285339] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T20:58:17.854396] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-30T20:58:17.884674] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T20:58:18.654367] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-30T20:58:19.454409] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-30T20:58:19.942815] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T20:58:20.136484] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T20:58:20.138295] [INFO ] [REMOTE ] RZC: Full fetch complete (9857 records). [2025-09-30T20:58:20.138370] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-30T20:58:20.259444] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-30T20:58:20.322765] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T20:58:20.570461] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-30T20:58:20.570551] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-30T20:58:20.570818] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-30T20:58:20.570889] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-30T20:58:20.571432] [DEBUG] [LOCAL ] RZC: Trimmed 9857 records to 6778 (keeping 200 days of data) [2025-09-30T20:58:20.615515] [DEBUG] [LOCAL ] RZC: Primary data saved (6778 records). [2025-09-30T20:58:20.615728] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-30T20:58:20.615881] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. RZC took 25.9s. Estimated remaining: 1h 5m 57s. Rate: 7.8 symbols/min [2025-09-30T20:58:20.800340] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:20.838804] [DEBUG] [LOCAL ] SAFE: Loaded 30266 existing records from primary storage. [2025-09-30T20:58:20.839078] [INFO ] [MAIN ] SAFE: Loaded 30266 existing records. [2025-09-30T20:58:21.030424] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:21.030774] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-30T20:58:21.030845] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-30T20:58:21.032182] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-30T20:58:21.032257] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-30T20:58:21.062837] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-30T20:58:21.425604] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:21.854372] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-30T20:58:22.021637] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T20:58:22.654375] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-30T20:58:22.745748] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T20:58:22.969552] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T20:58:23.454386] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-30T20:58:24.248471] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T20:58:24.257920] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-30T20:58:25.054402] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-30T20:58:25.138016] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T20:58:25.562171] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T20:58:25.854405] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-30T20:58:26.358928] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T20:58:26.654414] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-30T20:58:26.906892] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T20:58:27.454360] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-30T20:58:28.254327] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-30T20:58:28.761448] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-30T20:58:28.837750] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T20:58:29.054402] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-30T20:58:29.341569] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T20:58:29.854364] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-30T20:58:30.654385] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-30T20:58:30.672853] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T20:58:31.017559] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T20:58:31.454393] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-30T20:58:32.238885] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T20:58:32.254364] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-30T20:58:33.054406] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-30T20:58:33.545353] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T20:58:33.587093] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T20:58:33.656623] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T20:58:33.854386] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-30T20:58:34.654359] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-30T20:58:35.167296] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T20:58:35.454364] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-30T20:58:36.254370] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-30T20:58:36.882244] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T20:58:36.895271] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-09-30T20:58:36.895493] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-30T20:58:37.067472] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-30T20:58:37.359452] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T20:58:37.432863] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-30T20:58:37.430241] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-30T20:58:37.443981] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-30T20:58:37.445814] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-30T20:58:37.446505] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-30T20:58:37.448318] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53535 (keeping 200 days of data) [2025-09-30T20:58:37.859883] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-30T20:58:37.935095] [DEBUG] [LOCAL ] S: Primary data saved (53535 records). [2025-09-30T20:58:37.935312] [INFO ] [MAIN ] S: Full history saved. [2025-09-30T20:58:37.935502] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. S took 32.9s. Estimated remaining: 1h 5m 52s. Rate: 7.8 symbols/min [2025-09-30T20:58:38.208483] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:38.238293] [DEBUG] [LOCAL ] SAH: Loaded 22003 existing records from primary storage. [2025-09-30T20:58:38.238619] [INFO ] [MAIN ] SAH: Loaded 22003 existing records. [2025-09-30T20:58:38.478033] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:38.478365] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-30T20:58:38.478459] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-30T20:58:38.479497] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-30T20:58:38.479587] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-30T20:58:38.663721] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-30T20:58:38.708466] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T20:58:38.974045] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:39.457397] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-30T20:58:39.463448] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T20:58:39.474884] [INFO ] [REMOTE ] SA: Full fetch complete (62308 records). [2025-09-30T20:58:39.475023] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-30T20:58:39.596424] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T20:58:39.897381] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-30T20:58:39.897467] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-30T20:58:39.898804] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-30T20:58:39.898900] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-30T20:58:39.900250] [DEBUG] [LOCAL ] SA: Trimmed 62308 records to 43298 (keeping 200 days of data) [2025-09-30T20:58:40.134367] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T20:58:40.193019] [DEBUG] [LOCAL ] SA: Primary data saved (43298 records). [2025-09-30T20:58:40.193176] [INFO ] [MAIN ] SA: Full history saved. [2025-09-30T20:58:40.193293] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SA took 32.5s. Estimated remaining: 1h 5m 43s. Rate: 7.8 symbols/min [2025-09-30T20:58:40.261509] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-30T20:58:40.386318] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:40.386510] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-30T20:58:40.386568] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-30T20:58:40.386706] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-30T20:58:40.386757] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-30T20:58:40.386801] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-30T20:58:40.386834] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-30T20:58:40.772812] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:41.054366] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-30T20:58:41.723500] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T20:58:41.854383] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-30T20:58:42.149254] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T20:58:42.654337] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-30T20:58:42.860295] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T20:58:43.454347] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-30T20:58:43.767970] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T20:58:44.037483] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T20:58:44.040447] [INFO ] [REMOTE ] SABA: Full fetch complete (15513 records). [2025-09-30T20:58:44.040527] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-30T20:58:44.259620] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-30T20:58:44.461253] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-30T20:58:44.461354] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-30T20:58:44.461767] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-30T20:58:44.461831] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-30T20:58:44.462371] [DEBUG] [LOCAL ] SABA: Trimmed 15513 records to 9219 (keeping 200 days of data) [2025-09-30T20:58:44.527131] [DEBUG] [LOCAL ] SABA: Primary data saved (9219 records). [2025-09-30T20:58:44.527294] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-30T20:58:44.527443] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SABA took 35.4s. Estimated remaining: 1h 5m 34s. Rate: 7.8 symbols/min [2025-09-30T20:58:44.707942] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:44.734508] [DEBUG] [LOCAL ] SAM: Loaded 21311 existing records from primary storage. [2025-09-30T20:58:44.734852] [INFO ] [MAIN ] SAM: Loaded 21311 existing records. [2025-09-30T20:58:44.932460] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:44.932742] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-30T20:58:44.932829] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-30T20:58:44.933390] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-30T20:58:44.933454] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-30T20:58:45.059555] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-30T20:58:45.324181] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:45.859467] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-30T20:58:45.869031] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T20:58:46.199552] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T20:58:46.654331] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-30T20:58:46.820093] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:58:47.099778] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T20:58:47.454330] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-30T20:58:48.254330] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-30T20:58:48.563868] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T20:58:48.665551] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T20:58:49.054360] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-30T20:58:49.854372] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-30T20:58:50.271351] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T20:58:50.654377] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-30T20:58:51.454392] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-30T20:58:51.725697] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T20:58:52.254369] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-30T20:58:52.626740] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T20:58:53.054346] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-30T20:58:53.565698] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T20:58:53.854323] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-30T20:58:53.883068] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (4.83 seconds). [2025-09-30T20:58:54.007921] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T20:58:54.654370] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-30T20:58:55.387436] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T20:58:55.395371] [INFO ] [REMOTE ] SAFE: Full fetch complete (45133 records). [2025-09-30T20:58:55.395497] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-30T20:58:55.454768] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-30T20:58:55.727672] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T20:58:55.826032] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-30T20:58:55.826147] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-30T20:58:55.827506] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-30T20:58:55.827589] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-30T20:58:55.829124] [DEBUG] [LOCAL ] SAFE: Trimmed 45133 records to 30266 (keeping 200 days of data) [2025-09-30T20:58:55.898597] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T20:58:56.052598] [DEBUG] [LOCAL ] SAFE: Primary data saved (30266 records). [2025-09-30T20:58:56.052903] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-30T20:58:56.053079] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAFE took 35.4s. Estimated remaining: 1h 5m 28s. Rate: 7.8 symbols/min [2025-09-30T20:58:56.228476] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:58:56.262818] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-30T20:58:56.287801] [DEBUG] [LOCAL ] SAN: Loaded 52995 existing records from primary storage. [2025-09-30T20:58:56.288211] [INFO ] [MAIN ] SAN: Loaded 52995 existing records. [2025-09-30T20:58:56.480467] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:58:56.480783] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-30T20:58:56.480838] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-30T20:58:56.481946] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-30T20:58:56.482010] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-30T20:58:56.592730] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T20:58:56.879278] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:58:57.054368] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-30T20:58:57.452628] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T20:58:57.854395] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-30T20:58:58.654359] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-30T20:58:59.029411] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-30T20:58:59.454361] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-30T20:58:59.786264] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T20:58:59.854528] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T20:59:00.254367] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-30T20:59:01.054349] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-30T20:59:01.394273] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T20:59:01.854360] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-30T20:59:02.307475] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T20:59:02.654352] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-30T20:59:03.116624] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T20:59:03.454365] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-30T20:59:04.254336] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-30T20:59:04.504362] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T20:59:04.557367] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T20:59:04.654046] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T20:59:05.054359] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-30T20:59:05.854353] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-30T20:59:06.654337] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-30T20:59:06.716291] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T20:59:06.922114] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T20:59:06.926210] [INFO ] [REMOTE ] SAH: Full fetch complete (30462 records). [2025-09-30T20:59:06.926297] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-30T20:59:07.332448] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-30T20:59:07.332585] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-30T20:59:07.333325] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-30T20:59:07.333403] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-30T20:59:07.334197] [DEBUG] [LOCAL ] SAH: Trimmed 30462 records to 21955 (keeping 200 days of data) [2025-09-30T20:59:07.441520] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T20:59:07.454485] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-30T20:59:07.494329] [DEBUG] [LOCAL ] SAH: Primary data saved (21955 records). [2025-09-30T20:59:07.494457] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-30T20:59:07.494535] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 29.6s. Estimated remaining: 1h 5m 21s. Rate: 7.8 symbols/min [2025-09-30T20:59:07.674609] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:07.725510] [DEBUG] [LOCAL ] SAND: Loaded 51791 existing records from primary storage. [2025-09-30T20:59:07.725929] [INFO ] [MAIN ] SAND: Loaded 51791 existing records. [2025-09-30T20:59:07.905275] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:59:07.905511] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-30T20:59:07.905559] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-30T20:59:07.906900] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-30T20:59:07.906964] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-30T20:59:08.261585] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-30T20:59:08.285755] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:08.618841] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-30T20:59:08.619819] [INFO ] [REMOTE ] SAJ: Full fetch complete (920 records). [2025-09-30T20:59:08.634055] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T20:59:08.633513] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-30T20:59:08.836781] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-30T20:59:08.836975] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:59:08.837059] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:59:08.837145] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-30T20:59:08.837247] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-30T20:59:08.837323] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-30T20:59:08.837423] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-30T20:59:08.837516] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAJ took 28.6s. Estimated remaining: 1h 5m 12s. Rate: 7.8 symbols/min [2025-09-30T20:59:09.032214] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:09.061229] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-30T20:59:09.085670] [DEBUG] [LOCAL ] SAP: Loaded 50034 existing records from primary storage. [2025-09-30T20:59:09.086019] [INFO ] [MAIN ] SAP: Loaded 50034 existing records. [2025-09-30T20:59:09.289448] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:59:09.289709] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-30T20:59:09.289768] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-30T20:59:09.291199] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-30T20:59:09.291261] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-30T20:59:09.684000] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:09.854380] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-30T20:59:10.427561] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T20:59:10.654389] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-30T20:59:11.454369] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-30T20:59:11.827665] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T20:59:12.254338] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-30T20:59:12.436555] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T20:59:12.462864] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T20:59:13.054395] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-30T20:59:13.854392] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-30T20:59:14.226544] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T20:59:14.289077] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T20:59:14.294607] [INFO ] [REMOTE ] SAM: Full fetch complete (30515 records). [2025-09-30T20:59:14.294738] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-30T20:59:14.666692] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-30T20:59:14.681602] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-30T20:59:14.681726] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-30T20:59:14.682459] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-30T20:59:14.682553] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-30T20:59:14.683490] [DEBUG] [LOCAL ] SAM: Trimmed 30515 records to 21341 (keeping 200 days of data) [2025-09-30T20:59:14.832336] [DEBUG] [LOCAL ] SAM: Primary data saved (21341 records). [2025-09-30T20:59:14.832477] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-30T20:59:14.832560] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAM took 30.3s. Estimated remaining: 1h 5m 3s. Rate: 7.8 symbols/min [2025-09-30T20:59:15.009176] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:15.026966] [DEBUG] [LOCAL ] SAR: Loaded 16143 existing records from primary storage. [2025-09-30T20:59:15.027248] [INFO ] [MAIN ] SAR: Loaded 16143 existing records. [2025-09-30T20:59:15.212148] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:59:15.212418] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-30T20:59:15.212467] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-30T20:59:15.213006] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-30T20:59:15.213075] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-30T20:59:15.461451] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-30T20:59:15.581193] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:15.789024] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T20:59:16.259480] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-30T20:59:16.280326] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T20:59:17.054356] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-30T20:59:17.273389] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T20:59:17.332222] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-30T20:59:17.854369] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-30T20:59:18.654403] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-30T20:59:18.877331] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T20:59:18.988036] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T20:59:19.454374] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-30T20:59:20.254398] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-30T20:59:20.305900] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T20:59:20.430233] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T20:59:21.054378] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-30T20:59:21.815154] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T20:59:21.854333] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-30T20:59:22.654363] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-30T20:59:22.948389] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T20:59:23.454356] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-30T20:59:23.570580] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T20:59:23.801343] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T20:59:24.254354] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-30T20:59:25.054353] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-30T20:59:25.252863] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T20:59:25.854357] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-30T20:59:25.956205] [DEBUG] [REMOTE ] SAR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T20:59:25.956528] [WARN ] [REMOTE ] SAR: No data returned for month 2025-04 [2025-09-30T20:59:25.956617] [FATAL] [REMOTE ] SAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T20:59:25.956730] [FATAL] [MAIN ] SAR: Failed to fetch primary data. [2025-09-30T20:59:25.956798] [WARN ] [MAIN ] SAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T20:59:25.956884] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-30T20:59:25.956957] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-09-30T20:59:25.956993] [INFO ] [LOCAL ] SAR: Starting deletion of derivative data. [2025-09-30T20:59:25.957628] [DEBUG] [LOCAL ] SAR: Deleted derivative data file. [2025-09-30T20:59:25.957753] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAR took 11.1s. Estimated remaining: 1h 4m 57s. Rate: 7.8 symbols/min [2025-09-30T20:59:26.150619] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:26.202179] [DEBUG] [LOCAL ] SARO: Loaded 48625 existing records from primary storage. [2025-09-30T20:59:26.202492] [INFO ] [MAIN ] SARO: Loaded 48625 existing records. [2025-09-30T20:59:26.411505] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:59:26.411898] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-30T20:59:26.411972] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-30T20:59:26.413148] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-30T20:59:26.413213] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-30T20:59:26.673283] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-30T20:59:26.655572] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-30T20:59:26.880859] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:26.914637] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T20:59:27.454362] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-30T20:59:28.254364] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-30T20:59:28.762857] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T20:59:29.054369] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-30T20:59:29.100400] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T20:59:29.854413] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-30T20:59:29.958064] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T20:59:30.654416] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-30T20:59:30.893696] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T20:59:31.454422] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-30T20:59:31.894261] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T20:59:32.147209] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T20:59:32.254411] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-30T20:59:33.059444] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-30T20:59:33.076326] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T20:59:33.854330] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-30T20:59:34.263229] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T20:59:34.654365] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-30T20:59:35.043324] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T20:59:35.054786] [INFO ] [REMOTE ] SAN: Full fetch complete (76232 records). [2025-09-30T20:59:35.054940] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-30T20:59:35.482907] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-30T20:59:35.456830] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-30T20:59:35.484307] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-30T20:59:35.485474] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-30T20:59:35.485837] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-30T20:59:35.512592] [DEBUG] [LOCAL ] SAN: Trimmed 76232 records to 53004 (keeping 200 days of data) [2025-09-30T20:59:35.513838] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T20:59:35.860403] [DEBUG] [LOCAL ] SAN: Primary data saved (53004 records). [2025-09-30T20:59:35.860552] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-30T20:59:35.860637] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAN took 39.8s. Estimated remaining: 1h 4m 50s. Rate: 7.8 symbols/min [2025-09-30T20:59:36.052842] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:36.053025] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-30T20:59:36.053092] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-30T20:59:36.053206] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-30T20:59:36.053250] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-30T20:59:36.053301] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-30T20:59:36.053335] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-30T20:59:36.259180] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-30T20:59:36.454338] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:36.487275] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T20:59:37.054377] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-30T20:59:37.452487] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T20:59:37.854365] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-30T20:59:38.013854] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T20:59:38.037296] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T20:59:38.654402] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-30T20:59:39.053487] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-30T20:59:39.454337] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-30T20:59:39.755364] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T20:59:40.254393] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-30T20:59:40.594633] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T20:59:41.054404] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-30T20:59:41.538166] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T20:59:41.585216] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T20:59:41.598107] [INFO ] [REMOTE ] SAP: Full fetch complete (71826 records). [2025-09-30T20:59:41.598438] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-30T20:59:41.864894] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-30T20:59:42.027025] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-30T20:59:42.027113] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-30T20:59:42.028400] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-30T20:59:42.028486] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-30T20:59:42.032429] [DEBUG] [LOCAL ] SAP: Trimmed 71826 records to 49997 (keeping 200 days of data) [2025-09-30T20:59:42.366934] [DEBUG] [LOCAL ] SAP: Primary data saved (49997 records). [2025-09-30T20:59:42.367074] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-30T20:59:42.367173] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 33.5s. Estimated remaining: 1h 4m 42s. Rate: 7.8 symbols/min [2025-09-30T20:59:42.523450] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T20:59:42.559135] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:42.559273] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-30T20:59:42.559311] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-30T20:59:42.559441] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-30T20:59:42.559484] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-30T20:59:42.559526] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-30T20:59:42.559558] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-30T20:59:42.659520] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-30T20:59:42.942243] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:43.454393] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-30T20:59:44.063599] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T20:59:44.254363] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-30T20:59:44.498428] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T20:59:44.574765] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-30T20:59:45.054365] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-30T20:59:45.854373] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-30T20:59:46.297747] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-30T20:59:46.654368] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-30T20:59:46.851035] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T20:59:46.866091] [INFO ] [REMOTE ] SAND: Full fetch complete (74418 records). [2025-09-30T20:59:46.866263] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-30T20:59:47.078381] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T20:59:47.290226] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-30T20:59:47.290313] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-30T20:59:47.291534] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-30T20:59:47.291684] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-30T20:59:47.293272] [DEBUG] [LOCAL ] SAND: Trimmed 74418 records to 51807 (keeping 200 days of data) [2025-09-30T20:59:47.485359] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-30T20:59:47.648963] [DEBUG] [LOCAL ] SAND: Primary data saved (51807 records). [2025-09-30T20:59:47.649125] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-30T20:59:47.649216] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAND took 40.2s. Estimated remaining: 1h 4m 33s. Rate: 7.8 symbols/min [2025-09-30T20:59:47.827897] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:47.828088] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-30T20:59:47.828127] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-30T20:59:47.828240] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-30T20:59:47.828282] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-30T20:59:47.828377] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-30T20:59:47.828418] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-30T20:59:48.196715] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:48.254318] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-30T20:59:48.830079] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T20:59:48.999337] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T20:59:49.054364] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-30T20:59:49.467106] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T20:59:49.854371] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-30T20:59:50.654402] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-30T20:59:51.062460] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T20:59:51.454364] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-30T20:59:51.689870] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T20:59:51.835346] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T20:59:52.254375] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-30T20:59:52.662421] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T20:59:53.054382] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-30T20:59:53.553567] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T20:59:53.854451] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-30T20:59:54.446672] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T20:59:54.654383] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-30T20:59:55.298377] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T20:59:55.454393] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-30T20:59:55.857226] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T20:59:56.254399] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-30T20:59:56.558981] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-30T20:59:56.560071] [INFO ] [REMOTE ] SAT: Full fetch complete (1619 records). [2025-09-30T20:59:56.560151] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-30T20:59:56.766835] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T20:59:56.767103] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T20:59:56.767179] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T20:59:56.767253] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-30T20:59:56.767321] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-30T20:59:56.767359] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-30T20:59:56.767400] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-30T20:59:56.767458] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAT took 20.9s. Estimated remaining: 1h 4m 26s. Rate: 7.8 symbols/min [2025-09-30T20:59:56.951359] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T20:59:56.986543] [DEBUG] [LOCAL ] SB: Loaded 33129 existing records from primary storage. [2025-09-30T20:59:56.986866] [INFO ] [MAIN ] SB: Loaded 33129 existing records. [2025-09-30T20:59:57.059486] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-30T20:59:57.190056] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T20:59:57.190288] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-30T20:59:57.190338] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-30T20:59:57.191178] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-30T20:59:57.191282] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-30T20:59:57.598254] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T20:59:57.854361] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-30T20:59:58.517062] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T20:59:58.654354] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-30T20:59:59.005736] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T20:59:59.171283] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T20:59:59.454372] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-30T21:00:00.254365] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-30T21:00:01.054358] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-30T21:00:01.519512] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T21:00:01.858504] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-30T21:00:01.862161] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:00:01.876516] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T21:00:02.335170] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T21:00:02.654409] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-30T21:00:03.454403] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-30T21:00:04.254367] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-30T21:00:04.553001] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T21:00:04.705814] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T21:00:05.054338] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-30T21:00:05.187227] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T21:00:05.462145] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T21:00:05.463074] [INFO ] [REMOTE ] SAY: Full fetch complete (1401 records). [2025-09-30T21:00:05.463166] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-30T21:00:05.664146] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-30T21:00:05.664357] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:00:05.664429] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:00:05.664504] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-30T21:00:05.664572] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-30T21:00:05.664609] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-30T21:00:05.664679] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-30T21:00:05.664761] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAY took 23.3s. Estimated remaining: 1h 4m 19s. Rate: 7.8 symbols/min [2025-09-30T21:00:05.859511] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-30T21:00:05.863779] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:05.864983] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-30T21:00:05.865044] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-30T21:00:05.865165] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-30T21:00:05.865248] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-30T21:00:05.865303] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-30T21:00:05.865338] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-30T21:00:06.285790] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:06.483964] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T21:00:06.654363] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-30T21:00:06.973302] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:00:06.973630] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-30T21:00:06.973746] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:00:06.973795] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-30T21:00:06.973832] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:00:06.973901] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-30T21:00:06.973967] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-30T21:00:06.974003] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-30T21:00:06.974044] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-30T21:00:06.974092] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 1.3s. Estimated remaining: 1h 4m 9s. Rate: 7.8 symbols/min [2025-09-30T21:00:07.160617] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:07.220511] [DEBUG] [LOCAL ] SBH: Loaded 49790 existing records from primary storage. [2025-09-30T21:00:07.220933] [INFO ] [MAIN ] SBH: Loaded 49790 existing records. [2025-09-30T21:00:07.417199] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:07.417454] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-30T21:00:07.417506] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-30T21:00:07.418524] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-30T21:00:07.418589] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-30T21:00:07.459604] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-30T21:00:07.810889] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:08.254360] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-30T21:00:09.054360] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-30T21:00:09.352157] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T21:00:09.362609] [INFO ] [REMOTE ] SARO: Full fetch complete (69016 records). [2025-09-30T21:00:09.362806] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-30T21:00:09.792274] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-30T21:00:09.795275] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-30T21:00:09.795492] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T21:00:09.796880] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-30T21:00:09.797062] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-30T21:00:09.800184] [DEBUG] [LOCAL ] SARO: Trimmed 69016 records to 48623 (keeping 200 days of data) [2025-09-30T21:00:09.824407] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T21:00:09.883104] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-30T21:00:10.138391] [DEBUG] [LOCAL ] SARO: Primary data saved (48623 records). [2025-09-30T21:00:10.138548] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-30T21:00:10.138637] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SARO took 44.2s. Estimated remaining: 1h 4m 0s. Rate: 7.8 symbols/min [2025-09-30T21:00:10.321761] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:10.330806] [DEBUG] [LOCAL ] SBI: Loaded 7679 existing records from primary storage. [2025-09-30T21:00:10.331018] [INFO ] [MAIN ] SBI: Loaded 7679 existing records. [2025-09-30T21:00:10.529567] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:10.529885] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-30T21:00:10.529959] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-30T21:00:10.530558] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-30T21:00:10.530632] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-30T21:00:10.659492] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-30T21:00:10.936278] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:11.454384] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-30T21:00:11.857906] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T21:00:12.254410] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-30T21:00:12.453263] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-30T21:00:13.054371] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-30T21:00:13.182988] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-30T21:00:13.457850] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T21:00:13.477741] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T21:00:13.854350] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-30T21:00:14.230975] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-30T21:00:14.232265] [INFO ] [REMOTE ] SAZ: Full fetch complete (1824 records). [2025-09-30T21:00:14.232341] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-30T21:00:14.429604] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T21:00:14.429837] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:00:14.429909] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:00:14.429985] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-30T21:00:14.430069] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-30T21:00:14.430140] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-30T21:00:14.430221] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-30T21:00:14.430303] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SAZ took 26.8s. Estimated remaining: 1h 3m 52s. Rate: 7.8 symbols/min [2025-09-30T21:00:14.617710] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:14.628125] [DEBUG] [LOCAL ] SBR: Loaded 7282 existing records from primary storage. [2025-09-30T21:00:14.628345] [INFO ] [MAIN ] SBR: Loaded 7282 existing records. [2025-09-30T21:00:14.661049] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-30T21:00:14.833840] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:14.834074] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-30T21:00:14.834123] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-30T21:00:14.834479] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-30T21:00:14.834539] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-30T21:00:15.232039] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:15.454392] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-30T21:00:16.254319] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-30T21:00:16.339132] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:00:16.992887] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T21:00:17.054347] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-30T21:00:17.314559] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T21:00:17.854393] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-30T21:00:17.901967] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T21:00:18.654364] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-30T21:00:19.284303] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:00:19.454412] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-30T21:00:19.964397] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T21:00:20.254415] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-30T21:00:20.457450] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T21:00:21.028376] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T21:00:21.054315] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-30T21:00:21.854378] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-30T21:00:21.959285] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T21:00:22.655187] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-30T21:00:23.325175] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:00:23.454409] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-30T21:00:23.546333] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T21:00:24.254365] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-30T21:00:24.883024] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T21:00:25.054413] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-30T21:00:25.764548] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T21:00:25.844272] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T21:00:25.854308] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-30T21:00:26.654372] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-30T21:00:26.722755] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T21:00:27.454403] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-30T21:00:28.229084] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T21:00:28.254329] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-30T21:00:28.522699] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T21:00:29.054366] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-30T21:00:29.163295] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T21:00:29.854371] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-30T21:00:30.550514] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T21:00:30.654399] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-30T21:00:31.182669] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T21:00:31.186258] [INFO ] [REMOTE ] SBI: Full fetch complete (10644 records). [2025-09-30T21:00:31.186371] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-30T21:00:31.455368] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-30T21:00:31.615360] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-30T21:00:31.627067] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-30T21:00:31.642119] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-30T21:00:31.642244] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-30T21:00:31.646564] [DEBUG] [LOCAL ] SBI: Trimmed 10644 records to 7612 (keeping 200 days of data) [2025-09-30T21:00:31.648715] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:00:31.710219] [DEBUG] [LOCAL ] SBI: Primary data saved (7612 records). [2025-09-30T21:00:31.710374] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-30T21:00:31.710477] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 21.6s. Estimated remaining: 1h 3m 46s. Rate: 7.8 symbols/min [2025-09-30T21:00:31.893685] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:31.943251] [DEBUG] [LOCAL ] SBS: Loaded 49491 existing records from primary storage. [2025-09-30T21:00:31.943705] [INFO ] [MAIN ] SBS: Loaded 49491 existing records. [2025-09-30T21:00:32.150987] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:32.151369] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-30T21:00:32.151438] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-30T21:00:32.153161] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-30T21:00:32.153301] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-30T21:00:32.263988] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-30T21:00:32.554591] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:32.653013] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T21:00:32.660108] [INFO ] [REMOTE ] SB: Full fetch complete (50299 records). [2025-09-30T21:00:32.660277] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-30T21:00:33.062871] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-30T21:00:33.087626] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-30T21:00:33.087729] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-30T21:00:33.088639] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-30T21:00:33.088723] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-30T21:00:33.090100] [DEBUG] [LOCAL ] SB: Trimmed 50299 records to 33140 (keeping 200 days of data) [2025-09-30T21:00:33.318023] [DEBUG] [LOCAL ] SB: Primary data saved (33140 records). [2025-09-30T21:00:33.318180] [INFO ] [MAIN ] SB: Full history saved. [2025-09-30T21:00:33.318268] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SB took 36.6s. Estimated remaining: 1h 3m 37s. Rate: 7.8 symbols/min [2025-09-30T21:00:33.509161] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:33.525853] [DEBUG] [LOCAL ] SBSI: Loaded 14718 existing records from primary storage. [2025-09-30T21:00:33.526296] [INFO ] [MAIN ] SBSI: Loaded 14718 existing records. [2025-09-30T21:00:33.729685] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:33.730009] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-30T21:00:33.730101] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-30T21:00:33.730602] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-30T21:00:33.730698] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-30T21:00:33.858001] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-30T21:00:34.142971] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:34.171935] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T21:00:34.654346] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-30T21:00:34.777707] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T21:00:34.924680] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T21:00:35.454318] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-30T21:00:35.647780] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T21:00:36.254354] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-30T21:00:36.306330] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T21:00:37.054387] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-30T21:00:37.390020] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T21:00:37.854374] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-30T21:00:38.454198] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T21:00:38.654404] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-30T21:00:38.739864] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T21:00:39.454357] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-30T21:00:39.679020] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T21:00:40.254370] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-30T21:00:41.054343] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-30T21:00:41.218075] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T21:00:41.589414] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T21:00:41.854401] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-30T21:00:42.061739] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T21:00:42.654359] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-30T21:00:42.713417] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:00:43.454418] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-30T21:00:44.138825] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:00:44.254380] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-30T21:00:44.973855] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T21:00:45.054337] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-30T21:00:45.300990] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T21:00:45.854403] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-30T21:00:46.097823] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T21:00:46.654392] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-30T21:00:47.420250] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:00:47.454351] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-30T21:00:48.254348] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-30T21:00:48.374845] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T21:00:48.480020] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T21:00:48.491329] [INFO ] [REMOTE ] SBH: Full fetch complete (72791 records). [2025-09-30T21:00:48.491483] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-30T21:00:48.920905] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-30T21:00:48.920989] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-30T21:00:48.922070] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-30T21:00:48.922139] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-30T21:00:48.924712] [DEBUG] [LOCAL ] SBH: Trimmed 72791 records to 49770 (keeping 200 days of data) [2025-09-30T21:00:49.054404] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-30T21:00:49.271329] [DEBUG] [LOCAL ] SBH: Primary data saved (49770 records). [2025-09-30T21:00:49.271598] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-30T21:00:49.271814] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 42.3s. Estimated remaining: 1h 3m 32s. Rate: 7.8 symbols/min [2025-09-30T21:00:49.467925] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:00:49.522998] [DEBUG] [LOCAL ] SBSW: Loaded 52993 existing records from primary storage. [2025-09-30T21:00:49.523390] [INFO ] [MAIN ] SBSW: Loaded 52993 existing records. [2025-09-30T21:00:49.720337] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:00:49.720563] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-30T21:00:49.720612] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-30T21:00:49.722482] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-30T21:00:49.722547] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-30T21:00:49.859468] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-30T21:00:50.186520] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:00:50.192779] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T21:00:50.436888] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T21:00:50.513445] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T21:00:50.516396] [INFO ] [REMOTE ] SBR: Full fetch complete (11126 records). [2025-09-30T21:00:50.516553] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-30T21:00:50.659446] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-30T21:00:50.935598] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-30T21:00:50.935708] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-30T21:00:50.936011] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-30T21:00:50.936055] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-30T21:00:50.936520] [DEBUG] [LOCAL ] SBR: Trimmed 11126 records to 7345 (keeping 200 days of data) [2025-09-30T21:00:50.988839] [DEBUG] [LOCAL ] SBR: Primary data saved (7345 records). [2025-09-30T21:00:50.988987] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-30T21:00:50.989136] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBR took 36.6s. Estimated remaining: 1h 3m 22s. Rate: 7.8 symbols/min [2025-09-30T21:00:51.454410] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-30T21:00:52.127232] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:00:52.254397] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-30T21:00:52.462114] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T21:00:53.054364] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-30T21:00:53.854349] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-30T21:00:54.015986] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T21:00:54.129822] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T21:00:54.654354] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-30T21:00:55.454371] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-30T21:00:55.597218] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T21:00:56.254357] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-30T21:00:56.506991] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T21:00:56.551806] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T21:00:57.054363] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-30T21:00:57.854345] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-30T21:00:58.176374] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T21:00:58.661681] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-30T21:00:58.682634] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T21:00:58.695459] [INFO ] [REMOTE ] SBS: Full fetch complete (70142 records). [2025-09-30T21:00:58.695702] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-30T21:00:58.979266] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T21:00:59.161952] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-30T21:00:59.162109] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-30T21:00:59.163181] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-30T21:00:59.163249] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-30T21:00:59.164775] [DEBUG] [LOCAL ] SBS: Trimmed 70142 records to 49479 (keeping 200 days of data) [2025-09-30T21:00:59.455131] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-30T21:00:59.490724] [DEBUG] [LOCAL ] SBS: Primary data saved (49479 records). [2025-09-30T21:00:59.490882] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-30T21:00:59.491000] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBS took 27.8s. Estimated remaining: 1h 3m 15s. Rate: 7.8 symbols/min [2025-09-30T21:01:00.597940] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T21:01:00.602973] [INFO ] [REMOTE ] SBSI: Full fetch complete (21206 records). [2025-09-30T21:01:00.613926] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-30T21:01:00.702693] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T21:01:00.758266] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-30T21:01:01.087114] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-30T21:01:01.087210] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-30T21:01:01.087749] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-30T21:01:01.087846] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-30T21:01:01.088893] [DEBUG] [LOCAL ] SBSI: Trimmed 21206 records to 14739 (keeping 200 days of data) [2025-09-30T21:01:01.184380] [DEBUG] [LOCAL ] SBSI: Primary data saved (14739 records). [2025-09-30T21:01:01.184536] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-30T21:01:01.184691] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBSI took 27.9s. Estimated remaining: 1h 3m 6s. Rate: 7.8 symbols/min [2025-09-30T21:01:02.923424] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T21:01:02.934878] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-30T21:01:05.071696] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T21:01:05.083317] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-30T21:01:07.080219] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T21:01:07.092131] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-30T21:01:09.222310] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-30T21:01:09.233624] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-30T21:01:11.397174] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-30T21:01:11.409378] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-30T21:01:13.382363] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T21:01:13.394944] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-30T21:01:15.518610] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T21:01:15.531815] [INFO ] [REMOTE ] SBSW: Full fetch complete (76509 records). [2025-09-30T21:01:15.532006] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-30T21:01:16.002544] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-30T21:01:16.002694] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-30T21:01:16.004002] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-30T21:01:16.004082] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-30T21:01:16.005727] [DEBUG] [LOCAL ] SBSW: Trimmed 76509 records to 53001 (keeping 200 days of data) [2025-09-30T21:01:16.330235] [DEBUG] [LOCAL ] SBSW: Primary data saved (53001 records). [2025-09-30T21:01:16.330411] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-30T21:01:16.330513] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 27.1s. Estimated remaining: 1h 2m 60s. Rate: 7.8 symbols/min [2025-09-30T21:01:17.000369] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:17.091869] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:17.137536] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:17.158191] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:17.158757] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-30T21:01:17.159173] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-30T21:01:17.159318] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-30T21:01:17.159378] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-30T21:01:17.159486] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-30T21:01:17.160477] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-30T21:01:17.297808] [DEBUG] [LOCAL ] SCD: Loaded 12679 existing records from primary storage. [2025-09-30T21:01:17.322673] [INFO ] [MAIN ] SCD: Loaded 12679 existing records. [2025-09-30T21:01:17.642341] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-30T21:01:17.673118] [DEBUG] [LOCAL ] SCCO: Loaded 49404 existing records from primary storage. [2025-09-30T21:01:17.689290] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-09-30T21:01:17.711400] [INFO ] [MAIN ] SCCO: Loaded 49404 existing records. [2025-09-30T21:01:18.113808] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:18.148797] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:18.164205] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-30T21:01:18.176396] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-30T21:01:18.197587] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-30T21:01:18.281091] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-30T21:01:18.311709] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-30T21:01:18.315004] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:18.333585] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:18.356838] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-30T21:01:18.367440] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-30T21:01:18.367560] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-30T21:01:18.367625] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-30T21:01:18.417984] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-30T21:01:18.418045] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-30T21:01:18.437815] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-30T21:01:18.437950] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-30T21:01:18.750970] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T21:01:18.785220] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-30T21:01:19.399669] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T21:01:19.422193] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-30T21:01:19.653688] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:19.589114] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:19.661245] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-30T21:01:19.660998] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-30T21:01:19.660391] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:19.662580] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-30T21:01:20.210201] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T21:01:20.211216] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-30T21:01:20.531153] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-30T21:01:20.534380] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T21:01:20.532466] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-30T21:01:20.546441] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-30T21:01:20.563463] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T21:01:20.565715] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-30T21:01:20.945209] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T21:01:20.946182] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-30T21:01:21.231830] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T21:01:21.241506] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-30T21:01:21.609223] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:01:21.616310] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-30T21:01:21.618266] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T21:01:21.621508] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-30T21:01:21.625283] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T21:01:21.640073] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-30T21:01:22.402109] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:01:22.405258] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-30T21:01:22.473221] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T21:01:22.475448] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-30T21:01:22.557399] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T21:01:22.569253] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-30T21:01:22.702491] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T21:01:22.714730] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-30T21:01:22.855416] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T21:01:22.857124] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-30T21:01:23.294033] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T21:01:23.296471] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-30T21:01:23.389488] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T21:01:23.391392] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-30T21:01:23.573759] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T21:01:23.587607] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-30T21:01:23.861545] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-30T21:01:23.862372] [INFO ] [REMOTE ] SBXD: Full fetch complete (3091 records). [2025-09-30T21:01:23.862442] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-30T21:01:24.066933] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-30T21:01:24.067475] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:01:24.067792] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:01:24.068033] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-30T21:01:24.068229] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-30T21:01:24.068424] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-30T21:01:24.068625] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-30T21:01:24.068780] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SBXD took 7.7s. Estimated remaining: 1h 2m 52s. Rate: 7.8 symbols/min [2025-09-30T21:01:24.219561] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T21:01:24.258276] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-30T21:01:24.292140] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:24.331764] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T21:01:24.389892] [DEBUG] [LOCAL ] SCI: Loaded 46497 existing records from primary storage. [2025-09-30T21:01:24.390269] [INFO ] [MAIN ] SCI: Loaded 46497 existing records. [2025-09-30T21:01:24.608723] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:24.635635] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-30T21:01:24.636566] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-30T21:01:24.637519] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T21:01:24.647006] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-30T21:01:24.648084] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-30T21:01:25.043219] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:25.054349] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-30T21:01:25.106446] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T21:01:25.854389] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-30T21:01:26.654337] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-30T21:01:26.716349] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T21:01:26.920626] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T21:01:27.454370] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-30T21:01:27.668251] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T21:01:28.254330] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-30T21:01:28.357417] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T21:01:29.054403] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-30T21:01:29.854403] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-30T21:01:30.220030] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T21:01:30.366523] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T21:01:30.654364] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-30T21:01:30.783559] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T21:01:31.454400] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-30T21:01:32.254393] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-30T21:01:32.578238] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T21:01:32.878384] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T21:01:33.054329] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-30T21:01:33.174509] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T21:01:33.854476] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-30T21:01:34.089426] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T21:01:34.654498] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-30T21:01:35.454330] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-30T21:01:35.654838] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T21:01:36.070054] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T21:01:36.109988] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T21:01:36.108111] [INFO ] [REMOTE ] SCHW: Full fetch complete (77313 records). [2025-09-30T21:01:36.120429] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-30T21:01:36.122743] [FATAL] [VALIDATOR ] SCHW: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:01:36.122975] [FATAL] [MAIN ] SCHW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:01:36.123060] [WARN ] [MAIN ] SCHW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:01:36.123156] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-30T21:01:36.123446] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-09-30T21:01:36.123521] [INFO ] [LOCAL ] SCHW: Starting deletion of derivative data. [2025-09-30T21:01:36.124059] [DEBUG] [LOCAL ] SCHW: Deleted derivative data file. [2025-09-30T21:01:36.124373] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCHW took 19.8s. Estimated remaining: 1h 2m 46s. Rate: 7.8 symbols/min [2025-09-30T21:01:36.259546] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-30T21:01:36.332212] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:36.350278] [DEBUG] [LOCAL ] SCL: Loaded 14886 existing records from primary storage. [2025-09-30T21:01:36.350526] [INFO ] [MAIN ] SCL: Loaded 14886 existing records. [2025-09-30T21:01:36.559074] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:36.559345] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-30T21:01:36.559404] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-30T21:01:36.559898] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-30T21:01:36.559960] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-30T21:01:36.988535] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:37.054534] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-30T21:01:37.854368] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-30T21:01:38.066596] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T21:01:38.160074] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T21:01:38.654418] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-30T21:01:39.077163] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T21:01:39.454345] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-30T21:01:39.759416] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T21:01:40.254608] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-30T21:01:41.054355] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-30T21:01:41.207428] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T21:01:41.557093] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T21:01:41.742785] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T21:01:41.746285] [INFO ] [REMOTE ] SCD: Full fetch complete (16441 records). [2025-09-30T21:01:41.746380] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-30T21:01:41.858101] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-30T21:01:42.161505] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-30T21:01:42.161605] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-30T21:01:42.162163] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-30T21:01:42.162227] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-30T21:01:42.162987] [DEBUG] [LOCAL ] SCD: Trimmed 16441 records to 12737 (keeping 200 days of data) [2025-09-30T21:01:42.250905] [DEBUG] [LOCAL ] SCD: Primary data saved (12737 records). [2025-09-30T21:01:42.251054] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-30T21:01:42.251139] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCD took 25.9s. Estimated remaining: 1h 2m 37s. Rate: 7.8 symbols/min [2025-09-30T21:01:42.445486] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:42.472609] [DEBUG] [LOCAL ] SCM: Loaded 19770 existing records from primary storage. [2025-09-30T21:01:42.472917] [INFO ] [MAIN ] SCM: Loaded 19770 existing records. [2025-09-30T21:01:42.657223] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-30T21:01:42.671753] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:42.673120] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-30T21:01:42.673175] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-30T21:01:42.673553] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-30T21:01:42.673621] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-30T21:01:43.088855] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:43.454351] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-30T21:01:43.900267] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T21:01:44.254339] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-30T21:01:44.493429] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T21:01:44.552588] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T21:01:45.054360] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-30T21:01:45.854342] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-30T21:01:45.943171] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:01:46.654370] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-30T21:01:46.701007] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T21:01:46.802439] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T21:01:47.454338] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-30T21:01:47.591994] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:01:48.254340] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-30T21:01:48.477829] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T21:01:49.054392] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-30T21:01:49.854331] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-30T21:01:50.121869] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T21:01:50.159955] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T21:01:50.172206] [INFO ] [REMOTE ] SCCO: Full fetch complete (70884 records). [2025-09-30T21:01:50.172409] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-30T21:01:50.646590] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-30T21:01:50.646735] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-30T21:01:50.647989] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-30T21:01:50.648057] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-30T21:01:50.650005] [DEBUG] [LOCAL ] SCCO: Trimmed 70884 records to 49403 (keeping 200 days of data) [2025-09-30T21:01:50.709386] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-30T21:01:50.988591] [DEBUG] [LOCAL ] SCCO: Primary data saved (49403 records). [2025-09-30T21:01:50.988764] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-30T21:01:50.988857] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCCO took 34.7s. Estimated remaining: 1h 2m 30s. Rate: 7.8 symbols/min [2025-09-30T21:01:51.181152] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:51.228626] [DEBUG] [LOCAL ] SCS: Loaded 43337 existing records from primary storage. [2025-09-30T21:01:51.229054] [INFO ] [MAIN ] SCS: Loaded 43337 existing records. [2025-09-30T21:01:51.430378] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:01:51.430764] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-30T21:01:51.430925] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-30T21:01:51.431397] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-30T21:01:51.431467] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-30T21:01:51.467155] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-30T21:01:51.644413] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T21:01:51.888192] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:01:51.899787] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T21:01:52.204374] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T21:01:52.254436] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-30T21:01:53.054366] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-30T21:01:53.854372] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-30T21:01:54.002423] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T21:01:54.328270] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T21:01:54.654375] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-30T21:01:55.218592] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T21:01:55.454370] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-30T21:01:55.611229] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T21:01:56.254371] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-30T21:01:56.737439] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T21:01:57.054362] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-30T21:01:57.676492] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:01:57.854383] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-30T21:01:58.654323] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-30T21:01:58.758236] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T21:01:58.768287] [INFO ] [REMOTE ] SCI: Full fetch complete (67204 records). [2025-09-30T21:01:58.768433] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-30T21:01:59.080226] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T21:01:59.218438] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-30T21:01:59.218520] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-30T21:01:59.219633] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-30T21:01:59.219730] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-30T21:01:59.221267] [DEBUG] [LOCAL ] SCI: Trimmed 67204 records to 46449 (keeping 200 days of data) [2025-09-30T21:01:59.467680] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-30T21:01:59.558772] [DEBUG] [LOCAL ] SCI: Primary data saved (46449 records). [2025-09-30T21:01:59.558923] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-30T21:01:59.559014] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCI took 35.5s. Estimated remaining: 1h 2m 23s. Rate: 7.8 symbols/min [2025-09-30T21:01:59.765475] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:01:59.779239] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T21:01:59.814808] [DEBUG] [LOCAL ] SD: Loaded 28722 existing records from primary storage. [2025-09-30T21:01:59.815079] [INFO ] [MAIN ] SD: Loaded 28722 existing records. [2025-09-30T21:02:00.010592] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:00.011093] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-30T21:02:00.011162] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-30T21:02:00.011844] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-30T21:02:00.011917] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-30T21:02:00.261624] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-30T21:02:00.444314] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:00.548347] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T21:02:00.552705] [INFO ] [REMOTE ] SCL: Full fetch complete (21224 records). [2025-09-30T21:02:00.552831] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-30T21:02:00.960802] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-30T21:02:00.960916] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-30T21:02:00.961527] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-30T21:02:00.961592] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-30T21:02:00.962812] [DEBUG] [LOCAL ] SCL: Trimmed 21224 records to 14882 (keeping 200 days of data) [2025-09-30T21:02:01.054475] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-30T21:02:01.075596] [DEBUG] [LOCAL ] SCL: Primary data saved (14882 records). [2025-09-30T21:02:01.075737] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-30T21:02:01.075830] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCL took 25.0s. Estimated remaining: 1h 2m 13s. Rate: 7.8 symbols/min [2025-09-30T21:02:01.277527] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:01.295573] [DEBUG] [LOCAL ] SDHC: Loaded 10477 existing records from primary storage. [2025-09-30T21:02:01.296112] [INFO ] [MAIN ] SDHC: Loaded 10477 existing records. [2025-09-30T21:02:01.525072] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:01.525410] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-30T21:02:01.525484] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-30T21:02:01.525899] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-30T21:02:01.525961] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-30T21:02:01.660995] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T21:02:01.859585] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-30T21:02:01.995808] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:02.654416] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-30T21:02:02.828486] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T21:02:03.289203] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T21:02:03.454386] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-30T21:02:03.707543] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T21:02:04.254385] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-30T21:02:04.695102] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T21:02:05.054380] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-30T21:02:05.235357] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T21:02:05.854380] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-30T21:02:06.155713] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T21:02:06.654413] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-30T21:02:06.761730] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T21:02:07.454384] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-30T21:02:07.787766] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T21:02:07.792843] [INFO ] [REMOTE ] SCM: Full fetch complete (28576 records). [2025-09-30T21:02:07.792974] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-30T21:02:08.187851] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-30T21:02:08.187980] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-30T21:02:08.188592] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-30T21:02:08.188635] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-30T21:02:08.189496] [DEBUG] [LOCAL ] SCM: Trimmed 28576 records to 19760 (keeping 200 days of data) [2025-09-30T21:02:08.278516] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-30T21:02:08.320356] [DEBUG] [LOCAL ] SCM: Primary data saved (19760 records). [2025-09-30T21:02:08.320534] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-30T21:02:08.320706] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCM took 26.1s. Estimated remaining: 1h 2m 5s. Rate: 7.8 symbols/min [2025-09-30T21:02:08.509162] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:08.524396] [DEBUG] [LOCAL ] SDHY: Loaded 10460 existing records from primary storage. [2025-09-30T21:02:08.524668] [INFO ] [MAIN ] SDHY: Loaded 10460 existing records. [2025-09-30T21:02:08.726828] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:08.727033] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-30T21:02:08.727082] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-30T21:02:08.727364] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-30T21:02:08.727427] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-30T21:02:09.062171] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-30T21:02:09.125741] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:09.159315] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T21:02:09.559087] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T21:02:09.854430] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-30T21:02:10.161138] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T21:02:10.654367] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-30T21:02:11.459631] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-30T21:02:11.478891] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T21:02:11.534697] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T21:02:12.254379] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-30T21:02:12.690048] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T21:02:13.054389] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-30T21:02:13.162613] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T21:02:13.854356] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-30T21:02:13.955849] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T21:02:14.654413] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-30T21:02:15.166544] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:02:15.454395] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-30T21:02:15.583797] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T21:02:16.254379] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-30T21:02:16.981974] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T21:02:17.054375] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-30T21:02:17.093186] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T21:02:17.854353] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-30T21:02:17.921408] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T21:02:18.497544] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T21:02:18.654376] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-30T21:02:19.339300] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T21:02:19.454376] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-30T21:02:20.254373] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-30T21:02:20.309428] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T21:02:21.054359] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-30T21:02:21.710394] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:02:21.854377] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-30T21:02:22.587072] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T21:02:22.630169] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T21:02:22.654378] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-30T21:02:23.454335] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-30T21:02:23.534700] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T21:02:24.254384] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-30T21:02:24.300508] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T21:02:24.304608] [INFO ] [REMOTE ] SDHC: Full fetch complete (17211 records). [2025-09-30T21:02:24.304783] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-30T21:02:24.790748] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-30T21:02:24.790878] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-30T21:02:24.791322] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-30T21:02:24.791391] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-30T21:02:24.792199] [DEBUG] [LOCAL ] SDHC: Trimmed 17211 records to 10404 (keeping 200 days of data) [2025-09-30T21:02:24.860724] [DEBUG] [LOCAL ] SDHC: Primary data saved (10404 records). [2025-09-30T21:02:24.860889] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-30T21:02:24.860985] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 23.8s. Estimated remaining: 1h 2m 0s. Rate: 7.8 symbols/min [2025-09-30T21:02:25.054761] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-30T21:02:25.081918] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:25.133419] [DEBUG] [LOCAL ] SDRL: Loaded 41692 existing records from primary storage. [2025-09-30T21:02:25.133747] [INFO ] [MAIN ] SDRL: Loaded 41692 existing records. [2025-09-30T21:02:25.343686] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:25.343993] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-30T21:02:25.344046] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-30T21:02:25.344472] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-30T21:02:25.344531] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-30T21:02:25.746352] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T21:02:25.844783] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:25.854377] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-30T21:02:25.919160] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:02:26.654423] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-30T21:02:27.454433] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-30T21:02:27.562551] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T21:02:28.262868] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-30T21:02:28.283825] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:02:28.305568] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T21:02:29.054398] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-30T21:02:29.834215] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T21:02:29.854316] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-30T21:02:30.083417] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T21:02:30.654411] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-30T21:02:30.764858] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T21:02:30.768410] [INFO ] [REMOTE ] SDHY: Full fetch complete (15871 records). [2025-09-30T21:02:30.768714] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-30T21:02:31.179295] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-30T21:02:31.179410] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-30T21:02:31.179853] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-30T21:02:31.179916] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-30T21:02:31.180915] [DEBUG] [LOCAL ] SDHY: Trimmed 15871 records to 10544 (keeping 200 days of data) [2025-09-30T21:02:31.255758] [DEBUG] [LOCAL ] SDHY: Primary data saved (10544 records). [2025-09-30T21:02:31.255909] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-30T21:02:31.256033] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SDHY took 22.9s. Estimated remaining: 1h 1m 52s. Rate: 7.8 symbols/min [2025-09-30T21:02:31.460389] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-30T21:02:31.465729] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:31.467141] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-30T21:02:31.467201] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-30T21:02:31.467339] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-30T21:02:31.467382] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-30T21:02:31.467425] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-30T21:02:31.467464] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-30T21:02:31.898297] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:32.254369] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-30T21:02:32.366170] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T21:02:32.376797] [INFO ] [REMOTE ] SCS: Full fetch complete (60576 records). [2025-09-30T21:02:32.376982] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-30T21:02:32.804725] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-30T21:02:32.804907] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-30T21:02:32.806017] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-30T21:02:32.806095] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-30T21:02:32.807744] [DEBUG] [LOCAL ] SCS: Trimmed 60576 records to 43358 (keeping 200 days of data) [2025-09-30T21:02:32.926041] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:02:33.059517] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-30T21:02:33.125235] [DEBUG] [LOCAL ] SCS: Primary data saved (43358 records). [2025-09-30T21:02:33.125386] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-30T21:02:33.125526] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SCS took 42.1s. Estimated remaining: 1h 1m 43s. Rate: 7.8 symbols/min [2025-09-30T21:02:33.330085] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:33.391759] [DEBUG] [LOCAL ] SEE: Loaded 48292 existing records from primary storage. [2025-09-30T21:02:33.392169] [INFO ] [MAIN ] SEE: Loaded 48292 existing records. [2025-09-30T21:02:33.604881] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:33.605229] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-30T21:02:33.605286] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-30T21:02:33.605843] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-30T21:02:33.605904] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-30T21:02:33.868990] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-30T21:02:34.042861] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T21:02:34.096140] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:34.412166] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T21:02:34.654365] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-30T21:02:35.454381] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-30T21:02:35.701892] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T21:02:36.027414] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T21:02:36.254362] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-30T21:02:37.054341] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-30T21:02:37.181245] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:02:37.854400] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-30T21:02:38.220711] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T21:02:38.278876] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T21:02:38.654427] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-30T21:02:39.180932] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T21:02:39.454378] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-30T21:02:39.915831] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T21:02:39.923723] [INFO ] [REMOTE ] SD: Full fetch complete (40958 records). [2025-09-30T21:02:39.923902] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-30T21:02:40.260763] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-30T21:02:40.401325] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-30T21:02:40.401428] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-30T21:02:40.402335] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-30T21:02:40.402417] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-30T21:02:40.403578] [DEBUG] [LOCAL ] SD: Trimmed 40958 records to 28653 (keeping 200 days of data) [2025-09-30T21:02:40.605162] [DEBUG] [LOCAL ] SD: Primary data saved (28653 records). [2025-09-30T21:02:40.605343] [INFO ] [MAIN ] SD: Full history saved. [2025-09-30T21:02:40.605488] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SD took 41.0s. Estimated remaining: 1h 1m 35s. Rate: 7.8 symbols/min [2025-09-30T21:02:40.802206] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:02:40.820122] [DEBUG] [LOCAL ] SEG: Loaded 13602 existing records from primary storage. [2025-09-30T21:02:40.820388] [INFO ] [MAIN ] SEG: Loaded 13602 existing records. [2025-09-30T21:02:41.020299] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:02:41.020605] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-30T21:02:41.020698] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-30T21:02:41.020997] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-30T21:02:41.021060] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-30T21:02:41.066489] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-30T21:02:41.419083] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:02:41.449235] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T21:02:41.854386] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-30T21:02:41.992396] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T21:02:42.514325] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T21:02:42.622431] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T21:02:42.654319] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-30T21:02:43.454373] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-30T21:02:44.252116] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:02:44.260508] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-30T21:02:45.054411] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-30T21:02:45.127066] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T21:02:45.173073] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:02:45.854359] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-30T21:02:46.654328] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-30T21:02:46.691043] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T21:02:46.897887] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:02:47.454369] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-30T21:02:48.254345] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-30T21:02:48.403234] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T21:02:49.054359] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-30T21:02:49.102186] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T21:02:49.854365] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-30T21:02:50.507150] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-30T21:02:50.635170] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:02:50.654327] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-30T21:02:50.882080] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T21:02:51.454362] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-30T21:02:52.254387] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-30T21:02:52.487484] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T21:02:52.535384] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T21:02:53.054363] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-30T21:02:53.710729] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:02:53.854388] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-30T21:02:54.654408] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-30T21:02:54.721090] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:02:54.804728] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T21:02:55.454346] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-30T21:02:56.254418] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-30T21:02:56.585496] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T21:02:57.054372] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-30T21:02:57.191675] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T21:02:57.854307] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:02:57.854439] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-30T21:02:57.948333] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T21:02:58.654403] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-30T21:02:59.454424] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-30T21:02:59.864358] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T21:03:00.254343] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-30T21:03:00.284305] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T21:03:00.293432] [INFO ] [REMOTE ] SDRL: Full fetch complete (61694 records). [2025-09-30T21:03:00.293618] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-30T21:03:00.721596] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-30T21:03:00.721727] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-30T21:03:00.722913] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-30T21:03:00.722981] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-30T21:03:00.724338] [DEBUG] [LOCAL ] SDRL: Trimmed 61694 records to 41653 (keeping 200 days of data) [2025-09-30T21:03:01.000595] [DEBUG] [LOCAL ] SDRL: Primary data saved (41653 records). [2025-09-30T21:03:01.000787] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-30T21:03:01.000961] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SDRL took 36.1s. Estimated remaining: 1h 1m 31s. Rate: 7.8 symbols/min [2025-09-30T21:03:01.055907] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-30T21:03:01.209470] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:01.279297] [DEBUG] [LOCAL ] SEI: Loaded 49639 existing records from primary storage. [2025-09-30T21:03:01.279791] [INFO ] [MAIN ] SEI: Loaded 49639 existing records. [2025-09-30T21:03:01.461039] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T21:03:01.567619] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:01.573227] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-30T21:03:01.573527] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-30T21:03:01.574627] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-30T21:03:01.577317] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-30T21:03:01.577179] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T21:03:01.859779] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-30T21:03:02.045369] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:02.654419] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-30T21:03:03.266504] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T21:03:03.417118] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T21:03:03.454371] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-30T21:03:04.254535] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-30T21:03:04.330774] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T21:03:04.342173] [INFO ] [REMOTE ] SEE: Full fetch complete (69584 records). [2025-09-30T21:03:04.342356] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-30T21:03:04.488609] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T21:03:04.527272] [INFO ] [REMOTE ] SEG: Full fetch complete (19820 records). [2025-09-30T21:03:04.535855] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-30T21:03:05.067786] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-30T21:03:05.126101] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-30T21:03:05.160225] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-30T21:03:05.187353] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-30T21:03:05.202940] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-30T21:03:05.259744] [DEBUG] [LOCAL ] SEE: Trimmed 69584 records to 48284 (keeping 200 days of data) [2025-09-30T21:03:05.306550] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-30T21:03:05.306693] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-30T21:03:05.307121] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-30T21:03:05.307198] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-30T21:03:05.308793] [DEBUG] [LOCAL ] SEG: Trimmed 19820 records to 13636 (keeping 200 days of data) [2025-09-30T21:03:05.515956] [DEBUG] [LOCAL ] SEG: Primary data saved (13636 records). [2025-09-30T21:03:05.516777] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-30T21:03:05.517248] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEG took 24.9s. Estimated remaining: 1h 1m 22s. Rate: 7.8 symbols/min [2025-09-30T21:03:05.719950] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:05.871763] [DEBUG] [LOCAL ] SEM: Loaded 42796 existing records from primary storage. [2025-09-30T21:03:05.872712] [INFO ] [MAIN ] SEM: Loaded 42796 existing records. [2025-09-30T21:03:06.088981] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:06.090025] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-30T21:03:06.092100] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-30T21:03:06.119144] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-30T21:03:06.119290] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-30T21:03:06.468030] [DEBUG] [LOCAL ] SEE: Primary data saved (48284 records). [2025-09-30T21:03:06.479008] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-30T21:03:06.484312] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEE took 33.4s. Estimated remaining: 1h 1m 13s. Rate: 7.8 symbols/min [2025-09-30T21:03:06.635974] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:06.677811] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-30T21:03:06.765207] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:06.796900] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-30T21:03:06.809622] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-30T21:03:06.848773] [DEBUG] [LOCAL ] SEMR: Loaded 41505 existing records from primary storage. [2025-09-30T21:03:06.849077] [INFO ] [MAIN ] SEMR: Loaded 41505 existing records. [2025-09-30T21:03:07.037940] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T21:03:07.078852] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:07.079055] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-30T21:03:07.079103] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-30T21:03:07.079475] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-30T21:03:07.079534] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-30T21:03:07.455666] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-30T21:03:07.477440] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:07.701816] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T21:03:07.713264] [INFO ] [REMOTE ] SE: Full fetch complete (76685 records). [2025-09-30T21:03:07.713426] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-30T21:03:07.714272] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:03:07.714386] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:03:07.714429] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:03:07.714470] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-30T21:03:07.714592] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-30T21:03:07.714678] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-30T21:03:07.714794] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-09-30T21:03:07.714914] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SE took 36.5s. Estimated remaining: 1h 1m 3s. Rate: 7.8 symbols/min [2025-09-30T21:03:07.901322] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:07.961211] [DEBUG] [LOCAL ] SES: Loaded 51559 existing records from primary storage. [2025-09-30T21:03:07.961538] [INFO ] [MAIN ] SES: Loaded 51559 existing records. [2025-09-30T21:03:08.149476] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:08.149744] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-30T21:03:08.149800] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-30T21:03:08.150509] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-30T21:03:08.150569] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-30T21:03:08.256858] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-30T21:03:08.569019] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:08.610827] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T21:03:09.054432] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-30T21:03:09.187701] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T21:03:09.730420] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:03:09.854375] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-30T21:03:10.296009] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T21:03:10.654391] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-30T21:03:11.454389] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-30T21:03:11.900302] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-30T21:03:12.133546] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:03:12.254408] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-30T21:03:12.688834] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T21:03:13.054351] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-30T21:03:13.854374] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-30T21:03:14.654437] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-30T21:03:14.791950] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:03:14.908601] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-30T21:03:15.160014] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T21:03:15.454421] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-30T21:03:16.108680] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T21:03:16.254397] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-30T21:03:17.054372] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-30T21:03:17.345615] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:03:17.464452] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T21:03:17.854408] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-30T21:03:18.654434] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-30T21:03:19.454378] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-30T21:03:19.608888] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-30T21:03:19.673158] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T21:03:20.259550] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-30T21:03:20.282120] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:03:20.568074] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T21:03:21.054353] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-30T21:03:21.854372] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-30T21:03:22.654323] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-30T21:03:22.896266] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T21:03:23.023834] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-30T21:03:23.454384] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-30T21:03:23.530855] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T21:03:24.254353] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-30T21:03:24.283547] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T21:03:25.043877] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T21:03:25.056112] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-30T21:03:25.854384] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-30T21:03:26.547594] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T21:03:26.654407] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-30T21:03:26.707320] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T21:03:27.018619] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T21:03:27.454396] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-30T21:03:28.254331] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-30T21:03:28.595736] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T21:03:28.714457] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T21:03:29.054370] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-30T21:03:29.681083] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T21:03:29.854357] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-30T21:03:30.654388] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-30T21:03:31.454354] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-30T21:03:31.509821] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-30T21:03:31.680782] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T21:03:32.254377] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-30T21:03:32.316599] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T21:03:33.054367] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-30T21:03:33.234486] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T21:03:33.854391] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-30T21:03:34.487290] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T21:03:34.496538] [INFO ] [REMOTE ] SEM: Full fetch complete (61494 records). [2025-09-30T21:03:34.496752] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-30T21:03:34.657043] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-30T21:03:34.996968] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-30T21:03:34.976974] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-30T21:03:34.997280] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-30T21:03:34.998473] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-30T21:03:35.009634] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-30T21:03:35.014859] [DEBUG] [LOCAL ] SEM: Trimmed 61494 records to 42779 (keeping 200 days of data) [2025-09-30T21:03:35.178803] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T21:03:35.193731] [INFO ] [REMOTE ] SEMR: Full fetch complete (59061 records). [2025-09-30T21:03:35.196004] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-30T21:03:35.460242] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-30T21:03:35.773888] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-30T21:03:35.774865] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-30T21:03:35.776670] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-30T21:03:35.776803] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-30T21:03:35.793794] [DEBUG] [LOCAL ] SEMR: Trimmed 59061 records to 41502 (keeping 200 days of data) [2025-09-30T21:03:35.911233] [DEBUG] [LOCAL ] SEM: Primary data saved (42779 records). [2025-09-30T21:03:35.913382] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-30T21:03:35.915083] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 30.4s. Estimated remaining: 1h 1m 1s. Rate: 7.8 symbols/min [2025-09-30T21:03:36.149156] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:36.317407] [DEBUG] [LOCAL ] SF: Loaded 41603 existing records from primary storage. [2025-09-30T21:03:36.320352] [INFO ] [MAIN ] SF: Loaded 41603 existing records. [2025-09-30T21:03:36.320455] [DEBUG] [LOCAL ] SEMR: Primary data saved (41502 records). [2025-09-30T21:03:36.335159] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-30T21:03:36.373476] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 29.9s. Estimated remaining: 1h 0m 51s. Rate: 7.8 symbols/min [2025-09-30T21:03:36.642948] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:36.649003] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-30T21:03:36.659538] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-30T21:03:36.670209] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-30T21:03:36.685215] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-30T21:03:36.757374] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:36.856215] [DEBUG] [LOCAL ] SFB: Loaded 4000 existing records from primary storage. [2025-09-30T21:03:36.872053] [INFO ] [MAIN ] SFB: Loaded 4000 existing records. [2025-09-30T21:03:37.302493] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:37.374342] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-30T21:03:37.404224] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:37.405209] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-30T21:03:37.404554] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-30T21:03:37.409730] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-30T21:03:37.411148] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-30T21:03:37.411311] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-30T21:03:37.471022] [INFO ] [REMOTE ] SEI: Full fetch complete (69893 records). [2025-09-30T21:03:37.485248] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-30T21:03:38.220348] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:38.241187] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-30T21:03:38.309774] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-30T21:03:38.366287] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-30T21:03:38.366871] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-30T21:03:38.368379] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-30T21:03:38.366781] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-30T21:03:38.368478] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-30T21:03:38.371166] [DEBUG] [LOCAL ] SEI: Trimmed 69893 records to 49645 (keeping 200 days of data) [2025-09-30T21:03:38.623797] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T21:03:38.654361] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-30T21:03:38.730881] [DEBUG] [LOCAL ] SEI: Primary data saved (49645 records). [2025-09-30T21:03:38.731035] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-30T21:03:38.731123] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SEI took 37.7s. Estimated remaining: 1h 0m 42s. Rate: 7.8 symbols/min [2025-09-30T21:03:38.919885] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:38.942270] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T21:03:38.952887] [DEBUG] [LOCAL ] SFBS: Loaded 21030 existing records from primary storage. [2025-09-30T21:03:38.953197] [INFO ] [MAIN ] SFBS: Loaded 21030 existing records. [2025-09-30T21:03:39.155789] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:39.156069] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-30T21:03:39.156130] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-30T21:03:39.156555] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-30T21:03:39.156621] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-30T21:03:39.459594] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-30T21:03:39.594460] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:40.173626] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T21:03:40.254356] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-30T21:03:40.403566] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T21:03:40.498631] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T21:03:40.803500] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T21:03:41.054379] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-30T21:03:41.854326] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-30T21:03:41.960203] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T21:03:41.971615] [INFO ] [REMOTE ] SES: Full fetch complete (74985 records). [2025-09-30T21:03:41.971814] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-30T21:03:42.389443] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-30T21:03:42.389540] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-30T21:03:42.390759] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-30T21:03:42.390829] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-30T21:03:42.392367] [DEBUG] [LOCAL ] SES: Trimmed 74985 records to 51560 (keeping 200 days of data) [2025-09-30T21:03:42.679620] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-30T21:03:42.724732] [DEBUG] [LOCAL ] SES: Primary data saved (51560 records). [2025-09-30T21:03:42.724854] [INFO ] [MAIN ] SES: Full history saved. [2025-09-30T21:03:42.724934] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 35.0s. Estimated remaining: 1h 0m 34s. Rate: 7.8 symbols/min [2025-09-30T21:03:42.915827] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:03:42.965452] [DEBUG] [LOCAL ] SFL: Loaded 45250 existing records from primary storage. [2025-09-30T21:03:42.965817] [INFO ] [MAIN ] SFL: Loaded 45250 existing records. [2025-09-30T21:03:43.161795] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:03:43.162090] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-30T21:03:43.162296] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-30T21:03:43.162978] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-30T21:03:43.163108] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-30T21:03:43.299110] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:03:43.463371] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-30T21:03:43.578934] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:03:43.840297] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T21:03:44.179156] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T21:03:44.254371] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-30T21:03:44.929803] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T21:03:45.054377] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-30T21:03:45.854355] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-30T21:03:46.654350] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-30T21:03:46.830036] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T21:03:46.882443] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T21:03:47.454365] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-30T21:03:48.261506] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-30T21:03:48.284694] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:03:49.054324] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-30T21:03:49.251190] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:03:49.358941] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T21:03:49.854331] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-30T21:03:50.654931] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-30T21:03:50.656013] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T21:03:50.684287] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T21:03:51.454349] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-30T21:03:51.994116] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T21:03:52.241734] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:03:52.254302] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-30T21:03:53.054375] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-30T21:03:53.713119] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T21:03:53.721737] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T21:03:53.854387] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-30T21:03:54.654379] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-30T21:03:55.459438] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-30T21:03:55.474870] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:03:56.003699] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T21:03:56.254332] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-30T21:03:56.337625] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T21:03:57.054360] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-30T21:03:57.854342] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-30T21:03:58.002374] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T21:03:58.654319] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-30T21:03:58.843662] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T21:03:58.973265] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T21:03:59.454441] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-30T21:03:59.775161] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T21:03:59.784189] [INFO ] [REMOTE ] SF: Full fetch complete (59778 records). [2025-09-30T21:03:59.784310] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-30T21:04:00.217790] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-30T21:04:00.217930] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-30T21:04:00.219030] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-30T21:04:00.219095] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-30T21:04:00.220428] [DEBUG] [LOCAL ] SF: Trimmed 59778 records to 41564 (keeping 200 days of data) [2025-09-30T21:04:00.278894] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-30T21:04:00.496987] [DEBUG] [LOCAL ] SF: Primary data saved (41564 records). [2025-09-30T21:04:00.497124] [INFO ] [MAIN ] SF: Full history saved. [2025-09-30T21:04:00.497203] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SF took 24.6s. Estimated remaining: 1h 0m 28s. Rate: 7.8 symbols/min [2025-09-30T21:04:00.732869] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:00.789541] [DEBUG] [LOCAL ] SG: Loaded 53451 existing records from primary storage. [2025-09-30T21:04:00.789930] [INFO ] [MAIN ] SG: Loaded 53451 existing records. [2025-09-30T21:04:00.991744] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:00.992109] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-30T21:04:00.992192] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-30T21:04:00.999931] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-30T21:04:01.009809] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-30T21:04:01.056809] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-30T21:04:01.064796] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T21:04:01.420238] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:01.697355] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T21:04:01.699017] [INFO ] [REMOTE ] SFB: Full fetch complete (5918 records). [2025-09-30T21:04:01.699118] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-30T21:04:01.863252] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-30T21:04:02.139324] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T21:04:02.177210] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-30T21:04:02.177323] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-30T21:04:02.177878] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-30T21:04:02.177941] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-30T21:04:02.178417] [DEBUG] [LOCAL ] SFB: Trimmed 5918 records to 4105 (keeping 200 days of data) [2025-09-30T21:04:02.204431] [DEBUG] [LOCAL ] SFB: Primary data saved (4105 records). [2025-09-30T21:04:02.204581] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-30T21:04:02.204737] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFB took 25.8s. Estimated remaining: 1h 0m 19s. Rate: 7.8 symbols/min [2025-09-30T21:04:02.387852] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:02.440282] [DEBUG] [LOCAL ] SGHC: Loaded 45832 existing records from primary storage. [2025-09-30T21:04:02.440776] [INFO ] [MAIN ] SGHC: Loaded 45832 existing records. [2025-09-30T21:04:02.653667] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:02.653902] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-30T21:04:02.653951] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-30T21:04:02.654339] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-30T21:04:02.655241] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-30T21:04:02.655304] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-30T21:04:03.043611] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:03.454376] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-30T21:04:03.904736] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T21:04:04.254337] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-30T21:04:04.431857] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:04:04.565351] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T21:04:05.054379] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-30T21:04:05.854379] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-30T21:04:06.118911] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T21:04:06.322358] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T21:04:06.654403] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-30T21:04:07.331335] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:04:07.454397] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-30T21:04:08.254375] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-30T21:04:08.381250] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:04:08.957541] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T21:04:09.054387] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-30T21:04:09.765815] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T21:04:09.854400] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-30T21:04:10.654518] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-30T21:04:11.170089] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T21:04:11.465456] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-30T21:04:11.471069] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:04:11.871041] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T21:04:12.254372] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-30T21:04:13.054361] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-30T21:04:13.458965] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T21:04:13.854357] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-30T21:04:13.937011] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:04:14.174881] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T21:04:14.654367] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-30T21:04:15.454377] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-30T21:04:15.934977] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T21:04:16.254396] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-30T21:04:16.382925] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T21:04:17.054347] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-30T21:04:17.276789] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T21:04:17.423146] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T21:04:17.854354] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-30T21:04:18.654345] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-30T21:04:18.813261] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T21:04:18.953699] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T21:04:19.454412] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-30T21:04:20.254337] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-30T21:04:20.319200] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:04:21.054350] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-30T21:04:21.661821] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T21:04:21.849986] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T21:04:21.859320] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-30T21:04:21.861084] [INFO ] [REMOTE ] SFL: Full fetch complete (65639 records). [2025-09-30T21:04:21.861207] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-30T21:04:22.307469] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T21:04:22.307594] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-30T21:04:22.307768] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-30T21:04:22.314035] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-30T21:04:22.314192] [INFO ] [REMOTE ] SFBS: Full fetch complete (30212 records). [2025-09-30T21:04:22.314312] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-30T21:04:22.314415] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-30T21:04:22.430705] [DEBUG] [LOCAL ] SFL: Trimmed 65639 records to 45266 (keeping 200 days of data) [2025-09-30T21:04:22.656876] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-30T21:04:22.856587] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-30T21:04:22.857316] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-30T21:04:22.858716] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-30T21:04:22.859446] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-30T21:04:22.861865] [DEBUG] [LOCAL ] SFBS: Trimmed 30212 records to 21044 (keeping 200 days of data) [2025-09-30T21:04:23.165124] [DEBUG] [LOCAL ] SFL: Primary data saved (45266 records). [2025-09-30T21:04:23.166695] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-30T21:04:23.168735] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 40.4s. Estimated remaining: 1h 0m 15s. Rate: 7.8 symbols/min [2025-09-30T21:04:23.274584] [DEBUG] [LOCAL ] SFBS: Primary data saved (21044 records). [2025-09-30T21:04:23.286581] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-30T21:04:23.287070] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SFBS took 44.6s. Estimated remaining: 1h 0m 5s. Rate: 7.8 symbols/min [2025-09-30T21:04:23.469605] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:23.491752] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-30T21:04:23.502677] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-30T21:04:23.534037] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-30T21:04:23.569009] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-30T21:04:23.568916] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:23.569309] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-30T21:04:23.569874] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-30T21:04:23.663957] [DEBUG] [LOCAL ] SGU: Loaded 6691 existing records from primary storage. [2025-09-30T21:04:23.677968] [INFO ] [MAIN ] SGU: Loaded 6691 existing records. [2025-09-30T21:04:24.190298] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-30T21:04:24.298852] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-30T21:04:24.308217] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:24.326874] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-30T21:04:24.332260] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-30T21:04:24.354727] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-30T21:04:24.396527] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-30T21:04:24.403720] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:24.422761] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-30T21:04:24.777386] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:04:24.816255] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-30T21:04:24.822235] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:04:24.822127] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:24.822683] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-30T21:04:24.822794] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:04:24.823276] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-30T21:04:24.823667] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-30T21:04:24.823808] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-30T21:04:24.823911] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-30T21:04:24.824003] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGI took 1.7s. Estimated remaining: 59m 56s. Rate: 7.8 symbols/min [2025-09-30T21:04:24.969845] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-30T21:04:25.056281] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-30T21:04:25.056210] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:25.115323] [DEBUG] [LOCAL ] SHAK: Loaded 49035 existing records from primary storage. [2025-09-30T21:04:25.115699] [INFO ] [MAIN ] SHAK: Loaded 49035 existing records. [2025-09-30T21:04:25.302602] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:25.302851] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-30T21:04:25.302898] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-30T21:04:25.303449] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-30T21:04:25.303508] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-30T21:04:25.687794] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:25.854385] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-30T21:04:26.128851] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T21:04:26.579808] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T21:04:26.654312] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-30T21:04:27.177621] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T21:04:27.189556] [INFO ] [REMOTE ] SG: Full fetch complete (77271 records). [2025-09-30T21:04:27.189783] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-30T21:04:27.466719] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-30T21:04:27.617078] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-30T21:04:27.617174] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-30T21:04:27.618373] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-30T21:04:27.618444] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-30T21:04:27.620407] [DEBUG] [LOCAL ] SG: Trimmed 77271 records to 53450 (keeping 200 days of data) [2025-09-30T21:04:27.959182] [DEBUG] [LOCAL ] SG: Primary data saved (53450 records). [2025-09-30T21:04:27.959327] [INFO ] [MAIN ] SG: Full history saved. [2025-09-30T21:04:27.959410] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SG took 27.5s. Estimated remaining: 59m 47s. Rate: 7.8 symbols/min [2025-09-30T21:04:28.147774] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:28.181785] [DEBUG] [LOCAL ] SHCO: Loaded 25899 existing records from primary storage. [2025-09-30T21:04:28.182196] [INFO ] [MAIN ] SHCO: Loaded 25899 existing records. [2025-09-30T21:04:28.259268] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-30T21:04:28.301912] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T21:04:28.397696] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:28.398055] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-30T21:04:28.398237] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-30T21:04:28.398570] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-30T21:04:28.398725] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-30T21:04:28.832887] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:28.835472] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-30T21:04:28.846910] [INFO ] [REMOTE ] SGHC: Full fetch complete (63582 records). [2025-09-30T21:04:28.847070] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-30T21:04:29.066720] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-30T21:04:29.276980] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-30T21:04:29.277083] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-30T21:04:29.278173] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-30T21:04:29.278237] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-30T21:04:29.279528] [DEBUG] [LOCAL ] SGHC: Trimmed 63582 records to 45946 (keeping 200 days of data) [2025-09-30T21:04:29.573767] [DEBUG] [LOCAL ] SGHC: Primary data saved (45946 records). [2025-09-30T21:04:29.573908] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-30T21:04:29.574034] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SGHC took 27.4s. Estimated remaining: 59m 38s. Rate: 7.8 symbols/min [2025-09-30T21:04:29.765361] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:29.790251] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:04:29.845116] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T21:04:29.865080] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-30T21:04:29.868347] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-09-30T21:04:29.868761] [INFO ] [MAIN ] SHEL: Loaded 53671 existing records. [2025-09-30T21:04:30.066976] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:30.067259] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-30T21:04:30.067309] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-30T21:04:30.068780] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-30T21:04:30.068842] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-30T21:04:30.455183] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:30.625621] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T21:04:30.654360] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-30T21:04:31.280948] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T21:04:31.454406] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-30T21:04:32.254372] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-30T21:04:32.924611] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T21:04:33.054570] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-30T21:04:33.342563] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T21:04:33.854374] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-30T21:04:34.291589] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T21:04:34.654361] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-30T21:04:35.454330] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-30T21:04:35.626866] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T21:04:35.817836] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T21:04:36.185895] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T21:04:36.254373] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-30T21:04:37.054371] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-30T21:04:37.539723] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T21:04:37.854369] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-30T21:04:38.654442] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-30T21:04:38.771090] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T21:04:39.004069] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T21:04:39.454394] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-30T21:04:40.254336] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-30T21:04:40.520379] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T21:04:40.862370] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T21:04:40.902382] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T21:04:41.054361] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-30T21:04:41.856717] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-30T21:04:41.859261] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T21:04:41.862820] [INFO ] [REMOTE ] SGU: Full fetch complete (8999 records). [2025-09-30T21:04:41.863025] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-30T21:04:42.276691] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-30T21:04:42.276778] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-30T21:04:42.277024] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-30T21:04:42.277097] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-30T21:04:42.277688] [DEBUG] [LOCAL ] SGU: Trimmed 8999 records to 6718 (keeping 200 days of data) [2025-09-30T21:04:42.322829] [DEBUG] [LOCAL ] SGU: Primary data saved (6718 records). [2025-09-30T21:04:42.322977] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-30T21:04:42.323125] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SGU took 19.0s. Estimated remaining: 59m 32s. Rate: 7.8 symbols/min [2025-09-30T21:04:42.511074] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:42.552172] [DEBUG] [LOCAL ] SHG: Loaded 26594 existing records from primary storage. [2025-09-30T21:04:42.552894] [INFO ] [MAIN ] SHG: Loaded 26594 existing records. [2025-09-30T21:04:42.660116] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-30T21:04:42.755109] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:42.755371] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-30T21:04:42.755446] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-30T21:04:42.755931] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-30T21:04:42.756008] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-30T21:04:43.151727] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:43.170830] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T21:04:43.454380] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-30T21:04:44.254370] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-30T21:04:44.637232] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:04:44.782978] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T21:04:45.054353] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-30T21:04:45.854333] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-30T21:04:46.261765] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T21:04:46.654328] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-30T21:04:46.823592] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T21:04:46.940624] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T21:04:47.454354] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-30T21:04:48.254355] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-30T21:04:48.494944] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T21:04:49.007205] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T21:04:49.054329] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-30T21:04:49.854360] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-30T21:04:50.379560] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T21:04:50.654386] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-30T21:04:50.798003] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T21:04:51.207814] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T21:04:51.454311] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-30T21:04:51.481415] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T21:04:52.254405] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-30T21:04:53.054393] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-30T21:04:53.142858] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T21:04:53.854403] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-30T21:04:54.417342] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T21:04:54.618500] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T21:04:54.654318] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-30T21:04:54.911315] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T21:04:55.454411] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-30T21:04:56.022252] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T21:04:56.032193] [INFO ] [REMOTE ] SHCO: Full fetch complete (37753 records). [2025-09-30T21:04:56.032415] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-30T21:04:56.259516] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-30T21:04:56.432826] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-30T21:04:56.432915] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-30T21:04:56.433719] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-30T21:04:56.433783] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-30T21:04:56.434665] [DEBUG] [LOCAL ] SHCO: Trimmed 37753 records to 25925 (keeping 200 days of data) [2025-09-30T21:04:56.605307] [DEBUG] [LOCAL ] SHCO: Primary data saved (25925 records). [2025-09-30T21:04:56.605453] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-30T21:04:56.605579] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 28.6s. Estimated remaining: 59m 25s. Rate: 7.8 symbols/min [2025-09-30T21:04:56.779339] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:04:56.834524] [DEBUG] [LOCAL ] SHO: Loaded 49778 existing records from primary storage. [2025-09-30T21:04:56.834918] [INFO ] [MAIN ] SHO: Loaded 49778 existing records. [2025-09-30T21:04:57.021106] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:04:57.021321] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-30T21:04:57.021369] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-30T21:04:57.022013] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-30T21:04:57.022085] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-30T21:04:57.066942] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-30T21:04:57.416556] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:04:57.450945] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T21:04:57.854380] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-30T21:04:58.050031] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T21:04:58.353046] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T21:04:58.654385] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-30T21:04:59.454307] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-30T21:04:59.860415] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T21:05:00.254413] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-30T21:05:00.373913] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T21:05:01.054420] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-30T21:05:01.434240] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T21:05:01.463834] [INFO ] [REMOTE ] SHAK: Full fetch complete (70240 records). [2025-09-30T21:05:01.465689] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T21:05:01.465883] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-30T21:05:01.859588] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-30T21:05:01.985274] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-30T21:05:01.985355] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-30T21:05:01.986507] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-30T21:05:01.986572] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-30T21:05:01.988070] [DEBUG] [LOCAL ] SHAK: Trimmed 70240 records to 48993 (keeping 200 days of data) [2025-09-30T21:05:02.308282] [DEBUG] [LOCAL ] SHAK: Primary data saved (48993 records). [2025-09-30T21:05:02.308448] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-30T21:05:02.308575] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHAK took 37.5s. Estimated remaining: 59m 17s. Rate: 7.8 symbols/min [2025-09-30T21:05:02.545553] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:02.553893] [DEBUG] [LOCAL ] SHOC: Loaded 3522 existing records from primary storage. [2025-09-30T21:05:02.554182] [INFO ] [MAIN ] SHOC: Loaded 3522 existing records. [2025-09-30T21:05:02.661192] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-30T21:05:02.853349] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:02.853714] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-30T21:05:02.853810] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-30T21:05:02.854084] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-30T21:05:02.854161] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-30T21:05:03.329265] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T21:05:03.459431] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-30T21:05:03.603128] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-30T21:05:03.680245] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:04.254363] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-30T21:05:04.407053] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T21:05:04.475498] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T21:05:05.054392] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-30T21:05:05.854388] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-30T21:05:06.117807] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T21:05:06.654455] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-30T21:05:06.717775] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T21:05:06.878757] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T21:05:07.454380] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-30T21:05:08.254367] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-30T21:05:08.277660] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T21:05:08.438846] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T21:05:08.452707] [INFO ] [REMOTE ] SHEL: Full fetch complete (77691 records). [2025-09-30T21:05:08.452905] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-30T21:05:08.885908] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-30T21:05:08.886008] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-30T21:05:08.887281] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-30T21:05:08.887354] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-30T21:05:08.888974] [DEBUG] [LOCAL ] SHEL: Trimmed 77691 records to 53671 (keeping 200 days of data) [2025-09-30T21:05:09.086450] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-30T21:05:09.259796] [DEBUG] [LOCAL ] SHEL: Primary data saved (53671 records). [2025-09-30T21:05:09.260075] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-30T21:05:09.260187] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHEL took 39.7s. Estimated remaining: 59m 9s. Rate: 7.8 symbols/min [2025-09-30T21:05:09.456925] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:09.516071] [DEBUG] [LOCAL ] SHW: Loaded 50382 existing records from primary storage. [2025-09-30T21:05:09.516415] [INFO ] [MAIN ] SHW: Loaded 50382 existing records. [2025-09-30T21:05:09.712873] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:09.713196] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-30T21:05:09.713245] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-30T21:05:09.714280] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-30T21:05:09.714374] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-30T21:05:09.857659] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-30T21:05:10.116927] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:10.163787] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T21:05:10.168897] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T21:05:10.654375] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-30T21:05:10.819198] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T21:05:11.454377] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-30T21:05:11.954156] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T21:05:11.961301] [INFO ] [REMOTE ] SHG: Full fetch complete (41289 records). [2025-09-30T21:05:11.961464] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-30T21:05:12.256147] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-30T21:05:12.303706] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T21:05:12.451627] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-30T21:05:12.451774] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-30T21:05:12.452714] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-30T21:05:12.452783] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-30T21:05:12.453914] [DEBUG] [LOCAL ] SHG: Trimmed 41289 records to 26602 (keeping 200 days of data) [2025-09-30T21:05:12.631435] [DEBUG] [LOCAL ] SHG: Primary data saved (26602 records). [2025-09-30T21:05:12.631639] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-30T21:05:12.631781] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHG took 30.3s. Estimated remaining: 59m 1s. Rate: 7.8 symbols/min [2025-09-30T21:05:12.819041] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:12.819219] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-30T21:05:12.819258] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-30T21:05:12.819379] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-30T21:05:12.819421] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-30T21:05:12.819461] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-30T21:05:12.819494] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-30T21:05:13.056694] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-30T21:05:13.125502] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T21:05:13.215720] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:13.852521] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T21:05:13.856443] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-30T21:05:14.654361] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-30T21:05:15.328972] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:05:15.454374] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-30T21:05:15.891666] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T21:05:16.254395] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-30T21:05:16.882748] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T21:05:17.054349] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-30T21:05:17.317233] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T21:05:17.335457] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:05:17.335822] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-30T21:05:17.335988] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:05:17.336083] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-30T21:05:17.336170] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:05:17.336321] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-30T21:05:17.336407] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-30T21:05:17.336458] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-30T21:05:17.336541] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-30T21:05:17.336610] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SI took 4.7s. Estimated remaining: 58m 52s. Rate: 7.8 symbols/min [2025-09-30T21:05:17.529937] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:17.587179] [DEBUG] [LOCAL ] SID: Loaded 42361 existing records from primary storage. [2025-09-30T21:05:17.587508] [INFO ] [MAIN ] SID: Loaded 42361 existing records. [2025-09-30T21:05:17.787394] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:17.787694] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-30T21:05:17.787789] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-30T21:05:17.788389] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-30T21:05:17.788449] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-30T21:05:17.859492] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-30T21:05:18.167573] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:18.659969] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-30T21:05:18.662085] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T21:05:19.454381] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-30T21:05:20.254381] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-30T21:05:20.327707] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T21:05:20.532638] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T21:05:21.054393] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-30T21:05:21.603135] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T21:05:21.854344] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-30T21:05:21.896188] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:05:22.654418] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-30T21:05:23.226247] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T21:05:23.454335] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-30T21:05:23.692046] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T21:05:23.971016] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T21:05:24.254394] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-30T21:05:24.824326] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T21:05:25.054385] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-30T21:05:25.854411] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-30T21:05:26.418254] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T21:05:26.419512] [INFO ] [REMOTE ] SHOC: Full fetch complete (7366 records). [2025-09-30T21:05:26.419605] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-30T21:05:26.625435] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T21:05:26.659522] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-30T21:05:26.893516] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-30T21:05:26.893607] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-30T21:05:26.893863] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-30T21:05:26.893918] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-30T21:05:26.894342] [DEBUG] [LOCAL ] SHOC: Trimmed 7366 records to 3506 (keeping 200 days of data) [2025-09-30T21:05:26.917635] [DEBUG] [LOCAL ] SHOC: Primary data saved (3506 records). [2025-09-30T21:05:26.917788] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-30T21:05:26.917916] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHOC took 24.6s. Estimated remaining: 58m 45s. Rate: 7.8 symbols/min [2025-09-30T21:05:27.111135] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:27.168631] [DEBUG] [LOCAL ] SIG: Loaded 46323 existing records from primary storage. [2025-09-30T21:05:27.169031] [INFO ] [MAIN ] SIG: Loaded 46323 existing records. [2025-09-30T21:05:27.371263] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:27.371514] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-30T21:05:27.371565] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-30T21:05:27.372259] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-30T21:05:27.372323] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-30T21:05:27.459585] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-30T21:05:27.772245] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:28.068058] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T21:05:28.254360] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-30T21:05:28.532413] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T21:05:29.054383] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-30T21:05:29.610300] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T21:05:29.854392] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-30T21:05:30.654338] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-30T21:05:30.847815] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T21:05:31.454353] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-30T21:05:31.571682] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T21:05:31.907163] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T21:05:31.946857] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T21:05:32.254367] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-30T21:05:33.054356] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-30T21:05:33.109814] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:05:33.854404] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-30T21:05:34.654386] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-30T21:05:34.774123] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T21:05:34.787079] [INFO ] [REMOTE ] SHO: Full fetch complete (71083 records). [2025-09-30T21:05:34.787243] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-30T21:05:35.202870] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-30T21:05:35.202955] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-30T21:05:35.204078] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-30T21:05:35.204143] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-30T21:05:35.205812] [DEBUG] [LOCAL ] SHO: Trimmed 71083 records to 49720 (keeping 200 days of data) [2025-09-30T21:05:35.454370] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-30T21:05:35.532528] [DEBUG] [LOCAL ] SHO: Primary data saved (49720 records). [2025-09-30T21:05:35.532738] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-30T21:05:35.532836] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHO took 38.9s. Estimated remaining: 58m 37s. Rate: 7.8 symbols/min [2025-09-30T21:05:35.721149] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:35.751404] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T21:05:35.784424] [DEBUG] [LOCAL ] SII: Loaded 23405 existing records from primary storage. [2025-09-30T21:05:35.784790] [INFO ] [MAIN ] SII: Loaded 23405 existing records. [2025-09-30T21:05:36.000841] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:36.001226] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-30T21:05:36.001460] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-30T21:05:36.001866] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-30T21:05:36.001931] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-30T21:05:36.259777] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-30T21:05:36.439306] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:36.442308] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T21:05:36.486911] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T21:05:37.054364] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-30T21:05:37.845378] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T21:05:37.854306] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-30T21:05:38.665326] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-30T21:05:38.671138] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T21:05:39.454354] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-30T21:05:39.536150] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:05:39.765761] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T21:05:40.254366] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-30T21:05:41.054354] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-30T21:05:41.296753] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:05:41.640579] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T21:05:41.854347] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-30T21:05:41.958353] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T21:05:42.654394] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-30T21:05:42.875271] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:05:43.454362] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-30T21:05:44.115875] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:05:44.254387] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-30T21:05:44.957621] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T21:05:45.023531] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T21:05:45.037485] [INFO ] [REMOTE ] SID: Full fetch complete (60838 records). [2025-09-30T21:05:45.037708] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-30T21:05:45.060161] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-30T21:05:45.468884] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-30T21:05:45.468977] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-30T21:05:45.469976] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-30T21:05:45.470044] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-30T21:05:45.471496] [DEBUG] [LOCAL ] SID: Trimmed 60838 records to 42311 (keeping 200 days of data) [2025-09-30T21:05:45.723605] [DEBUG] [LOCAL ] SID: Primary data saved (42311 records). [2025-09-30T21:05:45.723765] [INFO ] [MAIN ] SID: Full history saved. [2025-09-30T21:05:45.723868] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SID took 28.4s. Estimated remaining: 58m 30s. Rate: 7.8 symbols/min [2025-09-30T21:05:45.859473] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-30T21:05:45.910568] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:45.945192] [DEBUG] [LOCAL ] SILA: Loaded 31020 existing records from primary storage. [2025-09-30T21:05:45.945519] [INFO ] [MAIN ] SILA: Loaded 31020 existing records. [2025-09-30T21:05:46.142816] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:46.143035] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-30T21:05:46.143083] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-30T21:05:46.143420] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-30T21:05:46.143479] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-30T21:05:46.537497] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:46.589058] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T21:05:46.630743] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T21:05:46.642086] [INFO ] [REMOTE ] SHW: Full fetch complete (72642 records). [2025-09-30T21:05:46.642253] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-30T21:05:46.643087] [FATAL] [VALIDATOR ] SHW: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:05:46.643180] [FATAL] [MAIN ] SHW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:05:46.643229] [WARN ] [MAIN ] SHW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:05:46.643312] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-30T21:05:46.643392] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-09-30T21:05:46.643435] [INFO ] [LOCAL ] SHW: Starting deletion of derivative data. [2025-09-30T21:05:46.644043] [DEBUG] [LOCAL ] SHW: Deleted derivative data file. [2025-09-30T21:05:46.644146] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SHW took 37.4s. Estimated remaining: 58m 21s. Rate: 7.8 symbols/min [2025-09-30T21:05:46.659412] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-30T21:05:46.830667] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:05:46.877534] [DEBUG] [LOCAL ] SITC: Loaded 41628 existing records from primary storage. [2025-09-30T21:05:46.877943] [INFO ] [MAIN ] SITC: Loaded 41628 existing records. [2025-09-30T21:05:47.077266] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:05:47.077495] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-30T21:05:47.077553] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-30T21:05:47.078254] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-30T21:05:47.078317] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-30T21:05:47.472175] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-30T21:05:47.481353] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:05:48.055954] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T21:05:48.254395] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-30T21:05:49.054336] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-30T21:05:49.250971] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:05:49.699927] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:05:49.854391] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-30T21:05:50.084999] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T21:05:50.654397] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-30T21:05:50.875281] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:05:51.454410] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-30T21:05:51.923470] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T21:05:52.254364] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-30T21:05:52.989079] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T21:05:53.054349] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-30T21:05:53.854403] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-30T21:05:54.196303] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T21:05:54.378680] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-30T21:05:54.654410] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-30T21:05:55.164139] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:05:55.454409] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-30T21:05:56.058698] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T21:05:56.254397] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-30T21:05:57.054373] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-30T21:05:57.137801] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T21:05:57.473224] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T21:05:57.854409] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-30T21:05:58.675495] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-30T21:05:58.692695] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T21:05:59.086367] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T21:05:59.454414] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-30T21:05:59.905082] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T21:06:00.254409] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-30T21:06:00.844873] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T21:06:01.054401] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-30T21:06:01.674917] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T21:06:01.854412] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-30T21:06:02.490496] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T21:06:02.654385] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-30T21:06:03.454333] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-30T21:06:03.712120] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T21:06:03.721803] [INFO ] [REMOTE ] SIG: Full fetch complete (67967 records). [2025-09-30T21:06:03.721957] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-30T21:06:04.144214] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-30T21:06:04.144302] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-30T21:06:04.145296] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-30T21:06:04.145361] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-30T21:06:04.146830] [DEBUG] [LOCAL ] SIG: Trimmed 67967 records to 46241 (keeping 200 days of data) [2025-09-30T21:06:04.257844] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-30T21:06:04.450792] [DEBUG] [LOCAL ] SIG: Primary data saved (46241 records). [2025-09-30T21:06:04.450943] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-30T21:06:04.451030] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 37.5s. Estimated remaining: 58m 16s. Rate: 7.8 symbols/min [2025-09-30T21:06:04.783475] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-30T21:06:05.054486] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-30T21:06:06.002545] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-30T21:06:06.010204] [INFO ] [REMOTE ] SII: Full fetch complete (30092 records). [2025-09-30T21:06:06.010377] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-30T21:06:06.438225] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-30T21:06:06.445221] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-30T21:06:06.458275] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-30T21:06:06.458761] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-30T21:06:06.460551] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T21:06:06.469010] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-30T21:06:06.469955] [DEBUG] [LOCAL ] SII: Trimmed 30092 records to 23525 (keeping 200 days of data) [2025-09-30T21:06:06.650923] [DEBUG] [LOCAL ] SII: Primary data saved (23525 records). [2025-09-30T21:06:06.651535] [INFO ] [MAIN ] SII: Full history saved. [2025-09-30T21:06:06.653259] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SII took 31.1s. Estimated remaining: 58m 7s. Rate: 7.8 symbols/min [2025-09-30T21:06:06.653045] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-30T21:06:06.663298] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-30T21:06:07.929047] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:06:07.935895] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-30T21:06:08.138639] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T21:06:08.254436] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-30T21:06:09.225846] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T21:06:09.232258] [INFO ] [REMOTE ] SILA: Full fetch complete (45058 records). [2025-09-30T21:06:09.232403] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-30T21:06:09.682829] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-30T21:06:09.683063] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-30T21:06:09.684097] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-30T21:06:09.684164] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-30T21:06:09.685317] [DEBUG] [LOCAL ] SILA: Trimmed 45058 records to 30891 (keeping 200 days of data) [2025-09-30T21:06:09.895388] [DEBUG] [LOCAL ] SILA: Primary data saved (30891 records). [2025-09-30T21:06:09.895549] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-30T21:06:09.895637] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SILA took 24.2s. Estimated remaining: 57m 58s. Rate: 7.8 symbols/min [2025-09-30T21:06:09.924888] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:06:09.935148] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-30T21:06:11.584560] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T21:06:11.595523] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-30T21:06:13.166190] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T21:06:13.178546] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-30T21:06:16.360526] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-09-30T21:06:16.370388] [INFO ] [REMOTE ] SITC: Full fetch complete (60981 records). [2025-09-30T21:06:16.370512] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-30T21:06:16.776613] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-30T21:06:16.776730] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-30T21:06:16.777785] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-30T21:06:16.777850] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-30T21:06:16.779139] [DEBUG] [LOCAL ] SITC: Trimmed 60981 records to 41568 (keeping 200 days of data) [2025-09-30T21:06:17.053513] [DEBUG] [LOCAL ] SITC: Primary data saved (41568 records). [2025-09-30T21:06:17.053693] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-30T21:06:17.053996] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 30.4s. Estimated remaining: 57m 50s. Rate: 7.8 symbols/min [2025-09-30T21:06:17.719093] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:17.789509] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:17.811619] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:17.838193] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:17.864367] [DEBUG] [LOCAL ] SJT: Loaded 22132 existing records from primary storage. [2025-09-30T21:06:17.864769] [INFO ] [MAIN ] SJT: Loaded 22132 existing records. [2025-09-30T21:06:18.067162] [DEBUG] [LOCAL ] SITE: Loaded 35027 existing records from primary storage. [2025-09-30T21:06:18.086267] [DEBUG] [LOCAL ] SKE: Loaded 35818 existing records from primary storage. [2025-09-30T21:06:18.086591] [INFO ] [MAIN ] SITE: Loaded 35027 existing records. [2025-09-30T21:06:18.145398] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:18.163621] [INFO ] [MAIN ] SKE: Loaded 35818 existing records. [2025-09-30T21:06:18.163858] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-30T21:06:18.286747] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-30T21:06:18.271106] [DEBUG] [LOCAL ] SJM: Loaded 50123 existing records from primary storage. [2025-09-30T21:06:18.317127] [INFO ] [MAIN ] SJM: Loaded 50123 existing records. [2025-09-30T21:06:18.361689] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-30T21:06:18.393464] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-30T21:06:18.635017] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:18.732585] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-30T21:06:18.752378] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-30T21:06:18.819830] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-30T21:06:18.814511] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:18.846773] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-30T21:06:18.846682] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-30T21:06:18.857958] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-30T21:06:18.964524] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:18.991718] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-30T21:06:19.027113] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-30T21:06:19.016676] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-30T21:06:19.047792] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-30T21:06:19.111308] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-30T21:06:19.142689] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-30T21:06:20.005515] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:20.076585] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-30T21:06:20.091068] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:20.134805] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-30T21:06:20.383319] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:20.401792] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-30T21:06:20.450431] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:20.450811] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-30T21:06:20.979677] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-30T21:06:20.990037] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-30T21:06:21.287179] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T21:06:21.293392] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-30T21:06:21.444113] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:06:21.450339] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-30T21:06:21.874801] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:06:21.882229] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-30T21:06:21.926712] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T21:06:21.936771] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-30T21:06:22.167941] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T21:06:22.172662] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-30T21:06:22.575802] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T21:06:22.586718] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-30T21:06:22.729752] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T21:06:22.735998] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-30T21:06:22.792600] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:06:22.799442] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-30T21:06:23.012669] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T21:06:23.017849] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-30T21:06:23.071615] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T21:06:23.082558] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-30T21:06:23.894117] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T21:06:23.901964] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-30T21:06:23.943353] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T21:06:24.187969] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T21:06:24.254687] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-30T21:06:24.257370] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:06:25.054416] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-30T21:06:25.133591] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T21:06:25.675206] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T21:06:25.854395] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-30T21:06:26.282004] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T21:06:26.654331] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-30T21:06:26.710734] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:06:27.454431] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-30T21:06:27.914045] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T21:06:28.254374] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-30T21:06:29.054376] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-30T21:06:29.231738] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T21:06:29.684138] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:06:29.854359] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-30T21:06:30.654332] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-30T21:06:30.828078] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:06:30.879499] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T21:06:31.172049] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T21:06:31.454394] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-30T21:06:32.254402] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-30T21:06:32.936315] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T21:06:33.054358] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-30T21:06:33.650240] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T21:06:33.854367] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-30T21:06:34.155565] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T21:06:34.654367] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-30T21:06:34.913429] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T21:06:35.454442] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-30T21:06:36.254353] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-30T21:06:36.299042] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:06:36.363707] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T21:06:37.054335] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-30T21:06:37.144375] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T21:06:37.854364] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-30T21:06:38.489374] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T21:06:38.654361] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-30T21:06:38.726187] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T21:06:38.736939] [INFO ] [REMOTE ] SJM: Full fetch complete (71687 records). [2025-09-30T21:06:38.737107] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-30T21:06:38.738277] [FATAL] [VALIDATOR ] SJM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:06:38.738388] [FATAL] [MAIN ] SJM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:06:38.738443] [WARN ] [MAIN ] SJM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:06:38.738514] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-30T21:06:38.738583] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-09-30T21:06:38.738622] [INFO ] [LOCAL ] SJM: Starting deletion of derivative data. [2025-09-30T21:06:38.739067] [DEBUG] [LOCAL ] SJM: Deleted derivative data file. [2025-09-30T21:06:38.739166] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJM took 21.7s. Estimated remaining: 57m 46s. Rate: 7.8 symbols/min [2025-09-30T21:06:38.924045] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:38.933099] [DEBUG] [LOCAL ] SKIL: Loaded 6287 existing records from primary storage. [2025-09-30T21:06:38.933290] [INFO ] [MAIN ] SKIL: Loaded 6287 existing records. [2025-09-30T21:06:39.129725] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:39.129953] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-30T21:06:39.130008] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-30T21:06:39.130232] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-30T21:06:39.130299] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-30T21:06:39.459512] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-30T21:06:39.545091] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:39.771942] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T21:06:39.777439] [INFO ] [REMOTE ] SJT: Full fetch complete (32198 records). [2025-09-30T21:06:39.777605] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-30T21:06:40.208339] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-30T21:06:40.208527] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-30T21:06:40.209244] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-30T21:06:40.209331] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-30T21:06:40.210201] [DEBUG] [LOCAL ] SJT: Trimmed 32198 records to 22341 (keeping 200 days of data) [2025-09-30T21:06:40.255407] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-30T21:06:40.342604] [DEBUG] [LOCAL ] SJT: Primary data saved (22341 records). [2025-09-30T21:06:40.342764] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-30T21:06:40.342891] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SJT took 23.3s. Estimated remaining: 57m 37s. Rate: 7.8 symbols/min [2025-09-30T21:06:40.529864] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:40.546193] [DEBUG] [LOCAL ] SKLZ: Loaded 11939 existing records from primary storage. [2025-09-30T21:06:40.546437] [INFO ] [MAIN ] SKLZ: Loaded 11939 existing records. [2025-09-30T21:06:40.738284] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:40.738451] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-30T21:06:40.738500] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-30T21:06:40.738849] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-30T21:06:40.738909] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-30T21:06:40.949932] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T21:06:41.058982] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-30T21:06:41.174583] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:41.196442] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T21:06:41.854365] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-30T21:06:42.598442] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T21:06:42.654331] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-30T21:06:42.786553] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T21:06:43.454369] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-30T21:06:43.887752] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T21:06:44.175550] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T21:06:44.254358] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-30T21:06:45.054361] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-30T21:06:45.855248] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-30T21:06:45.860935] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T21:06:45.870300] [INFO ] [REMOTE ] SKE: Full fetch complete (50430 records). [2025-09-30T21:06:45.870402] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-30T21:06:45.994843] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T21:06:46.297398] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-30T21:06:46.297483] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-30T21:06:46.298434] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-30T21:06:46.298499] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-30T21:06:46.299603] [DEBUG] [LOCAL ] SKE: Trimmed 50430 records to 35873 (keeping 200 days of data) [2025-09-30T21:06:46.533673] [DEBUG] [LOCAL ] SKE: Primary data saved (35873 records). [2025-09-30T21:06:46.533861] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-30T21:06:46.533990] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKE took 29.5s. Estimated remaining: 57m 29s. Rate: 7.8 symbols/min [2025-09-30T21:06:46.654889] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-30T21:06:46.768991] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:46.806870] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T21:06:46.826326] [DEBUG] [LOCAL ] SKM: Loaded 34959 existing records from primary storage. [2025-09-30T21:06:46.826803] [INFO ] [MAIN ] SKM: Loaded 34959 existing records. [2025-09-30T21:06:47.074473] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:47.074777] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-30T21:06:47.074834] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-30T21:06:47.075325] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-30T21:06:47.075386] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-30T21:06:47.481821] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-30T21:06:47.489133] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:47.744957] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:06:48.254388] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-30T21:06:48.800326] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T21:06:48.808059] [INFO ] [REMOTE ] SITE: Full fetch complete (49481 records). [2025-09-30T21:06:48.808188] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-30T21:06:49.059587] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-30T21:06:49.136410] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T21:06:49.233913] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-30T21:06:49.233999] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-30T21:06:49.234959] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-30T21:06:49.235026] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-30T21:06:49.236268] [DEBUG] [LOCAL ] SITE: Trimmed 49481 records to 35018 (keeping 200 days of data) [2025-09-30T21:06:49.456956] [DEBUG] [LOCAL ] SITE: Primary data saved (35018 records). [2025-09-30T21:06:49.457104] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-30T21:06:49.457190] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SITE took 32.4s. Estimated remaining: 57m 20s. Rate: 7.8 symbols/min [2025-09-30T21:06:49.637698] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:06:49.684310] [DEBUG] [LOCAL ] SKT: Loaded 42517 existing records from primary storage. [2025-09-30T21:06:49.684668] [INFO ] [MAIN ] SKT: Loaded 42517 existing records. [2025-09-30T21:06:49.857478] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-30T21:06:49.878986] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:06:49.879958] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-30T21:06:49.880017] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-30T21:06:49.880577] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-30T21:06:49.880728] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-30T21:06:50.266327] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:06:50.415187] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T21:06:50.654382] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-30T21:06:50.721448] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T21:06:51.454372] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-30T21:06:52.254521] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:06:52.254589] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-30T21:06:52.775543] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T21:06:53.054338] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-30T21:06:53.133529] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T21:06:53.854342] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-30T21:06:54.017637] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T21:06:54.654371] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-30T21:06:54.837727] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T21:06:55.454350] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-30T21:06:55.516174] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T21:06:56.254407] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-30T21:06:56.512201] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T21:06:57.054371] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-30T21:06:57.761754] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T21:06:57.854396] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-30T21:06:58.554164] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T21:06:58.654375] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-30T21:06:58.859025] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:06:59.448361] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:06:59.454306] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-30T21:07:00.254334] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-30T21:07:00.538148] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T21:07:01.054396] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-30T21:07:01.179009] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T21:07:01.854418] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-30T21:07:02.390990] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T21:07:02.654386] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-30T21:07:03.462067] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-30T21:07:03.466688] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:07:03.489720] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T21:07:04.254348] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-30T21:07:04.594426] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T21:07:05.054438] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-30T21:07:05.677677] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T21:07:05.854347] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-30T21:07:06.331717] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T21:07:06.654366] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-30T21:07:06.672724] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:07:07.454410] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-30T21:07:07.580319] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T21:07:07.585445] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18903 records). [2025-09-30T21:07:07.585744] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-30T21:07:08.047082] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-30T21:07:08.047171] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-30T21:07:08.047691] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-30T21:07:08.047764] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-30T21:07:08.048424] [DEBUG] [LOCAL ] SKLZ: Trimmed 18903 records to 11935 (keeping 200 days of data) [2025-09-30T21:07:08.117794] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11935 records). [2025-09-30T21:07:08.117961] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-30T21:07:08.118107] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKLZ took 27.8s. Estimated remaining: 57m 15s. Rate: 7.8 symbols/min [2025-09-30T21:07:08.267278] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-30T21:07:08.302043] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:08.348615] [DEBUG] [LOCAL ] SKY: Loaded 37686 existing records from primary storage. [2025-09-30T21:07:08.348964] [INFO ] [MAIN ] SKY: Loaded 37686 existing records. [2025-09-30T21:07:08.538782] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:08.539008] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-30T21:07:08.539057] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-30T21:07:08.539637] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-30T21:07:08.539719] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-30T21:07:08.942740] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:09.054373] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-30T21:07:09.081671] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T21:07:09.084326] [INFO ] [REMOTE ] SKIL: Full fetch complete (10167 records). [2025-09-30T21:07:09.084496] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-30T21:07:09.233790] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T21:07:09.504238] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-30T21:07:09.504319] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-30T21:07:09.504603] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-30T21:07:09.504700] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-30T21:07:09.505200] [DEBUG] [LOCAL ] SKIL: Trimmed 10167 records to 6305 (keeping 200 days of data) [2025-09-30T21:07:09.542401] [DEBUG] [LOCAL ] SKIL: Primary data saved (6305 records). [2025-09-30T21:07:09.542531] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-30T21:07:09.542629] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKIL took 30.8s. Estimated remaining: 57m 6s. Rate: 7.8 symbols/min [2025-09-30T21:07:09.726729] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:09.747748] [DEBUG] [LOCAL ] SKYH: Loaded 16530 existing records from primary storage. [2025-09-30T21:07:09.748063] [INFO ] [MAIN ] SKYH: Loaded 16530 existing records. [2025-09-30T21:07:09.860439] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-30T21:07:09.951592] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:09.951905] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-30T21:07:09.951969] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-30T21:07:09.952325] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-30T21:07:09.952412] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-30T21:07:10.329523] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:10.654393] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-30T21:07:11.121607] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T21:07:11.454443] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-30T21:07:11.659018] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T21:07:11.882832] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:07:12.254393] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-30T21:07:13.054328] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-30T21:07:13.085606] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T21:07:13.124965] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T21:07:13.854385] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-30T21:07:14.546688] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:07:14.654379] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-30T21:07:15.070194] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T21:07:15.454369] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-30T21:07:15.465225] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T21:07:16.254368] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-30T21:07:17.054534] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-30T21:07:17.100045] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T21:07:17.676229] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T21:07:17.854391] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-30T21:07:18.216494] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T21:07:18.654444] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-30T21:07:18.949742] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T21:07:19.454359] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-30T21:07:19.713964] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T21:07:20.254370] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-30T21:07:20.888280] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T21:07:20.897770] [INFO ] [REMOTE ] SKM: Full fetch complete (48039 records). [2025-09-30T21:07:20.897974] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-30T21:07:21.068774] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-30T21:07:21.348073] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-30T21:07:21.348224] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-30T21:07:21.349251] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-30T21:07:21.349420] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-30T21:07:21.351007] [DEBUG] [LOCAL ] SKM: Trimmed 48039 records to 34975 (keeping 200 days of data) [2025-09-30T21:07:21.374909] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T21:07:21.640321] [DEBUG] [LOCAL ] SKM: Primary data saved (34975 records). [2025-09-30T21:07:21.640490] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-30T21:07:21.640668] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 35.1s. Estimated remaining: 56m 59s. Rate: 7.8 symbols/min [2025-09-30T21:07:21.835808] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:21.854366] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-30T21:07:21.905148] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-30T21:07:21.905493] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-30T21:07:22.103738] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:22.103978] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-30T21:07:22.104042] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-30T21:07:22.104610] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-30T21:07:22.104842] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-30T21:07:22.513221] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:22.538872] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T21:07:22.654378] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-30T21:07:23.105612] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T21:07:23.454364] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-30T21:07:23.606408] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:07:24.254375] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-30T21:07:24.652110] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T21:07:24.905243] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T21:07:25.054383] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-30T21:07:25.854351] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-30T21:07:25.917775] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T21:07:26.654362] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-30T21:07:27.444146] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T21:07:27.453439] [INFO ] [REMOTE ] SKT: Full fetch complete (60237 records). [2025-09-30T21:07:27.453585] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-30T21:07:27.459536] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-30T21:07:27.745703] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:07:27.931728] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-30T21:07:27.931851] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-30T21:07:27.932981] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-30T21:07:27.933109] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-30T21:07:27.934474] [DEBUG] [LOCAL ] SKT: Trimmed 60237 records to 42511 (keeping 200 days of data) [2025-09-30T21:07:28.207538] [DEBUG] [LOCAL ] SKT: Primary data saved (42511 records). [2025-09-30T21:07:28.207702] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-30T21:07:28.207826] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 38.8s. Estimated remaining: 56m 51s. Rate: 7.8 symbols/min [2025-09-30T21:07:28.259473] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-30T21:07:28.405465] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:28.456263] [DEBUG] [LOCAL ] SLF: Loaded 38739 existing records from primary storage. [2025-09-30T21:07:28.456591] [INFO ] [MAIN ] SLF: Loaded 38739 existing records. [2025-09-30T21:07:28.654361] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:28.654623] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-30T21:07:28.654719] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-30T21:07:28.655397] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-30T21:07:28.655458] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-30T21:07:29.064877] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-30T21:07:29.071217] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:29.152509] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T21:07:29.395909] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T21:07:29.677808] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T21:07:29.854372] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-30T21:07:30.654353] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-30T21:07:31.286997] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T21:07:31.454389] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-30T21:07:31.821880] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T21:07:32.254371] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-30T21:07:32.437627] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T21:07:33.054377] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-30T21:07:33.715179] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:07:33.854335] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-30T21:07:33.981904] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T21:07:34.654464] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-30T21:07:35.001891] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T21:07:35.454399] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-30T21:07:36.259535] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-30T21:07:36.282541] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T21:07:36.296278] [INFO ] [REMOTE ] SKY: Full fetch complete (54785 records). [2025-09-30T21:07:36.296564] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-30T21:07:36.787183] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-30T21:07:36.787290] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-30T21:07:36.788668] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-30T21:07:36.788785] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-30T21:07:36.790413] [DEBUG] [LOCAL ] SKY: Trimmed 54785 records to 37750 (keeping 200 days of data) [2025-09-30T21:07:37.033295] [DEBUG] [LOCAL ] SKY: Primary data saved (37750 records). [2025-09-30T21:07:37.033538] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-30T21:07:37.033752] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 28.9s. Estimated remaining: 56m 43s. Rate: 7.8 symbols/min [2025-09-30T21:07:37.059547] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-30T21:07:37.245680] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:37.251342] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T21:07:37.296181] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T21:07:37.350117] [DEBUG] [LOCAL ] SLG: Loaded 45400 existing records from primary storage. [2025-09-30T21:07:37.350490] [INFO ] [MAIN ] SLG: Loaded 45400 existing records. [2025-09-30T21:07:37.575039] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:37.575412] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-30T21:07:37.575472] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-30T21:07:37.576026] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-30T21:07:37.576102] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-30T21:07:37.859500] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-30T21:07:38.028479] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:38.094452] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T21:07:38.654361] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-30T21:07:39.329004] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T21:07:39.332898] [INFO ] [REMOTE ] SKYH: Full fetch complete (22496 records). [2025-09-30T21:07:39.333048] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-30T21:07:39.454562] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-30T21:07:39.797663] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T21:07:39.820340] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-30T21:07:39.820911] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-30T21:07:39.821714] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-30T21:07:39.821819] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-30T21:07:39.822957] [DEBUG] [LOCAL ] SKYH: Trimmed 22496 records to 16576 (keeping 200 days of data) [2025-09-30T21:07:39.926494] [DEBUG] [LOCAL ] SKYH: Primary data saved (16576 records). [2025-09-30T21:07:39.926683] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-30T21:07:39.926791] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 30.4s. Estimated remaining: 56m 35s. Rate: 7.8 symbols/min [2025-09-30T21:07:40.121702] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:40.164276] [DEBUG] [LOCAL ] SLGN: Loaded 40384 existing records from primary storage. [2025-09-30T21:07:40.164585] [INFO ] [MAIN ] SLGN: Loaded 40384 existing records. [2025-09-30T21:07:40.259466] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-30T21:07:40.408524] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:07:40.409179] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-30T21:07:40.409372] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-30T21:07:40.409894] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-30T21:07:40.409965] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-30T21:07:40.838837] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:40.841509] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T21:07:41.054373] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-30T21:07:41.711685] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:07:41.854347] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-30T21:07:42.026461] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T21:07:42.654353] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-30T21:07:43.454322] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-30T21:07:43.487426] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:07:44.247926] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:07:44.257582] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-30T21:07:44.312692] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T21:07:45.054347] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-30T21:07:45.675920] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T21:07:45.686936] [INFO ] [REMOTE ] SLB: Full fetch complete (77350 records). [2025-09-30T21:07:45.687162] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-30T21:07:45.688050] [FATAL] [VALIDATOR ] SLB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:07:45.688143] [FATAL] [MAIN ] SLB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:07:45.688186] [WARN ] [MAIN ] SLB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:07:45.688263] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-30T21:07:45.688327] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-09-30T21:07:45.688363] [INFO ] [LOCAL ] SLB: Starting deletion of derivative data. [2025-09-30T21:07:45.688857] [DEBUG] [LOCAL ] SLB: Deleted derivative data file. [2025-09-30T21:07:45.688959] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 24.0s. Estimated remaining: 56m 26s. Rate: 7.8 symbols/min [2025-09-30T21:07:45.867364] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-30T21:07:45.905491] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T21:07:45.903924] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:45.914351] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-30T21:07:45.914441] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-30T21:07:45.914605] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-30T21:07:45.914680] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-30T21:07:45.914747] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-30T21:07:45.914783] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-30T21:07:46.315779] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:07:46.654368] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-30T21:07:47.016625] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T21:07:47.454359] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-30T21:07:47.556108] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:07:48.254356] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-30T21:07:48.701028] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T21:07:49.054391] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-30T21:07:49.434842] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-30T21:07:49.854375] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-30T21:07:50.317436] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T21:07:50.654403] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-30T21:07:51.112167] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T21:07:51.454360] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-30T21:07:51.831243] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T21:07:52.254384] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-30T21:07:52.993839] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T21:07:53.038223] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:07:53.054323] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-30T21:07:53.854366] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-30T21:07:54.654371] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-30T21:07:54.689459] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T21:07:55.389769] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T21:07:55.454411] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-30T21:07:55.861823] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-30T21:07:56.254358] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-30T21:07:56.490597] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T21:07:56.657313] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T21:07:57.054375] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-30T21:07:57.854425] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-30T21:07:58.654397] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-30T21:07:58.724602] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T21:07:59.007400] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T21:07:59.016017] [INFO ] [REMOTE ] SLF: Full fetch complete (56399 records). [2025-09-30T21:07:59.016179] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-30T21:07:59.105076] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T21:07:59.449401] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-30T21:07:59.449491] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-30T21:07:59.450421] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-30T21:07:59.450487] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-30T21:07:59.451764] [DEBUG] [LOCAL ] SLF: Trimmed 56399 records to 38760 (keeping 200 days of data) [2025-09-30T21:07:59.454359] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-30T21:07:59.704391] [DEBUG] [LOCAL ] SLF: Primary data saved (38760 records). [2025-09-30T21:07:59.704549] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-30T21:07:59.704678] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 31.5s. Estimated remaining: 56m 20s. Rate: 7.8 symbols/min [2025-09-30T21:07:59.897183] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:07:59.943680] [DEBUG] [LOCAL ] SLQT: Loaded 43566 existing records from primary storage. [2025-09-30T21:07:59.944001] [INFO ] [MAIN ] SLQT: Loaded 43566 existing records. [2025-09-30T21:08:00.146242] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:00.146477] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-30T21:08:00.146526] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-30T21:08:00.147142] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-30T21:08:00.147203] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-30T21:08:00.263831] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-30T21:08:00.543702] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:00.737233] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T21:08:01.054363] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-30T21:08:01.205796] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T21:08:01.446112] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-30T21:08:01.854382] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-30T21:08:02.654385] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-30T21:08:03.356699] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T21:08:03.385574] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:08:03.454371] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-30T21:08:03.891829] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T21:08:03.892568] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1049 records). [2025-09-30T21:08:03.892636] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-30T21:08:04.076932] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T21:08:04.077137] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:08:04.077208] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:08:04.077282] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-30T21:08:04.077347] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-30T21:08:04.077386] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-30T21:08:04.077425] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-30T21:08:04.077481] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLNZ took 18.4s. Estimated remaining: 56m 12s. Rate: 7.8 symbols/min [2025-09-30T21:08:04.256617] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:04.255631] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-30T21:08:04.291748] [DEBUG] [LOCAL ] SLVM: Loaded 27843 existing records from primary storage. [2025-09-30T21:08:04.292029] [INFO ] [MAIN ] SLVM: Loaded 27843 existing records. [2025-09-30T21:08:04.493610] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:04.493867] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-30T21:08:04.493915] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-30T21:08:04.494333] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-30T21:08:04.494392] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-30T21:08:04.914011] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:05.054405] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-30T21:08:05.854400] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-30T21:08:05.893785] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T21:08:06.654382] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-30T21:08:06.920360] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T21:08:07.063722] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T21:08:07.454393] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-30T21:08:08.254338] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-30T21:08:08.429987] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T21:08:09.054350] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-30T21:08:09.230961] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T21:08:09.854386] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-30T21:08:10.061242] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:08:10.174887] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T21:08:10.654376] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-30T21:08:11.433391] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:08:11.454317] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-30T21:08:11.550681] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T21:08:12.254356] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-30T21:08:13.010207] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:08:13.054336] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-30T21:08:13.854377] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-30T21:08:13.950596] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T21:08:14.440761] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T21:08:14.654372] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-30T21:08:15.461335] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-30T21:08:15.467178] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T21:08:15.479094] [INFO ] [REMOTE ] SLG: Full fetch complete (65171 records). [2025-09-30T21:08:15.479235] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-30T21:08:15.902172] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-30T21:08:15.902257] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-30T21:08:15.903385] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-30T21:08:15.903457] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-30T21:08:15.904891] [DEBUG] [LOCAL ] SLG: Trimmed 65171 records to 45336 (keeping 200 days of data) [2025-09-30T21:08:16.201744] [DEBUG] [LOCAL ] SLG: Primary data saved (45336 records). [2025-09-30T21:08:16.201881] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-30T21:08:16.201969] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLG took 39.2s. Estimated remaining: 56m 5s. Rate: 7.8 symbols/min [2025-09-30T21:08:16.261083] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-30T21:08:16.401844] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:16.436559] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T21:08:16.502284] [DEBUG] [LOCAL ] SM: Loaded 52302 existing records from primary storage. [2025-09-30T21:08:16.502685] [INFO ] [MAIN ] SM: Loaded 52302 existing records. [2025-09-30T21:08:16.716011] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:16.716416] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-30T21:08:16.716474] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-30T21:08:16.717002] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-30T21:08:16.717066] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-30T21:08:17.040687] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:08:17.068561] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-30T21:08:17.165991] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:17.508797] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T21:08:17.854396] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-30T21:08:18.654445] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-30T21:08:18.805966] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T21:08:19.003289] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T21:08:19.454391] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-30T21:08:20.254349] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-30T21:08:20.439331] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T21:08:20.467192] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T21:08:21.054365] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-30T21:08:21.854404] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-30T21:08:22.108071] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T21:08:22.654334] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-30T21:08:22.778117] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:08:23.100959] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:08:23.454396] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-30T21:08:23.904340] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T21:08:24.254415] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-30T21:08:25.054493] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-30T21:08:25.056442] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:08:25.844094] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T21:08:25.854455] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-30T21:08:26.654386] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-30T21:08:26.885817] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T21:08:27.454365] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-30T21:08:27.605553] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T21:08:28.113049] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:08:28.254361] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-30T21:08:28.889562] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T21:08:28.899449] [INFO ] [REMOTE ] SLGN: Full fetch complete (58399 records). [2025-09-30T21:08:28.899606] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-30T21:08:29.059534] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-30T21:08:29.341149] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-30T21:08:29.341246] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-30T21:08:29.342273] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-30T21:08:29.342342] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-30T21:08:29.343631] [DEBUG] [LOCAL ] SLGN: Trimmed 58399 records to 40385 (keeping 200 days of data) [2025-09-30T21:08:29.590239] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T21:08:29.598549] [INFO ] [REMOTE ] SLVM: Full fetch complete (39732 records). [2025-09-30T21:08:29.599607] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-30T21:08:29.865457] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-30T21:08:30.060527] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-30T21:08:30.060930] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-30T21:08:30.062371] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-30T21:08:30.062462] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-30T21:08:30.065102] [DEBUG] [LOCAL ] SLVM: Trimmed 39732 records to 27905 (keeping 200 days of data) [2025-09-30T21:08:30.205269] [DEBUG] [LOCAL ] SLGN: Primary data saved (40385 records). [2025-09-30T21:08:30.212541] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-30T21:08:30.212738] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLGN took 50.3s. Estimated remaining: 55m 59s. Rate: 7.8 symbols/min [2025-09-30T21:08:30.428179] [DEBUG] [LOCAL ] SLVM: Primary data saved (27905 records). [2025-09-30T21:08:30.441555] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-30T21:08:30.441735] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLVM took 26.4s. Estimated remaining: 55m 49s. Rate: 7.8 symbols/min [2025-09-30T21:08:30.466240] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:30.518220] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-30T21:08:30.544101] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-30T21:08:30.562533] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-30T21:08:30.586289] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-30T21:08:30.589475] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-30T21:08:30.589538] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-30T21:08:30.794404] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:30.906880] [DEBUG] [LOCAL ] SMBK: Loaded 8162 existing records from primary storage. [2025-09-30T21:08:30.924126] [INFO ] [MAIN ] SMBK: Loaded 8162 existing records. [2025-09-30T21:08:31.273460] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:31.342931] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-30T21:08:31.370734] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:31.371862] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-30T21:08:31.372171] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-30T21:08:31.372683] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-30T21:08:31.372803] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-30T21:08:31.451410] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T21:08:31.516169] [INFO ] [REMOTE ] SLQT: Full fetch complete (63568 records). [2025-09-30T21:08:31.574930] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-30T21:08:31.665881] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:08:31.689980] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-30T21:08:31.722003] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-30T21:08:31.831885] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:08:31.868534] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-30T21:08:31.901939] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-30T21:08:31.903850] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:08:31.940761] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-30T21:08:32.057579] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-30T21:08:32.074915] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-30T21:08:32.075081] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-30T21:08:32.088213] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SMA took 1.9s. Estimated remaining: 55m 40s. Rate: 7.8 symbols/min [2025-09-30T21:08:32.289342] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:32.359155] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-30T21:08:32.581095] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:32.604289] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-30T21:08:32.604387] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-30T21:08:32.605637] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-30T21:08:32.605839] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-30T21:08:32.607378] [DEBUG] [LOCAL ] SLQT: Trimmed 63568 records to 43498 (keeping 200 days of data) [2025-09-30T21:08:32.701165] [DEBUG] [LOCAL ] SMC: Loaded 11332 existing records from primary storage. [2025-09-30T21:08:32.704178] [INFO ] [MAIN ] SMC: Loaded 11332 existing records. [2025-09-30T21:08:32.921071] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:32.922887] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-30T21:08:32.924004] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-30T21:08:32.925031] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-30T21:08:32.925723] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-30T21:08:33.459939] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:33.461636] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-30T21:08:33.462451] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T21:08:33.525146] [DEBUG] [LOCAL ] SLQT: Primary data saved (43498 records). [2025-09-30T21:08:33.525307] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-30T21:08:33.525421] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SLQT took 33.8s. Estimated remaining: 55m 31s. Rate: 7.8 symbols/min [2025-09-30T21:08:33.728559] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:33.786228] [DEBUG] [LOCAL ] SMFG: Loaded 48091 existing records from primary storage. [2025-09-30T21:08:33.786614] [INFO ] [MAIN ] SMFG: Loaded 48091 existing records. [2025-09-30T21:08:33.863311] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-30T21:08:34.006953] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:34.007296] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-30T21:08:34.007379] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-30T21:08:34.008075] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-30T21:08:34.008166] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-30T21:08:34.162557] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T21:08:34.505951] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:34.537213] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T21:08:34.608791] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T21:08:34.654365] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-30T21:08:35.407583] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T21:08:35.454340] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-30T21:08:36.254364] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-30T21:08:37.054334] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-30T21:08:37.133029] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T21:08:37.346637] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T21:08:37.854357] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-30T21:08:38.654359] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-30T21:08:38.948665] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T21:08:39.046160] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T21:08:39.454349] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-30T21:08:39.588446] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T21:08:40.254355] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-30T21:08:40.322170] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T21:08:41.054356] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-30T21:08:41.867629] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-30T21:08:41.873609] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T21:08:42.598096] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T21:08:42.654320] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-30T21:08:42.795828] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T21:08:43.454365] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-30T21:08:44.260460] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-30T21:08:44.261588] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T21:08:44.488211] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T21:08:45.054364] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-30T21:08:45.186907] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T21:08:45.854367] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-30T21:08:45.887034] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T21:08:46.654337] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-30T21:08:46.873219] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T21:08:47.454365] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-30T21:08:48.254403] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-30T21:08:49.054346] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-30T21:08:49.237851] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T21:08:49.268166] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T21:08:49.854410] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-30T21:08:50.073797] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (3.42 seconds). [2025-09-30T21:08:50.433521] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T21:08:50.654437] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-30T21:08:51.454389] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-30T21:08:51.547134] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T21:08:51.697111] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T21:08:51.711916] [INFO ] [REMOTE ] SM: Full fetch complete (75296 records). [2025-09-30T21:08:51.712214] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-30T21:08:52.067154] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T21:08:52.145166] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-30T21:08:52.145257] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-30T21:08:52.146492] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-30T21:08:52.146561] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-30T21:08:52.148186] [DEBUG] [LOCAL ] SM: Trimmed 75296 records to 52321 (keeping 200 days of data) [2025-09-30T21:08:52.254689] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-30T21:08:52.492309] [DEBUG] [LOCAL ] SM: Primary data saved (52321 records). [2025-09-30T21:08:52.492467] [INFO ] [MAIN ] SM: Full history saved. [2025-09-30T21:08:52.492594] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SM took 36.3s. Estimated remaining: 55m 26s. Rate: 7.8 symbols/min [2025-09-30T21:08:52.686786] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:52.736939] [DEBUG] [LOCAL ] SMG: Loaded 43774 existing records from primary storage. [2025-09-30T21:08:52.737354] [INFO ] [MAIN ] SMG: Loaded 43774 existing records. [2025-09-30T21:08:52.945754] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:52.953576] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-30T21:08:52.954506] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T21:08:52.954614] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-30T21:08:52.957750] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-30T21:08:52.958184] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-30T21:08:53.059506] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-30T21:08:53.378284] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:53.854379] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-30T21:08:54.654338] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-30T21:08:54.810079] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T21:08:55.112115] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T21:08:55.222019] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T21:08:55.224132] [INFO ] [REMOTE ] SMBK: Full fetch complete (11741 records). [2025-09-30T21:08:55.224237] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-30T21:08:55.459542] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-30T21:08:55.626029] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-30T21:08:55.626119] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-30T21:08:55.626484] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-30T21:08:55.626557] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-30T21:08:55.627167] [DEBUG] [LOCAL ] SMBK: Trimmed 11741 records to 8147 (keeping 200 days of data) [2025-09-30T21:08:55.710084] [DEBUG] [LOCAL ] SMBK: Primary data saved (8147 records). [2025-09-30T21:08:55.710254] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-30T21:08:55.710360] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMBK took 25.3s. Estimated remaining: 55m 17s. Rate: 7.8 symbols/min [2025-09-30T21:08:55.978185] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:55.998762] [DEBUG] [LOCAL ] SMHI: Loaded 13369 existing records from primary storage. [2025-09-30T21:08:55.999090] [INFO ] [MAIN ] SMHI: Loaded 13369 existing records. [2025-09-30T21:08:56.257492] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-30T21:08:56.273113] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:56.273417] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-30T21:08:56.273512] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-30T21:08:56.275232] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-30T21:08:56.275373] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-30T21:08:56.671853] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:57.054347] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-30T21:08:57.129583] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T21:08:57.131950] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T21:08:57.143595] [INFO ] [REMOTE ] SMC: Full fetch complete (16570 records). [2025-09-30T21:08:57.143722] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-30T21:08:57.547849] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-30T21:08:57.548071] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-30T21:08:57.548510] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-30T21:08:57.548558] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-30T21:08:57.549379] [DEBUG] [LOCAL ] SMC: Trimmed 16570 records to 11325 (keeping 200 days of data) [2025-09-30T21:08:57.627229] [DEBUG] [LOCAL ] SMC: Primary data saved (11325 records). [2025-09-30T21:08:57.627378] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-30T21:08:57.627554] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMC took 25.5s. Estimated remaining: 55m 8s. Rate: 7.8 symbols/min [2025-09-30T21:08:57.815412] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:08:57.836943] [DEBUG] [LOCAL ] SMP: Loaded 19461 existing records from primary storage. [2025-09-30T21:08:57.837210] [INFO ] [MAIN ] SMP: Loaded 19461 existing records. [2025-09-30T21:08:57.859500] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-30T21:08:58.031285] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:08:58.031573] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-30T21:08:58.031665] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-30T21:08:58.032289] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-30T21:08:58.032352] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-30T21:08:58.414766] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:08:58.654345] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-30T21:08:58.820681] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T21:08:59.279374] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:08:59.454336] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-30T21:08:59.573682] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T21:09:00.254370] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-30T21:09:01.054349] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-30T21:09:01.119761] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:09:01.620133] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T21:09:01.750956] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T21:09:01.854365] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-30T21:09:02.654356] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-30T21:09:02.907628] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T21:09:03.454367] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-30T21:09:04.254349] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-30T21:09:04.446498] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T21:09:04.701702] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T21:09:05.054369] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-30T21:09:05.103395] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T21:09:05.854415] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-30T21:09:06.654341] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-30T21:09:06.767964] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T21:09:06.813899] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T21:09:07.454360] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-30T21:09:08.262364] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-30T21:09:08.267280] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:09:09.054358] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-30T21:09:09.617116] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T21:09:09.654547] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T21:09:09.854356] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-30T21:09:10.652392] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T21:09:10.656479] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-30T21:09:10.664621] [INFO ] [REMOTE ] SMFG: Full fetch complete (68968 records). [2025-09-30T21:09:10.664912] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-30T21:09:11.102419] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-30T21:09:11.102521] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-30T21:09:11.103575] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-30T21:09:11.108921] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-30T21:09:11.117116] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T21:09:11.122635] [DEBUG] [LOCAL ] SMFG: Trimmed 68968 records to 48125 (keeping 200 days of data) [2025-09-30T21:09:11.435161] [DEBUG] [LOCAL ] SMFG: Primary data saved (48125 records). [2025-09-30T21:09:11.435505] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-30T21:09:11.435814] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMFG took 37.9s. Estimated remaining: 55m 2s. Rate: 7.8 symbols/min [2025-09-30T21:09:11.459685] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-30T21:09:11.631122] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:11.631290] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-30T21:09:11.631327] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-30T21:09:11.631461] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-30T21:09:11.631501] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-30T21:09:11.631585] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-30T21:09:11.631633] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-30T21:09:12.032133] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:12.254403] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-30T21:09:12.508040] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T21:09:12.611058] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T21:09:13.054426] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-30T21:09:13.393981] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T21:09:13.854407] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-30T21:09:14.654342] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-30T21:09:14.969195] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T21:09:15.454368] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-30T21:09:15.870158] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T21:09:16.254342] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-30T21:09:16.467291] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T21:09:16.729094] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-09-30T21:09:17.054364] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-30T21:09:17.235009] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T21:09:17.854414] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-30T21:09:18.028780] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T21:09:18.654384] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-30T21:09:19.454352] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-30T21:09:19.455805] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:09:20.254342] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-30T21:09:20.622357] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T21:09:20.626556] [INFO ] [REMOTE ] SMP: Full fetch complete (26163 records). [2025-09-30T21:09:20.626718] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-30T21:09:21.052421] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-30T21:09:21.052520] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-30T21:09:21.053235] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-30T21:09:21.053313] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-30T21:09:21.054109] [DEBUG] [LOCAL ] SMP: Trimmed 26163 records to 19365 (keeping 200 days of data) [2025-09-30T21:09:21.054517] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-30T21:09:21.180554] [DEBUG] [LOCAL ] SMP: Primary data saved (19365 records). [2025-09-30T21:09:21.180731] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-30T21:09:21.180824] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMP took 23.6s. Estimated remaining: 54m 55s. Rate: 7.8 symbols/min [2025-09-30T21:09:21.361961] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:21.396718] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-30T21:09:21.450117] [DEBUG] [LOCAL ] SMRT: Loaded 43880 existing records from primary storage. [2025-09-30T21:09:21.450487] [INFO ] [MAIN ] SMRT: Loaded 43880 existing records. [2025-09-30T21:09:21.671069] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:21.671357] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-30T21:09:21.671523] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-30T21:09:21.672865] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-30T21:09:21.672943] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-30T21:09:21.862235] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-30T21:09:21.889694] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:09:21.967844] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T21:09:22.134272] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:22.654385] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-30T21:09:23.454388] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-30T21:09:24.232043] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T21:09:24.254334] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-30T21:09:24.404134] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-30T21:09:24.433785] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T21:09:25.054359] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-30T21:09:25.614030] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:09:25.854359] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-30T21:09:26.654389] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-30T21:09:27.116466] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T21:09:27.458475] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-30T21:09:27.461793] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T21:09:27.464794] [INFO ] [REMOTE ] SMHI: Full fetch complete (23491 records). [2025-09-30T21:09:27.464946] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-30T21:09:27.834970] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-30T21:09:27.936664] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-30T21:09:27.936757] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-30T21:09:27.937403] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-30T21:09:27.937491] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-30T21:09:27.938248] [DEBUG] [LOCAL ] SMHI: Trimmed 23491 records to 13229 (keeping 200 days of data) [2025-09-30T21:09:28.029447] [DEBUG] [LOCAL ] SMHI: Primary data saved (13229 records). [2025-09-30T21:09:28.029590] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-30T21:09:28.029725] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMHI took 32.3s. Estimated remaining: 54m 47s. Rate: 7.8 symbols/min [2025-09-30T21:09:28.213554] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:28.251943] [DEBUG] [LOCAL ] SMWB: Loaded 32507 existing records from primary storage. [2025-09-30T21:09:28.252243] [INFO ] [MAIN ] SMWB: Loaded 32507 existing records. [2025-09-30T21:09:28.263811] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-30T21:09:28.445020] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:28.445265] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-30T21:09:28.445383] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-30T21:09:28.446136] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-30T21:09:28.446221] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-30T21:09:28.831561] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:28.856938] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T21:09:29.054397] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-30T21:09:29.854385] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-30T21:09:29.936923] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T21:09:30.589076] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:09:30.654328] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-30T21:09:31.460398] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-30T21:09:31.477968] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T21:09:31.884090] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T21:09:32.254366] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-30T21:09:33.054356] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-30T21:09:33.716143] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-30T21:09:33.787226] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T21:09:33.854321] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-30T21:09:34.281512] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T21:09:34.654372] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-30T21:09:35.301024] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T21:09:35.454349] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-30T21:09:36.253091] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T21:09:36.261788] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-30T21:09:36.263364] [INFO ] [REMOTE ] SMG: Full fetch complete (62726 records). [2025-09-30T21:09:36.263452] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-30T21:09:36.685111] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-30T21:09:36.685197] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-30T21:09:36.686247] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-30T21:09:36.686347] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-30T21:09:36.687782] [DEBUG] [LOCAL ] SMG: Trimmed 62726 records to 43737 (keeping 200 days of data) [2025-09-30T21:09:36.972282] [DEBUG] [LOCAL ] SMG: Primary data saved (43737 records). [2025-09-30T21:09:36.972427] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-30T21:09:36.972516] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMG took 44.5s. Estimated remaining: 54m 40s. Rate: 7.8 symbols/min [2025-09-30T21:09:37.061784] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-30T21:09:37.162685] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:37.191289] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T21:09:37.246521] [DEBUG] [LOCAL ] SN: Loaded 49744 existing records from primary storage. [2025-09-30T21:09:37.246893] [INFO ] [MAIN ] SN: Loaded 49744 existing records. [2025-09-30T21:09:37.432184] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:37.432471] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-30T21:09:37.432525] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-30T21:09:37.434678] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-30T21:09:37.434743] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-30T21:09:37.828368] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:37.854349] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-30T21:09:38.622557] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T21:09:38.654322] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-30T21:09:38.792402] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-30T21:09:39.454353] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-30T21:09:39.590467] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T21:09:39.835887] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:09:40.254358] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-30T21:09:41.054349] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-30T21:09:41.330252] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T21:09:41.699859] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T21:09:41.854350] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-30T21:09:42.654358] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-30T21:09:43.454335] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-30T21:09:43.525404] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:09:43.804912] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-30T21:09:44.028485] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T21:09:44.254345] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-30T21:09:44.873635] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:09:45.054391] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-30T21:09:45.854346] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-30T21:09:45.924104] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T21:09:46.654337] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-30T21:09:46.844949] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T21:09:47.454416] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-30T21:09:47.563783] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T21:09:47.570529] [INFO ] [REMOTE ] SMWB: Full fetch complete (49867 records). [2025-09-30T21:09:47.570684] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-30T21:09:47.974701] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-30T21:09:47.974793] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-30T21:09:47.975737] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-30T21:09:47.975802] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-30T21:09:47.976961] [DEBUG] [LOCAL ] SMWB: Trimmed 49867 records to 32504 (keeping 200 days of data) [2025-09-30T21:09:48.179515] [DEBUG] [LOCAL ] SMWB: Primary data saved (32504 records). [2025-09-30T21:09:48.179696] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-30T21:09:48.179827] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMWB took 20.1s. Estimated remaining: 54m 33s. Rate: 7.8 symbols/min [2025-09-30T21:09:48.258479] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-30T21:09:48.364544] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:48.393548] [DEBUG] [LOCAL ] SNA: Loaded 26015 existing records from primary storage. [2025-09-30T21:09:48.393850] [INFO ] [MAIN ] SNA: Loaded 26015 existing records. [2025-09-30T21:09:48.592261] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:48.592610] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-30T21:09:48.592725] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-30T21:09:48.593476] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-30T21:09:48.593577] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-30T21:09:48.987070] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-09-30T21:09:49.064874] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:49.058638] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-30T21:09:49.336942] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T21:09:49.854331] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-30T21:09:49.958528] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:09:50.296596] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T21:09:50.654356] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-30T21:09:51.458572] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-30T21:09:51.471674] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T21:09:51.616415] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-30T21:09:52.254385] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-30T21:09:52.968127] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T21:09:53.054352] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-30T21:09:53.858758] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-30T21:09:53.872537] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-30T21:09:53.874011] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T21:09:54.654390] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-30T21:09:55.196178] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T21:09:55.204591] [INFO ] [REMOTE ] SMRT: Full fetch complete (62014 records). [2025-09-30T21:09:55.204758] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-30T21:09:55.458592] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-30T21:09:55.644997] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-30T21:09:55.645104] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-30T21:09:55.646165] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-30T21:09:55.646249] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-30T21:09:55.647959] [DEBUG] [LOCAL ] SMRT: Trimmed 62014 records to 43860 (keeping 200 days of data) [2025-09-30T21:09:55.766639] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T21:09:55.779933] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-30T21:09:55.781039] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-30T21:09:55.785087] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:09:55.786219] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:09:55.786926] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:09:55.787348] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-30T21:09:55.790575] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-30T21:09:55.792302] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-30T21:09:55.794296] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-09-30T21:09:55.794987] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 44.4s. Estimated remaining: 54m 25s. Rate: 7.8 symbols/min [2025-09-30T21:09:56.009499] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:56.163115] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-30T21:09:56.164739] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-30T21:09:56.260055] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-30T21:09:56.421574] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:56.423171] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-30T21:09:56.423247] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-30T21:09:56.425244] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-30T21:09:56.425365] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-30T21:09:56.779595] [DEBUG] [LOCAL ] SMRT: Primary data saved (43860 records). [2025-09-30T21:09:56.795533] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-30T21:09:56.806027] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SMRT took 35.6s. Estimated remaining: 54m 16s. Rate: 7.8 symbols/min [2025-09-30T21:09:56.909910] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:57.056492] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-30T21:09:57.060678] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:09:57.090496] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T21:09:57.090729] [DEBUG] [LOCAL ] SNDA: Loaded 4575 existing records from primary storage. [2025-09-30T21:09:57.098516] [INFO ] [MAIN ] SNDA: Loaded 4575 existing records. [2025-09-30T21:09:57.297238] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:09:57.297628] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-30T21:09:57.297723] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-30T21:09:57.298047] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-30T21:09:57.298118] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-30T21:09:57.628404] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T21:09:57.755599] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:09:57.854336] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-30T21:09:58.654332] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-30T21:09:58.940222] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T21:09:59.177079] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T21:09:59.454398] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-30T21:09:59.587597] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-30T21:10:00.154500] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T21:10:00.254418] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-30T21:10:01.023238] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T21:10:01.054387] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-30T21:10:01.854330] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-30T21:10:01.933786] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T21:10:02.654400] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-30T21:10:03.454456] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-30T21:10:04.254347] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-30T21:10:04.387119] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:10:04.432459] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T21:10:04.449435] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T21:10:04.539231] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-30T21:10:05.054406] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-30T21:10:05.802609] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T21:10:05.808238] [INFO ] [REMOTE ] SNA: Full fetch complete (38754 records). [2025-09-30T21:10:05.808343] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-30T21:10:05.809067] [FATAL] [VALIDATOR ] SNA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:10:05.809165] [FATAL] [MAIN ] SNA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:10:05.809225] [WARN ] [MAIN ] SNA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:10:05.809302] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-30T21:10:05.809370] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-09-30T21:10:05.809407] [INFO ] [LOCAL ] SNA: Starting deletion of derivative data. [2025-09-30T21:10:05.809998] [DEBUG] [LOCAL ] SNA: Deleted derivative data file. [2025-09-30T21:10:05.810098] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 17.6s. Estimated remaining: 54m 8s. Rate: 7.8 symbols/min [2025-09-30T21:10:05.859555] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-30T21:10:06.007790] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:06.047625] [DEBUG] [LOCAL ] SNDR: Loaded 40706 existing records from primary storage. [2025-09-30T21:10:06.048078] [INFO ] [MAIN ] SNDR: Loaded 40706 existing records. [2025-09-30T21:10:06.238576] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:10:06.238832] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-30T21:10:06.238888] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-30T21:10:06.240273] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-30T21:10:06.240336] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-30T21:10:06.635919] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:06.654323] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-30T21:10:06.709602] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T21:10:07.454393] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-30T21:10:08.166476] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T21:10:08.254386] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-30T21:10:09.054392] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-30T21:10:09.105714] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-30T21:10:09.854330] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-30T21:10:10.210333] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T21:10:10.540868] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T21:10:10.587582] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:10:10.654428] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-30T21:10:11.454390] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-30T21:10:12.028574] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T21:10:12.254364] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-30T21:10:13.054374] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-30T21:10:13.680573] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-09-30T21:10:13.796240] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T21:10:13.854358] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-30T21:10:14.654370] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-30T21:10:14.749721] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:10:15.392351] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T21:10:15.392135] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T21:10:15.454390] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-30T21:10:16.254406] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-30T21:10:16.990558] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T21:10:17.000877] [INFO ] [REMOTE ] SN: Full fetch complete (70913 records). [2025-09-30T21:10:17.001020] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-30T21:10:17.062534] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-30T21:10:17.454489] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-30T21:10:17.454601] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-30T21:10:17.455802] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-30T21:10:17.455874] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-30T21:10:17.457464] [DEBUG] [LOCAL ] SN: Trimmed 70913 records to 49762 (keeping 200 days of data) [2025-09-30T21:10:17.702686] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T21:10:17.801825] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T21:10:17.822141] [DEBUG] [LOCAL ] SN: Primary data saved (49762 records). [2025-09-30T21:10:17.822307] [INFO ] [MAIN ] SN: Full history saved. [2025-09-30T21:10:17.822401] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SN took 40.8s. Estimated remaining: 54m 2s. Rate: 7.8 symbols/min [2025-09-30T21:10:17.859515] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-30T21:10:18.015920] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:18.057845] [DEBUG] [LOCAL ] SNN: Loaded 44340 existing records from primary storage. [2025-09-30T21:10:18.058196] [INFO ] [MAIN ] SNN: Loaded 44340 existing records. [2025-09-30T21:10:18.251723] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:10:18.251977] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-30T21:10:18.252025] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-30T21:10:18.253182] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-30T21:10:18.253256] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-30T21:10:18.555862] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T21:10:18.572535] [INFO ] [REMOTE ] SNDA: Full fetch complete (8174 records). [2025-09-30T21:10:18.582964] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-30T21:10:18.659467] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-30T21:10:18.736946] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:19.066547] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-30T21:10:19.066676] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-30T21:10:19.066933] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-30T21:10:19.066978] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-30T21:10:19.067426] [DEBUG] [LOCAL ] SNDA: Trimmed 8174 records to 4543 (keeping 200 days of data) [2025-09-30T21:10:19.098414] [DEBUG] [LOCAL ] SNDA: Primary data saved (4543 records). [2025-09-30T21:10:19.098560] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-30T21:10:19.098670] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDA took 22.3s. Estimated remaining: 53m 52s. Rate: 7.8 symbols/min [2025-09-30T21:10:19.282750] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:19.282977] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-30T21:10:19.283034] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-30T21:10:19.283151] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-30T21:10:19.283194] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-30T21:10:19.283294] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-30T21:10:19.283347] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-30T21:10:19.461996] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-30T21:10:19.683029] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:20.254398] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-30T21:10:20.580946] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T21:10:21.054360] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-30T21:10:21.854345] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-30T21:10:22.101328] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-30T21:10:22.520005] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T21:10:22.655124] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:10:22.655196] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-30T21:10:23.454342] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-30T21:10:23.496529] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T21:10:24.254395] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-30T21:10:24.916616] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T21:10:25.025337] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-30T21:10:25.054309] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-30T21:10:25.525769] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:10:25.854390] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-30T21:10:26.654452] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-30T21:10:27.454376] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-30T21:10:27.638818] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-30T21:10:28.260037] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-30T21:10:28.274996] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-30T21:10:28.315098] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T21:10:29.025534] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T21:10:29.054407] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-30T21:10:29.854409] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-30T21:10:30.654331] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-30T21:10:30.719137] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-30T21:10:31.112577] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T21:10:31.334323] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-30T21:10:31.454379] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-30T21:10:31.566026] [DEBUG] [REMOTE ] SNOW: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T21:10:31.566371] [WARN ] [REMOTE ] SNOW: No data returned for month 2025-04 [2025-09-30T21:10:31.566517] [FATAL] [REMOTE ] SNOW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:10:31.566634] [FATAL] [MAIN ] SNOW: Failed to fetch primary data. [2025-09-30T21:10:31.566802] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:10:31.566903] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-30T21:10:31.567024] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-30T21:10:31.567112] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-30T21:10:31.567232] [DEBUG] [LOCAL ] SNOW: No derivative data file found to delete. [2025-09-30T21:10:31.567368] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNOW took 12.5s. Estimated remaining: 53m 46s. Rate: 7.8 symbols/min [2025-09-30T21:10:31.774031] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:31.834023] [DEBUG] [LOCAL ] SNV: Loaded 48851 existing records from primary storage. [2025-09-30T21:10:31.834369] [INFO ] [MAIN ] SNV: Loaded 48851 existing records. [2025-09-30T21:10:32.039631] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:10:32.040080] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-30T21:10:32.040147] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-30T21:10:32.049403] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-30T21:10:32.064393] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-30T21:10:32.073299] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T21:10:32.265325] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-30T21:10:32.481503] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:33.054369] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-30T21:10:33.854384] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-30T21:10:33.921316] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T21:10:33.931057] [INFO ] [REMOTE ] SNDR: Full fetch complete (59119 records). [2025-09-30T21:10:33.931269] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-30T21:10:34.386493] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-30T21:10:34.386669] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-30T21:10:34.387818] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-30T21:10:34.387885] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-30T21:10:34.389169] [DEBUG] [LOCAL ] SNDR: Trimmed 59119 records to 40697 (keeping 200 days of data) [2025-09-30T21:10:34.651558] [DEBUG] [LOCAL ] SNDR: Primary data saved (40697 records). [2025-09-30T21:10:34.651714] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-30T21:10:34.651806] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNDR took 28.8s. Estimated remaining: 53m 37s. Rate: 7.8 symbols/min [2025-09-30T21:10:34.663150] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-30T21:10:34.861248] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:34.876689] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T21:10:34.925974] [DEBUG] [LOCAL ] SNX: Loaded 39916 existing records from primary storage. [2025-09-30T21:10:34.926340] [INFO ] [MAIN ] SNX: Loaded 39916 existing records. [2025-09-30T21:10:35.122315] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:10:35.122559] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-30T21:10:35.122608] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-30T21:10:35.123806] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-30T21:10:35.123871] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-30T21:10:35.464320] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-30T21:10:35.506251] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:35.703114] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T21:10:36.254373] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-30T21:10:37.054367] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-30T21:10:37.256374] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T21:10:37.321573] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-30T21:10:37.854330] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-30T21:10:38.044110] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:10:38.361325] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:10:38.654369] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-30T21:10:39.454352] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-30T21:10:40.056912] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T21:10:40.254504] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-30T21:10:40.301697] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:10:41.054366] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-30T21:10:41.172482] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:10:41.854349] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-30T21:10:41.898494] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:10:42.654375] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-30T21:10:42.694564] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T21:10:43.096359] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T21:10:43.454375] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-30T21:10:44.254370] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-30T21:10:45.054325] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-30T21:10:45.176719] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:10:45.219988] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-30T21:10:45.231493] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-09-30T21:10:45.231696] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-30T21:10:45.651779] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-30T21:10:45.651933] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-30T21:10:45.653308] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-30T21:10:45.653402] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-30T21:10:45.655430] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-09-30T21:10:45.794507] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T21:10:45.880694] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-30T21:10:46.042701] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-30T21:10:46.042901] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-30T21:10:46.043082] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNAP took 50.2s. Estimated remaining: 53m 30s. Rate: 7.8 symbols/min [2025-09-30T21:10:46.232381] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:46.232596] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-30T21:10:46.232678] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-30T21:10:46.232808] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-30T21:10:46.232861] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-30T21:10:46.232909] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-30T21:10:46.232947] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-30T21:10:46.644480] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:46.659456] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-30T21:10:46.676343] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:10:47.375712] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T21:10:47.454388] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-30T21:10:48.254340] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-30T21:10:48.601512] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T21:10:49.054322] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-30T21:10:49.552215] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T21:10:49.826700] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T21:10:49.854317] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-30T21:10:49.930360] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T21:10:50.654342] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-30T21:10:51.451722] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:10:51.462910] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-30T21:10:52.064024] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T21:10:52.073740] [INFO ] [REMOTE ] SNN: Full fetch complete (63115 records). [2025-09-30T21:10:52.073886] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-30T21:10:52.263534] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-30T21:10:52.523208] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-30T21:10:52.523298] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-30T21:10:52.524385] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-30T21:10:52.524455] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-30T21:10:52.525986] [DEBUG] [LOCAL ] SNN: Trimmed 63115 records to 44274 (keeping 200 days of data) [2025-09-30T21:10:52.807091] [DEBUG] [LOCAL ] SNN: Primary data saved (44274 records). [2025-09-30T21:10:52.807231] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-30T21:10:52.807392] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNN took 35.0s. Estimated remaining: 53m 22s. Rate: 7.8 symbols/min [2025-09-30T21:10:52.986966] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:10:53.030417] [DEBUG] [LOCAL ] SOBO: Loaded 39451 existing records from primary storage. [2025-09-30T21:10:53.030839] [INFO ] [MAIN ] SOBO: Loaded 39451 existing records. [2025-09-30T21:10:53.063907] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-30T21:10:53.231954] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:10:53.232731] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-30T21:10:53.232910] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-30T21:10:53.234518] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-30T21:10:53.234582] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-30T21:10:53.637677] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T21:10:53.814759] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-30T21:10:53.864622] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-30T21:10:53.921209] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:10:54.514329] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T21:10:54.654404] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-30T21:10:54.757875] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:10:55.454412] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-30T21:10:56.020093] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T21:10:56.254384] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-30T21:10:57.054347] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-30T21:10:57.257257] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T21:10:57.854378] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-30T21:10:58.654375] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-30T21:10:58.869158] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T21:10:59.082924] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-30T21:10:59.454395] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-30T21:10:59.611540] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T21:10:59.622776] [INFO ] [REMOTE ] SNV: Full fetch complete (71154 records). [2025-09-30T21:10:59.622937] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-30T21:11:00.051842] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-30T21:11:00.051937] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-30T21:11:00.053119] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-30T21:11:00.053204] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-30T21:11:00.054818] [DEBUG] [LOCAL ] SNV: Trimmed 71154 records to 48852 (keeping 200 days of data) [2025-09-30T21:11:00.279479] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-30T21:11:00.386582] [DEBUG] [LOCAL ] SNV: Primary data saved (48852 records). [2025-09-30T21:11:00.386765] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-30T21:11:00.386864] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNV took 28.8s. Estimated remaining: 53m 15s. Rate: 7.8 symbols/min [2025-09-30T21:11:00.580506] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:00.630804] [DEBUG] [LOCAL ] SOC: Loaded 50346 existing records from primary storage. [2025-09-30T21:11:00.631203] [INFO ] [MAIN ] SOC: Loaded 50346 existing records. [2025-09-30T21:11:00.835514] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:00.835825] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-30T21:11:00.835997] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-30T21:11:00.844137] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-30T21:11:00.857149] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-30T21:11:00.888058] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T21:11:01.058469] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-30T21:11:01.295411] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:01.854327] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-30T21:11:01.925348] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:11:02.622237] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T21:11:02.631365] [INFO ] [REMOTE ] SNX: Full fetch complete (57058 records). [2025-09-30T21:11:02.631501] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-30T21:11:02.659583] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-30T21:11:03.068824] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-30T21:11:03.068945] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-30T21:11:03.070043] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-30T21:11:03.070113] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-30T21:11:03.071497] [DEBUG] [LOCAL ] SNX: Trimmed 57058 records to 39987 (keeping 200 days of data) [2025-09-30T21:11:03.340394] [DEBUG] [LOCAL ] SNX: Primary data saved (39987 records). [2025-09-30T21:11:03.340559] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-30T21:11:03.340684] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNX took 28.7s. Estimated remaining: 53m 6s. Rate: 7.8 symbols/min [2025-09-30T21:11:03.650689] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T21:11:03.661427] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-30T21:11:05.593637] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T21:11:05.603425] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-30T21:11:09.361383] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (10.71 seconds). [2025-09-30T21:11:09.379513] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-30T21:11:10.465277] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T21:11:10.477391] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-30T21:11:10.997984] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T21:11:11.009979] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-30T21:11:11.844985] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T21:11:11.856590] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-30T21:11:14.282169] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (11.62 seconds). [2025-09-30T21:11:14.294276] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-30T21:11:15.618818] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T21:11:15.628347] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-30T21:11:16.507592] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (10.90 seconds). [2025-09-30T21:11:16.517518] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-30T21:11:18.065503] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (6.21 seconds). [2025-09-30T21:11:18.080249] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-30T21:11:18.684397] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T21:11:18.695376] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-30T21:11:18.763707] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-09-30T21:11:18.773166] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-30T21:11:18.971046] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T21:11:18.982818] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-30T21:11:20.056534] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T21:11:20.072204] [INFO ] [REMOTE ] SO: Full fetch complete (77198 records). [2025-09-30T21:11:20.072371] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-30T21:11:20.073421] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:11:20.073535] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:11:20.073606] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:11:20.073700] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-30T21:11:20.073772] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-30T21:11:20.073807] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-30T21:11:20.073846] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-30T21:11:20.073905] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 34.0s. Estimated remaining: 53m 0s. Rate: 7.8 symbols/min [2025-09-30T21:11:20.111574] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T21:11:20.122130] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-30T21:11:20.349748] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:11:20.363378] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-30T21:11:21.825770] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:11:21.834543] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-30T21:11:21.951078] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T21:11:21.962285] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-30T21:11:23.792221] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T21:11:23.803678] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-30T21:11:23.871335] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T21:11:23.880743] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-30T21:11:25.382008] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T21:11:25.390817] [INFO ] [REMOTE ] SOBO: Full fetch complete (58517 records). [2025-09-30T21:11:25.390994] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-30T21:11:25.827837] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-30T21:11:25.828074] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-30T21:11:25.829261] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-30T21:11:25.829341] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-30T21:11:25.842807] [DEBUG] [LOCAL ] SOBO: Trimmed 58517 records to 39442 (keeping 200 days of data) [2025-09-30T21:11:25.866298] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T21:11:25.940820] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-30T21:11:26.134279] [DEBUG] [LOCAL ] SOBO: Primary data saved (39442 records). [2025-09-30T21:11:26.134440] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-30T21:11:26.134527] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 33.3s. Estimated remaining: 52m 52s. Rate: 7.8 symbols/min [2025-09-30T21:11:27.733280] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T21:11:27.744063] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-30T21:11:30.023983] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-30T21:11:30.036162] [INFO ] [REMOTE ] SOC: Full fetch complete (71514 records). [2025-09-30T21:11:30.036365] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-30T21:11:30.477162] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-30T21:11:30.477280] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-30T21:11:30.478377] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-30T21:11:30.478451] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-30T21:11:30.480021] [DEBUG] [LOCAL ] SOC: Trimmed 71514 records to 50398 (keeping 200 days of data) [2025-09-30T21:11:30.799761] [DEBUG] [LOCAL ] SOC: Primary data saved (50398 records). [2025-09-30T21:11:30.799921] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-30T21:11:30.800028] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 30.4s. Estimated remaining: 52m 44s. Rate: 7.8 symbols/min [2025-09-30T21:11:31.486835] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:31.452420] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:31.530700] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-30T21:11:31.593139] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:31.593670] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-30T21:11:31.594830] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:31.593886] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-30T21:11:31.595479] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-30T21:11:31.595672] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-30T21:11:31.595829] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-30T21:11:31.664870] [DEBUG] [LOCAL ] SOJC: Loaded 5050 existing records from primary storage. [2025-09-30T21:11:31.698223] [INFO ] [MAIN ] SOJC: Loaded 5050 existing records. [2025-09-30T21:11:31.721366] [DEBUG] [LOCAL ] SOJD: Loaded 13039 existing records from primary storage. [2025-09-30T21:11:31.750510] [INFO ] [MAIN ] SOJD: Loaded 13039 existing records. [2025-09-30T21:11:31.765831] [DEBUG] [LOCAL ] SOJE: Loaded 9332 existing records from primary storage. [2025-09-30T21:11:31.797780] [INFO ] [MAIN ] SOJE: Loaded 9332 existing records. [2025-09-30T21:11:32.522086] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:32.571587] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:32.576967] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-30T21:11:32.646289] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-30T21:11:32.598259] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-30T21:11:32.651594] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-30T21:11:32.669531] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:32.660816] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-30T21:11:32.669816] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-30T21:11:32.669893] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-30T21:11:32.670002] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-30T21:11:32.680008] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-30T21:11:32.736758] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:32.730787] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-30T21:11:32.742159] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-30T21:11:32.742633] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-30T21:11:32.753182] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-30T21:11:33.193889] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:11:33.325328] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-30T21:11:33.569985] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:11:33.649984] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-30T21:11:33.675030] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:11:33.712197] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-30T21:11:33.772726] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-30T21:11:33.948088] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-30T21:11:33.947972] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:33.906114] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:33.988705] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:33.982207] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-30T21:11:33.982476] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-30T21:11:33.989099] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-30T21:11:33.990503] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-30T21:11:33.990589] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 3.2s. Estimated remaining: 52m 35s. Rate: 7.8 symbols/min [2025-09-30T21:11:34.188291] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:34.204428] [DEBUG] [LOCAL ] SOL: Loaded 13458 existing records from primary storage. [2025-09-30T21:11:34.204673] [INFO ] [MAIN ] SOL: Loaded 13458 existing records. [2025-09-30T21:11:34.401326] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:34.401550] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-30T21:11:34.401599] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-30T21:11:34.402027] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-30T21:11:34.402089] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-30T21:11:34.808735] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:34.809124] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-30T21:11:34.833779] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T21:11:34.838067] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-30T21:11:34.912774] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T21:11:34.915584] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-30T21:11:35.248537] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T21:11:35.253531] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-30T21:11:35.403966] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T21:11:35.406070] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-30T21:11:35.452228] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T21:11:35.455029] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-30T21:11:36.030883] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T21:11:36.032753] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-30T21:11:36.062334] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T21:11:36.067874] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-30T21:11:36.265143] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T21:11:36.268837] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-30T21:11:36.302629] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T21:11:36.305124] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-30T21:11:36.643115] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T21:11:36.645374] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-30T21:11:36.940903] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T21:11:36.946262] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-30T21:11:37.005745] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T21:11:37.009061] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-30T21:11:37.177068] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T21:11:37.180390] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-30T21:11:37.474906] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T21:11:37.477990] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-30T21:11:37.701525] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T21:11:37.706723] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-30T21:11:37.976455] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T21:11:37.980022] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-30T21:11:37.994127] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T21:11:37.996078] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-30T21:11:38.162097] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T21:11:38.164998] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-30T21:11:38.576327] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T21:11:38.654322] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-30T21:11:38.665971] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T21:11:38.811693] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T21:11:38.999730] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T21:11:39.454333] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-30T21:11:39.687214] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T21:11:40.083477] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T21:11:40.254400] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-30T21:11:41.029622] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T21:11:41.054351] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-30T21:11:41.854365] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-30T21:11:42.043615] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T21:11:42.654387] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-30T21:11:42.761795] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T21:11:43.454400] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-30T21:11:43.654224] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T21:11:43.657069] [INFO ] [REMOTE ] SOJE: Full fetch complete (14457 records). [2025-09-30T21:11:43.657161] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-30T21:11:44.044304] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-30T21:11:44.044416] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-30T21:11:44.044810] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-30T21:11:44.044873] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-30T21:11:44.045372] [DEBUG] [LOCAL ] SOJE: Trimmed 14457 records to 9353 (keeping 200 days of data) [2025-09-30T21:11:44.105551] [DEBUG] [LOCAL ] SOJE: Primary data saved (9353 records). [2025-09-30T21:11:44.105722] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-30T21:11:44.105821] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJE took 13.3s. Estimated remaining: 52m 28s. Rate: 7.8 symbols/min [2025-09-30T21:11:44.259483] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-30T21:11:44.299662] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:44.349462] [DEBUG] [LOCAL ] SOLV: Loaded 44046 existing records from primary storage. [2025-09-30T21:11:44.349818] [INFO ] [MAIN ] SOLV: Loaded 44046 existing records. [2025-09-30T21:11:44.494689] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T21:11:44.559825] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:44.560059] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-30T21:11:44.560117] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-30T21:11:44.562557] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-30T21:11:44.562620] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-30T21:11:44.948236] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:45.049876] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T21:11:45.054322] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-30T21:11:45.854346] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-30T21:11:46.139915] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T21:11:46.443133] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T21:11:46.654426] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-30T21:11:47.280141] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T21:11:47.454391] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-30T21:11:48.124277] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T21:11:48.126046] [INFO ] [REMOTE ] SOJC: Full fetch complete (7834 records). [2025-09-30T21:11:48.126146] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-30T21:11:48.259483] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-30T21:11:48.541114] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-30T21:11:48.541222] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-30T21:11:48.541436] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-30T21:11:48.541523] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-30T21:11:48.541969] [DEBUG] [LOCAL ] SOJC: Trimmed 7834 records to 5058 (keeping 200 days of data) [2025-09-30T21:11:48.573938] [DEBUG] [LOCAL ] SOJC: Primary data saved (5058 records). [2025-09-30T21:11:48.574064] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-30T21:11:48.574159] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJC took 17.8s. Estimated remaining: 52m 19s. Rate: 7.8 symbols/min [2025-09-30T21:11:48.755285] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:48.795918] [DEBUG] [LOCAL ] SON: Loaded 42977 existing records from primary storage. [2025-09-30T21:11:48.796414] [INFO ] [MAIN ] SON: Loaded 42977 existing records. [2025-09-30T21:11:48.981750] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:48.981965] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-30T21:11:48.982012] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-30T21:11:48.983003] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-30T21:11:48.983063] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-30T21:11:49.062204] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-30T21:11:49.383053] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:11:49.389077] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:49.854318] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-30T21:11:50.222261] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T21:11:50.614290] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T21:11:50.654360] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-30T21:11:51.454401] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-30T21:11:52.037822] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T21:11:52.254332] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-30T21:11:52.470455] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:11:53.054375] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-30T21:11:53.860620] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-30T21:11:53.876143] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T21:11:53.898509] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T21:11:54.654330] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-30T21:11:54.683068] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T21:11:55.454396] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-30T21:11:56.215357] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T21:11:56.254364] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-30T21:11:56.417813] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:11:57.054362] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-30T21:11:57.726827] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T21:11:57.729847] [INFO ] [REMOTE ] SOJD: Full fetch complete (20052 records). [2025-09-30T21:11:57.729940] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-30T21:11:57.859455] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-30T21:11:58.141096] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-30T21:11:58.141271] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-30T21:11:58.141746] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-30T21:11:58.141827] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-30T21:11:58.166309] [DEBUG] [LOCAL ] SOJD: Trimmed 20052 records to 13075 (keeping 200 days of data) [2025-09-30T21:11:58.168203] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T21:11:58.263626] [DEBUG] [LOCAL ] SOJD: Primary data saved (13075 records). [2025-09-30T21:11:58.263801] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-30T21:11:58.263891] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJD took 27.5s. Estimated remaining: 52m 12s. Rate: 7.8 symbols/min [2025-09-30T21:11:58.448535] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:11:58.506840] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-30T21:11:58.507168] [INFO ] [MAIN ] SONY: Loaded 53357 existing records. [2025-09-30T21:11:58.660957] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-30T21:11:58.708689] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:11:58.709011] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-30T21:11:58.709114] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-30T21:11:58.709820] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-30T21:11:58.709883] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-30T21:11:58.992330] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T21:11:59.105363] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:11:59.454336] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-30T21:11:59.632527] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T21:12:00.254393] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-30T21:12:01.054377] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-30T21:12:01.610818] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-30T21:12:01.854378] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-30T21:12:01.961682] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T21:12:01.989984] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T21:12:01.993096] [INFO ] [REMOTE ] SOL: Full fetch complete (21580 records). [2025-09-30T21:12:01.993232] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-30T21:12:02.407403] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-30T21:12:02.407544] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-30T21:12:02.408133] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-30T21:12:02.408201] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-30T21:12:02.408892] [DEBUG] [LOCAL ] SOL: Trimmed 21580 records to 13394 (keeping 200 days of data) [2025-09-30T21:12:02.495965] [DEBUG] [LOCAL ] SOL: Primary data saved (13394 records). [2025-09-30T21:12:02.496108] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-30T21:12:02.496223] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOL took 28.5s. Estimated remaining: 52m 4s. Rate: 7.8 symbols/min [2025-09-30T21:12:02.658248] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-30T21:12:02.688722] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:02.694445] [DEBUG] [LOCAL ] SOR: Loaded 2891 existing records from primary storage. [2025-09-30T21:12:02.694670] [INFO ] [MAIN ] SOR: Loaded 2891 existing records. [2025-09-30T21:12:02.918573] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:02.918856] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-30T21:12:02.918936] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-30T21:12:02.919567] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-30T21:12:02.921307] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-30T21:12:02.921257] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T21:12:03.331676] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:03.454362] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-30T21:12:04.254367] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-30T21:12:04.764607] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-30T21:12:04.785198] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-30T21:12:05.054436] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-30T21:12:05.341691] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T21:12:05.862542] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-30T21:12:05.879829] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T21:12:06.654367] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-30T21:12:07.340733] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T21:12:07.454401] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-30T21:12:07.883958] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T21:12:07.889740] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T21:12:08.254368] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-30T21:12:09.054388] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-30T21:12:09.529796] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T21:12:09.857283] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-30T21:12:09.860148] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:12:10.389098] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T21:12:10.654393] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-30T21:12:11.454376] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-30T21:12:12.085976] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T21:12:12.125977] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T21:12:12.254350] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-30T21:12:13.054361] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-30T21:12:13.649519] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T21:12:13.718981] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:12:13.854379] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-30T21:12:14.654399] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-30T21:12:15.317742] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T21:12:15.454393] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-30T21:12:15.986694] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T21:12:16.034093] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T21:12:16.254399] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-30T21:12:17.054374] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-30T21:12:17.563951] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T21:12:17.854364] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-30T21:12:18.437445] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T21:12:18.654370] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-30T21:12:19.454403] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-30T21:12:19.521340] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T21:12:19.613278] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T21:12:19.625085] [INFO ] [REMOTE ] SON: Full fetch complete (62423 records). [2025-09-30T21:12:19.625380] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-30T21:12:20.046094] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-30T21:12:20.046191] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-30T21:12:20.047284] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-30T21:12:20.047399] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-30T21:12:20.049017] [DEBUG] [LOCAL ] SON: Trimmed 62423 records to 43029 (keeping 200 days of data) [2025-09-30T21:12:20.278999] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-30T21:12:20.337143] [DEBUG] [LOCAL ] SON: Primary data saved (43029 records). [2025-09-30T21:12:20.337303] [INFO ] [MAIN ] SON: Full history saved. [2025-09-30T21:12:20.337453] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SON took 31.8s. Estimated remaining: 51m 58s. Rate: 7.8 symbols/min [2025-09-30T21:12:20.519705] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:20.533408] [DEBUG] [LOCAL ] SOS: Loaded 8457 existing records from primary storage. [2025-09-30T21:12:20.533679] [INFO ] [MAIN ] SOS: Loaded 8457 existing records. [2025-09-30T21:12:20.727161] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:20.727402] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-30T21:12:20.727482] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-30T21:12:20.727746] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-30T21:12:20.727825] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-30T21:12:21.057240] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-30T21:12:21.121870] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:21.186097] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T21:12:21.195879] [INFO ] [REMOTE ] SOLV: Full fetch complete (62928 records). [2025-09-30T21:12:21.196025] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-30T21:12:21.196688] [FATAL] [VALIDATOR ] SOLV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:12:21.196784] [FATAL] [MAIN ] SOLV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:12:21.196832] [WARN ] [MAIN ] SOLV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:12:21.196899] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-30T21:12:21.196994] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-09-30T21:12:21.197056] [INFO ] [LOCAL ] SOLV: Starting deletion of derivative data. [2025-09-30T21:12:21.197447] [DEBUG] [LOCAL ] SOLV: Deleted derivative data file. [2025-09-30T21:12:21.197605] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOLV took 37.1s. Estimated remaining: 51m 49s. Rate: 7.8 symbols/min [2025-09-30T21:12:21.393021] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:21.429669] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T21:12:21.481071] [DEBUG] [LOCAL ] SPB: Loaded 34134 existing records from primary storage. [2025-09-30T21:12:21.481444] [INFO ] [MAIN ] SPB: Loaded 34134 existing records. [2025-09-30T21:12:21.601252] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T21:12:21.603414] [INFO ] [REMOTE ] SOR: Full fetch complete (4359 records). [2025-09-30T21:12:21.603533] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-30T21:12:21.808489] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:21.821852] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-30T21:12:21.821999] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-30T21:12:21.827963] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-30T21:12:21.838290] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-30T21:12:21.865290] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-30T21:12:22.404229] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-30T21:12:22.422107] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-30T21:12:22.434735] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-30T21:12:22.434941] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-30T21:12:22.452199] [DEBUG] [LOCAL ] SOR: Trimmed 4359 records to 2876 (keeping 200 days of data) [2025-09-30T21:12:22.539527] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:22.545765] [DEBUG] [LOCAL ] SOR: Primary data saved (2876 records). [2025-09-30T21:12:22.545884] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-30T21:12:22.546000] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 20.0s. Estimated remaining: 51m 40s. Rate: 7.8 symbols/min [2025-09-30T21:12:22.659908] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-30T21:12:22.754702] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:22.808215] [DEBUG] [LOCAL ] SPCE: Loaded 49882 existing records from primary storage. [2025-09-30T21:12:22.808542] [INFO ] [MAIN ] SPCE: Loaded 49882 existing records. [2025-09-30T21:12:22.998781] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:22.999081] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-30T21:12:22.999245] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-30T21:12:22.999908] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-30T21:12:22.999980] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-30T21:12:23.176755] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:12:23.394441] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:23.454394] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-30T21:12:24.036469] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T21:12:24.254355] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-30T21:12:25.017048] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T21:12:25.054333] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-30T21:12:25.616618] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T21:12:25.689962] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T21:12:25.854363] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-30T21:12:26.404000] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T21:12:26.654369] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-30T21:12:27.454355] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-30T21:12:27.885009] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T21:12:28.254331] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-30T21:12:28.714963] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-30T21:12:29.054373] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-30T21:12:29.739782] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T21:12:29.854359] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-30T21:12:30.406000] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-30T21:12:30.654338] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-30T21:12:31.454354] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-30T21:12:31.925625] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:12:32.036686] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T21:12:32.040871] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-30T21:12:32.254364] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-30T21:12:33.054361] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-30T21:12:33.683366] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T21:12:33.854349] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-30T21:12:34.654319] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-30T21:12:35.210238] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T21:12:35.454366] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-30T21:12:35.504888] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:12:36.254372] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-30T21:12:36.620148] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T21:12:36.622561] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T21:12:37.054358] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-30T21:12:37.843732] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T21:12:37.854314] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-30T21:12:38.654352] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-30T21:12:39.069492] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T21:12:39.144281] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T21:12:39.454378] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-30T21:12:40.254329] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-30T21:12:40.526621] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T21:12:40.590221] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T21:12:40.605723] [INFO ] [REMOTE ] SONY: Full fetch complete (77228 records). [2025-09-30T21:12:40.605944] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-30T21:12:41.038684] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-30T21:12:41.038801] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-30T21:12:41.040014] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-30T21:12:41.040111] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-30T21:12:41.041703] [DEBUG] [LOCAL ] SONY: Trimmed 77228 records to 53361 (keeping 200 days of data) [2025-09-30T21:12:41.099316] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-30T21:12:41.390062] [DEBUG] [LOCAL ] SONY: Primary data saved (53361 records). [2025-09-30T21:12:41.390238] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-30T21:12:41.390346] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 43.1s. Estimated remaining: 51m 35s. Rate: 7.8 symbols/min [2025-09-30T21:12:41.582317] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:41.593281] [DEBUG] [LOCAL ] SPE: Loaded 6363 existing records from primary storage. [2025-09-30T21:12:41.593533] [INFO ] [MAIN ] SPE: Loaded 6363 existing records. [2025-09-30T21:12:41.793631] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:41.793900] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-30T21:12:41.793950] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-30T21:12:41.794182] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-30T21:12:41.794252] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-30T21:12:41.856623] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-30T21:12:42.214708] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:42.247262] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T21:12:42.635488] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T21:12:42.654328] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-30T21:12:43.223438] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T21:12:43.227814] [INFO ] [REMOTE ] SOS: Full fetch complete (11033 records). [2025-09-30T21:12:43.227895] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-30T21:12:43.409957] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T21:12:43.463548] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-30T21:12:43.659241] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-30T21:12:43.659321] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-30T21:12:43.659611] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-30T21:12:43.659681] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-30T21:12:43.660248] [DEBUG] [LOCAL ] SOS: Trimmed 11033 records to 8590 (keeping 200 days of data) [2025-09-30T21:12:43.714135] [DEBUG] [LOCAL ] SOS: Primary data saved (8590 records). [2025-09-30T21:12:43.714282] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-30T21:12:43.714394] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 23.4s. Estimated remaining: 51m 26s. Rate: 7.8 symbols/min [2025-09-30T21:12:43.921432] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:43.975875] [DEBUG] [LOCAL ] SPG: Loaded 50320 existing records from primary storage. [2025-09-30T21:12:43.976274] [INFO ] [MAIN ] SPG: Loaded 50320 existing records. [2025-09-30T21:12:44.182552] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:44.184106] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-30T21:12:44.184169] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-30T21:12:44.185954] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-30T21:12:44.186029] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-30T21:12:44.259723] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-30T21:12:44.585334] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:45.054362] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-30T21:12:45.738702] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-30T21:12:45.840432] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:12:45.854309] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-30T21:12:45.920307] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T21:12:46.654397] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-30T21:12:47.449829] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:12:47.457138] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-30T21:12:47.949257] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T21:12:48.254367] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-30T21:12:48.480047] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T21:12:48.843350] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T21:12:49.054372] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-30T21:12:49.854357] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-30T21:12:50.155045] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T21:12:50.654400] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-30T21:12:50.987780] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T21:12:50.995230] [INFO ] [REMOTE ] SPB: Full fetch complete (47451 records). [2025-09-30T21:12:50.995380] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-30T21:12:51.489969] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T21:12:51.489269] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-30T21:12:51.532457] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-30T21:12:51.532563] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-30T21:12:51.533676] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-30T21:12:51.533751] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-30T21:12:51.537014] [DEBUG] [LOCAL ] SPB: Trimmed 47451 records to 34054 (keeping 200 days of data) [2025-09-30T21:12:51.763468] [DEBUG] [LOCAL ] SPB: Primary data saved (34054 records). [2025-09-30T21:12:51.763626] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-30T21:12:51.763749] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 30.6s. Estimated remaining: 51m 18s. Rate: 7.8 symbols/min [2025-09-30T21:12:51.949535] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:12:51.997462] [DEBUG] [LOCAL ] SPGI: Loaded 45801 existing records from primary storage. [2025-09-30T21:12:51.997850] [INFO ] [MAIN ] SPGI: Loaded 45801 existing records. [2025-09-30T21:12:52.195068] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:12:52.195287] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-30T21:12:52.195337] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-30T21:12:52.197334] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-30T21:12:52.197398] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-30T21:12:52.255762] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-30T21:12:52.591275] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:12:52.616947] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T21:12:53.054359] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-30T21:12:53.081297] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T21:12:53.854517] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-30T21:12:53.855804] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T21:12:54.654423] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-30T21:12:55.454371] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-30T21:12:55.585571] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T21:12:55.820228] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T21:12:56.117351] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:12:56.254395] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-30T21:12:56.695626] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T21:12:57.054350] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-30T21:12:57.854416] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-30T21:12:58.139628] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:12:58.654348] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-30T21:12:58.731247] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T21:12:59.454390] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-30T21:13:00.254335] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-30T21:13:00.352923] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T21:13:00.609798] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T21:13:00.984550] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T21:13:01.054373] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-30T21:13:01.854400] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-30T21:13:02.098710] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T21:13:02.654379] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-30T21:13:02.808135] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T21:13:03.459447] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-30T21:13:03.473040] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T21:13:04.254343] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-30T21:13:04.438504] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T21:13:04.449795] [INFO ] [REMOTE ] SPCE: Full fetch complete (72333 records). [2025-09-30T21:13:04.450061] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-30T21:13:04.890964] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-30T21:13:04.891050] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-30T21:13:04.892106] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-30T21:13:04.892172] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-30T21:13:04.893891] [DEBUG] [LOCAL ] SPCE: Trimmed 72333 records to 49901 (keeping 200 days of data) [2025-09-30T21:13:05.066776] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-30T21:13:05.145036] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T21:13:05.244585] [DEBUG] [LOCAL ] SPCE: Primary data saved (49901 records). [2025-09-30T21:13:05.244773] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-30T21:13:05.244879] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 42.7s. Estimated remaining: 51m 12s. Rate: 7.8 symbols/min [2025-09-30T21:13:05.428332] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:05.446504] [DEBUG] [LOCAL ] SPH: Loaded 17676 existing records from primary storage. [2025-09-30T21:13:05.446798] [INFO ] [MAIN ] SPH: Loaded 17676 existing records. [2025-09-30T21:13:05.645433] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:05.645746] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-30T21:13:05.645803] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-30T21:13:05.646271] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-30T21:13:05.646333] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-30T21:13:05.864747] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-30T21:13:06.081787] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:06.082136] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T21:13:06.654402] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-30T21:13:06.817620] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:13:07.142865] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T21:13:07.454375] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-30T21:13:08.259712] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-30T21:13:08.266115] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:13:09.054354] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-30T21:13:09.121791] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T21:13:09.854335] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-30T21:13:09.869765] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T21:13:09.872709] [INFO ] [REMOTE ] SPE: Full fetch complete (10156 records). [2025-09-30T21:13:09.872799] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-30T21:13:10.262188] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-30T21:13:10.262268] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-30T21:13:10.262507] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-30T21:13:10.262546] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-30T21:13:10.263048] [DEBUG] [LOCAL ] SPE: Trimmed 10156 records to 6352 (keeping 200 days of data) [2025-09-30T21:13:10.304921] [DEBUG] [LOCAL ] SPE: Primary data saved (6352 records). [2025-09-30T21:13:10.305052] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-30T21:13:10.305198] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPE took 28.9s. Estimated remaining: 51m 4s. Rate: 7.8 symbols/min [2025-09-30T21:13:10.489300] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:10.526606] [DEBUG] [LOCAL ] SPHR: Loaded 40022 existing records from primary storage. [2025-09-30T21:13:10.526968] [INFO ] [MAIN ] SPHR: Loaded 40022 existing records. [2025-09-30T21:13:10.656298] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-30T21:13:10.715859] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:10.716052] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-30T21:13:10.716102] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-30T21:13:10.716988] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-30T21:13:10.717071] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-30T21:13:11.112339] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T21:13:11.154437] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:11.274551] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T21:13:11.454373] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-30T21:13:12.254355] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-30T21:13:12.723716] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:13:13.054331] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-30T21:13:13.223631] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T21:13:13.841283] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T21:13:13.851383] [INFO ] [REMOTE ] SPGI: Full fetch complete (66397 records). [2025-09-30T21:13:13.851594] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-30T21:13:13.852470] [FATAL] [VALIDATOR ] SPGI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:13:13.852570] [FATAL] [MAIN ] SPGI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:13:13.852637] [WARN ] [MAIN ] SPGI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:13:13.852746] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-30T21:13:13.852825] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-09-30T21:13:13.852863] [INFO ] [LOCAL ] SPGI: Starting deletion of derivative data. [2025-09-30T21:13:13.853451] [DEBUG] [LOCAL ] SPGI: Deleted derivative data file. [2025-09-30T21:13:13.853864] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPGI took 22.1s. Estimated remaining: 50m 55s. Rate: 7.8 symbols/min [2025-09-30T21:13:13.859237] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-30T21:13:14.039286] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:14.076542] [DEBUG] [LOCAL ] SPIR: Loaded 37260 existing records from primary storage. [2025-09-30T21:13:14.076911] [INFO ] [MAIN ] SPIR: Loaded 37260 existing records. [2025-09-30T21:13:14.258173] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:14.258409] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-30T21:13:14.258463] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-30T21:13:14.259375] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-30T21:13:14.259440] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-30T21:13:14.628033] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:14.654354] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-30T21:13:15.155595] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T21:13:15.454389] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-30T21:13:16.013351] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T21:13:16.254390] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-30T21:13:17.054354] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-30T21:13:17.089317] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:13:17.148125] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T21:13:17.158834] [INFO ] [REMOTE ] SPG: Full fetch complete (71657 records). [2025-09-30T21:13:17.158988] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-30T21:13:17.159802] [FATAL] [VALIDATOR ] SPG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:13:17.159890] [FATAL] [MAIN ] SPG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:13:17.159969] [WARN ] [MAIN ] SPG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:13:17.160056] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-30T21:13:17.160138] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-09-30T21:13:17.160189] [INFO ] [LOCAL ] SPG: Starting deletion of derivative data. [2025-09-30T21:13:17.160522] [DEBUG] [LOCAL ] SPG: Deleted derivative data file. [2025-09-30T21:13:17.160684] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPG took 33.4s. Estimated remaining: 50m 46s. Rate: 7.8 symbols/min [2025-09-30T21:13:17.350445] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:17.357208] [DEBUG] [LOCAL ] SPMC: Loaded 5454 existing records from primary storage. [2025-09-30T21:13:17.357400] [INFO ] [MAIN ] SPMC: Loaded 5454 existing records. [2025-09-30T21:13:17.550154] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:17.550422] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-30T21:13:17.550478] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-30T21:13:17.550750] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-30T21:13:17.550810] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-30T21:13:17.859488] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-30T21:13:17.951399] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:18.302517] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T21:13:18.654385] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-30T21:13:19.389000] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T21:13:19.454367] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-30T21:13:19.531968] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T21:13:20.254355] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-30T21:13:20.861750] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T21:13:21.054323] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-30T21:13:21.420470] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T21:13:21.854366] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-30T21:13:22.654336] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-30T21:13:22.852918] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T21:13:23.332716] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-30T21:13:23.454332] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-30T21:13:23.529812] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T21:13:24.254371] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-30T21:13:24.710020] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T21:13:25.054964] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-30T21:13:25.057373] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T21:13:25.854355] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-30T21:13:26.105917] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T21:13:26.654377] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-30T21:13:27.454371] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-30T21:13:27.497125] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:13:28.254341] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-30T21:13:28.290958] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T21:13:28.347550] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T21:13:29.054386] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-30T21:13:29.854354] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-30T21:13:29.883130] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:13:30.605582] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T21:13:30.654335] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-30T21:13:30.684533] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:13:31.305102] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T21:13:31.454354] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-30T21:13:32.254328] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-30T21:13:32.569861] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T21:13:33.054354] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-30T21:13:33.769748] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T21:13:33.854334] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-30T21:13:34.659926] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-30T21:13:34.666589] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T21:13:35.307377] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T21:13:35.321537] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T21:13:35.454366] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-30T21:13:36.193566] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T21:13:36.254325] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-30T21:13:37.054323] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-30T21:13:37.292580] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T21:13:37.296105] [INFO ] [REMOTE ] SPH: Full fetch complete (28378 records). [2025-09-30T21:13:37.296187] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-30T21:13:37.706311] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-30T21:13:37.706413] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-30T21:13:37.707104] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-30T21:13:37.707170] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-30T21:13:37.708007] [DEBUG] [LOCAL ] SPH: Trimmed 28378 records to 17642 (keeping 200 days of data) [2025-09-30T21:13:37.822675] [DEBUG] [LOCAL ] SPH: Primary data saved (17642 records). [2025-09-30T21:13:37.822821] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-30T21:13:37.822907] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPH took 32.6s. Estimated remaining: 50m 41s. Rate: 7.8 symbols/min [2025-09-30T21:13:37.856097] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-30T21:13:38.009954] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:38.010126] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-30T21:13:38.010164] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-30T21:13:38.010275] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-30T21:13:38.010374] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-30T21:13:38.010438] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-30T21:13:38.010471] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-30T21:13:38.409088] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:38.586743] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T21:13:38.654368] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-30T21:13:38.903438] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:13:38.903804] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-30T21:13:38.903896] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:13:38.903969] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-30T21:13:38.904034] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:13:38.904105] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-30T21:13:38.904169] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-30T21:13:38.904205] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-30T21:13:38.904245] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-30T21:13:38.904292] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPME took 1.1s. Estimated remaining: 50m 32s. Rate: 7.8 symbols/min [2025-09-30T21:13:39.091314] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:39.129233] [DEBUG] [LOCAL ] SPNT: Loaded 34745 existing records from primary storage. [2025-09-30T21:13:39.129527] [INFO ] [MAIN ] SPNT: Loaded 34745 existing records. [2025-09-30T21:13:39.323589] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:39.323874] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-30T21:13:39.323935] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-30T21:13:39.324711] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-30T21:13:39.324780] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-30T21:13:39.459685] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-30T21:13:39.672906] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T21:13:39.743142] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:40.254349] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-30T21:13:41.054334] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-30T21:13:41.134556] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T21:13:41.633774] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T21:13:41.756508] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T21:13:41.854350] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-30T21:13:42.513129] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T21:13:42.514663] [INFO ] [REMOTE ] SPMC: Full fetch complete (8170 records). [2025-09-30T21:13:42.514785] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-30T21:13:42.661492] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-30T21:13:42.905883] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-30T21:13:42.905969] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-30T21:13:42.906206] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-30T21:13:42.906254] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-30T21:13:42.906696] [DEBUG] [LOCAL ] SPMC: Trimmed 8170 records to 5394 (keeping 200 days of data) [2025-09-30T21:13:42.941942] [DEBUG] [LOCAL ] SPMC: Primary data saved (5394 records). [2025-09-30T21:13:42.942069] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-30T21:13:42.942153] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 25.8s. Estimated remaining: 50m 24s. Rate: 7.8 symbols/min [2025-09-30T21:13:43.118809] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:43.118968] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-09-30T21:13:43.119049] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-09-30T21:13:43.119133] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-30T21:13:43.119170] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-30T21:13:43.119211] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-09-30T21:13:43.119242] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-30T21:13:43.459480] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-30T21:13:43.500216] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:44.254390] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-30T21:13:44.566812] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T21:13:44.577599] [INFO ] [REMOTE ] SPHR: Full fetch complete (57687 records). [2025-09-30T21:13:44.577777] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-30T21:13:44.925549] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T21:13:45.026281] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-30T21:13:45.026366] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-30T21:13:45.027297] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-30T21:13:45.027399] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-30T21:13:45.028907] [DEBUG] [LOCAL ] SPHR: Trimmed 57687 records to 39994 (keeping 200 days of data) [2025-09-30T21:13:45.080353] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-30T21:13:45.275295] [DEBUG] [LOCAL ] SPHR: Primary data saved (39994 records). [2025-09-30T21:13:45.275448] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-30T21:13:45.275530] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPHR took 35.0s. Estimated remaining: 50m 15s. Rate: 7.8 symbols/min [2025-09-30T21:13:45.456131] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:45.496320] [DEBUG] [LOCAL ] SPR: Loaded 41141 existing records from primary storage. [2025-09-30T21:13:45.496638] [INFO ] [MAIN ] SPR: Loaded 41141 existing records. [2025-09-30T21:13:45.694503] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:45.694781] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-30T21:13:45.694836] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-30T21:13:45.695935] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-30T21:13:45.695996] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-30T21:13:45.857672] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-30T21:13:46.059168] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T21:13:46.127659] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:46.232674] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T21:13:46.654360] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-30T21:13:47.454367] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-30T21:13:48.099855] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T21:13:48.256366] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-30T21:13:48.263459] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-30T21:13:48.673355] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T21:13:49.054431] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-30T21:13:49.854385] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-30T21:13:49.910203] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T21:13:50.138748] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T21:13:50.654375] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-30T21:13:51.454389] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-30T21:13:51.871246] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-30T21:13:51.929778] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T21:13:52.254371] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-30T21:13:52.882601] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:13:53.054367] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-30T21:13:53.788125] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T21:13:53.854393] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-30T21:13:54.654442] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-30T21:13:55.267574] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-30T21:13:55.415890] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T21:13:55.423298] [INFO ] [REMOTE ] SPIR: Full fetch complete (52568 records). [2025-09-30T21:13:55.423405] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-30T21:13:55.459481] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-30T21:13:55.885408] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-30T21:13:55.885528] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-30T21:13:55.886637] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-30T21:13:55.886745] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-30T21:13:55.888938] [DEBUG] [LOCAL ] SPIR: Trimmed 52568 records to 37168 (keeping 200 days of data) [2025-09-30T21:13:56.151144] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T21:13:56.193118] [DEBUG] [LOCAL ] SPIR: Primary data saved (37168 records). [2025-09-30T21:13:56.193273] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-30T21:13:56.193390] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPIR took 42.3s. Estimated remaining: 50m 8s. Rate: 7.8 symbols/min [2025-09-30T21:13:56.260757] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-30T21:13:56.387246] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:13:56.398110] [DEBUG] [LOCAL ] SPRU: Loaded 8757 existing records from primary storage. [2025-09-30T21:13:56.398380] [INFO ] [MAIN ] SPRU: Loaded 8757 existing records. [2025-09-30T21:13:56.632768] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:13:56.633159] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-30T21:13:56.633344] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-30T21:13:56.633821] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-30T21:13:56.633906] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-30T21:13:56.740082] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T21:13:57.038066] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:13:57.054369] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-30T21:13:57.854353] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-30T21:13:58.578724] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T21:13:58.654329] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-30T21:13:58.834010] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-30T21:13:59.454320] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-30T21:13:59.571465] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:13:59.706120] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T21:14:00.254374] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-30T21:14:01.054369] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-30T21:14:01.854396] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-30T21:14:01.857285] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-30T21:14:01.946876] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T21:14:02.119286] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T21:14:02.128709] [INFO ] [REMOTE ] SPNT: Full fetch complete (48984 records). [2025-09-30T21:14:02.128869] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-30T21:14:02.573337] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-30T21:14:02.573433] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-30T21:14:02.574410] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-30T21:14:02.574480] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-30T21:14:02.575819] [DEBUG] [LOCAL ] SPNT: Trimmed 48984 records to 34802 (keeping 200 days of data) [2025-09-30T21:14:02.667440] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-30T21:14:02.801862] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:14:02.813765] [DEBUG] [LOCAL ] SPNT: Primary data saved (34802 records). [2025-09-30T21:14:02.813923] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-30T21:14:02.814014] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPNT took 23.9s. Estimated remaining: 50m 0s. Rate: 7.8 symbols/min [2025-09-30T21:14:03.006785] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:03.030397] [DEBUG] [LOCAL ] SPXC: Loaded 23250 existing records from primary storage. [2025-09-30T21:14:03.030700] [INFO ] [MAIN ] SPXC: Loaded 23250 existing records. [2025-09-30T21:14:03.244190] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:03.244621] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-30T21:14:03.244737] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-30T21:14:03.246558] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-30T21:14:03.246620] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-30T21:14:03.459551] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-30T21:14:03.631010] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:04.254365] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-30T21:14:05.007699] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T21:14:05.037956] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T21:14:05.054305] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-30T21:14:05.222552] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-30T21:14:05.854368] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-30T21:14:06.654364] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-30T21:14:06.727606] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:14:07.454413] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-30T21:14:07.797580] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T21:14:07.985985] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-30T21:14:08.254426] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-30T21:14:09.055907] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-30T21:14:09.059009] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T21:14:09.703226] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T21:14:09.854373] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-30T21:14:10.654387] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-30T21:14:11.424958] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T21:14:11.454318] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-30T21:14:11.550317] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-30T21:14:11.874598] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T21:14:12.254368] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-30T21:14:13.054368] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-30T21:14:13.105363] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T21:14:13.114956] [INFO ] [REMOTE ] SPR: Full fetch complete (59965 records). [2025-09-30T21:14:13.115164] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-30T21:14:13.538453] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-30T21:14:13.538759] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-30T21:14:13.540493] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-30T21:14:13.540721] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-30T21:14:13.557873] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T21:14:13.558064] [DEBUG] [LOCAL ] SPR: Trimmed 59965 records to 41107 (keeping 200 days of data) [2025-09-30T21:14:13.817110] [DEBUG] [LOCAL ] SPR: Primary data saved (41107 records). [2025-09-30T21:14:13.817244] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-30T21:14:13.817400] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPR took 28.5s. Estimated remaining: 49m 53s. Rate: 7.8 symbols/min [2025-09-30T21:14:13.864631] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-30T21:14:14.001948] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:14.014927] [DEBUG] [LOCAL ] SPXX: Loaded 9028 existing records from primary storage. [2025-09-30T21:14:14.015185] [INFO ] [MAIN ] SPXX: Loaded 9028 existing records. [2025-09-30T21:14:14.210977] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:14.211215] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-30T21:14:14.211322] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-30T21:14:14.212567] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-30T21:14:14.212671] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-30T21:14:14.609971] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:14.654309] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-30T21:14:15.256604] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T21:14:15.289342] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T21:14:15.381927] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T21:14:15.454369] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-30T21:14:16.254420] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-30T21:14:16.301490] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T21:14:16.314446] [INFO ] [REMOTE ] SPOT: Full fetch complete (73393 records). [2025-09-30T21:14:16.314762] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-30T21:14:16.316175] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:14:16.316292] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:14:16.316337] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:14:16.316381] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-30T21:14:16.316478] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-09-30T21:14:16.316536] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-09-30T21:14:16.316632] [DEBUG] [LOCAL ] SPOT: No derivative data file found to delete. [2025-09-30T21:14:16.316800] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPOT took 33.4s. Estimated remaining: 49m 44s. Rate: 7.8 symbols/min [2025-09-30T21:14:16.499144] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:16.563709] [DEBUG] [LOCAL ] SQM: Loaded 48530 existing records from primary storage. [2025-09-30T21:14:16.564213] [INFO ] [MAIN ] SQM: Loaded 48530 existing records. [2025-09-30T21:14:16.761127] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:16.761457] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-30T21:14:16.761507] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-30T21:14:16.762245] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-30T21:14:16.762307] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-30T21:14:17.059523] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-30T21:14:17.139099] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:17.375019] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T21:14:17.740167] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T21:14:17.854372] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-30T21:14:18.654367] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-30T21:14:19.361037] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T21:14:19.454329] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-30T21:14:19.617935] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T21:14:20.254391] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-30T21:14:20.349712] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T21:14:20.735439] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T21:14:21.054361] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-30T21:14:21.854341] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-30T21:14:21.913838] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:14:22.654396] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-30T21:14:23.450544] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T21:14:23.454297] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-30T21:14:23.543946] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T21:14:24.254362] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-30T21:14:24.303957] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T21:14:25.054331] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-30T21:14:25.218215] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:14:25.854357] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-30T21:14:26.530938] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T21:14:26.530593] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T21:14:26.654365] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-30T21:14:27.454400] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-30T21:14:27.889119] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T21:14:28.254369] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-30T21:14:29.054363] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-30T21:14:29.356385] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T21:14:29.510006] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T21:14:29.854363] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-30T21:14:30.455765] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T21:14:30.659672] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-30T21:14:30.661436] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:14:31.454383] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-30T21:14:31.463463] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T21:14:32.254385] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-30T21:14:33.054348] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-30T21:14:33.158576] [DEBUG] [REMOTE ] SPXX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-30T21:14:33.158960] [WARN ] [REMOTE ] SPXX: No data returned for month 2025-06 [2025-09-30T21:14:33.159147] [FATAL] [REMOTE ] SPXX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:14:33.159273] [FATAL] [MAIN ] SPXX: Failed to fetch primary data. [2025-09-30T21:14:33.159356] [WARN ] [MAIN ] SPXX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:14:33.159453] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-30T21:14:33.159553] [DEBUG] [LOCAL ] SPXX: No primary data file found to delete. [2025-09-30T21:14:33.159719] [INFO ] [LOCAL ] SPXX: Starting deletion of derivative data. [2025-09-30T21:14:33.160307] [DEBUG] [LOCAL ] SPXX: Deleted derivative data file. [2025-09-30T21:14:33.160415] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPXX took 19.3s. Estimated remaining: 49m 38s. Rate: 7.8 symbols/min [2025-09-30T21:14:33.356192] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:33.386945] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T21:14:33.422699] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T21:14:33.436602] [DEBUG] [LOCAL ] SQNS: Loaded 26214 existing records from primary storage. [2025-09-30T21:14:33.436913] [INFO ] [MAIN ] SQNS: Loaded 26214 existing records. [2025-09-30T21:14:33.628826] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:33.629051] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-30T21:14:33.629100] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-30T21:14:33.629440] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-30T21:14:33.629501] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-30T21:14:33.859529] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-30T21:14:34.018212] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:34.654374] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-30T21:14:35.135204] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T21:14:35.141033] [INFO ] [REMOTE ] SPXC: Full fetch complete (34022 records). [2025-09-30T21:14:35.141157] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-30T21:14:35.459462] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-30T21:14:35.555154] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-30T21:14:35.555241] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-30T21:14:35.555936] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-30T21:14:35.556009] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-30T21:14:35.556865] [DEBUG] [LOCAL ] SPXC: Trimmed 34022 records to 23324 (keeping 200 days of data) [2025-09-30T21:14:35.704461] [DEBUG] [LOCAL ] SPXC: Primary data saved (23324 records). [2025-09-30T21:14:35.704600] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-30T21:14:35.704756] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 32.9s. Estimated remaining: 49m 30s. Rate: 7.8 symbols/min [2025-09-30T21:14:35.879544] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:14:35.899585] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:35.938540] [DEBUG] [LOCAL ] SR: Loaded 32873 existing records from primary storage. [2025-09-30T21:14:35.938893] [INFO ] [MAIN ] SR: Loaded 32873 existing records. [2025-09-30T21:14:36.144065] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:36.144383] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-30T21:14:36.144442] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-30T21:14:36.145211] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-30T21:14:36.145272] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-30T21:14:36.259435] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-30T21:14:36.482236] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T21:14:36.506220] [INFO ] [REMOTE ] SPRU: Full fetch complete (11556 records). [2025-09-30T21:14:36.534477] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-30T21:14:36.664505] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:36.988780] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-30T21:14:36.988868] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-30T21:14:36.989148] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-30T21:14:36.989231] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-30T21:14:36.989812] [DEBUG] [LOCAL ] SPRU: Trimmed 11556 records to 8931 (keeping 200 days of data) [2025-09-30T21:14:37.043724] [DEBUG] [LOCAL ] SPRU: Primary data saved (8931 records). [2025-09-30T21:14:37.043861] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-30T21:14:37.043969] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPRU took 40.9s. Estimated remaining: 49m 21s. Rate: 7.8 symbols/min [2025-09-30T21:14:37.059469] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-30T21:14:37.245189] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:37.245683] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-09-30T21:14:37.245745] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-09-30T21:14:37.245910] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-30T21:14:37.245962] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-30T21:14:37.246012] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-30T21:14:37.246067] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-30T21:14:37.637020] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:37.854349] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-30T21:14:37.983134] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T21:14:38.173837] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T21:14:38.372308] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T21:14:38.654352] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-30T21:14:39.454342] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-30T21:14:39.593600] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T21:14:40.254345] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-30T21:14:40.412942] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T21:14:40.750540] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T21:14:41.054409] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-30T21:14:41.854472] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-30T21:14:42.654366] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-30T21:14:42.712077] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:14:42.912540] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T21:14:43.454339] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-30T21:14:43.568826] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T21:14:44.254429] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-30T21:14:45.054374] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-30T21:14:45.138633] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T21:14:45.367397] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T21:14:45.854339] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-30T21:14:46.110868] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T21:14:46.654372] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-30T21:14:47.436493] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T21:14:47.454312] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-30T21:14:48.101234] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T21:14:48.254366] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-30T21:14:49.054392] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-30T21:14:49.258730] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T21:14:49.269932] [INFO ] [REMOTE ] SQM: Full fetch complete (68920 records). [2025-09-30T21:14:49.270112] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-30T21:14:49.724184] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-30T21:14:49.724352] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-30T21:14:49.725688] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-30T21:14:49.725782] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-30T21:14:49.727410] [DEBUG] [LOCAL ] SQM: Trimmed 68920 records to 48586 (keeping 200 days of data) [2025-09-30T21:14:49.855944] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-30T21:14:49.973546] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:14:50.001432] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T21:14:50.073056] [DEBUG] [LOCAL ] SQM: Primary data saved (48586 records). [2025-09-30T21:14:50.073211] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-30T21:14:50.073300] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQM took 33.8s. Estimated remaining: 49m 14s. Rate: 7.8 symbols/min [2025-09-30T21:14:50.259487] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:14:50.272762] [DEBUG] [LOCAL ] SREA: Loaded 10419 existing records from primary storage. [2025-09-30T21:14:50.273021] [INFO ] [MAIN ] SREA: Loaded 10419 existing records. [2025-09-30T21:14:50.479762] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:14:50.480001] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-30T21:14:50.480050] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-30T21:14:50.480485] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-30T21:14:50.480573] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-30T21:14:50.662430] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-30T21:14:50.901000] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:14:50.955593] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T21:14:51.454924] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-30T21:14:51.762002] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T21:14:52.254386] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-30T21:14:53.033448] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:14:53.054314] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-30T21:14:53.144631] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T21:14:53.854404] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-30T21:14:54.130324] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T21:14:54.654372] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-30T21:14:55.245752] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T21:14:55.454411] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-30T21:14:56.254366] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-30T21:14:56.919438] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:14:56.977965] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-30T21:14:57.054364] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-30T21:14:57.131963] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T21:14:57.854379] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-30T21:14:58.562716] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T21:14:58.654331] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-30T21:14:58.892724] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T21:14:59.454344] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-30T21:14:59.679446] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T21:15:00.254392] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-30T21:15:00.831037] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T21:15:01.054360] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-30T21:15:01.396585] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T21:15:01.854402] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-30T21:15:02.654364] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-30T21:15:02.744173] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:15:02.995639] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T21:15:03.335740] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T21:15:03.454371] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-30T21:15:04.254364] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-30T21:15:04.440453] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T21:15:05.054356] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-30T21:15:05.173608] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T21:15:05.184800] [INFO ] [REMOTE ] SRE: Full fetch complete (76904 records). [2025-09-30T21:15:05.184970] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-30T21:15:05.185723] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:15:05.185812] [FATAL] [MAIN ] SRE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:15:05.185857] [WARN ] [MAIN ] SRE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:15:05.185980] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-30T21:15:05.186058] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-30T21:15:05.186097] [INFO ] [LOCAL ] SRE: Starting deletion of derivative data. [2025-09-30T21:15:05.186138] [DEBUG] [LOCAL ] SRE: No derivative data file found to delete. [2025-09-30T21:15:05.186195] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SRE took 28.1s. Estimated remaining: 49m 8s. Rate: 7.8 symbols/min [2025-09-30T21:15:05.376523] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:05.418582] [DEBUG] [LOCAL ] SRFM: Loaded 36247 existing records from primary storage. [2025-09-30T21:15:05.418944] [INFO ] [MAIN ] SRFM: Loaded 36247 existing records. [2025-09-30T21:15:05.620858] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:05.621100] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-30T21:15:05.621156] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-30T21:15:05.621967] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-30T21:15:05.622032] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-30T21:15:05.862695] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-30T21:15:06.005024] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:06.363889] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T21:15:06.371561] [INFO ] [REMOTE ] SR: Full fetch complete (46165 records). [2025-09-30T21:15:06.371732] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-30T21:15:06.659683] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-30T21:15:06.813506] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-30T21:15:06.813621] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-30T21:15:06.814615] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-30T21:15:06.822427] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-30T21:15:06.823925] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T21:15:06.830140] [DEBUG] [LOCAL ] SR: Trimmed 46165 records to 32887 (keeping 200 days of data) [2025-09-30T21:15:07.055704] [DEBUG] [LOCAL ] SR: Primary data saved (32887 records). [2025-09-30T21:15:07.055865] [INFO ] [MAIN ] SR: Full history saved. [2025-09-30T21:15:07.055975] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 31.4s. Estimated remaining: 48m 59s. Rate: 7.8 symbols/min [2025-09-30T21:15:07.233023] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:07.251465] [DEBUG] [LOCAL ] SRG: Loaded 15524 existing records from primary storage. [2025-09-30T21:15:07.251750] [INFO ] [MAIN ] SRG: Loaded 15524 existing records. [2025-09-30T21:15:07.458341] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-30T21:15:07.462373] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:07.463617] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-30T21:15:07.463715] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-30T21:15:07.463970] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-30T21:15:07.464031] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-30T21:15:07.841358] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:08.254340] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-30T21:15:08.413523] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T21:15:08.624197] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T21:15:09.054359] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-30T21:15:09.799676] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T21:15:09.854356] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-30T21:15:10.654370] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-30T21:15:10.684977] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T21:15:11.448362] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:15:11.454297] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-30T21:15:11.542734] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T21:15:11.551389] [INFO ] [REMOTE ] SQNS: Full fetch complete (31951 records). [2025-09-30T21:15:11.551555] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-30T21:15:11.962793] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-30T21:15:11.962883] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-30T21:15:11.963607] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-30T21:15:11.963677] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-30T21:15:11.965233] [DEBUG] [LOCAL ] SQNS: Trimmed 31951 records to 26313 (keeping 200 days of data) [2025-09-30T21:15:12.128840] [DEBUG] [LOCAL ] SQNS: Primary data saved (26313 records). [2025-09-30T21:15:12.128987] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-30T21:15:12.129098] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SQNS took 39.0s. Estimated remaining: 48m 51s. Rate: 7.8 symbols/min [2025-09-30T21:15:12.259493] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-30T21:15:12.327985] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:12.338017] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T21:15:12.365818] [DEBUG] [LOCAL ] SRI: Loaded 27306 existing records from primary storage. [2025-09-30T21:15:12.366107] [INFO ] [MAIN ] SRI: Loaded 27306 existing records. [2025-09-30T21:15:12.566322] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:12.566560] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-30T21:15:12.566610] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-30T21:15:12.567468] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-30T21:15:12.567531] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-30T21:15:12.973108] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:13.054331] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-30T21:15:13.370604] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T21:15:13.853086] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T21:15:13.855549] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-30T21:15:14.654332] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-30T21:15:14.867907] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T21:15:15.435092] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T21:15:15.437317] [INFO ] [REMOTE ] SREA: Full fetch complete (15842 records). [2025-09-30T21:15:15.437389] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-30T21:15:15.461926] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-30T21:15:15.834532] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-30T21:15:15.834616] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-30T21:15:15.835057] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-30T21:15:15.835121] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-30T21:15:15.835792] [DEBUG] [LOCAL ] SREA: Trimmed 15842 records to 10425 (keeping 200 days of data) [2025-09-30T21:15:15.902106] [DEBUG] [LOCAL ] SREA: Primary data saved (10425 records). [2025-09-30T21:15:15.902272] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-30T21:15:15.902413] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SREA took 25.8s. Estimated remaining: 48m 42s. Rate: 7.8 symbols/min [2025-09-30T21:15:16.136062] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:16.136303] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-30T21:15:16.136385] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-30T21:15:16.136551] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-30T21:15:16.136637] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-30T21:15:16.136921] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-30T21:15:16.137001] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-30T21:15:16.259472] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-30T21:15:16.591748] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:16.675636] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T21:15:17.054379] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-30T21:15:17.432548] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T21:15:17.854322] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-30T21:15:18.239104] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T21:15:18.654332] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-30T21:15:19.035074] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T21:15:19.392043] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T21:15:19.454385] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-30T21:15:20.254399] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-30T21:15:20.696731] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T21:15:21.054363] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-30T21:15:21.733176] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T21:15:21.743503] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T21:15:21.854368] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-30T21:15:22.654376] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-30T21:15:22.947944] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:15:23.406955] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T21:15:23.454360] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-30T21:15:24.254403] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-30T21:15:24.401892] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T21:15:24.875167] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T21:15:25.054367] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-30T21:15:25.507518] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-30T21:15:25.854362] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-30T21:15:26.654381] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-30T21:15:27.201408] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T21:15:27.454392] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-30T21:15:27.805011] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T21:15:28.254361] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-30T21:15:28.640863] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T21:15:29.054416] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-30T21:15:29.543258] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T21:15:29.854378] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-30T21:15:30.031285] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T21:15:30.185864] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T21:15:30.654371] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-30T21:15:31.454377] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-30T21:15:31.685143] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T21:15:31.689166] [INFO ] [REMOTE ] SRG: Full fetch complete (24846 records). [2025-09-30T21:15:31.689315] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-30T21:15:32.006214] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T21:15:32.120436] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-30T21:15:32.120527] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-30T21:15:32.121044] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-30T21:15:32.121108] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-30T21:15:32.121820] [DEBUG] [LOCAL ] SRG: Trimmed 24846 records to 15509 (keeping 200 days of data) [2025-09-30T21:15:32.221254] [DEBUG] [LOCAL ] SRG: Primary data saved (15509 records). [2025-09-30T21:15:32.221431] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-30T21:15:32.221576] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRG took 25.2s. Estimated remaining: 48m 36s. Rate: 7.8 symbols/min [2025-09-30T21:15:32.259443] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-30T21:15:32.411879] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:32.422927] [DEBUG] [LOCAL ] SRV: Loaded 7429 existing records from primary storage. [2025-09-30T21:15:32.423131] [INFO ] [MAIN ] SRV: Loaded 7429 existing records. [2025-09-30T21:15:32.625353] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:32.625584] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-30T21:15:32.625668] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-30T21:15:32.625943] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-30T21:15:32.626004] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-30T21:15:32.914503] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:15:33.030614] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:33.054357] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-30T21:15:33.854321] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-30T21:15:34.164354] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T21:15:34.319501] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T21:15:34.654364] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-30T21:15:35.454371] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-30T21:15:35.566294] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:15:36.254342] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-30T21:15:36.623806] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T21:15:36.854852] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T21:15:37.054402] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-30T21:15:37.492831] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T21:15:37.854400] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-30T21:15:38.198239] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-30T21:15:38.199279] [INFO ] [REMOTE ] SRL: Full fetch complete (1957 records). [2025-09-30T21:15:38.199354] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-30T21:15:38.418277] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-30T21:15:38.418476] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:15:38.418544] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:15:38.418621] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-30T21:15:38.418726] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-30T21:15:38.418772] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-30T21:15:38.418849] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-30T21:15:38.418930] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRL took 22.5s. Estimated remaining: 48m 28s. Rate: 7.8 symbols/min [2025-09-30T21:15:38.610985] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:38.654926] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-30T21:15:38.657239] [DEBUG] [LOCAL ] SSB: Loaded 42740 existing records from primary storage. [2025-09-30T21:15:38.657727] [INFO ] [MAIN ] SSB: Loaded 42740 existing records. [2025-09-30T21:15:38.859912] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:38.860117] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-30T21:15:38.860164] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-30T21:15:38.861271] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-30T21:15:38.861335] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-30T21:15:39.281307] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:39.454361] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-30T21:15:39.542446] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:15:40.254412] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-30T21:15:40.960477] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T21:15:41.054409] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-30T21:15:41.850791] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T21:15:41.852196] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:15:41.854900] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-30T21:15:42.654399] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-30T21:15:43.357213] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T21:15:43.454339] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-30T21:15:44.254355] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-30T21:15:44.320164] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T21:15:44.497438] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T21:15:45.054364] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-30T21:15:45.859471] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-30T21:15:45.873877] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T21:15:45.912956] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T21:15:46.654371] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-30T21:15:47.454331] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-30T21:15:47.920193] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T21:15:48.254349] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-30T21:15:48.349515] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T21:15:48.587808] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-30T21:15:49.054405] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-30T21:15:49.862289] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-30T21:15:49.867089] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:15:50.315540] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T21:15:50.320898] [INFO ] [REMOTE ] SRI: Full fetch complete (41458 records). [2025-09-30T21:15:50.321042] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-30T21:15:50.659541] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-30T21:15:50.744743] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-30T21:15:50.744824] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-30T21:15:50.745736] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-30T21:15:50.745802] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-30T21:15:50.747036] [DEBUG] [LOCAL ] SRI: Trimmed 41458 records to 27270 (keeping 200 days of data) [2025-09-30T21:15:50.910821] [DEBUG] [LOCAL ] SRI: Primary data saved (27270 records). [2025-09-30T21:15:50.911008] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-30T21:15:50.911104] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 38.8s. Estimated remaining: 48m 22s. Rate: 7.8 symbols/min [2025-09-30T21:15:51.145121] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:51.171282] [DEBUG] [LOCAL ] SSD: Loaded 22375 existing records from primary storage. [2025-09-30T21:15:51.171560] [INFO ] [MAIN ] SSD: Loaded 22375 existing records. [2025-09-30T21:15:51.367781] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:51.368008] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-30T21:15:51.368069] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-30T21:15:51.368619] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-30T21:15:51.368712] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-30T21:15:51.458284] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-30T21:15:51.542093] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T21:15:51.776665] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:52.135237] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-30T21:15:52.254400] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-30T21:15:53.047172] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T21:15:53.054306] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-30T21:15:53.117208] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T21:15:53.854332] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-30T21:15:54.008748] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T21:15:54.011852] [INFO ] [REMOTE ] SRV: Full fetch complete (11574 records). [2025-09-30T21:15:54.011947] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-30T21:15:54.447331] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-30T21:15:54.447415] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-30T21:15:54.447730] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-30T21:15:54.447806] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-30T21:15:54.448403] [DEBUG] [LOCAL ] SRV: Trimmed 11574 records to 7419 (keeping 200 days of data) [2025-09-30T21:15:54.494524] [DEBUG] [LOCAL ] SRV: Primary data saved (7419 records). [2025-09-30T21:15:54.494684] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-30T21:15:54.494788] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 22.3s. Estimated remaining: 48m 13s. Rate: 7.8 symbols/min [2025-09-30T21:15:54.661569] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-30T21:15:54.691874] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:54.733376] [DEBUG] [LOCAL ] SSL: Loaded 41163 existing records from primary storage. [2025-09-30T21:15:54.733755] [INFO ] [MAIN ] SSL: Loaded 41163 existing records. [2025-09-30T21:15:54.931042] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:54.931310] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-30T21:15:54.931386] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-30T21:15:54.932181] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-30T21:15:54.932244] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-30T21:15:55.341735] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:55.454363] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-30T21:15:56.019433] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T21:15:56.030574] [INFO ] [REMOTE ] SRFM: Full fetch complete (49367 records). [2025-09-30T21:15:56.030751] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-30T21:15:56.264596] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-30T21:15:56.493894] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-30T21:15:56.494026] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-30T21:15:56.495228] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-30T21:15:56.495755] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-30T21:15:56.497495] [DEBUG] [LOCAL ] SRFM: Trimmed 49367 records to 36500 (keeping 200 days of data) [2025-09-30T21:15:56.612297] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T21:15:56.667479] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T21:15:56.775047] [DEBUG] [LOCAL ] SRFM: Primary data saved (36500 records). [2025-09-30T21:15:56.775251] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-30T21:15:56.775390] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SRFM took 51.6s. Estimated remaining: 48m 4s. Rate: 7.8 symbols/min [2025-09-30T21:15:56.966186] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:15:56.979194] [DEBUG] [LOCAL ] SST: Loaded 11966 existing records from primary storage. [2025-09-30T21:15:56.979428] [INFO ] [MAIN ] SST: Loaded 11966 existing records. [2025-09-30T21:15:57.063581] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-30T21:15:57.181500] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:15:57.181732] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-30T21:15:57.181789] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-30T21:15:57.182214] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-30T21:15:57.182275] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-30T21:15:57.591266] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:15:57.854334] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-30T21:15:57.894181] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:15:58.654422] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-30T21:15:58.878208] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T21:15:59.089941] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T21:15:59.454387] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-30T21:15:59.518779] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T21:16:00.254385] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-30T21:16:01.054371] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-30T21:16:01.180259] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:16:01.415410] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T21:16:01.854410] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-30T21:16:02.476612] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:16:02.654384] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-30T21:16:02.940903] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:16:03.454367] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-30T21:16:04.254410] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-30T21:16:04.383709] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:16:05.054372] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-30T21:16:05.127026] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:16:05.202709] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T21:16:05.854439] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-30T21:16:06.090443] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T21:16:06.654420] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-30T21:16:07.125766] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T21:16:07.454328] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-30T21:16:07.526676] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T21:16:08.254377] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-30T21:16:08.858970] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T21:16:09.054404] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-30T21:16:09.854358] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-30T21:16:09.932541] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:16:09.981849] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T21:16:10.654377] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-30T21:16:11.059077] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T21:16:11.454405] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-30T21:16:11.924937] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T21:16:12.254376] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-30T21:16:12.760966] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T21:16:13.054407] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-30T21:16:13.849196] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T21:16:13.854297] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-30T21:16:13.994051] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:16:14.654339] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-30T21:16:14.780066] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T21:16:15.454361] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-30T21:16:16.193318] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T21:16:16.195425] [INFO ] [REMOTE ] SST: Full fetch complete (18928 records). [2025-09-30T21:16:16.195551] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-30T21:16:16.258195] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-30T21:16:16.636055] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-30T21:16:16.636586] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-30T21:16:16.637355] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-30T21:16:16.637465] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-30T21:16:16.638721] [DEBUG] [LOCAL ] SST: Trimmed 18928 records to 11924 (keeping 200 days of data) [2025-09-30T21:16:16.722610] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T21:16:16.753399] [DEBUG] [LOCAL ] SST: Primary data saved (11924 records). [2025-09-30T21:16:16.753546] [INFO ] [MAIN ] SST: Full history saved. [2025-09-30T21:16:16.753777] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SST took 20.0s. Estimated remaining: 47m 59s. Rate: 7.8 symbols/min [2025-09-30T21:16:17.054403] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-30T21:16:17.854331] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-30T21:16:17.952594] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T21:16:17.961892] [INFO ] [REMOTE ] SSB: Full fetch complete (61153 records). [2025-09-30T21:16:17.962028] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-30T21:16:18.414416] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-30T21:16:18.414534] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-30T21:16:18.415671] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-30T21:16:18.415739] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-30T21:16:18.417253] [DEBUG] [LOCAL ] SSB: Trimmed 61153 records to 42707 (keeping 200 days of data) [2025-09-30T21:16:18.704405] [DEBUG] [LOCAL ] SSB: Primary data saved (42707 records). [2025-09-30T21:16:18.704554] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-30T21:16:18.704639] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSB took 40.3s. Estimated remaining: 47m 50s. Rate: 7.8 symbols/min [2025-09-30T21:16:18.754258] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T21:16:18.763288] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-30T21:16:18.915880] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T21:16:19.454372] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-30T21:16:20.395382] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:16:20.404772] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-30T21:16:20.736441] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T21:16:21.054366] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-30T21:16:22.059406] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T21:16:22.069549] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-30T21:16:22.117820] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T21:16:22.123294] [INFO ] [REMOTE ] SSD: Full fetch complete (32404 records). [2025-09-30T21:16:22.123439] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-30T21:16:22.539440] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-30T21:16:22.539527] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-30T21:16:22.540291] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-30T21:16:22.540358] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-30T21:16:22.541351] [DEBUG] [LOCAL ] SSD: Trimmed 32404 records to 22460 (keeping 200 days of data) [2025-09-30T21:16:22.691603] [DEBUG] [LOCAL ] SSD: Primary data saved (22460 records). [2025-09-30T21:16:22.691778] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-30T21:16:22.691924] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSD took 31.8s. Estimated remaining: 47m 42s. Rate: 7.8 symbols/min [2025-09-30T21:16:23.791378] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T21:16:23.801280] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-30T21:16:25.569598] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T21:16:25.579028] [INFO ] [REMOTE ] SSL: Full fetch complete (60147 records). [2025-09-30T21:16:25.579153] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-30T21:16:26.035489] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-30T21:16:26.035593] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-30T21:16:26.036785] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-30T21:16:26.036881] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-30T21:16:26.038525] [DEBUG] [LOCAL ] SSL: Trimmed 60147 records to 41129 (keeping 200 days of data) [2025-09-30T21:16:26.360671] [DEBUG] [LOCAL ] SSL: Primary data saved (41129 records). [2025-09-30T21:16:26.361026] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-30T21:16:26.361170] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSL took 31.9s. Estimated remaining: 47m 34s. Rate: 7.8 symbols/min [2025-09-30T21:16:27.323536] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:27.319370] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:27.356082] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:27.395755] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:27.430322] [DEBUG] [LOCAL ] SSTK: Loaded 26016 existing records from primary storage. [2025-09-30T21:16:27.430834] [INFO ] [MAIN ] SSTK: Loaded 26016 existing records. [2025-09-30T21:16:27.485382] [DEBUG] [LOCAL ] STC: Loaded 17536 existing records from primary storage. [2025-09-30T21:16:27.540901] [INFO ] [MAIN ] STC: Loaded 17536 existing records. [2025-09-30T21:16:27.803017] [DEBUG] [LOCAL ] STAG: Loaded 50034 existing records from primary storage. [2025-09-30T21:16:27.805547] [DEBUG] [LOCAL ] ST: Loaded 49729 existing records from primary storage. [2025-09-30T21:16:27.834977] [INFO ] [MAIN ] STAG: Loaded 50034 existing records. [2025-09-30T21:16:27.840548] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:27.863978] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-30T21:16:27.863551] [INFO ] [MAIN ] ST: Loaded 49729 existing records. [2025-09-30T21:16:27.913068] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-30T21:16:27.961279] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-30T21:16:27.976126] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-30T21:16:27.965702] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:28.138979] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-30T21:16:28.149544] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-30T21:16:28.301989] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-30T21:16:28.322973] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-30T21:16:28.589866] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:28.755382] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-30T21:16:28.816837] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-30T21:16:28.836992] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:28.859244] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-30T21:16:28.876335] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-30T21:16:28.897260] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-30T21:16:28.919181] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-30T21:16:28.947536] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-30T21:16:28.957489] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-30T21:16:29.169895] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:29.212845] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-30T21:16:29.919259] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:29.965034] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-30T21:16:30.073250] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:30.074461] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-30T21:16:30.173615] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:30.174095] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-30T21:16:30.400139] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T21:16:30.407319] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-30T21:16:31.245271] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T21:16:31.249695] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-30T21:16:31.466859] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T21:16:31.477016] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-30T21:16:31.594756] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T21:16:31.610562] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-30T21:16:31.995184] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:16:32.003510] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-30T21:16:32.428243] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T21:16:32.432922] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-30T21:16:33.042455] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T21:16:33.052689] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-30T21:16:33.116636] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T21:16:33.126412] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-30T21:16:33.193076] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T21:16:33.200073] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-30T21:16:33.495617] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T21:16:33.854448] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-30T21:16:34.506103] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:16:34.595412] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T21:16:34.654395] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-30T21:16:34.868934] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T21:16:35.151258] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T21:16:35.454393] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-30T21:16:36.254401] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-30T21:16:36.543620] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:16:36.760810] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T21:16:37.054410] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-30T21:16:37.742744] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T21:16:37.854404] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-30T21:16:38.654389] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-30T21:16:39.033917] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T21:16:39.454331] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-30T21:16:39.677086] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T21:16:39.753713] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T21:16:40.254402] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-30T21:16:41.054337] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-30T21:16:41.316568] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T21:16:41.361500] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T21:16:41.854328] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-30T21:16:42.318986] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T21:16:42.654352] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-30T21:16:42.753778] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T21:16:43.454394] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-30T21:16:44.254412] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-30T21:16:44.528499] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T21:16:44.906798] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T21:16:45.054416] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-30T21:16:45.540754] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T21:16:45.854342] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-30T21:16:45.874294] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:16:46.654363] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-30T21:16:47.066861] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T21:16:47.355269] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T21:16:47.359483] [INFO ] [REMOTE ] STC: Full fetch complete (25973 records). [2025-09-30T21:16:47.359606] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-30T21:16:47.459508] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-30T21:16:47.797493] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-30T21:16:47.797687] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-30T21:16:47.798363] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-30T21:16:47.798442] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-30T21:16:47.799389] [DEBUG] [LOCAL ] STC: Trimmed 25973 records to 17485 (keeping 200 days of data) [2025-09-30T21:16:47.917748] [DEBUG] [LOCAL ] STC: Primary data saved (17485 records). [2025-09-30T21:16:47.917911] [INFO ] [MAIN ] STC: Full history saved. [2025-09-30T21:16:47.918048] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 21.6s. Estimated remaining: 47m 28s. Rate: 7.8 symbols/min [2025-09-30T21:16:48.100558] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:48.139930] [DEBUG] [LOCAL ] STE: Loaded 35218 existing records from primary storage. [2025-09-30T21:16:48.140263] [INFO ] [MAIN ] STE: Loaded 35218 existing records. [2025-09-30T21:16:48.259471] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-30T21:16:48.341825] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:48.342552] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-30T21:16:48.342618] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-30T21:16:48.343710] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-30T21:16:48.343774] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-30T21:16:48.726382] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:48.890713] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T21:16:49.054380] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-30T21:16:49.559635] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T21:16:49.854400] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-30T21:16:50.654390] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-30T21:16:50.964877] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T21:16:51.454363] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-30T21:16:51.657907] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T21:16:51.796799] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T21:16:51.802822] [INFO ] [REMOTE ] SSTK: Full fetch complete (41921 records). [2025-09-30T21:16:51.802955] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-30T21:16:52.224586] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-30T21:16:52.224739] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-30T21:16:52.225671] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-30T21:16:52.225773] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-30T21:16:52.227168] [DEBUG] [LOCAL ] SSTK: Trimmed 41921 records to 25974 (keeping 200 days of data) [2025-09-30T21:16:52.300227] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-30T21:16:52.342537] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T21:16:52.427331] [DEBUG] [LOCAL ] SSTK: Primary data saved (25974 records). [2025-09-30T21:16:52.427481] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-30T21:16:52.427593] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. SSTK took 26.1s. Estimated remaining: 47m 20s. Rate: 7.8 symbols/min [2025-09-30T21:16:52.611582] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:52.634467] [DEBUG] [LOCAL ] STEL: Loaded 23292 existing records from primary storage. [2025-09-30T21:16:52.634744] [INFO ] [MAIN ] STEL: Loaded 23292 existing records. [2025-09-30T21:16:52.867260] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:16:52.867509] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-30T21:16:52.867557] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-30T21:16:52.868193] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-30T21:16:52.868255] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-30T21:16:53.060195] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-30T21:16:53.256226] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:16:53.782385] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T21:16:53.854374] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-30T21:16:54.295870] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T21:16:54.651848] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T21:16:54.658585] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-30T21:16:55.454389] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-30T21:16:56.254382] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-30T21:16:56.337822] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:16:56.423522] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T21:16:57.054353] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-30T21:16:57.797329] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T21:16:57.854372] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-30T21:16:58.654335] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-30T21:16:58.679398] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T21:16:58.901726] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:16:58.913417] [INFO ] [REMOTE ] ST: Full fetch complete (71912 records). [2025-09-30T21:16:58.913576] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-30T21:16:59.337588] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-30T21:16:59.337705] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-30T21:16:59.338884] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-30T21:16:59.338953] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-30T21:16:59.340707] [DEBUG] [LOCAL ] ST: Trimmed 71912 records to 49737 (keeping 200 days of data) [2025-09-30T21:16:59.454370] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-30T21:16:59.658479] [DEBUG] [LOCAL ] ST: Primary data saved (49737 records). [2025-09-30T21:16:59.658619] [INFO ] [MAIN ] ST: Full history saved. [2025-09-30T21:16:59.658736] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. ST took 33.3s. Estimated remaining: 47m 12s. Rate: 7.8 symbols/min [2025-09-30T21:16:59.841473] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:16:59.879723] [DEBUG] [LOCAL ] STEM: Loaded 39510 existing records from primary storage. [2025-09-30T21:16:59.880093] [INFO ] [MAIN ] STEM: Loaded 39510 existing records. [2025-09-30T21:17:00.069080] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:00.069320] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-30T21:17:00.069371] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-30T21:17:00.070206] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-30T21:17:00.070270] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-30T21:17:00.254610] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-30T21:17:00.466594] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:00.583383] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T21:17:01.054330] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-30T21:17:01.158255] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-30T21:17:01.170507] [INFO ] [REMOTE ] STAG: Full fetch complete (72014 records). [2025-09-30T21:17:01.170733] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-30T21:17:01.704589] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T21:17:01.712892] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-30T21:17:01.719611] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-30T21:17:01.721116] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-30T21:17:01.721211] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-30T21:17:01.723315] [DEBUG] [LOCAL ] STAG: Trimmed 72014 records to 50054 (keeping 200 days of data) [2025-09-30T21:17:01.854494] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-30T21:17:02.065209] [DEBUG] [LOCAL ] STAG: Primary data saved (50054 records). [2025-09-30T21:17:02.065368] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-30T21:17:02.065495] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. STAG took 35.7s. Estimated remaining: 47m 4s. Rate: 7.8 symbols/min [2025-09-30T21:17:02.186915] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T21:17:02.266869] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:02.267100] [DEBUG] [LOCAL ] STEW: No existing data file found in primary storage. [2025-09-30T21:17:02.267176] [WARN ] [MAIN ] STEW: No existing data found, performing full refresh instead. [2025-09-30T21:17:02.267328] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-30T21:17:02.267385] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-30T21:17:02.267432] [DEBUG] [LOCAL ] STEW: No primary data file found to delete. [2025-09-30T21:17:02.267465] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-30T21:17:02.648921] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:02.654313] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-30T21:17:03.454349] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-30T21:17:03.717332] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T21:17:04.091797] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T21:17:04.254367] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-30T21:17:04.541997] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:17:05.054367] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-30T21:17:05.159890] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:17:05.857473] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-30T21:17:05.860093] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T21:17:06.654384] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-30T21:17:06.759494] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T21:17:07.454358] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-30T21:17:07.730166] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T21:17:08.254324] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-30T21:17:08.286241] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T21:17:08.805624] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T21:17:09.054364] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-30T21:17:09.854363] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-30T21:17:10.505999] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T21:17:10.654402] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-30T21:17:11.060361] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T21:17:11.454407] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-30T21:17:11.498770] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T21:17:12.254341] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-30T21:17:12.562515] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T21:17:12.835757] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:17:12.842885] [INFO ] [REMOTE ] STE: Full fetch complete (50341 records). [2025-09-30T21:17:12.842992] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-30T21:17:12.843696] [FATAL] [VALIDATOR ] STE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:17:12.843783] [FATAL] [MAIN ] STE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:17:12.843827] [WARN ] [MAIN ] STE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:17:12.843878] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-30T21:17:12.843976] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-09-30T21:17:12.844034] [INFO ] [LOCAL ] STE: Starting deletion of derivative data. [2025-09-30T21:17:12.844490] [DEBUG] [LOCAL ] STE: Deleted derivative data file. [2025-09-30T21:17:12.844587] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STE took 24.9s. Estimated remaining: 46m 57s. Rate: 7.8 symbols/min [2025-09-30T21:17:13.025394] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:13.025584] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-30T21:17:13.025624] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-30T21:17:13.025759] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-30T21:17:13.025802] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-30T21:17:13.025844] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-30T21:17:13.025878] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-30T21:17:13.059464] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-30T21:17:13.440943] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:13.854378] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-30T21:17:14.246705] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T21:17:14.293045] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T21:17:14.654370] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-30T21:17:15.454359] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-30T21:17:15.696014] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T21:17:16.079979] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T21:17:16.254402] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-30T21:17:17.054355] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-30T21:17:17.253167] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T21:17:17.854368] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-30T21:17:17.892998] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T21:17:18.492967] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T21:17:18.654395] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-30T21:17:19.454393] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-30T21:17:19.900187] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:17:20.254390] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-30T21:17:21.054431] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-30T21:17:21.408608] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T21:17:21.422713] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-30T21:17:21.863987] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-30T21:17:21.868154] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-30T21:17:22.654368] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-30T21:17:22.745013] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T21:17:22.748246] [INFO ] [REMOTE ] STEW: Full fetch complete (21847 records). [2025-09-30T21:17:22.748336] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-30T21:17:23.148779] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T21:17:23.149855] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-30T21:17:23.151349] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-30T21:17:23.152040] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-30T21:17:23.152109] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-30T21:17:23.153343] [DEBUG] [LOCAL ] STEW: Trimmed 21847 records to 16033 (keeping 200 days of data) [2025-09-30T21:17:23.256605] [DEBUG] [LOCAL ] STEW: Primary data saved (16033 records). [2025-09-30T21:17:23.256873] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-30T21:17:23.256970] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEW took 21.2s. Estimated remaining: 46m 49s. Rate: 7.8 symbols/min [2025-09-30T21:17:23.445721] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:23.456600] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-30T21:17:23.457140] [DEBUG] [LOCAL ] STK: Loaded 9304 existing records from primary storage. [2025-09-30T21:17:23.458834] [INFO ] [MAIN ] STK: Loaded 9304 existing records. [2025-09-30T21:17:23.655406] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:23.655670] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-30T21:17:23.655737] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-30T21:17:23.656275] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-30T21:17:23.656336] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-30T21:17:24.000997] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-30T21:17:24.023379] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:24.254375] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-30T21:17:25.054345] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-30T21:17:25.325048] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T21:17:25.330206] [INFO ] [REMOTE ] STEL: Full fetch complete (32149 records). [2025-09-30T21:17:25.330327] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-30T21:17:25.708891] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-30T21:17:25.709008] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-30T21:17:25.710111] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-30T21:17:25.710177] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-30T21:17:25.711881] [DEBUG] [LOCAL ] STEL: Trimmed 32149 records to 23231 (keeping 200 days of data) [2025-09-30T21:17:25.856911] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-30T21:17:25.887684] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T21:17:25.892067] [DEBUG] [LOCAL ] STEL: Primary data saved (23231 records). [2025-09-30T21:17:25.896332] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-30T21:17:25.896495] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEL took 33.5s. Estimated remaining: 46m 41s. Rate: 7.8 symbols/min [2025-09-30T21:17:26.072822] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:26.136403] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-09-30T21:17:26.137063] [INFO ] [MAIN ] STLA: Loaded 53542 existing records. [2025-09-30T21:17:26.325561] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:26.325905] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-30T21:17:26.325971] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-30T21:17:26.327204] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-30T21:17:26.327271] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-30T21:17:26.659604] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-30T21:17:26.702269] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:27.120364] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-30T21:17:27.454359] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-30T21:17:27.906324] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T21:17:27.996929] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-30T21:17:28.254367] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-30T21:17:29.054387] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-30T21:17:29.082241] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T21:17:29.854356] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-30T21:17:30.654353] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-30T21:17:31.173878] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T21:17:31.445666] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-30T21:17:31.457742] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-30T21:17:31.488611] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:17:32.254377] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-30T21:17:33.054369] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-30T21:17:33.668301] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-30T21:17:33.715243] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:17:33.729521] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T21:17:33.730581] [INFO ] [REMOTE ] STG: Full fetch complete (2488 records). [2025-09-30T21:17:33.730680] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-30T21:17:33.859558] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-30T21:17:33.926197] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-30T21:17:33.926400] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:17:33.926467] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:17:33.926540] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-30T21:17:33.926604] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-30T21:17:33.926665] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-30T21:17:33.926735] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-30T21:17:33.926795] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STG took 21.1s. Estimated remaining: 46m 33s. Rate: 7.8 symbols/min [2025-09-30T21:17:34.110128] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:34.174841] [DEBUG] [LOCAL ] STM: Loaded 53582 existing records from primary storage. [2025-09-30T21:17:34.175189] [INFO ] [MAIN ] STM: Loaded 53582 existing records. [2025-09-30T21:17:34.364931] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:34.365143] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-30T21:17:34.365190] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-30T21:17:34.366516] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-30T21:17:34.366580] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-30T21:17:34.664076] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-30T21:17:34.755159] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:35.454406] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-30T21:17:35.593953] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T21:17:35.873621] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T21:17:36.254395] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-30T21:17:36.885808] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T21:17:37.054374] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-30T21:17:37.197899] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T21:17:37.854360] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-30T21:17:38.654323] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-30T21:17:38.838638] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:17:39.454331] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-30T21:17:39.579130] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T21:17:39.862790] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T21:17:40.254356] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-30T21:17:41.054328] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-30T21:17:41.141819] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T21:17:41.728312] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-30T21:17:41.854352] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-30T21:17:42.402196] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T21:17:42.654401] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-30T21:17:43.454337] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-30T21:17:43.920046] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T21:17:44.254387] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-30T21:17:44.857002] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T21:17:44.970353] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-30T21:17:45.054369] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-30T21:17:45.854373] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-30T21:17:46.351482] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T21:17:46.462026] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T21:17:46.654380] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-30T21:17:47.167767] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T21:17:47.454364] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-30T21:17:48.254403] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-30T21:17:48.273327] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T21:17:48.940126] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-30T21:17:49.054376] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-30T21:17:49.854337] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-30T21:17:50.211692] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T21:17:50.218823] [INFO ] [REMOTE ] STEM: Full fetch complete (62286 records). [2025-09-30T21:17:50.219063] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-30T21:17:50.601705] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-30T21:17:50.664341] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-30T21:17:50.713253] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-30T21:17:50.713350] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-30T21:17:50.714346] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-30T21:17:50.714412] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-30T21:17:50.716010] [DEBUG] [LOCAL ] STEM: Trimmed 62286 records to 39380 (keeping 200 days of data) [2025-09-30T21:17:50.951596] [DEBUG] [LOCAL ] STEM: Primary data saved (39380 records). [2025-09-30T21:17:50.951786] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-30T21:17:50.951881] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STEM took 51.3s. Estimated remaining: 46m 27s. Rate: 7.8 symbols/min [2025-09-30T21:17:51.132159] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:51.154991] [DEBUG] [LOCAL ] STN: Loaded 22940 existing records from primary storage. [2025-09-30T21:17:51.155358] [INFO ] [MAIN ] STN: Loaded 22940 existing records. [2025-09-30T21:17:51.348065] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:51.348299] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-30T21:17:51.348389] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-30T21:17:51.349059] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-30T21:17:51.349122] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-30T21:17:51.454435] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-30T21:17:51.735263] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:51.769746] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T21:17:52.254335] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-30T21:17:52.470815] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T21:17:53.066887] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-30T21:17:53.073255] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-30T21:17:53.854317] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-30T21:17:53.993467] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T21:17:54.022340] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T21:17:54.654353] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-30T21:17:55.454347] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-30T21:17:55.779951] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T21:17:55.823688] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T21:17:56.254334] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-30T21:17:56.313497] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T21:17:56.316494] [INFO ] [REMOTE ] STK: Full fetch complete (14132 records). [2025-09-30T21:17:56.316603] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-30T21:17:56.696748] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-30T21:17:56.696852] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-30T21:17:56.697228] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-30T21:17:56.697280] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-30T21:17:56.697847] [DEBUG] [LOCAL ] STK: Trimmed 14132 records to 9399 (keeping 200 days of data) [2025-09-30T21:17:56.758967] [DEBUG] [LOCAL ] STK: Primary data saved (9399 records). [2025-09-30T21:17:56.759111] [INFO ] [MAIN ] STK: Full history saved. [2025-09-30T21:17:56.759201] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STK took 33.5s. Estimated remaining: 46m 19s. Rate: 7.8 symbols/min [2025-09-30T21:17:56.937911] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:17:56.980081] [DEBUG] [LOCAL ] STNG: Loaded 43903 existing records from primary storage. [2025-09-30T21:17:56.980418] [INFO ] [MAIN ] STNG: Loaded 43903 existing records. [2025-09-30T21:17:57.056963] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-30T21:17:57.176955] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:17:57.177342] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-30T21:17:57.177515] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-30T21:17:57.183843] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-30T21:17:57.189492] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-30T21:17:57.260555] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T21:17:57.606539] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:17:57.854380] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-30T21:17:58.654361] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-30T21:17:58.963552] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T21:17:59.454340] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-30T21:17:59.792523] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-30T21:17:59.803969] [INFO ] [REMOTE ] STLA: Full fetch complete (77530 records). [2025-09-30T21:17:59.804110] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-30T21:18:00.218222] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-30T21:18:00.218375] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-30T21:18:00.219514] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-30T21:18:00.219587] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-30T21:18:00.221356] [DEBUG] [LOCAL ] STLA: Trimmed 77530 records to 53542 (keeping 200 days of data) [2025-09-30T21:18:00.283429] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-30T21:18:00.569130] [DEBUG] [LOCAL ] STLA: Primary data saved (53542 records). [2025-09-30T21:18:00.569281] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-30T21:18:00.569408] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STLA took 34.7s. Estimated remaining: 46m 11s. Rate: 7.8 symbols/min [2025-09-30T21:18:00.777593] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:00.790614] [DEBUG] [LOCAL ] STRV: Loaded 11439 existing records from primary storage. [2025-09-30T21:18:00.790872] [INFO ] [MAIN ] STRV: Loaded 11439 existing records. [2025-09-30T21:18:01.024195] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:18:01.026599] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-30T21:18:01.037530] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-30T21:18:01.038318] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-30T21:18:01.039464] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-30T21:18:01.039534] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-30T21:18:01.061494] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-30T21:18:01.484322] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T21:18:01.482678] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:01.517000] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T21:18:01.854370] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-30T21:18:02.654407] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-30T21:18:03.203265] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T21:18:03.250186] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-30T21:18:03.454321] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-30T21:18:03.838092] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T21:18:04.254376] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-30T21:18:05.054342] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-30T21:18:05.570451] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T21:18:05.699632] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T21:18:05.831189] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T21:18:05.854347] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-30T21:18:06.654346] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-30T21:18:06.714620] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:18:07.454361] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-30T21:18:07.883027] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T21:18:08.254362] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-30T21:18:09.054371] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-30T21:18:09.854356] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-30T21:18:09.936263] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-30T21:18:09.984513] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:18:09.994123] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T21:18:09.985212] [INFO ] [REMOTE ] STM: Full fetch complete (77526 records). [2025-09-30T21:18:09.998884] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-30T21:18:10.439960] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-30T21:18:10.440044] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-30T21:18:10.441448] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-30T21:18:10.441521] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-30T21:18:10.443059] [DEBUG] [LOCAL ] STM: Trimmed 77526 records to 53581 (keeping 200 days of data) [2025-09-30T21:18:10.658678] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-30T21:18:10.833373] [DEBUG] [LOCAL ] STM: Primary data saved (53581 records). [2025-09-30T21:18:10.848692] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T21:18:10.847554] [INFO ] [MAIN ] STM: Full history saved. [2025-09-30T21:18:10.853824] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STM took 36.9s. Estimated remaining: 46m 3s. Rate: 7.8 symbols/min [2025-09-30T21:18:11.044134] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:11.044372] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-09-30T21:18:11.044417] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-09-30T21:18:11.044543] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-30T21:18:11.044624] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-30T21:18:11.044713] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-30T21:18:11.044757] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-30T21:18:11.426957] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:11.454323] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-30T21:18:11.798241] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T21:18:12.140505] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T21:18:12.254359] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-30T21:18:13.054415] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-30T21:18:13.229724] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T21:18:13.854358] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-30T21:18:14.618769] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T21:18:14.654411] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-30T21:18:15.313231] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:18:15.454341] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-30T21:18:15.677586] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T21:18:16.254341] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-30T21:18:17.054317] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-30T21:18:17.093424] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T21:18:17.148317] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T21:18:17.854335] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-30T21:18:17.983452] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T21:18:18.654365] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-30T21:18:19.170809] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T21:18:19.454336] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-30T21:18:19.580924] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T21:18:20.254361] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-30T21:18:20.862774] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T21:18:20.919618] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T21:18:21.054361] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-30T21:18:21.854409] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-30T21:18:22.143759] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T21:18:22.570519] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T21:18:22.654380] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-30T21:18:23.454380] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-30T21:18:24.029584] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T21:18:24.037904] [INFO ] [REMOTE ] STN: Full fetch complete (32406 records). [2025-09-30T21:18:24.038117] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-30T21:18:24.259724] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-30T21:18:24.475591] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-30T21:18:24.475737] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-30T21:18:24.476532] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-30T21:18:24.476599] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-30T21:18:24.477637] [DEBUG] [LOCAL ] STN: Trimmed 32406 records to 22898 (keeping 200 days of data) [2025-09-30T21:18:24.626730] [DEBUG] [LOCAL ] STN: Primary data saved (22898 records). [2025-09-30T21:18:24.626868] [INFO ] [MAIN ] STN: Full history saved. [2025-09-30T21:18:24.626955] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STN took 33.7s. Estimated remaining: 45m 57s. Rate: 7.8 symbols/min [2025-09-30T21:18:24.840827] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:24.841191] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-30T21:18:24.841260] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-30T21:18:24.841461] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-30T21:18:24.841522] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-30T21:18:24.841570] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-30T21:18:24.841614] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-30T21:18:25.056972] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-30T21:18:25.238610] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:25.293471] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T21:18:25.568229] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T21:18:25.854365] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-30T21:18:26.053243] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T21:18:26.096379] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:18:26.096748] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-30T21:18:26.096844] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:18:26.096931] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-30T21:18:26.096995] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:18:26.097062] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-30T21:18:26.097126] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-30T21:18:26.097178] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-30T21:18:26.097219] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-30T21:18:26.097291] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STUB took 1.5s. Estimated remaining: 45m 48s. Rate: 7.8 symbols/min [2025-09-30T21:18:26.295482] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:26.326818] [DEBUG] [LOCAL ] STVN: Loaded 26204 existing records from primary storage. [2025-09-30T21:18:26.327172] [INFO ] [MAIN ] STVN: Loaded 26204 existing records. [2025-09-30T21:18:26.518735] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:18:26.518943] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-30T21:18:26.518990] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-30T21:18:26.519549] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-30T21:18:26.519608] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-30T21:18:26.670354] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-30T21:18:26.918156] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:27.454355] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-30T21:18:27.555054] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T21:18:28.254425] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-30T21:18:28.906413] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T21:18:29.054363] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-30T21:18:29.138618] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:18:29.854338] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-30T21:18:29.894968] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T21:18:30.654350] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-30T21:18:30.665836] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T21:18:30.670294] [INFO ] [REMOTE ] STRV: Full fetch complete (18271 records). [2025-09-30T21:18:30.670457] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-30T21:18:31.078196] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-30T21:18:31.078290] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-30T21:18:31.078772] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-30T21:18:31.078838] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-30T21:18:31.079592] [DEBUG] [LOCAL ] STRV: Trimmed 18271 records to 11413 (keeping 200 days of data) [2025-09-30T21:18:31.155916] [DEBUG] [LOCAL ] STRV: Primary data saved (11413 records). [2025-09-30T21:18:31.156098] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-30T21:18:31.156195] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 30.6s. Estimated remaining: 45m 40s. Rate: 7.8 symbols/min [2025-09-30T21:18:31.342437] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:31.404244] [DEBUG] [LOCAL ] STWD: Loaded 51877 existing records from primary storage. [2025-09-30T21:18:31.404783] [INFO ] [MAIN ] STWD: Loaded 51877 existing records. [2025-09-30T21:18:31.459526] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-30T21:18:31.619545] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:18:31.619795] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-30T21:18:31.619894] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-30T21:18:31.621148] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-30T21:18:31.621212] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-30T21:18:32.009423] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:32.108231] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:18:32.254382] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-30T21:18:32.952335] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T21:18:32.961819] [INFO ] [REMOTE ] STNG: Full fetch complete (64464 records). [2025-09-30T21:18:32.961949] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-30T21:18:33.055757] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-30T21:18:33.425769] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T21:18:33.429286] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-30T21:18:33.429365] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-30T21:18:33.440452] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-30T21:18:33.440679] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-30T21:18:33.441080] [INFO ] [REMOTE ] STT: Full fetch complete (74094 records). [2025-09-30T21:18:33.441406] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-30T21:18:33.442430] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:18:33.442528] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:18:33.442574] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:18:33.442639] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-30T21:18:33.442754] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-30T21:18:33.442795] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-09-30T21:18:33.442854] [DEBUG] [LOCAL ] STT: No derivative data file found to delete. [2025-09-30T21:18:33.442949] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STT took 22.6s. Estimated remaining: 45m 31s. Rate: 7.8 symbols/min [2025-09-30T21:18:33.476095] [DEBUG] [LOCAL ] STNG: Trimmed 64464 records to 43901 (keeping 200 days of data) [2025-09-30T21:18:33.743418] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:33.819824] [DEBUG] [LOCAL ] STXD: Loaded 1289 existing records from primary storage. [2025-09-30T21:18:33.847999] [INFO ] [MAIN ] STXD: Loaded 1289 existing records. [2025-09-30T21:18:33.858436] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-30T21:18:34.071469] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:18:34.073809] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-30T21:18:34.074526] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-30T21:18:34.076244] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-30T21:18:34.076606] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-30T21:18:34.508548] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:34.533003] [DEBUG] [LOCAL ] STNG: Primary data saved (43901 records). [2025-09-30T21:18:34.533189] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-30T21:18:34.533343] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STNG took 37.8s. Estimated remaining: 45m 22s. Rate: 7.8 symbols/min [2025-09-30T21:18:34.659565] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-30T21:18:34.729388] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:18:34.735929] [DEBUG] [LOCAL ] STXE: Loaded 2172 existing records from primary storage. [2025-09-30T21:18:34.736601] [INFO ] [MAIN ] STXE: Loaded 2172 existing records. [2025-09-30T21:18:34.966156] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:18:34.967687] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-30T21:18:34.969787] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T21:18:34.969892] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-30T21:18:34.980008] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-30T21:18:34.980935] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-30T21:18:35.211516] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T21:18:35.382617] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T21:18:35.421400] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:18:35.454369] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-30T21:18:36.035198] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T21:18:36.254401] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-30T21:18:36.900115] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T21:18:37.054408] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-30T21:18:37.525867] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T21:18:37.854368] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-30T21:18:38.317798] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T21:18:38.654451] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-30T21:18:39.454395] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-30T21:18:39.831446] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T21:18:40.254357] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-30T21:18:41.054376] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-30T21:18:41.206478] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T21:18:41.496544] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T21:18:41.636548] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T21:18:41.854372] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-30T21:18:42.654353] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-30T21:18:43.144775] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T21:18:43.374792] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T21:18:43.454365] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-30T21:18:44.254366] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-30T21:18:44.752406] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T21:18:45.054350] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-30T21:18:45.452181] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T21:18:45.854542] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-30T21:18:46.450533] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T21:18:46.607052] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T21:18:46.654338] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-30T21:18:47.454377] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-30T21:18:47.875905] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T21:18:48.254353] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-30T21:18:49.054420] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-30T21:18:49.192498] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T21:18:49.241389] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T21:18:49.386219] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T21:18:49.854407] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-30T21:18:50.244869] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T21:18:50.654404] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-30T21:18:51.070288] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T21:18:51.454404] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-30T21:18:52.254358] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-30T21:18:53.054413] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-30T21:18:53.180414] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T21:18:53.426780] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T21:18:53.474807] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T21:18:53.854365] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-30T21:18:54.654406] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-30T21:18:55.176464] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T21:18:55.454412] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-30T21:18:55.927289] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T21:18:56.254426] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-30T21:18:56.808473] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T21:18:57.054340] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-30T21:18:57.153802] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (3.30 seconds). [2025-09-30T21:18:57.854417] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-30T21:18:58.319061] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T21:18:58.355048] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T21:18:58.654459] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-30T21:18:58.994247] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T21:18:59.454468] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-30T21:18:59.868708] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T21:18:59.869881] [INFO ] [REMOTE ] STXD: Full fetch complete (2062 records). [2025-09-30T21:18:59.870008] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-30T21:19:00.265612] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-30T21:19:00.266386] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-30T21:19:00.267855] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-30T21:19:00.268088] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-30T21:19:00.268170] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-30T21:19:00.268942] [DEBUG] [LOCAL ] STXD: Trimmed 2062 records to 1287 (keeping 200 days of data) [2025-09-30T21:19:00.279726] [DEBUG] [LOCAL ] STXD: Primary data saved (1287 records). [2025-09-30T21:19:00.279891] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-30T21:19:00.280068] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STXD took 26.8s. Estimated remaining: 45m 18s. Rate: 7.8 symbols/min [2025-09-30T21:19:00.457712] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:00.463753] [DEBUG] [LOCAL ] STXG: Loaded 2515 existing records from primary storage. [2025-09-30T21:19:00.463925] [INFO ] [MAIN ] STXG: Loaded 2515 existing records. [2025-09-30T21:19:00.702817] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:00.703169] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-30T21:19:00.703236] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-30T21:19:00.703564] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-30T21:19:00.703629] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-30T21:19:00.967031] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T21:19:00.995792] [INFO ] [REMOTE ] STXE: Full fetch complete (3706 records). [2025-09-30T21:19:01.001857] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-30T21:19:01.059585] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-30T21:19:01.231113] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:01.525275] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-30T21:19:01.525441] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-30T21:19:01.525702] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-30T21:19:01.525780] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-30T21:19:01.526306] [DEBUG] [LOCAL ] STXE: Trimmed 3706 records to 2181 (keeping 200 days of data) [2025-09-30T21:19:01.543236] [DEBUG] [LOCAL ] STXE: Primary data saved (2181 records). [2025-09-30T21:19:01.543459] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-30T21:19:01.543590] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXE took 27.0s. Estimated remaining: 45m 9s. Rate: 7.8 symbols/min [2025-09-30T21:19:01.718569] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:01.722540] [DEBUG] [LOCAL ] STXK: Loaded 1495 existing records from primary storage. [2025-09-30T21:19:01.722868] [INFO ] [MAIN ] STXK: Loaded 1495 existing records. [2025-09-30T21:19:01.859597] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-30T21:19:01.923542] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:01.923835] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-30T21:19:01.923889] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-30T21:19:01.924143] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-30T21:19:01.924205] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-30T21:19:02.307608] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:02.654385] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-30T21:19:02.932293] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T21:19:03.194777] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T21:19:03.367840] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:19:03.375000] [INFO ] [REMOTE ] STVN: Full fetch complete (39492 records). [2025-09-30T21:19:03.375173] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-30T21:19:03.459490] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-30T21:19:03.795191] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-30T21:19:03.795327] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-30T21:19:03.796264] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-30T21:19:03.796353] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-30T21:19:03.797439] [DEBUG] [LOCAL ] STVN: Trimmed 39492 records to 26313 (keeping 200 days of data) [2025-09-30T21:19:04.002754] [DEBUG] [LOCAL ] STVN: Primary data saved (26313 records). [2025-09-30T21:19:04.002925] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-30T21:19:04.003043] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STVN took 37.9s. Estimated remaining: 45m 0s. Rate: 7.8 symbols/min [2025-09-30T21:19:04.188760] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:04.188974] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-30T21:19:04.189024] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-30T21:19:04.189165] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-30T21:19:04.189206] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-30T21:19:04.189253] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-30T21:19:04.189299] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-30T21:19:04.259511] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-30T21:19:04.566064] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:05.020791] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T21:19:05.054417] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-30T21:19:05.346459] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T21:19:05.476368] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T21:19:05.854364] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-30T21:19:06.270838] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T21:19:06.654388] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-30T21:19:07.454382] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-30T21:19:08.103114] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T21:19:08.254339] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-30T21:19:08.564737] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T21:19:08.577712] [INFO ] [REMOTE ] STWD: Full fetch complete (75060 records). [2025-09-30T21:19:08.578112] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-30T21:19:08.874901] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T21:19:09.014395] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-30T21:19:09.014764] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-30T21:19:09.015988] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-30T21:19:09.016210] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-30T21:19:09.020869] [DEBUG] [LOCAL ] STWD: Trimmed 75060 records to 51880 (keeping 200 days of data) [2025-09-30T21:19:09.079108] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-30T21:19:09.367809] [DEBUG] [LOCAL ] STWD: Primary data saved (51880 records). [2025-09-30T21:19:09.367986] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-30T21:19:09.368096] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STWD took 38.2s. Estimated remaining: 44m 52s. Rate: 7.8 symbols/min [2025-09-30T21:19:09.557063] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:09.561341] [DEBUG] [LOCAL ] STXT: Loaded 2526 existing records from primary storage. [2025-09-30T21:19:09.561497] [INFO ] [MAIN ] STXT: Loaded 2526 existing records. [2025-09-30T21:19:09.770144] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T21:19:09.769075] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:09.770520] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-30T21:19:09.772483] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-30T21:19:09.772946] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-30T21:19:09.773014] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-30T21:19:09.859580] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-30T21:19:10.154290] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:10.552127] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T21:19:10.654369] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-30T21:19:11.332103] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T21:19:11.454337] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-30T21:19:11.980155] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T21:19:12.254378] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-30T21:19:12.775820] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T21:19:13.054366] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-30T21:19:13.440136] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T21:19:13.854371] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-30T21:19:14.557024] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T21:19:14.654362] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-30T21:19:15.173431] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-30T21:19:15.454407] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-30T21:19:15.974464] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T21:19:16.254383] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-30T21:19:16.771396] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-30T21:19:17.054400] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-30T21:19:17.391576] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T21:19:17.854356] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-30T21:19:18.516004] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T21:19:18.654361] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-30T21:19:19.131565] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T21:19:19.454367] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-30T21:19:19.882295] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-30T21:19:20.254431] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-30T21:19:20.664796] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T21:19:21.054397] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-30T21:19:21.661623] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T21:19:21.854356] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-30T21:19:22.343403] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T21:19:22.654359] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-30T21:19:23.153533] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T21:19:23.454356] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-30T21:19:23.821573] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-30T21:19:24.254395] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-30T21:19:24.669572] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T21:19:25.054358] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-30T21:19:25.574484] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T21:19:25.854362] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-30T21:19:26.336981] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T21:19:26.654359] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-30T21:19:27.083319] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T21:19:27.454382] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-30T21:19:27.775339] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-30T21:19:28.254395] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-30T21:19:28.730285] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T21:19:28.731170] [INFO ] [REMOTE ] STXM: Full fetch complete (1424 records). [2025-09-30T21:19:28.731240] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-30T21:19:28.945915] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T21:19:28.946150] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:19:28.946236] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:19:28.946364] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-30T21:19:28.946459] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-30T21:19:28.946514] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-30T21:19:28.946632] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-30T21:19:28.946772] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXM took 24.9s. Estimated remaining: 44m 47s. Rate: 7.8 symbols/min [2025-09-30T21:19:29.061718] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-30T21:19:29.150272] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:29.156487] [DEBUG] [LOCAL ] STXV: Loaded 1590 existing records from primary storage. [2025-09-30T21:19:29.156734] [INFO ] [MAIN ] STXV: Loaded 1590 existing records. [2025-09-30T21:19:29.363709] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:29.363953] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-30T21:19:29.364027] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-30T21:19:29.364252] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-30T21:19:29.364310] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-30T21:19:29.644467] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:19:29.670519] [INFO ] [REMOTE ] STXK: Full fetch complete (2413 records). [2025-09-30T21:19:29.682893] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-30T21:19:29.889634] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:29.865879] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-30T21:19:30.172712] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-30T21:19:30.172801] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-30T21:19:30.172918] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-30T21:19:30.172978] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-30T21:19:30.173361] [DEBUG] [LOCAL ] STXK: Trimmed 2413 records to 1495 (keeping 200 days of data) [2025-09-30T21:19:30.183208] [DEBUG] [LOCAL ] STXK: Primary data saved (1495 records). [2025-09-30T21:19:30.183282] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-30T21:19:30.183371] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXK took 28.6s. Estimated remaining: 44m 38s. Rate: 7.8 symbols/min [2025-09-30T21:19:30.368203] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:30.440910] [DEBUG] [LOCAL ] STZ: Loaded 52277 existing records from primary storage. [2025-09-30T21:19:30.441265] [INFO ] [MAIN ] STZ: Loaded 52277 existing records. [2025-09-30T21:19:30.532795] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T21:19:30.655057] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-30T21:19:30.690250] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:30.691471] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-30T21:19:30.691556] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-30T21:19:30.692713] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-30T21:19:30.692782] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-30T21:19:31.101269] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:31.226041] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T21:19:31.454376] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-30T21:19:31.994447] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T21:19:32.254351] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-30T21:19:32.802804] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T21:19:33.054357] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-30T21:19:33.671348] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T21:19:33.854357] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-30T21:19:34.381540] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T21:19:34.654364] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-30T21:19:35.214920] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T21:19:35.454358] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-30T21:19:35.978271] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-30T21:19:36.254371] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-30T21:19:36.836785] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:19:36.837884] [INFO ] [REMOTE ] STXG: Full fetch complete (4177 records). [2025-09-30T21:19:36.837986] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-30T21:19:37.060077] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-30T21:19:37.269276] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-30T21:19:37.269378] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-30T21:19:37.269553] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-30T21:19:37.269606] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-30T21:19:37.270173] [DEBUG] [LOCAL ] STXG: Trimmed 4177 records to 2521 (keeping 200 days of data) [2025-09-30T21:19:37.292786] [DEBUG] [LOCAL ] STXG: Primary data saved (2521 records). [2025-09-30T21:19:37.292983] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-30T21:19:37.293090] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXG took 37.0s. Estimated remaining: 44m 30s. Rate: 7.8 symbols/min [2025-09-30T21:19:37.478053] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:37.548631] [DEBUG] [LOCAL ] SU: Loaded 53451 existing records from primary storage. [2025-09-30T21:19:37.549052] [INFO ] [MAIN ] SU: Loaded 53451 existing records. [2025-09-30T21:19:37.738789] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:37.739046] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-30T21:19:37.739097] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-30T21:19:37.739800] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-30T21:19:37.739864] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-30T21:19:37.842411] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T21:19:37.855363] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-30T21:19:38.153676] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:38.439930] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T21:19:38.654363] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-30T21:19:39.454405] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-30T21:19:39.535987] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T21:19:39.951549] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T21:19:40.254351] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-30T21:19:41.054423] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-30T21:19:41.442518] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-30T21:19:41.443614] [INFO ] [REMOTE ] STXT: Full fetch complete (3986 records). [2025-09-30T21:19:41.443709] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-30T21:19:41.849182] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-30T21:19:41.849268] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-30T21:19:41.849440] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-30T21:19:41.849504] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-30T21:19:41.849951] [DEBUG] [LOCAL ] STXT: Trimmed 3986 records to 2534 (keeping 200 days of data) [2025-09-30T21:19:41.863353] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-30T21:19:41.869617] [DEBUG] [LOCAL ] STXT: Primary data saved (2534 records). [2025-09-30T21:19:41.869795] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-30T21:19:41.869889] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXT took 32.5s. Estimated remaining: 44m 22s. Rate: 7.8 symbols/min [2025-09-30T21:19:42.064718] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:42.145109] [DEBUG] [LOCAL ] SUI: Loaded 41785 existing records from primary storage. [2025-09-30T21:19:42.146429] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T21:19:42.146921] [INFO ] [MAIN ] SUI: Loaded 41785 existing records. [2025-09-30T21:19:42.353581] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:42.353828] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-30T21:19:42.353877] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-30T21:19:42.354262] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-30T21:19:42.354322] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-30T21:19:42.654424] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-30T21:19:42.741107] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:42.940557] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T21:19:43.278508] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T21:19:43.454369] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-30T21:19:44.254364] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-30T21:19:44.675157] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T21:19:45.054363] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-30T21:19:45.173396] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:19:45.854386] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-30T21:19:46.461096] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T21:19:46.654410] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-30T21:19:46.939148] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:19:47.166611] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T21:19:47.454384] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-30T21:19:48.254352] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-30T21:19:48.883263] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T21:19:49.054375] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-30T21:19:49.846468] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:19:49.855082] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-30T21:19:50.654329] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-30T21:19:50.804441] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T21:19:50.968778] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T21:19:51.454380] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-30T21:19:51.940290] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T21:19:52.254341] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-30T21:19:52.345262] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T21:19:53.054399] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-30T21:19:53.448492] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-30T21:19:53.449524] [INFO ] [REMOTE ] STXV: Full fetch complete (2619 records). [2025-09-30T21:19:53.449597] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-30T21:19:53.831577] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-30T21:19:53.831707] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-30T21:19:53.831832] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-30T21:19:53.831873] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-30T21:19:53.832241] [DEBUG] [LOCAL ] STXV: Trimmed 2619 records to 1586 (keeping 200 days of data) [2025-09-30T21:19:53.843400] [DEBUG] [LOCAL ] STXV: Primary data saved (1586 records). [2025-09-30T21:19:53.843475] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-30T21:19:53.843553] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STXV took 24.9s. Estimated remaining: 44m 15s. Rate: 7.8 symbols/min [2025-09-30T21:19:53.859474] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-30T21:19:54.032140] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:19:54.072740] [DEBUG] [LOCAL ] SUN: Loaded 37437 existing records from primary storage. [2025-09-30T21:19:54.073103] [INFO ] [MAIN ] SUN: Loaded 37437 existing records. [2025-09-30T21:19:54.283729] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:19:54.284061] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-30T21:19:54.284175] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-30T21:19:54.295483] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-30T21:19:54.312487] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-30T21:19:54.386875] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T21:19:54.659329] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-30T21:19:54.733097] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:19:54.765845] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T21:19:55.454394] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-30T21:19:56.254355] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-30T21:19:56.588863] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T21:19:56.681967] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:19:57.054336] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-30T21:19:57.196728] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T21:19:57.854370] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-30T21:19:58.654357] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-30T21:19:58.699608] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:19:58.738618] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T21:19:59.454375] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-30T21:20:00.231275] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T21:20:00.254310] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-30T21:20:01.059293] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-30T21:20:01.063529] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T21:20:01.773265] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T21:20:01.854356] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-30T21:20:01.976556] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T21:20:02.654414] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-30T21:20:03.420620] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T21:20:03.454310] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-30T21:20:04.254341] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-30T21:20:04.786132] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T21:20:05.062475] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-30T21:20:05.083777] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:20:05.298127] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T21:20:05.854391] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-30T21:20:06.654321] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-30T21:20:06.738220] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T21:20:06.749856] [INFO ] [REMOTE ] STZ: Full fetch complete (75438 records). [2025-09-30T21:20:06.750027] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-30T21:20:06.750843] [FATAL] [VALIDATOR ] STZ: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T21:20:06.750935] [FATAL] [MAIN ] STZ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:20:06.750980] [WARN ] [MAIN ] STZ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:20:06.751025] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-30T21:20:06.751084] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-09-30T21:20:06.751121] [INFO ] [LOCAL ] STZ: Starting deletion of derivative data. [2025-09-30T21:20:06.751582] [DEBUG] [LOCAL ] STZ: Deleted derivative data file. [2025-09-30T21:20:06.751714] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. STZ took 36.6s. Estimated remaining: 44m 8s. Rate: 7.8 symbols/min [2025-09-30T21:20:06.943487] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:06.992996] [DEBUG] [LOCAL ] SUPV: Loaded 47228 existing records from primary storage. [2025-09-30T21:20:06.993524] [INFO ] [MAIN ] SUPV: Loaded 47228 existing records. [2025-09-30T21:20:07.192124] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T21:20:07.243949] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:07.244217] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-30T21:20:07.244339] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-30T21:20:07.246106] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-30T21:20:07.246173] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-30T21:20:07.464040] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-30T21:20:07.661185] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:08.254375] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-30T21:20:08.420470] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:20:09.054381] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-30T21:20:09.146178] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T21:20:09.660567] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T21:20:09.854376] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-30T21:20:10.654330] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-30T21:20:11.163881] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T21:20:11.175609] [INFO ] [REMOTE ] SU: Full fetch complete (77399 records). [2025-09-30T21:20:11.175846] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-30T21:20:11.459952] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-30T21:20:11.594580] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-30T21:20:11.594688] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-30T21:20:11.595791] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-30T21:20:11.595856] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-30T21:20:11.597348] [DEBUG] [LOCAL ] SU: Trimmed 77399 records to 53451 (keeping 200 days of data) [2025-09-30T21:20:11.960681] [DEBUG] [LOCAL ] SU: Primary data saved (53451 records). [2025-09-30T21:20:11.960846] [INFO ] [MAIN ] SU: Full history saved. [2025-09-30T21:20:11.960951] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SU took 34.7s. Estimated remaining: 43m 60s. Rate: 7.8 symbols/min [2025-09-30T21:20:12.161182] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:12.196807] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-30T21:20:12.251890] [DEBUG] [LOCAL ] SUZ: Loaded 45751 existing records from primary storage. [2025-09-30T21:20:12.252263] [INFO ] [MAIN ] SUZ: Loaded 45751 existing records. [2025-09-30T21:20:12.267071] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-30T21:20:12.500973] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:12.501263] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-30T21:20:12.501320] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-30T21:20:12.502258] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-30T21:20:12.502323] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-30T21:20:12.943201] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T21:20:13.059694] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-30T21:20:13.134979] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:13.165446] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-30T21:20:13.854353] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-30T21:20:13.941189] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T21:20:14.654375] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-30T21:20:14.726448] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:20:15.453930] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T21:20:15.462444] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-30T21:20:15.969169] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:20:16.254359] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-30T21:20:17.054376] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-30T21:20:17.192760] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T21:20:17.854352] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-30T21:20:17.940153] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:20:18.654385] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-30T21:20:18.950675] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T21:20:19.454330] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-30T21:20:19.657942] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T21:20:20.227349] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T21:20:20.236416] [INFO ] [REMOTE ] SUN: Full fetch complete (54811 records). [2025-09-30T21:20:20.236597] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-30T21:20:20.264788] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-30T21:20:20.658469] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-30T21:20:20.658567] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-30T21:20:20.659598] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-30T21:20:20.659688] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-30T21:20:20.661085] [DEBUG] [LOCAL ] SUN: Trimmed 54811 records to 37478 (keeping 200 days of data) [2025-09-30T21:20:20.898980] [DEBUG] [LOCAL ] SUN: Primary data saved (37478 records). [2025-09-30T21:20:20.899132] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-30T21:20:20.899217] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 27.1s. Estimated remaining: 43m 52s. Rate: 7.8 symbols/min [2025-09-30T21:20:21.060131] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-30T21:20:21.095012] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:21.135060] [DEBUG] [LOCAL ] SVV: Loaded 39617 existing records from primary storage. [2025-09-30T21:20:21.135374] [INFO ] [MAIN ] SVV: Loaded 39617 existing records. [2025-09-30T21:20:21.359835] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T21:20:21.358333] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:21.368885] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-30T21:20:21.369239] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-30T21:20:21.370088] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-30T21:20:21.370190] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-30T21:20:21.759983] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:21.790834] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T21:20:21.854351] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-30T21:20:22.658103] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-30T21:20:22.664301] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T21:20:23.323253] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T21:20:23.332417] [INFO ] [REMOTE ] SUI: Full fetch complete (60925 records). [2025-09-30T21:20:23.332545] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-30T21:20:23.459529] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-30T21:20:23.779514] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-30T21:20:23.779745] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-30T21:20:23.780793] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-30T21:20:23.780931] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-30T21:20:23.782520] [DEBUG] [LOCAL ] SUI: Trimmed 60925 records to 41735 (keeping 200 days of data) [2025-09-30T21:20:23.912752] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T21:20:24.093969] [DEBUG] [LOCAL ] SUI: Primary data saved (41735 records). [2025-09-30T21:20:24.094105] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-30T21:20:24.094186] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUI took 42.2s. Estimated remaining: 43m 44s. Rate: 7.8 symbols/min [2025-09-30T21:20:24.258680] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-30T21:20:24.285738] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:24.341277] [DEBUG] [LOCAL ] SW: Loaded 53160 existing records from primary storage. [2025-09-30T21:20:24.341708] [INFO ] [MAIN ] SW: Loaded 53160 existing records. [2025-09-30T21:20:24.533984] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:24.534204] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-30T21:20:24.534252] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-30T21:20:24.535308] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-30T21:20:24.535371] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-30T21:20:24.955941] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:24.988142] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T21:20:25.054386] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-30T21:20:25.700404] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T21:20:25.854385] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-30T21:20:26.572774] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T21:20:26.654398] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-30T21:20:26.768132] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T21:20:27.454369] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-30T21:20:28.022117] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T21:20:28.254362] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-30T21:20:29.054363] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-30T21:20:29.311528] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T21:20:29.342006] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:20:29.854362] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-30T21:20:29.928665] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T21:20:30.654361] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-30T21:20:31.427821] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T21:20:31.454361] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-30T21:20:32.256309] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-30T21:20:32.261857] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T21:20:32.806276] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T21:20:33.054422] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-30T21:20:33.854392] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-30T21:20:34.148463] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T21:20:34.423320] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T21:20:34.654365] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-30T21:20:35.454379] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-30T21:20:35.510424] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:20:35.647170] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T21:20:35.659069] [INFO ] [REMOTE ] SUPV: Full fetch complete (68302 records). [2025-09-30T21:20:35.659353] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-30T21:20:36.188968] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-30T21:20:36.189088] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-30T21:20:36.190496] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-30T21:20:36.190574] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-30T21:20:36.192271] [DEBUG] [LOCAL ] SUPV: Trimmed 68302 records to 47280 (keeping 200 days of data) [2025-09-30T21:20:36.261304] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-30T21:20:36.515490] [DEBUG] [LOCAL ] SUPV: Primary data saved (47280 records). [2025-09-30T21:20:36.515681] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-30T21:20:36.515825] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUPV took 29.8s. Estimated remaining: 43m 37s. Rate: 7.8 symbols/min [2025-09-30T21:20:36.711476] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:36.770546] [DEBUG] [LOCAL ] SWK: Loaded 52392 existing records from primary storage. [2025-09-30T21:20:36.771277] [INFO ] [MAIN ] SWK: Loaded 52392 existing records. [2025-09-30T21:20:36.974084] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:36.975717] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-30T21:20:36.975840] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-30T21:20:36.977490] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-30T21:20:36.977572] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-30T21:20:37.059578] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-30T21:20:37.212199] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T21:20:37.439019] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:37.473047] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T21:20:37.854381] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-30T21:20:38.654385] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-30T21:20:38.699863] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:20:38.971600] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T21:20:39.454354] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-30T21:20:39.684875] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T21:20:40.254357] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-30T21:20:40.952248] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T21:20:41.054390] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-30T21:20:41.542434] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T21:20:41.854393] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-30T21:20:42.654435] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-30T21:20:42.919995] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-30T21:20:43.070049] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T21:20:43.454411] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-30T21:20:44.259494] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-30T21:20:44.279290] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T21:20:44.993855] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T21:20:45.003170] [INFO ] [REMOTE ] SUZ: Full fetch complete (66844 records). [2025-09-30T21:20:45.003395] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-30T21:20:45.059454] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-30T21:20:45.452077] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-30T21:20:45.452178] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-30T21:20:45.453263] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-30T21:20:45.453329] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-30T21:20:45.454811] [DEBUG] [LOCAL ] SUZ: Trimmed 66844 records to 45715 (keeping 200 days of data) [2025-09-30T21:20:45.761312] [DEBUG] [LOCAL ] SUZ: Primary data saved (45715 records). [2025-09-30T21:20:45.761463] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-30T21:20:45.761614] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUZ took 33.8s. Estimated remaining: 43m 30s. Rate: 7.8 symbols/min [2025-09-30T21:20:45.855064] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-30T21:20:45.962186] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:20:46.006190] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:46.038277] [DEBUG] [LOCAL ] SWX: Loaded 31090 existing records from primary storage. [2025-09-30T21:20:46.038574] [INFO ] [MAIN ] SWX: Loaded 31090 existing records. [2025-09-30T21:20:46.244348] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:46.244583] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-30T21:20:46.244674] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-30T21:20:46.245395] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-30T21:20:46.245496] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-30T21:20:46.657381] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-30T21:20:46.657263] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:46.826285] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T21:20:47.454390] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-30T21:20:48.049311] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-30T21:20:48.200785] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T21:20:48.215338] [INFO ] [REMOTE ] SVV: Full fetch complete (56214 records). [2025-09-30T21:20:48.215528] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-30T21:20:48.259481] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-30T21:20:48.652509] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-30T21:20:48.652620] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-30T21:20:48.653620] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-30T21:20:48.653735] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-30T21:20:48.655545] [DEBUG] [LOCAL ] SVV: Trimmed 56214 records to 39703 (keeping 200 days of data) [2025-09-30T21:20:48.772331] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T21:20:48.941849] [DEBUG] [LOCAL ] SVV: Primary data saved (39703 records). [2025-09-30T21:20:48.942036] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-30T21:20:48.942368] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SVV took 28.0s. Estimated remaining: 43m 21s. Rate: 7.8 symbols/min [2025-09-30T21:20:49.059554] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-30T21:20:49.141817] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:20:49.154866] [DEBUG] [LOCAL ] SWZ: Loaded 6005 existing records from primary storage. [2025-09-30T21:20:49.155192] [INFO ] [MAIN ] SWZ: Loaded 6005 existing records. [2025-09-30T21:20:49.405782] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:20:49.406020] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-30T21:20:49.406078] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-30T21:20:49.406343] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-30T21:20:49.406405] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-30T21:20:49.836097] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:20:49.854342] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-30T21:20:50.006854] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T21:20:50.252987] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-30T21:20:50.365705] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T21:20:50.654361] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-30T21:20:51.454360] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-30T21:20:52.056442] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T21:20:52.254327] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-30T21:20:52.444976] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T21:20:52.832675] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T21:20:53.054400] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-30T21:20:53.854335] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-30T21:20:54.241452] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T21:20:54.654414] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-30T21:20:55.454393] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-30T21:20:55.780625] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T21:20:55.827731] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T21:20:55.958912] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T21:20:56.254390] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-30T21:20:57.054348] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-30T21:20:57.342373] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T21:20:57.854383] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-30T21:20:58.459370] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T21:20:58.654365] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-30T21:20:59.024356] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T21:20:59.064862] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T21:20:59.454385] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-30T21:21:00.086412] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T21:21:00.254393] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-30T21:21:01.054637] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-30T21:21:01.854340] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-30T21:21:02.254137] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T21:21:02.654345] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-30T21:21:02.847291] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T21:21:03.236949] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T21:21:03.454394] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-30T21:21:04.242034] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T21:21:04.254356] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-30T21:21:04.479761] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T21:21:04.859769] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-30T21:21:04.861393] [INFO ] [REMOTE ] SWZ: Full fetch complete (8094 records). [2025-09-30T21:21:04.861472] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-30T21:21:05.063746] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-30T21:21:05.299582] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-30T21:21:05.299688] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-30T21:21:05.299964] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-30T21:21:05.300008] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-30T21:21:05.300448] [DEBUG] [LOCAL ] SWZ: Trimmed 8094 records to 6014 (keeping 200 days of data) [2025-09-30T21:21:05.338430] [DEBUG] [LOCAL ] SWZ: Primary data saved (6014 records). [2025-09-30T21:21:05.338584] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-30T21:21:05.338694] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWZ took 16.4s. Estimated remaining: 43m 15s. Rate: 7.8 symbols/min [2025-09-30T21:21:05.544284] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:05.588207] [DEBUG] [LOCAL ] SXC: Loaded 41438 existing records from primary storage. [2025-09-30T21:21:05.588532] [INFO ] [MAIN ] SXC: Loaded 41438 existing records. [2025-09-30T21:21:05.782070] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:05.782347] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-30T21:21:05.782406] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-30T21:21:05.783690] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-30T21:21:05.783764] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-30T21:21:05.859511] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-30T21:21:06.192187] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:06.654361] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-30T21:21:07.172563] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T21:21:07.454410] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-30T21:21:07.813472] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T21:21:07.829748] [INFO ] [REMOTE ] SW: Full fetch complete (76766 records). [2025-09-30T21:21:07.829921] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-30T21:21:07.982066] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T21:21:08.259477] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-30T21:21:08.330472] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-30T21:21:08.330560] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-30T21:21:08.331918] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-30T21:21:08.331997] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-30T21:21:08.333868] [DEBUG] [LOCAL ] SW: Trimmed 76766 records to 53156 (keeping 200 days of data) [2025-09-30T21:21:08.604371] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T21:21:08.736316] [DEBUG] [LOCAL ] SW: Primary data saved (53156 records). [2025-09-30T21:21:08.736475] [INFO ] [MAIN ] SW: Full history saved. [2025-09-30T21:21:08.736578] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SW took 44.6s. Estimated remaining: 43m 6s. Rate: 7.8 symbols/min [2025-09-30T21:21:08.923390] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:08.936633] [DEBUG] [LOCAL ] SXI: Loaded 11510 existing records from primary storage. [2025-09-30T21:21:08.936951] [INFO ] [MAIN ] SXI: Loaded 11510 existing records. [2025-09-30T21:21:09.059436] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-30T21:21:09.138997] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:09.140138] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-30T21:21:09.140199] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-30T21:21:09.141102] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-30T21:21:09.141164] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-30T21:21:09.531664] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:09.854341] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-30T21:21:10.066936] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:21:10.348325] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T21:21:10.405906] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T21:21:10.654417] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-30T21:21:11.454371] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-30T21:21:11.471706] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T21:21:12.254413] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-30T21:21:12.858553] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T21:21:13.054351] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-30T21:21:13.854396] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-30T21:21:14.183719] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T21:21:14.202555] [INFO ] [REMOTE ] SWK: Full fetch complete (75340 records). [2025-09-30T21:21:14.202805] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-30T21:21:14.593785] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T21:21:14.655849] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-30T21:21:14.745508] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:21:14.959998] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-30T21:21:14.960111] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-30T21:21:14.961332] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-30T21:21:14.961422] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-30T21:21:14.964080] [DEBUG] [LOCAL ] SWK: Trimmed 75340 records to 52386 (keeping 200 days of data) [2025-09-30T21:21:15.314349] [DEBUG] [LOCAL ] SWK: Primary data saved (52386 records). [2025-09-30T21:21:15.314510] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-30T21:21:15.314635] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWK took 38.8s. Estimated remaining: 42m 59s. Rate: 7.8 symbols/min [2025-09-30T21:21:15.460197] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-30T21:21:15.546587] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:15.586802] [DEBUG] [LOCAL ] SXT: Loaded 29225 existing records from primary storage. [2025-09-30T21:21:15.587166] [INFO ] [MAIN ] SXT: Loaded 29225 existing records. [2025-09-30T21:21:15.810444] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:15.810730] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-30T21:21:15.810786] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-30T21:21:15.811481] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-30T21:21:15.811544] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-30T21:21:16.202046] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:16.221558] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T21:21:16.254310] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-30T21:21:16.529032] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T21:21:17.054363] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-30T21:21:17.633361] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T21:21:17.640294] [INFO ] [REMOTE ] SWX: Full fetch complete (43901 records). [2025-09-30T21:21:17.640414] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-30T21:21:17.862949] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-30T21:21:18.057431] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-30T21:21:18.057711] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-30T21:21:18.058799] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-30T21:21:18.058900] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-30T21:21:18.062372] [DEBUG] [LOCAL ] SWX: Trimmed 43901 records to 31066 (keeping 200 days of data) [2025-09-30T21:21:18.177916] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T21:21:18.284138] [DEBUG] [LOCAL ] SWX: Primary data saved (31066 records). [2025-09-30T21:21:18.284289] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-30T21:21:18.284376] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SWX took 32.5s. Estimated remaining: 42m 50s. Rate: 7.8 symbols/min [2025-09-30T21:21:18.653392] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T21:21:18.656316] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-30T21:21:19.454413] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-30T21:21:19.693226] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T21:21:20.254355] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-30T21:21:21.054361] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-30T21:21:21.415691] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T21:21:21.568730] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T21:21:21.675698] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T21:21:21.854367] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-30T21:21:22.654349] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-30T21:21:23.390453] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:21:23.454424] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-30T21:21:23.775553] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T21:21:24.254415] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-30T21:21:25.054389] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-30T21:21:25.129142] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T21:21:25.464677] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T21:21:25.854329] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-30T21:21:26.002498] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:21:26.654385] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-30T21:21:27.101780] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T21:21:27.454382] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-30T21:21:28.135825] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T21:21:28.228317] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T21:21:28.254350] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-30T21:21:29.054357] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-30T21:21:29.240322] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T21:21:29.854367] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-30T21:21:30.371457] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T21:21:30.654422] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-30T21:21:30.665547] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T21:21:30.668592] [INFO ] [REMOTE ] SXI: Full fetch complete (14769 records). [2025-09-30T21:21:30.668699] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-30T21:21:31.063055] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-30T21:21:31.063135] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-30T21:21:31.063500] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-30T21:21:31.063541] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-30T21:21:31.064089] [DEBUG] [LOCAL ] SXI: Trimmed 14769 records to 11488 (keeping 200 days of data) [2025-09-30T21:21:31.144260] [DEBUG] [LOCAL ] SXI: Primary data saved (11488 records). [2025-09-30T21:21:31.144417] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-30T21:21:31.144503] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXI took 22.4s. Estimated remaining: 42m 43s. Rate: 7.8 symbols/min [2025-09-30T21:21:31.454385] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-30T21:21:32.122354] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T21:21:32.254537] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-30T21:21:32.992188] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T21:21:33.054346] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-30T21:21:33.549540] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T21:21:33.854405] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-30T21:21:34.560576] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T21:21:34.654364] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-30T21:21:35.211613] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T21:21:35.219743] [INFO ] [REMOTE ] SXT: Full fetch complete (38232 records). [2025-09-30T21:21:35.219863] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-30T21:21:35.654718] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-30T21:21:35.654815] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-30T21:21:35.655702] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-30T21:21:35.655767] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-30T21:21:35.656753] [DEBUG] [LOCAL ] SXT: Trimmed 38232 records to 29307 (keeping 200 days of data) [2025-09-30T21:21:35.855895] [DEBUG] [LOCAL ] SXT: Primary data saved (29307 records). [2025-09-30T21:21:35.856108] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-30T21:21:35.856245] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 20.5s. Estimated remaining: 42m 35s. Rate: 7.8 symbols/min [2025-09-30T21:21:36.275744] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T21:21:36.285582] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-30T21:21:37.795031] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:21:37.807754] [INFO ] [REMOTE ] SXC: Full fetch complete (61182 records). [2025-09-30T21:21:37.807928] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-30T21:21:38.238552] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-30T21:21:38.238637] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-30T21:21:38.239740] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-30T21:21:38.239807] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-30T21:21:38.241249] [DEBUG] [LOCAL ] SXC: Trimmed 61182 records to 41407 (keeping 200 days of data) [2025-09-30T21:21:38.496025] [DEBUG] [LOCAL ] SXC: Primary data saved (41407 records). [2025-09-30T21:21:38.496164] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-30T21:21:38.496249] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SXC took 33.2s. Estimated remaining: 42m 27s. Rate: 7.8 symbols/min [2025-09-30T21:21:39.286278] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:39.289876] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:39.307285] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:39.306180] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:21:39.455433] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-09-30T21:21:39.457532] [DEBUG] [LOCAL ] SYY: Loaded 53228 existing records from primary storage. [2025-09-30T21:21:39.456142] [INFO ] [MAIN ] SYF: Loaded 53442 existing records. [2025-09-30T21:21:39.458403] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-30T21:21:39.470800] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-30T21:21:39.476277] [INFO ] [MAIN ] SYY: Loaded 53228 existing records. [2025-09-30T21:21:39.576961] [DEBUG] [LOCAL ] SYK: Loaded 46905 existing records from primary storage. [2025-09-30T21:21:39.690767] [INFO ] [MAIN ] SYK: Loaded 46905 existing records. [2025-09-30T21:21:39.953473] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:39.984979] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-30T21:21:40.025213] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-30T21:21:40.153398] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:40.189822] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-30T21:21:40.197408] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:40.170019] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-30T21:21:40.197767] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-30T21:21:40.197521] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-30T21:21:40.208789] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-30T21:21:40.214029] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-30T21:21:40.219285] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-30T21:21:40.261701] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-30T21:21:40.261108] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-30T21:21:40.305966] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:21:40.316808] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-30T21:21:40.376833] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-30T21:21:40.476254] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-30T21:21:40.558153] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-30T21:21:40.627781] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-30T21:21:41.727512] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:41.754919] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-30T21:21:41.795991] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:41.849783] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:41.846637] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-30T21:21:41.855695] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-30T21:21:41.940529] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:21:41.940910] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-30T21:21:43.684588] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T21:21:43.695714] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-30T21:21:43.730196] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:21:43.742596] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-30T21:21:43.780732] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T21:21:43.790793] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-30T21:21:43.999466] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T21:21:44.010755] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-30T21:21:45.555379] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T21:21:45.599556] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-30T21:21:45.604023] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T21:21:45.617879] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-30T21:21:45.707586] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T21:21:45.718524] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-30T21:21:47.327423] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T21:21:47.339624] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-30T21:21:47.405188] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T21:21:47.417927] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-30T21:21:47.453053] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:21:47.465241] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-30T21:21:47.504213] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (3.49 seconds). [2025-09-30T21:21:47.515672] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-30T21:21:48.986809] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:21:48.999595] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-30T21:21:49.038874] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T21:21:49.054314] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-30T21:21:49.309073] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:21:49.806270] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-30T21:21:49.854330] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-30T21:21:50.654328] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-30T21:21:50.733707] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T21:21:51.014781] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T21:21:51.454365] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-30T21:21:52.254330] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-30T21:21:52.299179] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-30T21:21:52.345083] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T21:21:53.054334] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-30T21:21:53.232434] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:21:53.854366] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-30T21:21:54.007104] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T21:21:54.654369] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-30T21:21:55.417424] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T21:21:55.454325] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-30T21:21:55.562803] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-30T21:21:55.965820] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T21:21:56.254345] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-30T21:21:57.054332] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-30T21:21:57.471202] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T21:21:57.854365] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-30T21:21:58.654335] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-30T21:21:58.752390] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-30T21:21:59.048704] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T21:21:59.373416] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T21:21:59.454353] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-30T21:22:00.254348] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-30T21:22:00.567046] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T21:22:01.054422] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-30T21:22:01.534795] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T21:22:01.854417] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-30T21:22:02.654369] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-30T21:22:02.745235] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-30T21:22:03.149731] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T21:22:03.164704] [INFO ] [REMOTE ] SYF: Full fetch complete (77327 records). [2025-09-30T21:22:03.164942] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-30T21:22:03.454569] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-30T21:22:03.609986] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T21:22:03.701534] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-30T21:22:03.701638] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-30T21:22:03.702904] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-30T21:22:03.702974] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-30T21:22:03.705103] [DEBUG] [LOCAL ] SYF: Trimmed 77327 records to 53442 (keeping 200 days of data) [2025-09-30T21:22:04.084270] [DEBUG] [LOCAL ] SYF: Primary data saved (53442 records). [2025-09-30T21:22:04.084433] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-30T21:22:04.084529] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYF took 25.6s. Estimated remaining: 42m 22s. Rate: 7.8 symbols/min [2025-09-30T21:22:04.277269] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:04.277599] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-30T21:22:04.327754] [DEBUG] [LOCAL ] TAC: Loaded 42590 existing records from primary storage. [2025-09-30T21:22:04.328173] [INFO ] [MAIN ] TAC: Loaded 42590 existing records. [2025-09-30T21:22:04.576670] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:04.577123] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-30T21:22:04.577195] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-30T21:22:04.577782] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-30T21:22:04.577928] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-30T21:22:04.797386] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-30T21:22:05.054088] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:05.054413] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-30T21:22:05.854396] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-30T21:22:06.067448] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-30T21:22:06.173300] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T21:22:06.183970] [INFO ] [REMOTE ] SYK: Full fetch complete (68785 records). [2025-09-30T21:22:06.184353] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-30T21:22:06.630933] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-30T21:22:06.631024] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-30T21:22:06.632582] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-30T21:22:06.632673] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-30T21:22:06.634567] [DEBUG] [LOCAL ] SYK: Trimmed 68785 records to 46866 (keeping 200 days of data) [2025-09-30T21:22:06.710220] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-30T21:22:06.934994] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:22:07.020761] [DEBUG] [LOCAL ] SYK: Primary data saved (46866 records). [2025-09-30T21:22:07.020916] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-30T21:22:07.021005] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYK took 28.5s. Estimated remaining: 42m 13s. Rate: 7.8 symbols/min [2025-09-30T21:22:07.210024] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:07.269956] [DEBUG] [LOCAL ] TAK: Loaded 49800 existing records from primary storage. [2025-09-30T21:22:07.270395] [INFO ] [MAIN ] TAK: Loaded 49800 existing records. [2025-09-30T21:22:07.471130] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:07.464897] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-30T21:22:07.471561] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-30T21:22:07.472552] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-30T21:22:07.473046] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-30T21:22:07.473106] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-30T21:22:07.883623] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T21:22:07.928890] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:08.254410] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-30T21:22:09.054374] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-30T21:22:09.243615] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-30T21:22:09.598672] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-30T21:22:09.854380] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-30T21:22:10.005764] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T21:22:10.017814] [INFO ] [REMOTE ] SYY: Full fetch complete (76964 records). [2025-09-30T21:22:10.018004] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-30T21:22:10.492163] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-30T21:22:10.492313] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-30T21:22:10.493814] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-30T21:22:10.494034] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-30T21:22:10.496466] [DEBUG] [LOCAL ] SYY: Trimmed 76964 records to 53220 (keeping 200 days of data) [2025-09-30T21:22:10.631937] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T21:22:10.654454] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-30T21:22:10.899620] [DEBUG] [LOCAL ] SYY: Primary data saved (53220 records). [2025-09-30T21:22:10.900405] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-30T21:22:10.900703] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYY took 32.4s. Estimated remaining: 42m 5s. Rate: 7.8 symbols/min [2025-09-30T21:22:11.093204] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:11.159793] [DEBUG] [LOCAL ] TAL: Loaded 51990 existing records from primary storage. [2025-09-30T21:22:11.160461] [INFO ] [MAIN ] TAL: Loaded 51990 existing records. [2025-09-30T21:22:11.375687] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:11.375938] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-30T21:22:11.376014] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-30T21:22:11.376597] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-30T21:22:11.376697] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-30T21:22:11.462688] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-30T21:22:11.831313] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:12.039398] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T21:22:12.053027] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-30T21:22:12.053194] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-30T21:22:12.256884] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-30T21:22:12.528303] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-30T21:22:12.541567] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-30T21:22:12.543102] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-30T21:22:12.543265] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-30T21:22:12.546136] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T21:22:12.557618] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-09-30T21:22:12.946006] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-30T21:22:12.946328] [INFO ] [MAIN ] T: Full history saved. [2025-09-30T21:22:12.946527] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 34.4s. Estimated remaining: 41m 56s. Rate: 7.8 symbols/min [2025-09-30T21:22:13.056348] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-30T21:22:13.139825] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:13.171338] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T21:22:13.235194] [DEBUG] [LOCAL ] TALO: Loaded 50798 existing records from primary storage. [2025-09-30T21:22:13.235618] [INFO ] [MAIN ] TALO: Loaded 50798 existing records. [2025-09-30T21:22:13.437762] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:13.438118] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-30T21:22:13.438195] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-30T21:22:13.438805] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-30T21:22:13.438874] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-30T21:22:13.830252] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:13.854317] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-30T21:22:14.296578] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T21:22:14.665635] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-30T21:22:14.695293] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:22:15.454373] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-30T21:22:15.639103] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T21:22:16.254443] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-30T21:22:16.656153] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T21:22:17.040767] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T21:22:17.054331] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-30T21:22:17.854343] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-30T21:22:18.002718] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T21:22:18.654426] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-30T21:22:18.976682] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T21:22:19.460124] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-30T21:22:19.465116] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T21:22:20.260132] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-30T21:22:20.283401] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T21:22:21.054386] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-30T21:22:21.347561] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T21:22:21.778282] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T21:22:21.854386] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-30T21:22:22.654362] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-30T21:22:22.814601] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T21:22:22.962786] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T21:22:23.454373] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-30T21:22:24.254409] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-30T21:22:24.619876] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T21:22:25.054373] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-30T21:22:25.362007] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T21:22:25.854373] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-30T21:22:25.941745] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T21:22:26.654389] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-30T21:22:26.902821] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T21:22:27.461427] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-30T21:22:27.468689] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T21:22:28.254416] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-30T21:22:28.332553] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T21:22:29.054415] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-30T21:22:29.625994] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T21:22:29.854360] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-30T21:22:29.969892] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T21:22:30.654337] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-30T21:22:30.841191] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T21:22:31.331998] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:22:31.454407] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-30T21:22:32.254408] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-30T21:22:32.478037] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T21:22:33.054399] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-30T21:22:33.235960] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T21:22:33.546046] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T21:22:33.560104] [INFO ] [REMOTE ] TAC: Full fetch complete (63910 records). [2025-09-30T21:22:33.560391] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-30T21:22:33.859530] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-30T21:22:34.015479] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-30T21:22:34.015597] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-30T21:22:34.016926] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-30T21:22:34.017026] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-30T21:22:34.018607] [DEBUG] [LOCAL ] TAC: Trimmed 63910 records to 42538 (keeping 200 days of data) [2025-09-30T21:22:34.314319] [DEBUG] [LOCAL ] TAC: Primary data saved (42538 records). [2025-09-30T21:22:34.314485] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-30T21:22:34.314710] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 30.2s. Estimated remaining: 41m 51s. Rate: 7.8 symbols/min [2025-09-30T21:22:34.514920] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:34.591684] [DEBUG] [LOCAL ] TAP: Loaded 52873 existing records from primary storage. [2025-09-30T21:22:34.592191] [INFO ] [MAIN ] TAP: Loaded 52873 existing records. [2025-09-30T21:22:34.656976] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-30T21:22:34.854613] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T21:22:34.861179] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:34.872092] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-30T21:22:34.872494] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-30T21:22:34.873272] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-30T21:22:34.873378] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-30T21:22:35.307164] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:35.454406] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-30T21:22:35.702560] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T21:22:36.254347] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-30T21:22:36.460792] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T21:22:37.054373] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-30T21:22:37.404834] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T21:22:37.860550] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-30T21:22:37.882963] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T21:22:37.896785] [INFO ] [REMOTE ] TAK: Full fetch complete (71554 records). [2025-09-30T21:22:37.897031] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-30T21:22:38.380028] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-30T21:22:38.380123] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-30T21:22:38.381575] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-30T21:22:38.381673] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-30T21:22:38.383334] [DEBUG] [LOCAL ] TAK: Trimmed 71554 records to 49806 (keeping 200 days of data) [2025-09-30T21:22:38.674601] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-30T21:22:38.714227] [DEBUG] [LOCAL ] TAK: Primary data saved (49806 records). [2025-09-30T21:22:38.714351] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-30T21:22:38.714437] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAK took 31.7s. Estimated remaining: 41m 43s. Rate: 7.8 symbols/min [2025-09-30T21:22:38.905634] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:38.941598] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T21:22:38.963392] [DEBUG] [LOCAL ] TBB: Loaded 11736 existing records from primary storage. [2025-09-30T21:22:38.963681] [INFO ] [MAIN ] TBB: Loaded 11736 existing records. [2025-09-30T21:22:39.165954] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:39.166358] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-30T21:22:39.166463] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-30T21:22:39.166866] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-30T21:22:39.166929] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-30T21:22:39.458979] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-30T21:22:39.560834] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:39.805486] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T21:22:40.014031] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T21:22:40.254422] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-30T21:22:40.921617] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:22:41.054379] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-30T21:22:41.854413] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-30T21:22:42.162035] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T21:22:42.188375] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T21:22:42.654398] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-30T21:22:43.454401] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-30T21:22:43.555843] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T21:22:43.570123] [INFO ] [REMOTE ] TALO: Full fetch complete (73279 records). [2025-09-30T21:22:43.570320] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-30T21:22:44.015309] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-30T21:22:44.015538] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-30T21:22:44.016899] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-30T21:22:44.017197] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-30T21:22:44.019357] [DEBUG] [LOCAL ] TALO: Trimmed 73279 records to 50785 (keeping 200 days of data) [2025-09-30T21:22:44.139843] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T21:22:44.162572] [INFO ] [REMOTE ] TAL: Full fetch complete (75580 records). [2025-09-30T21:22:44.163405] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-30T21:22:44.260098] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-30T21:22:44.463096] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T21:22:44.756099] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-30T21:22:44.757238] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-30T21:22:44.759468] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-30T21:22:44.760210] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-30T21:22:44.766084] [DEBUG] [LOCAL ] TAL: Trimmed 75580 records to 51976 (keeping 200 days of data) [2025-09-30T21:22:45.046372] [DEBUG] [LOCAL ] TALO: Primary data saved (50785 records). [2025-09-30T21:22:45.056683] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-30T21:22:45.058317] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-30T21:22:45.085063] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TALO took 32.1s. Estimated remaining: 41m 35s. Rate: 7.8 symbols/min [2025-09-30T21:22:45.288729] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:45.403291] [DEBUG] [LOCAL ] TBBB: Loaded 35550 existing records from primary storage. [2025-09-30T21:22:45.404704] [INFO ] [MAIN ] TBBB: Loaded 35550 existing records. [2025-09-30T21:22:45.631931] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:45.632144] [DEBUG] [LOCAL ] TAL: Primary data saved (51976 records). [2025-09-30T21:22:45.632751] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-30T21:22:45.632833] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-30T21:22:45.633020] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAL took 34.7s. Estimated remaining: 41m 26s. Rate: 7.8 symbols/min [2025-09-30T21:22:45.633106] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-30T21:22:45.645355] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-30T21:22:45.657621] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-30T21:22:45.935167] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T21:22:45.967763] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:22:45.977408] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-30T21:22:46.267191] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:46.268166] [DEBUG] [LOCAL ] TBI: Loaded 22581 existing records from primary storage. [2025-09-30T21:22:46.269228] [INFO ] [MAIN ] TBI: Loaded 22581 existing records. [2025-09-30T21:22:46.504025] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-30T21:22:46.528997] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:22:46.529573] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-30T21:22:46.529792] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-30T21:22:46.530216] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-30T21:22:46.530278] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-30T21:22:46.659486] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-30T21:22:46.939768] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:22:46.989145] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:22:47.454379] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-30T21:22:47.927593] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T21:22:48.254387] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-30T21:22:48.525713] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T21:22:49.054363] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-30T21:22:49.854381] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-30T21:22:50.070027] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:22:50.194982] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T21:22:50.654357] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-30T21:22:50.969448] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T21:22:51.454374] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-30T21:22:52.254406] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-30T21:22:53.054466] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-30T21:23:05.302766] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (14.65 seconds). [2025-09-30T21:23:05.308376] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-30T21:23:06.459593] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (15.01 seconds). [2025-09-30T21:23:06.468919] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-30T21:23:06.999874] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (13.95 seconds). [2025-09-30T21:23:07.011926] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-30T21:23:07.058858] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (14.80 seconds). [2025-09-30T21:23:07.064524] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-30T21:23:07.817817] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T21:23:07.826210] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-30T21:23:07.998298] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T21:23:08.002142] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-30T21:23:08.056846] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-30T21:23:08.062486] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-30T21:23:08.680934] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:23:08.696055] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-30T21:23:08.876905] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T21:23:08.890128] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-30T21:23:09.301125] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:23:09.310878] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-30T21:23:09.544217] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T21:23:09.553525] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-30T21:23:09.565482] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T21:23:09.572298] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-30T21:23:10.379701] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:23:10.392017] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T21:23:10.396206] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-30T21:23:10.397489] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-30T21:23:10.728885] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T21:23:10.737223] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-30T21:23:10.925895] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T21:23:10.932605] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-30T21:23:10.976042] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:23:10.979164] [INFO ] [REMOTE ] TBB: Full fetch complete (17849 records). [2025-09-30T21:23:10.979311] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-30T21:23:11.403017] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-30T21:23:11.403155] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-30T21:23:11.403686] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-30T21:23:11.403774] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-30T21:23:11.404629] [DEBUG] [LOCAL ] TBB: Trimmed 17849 records to 11735 (keeping 200 days of data) [2025-09-30T21:23:11.499283] [DEBUG] [LOCAL ] TBB: Primary data saved (11735 records). [2025-09-30T21:23:11.499434] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-30T21:23:11.499523] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 32.8s. Estimated remaining: 41m 21s. Rate: 7.8 symbols/min [2025-09-30T21:23:11.704798] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:11.705170] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-30T21:23:11.705225] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-30T21:23:11.705374] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-30T21:23:11.705444] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-30T21:23:11.705498] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-30T21:23:11.705532] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-30T21:23:12.088338] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T21:23:12.183161] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-30T21:23:12.182854] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:12.183748] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-30T21:23:12.188248] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T21:23:12.194892] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-30T21:23:12.332028] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T21:23:12.345882] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-30T21:23:12.424296] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-30T21:23:12.425222] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-30T21:23:12.788681] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-30T21:23:12.789746] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-30T21:23:13.143108] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T21:23:13.144451] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-30T21:23:13.348322] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T21:23:13.354338] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-30T21:23:13.581718] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T21:23:13.582830] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-30T21:23:13.611140] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T21:23:13.854368] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-30T21:23:13.959234] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-30T21:23:14.114979] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T21:23:14.317034] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T21:23:14.329934] [INFO ] [REMOTE ] TAP: Full fetch complete (76154 records). [2025-09-30T21:23:14.330108] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-30T21:23:14.662378] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-30T21:23:14.771517] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-30T21:23:14.771615] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-30T21:23:14.772851] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-30T21:23:14.772921] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-30T21:23:14.775560] [DEBUG] [LOCAL ] TAP: Trimmed 76154 records to 52878 (keeping 200 days of data) [2025-09-30T21:23:15.033293] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T21:23:15.162783] [DEBUG] [LOCAL ] TAP: Primary data saved (52878 records). [2025-09-30T21:23:15.162934] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-30T21:23:15.163045] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TAP took 40.8s. Estimated remaining: 41m 13s. Rate: 7.8 symbols/min [2025-09-30T21:23:15.255790] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T21:23:15.352191] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:15.356946] [DEBUG] [LOCAL ] TBN: Loaded 2993 existing records from primary storage. [2025-09-30T21:23:15.357114] [INFO ] [MAIN ] TBN: Loaded 2993 existing records. [2025-09-30T21:23:15.459493] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-30T21:23:15.551582] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:15.551868] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-30T21:23:15.551931] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-30T21:23:15.552351] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-30T21:23:15.552427] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-30T21:23:15.944364] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:16.254360] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-30T21:23:16.531160] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-30T21:23:17.005192] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T21:23:17.012915] [INFO ] [REMOTE ] TBBB: Full fetch complete (51239 records). [2025-09-30T21:23:17.013111] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-30T21:23:17.059493] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-30T21:23:17.440334] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-30T21:23:17.440418] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-30T21:23:17.441401] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-30T21:23:17.441469] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-30T21:23:17.442700] [DEBUG] [LOCAL ] TBBB: Trimmed 51239 records to 35601 (keeping 200 days of data) [2025-09-30T21:23:17.666142] [DEBUG] [LOCAL ] TBBB: Primary data saved (35601 records). [2025-09-30T21:23:17.666297] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-30T21:23:17.666400] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBBB took 32.6s. Estimated remaining: 41m 4s. Rate: 7.8 symbols/min [2025-09-30T21:23:17.858229] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-30T21:23:17.858055] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:17.859404] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-30T21:23:17.859499] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-30T21:23:17.859677] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-30T21:23:17.859732] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-30T21:23:17.859778] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-30T21:23:17.859824] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-30T21:23:18.172423] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T21:23:18.200603] [INFO ] [REMOTE ] TBI: Full fetch complete (31751 records). [2025-09-30T21:23:18.211043] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-30T21:23:18.343158] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:18.461845] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T21:23:18.674753] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-30T21:23:18.690165] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-30T21:23:18.690258] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-30T21:23:18.691027] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-30T21:23:18.691211] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-30T21:23:18.692149] [DEBUG] [LOCAL ] TBI: Trimmed 31751 records to 22555 (keeping 200 days of data) [2025-09-30T21:23:18.821629] [DEBUG] [LOCAL ] TBI: Primary data saved (22555 records). [2025-09-30T21:23:18.821819] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-30T21:23:18.821942] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBI took 33.2s. Estimated remaining: 40m 55s. Rate: 7.8 symbols/min [2025-09-30T21:23:18.908009] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:23:18.934739] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-30T21:23:18.934984] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:23:18.935060] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-30T21:23:18.935165] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:23:18.940969] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-30T21:23:18.951330] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-30T21:23:18.956535] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-30T21:23:18.966986] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-30T21:23:18.986413] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TCAI took 1.3s. Estimated remaining: 40m 47s. Rate: 7.8 symbols/min [2025-09-30T21:23:19.071520] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:19.215054] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:19.263125] [DEBUG] [LOCAL ] TD: Loaded 52270 existing records from primary storage. [2025-09-30T21:23:19.263538] [INFO ] [MAIN ] TD: Loaded 52270 existing records. [2025-09-30T21:23:19.457014] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-30T21:23:19.498348] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:19.500663] [DEBUG] [LOCAL ] TDC: Loaded 46688 existing records from primary storage. [2025-09-30T21:23:19.499381] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-30T21:23:19.500917] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-30T21:23:19.501285] [INFO ] [MAIN ] TDC: Loaded 46688 existing records. [2025-09-30T21:23:19.513535] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-30T21:23:19.518977] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-30T21:23:19.915518] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T21:23:19.921285] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:19.975471] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-30T21:23:20.004239] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-30T21:23:20.021622] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-30T21:23:20.032011] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-30T21:23:20.200804] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:20.262584] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-30T21:23:20.503962] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:20.982228] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T21:23:21.054414] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-30T21:23:21.854406] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-30T21:23:22.486031] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T21:23:22.654386] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-30T21:23:22.916590] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-30T21:23:22.919951] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T21:23:23.454401] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-30T21:23:23.717004] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-30T21:23:23.717918] [INFO ] [REMOTE ] TBLU: Full fetch complete (1174 records). [2025-09-30T21:23:23.718027] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-30T21:23:23.920356] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T21:23:23.920527] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:23:23.920597] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:23:23.920697] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-30T21:23:23.920771] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-30T21:23:23.920809] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-30T21:23:23.920849] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-30T21:23:23.920907] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBLU took 12.4s. Estimated remaining: 40m 39s. Rate: 7.8 symbols/min [2025-09-30T21:23:24.113335] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:24.124056] [DEBUG] [LOCAL ] TDF: Loaded 6433 existing records from primary storage. [2025-09-30T21:23:24.124269] [INFO ] [MAIN ] TDF: Loaded 6433 existing records. [2025-09-30T21:23:24.259481] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-30T21:23:24.339317] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:24.339548] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-30T21:23:24.339607] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-30T21:23:24.340119] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-30T21:23:24.340191] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-30T21:23:24.749080] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:25.054419] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-30T21:23:25.754378] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T21:23:25.835531] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T21:23:25.854353] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-30T21:23:26.654359] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-30T21:23:27.081208] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:23:27.454420] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-30T21:23:28.254375] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-30T21:23:28.484721] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T21:23:28.947814] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T21:23:28.973790] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T21:23:29.054333] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-30T21:23:29.620288] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T21:23:29.854417] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-30T21:23:30.654361] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-30T21:23:31.433904] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T21:23:31.454302] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-30T21:23:31.556366] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T21:23:32.254333] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-30T21:23:32.387154] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T21:23:33.054370] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-30T21:23:33.688168] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T21:23:33.854405] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-30T21:23:34.654350] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-30T21:23:34.857367] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T21:23:35.398275] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T21:23:35.454401] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-30T21:23:35.651377] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:23:35.875408] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T21:23:36.254426] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-30T21:23:36.623228] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-30T21:23:37.054453] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-30T21:23:37.854379] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-30T21:23:38.633304] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:23:38.654364] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-30T21:23:39.450619] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:23:39.459788] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-30T21:23:40.053263] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T21:23:40.254334] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-30T21:23:40.426715] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T21:23:41.054399] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-30T21:23:41.479251] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T21:23:41.854368] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-30T21:23:41.935265] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T21:23:42.152603] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-30T21:23:42.654373] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-30T21:23:43.454409] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-30T21:23:43.892439] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T21:23:44.264183] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-30T21:23:44.287215] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:23:44.754697] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T21:23:45.054337] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-30T21:23:45.854402] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-30T21:23:46.654334] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-30T21:23:46.917011] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T21:23:47.454400] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-30T21:23:47.538862] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:23:47.571200] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T21:23:47.573837] [INFO ] [REMOTE ] TDF: Full fetch complete (10499 records). [2025-09-30T21:23:47.574037] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-30T21:23:48.020764] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-30T21:23:48.020992] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-30T21:23:48.021288] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-30T21:23:48.021333] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-30T21:23:48.022056] [DEBUG] [LOCAL ] TDF: Trimmed 10499 records to 6441 (keeping 200 days of data) [2025-09-30T21:23:48.066855] [DEBUG] [LOCAL ] TDF: Primary data saved (6441 records). [2025-09-30T21:23:48.067002] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-30T21:23:48.067091] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TDF took 24.1s. Estimated remaining: 40m 33s. Rate: 7.8 symbols/min [2025-09-30T21:23:48.161185] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T21:23:48.264991] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-30T21:23:48.269080] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:48.299717] [DEBUG] [LOCAL ] TDG: Loaded 21894 existing records from primary storage. [2025-09-30T21:23:48.300008] [INFO ] [MAIN ] TDG: Loaded 21894 existing records. [2025-09-30T21:23:48.497674] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:48.497901] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-30T21:23:48.497952] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-30T21:23:48.498614] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-30T21:23:48.498711] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-30T21:23:48.910731] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:49.054381] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-30T21:23:49.614671] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T21:23:49.854895] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-30T21:23:49.858634] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T21:23:50.580349] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T21:23:50.582381] [INFO ] [REMOTE ] TBN: Full fetch complete (5094 records). [2025-09-30T21:23:50.582459] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-30T21:23:50.659452] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-30T21:23:50.982524] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-30T21:23:50.982603] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-30T21:23:50.982789] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-30T21:23:50.982851] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-30T21:23:50.983238] [DEBUG] [LOCAL ] TBN: Trimmed 5094 records to 3242 (keeping 200 days of data) [2025-09-30T21:23:51.002991] [DEBUG] [LOCAL ] TBN: Primary data saved (3242 records). [2025-09-30T21:23:51.003106] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-30T21:23:51.003191] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TBN took 35.8s. Estimated remaining: 40m 25s. Rate: 7.8 symbols/min [2025-09-30T21:23:51.206629] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:51.270974] [DEBUG] [LOCAL ] TDOC: Loaded 53344 existing records from primary storage. [2025-09-30T21:23:51.271302] [INFO ] [MAIN ] TDOC: Loaded 53344 existing records. [2025-09-30T21:23:51.459564] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-30T21:23:51.465087] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:51.466320] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-30T21:23:51.466384] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-30T21:23:51.467145] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-30T21:23:51.467207] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-30T21:23:51.883634] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:52.254413] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-30T21:23:52.481261] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T21:23:52.702227] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T21:23:53.054439] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-30T21:23:53.854364] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-30T21:23:54.301282] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-30T21:23:54.438506] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T21:23:54.449900] [INFO ] [REMOTE ] TDC: Full fetch complete (66885 records). [2025-09-30T21:23:54.450087] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-30T21:23:54.665322] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-30T21:23:54.883293] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-30T21:23:54.883397] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-30T21:23:54.884579] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-30T21:23:54.884785] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-30T21:23:54.886368] [DEBUG] [LOCAL ] TDC: Trimmed 66885 records to 46646 (keeping 200 days of data) [2025-09-30T21:23:54.999910] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T21:23:55.190337] [DEBUG] [LOCAL ] TDC: Primary data saved (46646 records). [2025-09-30T21:23:55.190471] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-30T21:23:55.190583] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDC took 36.2s. Estimated remaining: 40m 17s. Rate: 7.8 symbols/min [2025-09-30T21:23:55.374109] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:55.417763] [DEBUG] [LOCAL ] TDS: Loaded 42693 existing records from primary storage. [2025-09-30T21:23:55.418158] [INFO ] [MAIN ] TDS: Loaded 42693 existing records. [2025-09-30T21:23:55.459557] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-30T21:23:55.622188] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:55.622442] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-30T21:23:55.622495] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-30T21:23:55.623112] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-30T21:23:55.623170] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-30T21:23:56.001237] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:56.254365] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-30T21:23:56.805675] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-30T21:23:57.054356] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-30T21:23:57.146231] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:23:57.311994] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:23:57.323873] [INFO ] [REMOTE ] TD: Full fetch complete (75791 records). [2025-09-30T21:23:57.324027] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-30T21:23:57.793858] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-30T21:23:57.793950] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-30T21:23:57.795066] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-30T21:23:57.795139] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-30T21:23:57.796759] [DEBUG] [LOCAL ] TD: Trimmed 75791 records to 52282 (keeping 200 days of data) [2025-09-30T21:23:57.855425] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-30T21:23:58.146742] [DEBUG] [LOCAL ] TD: Primary data saved (52282 records). [2025-09-30T21:23:58.146926] [INFO ] [MAIN ] TD: Full history saved. [2025-09-30T21:23:58.147021] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TD took 39.3s. Estimated remaining: 40m 8s. Rate: 7.8 symbols/min [2025-09-30T21:23:58.332501] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:23:58.381824] [DEBUG] [LOCAL ] TDW: Loaded 45406 existing records from primary storage. [2025-09-30T21:23:58.382196] [INFO ] [MAIN ] TDW: Loaded 45406 existing records. [2025-09-30T21:23:58.577088] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:23:58.577326] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-30T21:23:58.577375] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-30T21:23:58.577834] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-30T21:23:58.577898] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-30T21:23:58.659422] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-30T21:23:58.974281] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:23:59.006251] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T21:23:59.370335] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:23:59.454384] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-30T21:23:59.908713] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T21:24:00.254368] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-30T21:24:01.054461] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-30T21:24:01.418395] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T21:24:01.723313] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:24:01.854449] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-30T21:24:02.564166] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T21:24:02.654370] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-30T21:24:03.128345] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T21:24:03.454397] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-30T21:24:04.254335] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-30T21:24:04.377365] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:24:05.054357] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-30T21:24:05.069605] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T21:24:05.598935] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T21:24:05.854354] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-30T21:24:06.654333] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-30T21:24:06.803273] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T21:24:06.964868] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T21:24:07.454407] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-30T21:24:08.254379] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-30T21:24:08.413968] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T21:24:09.054414] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-30T21:24:09.499021] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T21:24:09.598105] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T21:24:09.854385] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-30T21:24:10.664677] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-30T21:24:10.670192] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T21:24:10.882452] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T21:24:11.454362] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-30T21:24:12.254353] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-30T21:24:12.474563] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T21:24:13.054357] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-30T21:24:13.518512] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-30T21:24:13.547953] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T21:24:13.553944] [INFO ] [REMOTE ] TDG: Full fetch complete (32112 records). [2025-09-30T21:24:13.554120] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-30T21:24:13.859420] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-30T21:24:13.979514] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-30T21:24:13.979600] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-30T21:24:13.980253] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-30T21:24:13.980314] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-30T21:24:13.981383] [DEBUG] [LOCAL ] TDG: Trimmed 32112 records to 21923 (keeping 200 days of data) [2025-09-30T21:24:14.141262] [DEBUG] [LOCAL ] TDG: Primary data saved (21923 records). [2025-09-30T21:24:14.141410] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-30T21:24:14.141523] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDG took 26.1s. Estimated remaining: 40m 2s. Rate: 7.8 symbols/min [2025-09-30T21:24:14.332702] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:14.365867] [DEBUG] [LOCAL ] TDY: Loaded 22545 existing records from primary storage. [2025-09-30T21:24:14.366298] [INFO ] [MAIN ] TDY: Loaded 22545 existing records. [2025-09-30T21:24:14.564301] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:14.564849] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-30T21:24:14.564941] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-30T21:24:14.565526] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-30T21:24:14.565592] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-30T21:24:14.662058] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-30T21:24:14.823859] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T21:24:14.989918] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:15.454355] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-30T21:24:15.979083] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-30T21:24:16.222971] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T21:24:16.254325] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-30T21:24:16.719449] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T21:24:17.054395] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-30T21:24:17.552420] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T21:24:17.854402] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-30T21:24:18.503789] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T21:24:18.654391] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-30T21:24:19.011159] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T21:24:19.454375] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-30T21:24:19.996123] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T21:24:20.254418] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-30T21:24:21.054345] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-30T21:24:21.216073] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T21:24:21.723595] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-30T21:24:21.854565] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-30T21:24:22.376276] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:24:22.654409] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-30T21:24:23.454393] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-30T21:24:23.970957] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T21:24:24.018327] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T21:24:24.254403] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-30T21:24:25.054378] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-30T21:24:25.086961] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:24:25.854369] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-30T21:24:25.913255] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T21:24:25.923432] [INFO ] [REMOTE ] TDS: Full fetch complete (61655 records). [2025-09-30T21:24:25.923665] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-30T21:24:26.358549] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-30T21:24:26.358676] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-30T21:24:26.359785] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-30T21:24:26.359850] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-30T21:24:26.363391] [DEBUG] [LOCAL ] TDS: Trimmed 61655 records to 42781 (keeping 200 days of data) [2025-09-30T21:24:26.484548] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T21:24:26.654562] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-30T21:24:26.682262] [DEBUG] [LOCAL ] TDS: Primary data saved (42781 records). [2025-09-30T21:24:26.682406] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-30T21:24:26.682549] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 31.5s. Estimated remaining: 39m 55s. Rate: 7.8 symbols/min [2025-09-30T21:24:26.874873] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:26.875103] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-30T21:24:26.875158] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-30T21:24:26.875271] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-30T21:24:26.875333] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-30T21:24:26.875394] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-30T21:24:26.875447] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-30T21:24:27.261350] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:27.461568] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-30T21:24:27.467359] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:24:27.676771] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:24:27.677089] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-30T21:24:27.677193] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:24:27.677271] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-30T21:24:27.677350] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:24:27.677435] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-30T21:24:27.677520] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-30T21:24:27.677587] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-30T21:24:27.677746] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-30T21:24:27.677852] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 1.0s. Estimated remaining: 39m 46s. Rate: 7.8 symbols/min [2025-09-30T21:24:27.875555] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:27.894318] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T21:24:27.906981] [DEBUG] [LOCAL ] TEAF: Loaded 7473 existing records from primary storage. [2025-09-30T21:24:27.907221] [INFO ] [MAIN ] TEAF: Loaded 7473 existing records. [2025-09-30T21:24:28.088540] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:28.088821] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-30T21:24:28.088870] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-30T21:24:28.089510] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-30T21:24:28.089581] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-30T21:24:28.254393] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-30T21:24:28.481026] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:29.054364] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-30T21:24:29.456786] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T21:24:29.854358] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-30T21:24:30.654345] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-30T21:24:31.200508] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T21:24:31.214770] [INFO ] [REMOTE ] TDOC: Full fetch complete (77277 records). [2025-09-30T21:24:31.217958] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-30T21:24:31.217766] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-30T21:24:31.454863] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-30T21:24:31.705257] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-30T21:24:31.714751] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-30T21:24:31.719170] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-30T21:24:31.719884] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-30T21:24:31.722225] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T21:24:31.735011] [DEBUG] [LOCAL ] TDOC: Trimmed 77277 records to 53344 (keeping 200 days of data) [2025-09-30T21:24:32.069684] [DEBUG] [LOCAL ] TDOC: Primary data saved (53344 records). [2025-09-30T21:24:32.069827] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-30T21:24:32.069933] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDOC took 41.1s. Estimated remaining: 39m 38s. Rate: 7.8 symbols/min [2025-09-30T21:24:32.257001] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-30T21:24:32.258797] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:32.324767] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-30T21:24:32.325199] [INFO ] [MAIN ] TECK: Loaded 53436 existing records. [2025-09-30T21:24:32.517014] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:32.517248] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-30T21:24:32.517320] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-30T21:24:32.518456] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-30T21:24:32.518517] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-30T21:24:32.914238] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:32.932811] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T21:24:33.054377] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-30T21:24:33.854420] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-30T21:24:33.915875] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T21:24:33.925435] [INFO ] [REMOTE ] TDW: Full fetch complete (67167 records). [2025-09-30T21:24:33.925603] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-30T21:24:34.373865] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-30T21:24:34.373984] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-30T21:24:34.375740] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-30T21:24:34.375866] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-30T21:24:34.377767] [DEBUG] [LOCAL ] TDW: Trimmed 67167 records to 45366 (keeping 200 days of data) [2025-09-30T21:24:34.571280] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T21:24:34.662318] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-30T21:24:34.684472] [DEBUG] [LOCAL ] TDW: Primary data saved (45366 records). [2025-09-30T21:24:34.684636] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-30T21:24:34.684813] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDW took 36.5s. Estimated remaining: 39m 30s. Rate: 7.8 symbols/min [2025-09-30T21:24:34.887607] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:34.919356] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T21:24:34.966409] [DEBUG] [LOCAL ] TEF: Loaded 37364 existing records from primary storage. [2025-09-30T21:24:34.966777] [INFO ] [MAIN ] TEF: Loaded 37364 existing records. [2025-09-30T21:24:35.170302] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:35.170757] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-30T21:24:35.170811] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-30T21:24:35.171245] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-30T21:24:35.171304] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-30T21:24:35.463799] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-30T21:24:35.570271] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:35.796344] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T21:24:36.254359] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-30T21:24:37.054370] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-30T21:24:37.206453] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T21:24:37.425139] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T21:24:37.489486] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T21:24:37.854408] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-30T21:24:38.654406] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-30T21:24:39.302162] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T21:24:39.377947] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T21:24:39.454344] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-30T21:24:40.254386] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-30T21:24:41.054377] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-30T21:24:41.168974] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T21:24:41.209263] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T21:24:41.770362] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T21:24:41.775771] [INFO ] [REMOTE ] TDY: Full fetch complete (32289 records). [2025-09-30T21:24:41.775975] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-30T21:24:41.859495] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-30T21:24:42.191800] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-30T21:24:42.191891] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-30T21:24:42.192618] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-30T21:24:42.192690] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-30T21:24:42.193549] [DEBUG] [LOCAL ] TDY: Trimmed 32289 records to 22582 (keeping 200 days of data) [2025-09-30T21:24:42.359678] [DEBUG] [LOCAL ] TDY: Primary data saved (22582 records). [2025-09-30T21:24:42.359832] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-30T21:24:42.359944] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDY took 28.2s. Estimated remaining: 39m 22s. Rate: 7.8 symbols/min [2025-09-30T21:24:42.604400] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:42.629247] [DEBUG] [LOCAL ] TEI: Loaded 20866 existing records from primary storage. [2025-09-30T21:24:42.629524] [INFO ] [MAIN ] TEI: Loaded 20866 existing records. [2025-09-30T21:24:42.663722] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-30T21:24:42.827098] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:42.827330] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-30T21:24:42.827391] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-30T21:24:42.827991] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-30T21:24:42.828060] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-30T21:24:43.211289] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:43.341082] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T21:24:43.454369] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-30T21:24:43.683146] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T21:24:43.933028] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T21:24:44.254406] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-30T21:24:45.054333] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-30T21:24:45.116301] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T21:24:45.854362] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-30T21:24:46.450207] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T21:24:46.654380] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-30T21:24:47.392677] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T21:24:47.439357] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:24:47.454306] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-30T21:24:47.974603] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T21:24:47.977008] [INFO ] [REMOTE ] TEAF: Full fetch complete (10008 records). [2025-09-30T21:24:47.977113] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-30T21:24:48.259475] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-30T21:24:48.379878] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-30T21:24:48.379971] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-30T21:24:48.380283] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-30T21:24:48.380368] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-30T21:24:48.380879] [DEBUG] [LOCAL ] TEAF: Trimmed 10008 records to 7566 (keeping 200 days of data) [2025-09-30T21:24:48.428773] [DEBUG] [LOCAL ] TEAF: Primary data saved (7566 records). [2025-09-30T21:24:48.428903] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-30T21:24:48.429005] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 20.8s. Estimated remaining: 39m 14s. Rate: 7.8 symbols/min [2025-09-30T21:24:48.621937] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:24:48.697281] [DEBUG] [LOCAL ] TEL: Loaded 51130 existing records from primary storage. [2025-09-30T21:24:48.697691] [INFO ] [MAIN ] TEL: Loaded 51130 existing records. [2025-09-30T21:24:48.889120] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:24:48.889388] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-30T21:24:48.889459] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-30T21:24:48.890428] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-30T21:24:48.890504] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-30T21:24:49.075050] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-30T21:24:49.323741] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:24:49.854443] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-30T21:24:50.379974] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T21:24:50.460020] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T21:24:50.654372] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-30T21:24:51.185189] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T21:24:51.454360] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-30T21:24:52.143555] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T21:24:52.254324] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-30T21:24:52.567588] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T21:24:53.054390] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-30T21:24:53.807390] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T21:24:53.854392] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-30T21:24:54.157085] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T21:24:54.654372] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-30T21:24:55.291487] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T21:24:55.454381] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-30T21:24:56.254374] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-30T21:24:56.374483] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T21:24:56.510463] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T21:24:57.054362] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-30T21:24:57.854358] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-30T21:24:58.133202] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T21:24:58.572605] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T21:24:58.654352] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-30T21:24:58.925517] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T21:24:59.454394] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-30T21:24:59.842547] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T21:25:00.254371] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-30T21:25:01.017256] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T21:25:01.054338] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-30T21:25:01.437217] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T21:25:01.854380] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-30T21:25:02.654358] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-30T21:25:02.861575] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T21:25:03.014561] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T21:25:03.454360] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-30T21:25:04.254361] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-30T21:25:04.454725] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T21:25:05.054379] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-30T21:25:05.441564] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T21:25:05.449884] [INFO ] [REMOTE ] TEF: Full fetch complete (54694 records). [2025-09-30T21:25:05.450038] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-30T21:25:05.858948] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-30T21:25:05.877312] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-30T21:25:05.877494] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-30T21:25:05.878841] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-30T21:25:05.879095] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-30T21:25:05.900513] [DEBUG] [LOCAL ] TEF: Trimmed 54694 records to 37336 (keeping 200 days of data) [2025-09-30T21:25:05.923793] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-30T21:25:05.992963] [INFO ] [REMOTE ] TECK: Full fetch complete (77312 records). [2025-09-30T21:25:06.019990] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-30T21:25:06.505018] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-30T21:25:06.505226] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-30T21:25:06.508140] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-30T21:25:06.509137] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-30T21:25:06.516999] [DEBUG] [LOCAL ] TECK: Trimmed 77312 records to 53436 (keeping 200 days of data) [2025-09-30T21:25:06.727579] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T21:25:06.735674] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-30T21:25:06.795541] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:25:06.824341] [DEBUG] [LOCAL ] TEF: Primary data saved (37336 records). [2025-09-30T21:25:06.825567] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-30T21:25:06.825831] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEF took 32.1s. Estimated remaining: 39m 8s. Rate: 7.8 symbols/min [2025-09-30T21:25:07.034896] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:07.100026] [DEBUG] [LOCAL ] TEN: No existing data file found in primary storage. [2025-09-30T21:25:07.100424] [WARN ] [MAIN ] TEN: No existing data found, performing full refresh instead. [2025-09-30T21:25:07.100586] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-30T21:25:07.127702] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-30T21:25:07.131054] [DEBUG] [LOCAL ] TEN: No primary data file found to delete. [2025-09-30T21:25:07.132449] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-30T21:25:07.455712] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-30T21:25:07.557660] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:07.666864] [DEBUG] [LOCAL ] TECK: Primary data saved (53436 records). [2025-09-30T21:25:07.667015] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-30T21:25:07.667121] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TECK took 35.6s. Estimated remaining: 38m 59s. Rate: 7.8 symbols/min [2025-09-30T21:25:07.857178] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:07.881620] [DEBUG] [LOCAL ] TEO: Loaded 22040 existing records from primary storage. [2025-09-30T21:25:07.881921] [INFO ] [MAIN ] TEO: Loaded 22040 existing records. [2025-09-30T21:25:08.032863] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T21:25:08.097758] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:25:08.098072] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-30T21:25:08.098133] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-30T21:25:08.098812] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-30T21:25:08.098890] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-30T21:25:08.267471] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-30T21:25:08.511233] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:09.054383] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-30T21:25:09.356792] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T21:25:09.777340] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:25:09.854588] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-30T21:25:10.200593] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T21:25:10.654476] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-30T21:25:11.212677] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:25:11.454438] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-30T21:25:11.734020] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T21:25:12.254419] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-30T21:25:12.705387] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T21:25:13.054382] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-30T21:25:13.854400] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-30T21:25:14.043934] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:25:14.158403] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T21:25:14.654373] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-30T21:25:15.360226] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T21:25:15.454393] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-30T21:25:16.254330] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-30T21:25:16.422129] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T21:25:16.453813] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T21:25:17.054398] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-30T21:25:17.733516] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T21:25:17.854405] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-30T21:25:18.638772] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:25:18.661080] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-30T21:25:18.673677] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T21:25:19.454390] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-30T21:25:20.254355] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-30T21:25:20.473062] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:25:20.693986] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T21:25:21.019549] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T21:25:21.054373] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-30T21:25:21.854379] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-30T21:25:22.654339] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-30T21:25:22.684678] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T21:25:22.841309] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T21:25:22.852263] [INFO ] [REMOTE ] TEL: Full fetch complete (73392 records). [2025-09-30T21:25:22.852409] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-30T21:25:23.279455] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-30T21:25:23.279551] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-30T21:25:23.280782] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-30T21:25:23.280866] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-30T21:25:23.282441] [DEBUG] [LOCAL ] TEL: Trimmed 73392 records to 51113 (keeping 200 days of data) [2025-09-30T21:25:23.474671] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-30T21:25:23.631149] [DEBUG] [LOCAL ] TEL: Primary data saved (51113 records). [2025-09-30T21:25:23.631299] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-30T21:25:23.631389] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEL took 35.2s. Estimated remaining: 38m 53s. Rate: 7.8 symbols/min [2025-09-30T21:25:23.826298] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:23.861880] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T21:25:23.916043] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-30T21:25:23.916534] [INFO ] [MAIN ] TEVA: Loaded 53632 existing records. [2025-09-30T21:25:24.123116] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:25:24.123443] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-30T21:25:24.124297] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-30T21:25:24.124807] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-30T21:25:24.124866] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-30T21:25:24.256850] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-30T21:25:24.455084] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T21:25:24.548898] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:25.054405] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-30T21:25:25.532830] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T21:25:25.538239] [INFO ] [REMOTE ] TEI: Full fetch complete (30318 records). [2025-09-30T21:25:25.538346] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-30T21:25:25.859436] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-30T21:25:25.931760] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-30T21:25:25.931839] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-30T21:25:25.932459] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-30T21:25:25.932503] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-30T21:25:25.933752] [DEBUG] [LOCAL ] TEI: Trimmed 30318 records to 20995 (keeping 200 days of data) [2025-09-30T21:25:26.065977] [DEBUG] [LOCAL ] TEI: Primary data saved (20995 records). [2025-09-30T21:25:26.066108] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-30T21:25:26.066190] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEI took 43.7s. Estimated remaining: 38m 44s. Rate: 7.8 symbols/min [2025-09-30T21:25:26.259092] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:26.323584] [DEBUG] [LOCAL ] TEX: Loaded 44379 existing records from primary storage. [2025-09-30T21:25:26.324002] [INFO ] [MAIN ] TEX: Loaded 44379 existing records. [2025-09-30T21:25:26.517227] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:25:26.517479] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-30T21:25:26.517554] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-30T21:25:26.518537] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-30T21:25:26.518601] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-30T21:25:26.672547] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-30T21:25:26.907913] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:26.943402] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T21:25:27.299484] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T21:25:27.454390] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-30T21:25:27.519164] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T21:25:28.254388] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-30T21:25:28.988411] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:25:29.054416] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-30T21:25:29.818720] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T21:25:29.854347] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-30T21:25:30.339413] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T21:25:30.654417] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-30T21:25:31.454326] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-30T21:25:31.507992] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T21:25:31.976580] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-30T21:25:32.254420] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-30T21:25:32.973899] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T21:25:32.980667] [INFO ] [REMOTE ] TEO: Full fetch complete (32795 records). [2025-09-30T21:25:32.980833] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-30T21:25:33.059542] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-30T21:25:33.411994] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-30T21:25:33.412083] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-30T21:25:33.412839] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-30T21:25:33.412904] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-30T21:25:33.413752] [DEBUG] [LOCAL ] TEO: Trimmed 32795 records to 22085 (keeping 200 days of data) [2025-09-30T21:25:33.565822] [DEBUG] [LOCAL ] TEO: Primary data saved (22085 records). [2025-09-30T21:25:33.565961] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-30T21:25:33.566047] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 25.9s. Estimated remaining: 38m 36s. Rate: 7.8 symbols/min [2025-09-30T21:25:33.749190] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:33.814495] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-30T21:25:33.814876] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-30T21:25:33.860129] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-30T21:25:34.023670] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:25:34.023988] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-30T21:25:34.024063] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-30T21:25:34.024678] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-30T21:25:34.024741] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-30T21:25:34.441112] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:34.484860] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-30T21:25:34.654416] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-30T21:25:34.779557] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:25:34.909921] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T21:25:34.925603] [INFO ] [REMOTE ] TEN: Full fetch complete (44523 records). [2025-09-30T21:25:34.925851] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-30T21:25:35.357745] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-30T21:25:35.357848] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-30T21:25:35.358857] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-30T21:25:35.358928] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-30T21:25:35.360100] [DEBUG] [LOCAL ] TEN: Trimmed 44523 records to 30736 (keeping 200 days of data) [2025-09-30T21:25:35.456263] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-30T21:25:35.562216] [DEBUG] [LOCAL ] TEN: Primary data saved (30736 records). [2025-09-30T21:25:35.562378] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-30T21:25:35.562490] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEN took 28.7s. Estimated remaining: 38m 28s. Rate: 7.8 symbols/min [2025-09-30T21:25:35.747164] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:25:35.784376] [DEBUG] [LOCAL ] TFII: Loaded 33910 existing records from primary storage. [2025-09-30T21:25:35.784678] [INFO ] [MAIN ] TFII: Loaded 33910 existing records. [2025-09-30T21:25:36.009326] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:25:36.009534] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-30T21:25:36.009582] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-30T21:25:36.010062] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-30T21:25:36.010137] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-30T21:25:36.266289] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-30T21:25:36.407004] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:25:36.757263] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T21:25:37.068820] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-30T21:25:37.093290] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:25:37.860418] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-30T21:25:37.869498] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:25:38.303380] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:25:38.654436] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-30T21:25:39.454366] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-30T21:25:39.612908] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T21:25:39.870528] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T21:25:40.254404] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-30T21:25:41.054359] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-30T21:25:41.337675] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T21:25:41.375773] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T21:25:41.854361] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-30T21:25:42.654363] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-30T21:25:43.253350] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-30T21:25:43.358042] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T21:25:43.454424] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-30T21:25:44.254371] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-30T21:25:44.331166] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:25:45.054379] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-30T21:25:45.482546] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T21:25:45.854370] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-30T21:25:46.390896] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T21:25:46.423323] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T21:25:46.654362] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-30T21:25:47.454431] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-30T21:25:48.035489] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T21:25:48.254362] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-30T21:25:48.718110] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T21:25:49.062727] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-30T21:25:49.082849] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T21:25:49.823151] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:25:49.854418] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-30T21:25:50.654427] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-30T21:25:50.997964] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T21:25:51.042316] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T21:25:51.454444] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-30T21:25:52.211612] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T21:25:52.254352] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-30T21:25:52.781061] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T21:25:53.054351] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-30T21:25:53.854358] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-30T21:25:54.001111] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T21:25:54.523788] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T21:25:54.654356] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-30T21:25:55.454361] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-30T21:25:55.884054] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T21:25:56.043628] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-30T21:25:56.254368] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-30T21:25:57.054417] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-30T21:25:57.303740] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T21:25:57.854371] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-30T21:25:58.476806] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T21:25:58.488995] [INFO ] [REMOTE ] TEVA: Full fetch complete (77691 records). [2025-09-30T21:25:58.489186] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-30T21:25:58.667816] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-30T21:25:58.710195] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T21:25:58.805577] [INFO ] [REMOTE ] TEX: Full fetch complete (64624 records). [2025-09-30T21:25:58.820693] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-30T21:25:59.168859] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-30T21:25:59.185927] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-30T21:25:59.210859] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-30T21:25:59.252409] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-30T21:25:59.321977] [DEBUG] [LOCAL ] TEVA: Trimmed 77691 records to 53632 (keeping 200 days of data) [2025-09-30T21:25:59.478157] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-30T21:25:59.504951] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-30T21:25:59.505982] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-30T21:25:59.508426] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-30T21:25:59.512926] [DEBUG] [LOCAL ] TEX: Trimmed 64624 records to 44264 (keeping 200 days of data) [2025-09-30T21:25:59.666749] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T21:25:59.688734] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-30T21:26:00.067469] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T21:26:00.108927] [DEBUG] [LOCAL ] TEVA: Primary data saved (53632 records). [2025-09-30T21:26:00.111075] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-30T21:26:00.111237] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEVA took 36.5s. Estimated remaining: 38m 23s. Rate: 7.8 symbols/min [2025-09-30T21:26:00.263812] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-30T21:26:00.331736] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:00.337628] [DEBUG] [LOCAL ] TEX: Primary data saved (44264 records). [2025-09-30T21:26:00.337903] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-30T21:26:00.338044] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEX took 34.3s. Estimated remaining: 38m 14s. Rate: 7.8 symbols/min [2025-09-30T21:26:00.545600] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:00.546269] [DEBUG] [LOCAL ] TFIN: Loaded 23487 existing records from primary storage. [2025-09-30T21:26:00.546960] [INFO ] [MAIN ] TFIN: Loaded 23487 existing records. [2025-09-30T21:26:00.780629] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:00.792757] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-30T21:26:00.792874] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-30T21:26:00.793704] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-30T21:26:00.793902] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-30T21:26:00.793825] [DEBUG] [LOCAL ] TFPM: Loaded 37691 existing records from primary storage. [2025-09-30T21:26:00.862946] [INFO ] [MAIN ] TFPM: Loaded 37691 existing records. [2025-09-30T21:26:01.284937] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:01.307595] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-30T21:26:01.310997] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-30T21:26:01.316637] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-30T21:26:01.332186] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-30T21:26:01.482850] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:01.495969] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-30T21:26:01.814966] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T21:26:01.852886] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:01.859670] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-30T21:26:01.860977] [INFO ] [REMOTE ] TFII: Full fetch complete (47754 records). [2025-09-30T21:26:01.861067] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-30T21:26:01.907033] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T21:26:02.322012] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T21:26:02.382126] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-30T21:26:02.382213] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-30T21:26:02.383287] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-30T21:26:02.383363] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-30T21:26:02.384633] [DEBUG] [LOCAL ] TFII: Trimmed 47754 records to 33790 (keeping 200 days of data) [2025-09-30T21:26:02.622725] [DEBUG] [LOCAL ] TFII: Primary data saved (33790 records). [2025-09-30T21:26:02.622911] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-30T21:26:02.623039] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 27.1s. Estimated remaining: 38m 5s. Rate: 7.8 symbols/min [2025-09-30T21:26:02.659459] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-30T21:26:02.807458] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:02.852278] [DEBUG] [LOCAL ] TFX: Loaded 37180 existing records from primary storage. [2025-09-30T21:26:02.852594] [INFO ] [MAIN ] TFX: Loaded 37180 existing records. [2025-09-30T21:26:03.056122] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:03.056481] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-30T21:26:03.056555] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-30T21:26:03.062958] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-30T21:26:03.075128] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-30T21:26:03.076518] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T21:26:03.458127] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-30T21:26:03.564553] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:03.766936] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T21:26:04.254431] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-30T21:26:05.054347] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-30T21:26:05.168663] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T21:26:05.180872] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-30T21:26:05.181084] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-30T21:26:05.384680] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T21:26:05.625867] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-30T21:26:05.625966] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-30T21:26:05.627207] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-30T21:26:05.627276] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-30T21:26:05.628914] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-09-30T21:26:05.855500] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-30T21:26:05.986417] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-30T21:26:05.986579] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-30T21:26:05.986721] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFC took 32.4s. Estimated remaining: 37m 57s. Rate: 7.8 symbols/min [2025-09-30T21:26:06.175523] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:06.188554] [DEBUG] [LOCAL ] TG: Loaded 10383 existing records from primary storage. [2025-09-30T21:26:06.188812] [INFO ] [MAIN ] TG: Loaded 10383 existing records. [2025-09-30T21:26:06.388136] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:06.388620] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-30T21:26:06.388955] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-30T21:26:06.397638] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-30T21:26:06.410217] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-30T21:26:06.417324] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T21:26:06.657835] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-30T21:26:06.831310] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:06.853052] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T21:26:07.454380] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-30T21:26:08.211609] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:26:08.254374] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-30T21:26:08.800250] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T21:26:09.054413] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-30T21:26:09.106048] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T21:26:09.854416] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-30T21:26:10.284079] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T21:26:10.654382] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-30T21:26:10.692613] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T21:26:11.454383] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-30T21:26:11.710371] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T21:26:12.240118] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T21:26:12.254345] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-30T21:26:13.054347] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-30T21:26:13.134729] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T21:26:13.854391] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-30T21:26:14.417129] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T21:26:14.654416] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-30T21:26:15.438585] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T21:26:15.454308] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-30T21:26:16.254370] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-30T21:26:16.431453] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T21:26:16.874403] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T21:26:17.054408] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-30T21:26:17.100203] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T21:26:17.854329] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-30T21:26:18.232449] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:26:18.654411] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-30T21:26:18.674400] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T21:26:19.454365] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-30T21:26:20.254317] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-30T21:26:20.355489] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T21:26:20.833687] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T21:26:21.017104] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:26:21.054375] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-30T21:26:21.805007] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T21:26:21.854367] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-30T21:26:22.654383] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-30T21:26:22.693762] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T21:26:23.454402] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-30T21:26:23.889147] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T21:26:24.254369] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-30T21:26:24.545468] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T21:26:25.054403] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-30T21:26:25.323582] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T21:26:25.854369] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-30T21:26:26.662887] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-30T21:26:26.670826] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:26:27.316939] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T21:26:27.391709] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T21:26:27.454353] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-30T21:26:28.254364] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-30T21:26:28.578389] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T21:26:28.585876] [INFO ] [REMOTE ] TFIN: Full fetch complete (31156 records). [2025-09-30T21:26:28.586086] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-30T21:26:29.004055] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T21:26:29.004451] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-30T21:26:29.004582] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-30T21:26:29.005390] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-30T21:26:29.009244] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-30T21:26:29.009491] [INFO ] [REMOTE ] TG: Full fetch complete (15137 records). [2025-09-30T21:26:29.010034] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-30T21:26:29.035600] [DEBUG] [LOCAL ] TFIN: Trimmed 31156 records to 23505 (keeping 200 days of data) [2025-09-30T21:26:29.059478] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-30T21:26:29.564259] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-30T21:26:29.564987] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-30T21:26:29.565693] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-30T21:26:29.565773] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-30T21:26:29.570302] [DEBUG] [LOCAL ] TG: Trimmed 15137 records to 10417 (keeping 200 days of data) [2025-09-30T21:26:29.652594] [DEBUG] [LOCAL ] TG: Primary data saved (10417 records). [2025-09-30T21:26:29.653421] [INFO ] [MAIN ] TG: Full history saved. [2025-09-30T21:26:29.653313] [DEBUG] [LOCAL ] TFIN: Primary data saved (23505 records). [2025-09-30T21:26:29.653784] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TG took 23.7s. Estimated remaining: 37m 52s. Rate: 7.8 symbols/min [2025-09-30T21:26:29.653904] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-30T21:26:29.654375] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFIN took 29.5s. Estimated remaining: 37m 43s. Rate: 7.8 symbols/min [2025-09-30T21:26:29.838934] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:29.839112] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-30T21:26:29.839153] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-30T21:26:29.839291] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-30T21:26:29.839358] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-30T21:26:29.839443] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-30T21:26:29.839577] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-30T21:26:29.872469] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-30T21:26:30.211853] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:30.654423] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-30T21:26:30.738893] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:26:30.869408] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:26:30.869769] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-30T21:26:30.869872] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:26:30.869943] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-30T21:26:30.870006] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:26:30.870080] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-30T21:26:30.870147] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-30T21:26:30.870184] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-30T21:26:30.870241] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-30T21:26:30.870311] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TGE took 1.2s. Estimated remaining: 37m 34s. Rate: 7.8 symbols/min [2025-09-30T21:26:31.259091] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T21:26:31.454401] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-30T21:26:32.254383] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-30T21:26:33.035839] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T21:26:33.046013] [INFO ] [REMOTE ] TFPM: Full fetch complete (50973 records). [2025-09-30T21:26:33.046203] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-30T21:26:33.455548] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-30T21:26:33.455709] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-30T21:26:33.456805] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-30T21:26:33.456929] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-30T21:26:33.458334] [DEBUG] [LOCAL ] TFPM: Trimmed 50973 records to 37785 (keeping 200 days of data) [2025-09-30T21:26:33.714221] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:26:33.725466] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-30T21:26:33.754213] [DEBUG] [LOCAL ] TFPM: Primary data saved (37785 records). [2025-09-30T21:26:33.754393] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-30T21:26:33.754544] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFPM took 33.4s. Estimated remaining: 37m 26s. Rate: 7.8 symbols/min [2025-09-30T21:26:35.218102] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T21:26:35.226109] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-30T21:26:36.449939] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T21:26:36.461481] [INFO ] [REMOTE ] TFX: Full fetch complete (54459 records). [2025-09-30T21:26:36.461715] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-30T21:26:36.894108] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-30T21:26:36.894191] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-30T21:26:36.895208] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-30T21:26:36.895276] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-30T21:26:36.896498] [DEBUG] [LOCAL ] TFX: Trimmed 54459 records to 37113 (keeping 200 days of data) [2025-09-30T21:26:37.141202] [DEBUG] [LOCAL ] TFX: Primary data saved (37113 records). [2025-09-30T21:26:37.141344] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-30T21:26:37.141462] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 34.5s. Estimated remaining: 37m 18s. Rate: 7.8 symbols/min [2025-09-30T21:26:37.866950] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:37.881323] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:37.917429] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:37.948952] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:26:37.984520] [DEBUG] [LOCAL ] TGS: Loaded 32648 existing records from primary storage. [2025-09-30T21:26:37.984874] [INFO ] [MAIN ] TGS: Loaded 32648 existing records. [2025-09-30T21:26:38.094835] [DEBUG] [LOCAL ] TGLS: Loaded 28129 existing records from primary storage. [2025-09-30T21:26:38.154017] [INFO ] [MAIN ] TGLS: Loaded 28129 existing records. [2025-09-30T21:26:38.217495] [DEBUG] [LOCAL ] TGNA: Loaded 48677 existing records from primary storage. [2025-09-30T21:26:38.259249] [INFO ] [MAIN ] TGNA: Loaded 48677 existing records. [2025-09-30T21:26:38.404163] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-30T21:26:38.453326] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-30T21:26:38.415760] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:38.459940] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-30T21:26:38.465276] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-30T21:26:38.549516] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-30T21:26:38.659480] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-30T21:26:38.771328] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:38.781949] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-30T21:26:38.808447] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-30T21:26:38.927036] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-30T21:26:39.098410] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:39.104928] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-30T21:26:39.109732] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:26:39.009501] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-30T21:26:39.114571] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-30T21:26:39.115077] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-30T21:26:39.137668] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-30T21:26:39.153341] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-30T21:26:39.174316] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-30T21:26:39.174212] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-30T21:26:39.261355] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-30T21:26:40.175960] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:40.258574] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-30T21:26:40.545575] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:40.600039] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-30T21:26:40.683915] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:40.690011] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:26:40.690316] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-30T21:26:40.690673] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-30T21:26:41.759989] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T21:26:41.766722] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-30T21:26:41.920190] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:26:41.925673] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-30T21:26:41.994574] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T21:26:42.005390] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-30T21:26:42.574777] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:26:42.587046] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-30T21:26:43.160867] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T21:26:43.170318] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-30T21:26:43.232868] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T21:26:43.239579] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-30T21:26:43.322229] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T21:26:43.332154] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-30T21:26:44.089267] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T21:26:44.095118] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-30T21:26:44.566834] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T21:26:44.575057] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-30T21:26:44.712909] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-30T21:26:44.788294] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:26:45.053378] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:26:45.060318] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-30T21:26:45.854333] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-30T21:26:45.946185] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T21:26:46.654345] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-30T21:26:46.800052] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:26:47.454372] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-30T21:26:47.527686] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T21:26:48.003721] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T21:26:48.254358] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-30T21:26:48.893700] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T21:26:49.054370] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-30T21:26:49.854363] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-30T21:26:50.657828] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-30T21:26:50.661930] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-30T21:26:50.735011] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T21:26:50.789271] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T21:26:51.454356] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-30T21:26:51.637426] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T21:26:52.254350] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-30T21:26:53.054371] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-30T21:26:53.537851] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-30T21:26:53.830003] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:26:53.854335] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-30T21:26:54.414457] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T21:26:54.654366] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-30T21:26:55.454323] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-30T21:26:55.487370] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T21:26:55.554249] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T21:26:56.254396] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-30T21:26:57.054323] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-30T21:26:57.449638] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T21:26:57.854332] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-30T21:26:57.940312] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-30T21:26:58.654364] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-30T21:26:58.806784] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T21:26:59.177515] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:26:59.454367] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-30T21:26:59.972260] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T21:27:00.254370] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-30T21:27:01.054329] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-30T21:27:01.379932] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T21:27:01.411462] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T21:27:01.410406] [INFO ] [REMOTE ] TGNA: Full fetch complete (69969 records). [2025-09-30T21:27:01.418624] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-30T21:27:01.849461] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-30T21:27:01.849632] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-30T21:27:01.850719] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-30T21:27:01.850803] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-30T21:27:01.852754] [DEBUG] [LOCAL ] TGNA: Trimmed 69969 records to 48665 (keeping 200 days of data) [2025-09-30T21:27:01.854403] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-30T21:27:02.173672] [DEBUG] [LOCAL ] TGNA: Primary data saved (48665 records). [2025-09-30T21:27:02.173822] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-30T21:27:02.173908] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGNA took 25.0s. Estimated remaining: 37m 12s. Rate: 7.8 symbols/min [2025-09-30T21:27:02.362959] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:02.427058] [DEBUG] [LOCAL ] THC: Loaded 47803 existing records from primary storage. [2025-09-30T21:27:02.427574] [INFO ] [MAIN ] THC: Loaded 47803 existing records. [2025-09-30T21:27:02.628029] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:02.628331] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-30T21:27:02.628390] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-30T21:27:02.629358] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-30T21:27:02.629420] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-30T21:27:02.666219] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-30T21:27:03.068095] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:03.090260] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T21:27:03.144142] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T21:27:03.454375] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-30T21:27:04.040690] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T21:27:04.046953] [INFO ] [REMOTE ] TGLS: Full fetch complete (40498 records). [2025-09-30T21:27:04.047094] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-30T21:27:04.259571] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-30T21:27:04.490191] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-30T21:27:04.490393] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-30T21:27:04.491338] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-30T21:27:04.491437] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-30T21:27:04.492589] [DEBUG] [LOCAL ] TGLS: Trimmed 40498 records to 28070 (keeping 200 days of data) [2025-09-30T21:27:04.644759] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T21:27:04.656738] [INFO ] [REMOTE ] TGS: Full fetch complete (47829 records). [2025-09-30T21:27:04.657413] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-30T21:27:05.055758] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-30T21:27:05.137610] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-30T21:27:05.138615] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-30T21:27:05.140963] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-30T21:27:05.141526] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-30T21:27:05.146738] [DEBUG] [LOCAL ] TGS: Trimmed 47829 records to 32763 (keeping 200 days of data) [2025-09-30T21:27:05.210913] [DEBUG] [LOCAL ] TGLS: Primary data saved (28070 records). [2025-09-30T21:27:05.239370] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-30T21:27:05.245245] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGLS took 28.1s. Estimated remaining: 37m 4s. Rate: 7.8 symbols/min [2025-09-30T21:27:05.457423] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:05.545978] [DEBUG] [LOCAL ] THG: Loaded 21717 existing records from primary storage. [2025-09-30T21:27:05.547152] [INFO ] [MAIN ] THG: Loaded 21717 existing records. [2025-09-30T21:27:05.750216] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:05.751445] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-30T21:27:05.751862] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-30T21:27:05.755012] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-30T21:27:05.755787] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-30T21:27:05.757893] [DEBUG] [LOCAL ] TGS: Primary data saved (32763 records). [2025-09-30T21:27:05.758099] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-30T21:27:05.793365] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGS took 28.6s. Estimated remaining: 36m 55s. Rate: 7.8 symbols/min [2025-09-30T21:27:06.219686] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:06.327952] [DEBUG] [LOCAL ] THIR: Loaded 2188 existing records from primary storage. [2025-09-30T21:27:06.346463] [INFO ] [MAIN ] THIR: Loaded 2188 existing records. [2025-09-30T21:27:06.374723] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:06.433588] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-30T21:27:06.574319] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:06.574559] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-30T21:27:06.574627] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-30T21:27:06.574903] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-30T21:27:06.574966] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-30T21:27:06.994929] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T21:27:07.053030] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-30T21:27:07.097355] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:07.100133] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-30T21:27:07.373374] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:27:07.454369] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-30T21:27:08.254336] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-30T21:27:08.729187] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T21:27:09.054345] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-30T21:27:09.304792] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T21:27:09.656831] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T21:27:09.854357] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-30T21:27:10.659078] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-30T21:27:10.670232] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T21:27:11.081225] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T21:27:11.454365] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-30T21:27:12.254345] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-30T21:27:12.347311] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-30T21:27:12.358845] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-30T21:27:12.359000] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-30T21:27:12.792870] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-30T21:27:12.793060] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-30T21:27:12.794360] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-30T21:27:12.794514] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-30T21:27:12.821153] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T21:27:12.819751] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-09-30T21:27:13.060428] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-30T21:27:13.200742] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-30T21:27:13.200878] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-30T21:27:13.200960] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 36.0s. Estimated remaining: 36m 48s. Rate: 7.8 symbols/min [2025-09-30T21:27:13.376346] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:13.381314] [DEBUG] [LOCAL ] THLV: Loaded 1564 existing records from primary storage. [2025-09-30T21:27:13.381485] [INFO ] [MAIN ] THLV: Loaded 1564 existing records. [2025-09-30T21:27:13.568537] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:13.568780] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-30T21:27:13.568832] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-30T21:27:13.569207] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-30T21:27:13.569269] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-30T21:27:13.869854] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-30T21:27:13.965313] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:14.108343] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T21:27:14.197003] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T21:27:14.269739] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-30T21:27:14.654403] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-30T21:27:14.985602] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T21:27:15.454405] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-30T21:27:16.254386] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-30T21:27:16.605294] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T21:27:17.054446] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-30T21:27:17.088982] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:27:17.522958] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T21:27:17.854359] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-30T21:27:18.290519] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T21:27:18.654359] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-30T21:27:19.098083] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T21:27:19.454380] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-30T21:27:20.254392] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-30T21:27:20.743901] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T21:27:21.054375] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-30T21:27:21.230713] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:27:21.854361] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-30T21:27:22.063826] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T21:27:22.654362] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-30T21:27:23.010792] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-30T21:27:23.271204] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T21:27:23.454398] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-30T21:27:24.001219] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T21:27:24.254384] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-30T21:27:24.587361] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T21:27:25.054391] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-30T21:27:25.854399] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-30T21:27:26.287358] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T21:27:26.654330] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-30T21:27:26.734975] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:27:26.939506] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-30T21:27:27.454377] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-30T21:27:27.997240] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T21:27:28.254379] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-30T21:27:28.659997] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T21:27:28.661499] [INFO ] [REMOTE ] THIR: Full fetch complete (2722 records). [2025-09-30T21:27:28.661581] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-30T21:27:29.062505] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-30T21:27:29.070553] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-30T21:27:29.070639] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-30T21:27:29.070800] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-30T21:27:29.070846] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-30T21:27:29.071210] [DEBUG] [LOCAL ] THIR: Trimmed 2722 records to 2194 (keeping 200 days of data) [2025-09-30T21:27:29.085319] [DEBUG] [LOCAL ] THIR: Primary data saved (2194 records). [2025-09-30T21:27:29.085416] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-30T21:27:29.085498] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 23.2s. Estimated remaining: 36m 41s. Rate: 7.8 symbols/min [2025-09-30T21:27:29.263861] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:29.321383] [DEBUG] [LOCAL ] THO: Loaded 42119 existing records from primary storage. [2025-09-30T21:27:29.321718] [INFO ] [MAIN ] THO: Loaded 42119 existing records. [2025-09-30T21:27:29.515134] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:29.515378] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-30T21:27:29.515447] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-30T21:27:29.515940] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-30T21:27:29.516000] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-30T21:27:29.861351] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-30T21:27:29.903955] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:30.665352] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-30T21:27:30.670928] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T21:27:30.733082] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T21:27:31.115046] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T21:27:31.454360] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-30T21:27:32.254331] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-30T21:27:32.487921] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T21:27:33.054373] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-30T21:27:33.854343] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-30T21:27:33.882114] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:27:34.638370] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T21:27:34.648398] [INFO ] [REMOTE ] THC: Full fetch complete (69307 records). [2025-09-30T21:27:34.648551] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-30T21:27:34.661290] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-30T21:27:34.992963] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T21:27:35.113230] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-30T21:27:35.113302] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-30T21:27:35.114311] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-30T21:27:35.114376] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-30T21:27:35.115774] [DEBUG] [LOCAL ] THC: Trimmed 69307 records to 47711 (keeping 200 days of data) [2025-09-30T21:27:35.426955] [DEBUG] [LOCAL ] THC: Primary data saved (47711 records). [2025-09-30T21:27:35.427091] [INFO ] [MAIN ] THC: Full history saved. [2025-09-30T21:27:35.427175] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THC took 33.3s. Estimated remaining: 36m 33s. Rate: 7.8 symbols/min [2025-09-30T21:27:35.459450] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-30T21:27:35.610856] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:35.640334] [DEBUG] [LOCAL ] THQ: Loaded 24768 existing records from primary storage. [2025-09-30T21:27:35.640618] [INFO ] [MAIN ] THQ: Loaded 24768 existing records. [2025-09-30T21:27:35.831498] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:35.831948] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-30T21:27:35.832114] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-30T21:27:35.832625] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-30T21:27:35.832726] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-30T21:27:36.208458] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:27:36.253873] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:36.254309] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-30T21:27:36.598256] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T21:27:37.022843] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T21:27:37.054321] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-30T21:27:37.854358] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-30T21:27:38.333451] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T21:27:38.654373] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-30T21:27:39.373366] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T21:27:39.454386] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-30T21:27:39.654158] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T21:27:39.848486] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T21:27:40.254365] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-30T21:27:41.054356] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-30T21:27:41.706770] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T21:27:41.854383] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-30T21:27:42.113245] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T21:27:42.117728] [INFO ] [REMOTE ] THG: Full fetch complete (31103 records). [2025-09-30T21:27:42.117829] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-30T21:27:42.509748] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-30T21:27:42.509876] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-30T21:27:42.511229] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-30T21:27:42.511299] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-30T21:27:42.512546] [DEBUG] [LOCAL ] THG: Trimmed 31103 records to 21678 (keeping 200 days of data) [2025-09-30T21:27:42.649626] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T21:27:42.656935] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-30T21:27:42.697666] [DEBUG] [LOCAL ] THG: Primary data saved (21678 records). [2025-09-30T21:27:42.697881] [INFO ] [MAIN ] THG: Full history saved. [2025-09-30T21:27:42.698029] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 37.5s. Estimated remaining: 36m 25s. Rate: 7.8 symbols/min [2025-09-30T21:27:42.868528] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:42.893839] [DEBUG] [LOCAL ] THR: Loaded 19815 existing records from primary storage. [2025-09-30T21:27:42.894182] [INFO ] [MAIN ] THR: Loaded 19815 existing records. [2025-09-30T21:27:43.078142] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:43.078411] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-30T21:27:43.078472] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-30T21:27:43.078866] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-30T21:27:43.078927] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-30T21:27:43.459535] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-30T21:27:43.560141] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:43.844510] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T21:27:44.254381] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-30T21:27:44.345555] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T21:27:45.054367] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-30T21:27:45.394793] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T21:27:45.678696] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T21:27:45.854386] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-30T21:27:46.654356] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-30T21:27:47.162987] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T21:27:47.454364] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-30T21:27:47.858690] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T21:27:47.881872] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-30T21:27:47.882883] [INFO ] [REMOTE ] THLV: Full fetch complete (2632 records). [2025-09-30T21:27:47.882961] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-30T21:27:48.259531] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-30T21:27:48.308478] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-30T21:27:48.308567] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-30T21:27:48.308735] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-30T21:27:48.308800] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-30T21:27:48.309271] [DEBUG] [LOCAL ] THLV: Trimmed 2632 records to 1546 (keeping 200 days of data) [2025-09-30T21:27:48.320322] [DEBUG] [LOCAL ] THLV: Primary data saved (1546 records). [2025-09-30T21:27:48.320451] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-30T21:27:48.320539] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THLV took 35.1s. Estimated remaining: 36m 17s. Rate: 7.8 symbols/min [2025-09-30T21:27:48.588556] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:27:48.650512] [DEBUG] [LOCAL ] THS: Loaded 38036 existing records from primary storage. [2025-09-30T21:27:48.651084] [INFO ] [MAIN ] THS: Loaded 38036 existing records. [2025-09-30T21:27:48.941960] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:27:48.942306] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-30T21:27:48.942370] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-30T21:27:48.942789] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-30T21:27:48.942868] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-30T21:27:49.059572] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-30T21:27:49.431574] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T21:27:49.435923] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:27:49.854337] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-30T21:27:50.129903] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T21:27:50.654371] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-30T21:27:50.900694] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T21:27:51.454400] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-30T21:27:52.017763] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T21:27:52.254371] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-30T21:27:52.826578] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T21:27:53.054367] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-30T21:27:53.664248] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T21:27:53.854383] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-30T21:27:54.277367] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T21:27:54.654375] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-30T21:27:54.949165] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T21:27:55.454372] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-30T21:27:55.794396] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T21:27:56.254354] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-30T21:27:57.054375] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-30T21:27:57.109506] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T21:27:57.280878] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T21:27:57.854363] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-30T21:27:58.654369] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-30T21:27:59.454342] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-30T21:27:59.484523] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T21:27:59.494248] [INFO ] [REMOTE ] THO: Full fetch complete (60173 records). [2025-09-30T21:27:59.494437] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-30T21:27:59.716903] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T21:27:59.940160] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-30T21:27:59.955064] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-30T21:27:59.957920] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (2.90 seconds). [2025-09-30T21:27:59.956780] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-30T21:27:59.965503] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-30T21:27:59.967481] [DEBUG] [LOCAL ] THO: Trimmed 60173 records to 42038 (keeping 200 days of data) [2025-09-30T21:28:00.248480] [DEBUG] [LOCAL ] THO: Primary data saved (42038 records). [2025-09-30T21:28:00.248628] [INFO ] [MAIN ] THO: Full history saved. [2025-09-30T21:28:00.248749] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THO took 31.2s. Estimated remaining: 36m 10s. Rate: 7.8 symbols/min [2025-09-30T21:28:00.260145] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-30T21:28:00.435263] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:00.457751] [DEBUG] [LOCAL ] THW: Loaded 19211 existing records from primary storage. [2025-09-30T21:28:00.458068] [INFO ] [MAIN ] THW: Loaded 19211 existing records. [2025-09-30T21:28:00.653969] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:00.654183] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-30T21:28:00.654244] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-30T21:28:00.654689] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-30T21:28:00.654778] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-30T21:28:01.040842] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:01.063988] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-30T21:28:01.066527] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T21:28:01.076249] [INFO ] [REMOTE ] THQ: Full fetch complete (35096 records). [2025-09-30T21:28:01.076428] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-30T21:28:01.603396] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-30T21:28:01.603572] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-30T21:28:01.604608] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-30T21:28:01.604727] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-30T21:28:01.606066] [DEBUG] [LOCAL ] THQ: Trimmed 35096 records to 24858 (keeping 200 days of data) [2025-09-30T21:28:01.721679] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:28:01.800421] [DEBUG] [LOCAL ] THQ: Primary data saved (24858 records). [2025-09-30T21:28:01.800600] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-30T21:28:01.800729] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THQ took 26.4s. Estimated remaining: 36m 2s. Rate: 7.8 symbols/min [2025-09-30T21:28:01.859746] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-30T21:28:02.005383] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:02.005552] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-30T21:28:02.005592] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-30T21:28:02.005731] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-30T21:28:02.005799] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-30T21:28:02.005880] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-30T21:28:02.005969] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-30T21:28:02.404454] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:02.606818] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:28:02.654413] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-30T21:28:02.863755] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:28:02.864090] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-30T21:28:02.864210] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:28:02.864321] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-30T21:28:02.864404] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:28:02.864479] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-30T21:28:02.864545] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-30T21:28:02.864582] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-30T21:28:02.864625] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-30T21:28:02.864714] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. TIC took 1.1s. Estimated remaining: 35m 53s. Rate: 7.8 symbols/min [2025-09-30T21:28:03.051168] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:03.066059] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T21:28:03.106681] [DEBUG] [LOCAL ] TIMB: Loaded 36222 existing records from primary storage. [2025-09-30T21:28:03.107006] [INFO ] [MAIN ] TIMB: Loaded 36222 existing records. [2025-09-30T21:28:03.289893] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:03.290100] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-30T21:28:03.290148] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-30T21:28:03.290513] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-30T21:28:03.290571] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-30T21:28:03.457883] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-30T21:28:03.687028] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:04.254374] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-30T21:28:05.013453] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T21:28:05.054399] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-30T21:28:05.530855] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T21:28:05.854332] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-30T21:28:06.083584] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T21:28:06.654355] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-30T21:28:07.036519] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:28:07.454371] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-30T21:28:08.254340] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-30T21:28:08.496124] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T21:28:08.917927] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T21:28:09.054401] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-30T21:28:09.270603] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T21:28:09.854370] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-30T21:28:10.547059] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T21:28:10.654367] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-30T21:28:11.185165] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T21:28:11.454404] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-30T21:28:11.925133] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T21:28:12.254337] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-30T21:28:12.288083] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T21:28:13.054340] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-30T21:28:13.493058] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T21:28:13.854365] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-30T21:28:14.580398] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T21:28:14.654337] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-30T21:28:15.304788] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T21:28:15.454375] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-30T21:28:16.090181] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T21:28:16.254379] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-30T21:28:16.337736] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T21:28:17.054373] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-30T21:28:17.425369] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T21:28:17.431596] [INFO ] [REMOTE ] THR: Full fetch complete (28861 records). [2025-09-30T21:28:17.431770] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-30T21:28:17.840079] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-30T21:28:17.840282] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-30T21:28:17.841018] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-30T21:28:17.841084] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-30T21:28:17.841877] [DEBUG] [LOCAL ] THR: Trimmed 28861 records to 19835 (keeping 200 days of data) [2025-09-30T21:28:17.891942] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-30T21:28:17.965902] [DEBUG] [LOCAL ] THR: Primary data saved (19835 records). [2025-09-30T21:28:17.966064] [INFO ] [MAIN ] THR: Full history saved. [2025-09-30T21:28:17.966153] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THR took 35.3s. Estimated remaining: 35m 46s. Rate: 7.8 symbols/min [2025-09-30T21:28:18.159628] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:18.160357] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T21:28:18.170188] [DEBUG] [LOCAL ] TISI: Loaded 3729 existing records from primary storage. [2025-09-30T21:28:18.170406] [INFO ] [MAIN ] TISI: Loaded 3729 existing records. [2025-09-30T21:28:18.360880] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:18.361129] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-30T21:28:18.361179] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-30T21:28:18.361395] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-30T21:28:18.361459] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-30T21:28:18.660563] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-30T21:28:18.829520] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:19.365364] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:28:19.454359] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-30T21:28:19.501917] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T21:28:20.254373] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-30T21:28:20.884235] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T21:28:21.054955] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-30T21:28:21.054880] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:28:21.854341] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-30T21:28:22.141491] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T21:28:22.654381] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-30T21:28:23.159972] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T21:28:23.331311] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T21:28:23.340718] [INFO ] [REMOTE ] THS: Full fetch complete (53915 records). [2025-09-30T21:28:23.340867] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-30T21:28:23.454370] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-30T21:28:23.757348] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-30T21:28:23.757467] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-30T21:28:23.758446] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-30T21:28:23.758511] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-30T21:28:23.759934] [DEBUG] [LOCAL ] THS: Trimmed 53915 records to 38125 (keeping 200 days of data) [2025-09-30T21:28:23.989463] [DEBUG] [LOCAL ] THS: Primary data saved (38125 records). [2025-09-30T21:28:23.989669] [INFO ] [MAIN ] THS: Full history saved. [2025-09-30T21:28:23.989778] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 35.7s. Estimated remaining: 35m 39s. Rate: 7.8 symbols/min [2025-09-30T21:28:24.177235] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:24.209076] [DEBUG] [LOCAL ] TIXT: Loaded 31355 existing records from primary storage. [2025-09-30T21:28:24.209456] [INFO ] [MAIN ] TIXT: Loaded 31355 existing records. [2025-09-30T21:28:24.265012] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-30T21:28:24.402880] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:24.403095] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-30T21:28:24.403144] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-30T21:28:24.403851] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-30T21:28:24.403912] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-30T21:28:24.780778] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:25.054377] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-30T21:28:25.061680] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T21:28:25.088277] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T21:28:25.854346] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-30T21:28:26.149393] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T21:28:26.654383] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-30T21:28:26.996488] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T21:28:27.183309] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T21:28:27.454385] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-30T21:28:28.254360] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-30T21:28:28.614506] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T21:28:29.054328] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-30T21:28:29.619475] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T21:28:29.626373] [INFO ] [REMOTE ] TIMB: Full fetch complete (54365 records). [2025-09-30T21:28:29.626501] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-30T21:28:29.860705] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-30T21:28:30.045607] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-30T21:28:30.045886] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-30T21:28:30.046842] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-30T21:28:30.047058] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-30T21:28:30.048468] [DEBUG] [LOCAL ] TIMB: Trimmed 54365 records to 36151 (keeping 200 days of data) [2025-09-30T21:28:30.303264] [DEBUG] [LOCAL ] TIMB: Primary data saved (36151 records). [2025-09-30T21:28:30.304149] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-30T21:28:30.305030] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TIMB took 27.4s. Estimated remaining: 35m 31s. Rate: 7.8 symbols/min [2025-09-30T21:28:30.304880] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T21:28:30.490709] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:30.548877] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-09-30T21:28:30.549308] [INFO ] [MAIN ] TJX: Loaded 53669 existing records. [2025-09-30T21:28:30.659450] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-30T21:28:30.716157] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T21:28:30.764150] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:30.764422] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-30T21:28:30.764511] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-30T21:28:30.765433] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-30T21:28:30.765496] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-30T21:28:31.146939] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:31.454400] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-30T21:28:31.717217] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T21:28:32.254362] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-30T21:28:32.772781] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T21:28:33.013382] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T21:28:33.018385] [INFO ] [REMOTE ] THW: Full fetch complete (29517 records). [2025-09-30T21:28:33.018546] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-30T21:28:33.059524] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-30T21:28:33.420723] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-30T21:28:33.420817] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-30T21:28:33.421450] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-30T21:28:33.421511] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-30T21:28:33.422302] [DEBUG] [LOCAL ] THW: Trimmed 29517 records to 19361 (keeping 200 days of data) [2025-09-30T21:28:33.553436] [DEBUG] [LOCAL ] THW: Primary data saved (19361 records). [2025-09-30T21:28:33.553592] [INFO ] [MAIN ] THW: Full history saved. [2025-09-30T21:28:33.553710] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. THW took 33.3s. Estimated remaining: 35m 22s. Rate: 7.8 symbols/min [2025-09-30T21:28:33.733809] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:33.775284] [DEBUG] [LOCAL ] TK: Loaded 39550 existing records from primary storage. [2025-09-30T21:28:33.775698] [INFO ] [MAIN ] TK: Loaded 39550 existing records. [2025-09-30T21:28:33.860314] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-30T21:28:33.985902] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:33.986453] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-30T21:28:33.986526] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-30T21:28:33.986946] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-30T21:28:33.987006] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-30T21:28:34.407036] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:34.654351] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-30T21:28:35.153375] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T21:28:35.301697] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:28:35.454332] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-30T21:28:36.166025] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:28:36.254388] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-30T21:28:36.327626] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T21:28:37.054420] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-30T21:28:37.798033] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T21:28:37.854375] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-30T21:28:38.270612] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T21:28:38.654419] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-30T21:28:39.291771] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T21:28:39.454349] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-30T21:28:39.683021] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T21:28:40.254406] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-30T21:28:40.603457] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T21:28:40.884177] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T21:28:41.054362] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-30T21:28:41.854414] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-30T21:28:42.099609] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T21:28:42.143750] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-30T21:28:42.654377] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-30T21:28:43.454387] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-30T21:28:44.003626] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T21:28:44.254383] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-30T21:28:44.554310] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-30T21:28:44.687963] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T21:28:45.054356] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-30T21:28:45.531928] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T21:28:45.532980] [INFO ] [REMOTE ] TISI: Full fetch complete (4878 records). [2025-09-30T21:28:45.533090] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-30T21:28:45.859495] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-30T21:28:45.942873] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-30T21:28:45.942981] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-30T21:28:45.943208] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-30T21:28:45.943281] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-30T21:28:45.944348] [DEBUG] [LOCAL ] TISI: Trimmed 4878 records to 3714 (keeping 200 days of data) [2025-09-30T21:28:45.968112] [DEBUG] [LOCAL ] TISI: Primary data saved (3714 records). [2025-09-30T21:28:45.968275] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-30T21:28:45.968426] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TISI took 28.0s. Estimated remaining: 35m 15s. Rate: 7.8 symbols/min [2025-09-30T21:28:46.161434] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:46.220750] [DEBUG] [LOCAL ] TKC: Loaded 38704 existing records from primary storage. [2025-09-30T21:28:46.221074] [INFO ] [MAIN ] TKC: Loaded 38704 existing records. [2025-09-30T21:28:46.418904] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:46.419161] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-30T21:28:46.419211] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-30T21:28:46.420103] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-30T21:28:46.420187] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-30T21:28:46.659466] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-30T21:28:46.827775] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:47.454390] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-30T21:28:48.254334] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-30T21:28:48.311740] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T21:28:48.513729] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-30T21:28:48.600090] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T21:28:49.054371] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-30T21:28:49.661540] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T21:28:49.854351] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-30T21:28:50.654343] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-30T21:28:51.077075] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T21:28:51.108782] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T21:28:51.454362] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-30T21:28:51.984739] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T21:28:52.254394] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-30T21:28:53.054358] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-30T21:28:53.484411] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T21:28:53.737852] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T21:28:53.747324] [INFO ] [REMOTE ] TIXT: Full fetch complete (45742 records). [2025-09-30T21:28:53.747510] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-30T21:28:53.856597] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-30T21:28:54.134475] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:28:54.234213] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-30T21:28:54.234344] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-30T21:28:54.235716] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-30T21:28:54.235791] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-30T21:28:54.237263] [DEBUG] [LOCAL ] TIXT: Trimmed 45742 records to 31376 (keeping 200 days of data) [2025-09-30T21:28:54.429932] [DEBUG] [LOCAL ] TIXT: Primary data saved (31376 records). [2025-09-30T21:28:54.430161] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-30T21:28:54.430306] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIXT took 30.4s. Estimated remaining: 35m 8s. Rate: 7.8 symbols/min [2025-09-30T21:28:54.623921] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:28:54.654361] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-30T21:28:54.674473] [DEBUG] [LOCAL ] TKO: Loaded 44049 existing records from primary storage. [2025-09-30T21:28:54.674846] [INFO ] [MAIN ] TKO: Loaded 44049 existing records. [2025-09-30T21:28:54.860897] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:28:54.861170] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-30T21:28:54.861332] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-30T21:28:54.862552] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-30T21:28:54.862617] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-30T21:28:55.247077] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:28:55.373540] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T21:28:55.454361] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-30T21:28:56.254344] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-30T21:28:56.635401] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T21:28:57.018125] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T21:28:57.054349] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-30T21:28:57.517012] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T21:28:57.854402] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-30T21:28:58.572056] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T21:28:58.654358] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-30T21:28:59.454340] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-30T21:28:59.828893] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T21:29:00.254368] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-30T21:29:00.357625] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T21:29:01.054374] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-30T21:29:01.585388] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T21:29:01.854346] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-30T21:29:02.102350] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T21:29:02.304566] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T21:29:02.654411] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-30T21:29:03.342412] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T21:29:03.454404] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-30T21:29:04.116282] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:29:04.254385] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-30T21:29:04.940995] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T21:29:05.054405] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-30T21:29:05.216249] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T21:29:05.224004] [INFO ] [REMOTE ] TK: Full fetch complete (56573 records). [2025-09-30T21:29:05.224123] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-30T21:29:05.646928] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-30T21:29:05.647045] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-30T21:29:05.648324] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-30T21:29:05.648403] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-30T21:29:05.649840] [DEBUG] [LOCAL ] TK: Trimmed 56573 records to 39498 (keeping 200 days of data) [2025-09-30T21:29:05.871338] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-30T21:29:05.913850] [DEBUG] [LOCAL ] TK: Primary data saved (39498 records). [2025-09-30T21:29:05.914057] [INFO ] [MAIN ] TK: Full history saved. [2025-09-30T21:29:05.914162] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 32.4s. Estimated remaining: 35m 1s. Rate: 7.8 symbols/min [2025-09-30T21:29:06.132543] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:06.175082] [DEBUG] [LOCAL ] TKR: Loaded 40096 existing records from primary storage. [2025-09-30T21:29:06.175395] [INFO ] [MAIN ] TKR: Loaded 40096 existing records. [2025-09-30T21:29:06.377586] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:06.377808] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-30T21:29:06.377858] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-30T21:29:06.378920] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-30T21:29:06.378982] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-30T21:29:06.659365] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-30T21:29:06.805842] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:06.941588] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:29:07.454397] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-30T21:29:08.094956] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T21:29:08.259987] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-30T21:29:08.265359] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T21:29:08.500055] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T21:29:09.054370] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-30T21:29:09.854326] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-30T21:29:10.654339] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-30T21:29:10.801899] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T21:29:11.003073] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T21:29:11.456119] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-30T21:29:11.459318] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (3.20 seconds). [2025-09-30T21:29:11.471409] [INFO ] [REMOTE ] TJX: Full fetch complete (77678 records). [2025-09-30T21:29:11.471574] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-30T21:29:11.916048] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-30T21:29:11.916161] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-30T21:29:11.917399] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-30T21:29:11.917606] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-30T21:29:11.941987] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T21:29:11.950095] [DEBUG] [LOCAL ] TJX: Trimmed 77678 records to 53669 (keeping 200 days of data) [2025-09-30T21:29:12.259987] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-30T21:29:12.315466] [DEBUG] [LOCAL ] TJX: Primary data saved (53669 records). [2025-09-30T21:29:12.315612] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-30T21:29:12.315774] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 42.0s. Estimated remaining: 34m 53s. Rate: 7.8 symbols/min [2025-09-30T21:29:12.497034] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:12.542791] [DEBUG] [LOCAL ] TLK: Loaded 39177 existing records from primary storage. [2025-09-30T21:29:12.543143] [INFO ] [MAIN ] TLK: Loaded 39177 existing records. [2025-09-30T21:29:12.731297] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:12.731555] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-30T21:29:12.731629] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-30T21:29:12.732450] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-30T21:29:12.732527] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-30T21:29:13.057381] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-30T21:29:13.138558] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:13.175797] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T21:29:13.740949] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:29:13.854416] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-30T21:29:14.620202] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T21:29:14.654326] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-30T21:29:15.327149] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:29:15.454395] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-30T21:29:16.183200] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T21:29:16.254354] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-30T21:29:17.054375] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-30T21:29:17.096396] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:29:17.854403] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-30T21:29:17.931719] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:29:18.215682] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T21:29:18.654401] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-30T21:29:19.434429] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T21:29:19.444479] [INFO ] [REMOTE ] TKC: Full fetch complete (51951 records). [2025-09-30T21:29:19.444696] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-30T21:29:19.459504] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-30T21:29:19.864168] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-30T21:29:19.864303] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-30T21:29:19.865331] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-30T21:29:19.865518] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-30T21:29:19.866771] [DEBUG] [LOCAL ] TKC: Trimmed 51951 records to 38850 (keeping 200 days of data) [2025-09-30T21:29:20.113336] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:29:20.149715] [DEBUG] [LOCAL ] TKC: Primary data saved (38850 records). [2025-09-30T21:29:20.149869] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-30T21:29:20.149957] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 34.2s. Estimated remaining: 34m 45s. Rate: 7.8 symbols/min [2025-09-30T21:29:20.260546] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-30T21:29:20.338092] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:20.356917] [DEBUG] [LOCAL ] TLYS: Loaded 16915 existing records from primary storage. [2025-09-30T21:29:20.357171] [INFO ] [MAIN ] TLYS: Loaded 16915 existing records. [2025-09-30T21:29:20.544294] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:20.544614] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-30T21:29:20.544697] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-30T21:29:20.545127] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-30T21:29:20.545198] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-30T21:29:20.925144] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:20.950516] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:29:21.054359] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-30T21:29:21.854330] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-30T21:29:21.946227] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T21:29:22.448082] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T21:29:22.654369] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-30T21:29:23.076279] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T21:29:23.454404] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-30T21:29:23.554268] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T21:29:24.254387] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-30T21:29:25.025388] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T21:29:25.025007] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:29:25.054326] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-30T21:29:25.854359] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-30T21:29:26.617706] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T21:29:26.653136] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T21:29:26.661288] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-30T21:29:27.454376] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-30T21:29:28.101117] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T21:29:28.254380] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-30T21:29:28.595710] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T21:29:28.811841] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T21:29:29.054405] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-30T21:29:29.854356] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-30T21:29:30.494510] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T21:29:30.520131] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T21:29:30.654344] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-30T21:29:31.454320] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-30T21:29:31.688671] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T21:29:32.254346] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-30T21:29:32.962951] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:29:32.972771] [INFO ] [REMOTE ] TKO: Full fetch complete (64758 records). [2025-09-30T21:29:32.972907] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-30T21:29:33.059444] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-30T21:29:33.408760] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-30T21:29:33.408913] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-30T21:29:33.409932] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-30T21:29:33.409998] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-30T21:29:33.411307] [DEBUG] [LOCAL ] TKO: Trimmed 64758 records to 44052 (keeping 200 days of data) [2025-09-30T21:29:33.707314] [DEBUG] [LOCAL ] TKO: Primary data saved (44052 records). [2025-09-30T21:29:33.707456] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-30T21:29:33.707551] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 39.3s. Estimated remaining: 34m 38s. Rate: 7.8 symbols/min [2025-09-30T21:29:33.836732] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:29:33.858533] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-30T21:29:33.974742] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:34.013553] [DEBUG] [LOCAL ] TM: Loaded 36388 existing records from primary storage. [2025-09-30T21:29:34.013928] [INFO ] [MAIN ] TM: Loaded 36388 existing records. [2025-09-30T21:29:34.214986] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:34.216443] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-30T21:29:34.216509] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-30T21:29:34.218019] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-30T21:29:34.218087] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-30T21:29:34.354038] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T21:29:34.639563] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:34.654332] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-30T21:29:35.455945] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-30T21:29:35.458529] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T21:29:35.750344] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T21:29:36.254358] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-30T21:29:37.061463] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-30T21:29:37.067314] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T21:29:37.077393] [INFO ] [REMOTE ] TKR: Full fetch complete (57755 records). [2025-09-30T21:29:37.077548] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-30T21:29:37.502875] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-30T21:29:37.502961] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-30T21:29:37.503990] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-30T21:29:37.504056] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-30T21:29:37.505422] [DEBUG] [LOCAL ] TKR: Trimmed 57755 records to 40075 (keeping 200 days of data) [2025-09-30T21:29:37.770551] [DEBUG] [LOCAL ] TKR: Primary data saved (40075 records). [2025-09-30T21:29:37.770734] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-30T21:29:37.770850] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 31.9s. Estimated remaining: 34m 30s. Rate: 7.8 symbols/min [2025-09-30T21:29:37.854928] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-30T21:29:37.963208] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:37.993272] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T21:29:38.054909] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-09-30T21:29:38.055292] [INFO ] [MAIN ] TME: Loaded 53194 existing records. [2025-09-30T21:29:38.242354] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:38.242570] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-30T21:29:38.242617] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-30T21:29:38.243961] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-30T21:29:38.244023] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-30T21:29:38.607878] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T21:29:38.646582] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:38.654308] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-30T21:29:38.726901] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T21:29:39.454359] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-30T21:29:39.643168] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T21:29:39.646622] [INFO ] [REMOTE ] TLYS: Full fetch complete (21839 records). [2025-09-30T21:29:39.646731] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-30T21:29:40.038776] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-30T21:29:40.038858] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-30T21:29:40.039377] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-30T21:29:40.039439] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-30T21:29:40.040107] [DEBUG] [LOCAL ] TLYS: Trimmed 21839 records to 16716 (keeping 200 days of data) [2025-09-30T21:29:40.136625] [DEBUG] [LOCAL ] TLYS: Primary data saved (16716 records). [2025-09-30T21:29:40.136797] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-30T21:29:40.136897] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLYS took 20.0s. Estimated remaining: 34m 21s. Rate: 7.8 symbols/min [2025-09-30T21:29:40.259486] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-30T21:29:40.324704] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:40.366096] [DEBUG] [LOCAL ] TMHC: Loaded 45505 existing records from primary storage. [2025-09-30T21:29:40.366433] [INFO ] [MAIN ] TMHC: Loaded 45505 existing records. [2025-09-30T21:29:40.555120] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:40.555356] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-30T21:29:40.555405] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-30T21:29:40.556587] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-30T21:29:40.556678] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-30T21:29:40.923709] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:41.054339] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-30T21:29:41.548511] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T21:29:41.854371] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-30T21:29:41.936901] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T21:29:42.524479] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T21:29:42.532636] [INFO ] [REMOTE ] TLK: Full fetch complete (57299 records). [2025-09-30T21:29:42.532786] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-30T21:29:42.659531] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-30T21:29:42.953332] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-30T21:29:42.953491] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-30T21:29:42.954530] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-30T21:29:42.954692] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-30T21:29:42.956207] [DEBUG] [LOCAL ] TLK: Trimmed 57299 records to 39189 (keeping 200 days of data) [2025-09-30T21:29:43.085584] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:29:43.236470] [DEBUG] [LOCAL ] TLK: Primary data saved (39189 records). [2025-09-30T21:29:43.236612] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-30T21:29:43.236725] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLK took 30.9s. Estimated remaining: 34m 13s. Rate: 7.8 symbols/min [2025-09-30T21:29:43.419626] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:29:43.454385] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-30T21:29:43.476510] [DEBUG] [LOCAL ] TMO: Loaded 52328 existing records from primary storage. [2025-09-30T21:29:43.476884] [INFO ] [MAIN ] TMO: Loaded 52328 existing records. [2025-09-30T21:29:43.666233] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:29:43.666554] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-30T21:29:43.666611] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-30T21:29:43.667801] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-30T21:29:43.667863] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-30T21:29:44.035074] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:29:44.254374] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-30T21:29:44.492946] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T21:29:45.054329] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-30T21:29:45.090889] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T21:29:45.854354] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-30T21:29:46.016059] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T21:29:46.654383] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-30T21:29:46.945461] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T21:29:47.454367] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-30T21:29:47.494504] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:29:48.234355] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T21:29:48.254311] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-30T21:29:49.054364] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-30T21:29:49.396407] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T21:29:49.854436] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-30T21:29:50.031001] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T21:29:50.654348] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-30T21:29:50.702773] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:29:51.425274] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:29:51.454319] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-30T21:29:52.262830] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-30T21:29:52.268356] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:29:53.054356] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-30T21:29:53.367924] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T21:29:53.854337] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-30T21:29:54.140264] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T21:29:54.654349] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-30T21:29:54.725917] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T21:29:55.454356] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-30T21:29:56.194062] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:29:56.254356] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-30T21:29:56.695975] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-30T21:29:57.011161] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:29:57.054322] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-30T21:29:57.854364] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-30T21:29:57.977763] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T21:29:58.216179] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T21:29:58.654358] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-30T21:29:59.454369] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-30T21:29:59.894660] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T21:29:59.942209] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T21:30:00.254410] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-30T21:30:01.054391] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-30T21:30:01.837318] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:30:01.854306] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-30T21:30:01.946362] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-30T21:30:02.654398] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-30T21:30:03.257096] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T21:30:03.454440] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-30T21:30:03.778589] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T21:30:04.254363] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-30T21:30:04.356574] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T21:30:05.054453] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-30T21:30:05.651666] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-30T21:30:05.799507] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T21:30:05.854405] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-30T21:30:06.654348] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-30T21:30:06.833741] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T21:30:07.362464] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:30:07.369575] [INFO ] [REMOTE ] TM: Full fetch complete (52847 records). [2025-09-30T21:30:07.369779] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-30T21:30:07.460719] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-30T21:30:07.843297] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-30T21:30:07.843393] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-30T21:30:07.844449] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-30T21:30:07.844520] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-30T21:30:07.845852] [DEBUG] [LOCAL ] TM: Trimmed 52847 records to 36435 (keeping 200 days of data) [2025-09-30T21:30:08.087348] [DEBUG] [LOCAL ] TM: Primary data saved (36435 records). [2025-09-30T21:30:08.087507] [INFO ] [MAIN ] TM: Full history saved. [2025-09-30T21:30:08.087599] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 34.4s. Estimated remaining: 34m 8s. Rate: 7.8 symbols/min [2025-09-30T21:30:08.270119] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-30T21:30:08.275328] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:08.296294] [DEBUG] [LOCAL ] TNC: Loaded 14964 existing records from primary storage. [2025-09-30T21:30:08.296593] [INFO ] [MAIN ] TNC: Loaded 14964 existing records. [2025-09-30T21:30:08.500080] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:08.500405] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-30T21:30:08.500564] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-30T21:30:08.501201] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-30T21:30:08.501267] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-30T21:30:08.922365] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-30T21:30:08.958998] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:09.054323] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-30T21:30:09.353270] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T21:30:09.363715] [INFO ] [REMOTE ] TMHC: Full fetch complete (65975 records). [2025-09-30T21:30:09.363861] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-30T21:30:09.783438] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-30T21:30:09.783528] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-30T21:30:09.784661] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-30T21:30:09.784731] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-30T21:30:09.786134] [DEBUG] [LOCAL ] TMHC: Trimmed 65975 records to 45443 (keeping 200 days of data) [2025-09-30T21:30:09.872092] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-30T21:30:10.070969] [DEBUG] [LOCAL ] TMHC: Primary data saved (45443 records). [2025-09-30T21:30:10.071201] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-30T21:30:10.071307] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMHC took 29.9s. Estimated remaining: 33m 59s. Rate: 7.8 symbols/min [2025-09-30T21:30:10.273306] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:10.311826] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T21:30:10.326265] [INFO ] [REMOTE ] TME: Full fetch complete (76926 records). [2025-09-30T21:30:10.326447] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-30T21:30:10.521060] [DEBUG] [LOCAL ] TNET: Loaded 28664 existing records from primary storage. [2025-09-30T21:30:10.567101] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:30:10.589877] [INFO ] [MAIN ] TNET: Loaded 28664 existing records. [2025-09-30T21:30:10.669749] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-30T21:30:10.996294] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:11.034152] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-30T21:30:11.037992] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-30T21:30:11.038161] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-30T21:30:11.038271] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-30T21:30:11.039538] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-30T21:30:11.039672] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-30T21:30:11.039615] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-30T21:30:11.039792] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-30T21:30:11.154589] [DEBUG] [LOCAL ] TME: Trimmed 76926 records to 53194 (keeping 200 days of data) [2025-09-30T21:30:11.533060] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:11.534344] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-30T21:30:11.766020] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T21:30:11.798789] [DEBUG] [LOCAL ] TME: Primary data saved (53194 records). [2025-09-30T21:30:11.798959] [INFO ] [MAIN ] TME: Full history saved. [2025-09-30T21:30:11.799054] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TME took 34.0s. Estimated remaining: 33m 51s. Rate: 7.8 symbols/min [2025-09-30T21:30:11.991475] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:11.991811] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-30T21:30:11.991882] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-30T21:30:11.992062] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-30T21:30:11.992169] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-30T21:30:11.992279] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-30T21:30:11.992489] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-30T21:30:12.259553] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-30T21:30:12.324838] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-30T21:30:12.463116] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:12.480014] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:30:13.054340] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-30T21:30:13.366416] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T21:30:13.854366] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-30T21:30:14.654342] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-30T21:30:14.693583] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T21:30:15.017733] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T21:30:15.454357] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-30T21:30:15.491584] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T21:30:16.254399] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-30T21:30:16.460453] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:30:16.460891] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-30T21:30:16.460991] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:30:16.461044] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-30T21:30:16.461103] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:30:16.461152] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-30T21:30:16.461210] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-30T21:30:16.461244] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-30T21:30:16.461313] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-30T21:30:16.461383] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNGY took 4.7s. Estimated remaining: 33m 43s. Rate: 7.8 symbols/min [2025-09-30T21:30:16.645450] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:16.683030] [DEBUG] [LOCAL ] TNK: Loaded 35166 existing records from primary storage. [2025-09-30T21:30:16.683330] [INFO ] [MAIN ] TNK: Loaded 35166 existing records. [2025-09-30T21:30:16.873010] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:16.873218] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-30T21:30:16.873265] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-30T21:30:16.873868] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-30T21:30:16.873929] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-30T21:30:17.056684] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-30T21:30:17.306238] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:17.351605] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T21:30:17.364040] [INFO ] [REMOTE ] TMO: Full fetch complete (75475 records). [2025-09-30T21:30:17.364205] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-30T21:30:17.784842] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-30T21:30:17.784931] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-30T21:30:17.786140] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-30T21:30:17.786210] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-30T21:30:17.787851] [DEBUG] [LOCAL ] TMO: Trimmed 75475 records to 52339 (keeping 200 days of data) [2025-09-30T21:30:17.857542] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-30T21:30:18.144432] [DEBUG] [LOCAL ] TMO: Primary data saved (52339 records). [2025-09-30T21:30:18.144588] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-30T21:30:18.144788] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TMO took 34.9s. Estimated remaining: 33m 34s. Rate: 7.8 symbols/min [2025-09-30T21:30:18.333148] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:18.361886] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T21:30:18.407480] [DEBUG] [LOCAL ] TNL: Loaded 41762 existing records from primary storage. [2025-09-30T21:30:18.407841] [INFO ] [MAIN ] TNL: Loaded 41762 existing records. [2025-09-30T21:30:18.599242] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:18.599487] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-30T21:30:18.599536] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-30T21:30:18.600426] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-30T21:30:18.600489] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-30T21:30:18.660461] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-30T21:30:18.990692] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:19.022816] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T21:30:19.454390] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-30T21:30:20.090525] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T21:30:20.254361] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-30T21:30:20.849008] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T21:30:21.054370] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-30T21:30:21.725250] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:30:21.854412] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-30T21:30:22.446608] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T21:30:22.654421] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-30T21:30:23.278783] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:30:23.454324] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-30T21:30:24.121255] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T21:30:24.254364] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-30T21:30:25.054364] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-30T21:30:25.093732] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:30:25.657902] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T21:30:25.854358] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-30T21:30:26.049821] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T21:30:26.654398] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-30T21:30:27.463117] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-30T21:30:27.481824] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:30:28.254345] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-30T21:30:28.490732] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:30:28.736048] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T21:30:28.961458] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T21:30:29.054365] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-30T21:30:29.854353] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-30T21:30:30.006103] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T21:30:30.654381] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-30T21:30:31.025287] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T21:30:31.454435] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-30T21:30:32.171959] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T21:30:32.201690] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T21:30:32.254321] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-30T21:30:33.054407] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-30T21:30:33.845592] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T21:30:33.854537] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-30T21:30:34.654332] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-30T21:30:34.743793] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T21:30:34.988189] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T21:30:35.454358] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-30T21:30:35.531915] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T21:30:35.535597] [INFO ] [REMOTE ] TNC: Full fetch complete (22998 records). [2025-09-30T21:30:35.535705] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-30T21:30:35.940691] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-30T21:30:35.940780] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-30T21:30:35.941270] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-30T21:30:35.941311] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-30T21:30:35.942703] [DEBUG] [LOCAL ] TNC: Trimmed 22998 records to 14904 (keeping 200 days of data) [2025-09-30T21:30:36.042219] [DEBUG] [LOCAL ] TNC: Primary data saved (14904 records). [2025-09-30T21:30:36.042370] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-30T21:30:36.042456] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNC took 28.0s. Estimated remaining: 33m 28s. Rate: 7.8 symbols/min [2025-09-30T21:30:36.235527] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:36.254344] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-30T21:30:36.302822] [DEBUG] [LOCAL ] TOL: Loaded 50929 existing records from primary storage. [2025-09-30T21:30:36.303172] [INFO ] [MAIN ] TOL: Loaded 50929 existing records. [2025-09-30T21:30:36.502838] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:36.503156] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-30T21:30:36.503210] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-30T21:30:36.503945] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-30T21:30:36.504007] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-30T21:30:36.919178] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:36.940218] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:30:37.054409] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-30T21:30:37.563315] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T21:30:37.854363] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-30T21:30:38.197790] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T21:30:38.654361] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-30T21:30:38.978885] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T21:30:39.454346] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-30T21:30:39.978156] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:30:40.254389] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-30T21:30:40.920596] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:30:41.054357] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-30T21:30:41.857955] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-30T21:30:41.871474] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T21:30:42.654366] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-30T21:30:42.709628] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T21:30:43.250921] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T21:30:43.260417] [INFO ] [REMOTE ] TNK: Full fetch complete (51867 records). [2025-09-30T21:30:43.260627] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-30T21:30:43.459537] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-30T21:30:43.839638] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-30T21:30:43.839789] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-30T21:30:43.841360] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-30T21:30:43.841490] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-30T21:30:43.843092] [DEBUG] [LOCAL ] TNK: Trimmed 51867 records to 35161 (keeping 200 days of data) [2025-09-30T21:30:44.132795] [DEBUG] [LOCAL ] TNK: Primary data saved (35161 records). [2025-09-30T21:30:44.146572] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-30T21:30:44.166532] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNK took 27.7s. Estimated remaining: 33m 20s. Rate: 7.8 symbols/min [2025-09-30T21:30:44.230891] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T21:30:44.259825] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-30T21:30:44.435170] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:44.499632] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-30T21:30:44.500064] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-30T21:30:44.701949] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:44.702174] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-30T21:30:44.702221] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-30T21:30:44.703257] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-30T21:30:44.703321] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-30T21:30:45.056624] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-30T21:30:45.089078] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:45.116699] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T21:30:45.532600] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T21:30:45.541116] [INFO ] [REMOTE ] TNET: Full fetch complete (41735 records). [2025-09-30T21:30:45.541457] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-30T21:30:45.859602] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-30T21:30:45.966470] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-30T21:30:45.966607] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-30T21:30:45.967553] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-30T21:30:45.967617] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-30T21:30:45.968911] [DEBUG] [LOCAL ] TNET: Trimmed 41735 records to 28638 (keeping 200 days of data) [2025-09-30T21:30:46.150875] [DEBUG] [LOCAL ] TNET: Primary data saved (28638 records). [2025-09-30T21:30:46.151022] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-30T21:30:46.151123] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNET took 36.1s. Estimated remaining: 33m 12s. Rate: 7.8 symbols/min [2025-09-30T21:30:46.336206] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:46.364548] [DEBUG] [LOCAL ] TPB: Loaded 25081 existing records from primary storage. [2025-09-30T21:30:46.364847] [INFO ] [MAIN ] TPB: Loaded 25081 existing records. [2025-09-30T21:30:46.560560] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:46.560800] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-30T21:30:46.560850] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-30T21:30:46.561216] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-30T21:30:46.561275] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-30T21:30:46.660332] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-30T21:30:46.962196] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:46.997067] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T21:30:47.454337] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-30T21:30:47.794598] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T21:30:47.865242] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T21:30:47.874026] [INFO ] [REMOTE ] TNL: Full fetch complete (58941 records). [2025-09-30T21:30:47.874139] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-30T21:30:48.259432] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-30T21:30:48.314548] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-30T21:30:48.314629] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-30T21:30:48.315722] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-30T21:30:48.315788] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-30T21:30:48.317187] [DEBUG] [LOCAL ] TNL: Trimmed 58941 records to 41767 (keeping 200 days of data) [2025-09-30T21:30:48.583779] [DEBUG] [LOCAL ] TNL: Primary data saved (41767 records). [2025-09-30T21:30:48.583908] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-30T21:30:48.583986] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNL took 30.4s. Estimated remaining: 33m 4s. Rate: 7.8 symbols/min [2025-09-30T21:30:48.766319] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:30:48.802834] [DEBUG] [LOCAL ] TPC: Loaded 38713 existing records from primary storage. [2025-09-30T21:30:48.803137] [INFO ] [MAIN ] TPC: Loaded 38713 existing records. [2025-09-30T21:30:49.005389] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:30:49.005697] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-30T21:30:49.005848] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-30T21:30:49.007049] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-30T21:30:49.007144] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-30T21:30:49.059505] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-30T21:30:49.328768] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T21:30:49.477793] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:30:49.831384] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T21:30:49.854309] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-30T21:30:50.255839] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T21:30:50.654366] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-30T21:30:51.454331] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-30T21:30:51.548617] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:30:51.581787] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T21:30:52.254364] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-30T21:30:53.054358] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-30T21:30:53.095893] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T21:30:53.308796] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T21:30:53.854365] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-30T21:30:54.004162] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:30:54.654372] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-30T21:30:55.140442] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T21:30:55.454359] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-30T21:30:56.257039] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-30T21:30:56.259514] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T21:30:56.563968] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T21:30:57.054354] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-30T21:30:57.810811] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:30:57.854392] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-30T21:30:58.654335] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-30T21:30:58.812748] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T21:30:59.401533] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T21:30:59.454365] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-30T21:30:59.754847] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T21:31:00.254365] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-30T21:31:01.054363] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-30T21:31:01.243828] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T21:31:01.854400] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-30T21:31:02.199945] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T21:31:02.539211] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T21:31:02.654370] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-30T21:31:03.275751] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T21:31:03.454403] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-30T21:31:03.957895] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T21:31:04.254409] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-30T21:31:05.054353] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-30T21:31:05.185217] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T21:31:05.854373] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-30T21:31:06.222574] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T21:31:06.432918] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T21:31:06.654388] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-30T21:31:07.454384] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-30T21:31:07.843996] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T21:31:08.254339] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-30T21:31:08.341050] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T21:31:09.059560] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-30T21:31:09.076012] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T21:31:09.089739] [INFO ] [REMOTE ] TOL: Full fetch complete (73841 records). [2025-09-30T21:31:09.090021] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-30T21:31:09.556731] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-30T21:31:09.556838] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-30T21:31:09.558108] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-30T21:31:09.558186] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-30T21:31:09.559779] [DEBUG] [LOCAL ] TOL: Trimmed 73841 records to 50887 (keeping 200 days of data) [2025-09-30T21:31:09.679455] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T21:31:09.692887] [INFO ] [REMOTE ] TPB: Full fetch complete (34901 records). [2025-09-30T21:31:09.694198] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-30T21:31:09.857452] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-30T21:31:10.207435] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-30T21:31:10.234528] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-30T21:31:10.236782] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-30T21:31:10.236876] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-30T21:31:10.240860] [DEBUG] [LOCAL ] TPB: Trimmed 34901 records to 25036 (keeping 200 days of data) [2025-09-30T21:31:10.505370] [DEBUG] [LOCAL ] TPB: Primary data saved (25036 records). [2025-09-30T21:31:10.506513] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-30T21:31:10.506885] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TPB took 24.4s. Estimated remaining: 32m 58s. Rate: 7.8 symbols/min [2025-09-30T21:31:10.646152] [DEBUG] [LOCAL ] TOL: Primary data saved (50887 records). [2025-09-30T21:31:10.656974] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-30T21:31:10.672614] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOL took 34.6s. Estimated remaining: 32m 49s. Rate: 7.8 symbols/min [2025-09-30T21:31:10.742770] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:10.780998] [DEBUG] [LOCAL ] TPH: No existing data file found in primary storage. [2025-09-30T21:31:10.810744] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T21:31:10.810939] [WARN ] [MAIN ] TPH: No existing data found, performing full refresh instead. [2025-09-30T21:31:10.819447] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-30T21:31:10.858834] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-30T21:31:10.858320] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-30T21:31:10.877164] [DEBUG] [LOCAL ] TPH: No primary data file found to delete. [2025-09-30T21:31:10.882579] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-30T21:31:11.065175] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:11.167229] [DEBUG] [LOCAL ] TPL: Loaded 12304 existing records from primary storage. [2025-09-30T21:31:11.254520] [INFO ] [MAIN ] TPL: Loaded 12304 existing records. [2025-09-30T21:31:11.581084] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:11.592628] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-30T21:31:11.660523] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:11.660927] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-30T21:31:11.660980] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-30T21:31:11.661479] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-30T21:31:11.661550] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-30T21:31:12.065456] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:12.108586] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T21:31:12.254344] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-30T21:31:12.443633] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T21:31:12.880188] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T21:31:13.054340] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-30T21:31:13.854406] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-30T21:31:14.535734] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-30T21:31:14.589478] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T21:31:14.654361] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-30T21:31:15.082520] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T21:31:15.454356] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-30T21:31:16.254383] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-30T21:31:16.757916] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T21:31:16.770221] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-30T21:31:16.770388] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-30T21:31:17.055936] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-30T21:31:17.267839] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T21:31:17.266259] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-30T21:31:17.277048] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-30T21:31:17.278577] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-30T21:31:17.278732] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-30T21:31:17.280713] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 53681 (keeping 200 days of data) [2025-09-30T21:31:17.555553] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T21:31:17.670728] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-30T21:31:17.670888] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-30T21:31:17.670984] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 33.5s. Estimated remaining: 32m 41s. Rate: 7.8 symbols/min [2025-09-30T21:31:17.857789] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-30T21:31:17.857708] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:17.915041] [DEBUG] [LOCAL ] TPR: Loaded 53470 existing records from primary storage. [2025-09-30T21:31:17.915357] [INFO ] [MAIN ] TPR: Loaded 53470 existing records. [2025-09-30T21:31:18.120602] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:18.120895] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-30T21:31:18.120979] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-30T21:31:18.122235] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-30T21:31:18.122302] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-30T21:31:18.486793] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T21:31:18.536849] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:18.654392] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-30T21:31:19.454955] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-30T21:31:19.457705] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:31:20.163708] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:31:20.254408] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-30T21:31:21.054364] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-30T21:31:21.240745] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T21:31:21.854339] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-30T21:31:22.028927] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T21:31:22.342807] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T21:31:22.351178] [INFO ] [REMOTE ] TPC: Full fetch complete (55066 records). [2025-09-30T21:31:22.351322] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-30T21:31:22.663046] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-30T21:31:22.778289] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-30T21:31:22.778397] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-30T21:31:22.779554] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-30T21:31:22.779629] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-30T21:31:22.780998] [DEBUG] [LOCAL ] TPC: Trimmed 55066 records to 38730 (keeping 200 days of data) [2025-09-30T21:31:23.021120] [DEBUG] [LOCAL ] TPC: Primary data saved (38730 records). [2025-09-30T21:31:23.021271] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-30T21:31:23.021422] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 34.4s. Estimated remaining: 32m 33s. Rate: 7.8 symbols/min [2025-09-30T21:31:23.454402] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-30T21:31:23.596507] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T21:31:24.254399] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-30T21:31:24.293999] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T21:31:24.485616] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T21:31:25.054415] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-30T21:31:25.516595] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T21:31:25.854363] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-30T21:31:25.938615] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T21:31:26.654420] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-30T21:31:27.454385] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-30T21:31:27.767218] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T21:31:28.192099] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T21:31:28.254424] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-30T21:31:28.431037] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T21:31:29.054373] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-30T21:31:29.854416] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-30T21:31:30.231542] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T21:31:30.665269] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-30T21:31:30.671841] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:31:30.720670] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T21:31:31.454364] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-30T21:31:32.254444] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-30T21:31:32.486597] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T21:31:32.743259] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T21:31:33.054384] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-30T21:31:33.854391] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-30T21:31:34.098951] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T21:31:34.654348] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-30T21:31:34.872977] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T21:31:34.920318] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T21:31:35.454370] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-30T21:31:36.263808] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-30T21:31:36.298539] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T21:31:36.314189] [INFO ] [REMOTE ] TPH: Full fetch complete (64990 records). [2025-09-30T21:31:36.314512] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-30T21:31:36.854510] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-30T21:31:36.854690] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-30T21:31:36.855846] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-30T21:31:36.855983] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-30T21:31:36.857620] [DEBUG] [LOCAL ] TPH: Trimmed 64990 records to 45002 (keeping 200 days of data) [2025-09-30T21:31:37.149228] [DEBUG] [LOCAL ] TPH: Primary data saved (45002 records). [2025-09-30T21:31:37.149389] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-30T21:31:37.149473] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 26.6s. Estimated remaining: 32m 26s. Rate: 7.8 symbols/min [2025-09-30T21:31:37.288929] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T21:31:37.292978] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-30T21:31:37.477351] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T21:31:37.854359] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-30T21:31:38.307169] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T21:31:38.654364] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-30T21:31:39.390780] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T21:31:39.454397] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-30T21:31:39.660023] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T21:31:39.663006] [INFO ] [REMOTE ] TPL: Full fetch complete (18001 records). [2025-09-30T21:31:39.663096] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-30T21:31:40.071905] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-30T21:31:40.072035] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-30T21:31:40.072448] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-30T21:31:40.072629] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-30T21:31:40.073333] [DEBUG] [LOCAL ] TPL: Trimmed 18001 records to 12274 (keeping 200 days of data) [2025-09-30T21:31:40.158818] [DEBUG] [LOCAL ] TPL: Primary data saved (12274 records). [2025-09-30T21:31:40.158985] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-30T21:31:40.159084] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 29.4s. Estimated remaining: 32m 18s. Rate: 7.8 symbols/min [2025-09-30T21:31:41.173368] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T21:31:41.185586] [INFO ] [REMOTE ] TPR: Full fetch complete (77425 records). [2025-09-30T21:31:41.185819] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-30T21:31:41.638850] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-30T21:31:41.638944] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-30T21:31:41.640340] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-30T21:31:41.640445] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-30T21:31:41.643888] [DEBUG] [LOCAL ] TPR: Trimmed 77425 records to 53468 (keeping 200 days of data) [2025-09-30T21:31:42.022216] [DEBUG] [LOCAL ] TPR: Primary data saved (53468 records). [2025-09-30T21:31:42.022366] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-30T21:31:42.022450] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 24.4s. Estimated remaining: 32m 10s. Rate: 7.8 symbols/min [2025-09-30T21:31:42.690510] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:42.681471] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:42.792022] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:42.818389] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:31:42.826183] [DEBUG] [LOCAL ] TPZ: Loaded 5014 existing records from primary storage. [2025-09-30T21:31:42.826636] [INFO ] [MAIN ] TPZ: Loaded 5014 existing records. [2025-09-30T21:31:42.907851] [DEBUG] [LOCAL ] TPYP: Loaded 7911 existing records from primary storage. [2025-09-30T21:31:42.919261] [INFO ] [MAIN ] TPYP: Loaded 7911 existing records. [2025-09-30T21:31:43.027837] [DEBUG] [LOCAL ] TPVG: Loaded 26999 existing records from primary storage. [2025-09-30T21:31:43.050555] [INFO ] [MAIN ] TPVG: Loaded 26999 existing records. [2025-09-30T21:31:43.050422] [DEBUG] [LOCAL ] TR: Loaded 18290 existing records from primary storage. [2025-09-30T21:31:43.113362] [INFO ] [MAIN ] TR: Loaded 18290 existing records. [2025-09-30T21:31:43.219323] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:43.453605] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-30T21:31:43.467889] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:43.479220] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-30T21:31:43.494943] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-30T21:31:43.505867] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-30T21:31:43.511190] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-30T21:31:43.547364] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-30T21:31:43.639239] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-30T21:31:43.639456] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-30T21:31:43.699346] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:43.757387] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-30T21:31:43.810907] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-30T21:31:43.908357] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-30T21:31:43.920099] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:31:43.939158] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-30T21:31:43.939317] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-30T21:31:43.939395] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-30T21:31:43.983042] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-30T21:31:44.065520] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-30T21:31:45.012442] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:45.125684] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-30T21:31:45.190840] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:45.201987] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-30T21:31:45.318277] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:45.342977] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-30T21:31:45.383021] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:31:45.383482] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-30T21:31:45.817864] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T21:31:45.820420] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-30T21:31:46.022091] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T21:31:46.024956] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-30T21:31:46.297695] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:31:46.302558] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-30T21:31:46.579200] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T21:31:46.582883] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-30T21:31:46.689883] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T21:31:46.704455] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-30T21:31:46.712760] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T21:31:46.999157] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T21:31:47.365254] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T21:31:47.454393] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-30T21:31:47.890984] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T21:31:48.222254] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T21:31:48.254338] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-30T21:31:48.984458] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T21:31:49.054380] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-30T21:31:49.854365] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-30T21:31:49.866473] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T21:31:50.654366] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-30T21:31:50.974161] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T21:31:51.454334] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-30T21:31:51.505955] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T21:31:52.254354] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-30T21:31:52.379431] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T21:31:52.985170] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T21:31:53.054362] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-30T21:31:53.854397] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-30T21:31:54.378680] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T21:31:54.409682] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T21:31:54.654408] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-30T21:31:55.454376] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-30T21:31:55.513991] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T21:31:56.078074] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T21:31:56.254408] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-30T21:31:57.054390] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-30T21:31:57.657672] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T21:31:57.777975] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T21:31:57.854377] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-30T21:31:58.654357] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-30T21:31:58.944750] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T21:31:59.398103] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T21:31:59.454402] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-30T21:31:59.857179] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-30T21:32:00.254371] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-30T21:32:01.054375] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-30T21:32:01.218547] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T21:32:01.455093] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T21:32:01.854386] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-30T21:32:02.440511] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T21:32:02.654380] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-30T21:32:03.454371] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-30T21:32:03.496854] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T21:32:03.499095] [INFO ] [REMOTE ] TPYP: Full fetch complete (12608 records). [2025-09-30T21:32:03.499198] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-30T21:32:03.910383] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-30T21:32:03.910521] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-30T21:32:03.910991] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-30T21:32:03.911060] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-30T21:32:03.911849] [DEBUG] [LOCAL ] TPYP: Trimmed 12608 records to 7918 (keeping 200 days of data) [2025-09-30T21:32:03.974435] [DEBUG] [LOCAL ] TPYP: Primary data saved (7918 records). [2025-09-30T21:32:03.974599] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-30T21:32:03.974717] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 22.0s. Estimated remaining: 32m 4s. Rate: 7.8 symbols/min [2025-09-30T21:32:04.162193] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:04.173720] [DEBUG] [LOCAL ] TRAK: Loaded 9222 existing records from primary storage. [2025-09-30T21:32:04.174045] [INFO ] [MAIN ] TRAK: Loaded 9222 existing records. [2025-09-30T21:32:04.263127] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-30T21:32:04.391546] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:04.392055] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-30T21:32:04.392129] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-30T21:32:04.397729] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-30T21:32:04.405027] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-30T21:32:04.411345] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T21:32:04.812864] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:04.893912] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T21:32:04.895940] [INFO ] [REMOTE ] TPZ: Full fetch complete (9206 records). [2025-09-30T21:32:04.896015] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-30T21:32:05.058105] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-30T21:32:05.286202] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-30T21:32:05.286282] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-30T21:32:05.286503] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-30T21:32:05.286544] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-30T21:32:05.287159] [DEBUG] [LOCAL ] TPZ: Trimmed 9206 records to 4975 (keeping 200 days of data) [2025-09-30T21:32:05.319477] [DEBUG] [LOCAL ] TPZ: Primary data saved (4975 records). [2025-09-30T21:32:05.319620] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-30T21:32:05.319755] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPZ took 23.3s. Estimated remaining: 31m 55s. Rate: 7.8 symbols/min [2025-09-30T21:32:05.499591] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:05.499801] [DEBUG] [LOCAL ] TRC: No existing data file found in primary storage. [2025-09-30T21:32:05.499846] [WARN ] [MAIN ] TRC: No existing data found, performing full refresh instead. [2025-09-30T21:32:05.499960] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-30T21:32:05.500011] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-30T21:32:05.500056] [DEBUG] [LOCAL ] TRC: No primary data file found to delete. [2025-09-30T21:32:05.500091] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-30T21:32:05.857200] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-30T21:32:05.886028] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:06.579524] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T21:32:06.657891] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-30T21:32:06.661263] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T21:32:07.454395] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-30T21:32:07.724531] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T21:32:08.254394] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-30T21:32:08.537464] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T21:32:09.054385] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-30T21:32:09.190573] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T21:32:09.815180] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T21:32:09.854361] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-30T21:32:10.602707] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T21:32:10.654363] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-30T21:32:11.454366] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-30T21:32:11.669447] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T21:32:12.254341] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-30T21:32:12.435239] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T21:32:13.054361] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-30T21:32:13.372895] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:32:13.854328] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-30T21:32:14.025784] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T21:32:14.654330] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-30T21:32:14.690517] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T21:32:15.454336] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-30T21:32:15.491546] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T21:32:16.254336] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-30T21:32:16.282453] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T21:32:16.287331] [INFO ] [REMOTE ] TR: Full fetch complete (25062 records). [2025-09-30T21:32:16.287415] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-30T21:32:16.694821] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-30T21:32:16.694902] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-30T21:32:16.695463] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-30T21:32:16.695511] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-30T21:32:16.696691] [DEBUG] [LOCAL ] TR: Trimmed 25062 records to 18422 (keeping 200 days of data) [2025-09-30T21:32:16.817437] [DEBUG] [LOCAL ] TR: Primary data saved (18422 records). [2025-09-30T21:32:16.817604] [INFO ] [MAIN ] TR: Full history saved. [2025-09-30T21:32:16.817727] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 34.8s. Estimated remaining: 31m 48s. Rate: 7.8 symbols/min [2025-09-30T21:32:16.997500] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:17.049731] [DEBUG] [LOCAL ] TREX: Loaded 49972 existing records from primary storage. [2025-09-30T21:32:17.050076] [INFO ] [MAIN ] TREX: Loaded 49972 existing records. [2025-09-30T21:32:17.061316] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-30T21:32:17.169720] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T21:32:17.255765] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:17.256016] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-30T21:32:17.256085] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-30T21:32:17.257062] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-30T21:32:17.257124] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-30T21:32:17.618789] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:17.854383] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-30T21:32:18.459769] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T21:32:18.466580] [INFO ] [REMOTE ] TPVG: Full fetch complete (40486 records). [2025-09-30T21:32:18.466736] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-30T21:32:18.659531] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-30T21:32:18.895432] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-30T21:32:18.895886] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-30T21:32:18.897225] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-30T21:32:18.897320] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-30T21:32:18.896260] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T21:32:18.903762] [DEBUG] [LOCAL ] TPVG: Trimmed 40486 records to 26983 (keeping 200 days of data) [2025-09-30T21:32:19.081523] [DEBUG] [LOCAL ] TPVG: Primary data saved (26983 records). [2025-09-30T21:32:19.081696] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-30T21:32:19.081852] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 37.1s. Estimated remaining: 31m 40s. Rate: 7.8 symbols/min [2025-09-30T21:32:19.262309] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:19.314364] [DEBUG] [LOCAL ] TRGP: Loaded 50707 existing records from primary storage. [2025-09-30T21:32:19.314708] [INFO ] [MAIN ] TRGP: Loaded 50707 existing records. [2025-09-30T21:32:19.463976] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-30T21:32:19.510133] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:19.521881] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-30T21:32:19.522245] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T21:32:19.522444] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-30T21:32:19.528202] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-30T21:32:19.528267] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-30T21:32:19.920011] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:20.254372] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-30T21:32:20.303383] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T21:32:21.054420] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-30T21:32:21.443278] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T21:32:21.827059] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T21:32:21.854363] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-30T21:32:22.654407] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-30T21:32:23.375749] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T21:32:23.454354] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-30T21:32:24.186572] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:32:24.254365] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-30T21:32:25.054337] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-30T21:32:25.100211] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:32:25.207099] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T21:32:25.854395] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-30T21:32:25.953917] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T21:32:26.654386] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-30T21:32:27.454328] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-30T21:32:27.579136] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:32:28.254383] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-30T21:32:28.433283] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T21:32:28.465057] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T21:32:28.937173] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T21:32:29.054371] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-30T21:32:29.854362] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-30T21:32:30.040746] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T21:32:30.654358] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-30T21:32:31.452910] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T21:32:31.462411] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-30T21:32:31.477970] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T21:32:31.480904] [INFO ] [REMOTE ] TRAK: Full fetch complete (13437 records). [2025-09-30T21:32:31.481055] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-30T21:32:31.873060] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-30T21:32:31.873182] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-30T21:32:31.873661] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-30T21:32:31.873736] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-30T21:32:31.874307] [DEBUG] [LOCAL ] TRAK: Trimmed 13437 records to 9319 (keeping 200 days of data) [2025-09-30T21:32:31.935615] [DEBUG] [LOCAL ] TRAK: Primary data saved (9319 records). [2025-09-30T21:32:31.935789] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-30T21:32:31.935880] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 28.0s. Estimated remaining: 31m 33s. Rate: 7.8 symbols/min [2025-09-30T21:32:32.120481] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:32.157924] [DEBUG] [LOCAL ] TRN: Loaded 37138 existing records from primary storage. [2025-09-30T21:32:32.158262] [INFO ] [MAIN ] TRN: Loaded 37138 existing records. [2025-09-30T21:32:32.260944] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-30T21:32:32.351596] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:32.351879] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-30T21:32:32.351928] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-30T21:32:32.352919] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-30T21:32:32.352982] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-30T21:32:32.645003] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T21:32:32.763029] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:33.054398] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-30T21:32:33.854364] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-30T21:32:33.994491] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T21:32:34.040312] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T21:32:34.654396] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-30T21:32:35.230602] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T21:32:35.454331] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-30T21:32:35.620478] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T21:32:35.624263] [INFO ] [REMOTE ] TRC: Full fetch complete (22101 records). [2025-09-30T21:32:35.624341] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-30T21:32:36.008501] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-30T21:32:36.008663] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-30T21:32:36.009268] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-30T21:32:36.009343] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-30T21:32:36.010335] [DEBUG] [LOCAL ] TRC: Trimmed 22101 records to 15798 (keeping 200 days of data) [2025-09-30T21:32:36.105887] [DEBUG] [LOCAL ] TRC: Primary data saved (15798 records). [2025-09-30T21:32:36.106038] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-30T21:32:36.106117] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 30.8s. Estimated remaining: 31m 24s. Rate: 7.8 symbols/min [2025-09-30T21:32:36.257896] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-30T21:32:36.283820] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:36.325916] [DEBUG] [LOCAL ] TRNO: Loaded 43949 existing records from primary storage. [2025-09-30T21:32:36.326279] [INFO ] [MAIN ] TRNO: Loaded 43949 existing records. [2025-09-30T21:32:36.508891] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:36.509136] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-30T21:32:36.509185] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-30T21:32:36.510264] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-30T21:32:36.510328] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-30T21:32:36.894374] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:37.054385] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-30T21:32:37.102846] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T21:32:37.854363] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-30T21:32:38.499350] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T21:32:38.500810] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:32:38.654413] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-30T21:32:39.454358] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-30T21:32:39.646453] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:32:39.932039] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T21:32:40.254360] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-30T21:32:40.819434] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T21:32:41.054369] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-30T21:32:41.854334] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-30T21:32:41.976704] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T21:32:42.447707] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T21:32:42.654359] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-30T21:32:43.454372] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-30T21:32:43.692763] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T21:32:44.179620] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T21:32:44.254361] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-30T21:32:45.054377] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-30T21:32:45.226734] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T21:32:45.773340] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T21:32:45.854422] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-30T21:32:46.330023] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T21:32:46.654362] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-30T21:32:47.454371] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-30T21:32:47.592162] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T21:32:47.831608] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T21:32:48.254360] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-30T21:32:48.644447] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T21:32:49.054370] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-30T21:32:49.854355] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-30T21:32:49.941049] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:32:50.654326] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-30T21:32:50.815938] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T21:32:51.454370] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-30T21:32:51.611242] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T21:32:52.254393] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-30T21:32:52.510340] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T21:32:52.521351] [INFO ] [REMOTE ] TREX: Full fetch complete (71052 records). [2025-09-30T21:32:52.521544] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-30T21:32:52.969198] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-30T21:32:52.978823] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-30T21:32:52.980158] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-30T21:32:52.980252] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-30T21:32:52.982702] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T21:32:52.993818] [DEBUG] [LOCAL ] TREX: Trimmed 71052 records to 49961 (keeping 200 days of data) [2025-09-30T21:32:53.080122] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-30T21:32:53.305095] [DEBUG] [LOCAL ] TREX: Primary data saved (49961 records). [2025-09-30T21:32:53.305272] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-30T21:32:53.305369] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 36.5s. Estimated remaining: 31m 18s. Rate: 7.8 symbols/min [2025-09-30T21:32:53.504988] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:53.562540] [DEBUG] [LOCAL ] TROX: Loaded 51813 existing records from primary storage. [2025-09-30T21:32:53.563005] [INFO ] [MAIN ] TROX: Loaded 51813 existing records. [2025-09-30T21:32:53.818296] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T21:32:53.863994] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-30T21:32:53.872569] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:53.873266] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-30T21:32:53.873337] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-30T21:32:53.873515] [INFO ] [REMOTE ] TRGP: Full fetch complete (73461 records). [2025-09-30T21:32:53.873610] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-30T21:32:53.885935] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-30T21:32:53.933316] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-30T21:32:54.664287] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:54.697476] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-30T21:32:54.748339] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-30T21:32:54.748444] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-30T21:32:54.749584] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-30T21:32:54.749859] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-30T21:32:54.769100] [DEBUG] [LOCAL ] TRGP: Trimmed 73461 records to 50701 (keeping 200 days of data) [2025-09-30T21:32:54.773602] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T21:32:55.114449] [DEBUG] [LOCAL ] TRGP: Primary data saved (50701 records). [2025-09-30T21:32:55.114611] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-30T21:32:55.114745] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 36.0s. Estimated remaining: 31m 9s. Rate: 7.8 symbols/min [2025-09-30T21:32:55.337846] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:32:55.391699] [DEBUG] [LOCAL ] TRP: Loaded 52103 existing records from primary storage. [2025-09-30T21:32:55.392206] [INFO ] [MAIN ] TRP: Loaded 52103 existing records. [2025-09-30T21:32:55.461759] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-30T21:32:55.598895] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:32:55.599447] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-30T21:32:55.599513] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-30T21:32:55.608860] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-30T21:32:55.624469] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-30T21:32:55.673233] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T21:32:56.035015] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:32:56.254408] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-30T21:32:56.545390] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T21:32:56.614729] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T21:32:57.054506] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-30T21:32:57.854328] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-30T21:32:57.891390] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:32:58.303880] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T21:32:58.654366] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-30T21:32:59.105830] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:32:59.454381] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-30T21:33:00.205476] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T21:33:00.254415] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-30T21:33:00.975062] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T21:33:01.054396] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-30T21:33:01.854330] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-30T21:33:02.031970] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T21:33:02.224136] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T21:33:02.654363] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-30T21:33:03.180055] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T21:33:03.454351] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-30T21:33:04.042870] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T21:33:04.050280] [INFO ] [REMOTE ] TRN: Full fetch complete (52812 records). [2025-09-30T21:33:04.050386] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-30T21:33:04.259902] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-30T21:33:04.481483] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-30T21:33:04.481576] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-30T21:33:04.482553] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-30T21:33:04.482621] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-30T21:33:04.483874] [DEBUG] [LOCAL ] TRN: Trimmed 52812 records to 37089 (keeping 200 days of data) [2025-09-30T21:33:04.718567] [DEBUG] [LOCAL ] TRN: Primary data saved (37089 records). [2025-09-30T21:33:04.718758] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-30T21:33:04.718909] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 32.8s. Estimated remaining: 31m 2s. Rate: 7.8 symbols/min [2025-09-30T21:33:04.903095] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:04.940432] [DEBUG] [LOCAL ] TRTX: Loaded 37400 existing records from primary storage. [2025-09-30T21:33:04.940824] [INFO ] [MAIN ] TRTX: Loaded 37400 existing records. [2025-09-30T21:33:05.058033] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-30T21:33:05.141935] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:05.142388] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-30T21:33:05.142547] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-30T21:33:05.143717] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-30T21:33:05.143784] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-30T21:33:05.486852] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T21:33:05.583056] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:05.757755] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T21:33:05.854373] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-30T21:33:06.661730] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-30T21:33:06.667060] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T21:33:06.677088] [INFO ] [REMOTE ] TRNO: Full fetch complete (63843 records). [2025-09-30T21:33:06.677217] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-30T21:33:07.099583] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-30T21:33:07.099712] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-30T21:33:07.100748] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-30T21:33:07.100814] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-30T21:33:07.102429] [DEBUG] [LOCAL ] TRNO: Trimmed 63843 records to 43946 (keeping 200 days of data) [2025-09-30T21:33:07.386728] [DEBUG] [LOCAL ] TRNO: Primary data saved (43946 records). [2025-09-30T21:33:07.386937] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-30T21:33:07.387053] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 31.3s. Estimated remaining: 30m 54s. Rate: 7.8 symbols/min [2025-09-30T21:33:07.457727] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-30T21:33:07.576272] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:07.608313] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T21:33:07.669097] [DEBUG] [LOCAL ] TRU: Loaded 51194 existing records from primary storage. [2025-09-30T21:33:07.669550] [INFO ] [MAIN ] TRU: Loaded 51194 existing records. [2025-09-30T21:33:07.864936] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:07.865274] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-30T21:33:07.865335] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-30T21:33:07.866660] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-30T21:33:07.866728] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-30T21:33:08.251662] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:08.264387] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-30T21:33:08.286949] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:33:09.054351] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-30T21:33:09.277347] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T21:33:09.854374] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-30T21:33:09.945331] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T21:33:10.654338] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-30T21:33:10.822829] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T21:33:11.222343] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T21:33:11.454416] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-30T21:33:12.254318] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-30T21:33:12.380080] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T21:33:12.434077] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T21:33:13.054371] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-30T21:33:13.854335] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-30T21:33:14.032281] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T21:33:14.343746] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T21:33:14.654369] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-30T21:33:15.454421] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-30T21:33:15.753042] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T21:33:16.110268] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T21:33:16.254417] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-30T21:33:17.049131] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T21:33:17.058820] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-30T21:33:17.448862] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T21:33:17.854463] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-30T21:33:18.579760] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T21:33:18.654324] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-30T21:33:19.367897] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T21:33:19.454409] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-30T21:33:20.183660] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T21:33:20.195370] [INFO ] [REMOTE ] TROX: Full fetch complete (73012 records). [2025-09-30T21:33:20.195615] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-30T21:33:20.267492] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-30T21:33:20.642817] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-30T21:33:20.642931] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-30T21:33:20.644451] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-30T21:33:20.644537] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-30T21:33:20.646388] [DEBUG] [LOCAL ] TROX: Trimmed 73012 records to 51863 (keeping 200 days of data) [2025-09-30T21:33:20.995885] [DEBUG] [LOCAL ] TROX: Primary data saved (51863 records). [2025-09-30T21:33:20.996218] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-30T21:33:20.996441] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 27.7s. Estimated remaining: 30m 47s. Rate: 7.8 symbols/min [2025-09-30T21:33:21.059730] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-30T21:33:21.212066] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:21.276394] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T21:33:21.303441] [DEBUG] [LOCAL ] TRV: Loaded 47907 existing records from primary storage. [2025-09-30T21:33:21.304432] [INFO ] [MAIN ] TRV: Loaded 47907 existing records. [2025-09-30T21:33:21.504366] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:21.504832] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-30T21:33:21.505102] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-30T21:33:21.513856] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-30T21:33:21.527680] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T21:33:21.526806] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-30T21:33:21.859554] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-30T21:33:21.941255] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:22.654322] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-30T21:33:22.860260] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T21:33:23.454418] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-30T21:33:23.788208] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T21:33:24.254370] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-30T21:33:24.455164] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T21:33:25.054401] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-30T21:33:25.320959] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T21:33:25.854371] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-30T21:33:26.108369] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T21:33:26.654391] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-30T21:33:26.946751] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T21:33:27.309765] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T21:33:27.454385] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-30T21:33:28.040214] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T21:33:28.254408] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-30T21:33:29.054345] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-30T21:33:29.201121] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T21:33:29.212612] [INFO ] [REMOTE ] TRP: Full fetch complete (75564 records). [2025-09-30T21:33:29.212826] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-30T21:33:29.647298] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-30T21:33:29.647444] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-30T21:33:29.648847] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-30T21:33:29.648933] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-30T21:33:29.650853] [DEBUG] [LOCAL ] TRP: Trimmed 75564 records to 52096 (keeping 200 days of data) [2025-09-30T21:33:29.776475] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T21:33:29.883584] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-30T21:33:30.040329] [DEBUG] [LOCAL ] TRP: Primary data saved (52096 records). [2025-09-30T21:33:30.040494] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-30T21:33:30.040697] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRP took 34.9s. Estimated remaining: 30m 39s. Rate: 7.8 symbols/min [2025-09-30T21:33:30.226327] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:30.277731] [DEBUG] [LOCAL ] TS: Loaded 51664 existing records from primary storage. [2025-09-30T21:33:30.278101] [INFO ] [MAIN ] TS: Loaded 51664 existing records. [2025-09-30T21:33:30.478185] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:30.478534] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-30T21:33:30.478617] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-30T21:33:30.479775] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-30T21:33:30.479838] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-30T21:33:30.661472] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-30T21:33:30.734130] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T21:33:30.913061] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:31.454331] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-30T21:33:31.767755] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T21:33:32.195974] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T21:33:32.254364] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-30T21:33:33.054335] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-30T21:33:33.390635] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T21:33:33.774455] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T21:33:33.854320] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-30T21:33:34.497425] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T21:33:34.654342] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-30T21:33:35.454327] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-30T21:33:35.796402] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T21:33:36.254329] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-30T21:33:36.461626] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T21:33:36.472918] [INFO ] [REMOTE ] TRU: Full fetch complete (73307 records). [2025-09-30T21:33:36.473041] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-30T21:33:36.915523] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-30T21:33:36.915666] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-30T21:33:36.916964] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-30T21:33:36.917078] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-30T21:33:36.920274] [DEBUG] [LOCAL ] TRU: Trimmed 73307 records to 51214 (keeping 200 days of data) [2025-09-30T21:33:37.057323] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-30T21:33:37.259578] [DEBUG] [LOCAL ] TRU: Primary data saved (51214 records). [2025-09-30T21:33:37.259779] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-30T21:33:37.259918] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRU took 29.9s. Estimated remaining: 30m 31s. Rate: 7.8 symbols/min [2025-09-30T21:33:37.450956] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:37.505452] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T21:33:37.504419] [DEBUG] [LOCAL ] TSE: Loaded 28538 existing records from primary storage. [2025-09-30T21:33:37.516824] [INFO ] [MAIN ] TSE: Loaded 28538 existing records. [2025-09-30T21:33:37.712534] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:37.712809] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-30T21:33:37.712977] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-30T21:33:37.713761] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-30T21:33:37.713941] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-30T21:33:37.861875] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T21:33:37.856686] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-30T21:33:38.151048] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:38.247948] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T21:33:38.257610] [INFO ] [REMOTE ] TRTX: Full fetch complete (53318 records). [2025-09-30T21:33:38.257829] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-30T21:33:38.659600] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-30T21:33:38.865028] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-30T21:33:38.865141] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-30T21:33:38.866406] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-30T21:33:38.866510] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-30T21:33:38.870260] [DEBUG] [LOCAL ] TRTX: Trimmed 53318 records to 37480 (keeping 200 days of data) [2025-09-30T21:33:39.217052] [DEBUG] [LOCAL ] TRTX: Primary data saved (37480 records). [2025-09-30T21:33:39.217205] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-30T21:33:39.217333] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRTX took 34.5s. Estimated remaining: 30m 23s. Rate: 7.8 symbols/min [2025-09-30T21:33:39.424487] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:39.456332] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-30T21:33:39.467462] [DEBUG] [LOCAL ] TSI: Loaded 7626 existing records from primary storage. [2025-09-30T21:33:39.462590] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T21:33:39.468143] [INFO ] [MAIN ] TSI: Loaded 7626 existing records. [2025-09-30T21:33:39.687027] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:39.687253] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-30T21:33:39.687303] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-30T21:33:39.687636] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-30T21:33:39.687746] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-30T21:33:40.087463] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:40.107880] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:33:40.254359] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-30T21:33:41.054334] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-30T21:33:41.095762] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:33:41.854337] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-30T21:33:41.965034] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T21:33:42.176004] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T21:33:42.346432] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T21:33:42.654359] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-30T21:33:43.454420] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-30T21:33:44.254383] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-30T21:33:44.506291] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T21:33:44.556093] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T21:33:44.869088] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T21:33:45.054372] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-30T21:33:45.854370] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-30T21:33:46.566515] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T21:33:46.654366] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-30T21:33:47.454325] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-30T21:33:47.588701] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T21:33:47.969209] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:33:48.254385] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-30T21:33:49.054335] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-30T21:33:49.198301] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T21:33:49.276930] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T21:33:49.854346] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-30T21:33:50.441121] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T21:33:50.451692] [INFO ] [REMOTE ] TRV: Full fetch complete (69876 records). [2025-09-30T21:33:50.451878] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-30T21:33:50.596423] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T21:33:50.668021] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-30T21:33:50.904616] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-30T21:33:50.904758] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-30T21:33:50.905960] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-30T21:33:50.906029] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-30T21:33:50.909173] [DEBUG] [LOCAL ] TRV: Trimmed 69876 records to 47872 (keeping 200 days of data) [2025-09-30T21:33:51.223365] [DEBUG] [LOCAL ] TRV: Primary data saved (47872 records). [2025-09-30T21:33:51.223503] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-30T21:33:51.223599] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 30.2s. Estimated remaining: 30m 16s. Rate: 7.8 symbols/min [2025-09-30T21:33:51.407372] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:33:51.447085] [DEBUG] [LOCAL ] TSLX: Loaded 35148 existing records from primary storage. [2025-09-30T21:33:51.447375] [INFO ] [MAIN ] TSLX: Loaded 35148 existing records. [2025-09-30T21:33:51.460319] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-30T21:33:51.643236] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:33:51.643572] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-30T21:33:51.643680] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-30T21:33:51.644807] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-30T21:33:51.644884] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-30T21:33:52.048291] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:33:52.254394] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-30T21:33:52.457745] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T21:33:52.510686] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T21:33:53.054417] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-30T21:33:53.572741] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T21:33:53.854376] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-30T21:33:54.443080] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T21:33:54.654365] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-30T21:33:54.710738] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:33:55.430547] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T21:33:55.454363] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-30T21:33:56.130386] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T21:33:56.254369] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-30T21:33:57.054350] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-30T21:33:57.071324] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:33:57.854365] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-30T21:33:58.292286] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T21:33:58.654399] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-30T21:33:59.378808] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T21:33:59.380998] [INFO ] [REMOTE ] TSI: Full fetch complete (13259 records). [2025-09-30T21:33:59.381103] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-30T21:33:59.459704] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-30T21:33:59.824912] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-30T21:33:59.840953] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-30T21:33:59.841440] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-30T21:33:59.841525] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-30T21:33:59.843957] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T21:33:59.855844] [DEBUG] [LOCAL ] TSI: Trimmed 13259 records to 7508 (keeping 200 days of data) [2025-09-30T21:33:59.900067] [DEBUG] [LOCAL ] TSI: Primary data saved (7508 records). [2025-09-30T21:33:59.900192] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-30T21:33:59.900315] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSI took 20.7s. Estimated remaining: 30m 8s. Rate: 7.8 symbols/min [2025-09-30T21:34:00.079129] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:00.139341] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-30T21:34:00.139753] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-30T21:34:00.259507] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-30T21:34:00.338904] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:00.339112] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-30T21:34:00.339161] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-30T21:34:00.340434] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-30T21:34:00.340497] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-30T21:34:00.735392] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:01.054383] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-30T21:34:01.717481] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:34:01.854381] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-30T21:34:02.654372] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-30T21:34:03.386998] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (3.93 seconds). [2025-09-30T21:34:03.454413] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-30T21:34:03.660109] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T21:34:03.674719] [INFO ] [REMOTE ] TS: Full fetch complete (74485 records). [2025-09-30T21:34:03.675185] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-30T21:34:03.816217] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-30T21:34:04.095674] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T21:34:04.212459] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-30T21:34:04.212587] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-30T21:34:04.214080] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-30T21:34:04.214173] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-30T21:34:04.215872] [DEBUG] [LOCAL ] TS: Trimmed 74485 records to 51673 (keeping 200 days of data) [2025-09-30T21:34:04.277555] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-30T21:34:04.363039] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T21:34:04.598443] [DEBUG] [LOCAL ] TS: Primary data saved (51673 records). [2025-09-30T21:34:04.598599] [INFO ] [MAIN ] TS: Full history saved. [2025-09-30T21:34:04.598742] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TS took 34.6s. Estimated remaining: 30m 0s. Rate: 7.8 symbols/min [2025-09-30T21:34:04.784395] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:04.835287] [DEBUG] [LOCAL ] TSN: Loaded 52896 existing records from primary storage. [2025-09-30T21:34:04.835669] [INFO ] [MAIN ] TSN: Loaded 52896 existing records. [2025-09-30T21:34:05.024060] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:05.024299] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-30T21:34:05.024347] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-30T21:34:05.025556] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-30T21:34:05.025624] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-30T21:34:05.060596] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-30T21:34:05.463792] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:05.854416] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-30T21:34:06.654527] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-30T21:34:06.666465] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T21:34:06.945556] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-30T21:34:07.454383] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-30T21:34:07.681125] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T21:34:07.922059] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T21:34:08.254372] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-30T21:34:08.727969] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T21:34:09.054331] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-30T21:34:09.135037] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T21:34:09.854408] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-30T21:34:10.491548] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T21:34:10.654363] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-30T21:34:11.454332] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-30T21:34:11.914890] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T21:34:12.254363] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-30T21:34:12.462534] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-30T21:34:12.921699] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T21:34:13.054410] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-30T21:34:13.760763] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T21:34:13.854389] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-30T21:34:14.543236] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T21:34:14.581869] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T21:34:14.587378] [INFO ] [REMOTE ] TSE: Full fetch complete (41449 records). [2025-09-30T21:34:14.587522] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-30T21:34:14.659735] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-30T21:34:15.006802] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-30T21:34:15.006885] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-30T21:34:15.007803] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-30T21:34:15.007866] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-30T21:34:15.008920] [DEBUG] [LOCAL ] TSE: Trimmed 41449 records to 28411 (keeping 200 days of data) [2025-09-30T21:34:15.187633] [DEBUG] [LOCAL ] TSE: Primary data saved (28411 records). [2025-09-30T21:34:15.187837] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-30T21:34:15.187934] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSE took 37.9s. Estimated remaining: 29m 53s. Rate: 7.8 symbols/min [2025-09-30T21:34:15.369548] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:15.381190] [DEBUG] [LOCAL ] TSQ: Loaded 12000 existing records from primary storage. [2025-09-30T21:34:15.381415] [INFO ] [MAIN ] TSQ: Loaded 12000 existing records. [2025-09-30T21:34:15.462305] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-30T21:34:15.595773] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:15.596020] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-30T21:34:15.596076] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-30T21:34:15.596587] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-30T21:34:15.596738] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-30T21:34:16.016401] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:16.115285] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:34:16.254396] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-30T21:34:17.057090] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-30T21:34:17.060147] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T21:34:17.313218] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T21:34:17.854363] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-30T21:34:18.521093] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T21:34:18.654397] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-30T21:34:19.454353] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-30T21:34:19.512483] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:34:19.830606] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-30T21:34:20.254400] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-30T21:34:20.721843] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T21:34:21.054366] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-30T21:34:21.079406] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T21:34:21.854410] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-30T21:34:22.654391] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-30T21:34:23.454340] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-30T21:34:23.468869] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T21:34:23.725116] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T21:34:23.819323] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-30T21:34:24.254416] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-30T21:34:24.476140] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T21:34:24.484161] [INFO ] [REMOTE ] TSLX: Full fetch complete (49193 records). [2025-09-30T21:34:24.484348] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-30T21:34:24.905027] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-30T21:34:24.905115] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-30T21:34:24.905997] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-30T21:34:24.906059] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-30T21:34:24.907186] [DEBUG] [LOCAL ] TSLX: Trimmed 49193 records to 35140 (keeping 200 days of data) [2025-09-30T21:34:25.080008] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-30T21:34:25.138892] [DEBUG] [LOCAL ] TSLX: Primary data saved (35140 records). [2025-09-30T21:34:25.139088] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-30T21:34:25.139192] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 33.9s. Estimated remaining: 29m 45s. Rate: 7.8 symbols/min [2025-09-30T21:34:25.243374] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T21:34:25.340058] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:25.392090] [DEBUG] [LOCAL ] TT: Loaded 47762 existing records from primary storage. [2025-09-30T21:34:25.392514] [INFO ] [MAIN ] TT: Loaded 47762 existing records. [2025-09-30T21:34:25.578085] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:25.578298] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-30T21:34:25.578348] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-30T21:34:25.579458] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-30T21:34:25.579527] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-30T21:34:25.863720] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-30T21:34:25.957580] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:26.654399] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-30T21:34:27.387685] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-30T21:34:27.454364] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-30T21:34:27.700386] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T21:34:28.254363] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-30T21:34:28.904422] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-30T21:34:29.054362] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-30T21:34:29.122622] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T21:34:29.160276] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T21:34:29.854386] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-30T21:34:30.654431] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-30T21:34:31.227744] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T21:34:31.454416] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-30T21:34:31.636975] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T21:34:31.702997] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-30T21:34:32.254423] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-30T21:34:33.054409] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-30T21:34:33.152764] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T21:34:33.617069] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T21:34:33.792925] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T21:34:33.795511] [INFO ] [REMOTE ] TSQ: Full fetch complete (16551 records). [2025-09-30T21:34:33.795613] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-30T21:34:33.859436] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-30T21:34:34.195591] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-30T21:34:34.195698] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-30T21:34:34.196119] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-30T21:34:34.196161] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-30T21:34:34.197237] [DEBUG] [LOCAL ] TSQ: Trimmed 16551 records to 11991 (keeping 200 days of data) [2025-09-30T21:34:34.272119] [DEBUG] [LOCAL ] TSQ: Primary data saved (11991 records). [2025-09-30T21:34:34.272267] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-30T21:34:34.272355] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 19.1s. Estimated remaining: 29m 38s. Rate: 7.8 symbols/min [2025-09-30T21:34:34.460401] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:34.460592] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-30T21:34:34.460632] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-30T21:34:34.460767] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-30T21:34:34.460835] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-30T21:34:34.460894] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-30T21:34:34.460929] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-30T21:34:34.665382] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-30T21:34:34.852054] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:35.454370] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-30T21:34:35.657631] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:34:35.658092] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-30T21:34:35.658195] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:34:35.658243] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-30T21:34:35.658303] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:34:35.658376] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-30T21:34:35.658445] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-30T21:34:35.658484] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-30T21:34:35.658557] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-30T21:34:35.658697] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 1.4s. Estimated remaining: 29m 30s. Rate: 7.8 symbols/min [2025-09-30T21:34:35.839894] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:35.892838] [DEBUG] [LOCAL ] TTC: Loaded 42206 existing records from primary storage. [2025-09-30T21:34:35.893183] [INFO ] [MAIN ] TTC: Loaded 42206 existing records. [2025-09-30T21:34:36.092443] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:36.092699] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-30T21:34:36.092757] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-30T21:34:36.093829] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-30T21:34:36.093890] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-30T21:34:36.257314] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-30T21:34:36.490274] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:36.700865] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T21:34:36.826700] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-30T21:34:37.054369] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-30T21:34:37.854351] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-30T21:34:37.899689] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T21:34:38.654357] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-30T21:34:39.454364] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-30T21:34:39.744942] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-30T21:34:39.795209] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T21:34:40.254367] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-30T21:34:40.636036] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T21:34:40.958089] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T21:34:41.054370] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-30T21:34:41.854336] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-30T21:34:42.108278] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:34:42.120418] [INFO ] [REMOTE ] TSN: Full fetch complete (76301 records). [2025-09-30T21:34:42.120571] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-30T21:34:42.552966] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-30T21:34:42.553147] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-30T21:34:42.554557] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-30T21:34:42.554693] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-30T21:34:42.557056] [DEBUG] [LOCAL ] TSN: Trimmed 76301 records to 52902 (keeping 200 days of data) [2025-09-30T21:34:42.672415] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-30T21:34:42.646262] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:34:42.932237] [DEBUG] [LOCAL ] TSN: Primary data saved (52902 records). [2025-09-30T21:34:42.932393] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-30T21:34:42.932528] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 38.3s. Estimated remaining: 29m 22s. Rate: 7.8 symbols/min [2025-09-30T21:34:43.126989] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:43.188895] [DEBUG] [LOCAL ] TTE: Loaded 51619 existing records from primary storage. [2025-09-30T21:34:43.189270] [INFO ] [MAIN ] TTE: Loaded 51619 existing records. [2025-09-30T21:34:43.383912] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:43.384306] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-30T21:34:43.384363] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-30T21:34:43.385225] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-30T21:34:43.385287] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-30T21:34:43.459475] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-30T21:34:43.789058] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:43.819920] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T21:34:44.254349] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-30T21:34:45.054342] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-30T21:34:45.125804] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T21:34:45.161505] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-30T21:34:45.161827] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-30T21:34:45.163975] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T21:34:45.587841] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-30T21:34:45.588011] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-30T21:34:45.589281] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-30T21:34:45.589394] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-30T21:34:45.591085] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-09-30T21:34:45.855788] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-30T21:34:45.968473] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T21:34:45.992881] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-30T21:34:45.993178] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-30T21:34:45.993292] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSM took 46.1s. Estimated remaining: 29m 14s. Rate: 7.8 symbols/min [2025-09-30T21:34:46.172809] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:46.222425] [DEBUG] [LOCAL ] TTI: Loaded 45490 existing records from primary storage. [2025-09-30T21:34:46.222845] [INFO ] [MAIN ] TTI: Loaded 45490 existing records. [2025-09-30T21:34:46.413812] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:46.414018] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-30T21:34:46.414064] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-30T21:34:46.414905] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-30T21:34:46.414973] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-30T21:34:46.661757] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-30T21:34:46.796258] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:46.830521] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T21:34:47.454373] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-30T21:34:47.714933] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T21:34:48.254345] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-30T21:34:48.560676] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T21:34:48.873199] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:34:49.054367] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-30T21:34:49.450841] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T21:34:49.854370] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-30T21:34:50.490138] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:34:50.654364] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-30T21:34:51.454357] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-30T21:34:51.497192] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T21:34:52.254334] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-30T21:34:52.525883] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T21:34:52.643276] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T21:34:53.054385] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-30T21:34:53.854334] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-30T21:34:54.188416] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T21:34:54.198918] [INFO ] [REMOTE ] TT: Full fetch complete (69861 records). [2025-09-30T21:34:54.199061] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-30T21:34:54.634944] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-30T21:34:54.635087] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-30T21:34:54.636214] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-30T21:34:54.636436] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-30T21:34:54.638568] [DEBUG] [LOCAL ] TT: Trimmed 69861 records to 47747 (keeping 200 days of data) [2025-09-30T21:34:54.661287] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-30T21:34:54.667801] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T21:34:54.992299] [DEBUG] [LOCAL ] TT: Primary data saved (47747 records). [2025-09-30T21:34:54.992446] [INFO ] [MAIN ] TT: Full history saved. [2025-09-30T21:34:54.992571] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TT took 29.9s. Estimated remaining: 29m 6s. Rate: 7.8 symbols/min [2025-09-30T21:34:55.179408] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:34:55.238393] [DEBUG] [LOCAL ] TU: Loaded 49845 existing records from primary storage. [2025-09-30T21:34:55.238776] [INFO ] [MAIN ] TU: Loaded 49845 existing records. [2025-09-30T21:34:55.455152] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-30T21:34:55.462393] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:34:55.465167] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-30T21:34:55.465265] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-30T21:34:55.466465] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-30T21:34:55.466576] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-30T21:34:55.584502] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T21:34:55.934899] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:34:56.254457] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-30T21:34:56.701549] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T21:34:57.054342] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-30T21:34:57.188401] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:34:57.755351] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T21:34:57.854405] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-30T21:34:58.654351] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-30T21:34:58.776220] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T21:34:59.297133] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T21:34:59.454377] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-30T21:35:00.259435] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-30T21:35:00.277020] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T21:35:01.054410] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-30T21:35:01.775393] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-30T21:35:01.854479] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-30T21:35:02.068979] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:35:02.654386] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-30T21:35:02.733873] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T21:35:03.212008] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:35:03.454385] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-30T21:35:04.254378] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-30T21:35:04.556257] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T21:35:05.054342] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-30T21:35:05.219200] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T21:35:05.854347] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-30T21:35:06.098708] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T21:35:06.636248] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T21:35:06.649696] [INFO ] [REMOTE ] TTC: Full fetch complete (62204 records). [2025-09-30T21:35:06.649900] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-30T21:35:06.662736] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-30T21:35:07.074973] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-30T21:35:07.075066] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-30T21:35:07.076171] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-30T21:35:07.076239] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-30T21:35:07.077621] [DEBUG] [LOCAL ] TTC: Trimmed 62204 records to 42167 (keeping 200 days of data) [2025-09-30T21:35:07.359734] [DEBUG] [LOCAL ] TTC: Primary data saved (42167 records). [2025-09-30T21:35:07.360047] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-30T21:35:07.360228] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTC took 31.7s. Estimated remaining: 28m 59s. Rate: 7.8 symbols/min [2025-09-30T21:35:07.459103] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-30T21:35:07.577535] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:07.582640] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T21:35:07.644551] [DEBUG] [LOCAL ] TUYA: Loaded 46346 existing records from primary storage. [2025-09-30T21:35:07.644952] [INFO ] [MAIN ] TUYA: Loaded 46346 existing records. [2025-09-30T21:35:07.853754] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:07.853990] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-30T21:35:07.854040] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-30T21:35:07.854742] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-30T21:35:07.854805] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-30T21:35:08.245131] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:08.254314] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-30T21:35:08.422732] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T21:35:08.917899] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T21:35:09.054413] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-30T21:35:09.686853] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T21:35:09.854363] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-30T21:35:10.654335] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-30T21:35:10.844351] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T21:35:11.281583] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T21:35:11.454433] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-30T21:35:12.254384] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-30T21:35:12.502216] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:35:12.514506] [INFO ] [REMOTE ] TTE: Full fetch complete (75043 records). [2025-09-30T21:35:12.514760] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-30T21:35:12.946639] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-30T21:35:12.946808] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-30T21:35:12.948261] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-30T21:35:12.948338] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-30T21:35:12.950149] [DEBUG] [LOCAL ] TTE: Trimmed 75043 records to 51628 (keeping 200 days of data) [2025-09-30T21:35:13.054611] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-30T21:35:13.212253] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T21:35:13.336589] [DEBUG] [LOCAL ] TTE: Primary data saved (51628 records). [2025-09-30T21:35:13.336766] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-30T21:35:13.336860] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 30.4s. Estimated remaining: 28m 51s. Rate: 7.8 symbols/min [2025-09-30T21:35:13.515264] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:13.556168] [DEBUG] [LOCAL ] TV: Loaded 42765 existing records from primary storage. [2025-09-30T21:35:13.556534] [INFO ] [MAIN ] TV: Loaded 42765 existing records. [2025-09-30T21:35:13.747860] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:13.748124] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-30T21:35:13.748189] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-30T21:35:13.749153] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-30T21:35:13.749220] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-30T21:35:13.855000] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-30T21:35:14.159472] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:14.272156] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T21:35:14.654354] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-30T21:35:14.711337] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:35:15.454355] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-30T21:35:15.547098] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T21:35:16.214834] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T21:35:16.254353] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-30T21:35:17.054427] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-30T21:35:17.254840] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T21:35:17.854412] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-30T21:35:17.912046] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T21:35:18.598548] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:35:18.654339] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-30T21:35:19.454343] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-30T21:35:19.493528] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T21:35:20.057476] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T21:35:20.254357] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-30T21:35:20.910097] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:35:21.054365] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-30T21:35:21.861377] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-30T21:35:21.882597] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T21:35:22.654430] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-30T21:35:22.700373] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T21:35:22.710474] [INFO ] [REMOTE ] TTI: Full fetch complete (65117 records). [2025-09-30T21:35:22.710613] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-30T21:35:23.195239] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-30T21:35:23.195368] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-30T21:35:23.197597] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-30T21:35:23.197730] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-30T21:35:23.202398] [DEBUG] [LOCAL ] TTI: Trimmed 65117 records to 45500 (keeping 200 days of data) [2025-09-30T21:35:23.464392] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-30T21:35:23.594126] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T21:35:23.690258] [DEBUG] [LOCAL ] TTI: Primary data saved (45500 records). [2025-09-30T21:35:23.690495] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-30T21:35:23.690630] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 37.7s. Estimated remaining: 28m 44s. Rate: 7.8 symbols/min [2025-09-30T21:35:23.951493] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:23.957721] [DEBUG] [LOCAL ] TVC: Loaded 3412 existing records from primary storage. [2025-09-30T21:35:23.957971] [INFO ] [MAIN ] TVC: Loaded 3412 existing records. [2025-09-30T21:35:24.177945] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:24.178443] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-30T21:35:24.178507] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-30T21:35:24.178839] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-30T21:35:24.178917] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-30T21:35:24.258566] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-30T21:35:24.563127] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T21:35:24.671060] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:25.054320] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-30T21:35:25.243234] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T21:35:25.254352] [INFO ] [REMOTE ] TU: Full fetch complete (72883 records). [2025-09-30T21:35:25.254524] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-30T21:35:25.681979] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-30T21:35:25.682073] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-30T21:35:25.683275] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-30T21:35:25.683343] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-30T21:35:25.685003] [DEBUG] [LOCAL ] TU: Trimmed 72883 records to 49845 (keeping 200 days of data) [2025-09-30T21:35:25.876094] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-30T21:35:26.040266] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T21:35:26.062995] [DEBUG] [LOCAL ] TU: Primary data saved (49845 records). [2025-09-30T21:35:26.063139] [INFO ] [MAIN ] TU: Full history saved. [2025-09-30T21:35:26.063224] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 31.1s. Estimated remaining: 28m 35s. Rate: 7.8 symbols/min [2025-09-30T21:35:26.252978] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:26.257606] [DEBUG] [LOCAL ] TVE: Loaded 2753 existing records from primary storage. [2025-09-30T21:35:26.257817] [INFO ] [MAIN ] TVE: Loaded 2753 existing records. [2025-09-30T21:35:26.453317] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:26.453603] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-30T21:35:26.453799] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-30T21:35:26.454141] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-30T21:35:26.454204] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-30T21:35:26.577358] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T21:35:26.659926] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-30T21:35:26.780126] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T21:35:26.913970] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:27.315860] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T21:35:27.454340] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-30T21:35:27.915377] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T21:35:28.254386] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-30T21:35:29.054364] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-30T21:35:29.682542] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T21:35:29.844828] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T21:35:29.854400] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-30T21:35:30.464813] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T21:35:30.654372] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-30T21:35:31.454393] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-30T21:35:32.035512] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-30T21:35:32.254372] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-30T21:35:32.301403] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T21:35:32.754683] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T21:35:33.054334] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-30T21:35:33.713385] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T21:35:33.854368] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-30T21:35:34.273295] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T21:35:34.654345] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-30T21:35:35.454350] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-30T21:35:35.967706] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T21:35:36.254388] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-30T21:35:36.353320] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:35:36.743214] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T21:35:37.054360] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-30T21:35:37.619304] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T21:35:37.854404] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-30T21:35:38.654355] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-30T21:35:39.202178] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T21:35:39.203393] [INFO ] [REMOTE ] TVC: Full fetch complete (5606 records). [2025-09-30T21:35:39.203466] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-30T21:35:39.455480] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-30T21:35:39.599496] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-30T21:35:39.599599] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-30T21:35:39.599913] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-30T21:35:39.600008] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-30T21:35:39.600701] [DEBUG] [LOCAL ] TVC: Trimmed 5606 records to 3392 (keeping 200 days of data) [2025-09-30T21:35:39.645678] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:35:39.661266] [DEBUG] [LOCAL ] TVC: Primary data saved (3392 records). [2025-09-30T21:35:39.661376] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-30T21:35:39.661452] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TVC took 16.0s. Estimated remaining: 28m 28s. Rate: 7.8 symbols/min [2025-09-30T21:35:39.842857] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:39.878822] [DEBUG] [LOCAL ] TWI: Loaded 34294 existing records from primary storage. [2025-09-30T21:35:39.879139] [INFO ] [MAIN ] TWI: Loaded 34294 existing records. [2025-09-30T21:35:40.074860] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:40.075080] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-30T21:35:40.075169] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-30T21:35:40.076034] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-30T21:35:40.076095] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-30T21:35:40.260082] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-30T21:35:40.458880] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:41.054336] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-30T21:35:41.127273] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T21:35:41.137343] [INFO ] [REMOTE ] TUYA: Full fetch complete (65694 records). [2025-09-30T21:35:41.137530] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-30T21:35:41.613129] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-30T21:35:41.613458] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-30T21:35:41.614759] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-30T21:35:41.614853] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-30T21:35:41.640690] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T21:35:41.641601] [DEBUG] [LOCAL ] TUYA: Trimmed 65694 records to 46223 (keeping 200 days of data) [2025-09-30T21:35:41.749613] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T21:35:41.872334] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-30T21:35:41.951744] [DEBUG] [LOCAL ] TUYA: Primary data saved (46223 records). [2025-09-30T21:35:41.951922] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-30T21:35:41.952091] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TUYA took 34.6s. Estimated remaining: 28m 20s. Rate: 7.8 symbols/min [2025-09-30T21:35:42.158626] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:42.214562] [DEBUG] [LOCAL ] TWLO: Loaded 52709 existing records from primary storage. [2025-09-30T21:35:42.214975] [INFO ] [MAIN ] TWLO: Loaded 52709 existing records. [2025-09-30T21:35:42.420546] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:42.424556] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T21:35:42.426260] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-30T21:35:42.426321] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-30T21:35:42.427465] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-30T21:35:42.427537] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-30T21:35:42.659506] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-30T21:35:42.819043] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:43.198402] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T21:35:43.454365] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-30T21:35:44.254376] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-30T21:35:44.866863] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T21:35:45.054359] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-30T21:35:45.833113] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:35:45.854312] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-30T21:35:46.432797] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T21:35:46.654333] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-30T21:35:47.077304] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T21:35:47.151625] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T21:35:47.454362] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-30T21:35:48.254394] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-30T21:35:48.722705] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:35:49.054397] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-30T21:35:49.524924] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T21:35:49.854358] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-30T21:35:50.250506] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-30T21:35:50.251807] [INFO ] [REMOTE ] TVE: Full fetch complete (4447 records). [2025-09-30T21:35:50.251879] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-30T21:35:50.551305] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-30T21:35:50.659456] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-30T21:35:50.705339] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-30T21:35:50.705418] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-30T21:35:50.705575] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-30T21:35:50.705617] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-30T21:35:50.706078] [DEBUG] [LOCAL ] TVE: Trimmed 4447 records to 2810 (keeping 200 days of data) [2025-09-30T21:35:50.727083] [DEBUG] [LOCAL ] TVE: Primary data saved (2810 records). [2025-09-30T21:35:50.727214] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-30T21:35:50.727337] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVE took 24.7s. Estimated remaining: 28m 12s. Rate: 7.8 symbols/min [2025-09-30T21:35:50.916191] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:35:50.922163] [DEBUG] [LOCAL ] TWN: Loaded 3153 existing records from primary storage. [2025-09-30T21:35:50.922344] [INFO ] [MAIN ] TWN: Loaded 3153 existing records. [2025-09-30T21:35:51.114854] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:35:51.115081] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-30T21:35:51.115137] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-30T21:35:51.115558] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-30T21:35:51.115626] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-30T21:35:51.459539] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-30T21:35:51.530719] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:35:52.254362] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-30T21:35:52.967477] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-30T21:35:53.005143] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:35:53.054324] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-30T21:35:53.845533] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T21:35:53.854316] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-30T21:35:54.283821] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T21:35:54.654386] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-30T21:35:54.661322] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T21:35:55.454362] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-30T21:35:56.254343] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-30T21:35:56.631676] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T21:35:56.712391] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T21:35:57.022396] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:35:57.054310] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-30T21:35:57.854386] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-30T21:35:58.439625] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T21:35:58.654388] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-30T21:35:59.076744] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T21:35:59.454360] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-30T21:35:59.848939] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T21:36:00.060532] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T21:36:00.254398] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-30T21:36:01.054409] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-30T21:36:01.854419] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-30T21:36:02.391191] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T21:36:02.473740] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T21:36:02.483377] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T21:36:02.654364] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-30T21:36:03.454372] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-30T21:36:04.021872] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T21:36:04.254374] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-30T21:36:04.665734] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T21:36:04.674899] [INFO ] [REMOTE ] TV: Full fetch complete (62111 records). [2025-09-30T21:36:04.675105] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-30T21:36:05.075360] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-30T21:36:05.098173] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-30T21:36:05.098246] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-30T21:36:05.099397] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-30T21:36:05.099555] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-30T21:36:05.100902] [DEBUG] [LOCAL ] TV: Trimmed 62111 records to 42730 (keeping 200 days of data) [2025-09-30T21:36:05.250476] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T21:36:05.393713] [DEBUG] [LOCAL ] TV: Primary data saved (42730 records). [2025-09-30T21:36:05.393853] [INFO ] [MAIN ] TV: Full history saved. [2025-09-30T21:36:05.393940] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TV took 52.1s. Estimated remaining: 28m 5s. Rate: 7.8 symbols/min [2025-09-30T21:36:05.584108] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:05.634100] [DEBUG] [LOCAL ] TWO: Loaded 48311 existing records from primary storage. [2025-09-30T21:36:05.634424] [INFO ] [MAIN ] TWO: Loaded 48311 existing records. [2025-09-30T21:36:05.826521] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:05.826764] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-30T21:36:05.826820] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-30T21:36:05.827823] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-30T21:36:05.827885] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-30T21:36:05.861366] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-30T21:36:06.256047] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:06.654412] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-30T21:36:06.902164] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T21:36:06.960813] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T21:36:06.967821] [INFO ] [REMOTE ] TWI: Full fetch complete (52887 records). [2025-09-30T21:36:06.967948] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-30T21:36:07.402115] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-30T21:36:07.402204] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-30T21:36:07.403170] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-30T21:36:07.403234] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-30T21:36:07.404553] [DEBUG] [LOCAL ] TWI: Trimmed 52887 records to 34200 (keeping 200 days of data) [2025-09-30T21:36:07.462420] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-30T21:36:07.615086] [DEBUG] [LOCAL ] TWI: Primary data saved (34200 records). [2025-09-30T21:36:07.615283] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-30T21:36:07.615402] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWI took 28.0s. Estimated remaining: 27m 57s. Rate: 7.8 symbols/min [2025-09-30T21:36:07.800527] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:07.800735] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-30T21:36:07.800785] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-30T21:36:07.800925] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-30T21:36:07.800994] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-30T21:36:07.801051] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-30T21:36:07.801087] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-30T21:36:08.130890] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T21:36:08.206227] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:08.254377] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-30T21:36:08.388736] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T21:36:08.465382] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:36:08.465717] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-30T21:36:08.465810] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:36:08.465863] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-30T21:36:08.465922] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:36:08.465993] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-30T21:36:08.466058] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-30T21:36:08.466093] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-30T21:36:08.466164] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-30T21:36:08.466233] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 0.9s. Estimated remaining: 27m 49s. Rate: 7.8 symbols/min [2025-09-30T21:36:08.649533] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:08.672038] [DEBUG] [LOCAL ] TX: Loaded 23300 existing records from primary storage. [2025-09-30T21:36:08.672316] [INFO ] [MAIN ] TX: Loaded 23300 existing records. [2025-09-30T21:36:08.876093] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:08.876325] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-30T21:36:08.876379] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-30T21:36:08.877003] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-30T21:36:08.877078] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-30T21:36:09.054408] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-30T21:36:09.297071] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:09.854378] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-30T21:36:10.654406] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-30T21:36:10.771133] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:36:10.830189] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T21:36:11.454406] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-30T21:36:12.262614] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-30T21:36:12.265033] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T21:36:12.626027] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T21:36:12.901877] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T21:36:13.054380] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-30T21:36:13.854345] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-30T21:36:14.324559] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T21:36:14.442906] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T21:36:14.654403] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-30T21:36:15.108826] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T21:36:15.454370] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-30T21:36:15.830409] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-30T21:36:15.831904] [INFO ] [REMOTE ] TWN: Full fetch complete (5364 records). [2025-09-30T21:36:15.831991] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-30T21:36:16.252478] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-30T21:36:16.252569] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-30T21:36:16.252765] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-30T21:36:16.252828] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-30T21:36:16.253262] [DEBUG] [LOCAL ] TWN: Trimmed 5364 records to 3147 (keeping 200 days of data) [2025-09-30T21:36:16.254406] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-30T21:36:16.277476] [DEBUG] [LOCAL ] TWN: Primary data saved (3147 records). [2025-09-30T21:36:16.277721] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-30T21:36:16.277843] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWN took 25.6s. Estimated remaining: 27m 41s. Rate: 7.8 symbols/min [2025-09-30T21:36:16.493506] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:16.552685] [DEBUG] [LOCAL ] TXNM: Loaded 43630 existing records from primary storage. [2025-09-30T21:36:16.553022] [INFO ] [MAIN ] TXNM: Loaded 43630 existing records. [2025-09-30T21:36:16.745825] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:16.746091] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-30T21:36:16.746159] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-30T21:36:16.747291] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-30T21:36:16.747356] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-30T21:36:17.059574] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-30T21:36:17.134044] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:17.854384] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-30T21:36:17.902838] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:36:18.654414] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-30T21:36:19.125029] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T21:36:19.380823] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T21:36:19.454398] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-30T21:36:19.961826] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:36:20.254422] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-30T21:36:20.767577] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:36:21.054391] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-30T21:36:21.781696] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T21:36:21.854377] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-30T21:36:22.654374] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-30T21:36:22.846465] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T21:36:23.037772] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T21:36:23.049456] [INFO ] [REMOTE ] TWLO: Full fetch complete (76448 records). [2025-09-30T21:36:23.049602] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-30T21:36:23.460571] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-30T21:36:23.486450] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-30T21:36:23.486569] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-30T21:36:23.487736] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-30T21:36:23.487920] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-30T21:36:23.489574] [DEBUG] [LOCAL ] TWLO: Trimmed 76448 records to 52710 (keeping 200 days of data) [2025-09-30T21:36:23.826546] [DEBUG] [LOCAL ] TWLO: Primary data saved (52710 records). [2025-09-30T21:36:23.826753] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-30T21:36:23.826873] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWLO took 41.9s. Estimated remaining: 27m 33s. Rate: 7.8 symbols/min [2025-09-30T21:36:24.012334] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:24.033922] [DEBUG] [LOCAL ] TXO: Loaded 18852 existing records from primary storage. [2025-09-30T21:36:24.034186] [INFO ] [MAIN ] TXO: Loaded 18852 existing records. [2025-09-30T21:36:24.249827] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:24.250266] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-30T21:36:24.250325] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-30T21:36:24.250883] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-30T21:36:24.250947] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-30T21:36:24.266691] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-30T21:36:24.585131] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T21:36:24.679993] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:24.693792] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T21:36:25.054360] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-30T21:36:25.854362] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-30T21:36:25.987919] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:36:26.657406] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-30T21:36:26.663341] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T21:36:26.762512] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T21:36:27.231902] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T21:36:27.454366] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-30T21:36:28.254393] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-30T21:36:29.054419] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-30T21:36:29.294691] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T21:36:29.796345] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T21:36:29.854361] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-30T21:36:29.971178] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T21:36:30.654365] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-30T21:36:31.161595] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:36:31.453294] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T21:36:31.459480] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-30T21:36:32.254398] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-30T21:36:32.848960] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T21:36:33.054524] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-30T21:36:33.363624] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T21:36:33.854390] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-30T21:36:34.288811] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T21:36:34.428612] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T21:36:34.654375] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-30T21:36:35.454355] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-30T21:36:36.029499] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T21:36:36.254357] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-30T21:36:36.274979] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T21:36:37.054379] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-30T21:36:37.854376] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-30T21:36:37.983335] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T21:36:37.993959] [INFO ] [REMOTE ] TWO: Full fetch complete (69003 records). [2025-09-30T21:36:37.994133] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-30T21:36:38.444477] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-30T21:36:38.444287] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T21:36:38.444691] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-30T21:36:38.451798] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-30T21:36:38.451874] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-30T21:36:38.455329] [DEBUG] [LOCAL ] TWO: Trimmed 69003 records to 48314 (keeping 200 days of data) [2025-09-30T21:36:38.672815] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-30T21:36:38.760733] [DEBUG] [LOCAL ] TWO: Primary data saved (48314 records). [2025-09-30T21:36:38.760877] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-30T21:36:38.760983] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWO took 33.4s. Estimated remaining: 27m 26s. Rate: 7.8 symbols/min [2025-09-30T21:36:39.454338] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-30T21:36:39.476413] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T21:36:39.481796] [INFO ] [REMOTE ] TX: Full fetch complete (35880 records). [2025-09-30T21:36:39.481944] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-30T21:36:39.720781] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T21:36:39.948165] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-30T21:36:39.948248] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-30T21:36:39.948970] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-30T21:36:39.949033] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-30T21:36:39.949960] [DEBUG] [LOCAL ] TX: Trimmed 35880 records to 23324 (keeping 200 days of data) [2025-09-30T21:36:40.087693] [DEBUG] [LOCAL ] TX: Primary data saved (23324 records). [2025-09-30T21:36:40.087831] [INFO ] [MAIN ] TX: Full history saved. [2025-09-30T21:36:40.087913] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TX took 31.6s. Estimated remaining: 27m 18s. Rate: 7.8 symbols/min [2025-09-30T21:36:40.254383] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-30T21:36:40.686382] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T21:36:41.054368] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-30T21:36:41.802555] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T21:36:41.849945] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T21:36:41.854344] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-30T21:36:42.654368] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-30T21:36:43.484729] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T21:36:43.495270] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-30T21:36:43.539345] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T21:36:44.254370] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-30T21:36:45.037208] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T21:36:45.054305] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-30T21:36:45.269911] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T21:36:45.274498] [INFO ] [REMOTE ] TXO: Full fetch complete (26216 records). [2025-09-30T21:36:45.274668] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-30T21:36:45.699874] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-30T21:36:45.699961] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-30T21:36:45.700568] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-30T21:36:45.700610] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-30T21:36:45.701361] [DEBUG] [LOCAL ] TXO: Trimmed 26216 records to 18916 (keeping 200 days of data) [2025-09-30T21:36:45.822251] [DEBUG] [LOCAL ] TXO: Primary data saved (18916 records). [2025-09-30T21:36:45.822406] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-30T21:36:45.822491] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXO took 22.0s. Estimated remaining: 27m 10s. Rate: 7.8 symbols/min [2025-09-30T21:36:46.270276] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T21:36:46.278881] [INFO ] [REMOTE ] TXNM: Full fetch complete (62677 records). [2025-09-30T21:36:46.279026] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-30T21:36:46.691065] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-30T21:36:46.691167] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-30T21:36:46.692274] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-30T21:36:46.692343] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-30T21:36:46.693722] [DEBUG] [LOCAL ] TXNM: Trimmed 62677 records to 43548 (keeping 200 days of data) [2025-09-30T21:36:46.973749] [DEBUG] [LOCAL ] TXNM: Primary data saved (43548 records). [2025-09-30T21:36:46.973887] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-30T21:36:46.973972] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXNM took 30.7s. Estimated remaining: 27m 2s. Rate: 7.8 symbols/min [2025-09-30T21:36:47.554567] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:47.633881] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:47.721283] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:47.726510] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:36:47.748863] [DEBUG] [LOCAL ] TY: Loaded 7581 existing records from primary storage. [2025-09-30T21:36:47.749194] [DEBUG] [LOCAL ] TYG: Loaded 14195 existing records from primary storage. [2025-09-30T21:36:47.749565] [INFO ] [MAIN ] TY: Loaded 7581 existing records. [2025-09-30T21:36:47.767234] [INFO ] [MAIN ] TYG: Loaded 14195 existing records. [2025-09-30T21:36:47.871402] [DEBUG] [LOCAL ] TYL: Loaded 22172 existing records from primary storage. [2025-09-30T21:36:47.910615] [INFO ] [MAIN ] TYL: Loaded 22172 existing records. [2025-09-30T21:36:48.098302] [DEBUG] [LOCAL ] TXT: Loaded 49733 existing records from primary storage. [2025-09-30T21:36:48.182970] [INFO ] [MAIN ] TXT: Loaded 49733 existing records. [2025-09-30T21:36:48.251957] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:48.292294] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-30T21:36:48.362558] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-30T21:36:48.394818] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-30T21:36:48.409709] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-30T21:36:48.384399] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:48.528316] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-30T21:36:48.538848] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-30T21:36:48.523011] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:48.575632] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-30T21:36:48.570274] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-30T21:36:48.597147] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-30T21:36:48.611317] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-30T21:36:48.611407] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-30T21:36:48.627459] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-30T21:36:49.026373] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:36:49.069930] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-30T21:36:49.122355] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-30T21:36:49.311442] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-30T21:36:49.450949] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-30T21:36:49.809030] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:49.825136] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-30T21:36:49.993559] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:50.042292] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:50.052875] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-30T21:36:50.075534] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-30T21:36:50.337012] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:36:50.337310] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-30T21:36:50.675829] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T21:36:50.679005] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-30T21:36:50.993143] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:36:50.997962] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-30T21:36:51.057090] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T21:36:51.061663] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-30T21:36:51.227604] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T21:36:51.454351] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-30T21:36:51.746522] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T21:36:52.101780] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T21:36:52.184353] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T21:36:52.200302] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T21:36:52.254369] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-30T21:36:52.995903] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T21:36:53.054409] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-30T21:36:53.836219] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T21:36:53.854302] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-30T21:36:54.648819] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T21:36:54.654299] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-30T21:36:55.328840] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T21:36:55.454438] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-30T21:36:56.254324] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-30T21:36:56.363124] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T21:36:57.054373] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-30T21:36:57.336132] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:36:57.802270] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T21:36:57.854397] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-30T21:36:58.602814] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T21:36:58.654326] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-30T21:36:59.454352] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-30T21:36:59.939801] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T21:36:59.996893] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T21:37:00.254351] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-30T21:37:01.054399] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-30T21:37:01.722928] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:37:01.854338] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-30T21:37:02.167508] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T21:37:02.654386] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-30T21:37:03.454375] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-30T21:37:03.691893] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T21:37:03.837910] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:37:04.254362] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-30T21:37:04.620373] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T21:37:05.019039] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T21:37:05.021253] [INFO ] [REMOTE ] TY: Full fetch complete (11670 records). [2025-09-30T21:37:05.021335] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-30T21:37:05.059480] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-30T21:37:05.438263] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-30T21:37:05.438375] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-30T21:37:05.438682] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-30T21:37:05.438744] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-30T21:37:05.439224] [DEBUG] [LOCAL ] TY: Trimmed 11670 records to 7560 (keeping 200 days of data) [2025-09-30T21:37:05.489918] [DEBUG] [LOCAL ] TY: Primary data saved (7560 records). [2025-09-30T21:37:05.490076] [INFO ] [MAIN ] TY: Full history saved. [2025-09-30T21:37:05.490183] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 18.5s. Estimated remaining: 26m 55s. Rate: 7.8 symbols/min [2025-09-30T21:37:05.709241] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:05.764281] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-30T21:37:05.764634] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-30T21:37:05.859443] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-30T21:37:05.958023] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:37:05.958266] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-30T21:37:05.958317] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-30T21:37:05.959891] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-30T21:37:05.959961] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-30T21:37:06.348901] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:06.654351] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-30T21:37:06.752108] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:37:07.106955] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T21:37:07.190343] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-30T21:37:07.454377] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-30T21:37:08.254363] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-30T21:37:09.054382] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-30T21:37:09.373634] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:37:09.565437] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T21:37:09.854455] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-30T21:37:10.322400] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T21:37:10.654446] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-30T21:37:10.726768] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T21:37:11.454394] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-30T21:37:11.693470] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T21:37:12.254627] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-30T21:37:12.290039] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T21:37:12.294928] [INFO ] [REMOTE ] TYG: Full fetch complete (22527 records). [2025-09-30T21:37:12.295038] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-30T21:37:12.703392] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-30T21:37:12.703484] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-30T21:37:12.704065] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-30T21:37:12.704142] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-30T21:37:12.705069] [DEBUG] [LOCAL ] TYG: Trimmed 22527 records to 14191 (keeping 200 days of data) [2025-09-30T21:37:12.799033] [DEBUG] [LOCAL ] TYG: Primary data saved (14191 records). [2025-09-30T21:37:12.799214] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-30T21:37:12.799364] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 25.8s. Estimated remaining: 26m 48s. Rate: 7.8 symbols/min [2025-09-30T21:37:12.981452] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:12.981704] [DEBUG] [LOCAL ] UA: No existing data file found in primary storage. [2025-09-30T21:37:12.981761] [WARN ] [MAIN ] UA: No existing data found, performing full refresh instead. [2025-09-30T21:37:12.981896] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-30T21:37:12.981941] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-30T21:37:12.981982] [DEBUG] [LOCAL ] UA: No primary data file found to delete. [2025-09-30T21:37:12.982014] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-30T21:37:13.059706] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-30T21:37:13.377307] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:13.854416] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-30T21:37:14.353223] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T21:37:14.654439] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-30T21:37:14.977066] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T21:37:15.454437] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-30T21:37:15.603192] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T21:37:16.254383] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-30T21:37:16.650047] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T21:37:17.054396] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-30T21:37:17.252191] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T21:37:17.552865] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T21:37:17.810978] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T21:37:17.815977] [INFO ] [REMOTE ] TYL: Full fetch complete (31334 records). [2025-09-30T21:37:17.816073] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-30T21:37:17.859522] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-30T21:37:18.246678] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-30T21:37:18.246766] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-30T21:37:18.247477] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-30T21:37:18.247529] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-30T21:37:18.248332] [DEBUG] [LOCAL ] TYL: Trimmed 31334 records to 22196 (keeping 200 days of data) [2025-09-30T21:37:18.391897] [DEBUG] [LOCAL ] TYL: Primary data saved (22196 records). [2025-09-30T21:37:18.392042] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-30T21:37:18.392126] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYL took 31.4s. Estimated remaining: 26m 40s. Rate: 7.8 symbols/min [2025-09-30T21:37:18.576237] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:18.576505] [DEBUG] [LOCAL ] UAA: No existing data file found in primary storage. [2025-09-30T21:37:18.576557] [WARN ] [MAIN ] UAA: No existing data found, performing full refresh instead. [2025-09-30T21:37:18.576701] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-30T21:37:18.576770] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-30T21:37:18.576855] [DEBUG] [LOCAL ] UAA: No primary data file found to delete. [2025-09-30T21:37:18.576918] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-30T21:37:18.659610] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-30T21:37:18.966718] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:19.454374] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-30T21:37:19.591800] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:37:20.254352] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-30T21:37:20.501143] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T21:37:21.054413] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-30T21:37:21.107621] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T21:37:21.854348] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-30T21:37:21.972260] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:37:22.654394] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-30T21:37:23.454429] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-30T21:37:23.662269] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T21:37:23.866676] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-30T21:37:24.254357] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-30T21:37:24.424248] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:37:25.054370] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-30T21:37:25.484854] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T21:37:25.854413] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-30T21:37:26.080894] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T21:37:26.421401] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T21:37:26.654434] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-30T21:37:27.454397] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-30T21:37:27.936138] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T21:37:28.163475] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T21:37:28.254405] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-30T21:37:29.054376] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-30T21:37:29.248339] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T21:37:29.828794] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T21:37:29.839636] [INFO ] [REMOTE ] TXT: Full fetch complete (72262 records). [2025-09-30T21:37:29.839884] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-30T21:37:29.863720] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-30T21:37:30.269985] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-30T21:37:30.270161] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-30T21:37:30.271296] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-30T21:37:30.271363] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-30T21:37:30.272836] [DEBUG] [LOCAL ] TXT: Trimmed 72262 records to 49719 (keeping 200 days of data) [2025-09-30T21:37:30.555075] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T21:37:30.651934] [DEBUG] [LOCAL ] TXT: Primary data saved (49719 records). [2025-09-30T21:37:30.652093] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-30T21:37:30.652232] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 43.7s. Estimated remaining: 26m 32s. Rate: 7.8 symbols/min [2025-09-30T21:37:30.657903] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-30T21:37:30.851841] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:30.859935] [DEBUG] [LOCAL ] UAN: Loaded 5404 existing records from primary storage. [2025-09-30T21:37:30.860142] [INFO ] [MAIN ] UAN: Loaded 5404 existing records. [2025-09-30T21:37:31.060798] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:37:31.061187] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-30T21:37:31.061276] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-30T21:37:31.061760] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-30T21:37:31.061873] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-30T21:37:31.458949] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-30T21:37:31.489382] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:31.876241] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T21:37:32.254355] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-30T21:37:32.651959] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T21:37:32.961959] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T21:37:33.054390] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-30T21:37:33.752949] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T21:37:33.854378] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-30T21:37:34.654353] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-30T21:37:34.795673] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T21:37:34.809310] [INFO ] [REMOTE ] UA: Full fetch complete (73003 records). [2025-09-30T21:37:34.809509] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-30T21:37:35.275489] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-30T21:37:35.275587] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-30T21:37:35.277128] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-30T21:37:35.277207] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-30T21:37:35.278765] [DEBUG] [LOCAL ] UA: Trimmed 73003 records to 50459 (keeping 200 days of data) [2025-09-30T21:37:35.479821] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-30T21:37:35.580088] [DEBUG] [LOCAL ] UA: Primary data saved (50459 records). [2025-09-30T21:37:35.580236] [INFO ] [MAIN ] UA: Full history saved. [2025-09-30T21:37:35.580321] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UA took 22.8s. Estimated remaining: 26m 24s. Rate: 7.8 symbols/min [2025-09-30T21:37:35.757779] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:35.811253] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-30T21:37:35.811621] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-30T21:37:36.029917] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:37:36.031620] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T21:37:36.034892] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-30T21:37:36.035115] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-30T21:37:36.036189] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-30T21:37:36.036255] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-30T21:37:36.260966] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-30T21:37:36.477129] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:36.484025] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-30T21:37:36.530983] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T21:37:36.890810] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T21:37:37.054403] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-30T21:37:37.854372] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-30T21:37:38.470806] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T21:37:38.654366] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-30T21:37:39.296405] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T21:37:39.405394] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T21:37:39.454328] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-30T21:37:40.254366] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-30T21:37:41.054355] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-30T21:37:41.787610] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T21:37:41.854346] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-30T21:37:42.038707] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-30T21:37:42.284295] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T21:37:42.446372] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T21:37:42.654351] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-30T21:37:43.222537] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T21:37:43.454358] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-30T21:37:43.897517] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T21:37:44.254370] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-30T21:37:45.054358] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-30T21:37:45.854395] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-30T21:37:46.654331] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-30T21:37:46.733015] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-30T21:37:47.390576] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T21:37:47.392190] [INFO ] [REMOTE ] UAN: Full fetch complete (8128 records). [2025-09-30T21:37:47.392264] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-30T21:37:47.462441] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-30T21:37:47.850582] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T21:37:47.890524] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-30T21:37:47.890856] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-30T21:37:47.891192] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-30T21:37:47.891760] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-30T21:37:47.893084] [DEBUG] [LOCAL ] UAN: Trimmed 8128 records to 5387 (keeping 200 days of data) [2025-09-30T21:37:47.962511] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-09-30T21:37:47.979962] [DEBUG] [LOCAL ] UAN: Primary data saved (5387 records). [2025-09-30T21:37:47.980077] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-30T21:37:47.980153] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UAN took 17.3s. Estimated remaining: 26m 17s. Rate: 7.8 symbols/min [2025-09-30T21:37:48.162060] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:48.214263] [DEBUG] [LOCAL ] UBS: Loaded 52406 existing records from primary storage. [2025-09-30T21:37:48.214701] [INFO ] [MAIN ] UBS: Loaded 52406 existing records. [2025-09-30T21:37:48.260092] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-30T21:37:48.411950] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:37:48.412188] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-30T21:37:48.412235] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-30T21:37:48.413488] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-30T21:37:48.413555] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-30T21:37:48.799985] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:49.054383] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-30T21:37:49.854374] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-30T21:37:49.974965] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-30T21:37:49.987307] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-30T21:37:49.987545] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-30T21:37:50.415466] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-30T21:37:50.415626] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-30T21:37:50.416849] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-30T21:37:50.417005] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-30T21:37:50.418725] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-09-30T21:37:50.797601] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-30T21:37:50.811776] [INFO ] [MAIN ] U: Full history saved. [2025-09-30T21:37:50.812055] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. U took 45.3s. Estimated remaining: 26m 9s. Rate: 7.8 symbols/min [2025-09-30T21:37:50.831761] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-30T21:37:50.903365] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-30T21:37:51.086061] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:51.121373] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T21:37:51.164577] [DEBUG] [LOCAL ] UCB: Loaded 37898 existing records from primary storage. [2025-09-30T21:37:51.164944] [INFO ] [MAIN ] UCB: Loaded 37898 existing records. [2025-09-30T21:37:51.410500] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:37:51.411194] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-30T21:37:51.411500] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-30T21:37:51.412585] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-30T21:37:51.412686] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-30T21:37:51.456809] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-30T21:37:51.833556] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T21:37:51.838974] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:37:52.254397] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-30T21:37:53.023806] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T21:37:53.066671] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-30T21:37:53.073380] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T21:37:53.861143] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-30T21:37:53.868583] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:37:54.654371] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-30T21:37:54.818714] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T21:37:55.255027] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T21:37:55.454355] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-30T21:37:56.254325] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-30T21:37:56.453704] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T21:37:57.054374] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-30T21:37:57.420959] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T21:37:57.854338] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-30T21:37:57.908706] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T21:37:58.654323] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-30T21:37:58.787470] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T21:37:58.799506] [INFO ] [REMOTE ] UAA: Full fetch complete (77483 records). [2025-09-30T21:37:58.799731] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-30T21:37:59.204849] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-30T21:37:59.204963] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-30T21:37:59.206603] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-30T21:37:59.206694] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-30T21:37:59.208739] [DEBUG] [LOCAL ] UAA: Trimmed 77483 records to 53507 (keeping 200 days of data) [2025-09-30T21:37:59.455341] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-30T21:37:59.563198] [DEBUG] [LOCAL ] UAA: Primary data saved (53507 records). [2025-09-30T21:37:59.563478] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-30T21:37:59.563837] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 41.2s. Estimated remaining: 26m 1s. Rate: 7.8 symbols/min [2025-09-30T21:37:59.753156] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:37:59.822243] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T21:37:59.852876] [DEBUG] [LOCAL ] UDR: Loaded 51792 existing records from primary storage. [2025-09-30T21:37:59.853368] [INFO ] [MAIN ] UDR: Loaded 51792 existing records. [2025-09-30T21:38:00.055363] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:00.073169] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-30T21:38:00.073494] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-30T21:38:00.074871] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T21:38:00.081768] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-30T21:38:00.082373] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-30T21:38:00.273907] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-30T21:38:00.471264] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:01.054396] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-30T21:38:01.854491] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-30T21:38:01.953463] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T21:38:02.121762] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T21:38:02.358508] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T21:38:02.654404] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-30T21:38:03.366850] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T21:38:03.454399] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-30T21:38:03.942667] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T21:38:04.254345] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-30T21:38:05.059452] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-30T21:38:05.082087] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:38:05.453930] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T21:38:05.854399] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-30T21:38:06.654335] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-30T21:38:06.913615] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T21:38:07.454396] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-30T21:38:08.191336] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-30T21:38:08.254336] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-30T21:38:08.352715] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T21:38:08.941591] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:38:09.054400] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-30T21:38:09.211165] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T21:38:09.854375] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-30T21:38:10.654340] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-30T21:38:10.829236] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T21:38:11.279097] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T21:38:11.454357] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-30T21:38:12.254410] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-30T21:38:12.943612] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:38:12.987665] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-30T21:38:13.054382] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-30T21:38:13.854332] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-30T21:38:14.074579] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T21:38:14.088320] [INFO ] [REMOTE ] UBS: Full fetch complete (75642 records). [2025-09-30T21:38:14.088495] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-30T21:38:14.527196] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-30T21:38:14.527286] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-30T21:38:14.528563] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-30T21:38:14.528741] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-30T21:38:14.530323] [DEBUG] [LOCAL ] UBS: Trimmed 75642 records to 52407 (keeping 200 days of data) [2025-09-30T21:38:14.654586] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-30T21:38:14.879913] [DEBUG] [LOCAL ] UBS: Primary data saved (52407 records). [2025-09-30T21:38:14.880074] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-30T21:38:14.880164] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBS took 26.9s. Estimated remaining: 25m 54s. Rate: 7.8 symbols/min [2025-09-30T21:38:15.070263] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:15.112722] [DEBUG] [LOCAL ] UE: Loaded 42769 existing records from primary storage. [2025-09-30T21:38:15.113044] [INFO ] [MAIN ] UE: Loaded 42769 existing records. [2025-09-30T21:38:15.320456] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:15.321183] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-30T21:38:15.321522] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-30T21:38:15.322882] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-30T21:38:15.322952] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-30T21:38:15.680701] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-30T21:38:15.711434] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T21:38:15.755219] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-30T21:38:15.836241] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:16.094625] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T21:38:16.254420] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-30T21:38:17.054351] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-30T21:38:17.194713] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T21:38:17.594996] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T21:38:17.603067] [INFO ] [REMOTE ] UCB: Full fetch complete (54694 records). [2025-09-30T21:38:17.603220] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-30T21:38:17.866852] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-30T21:38:18.015735] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-30T21:38:18.015831] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-30T21:38:18.016891] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-30T21:38:18.017018] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-30T21:38:18.018599] [DEBUG] [LOCAL ] UCB: Trimmed 54694 records to 37859 (keeping 200 days of data) [2025-09-30T21:38:18.289058] [DEBUG] [LOCAL ] UCB: Primary data saved (37859 records). [2025-09-30T21:38:18.289282] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-30T21:38:18.289420] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 27.5s. Estimated remaining: 25m 46s. Rate: 7.8 symbols/min [2025-09-30T21:38:18.539282] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:18.541777] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T21:38:18.562417] [DEBUG] [LOCAL ] UFI: Loaded 8088 existing records from primary storage. [2025-09-30T21:38:18.562704] [INFO ] [MAIN ] UFI: Loaded 8088 existing records. [2025-09-30T21:38:18.659595] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-30T21:38:18.822623] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:18.822929] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-30T21:38:18.823008] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-30T21:38:18.823417] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-30T21:38:18.823498] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-30T21:38:19.425750] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:19.454425] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-30T21:38:20.016427] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T21:38:20.254343] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-30T21:38:20.419318] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T21:38:20.516361] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T21:38:20.726960] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T21:38:21.054358] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-30T21:38:21.854366] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-30T21:38:22.453420] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T21:38:22.628715] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T21:38:22.654382] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-30T21:38:23.204852] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T21:38:23.454403] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-30T21:38:24.235953] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T21:38:24.254362] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-30T21:38:25.054339] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-30T21:38:25.159038] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T21:38:25.854347] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-30T21:38:26.654380] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-30T21:38:27.177427] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T21:38:27.190001] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-30T21:38:27.190149] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-30T21:38:27.471149] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-30T21:38:27.693018] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-30T21:38:27.693178] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-30T21:38:27.694516] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-30T21:38:27.694848] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-30T21:38:27.697074] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:38:27.709849] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-09-30T21:38:28.060773] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-30T21:38:28.060945] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-30T21:38:28.061036] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UBER took 52.5s. Estimated remaining: 25m 39s. Rate: 7.8 symbols/min [2025-09-30T21:38:28.246702] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:28.254342] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-30T21:38:28.269564] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T21:38:28.306837] [DEBUG] [LOCAL ] UGI: Loaded 50508 existing records from primary storage. [2025-09-30T21:38:28.307197] [INFO ] [MAIN ] UGI: Loaded 50508 existing records. [2025-09-30T21:38:28.504476] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:28.505063] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-30T21:38:28.505133] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-30T21:38:28.517191] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-30T21:38:28.541711] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-30T21:38:28.614446] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T21:38:28.951096] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:29.054391] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-30T21:38:29.859477] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-30T21:38:29.874538] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T21:38:30.615393] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T21:38:30.620116] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T21:38:30.654355] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-30T21:38:31.454362] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-30T21:38:32.081748] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T21:38:32.169145] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T21:38:32.254361] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-30T21:38:33.054364] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-30T21:38:33.656195] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T21:38:33.804760] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T21:38:33.854357] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-30T21:38:34.593233] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T21:38:34.596152] [INFO ] [REMOTE ] UFI: Full fetch complete (12377 records). [2025-09-30T21:38:34.596291] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-30T21:38:34.664132] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-30T21:38:34.997309] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-30T21:38:34.997424] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-30T21:38:34.997782] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-30T21:38:34.997845] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-30T21:38:34.998539] [DEBUG] [LOCAL ] UFI: Trimmed 12377 records to 8082 (keeping 200 days of data) [2025-09-30T21:38:35.045338] [DEBUG] [LOCAL ] UFI: Primary data saved (8082 records). [2025-09-30T21:38:35.045474] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-30T21:38:35.045561] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UFI took 16.8s. Estimated remaining: 25m 31s. Rate: 7.8 symbols/min [2025-09-30T21:38:35.225228] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:35.266043] [DEBUG] [LOCAL ] UGP: Loaded 42809 existing records from primary storage. [2025-09-30T21:38:35.266343] [INFO ] [MAIN ] UGP: Loaded 42809 existing records. [2025-09-30T21:38:35.455097] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-30T21:38:35.454953] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:35.455485] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-30T21:38:35.456695] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-30T21:38:35.457593] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-30T21:38:35.457694] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-30T21:38:35.840174] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:36.254346] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-30T21:38:36.495435] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T21:38:36.773409] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:38:37.054358] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-30T21:38:37.847905] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T21:38:37.857712] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-30T21:38:38.367234] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T21:38:38.654366] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-30T21:38:39.454402] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-30T21:38:39.590044] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T21:38:39.606874] [INFO ] [REMOTE ] UDR: Full fetch complete (74536 records). [2025-09-30T21:38:39.607074] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-30T21:38:40.066239] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-30T21:38:40.066471] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-30T21:38:40.067731] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-30T21:38:40.067819] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-30T21:38:40.071925] [DEBUG] [LOCAL ] UDR: Trimmed 74536 records to 51821 (keeping 200 days of data) [2025-09-30T21:38:40.234408] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T21:38:40.284579] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-30T21:38:40.440537] [DEBUG] [LOCAL ] UDR: Primary data saved (51821 records). [2025-09-30T21:38:40.440717] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-30T21:38:40.440823] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UDR took 40.9s. Estimated remaining: 25m 23s. Rate: 7.8 symbols/min [2025-09-30T21:38:40.623139] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:40.642853] [DEBUG] [LOCAL ] UHAL: Loaded 16542 existing records from primary storage. [2025-09-30T21:38:40.643130] [INFO ] [MAIN ] UHAL: Loaded 16542 existing records. [2025-09-30T21:38:40.854637] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:40.854907] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-30T21:38:40.854967] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-30T21:38:40.855857] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-30T21:38:40.855920] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-30T21:38:41.055362] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-30T21:38:41.260604] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T21:38:41.293789] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:41.723789] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T21:38:41.854354] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-30T21:38:42.533538] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T21:38:42.543276] [INFO ] [REMOTE ] UE: Full fetch complete (61448 records). [2025-09-30T21:38:42.543423] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-30T21:38:42.663447] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-30T21:38:43.001827] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-30T21:38:43.001922] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-30T21:38:43.002928] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-30T21:38:43.002994] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-30T21:38:43.004354] [DEBUG] [LOCAL ] UE: Trimmed 61448 records to 42788 (keeping 200 days of data) [2025-09-30T21:38:43.280738] [DEBUG] [LOCAL ] UE: Primary data saved (42788 records). [2025-09-30T21:38:43.280874] [INFO ] [MAIN ] UE: Full history saved. [2025-09-30T21:38:43.280983] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 28.4s. Estimated remaining: 25m 15s. Rate: 7.8 symbols/min [2025-09-30T21:38:43.468783] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:38:43.464400] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-30T21:38:43.523958] [DEBUG] [LOCAL ] UHS: Loaded 40961 existing records from primary storage. [2025-09-30T21:38:43.524280] [INFO ] [MAIN ] UHS: Loaded 40961 existing records. [2025-09-30T21:38:43.716790] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:38:43.717694] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-30T21:38:43.717799] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-30T21:38:43.730573] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-30T21:38:43.748930] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-30T21:38:43.815005] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T21:38:44.171878] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:38:44.183929] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T21:38:44.214447] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:38:44.254374] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-30T21:38:45.054392] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-30T21:38:45.607765] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T21:38:45.843178] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T21:38:45.854307] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-30T21:38:46.654402] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-30T21:38:46.674800] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T21:38:47.454391] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-30T21:38:48.088296] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:38:48.158721] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T21:38:48.254367] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-30T21:38:49.054398] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-30T21:38:49.223847] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T21:38:49.854380] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-30T21:38:50.615947] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T21:38:50.654373] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-30T21:38:51.102902] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T21:38:51.454365] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-30T21:38:52.120773] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T21:38:52.254381] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-30T21:38:52.778888] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T21:38:53.054400] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-30T21:38:53.843869] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T21:38:53.861517] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-30T21:38:53.862757] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T21:38:54.654417] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-30T21:38:55.454351] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-30T21:38:55.547582] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T21:38:55.635695] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T21:38:56.254368] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-30T21:38:57.054326] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-30T21:38:57.166246] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T21:38:57.517791] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T21:38:57.854376] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-30T21:38:58.514699] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:38:58.654375] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-30T21:38:59.454341] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-30T21:38:59.549506] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T21:38:59.560636] [INFO ] [REMOTE ] UGI: Full fetch complete (73365 records). [2025-09-30T21:38:59.560838] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-30T21:38:59.760952] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T21:39:00.024754] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-30T21:39:00.024852] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-30T21:39:00.026026] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-30T21:39:00.026094] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-30T21:39:00.027625] [DEBUG] [LOCAL ] UGI: Trimmed 73365 records to 50512 (keeping 200 days of data) [2025-09-30T21:39:00.257153] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-30T21:39:00.366726] [DEBUG] [LOCAL ] UGI: Primary data saved (50512 records). [2025-09-30T21:39:00.366880] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-30T21:39:00.366986] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 32.3s. Estimated remaining: 25m 8s. Rate: 7.8 symbols/min [2025-09-30T21:39:00.547418] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:00.558554] [DEBUG] [LOCAL ] UHT: Loaded 9973 existing records from primary storage. [2025-09-30T21:39:00.558844] [INFO ] [MAIN ] UHT: Loaded 9973 existing records. [2025-09-30T21:39:00.760426] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:00.760852] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-30T21:39:00.760918] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-30T21:39:00.761322] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-30T21:39:00.761384] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-30T21:39:01.056254] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-30T21:39:01.156622] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:01.242392] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T21:39:01.854370] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-30T21:39:01.945449] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T21:39:02.067170] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T21:39:02.482057] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T21:39:02.654374] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-30T21:39:03.454350] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-30T21:39:04.222106] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T21:39:04.254339] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-30T21:39:05.059445] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-30T21:39:05.075906] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T21:39:05.094837] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T21:39:05.854373] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-30T21:39:06.080993] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T21:39:06.085975] [INFO ] [REMOTE ] UHAL: Full fetch complete (23158 records). [2025-09-30T21:39:06.086092] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-30T21:39:06.498105] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-30T21:39:06.498243] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-30T21:39:06.499053] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-30T21:39:06.499225] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-30T21:39:06.500046] [DEBUG] [LOCAL ] UHAL: Trimmed 23158 records to 16541 (keeping 200 days of data) [2025-09-30T21:39:06.607634] [DEBUG] [LOCAL ] UHAL: Primary data saved (16541 records). [2025-09-30T21:39:06.607812] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-30T21:39:06.608080] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UHAL took 26.2s. Estimated remaining: 25m 0s. Rate: 7.8 symbols/min [2025-09-30T21:39:06.659463] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-30T21:39:06.812684] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:06.832622] [DEBUG] [LOCAL ] UI: Loaded 12807 existing records from primary storage. [2025-09-30T21:39:06.832967] [INFO ] [MAIN ] UI: Loaded 12807 existing records. [2025-09-30T21:39:07.029589] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:07.029810] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-30T21:39:07.029860] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-30T21:39:07.030143] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-30T21:39:07.030232] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-30T21:39:07.432122] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:07.459535] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-30T21:39:07.478514] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T21:39:07.710579] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T21:39:07.936339] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T21:39:08.254420] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-30T21:39:09.054377] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-30T21:39:09.671937] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T21:39:09.854327] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-30T21:39:10.115451] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T21:39:10.654383] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-30T21:39:10.753306] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T21:39:11.454393] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-30T21:39:11.925841] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T21:39:11.939015] [INFO ] [REMOTE ] UGP: Full fetch complete (62186 records). [2025-09-30T21:39:11.939234] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-30T21:39:12.259539] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-30T21:39:12.405781] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-30T21:39:12.405881] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-30T21:39:12.407011] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-30T21:39:12.407079] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-30T21:39:12.410619] [DEBUG] [LOCAL ] UGP: Trimmed 62186 records to 42899 (keeping 200 days of data) [2025-09-30T21:39:12.472631] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T21:39:12.765669] [DEBUG] [LOCAL ] UGP: Primary data saved (42899 records). [2025-09-30T21:39:12.765834] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-30T21:39:12.765974] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UGP took 37.7s. Estimated remaining: 24m 53s. Rate: 7.8 symbols/min [2025-09-30T21:39:12.975401] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:13.024066] [DEBUG] [LOCAL ] UIS: Loaded 36931 existing records from primary storage. [2025-09-30T21:39:13.024351] [INFO ] [MAIN ] UIS: Loaded 36931 existing records. [2025-09-30T21:39:13.059085] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-30T21:39:13.221503] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:13.221793] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-30T21:39:13.221877] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-30T21:39:13.229992] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-30T21:39:13.230135] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-30T21:39:13.336973] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T21:39:13.649541] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:13.854319] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-30T21:39:14.593281] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T21:39:14.654393] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-30T21:39:14.683610] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T21:39:15.454380] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-30T21:39:16.200766] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T21:39:16.254376] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-30T21:39:16.843913] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T21:39:17.054421] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-30T21:39:17.696880] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T21:39:17.705754] [INFO ] [REMOTE ] UHS: Full fetch complete (58275 records). [2025-09-30T21:39:17.705922] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-30T21:39:17.865897] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-30T21:39:18.144615] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-30T21:39:18.144834] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-30T21:39:18.145805] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-30T21:39:18.145902] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-30T21:39:18.147121] [DEBUG] [LOCAL ] UHS: Trimmed 58275 records to 40923 (keeping 200 days of data) [2025-09-30T21:39:18.400987] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T21:39:18.444715] [DEBUG] [LOCAL ] UHS: Primary data saved (40923 records). [2025-09-30T21:39:18.444851] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-30T21:39:18.444952] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 35.2s. Estimated remaining: 24m 45s. Rate: 7.8 symbols/min [2025-09-30T21:39:18.631661] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:18.654371] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-30T21:39:18.694969] [DEBUG] [LOCAL ] UL: Loaded 53060 existing records from primary storage. [2025-09-30T21:39:18.695351] [INFO ] [MAIN ] UL: Loaded 53060 existing records. [2025-09-30T21:39:18.916316] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:18.917520] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T21:39:18.917712] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-30T21:39:18.917901] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-30T21:39:18.920985] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-30T21:39:18.921895] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-30T21:39:19.310136] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:19.454328] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-30T21:39:20.196997] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:39:20.254361] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-30T21:39:21.054335] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-30T21:39:21.342812] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T21:39:21.409693] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T21:39:21.619574] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T21:39:21.854399] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-30T21:39:22.654364] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-30T21:39:23.350388] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T21:39:23.454351] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-30T21:39:24.146560] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T21:39:24.246576] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:39:24.254303] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-30T21:39:25.054372] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-30T21:39:25.074159] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T21:39:25.723594] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T21:39:25.854376] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-30T21:39:26.654371] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-30T21:39:26.679245] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:39:27.454345] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-30T21:39:28.068686] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T21:39:28.241276] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T21:39:28.244106] [INFO ] [REMOTE ] UHT: Full fetch complete (15144 records). [2025-09-30T21:39:28.244194] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-30T21:39:28.259527] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-30T21:39:28.659232] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-30T21:39:28.659311] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-30T21:39:28.659660] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-30T21:39:28.659741] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-30T21:39:28.660276] [DEBUG] [LOCAL ] UHT: Trimmed 15144 records to 9964 (keeping 200 days of data) [2025-09-30T21:39:28.724625] [DEBUG] [LOCAL ] UHT: Primary data saved (9964 records). [2025-09-30T21:39:28.724786] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-30T21:39:28.724870] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 28.4s. Estimated remaining: 24m 37s. Rate: 7.8 symbols/min [2025-09-30T21:39:28.906836] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:28.954456] [DEBUG] [LOCAL ] ULS: Loaded 39257 existing records from primary storage. [2025-09-30T21:39:28.954790] [INFO ] [MAIN ] ULS: Loaded 39257 existing records. [2025-09-30T21:39:29.061868] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-30T21:39:29.166132] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:29.166414] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-30T21:39:29.166489] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-30T21:39:29.167198] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-30T21:39:29.167276] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-30T21:39:29.561051] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:29.775931] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T21:39:29.837063] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:39:29.854310] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-30T21:39:30.654388] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-30T21:39:30.970787] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:39:31.388116] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T21:39:31.454348] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-30T21:39:32.254370] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-30T21:39:33.054363] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-30T21:39:33.285988] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T21:39:33.375083] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T21:39:33.854363] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-30T21:39:33.997371] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T21:39:34.654377] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-30T21:39:35.105791] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T21:39:35.269067] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T21:39:35.454400] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-30T21:39:36.254371] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-30T21:39:36.513252] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T21:39:36.522527] [INFO ] [REMOTE ] UIS: Full fetch complete (51737 records). [2025-09-30T21:39:36.522721] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-30T21:39:36.968204] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-30T21:39:36.968358] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-30T21:39:36.969310] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-30T21:39:36.969403] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-30T21:39:36.970861] [DEBUG] [LOCAL ] UIS: Trimmed 51737 records to 36971 (keeping 200 days of data) [2025-09-30T21:39:37.058847] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-30T21:39:37.197172] [DEBUG] [LOCAL ] UIS: Primary data saved (36971 records). [2025-09-30T21:39:37.197326] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-30T21:39:37.197413] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UIS took 24.4s. Estimated remaining: 24m 30s. Rate: 7.8 symbols/min [2025-09-30T21:39:37.371343] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:37.429165] [DEBUG] [LOCAL ] UMC: Loaded 52708 existing records from primary storage. [2025-09-30T21:39:37.429529] [INFO ] [MAIN ] UMC: Loaded 52708 existing records. [2025-09-30T21:39:37.635677] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:37.635989] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-30T21:39:37.636089] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-30T21:39:37.636699] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-30T21:39:37.636785] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-30T21:39:37.859609] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-30T21:39:38.038857] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:38.089706] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T21:39:38.297515] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T21:39:38.622764] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T21:39:38.654317] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-30T21:39:39.454322] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-30T21:39:39.897833] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T21:39:40.254353] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-30T21:39:41.054381] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-30T21:39:41.193424] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T21:39:41.751731] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T21:39:41.854341] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-30T21:39:42.096179] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T21:39:42.100744] [INFO ] [REMOTE ] UI: Full fetch complete (18539 records). [2025-09-30T21:39:42.100849] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-30T21:39:42.493023] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-30T21:39:42.493139] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-30T21:39:42.493576] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-30T21:39:42.493638] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-30T21:39:42.495792] [DEBUG] [LOCAL ] UI: Trimmed 18539 records to 13038 (keeping 200 days of data) [2025-09-30T21:39:42.580439] [DEBUG] [LOCAL ] UI: Primary data saved (13038 records). [2025-09-30T21:39:42.580624] [INFO ] [MAIN ] UI: Full history saved. [2025-09-30T21:39:42.580769] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UI took 36.0s. Estimated remaining: 24m 22s. Rate: 7.8 symbols/min [2025-09-30T21:39:42.660480] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-30T21:39:42.766981] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:42.817977] [DEBUG] [LOCAL ] UMH: Loaded 33623 existing records from primary storage. [2025-09-30T21:39:42.818348] [INFO ] [MAIN ] UMH: Loaded 33623 existing records. [2025-09-30T21:39:43.004816] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:43.005044] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-30T21:39:43.005093] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-30T21:39:43.005582] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-30T21:39:43.005673] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-30T21:39:43.391810] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:43.454316] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-30T21:39:43.539694] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T21:39:44.254377] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-30T21:39:44.291940] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:39:44.801589] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T21:39:45.054393] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-30T21:39:45.854378] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-30T21:39:46.069358] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T21:39:46.654358] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-30T21:39:46.842141] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T21:39:46.947620] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T21:39:47.454410] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-30T21:39:48.254382] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-30T21:39:48.405570] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T21:39:49.054345] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-30T21:39:49.094509] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:39:49.339017] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:39:49.854408] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-30T21:39:50.654330] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-30T21:39:50.858351] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T21:39:51.225009] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T21:39:51.454358] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-30T21:39:52.254350] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-30T21:39:52.293616] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T21:39:52.582999] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T21:39:53.054377] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-30T21:39:53.854386] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-30T21:39:54.140956] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T21:39:54.199076] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T21:39:54.654397] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-30T21:39:55.454347] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-30T21:39:55.508723] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T21:39:56.254366] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-30T21:39:56.631758] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T21:39:56.665392] [INFO ] [REMOTE ] UL: Full fetch complete (76876 records). [2025-09-30T21:39:56.668307] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-30T21:39:56.669451] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T21:39:57.067790] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-30T21:39:57.093187] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-30T21:39:57.093270] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-30T21:39:57.094454] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-30T21:39:57.094521] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-30T21:39:57.096935] [DEBUG] [LOCAL ] UL: Trimmed 76876 records to 53057 (keeping 200 days of data) [2025-09-30T21:39:57.439515] [DEBUG] [LOCAL ] UL: Primary data saved (53057 records). [2025-09-30T21:39:57.439806] [INFO ] [MAIN ] UL: Full history saved. [2025-09-30T21:39:57.439906] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 39.0s. Estimated remaining: 24m 15s. Rate: 7.8 symbols/min [2025-09-30T21:39:57.631391] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:39:57.646461] [DEBUG] [LOCAL ] UNF: Loaded 11964 existing records from primary storage. [2025-09-30T21:39:57.646702] [INFO ] [MAIN ] UNF: Loaded 11964 existing records. [2025-09-30T21:39:57.838776] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:39:57.865926] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-30T21:39:57.871688] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:39:57.884624] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-30T21:39:57.884721] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-30T21:39:57.885176] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-30T21:39:57.885237] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-30T21:39:58.263818] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:39:58.506469] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T21:39:58.654420] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-30T21:39:59.454371] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-30T21:39:59.827077] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T21:40:00.097561] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T21:40:00.169001] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T21:40:00.254341] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-30T21:40:01.054366] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-30T21:40:01.739781] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T21:40:01.748472] [INFO ] [REMOTE ] ULS: Full fetch complete (54446 records). [2025-09-30T21:40:01.748674] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-30T21:40:01.859613] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-30T21:40:02.172461] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-30T21:40:02.172562] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-30T21:40:02.173709] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-30T21:40:02.173785] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-30T21:40:02.175091] [DEBUG] [LOCAL ] ULS: Trimmed 54446 records to 39433 (keeping 200 days of data) [2025-09-30T21:40:02.448125] [DEBUG] [LOCAL ] ULS: Primary data saved (39433 records). [2025-09-30T21:40:02.448333] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-30T21:40:02.448515] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 33.7s. Estimated remaining: 24m 7s. Rate: 7.8 symbols/min [2025-09-30T21:40:02.656580] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:02.655692] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-30T21:40:02.705364] [DEBUG] [LOCAL ] UNFI: Loaded 41830 existing records from primary storage. [2025-09-30T21:40:02.705778] [INFO ] [MAIN ] UNFI: Loaded 41830 existing records. [2025-09-30T21:40:02.909126] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:02.909745] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-30T21:40:02.909911] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-30T21:40:02.910881] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-30T21:40:02.910971] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-30T21:40:03.036215] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T21:40:03.174793] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T21:40:03.420133] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:03.454401] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-30T21:40:04.123892] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T21:40:04.254352] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-30T21:40:05.053926] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:40:05.062299] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-30T21:40:05.491871] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T21:40:05.500621] [INFO ] [REMOTE ] UMH: Full fetch complete (46647 records). [2025-09-30T21:40:05.500816] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-30T21:40:05.859462] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-30T21:40:05.944519] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-30T21:40:05.944667] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-30T21:40:05.953018] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-30T21:40:05.953392] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-30T21:40:05.953264] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:40:05.958503] [DEBUG] [LOCAL ] UMH: Trimmed 46647 records to 33624 (keeping 200 days of data) [2025-09-30T21:40:06.175691] [DEBUG] [LOCAL ] UMH: Primary data saved (33624 records). [2025-09-30T21:40:06.175851] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-30T21:40:06.175941] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMH took 23.6s. Estimated remaining: 23m 59s. Rate: 7.8 symbols/min [2025-09-30T21:40:06.358402] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:06.424903] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-30T21:40:06.425258] [INFO ] [MAIN ] UNH: Loaded 53794 existing records. [2025-09-30T21:40:06.621929] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:06.622164] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-30T21:40:06.622215] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-30T21:40:06.623065] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-30T21:40:06.623132] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-30T21:40:06.659493] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-30T21:40:07.027485] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:07.454338] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-30T21:40:07.477316] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T21:40:08.254332] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-30T21:40:08.529783] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T21:40:08.613120] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T21:40:09.054370] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-30T21:40:09.454143] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T21:40:09.854369] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-30T21:40:10.179809] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T21:40:10.654375] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-30T21:40:11.454332] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-30T21:40:11.499773] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:40:11.639767] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T21:40:12.254376] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-30T21:40:13.054384] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-30T21:40:13.854334] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-30T21:40:13.929519] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:40:13.973563] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-30T21:40:14.441888] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T21:40:14.654395] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-30T21:40:15.015750] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T21:40:15.454355] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-30T21:40:15.466243] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:40:16.254363] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-30T21:40:17.023416] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T21:40:17.054329] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-30T21:40:17.801362] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-30T21:40:17.854406] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-30T21:40:18.523875] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T21:40:18.654358] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-30T21:40:19.459982] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-30T21:40:19.466308] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T21:40:20.254394] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-30T21:40:21.054337] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-30T21:40:21.149620] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-30T21:40:21.189724] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:40:21.211854] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T21:40:21.216425] [INFO ] [REMOTE ] UNF: Full fetch complete (17274 records). [2025-09-30T21:40:21.216541] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-30T21:40:21.662513] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-30T21:40:21.662605] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-30T21:40:21.663041] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-30T21:40:21.663106] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-30T21:40:21.663842] [DEBUG] [LOCAL ] UNF: Trimmed 17274 records to 12028 (keeping 200 days of data) [2025-09-30T21:40:21.745389] [DEBUG] [LOCAL ] UNF: Primary data saved (12028 records). [2025-09-30T21:40:21.745539] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-30T21:40:21.745623] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UNF took 24.3s. Estimated remaining: 23m 52s. Rate: 7.8 symbols/min [2025-09-30T21:40:21.859509] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-30T21:40:21.929033] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:21.983197] [DEBUG] [LOCAL ] UNM: Loaded 48581 existing records from primary storage. [2025-09-30T21:40:21.983529] [INFO ] [MAIN ] UNM: Loaded 48581 existing records. [2025-09-30T21:40:22.176525] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:22.176805] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-30T21:40:22.176861] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-30T21:40:22.177620] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-30T21:40:22.177714] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-30T21:40:22.643285] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:22.654393] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-30T21:40:23.015557] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T21:40:23.033515] [INFO ] [REMOTE ] UMC: Full fetch complete (76589 records). [2025-09-30T21:40:23.033777] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-30T21:40:23.464019] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-30T21:40:23.592973] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-30T21:40:23.593199] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-30T21:40:23.594859] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-30T21:40:23.594956] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-30T21:40:23.597368] [DEBUG] [LOCAL ] UMC: Trimmed 76589 records to 52711 (keeping 200 days of data) [2025-09-30T21:40:23.735670] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T21:40:23.979802] [DEBUG] [LOCAL ] UMC: Primary data saved (52711 records). [2025-09-30T21:40:23.979954] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-30T21:40:23.980055] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UMC took 46.8s. Estimated remaining: 23m 43s. Rate: 7.8 symbols/min [2025-09-30T21:40:24.178582] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:24.185382] [DEBUG] [LOCAL ] UNMA: Loaded 3529 existing records from primary storage. [2025-09-30T21:40:24.185553] [INFO ] [MAIN ] UNMA: Loaded 3529 existing records. [2025-09-30T21:40:24.257091] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-30T21:40:24.378186] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:24.378451] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-30T21:40:24.378692] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-30T21:40:24.379024] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-30T21:40:24.379132] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-30T21:40:24.518820] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T21:40:24.801749] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:25.054375] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-30T21:40:25.417898] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T21:40:25.650477] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T21:40:25.854392] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-30T21:40:26.654397] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-30T21:40:26.762341] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-30T21:40:27.394599] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T21:40:27.454326] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-30T21:40:27.929221] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:40:28.254369] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-30T21:40:29.054377] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-30T21:40:29.142980] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T21:40:29.152625] [INFO ] [REMOTE ] UNFI: Full fetch complete (59124 records). [2025-09-30T21:40:29.152780] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-30T21:40:29.573019] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-30T21:40:29.573139] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-30T21:40:29.574274] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-30T21:40:29.574345] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-30T21:40:29.576220] [DEBUG] [LOCAL ] UNFI: Trimmed 59124 records to 41874 (keeping 200 days of data) [2025-09-30T21:40:29.833298] [DEBUG] [LOCAL ] UNFI: Primary data saved (41874 records). [2025-09-30T21:40:29.833451] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-30T21:40:29.833540] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 27.4s. Estimated remaining: 23m 36s. Rate: 7.8 symbols/min [2025-09-30T21:40:29.866195] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-30T21:40:30.028494] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:30.090716] [DEBUG] [LOCAL ] UNP: Loaded 53265 existing records from primary storage. [2025-09-30T21:40:30.091066] [INFO ] [MAIN ] UNP: Loaded 53265 existing records. [2025-09-30T21:40:30.287848] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:30.288927] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-30T21:40:30.289013] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-30T21:40:30.289723] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-30T21:40:30.289784] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-30T21:40:30.593667] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T21:40:30.676006] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-30T21:40:30.720213] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:30.752637] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T21:40:31.107099] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T21:40:31.111612] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-30T21:40:31.454365] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-30T21:40:32.254371] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-30T21:40:33.054353] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-30T21:40:33.854331] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-30T21:40:34.075290] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T21:40:34.215764] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-30T21:40:34.437578] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T21:40:34.592461] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T21:40:34.654366] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-30T21:40:35.231304] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-30T21:40:35.454362] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-30T21:40:36.007525] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T21:40:36.254366] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-30T21:40:37.054351] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-30T21:40:37.821322] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:40:37.854316] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-30T21:40:38.654361] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-30T21:40:39.454369] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-30T21:40:39.534177] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T21:40:39.828322] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-30T21:40:40.254415] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-30T21:40:40.564132] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T21:40:40.884216] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T21:40:41.054379] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-30T21:40:41.854385] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-30T21:40:42.654372] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-30T21:40:42.782941] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (5.73 seconds). [2025-09-30T21:40:42.988150] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T21:40:43.063434] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-30T21:40:43.163225] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T21:40:43.454380] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-30T21:40:44.254378] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-30T21:40:44.872121] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T21:40:44.873470] [INFO ] [REMOTE ] UNMA: Full fetch complete (5813 records). [2025-09-30T21:40:44.873542] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-30T21:40:45.059524] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-30T21:40:45.266833] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-30T21:40:45.266912] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-30T21:40:45.267094] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-30T21:40:45.267135] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-30T21:40:45.267538] [DEBUG] [LOCAL ] UNMA: Trimmed 5813 records to 3536 (keeping 200 days of data) [2025-09-30T21:40:45.289789] [DEBUG] [LOCAL ] UNMA: Primary data saved (3536 records). [2025-09-30T21:40:45.289919] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-30T21:40:45.290005] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 21.3s. Estimated remaining: 23m 29s. Rate: 7.8 symbols/min [2025-09-30T21:40:45.483118] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:45.534816] [DEBUG] [LOCAL ] UP: Loaded 43110 existing records from primary storage. [2025-09-30T21:40:45.535236] [INFO ] [MAIN ] UP: Loaded 43110 existing records. [2025-09-30T21:40:45.745602] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:45.745879] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-30T21:40:45.745940] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-30T21:40:45.746742] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-30T21:40:45.746808] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-30T21:40:45.862005] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-30T21:40:46.156437] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:46.200863] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-30T21:40:46.509608] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T21:40:46.654372] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-30T21:40:47.454384] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-30T21:40:47.882071] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T21:40:48.254369] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-30T21:40:48.333233] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T21:40:49.054376] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-30T21:40:49.854352] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-30T21:40:50.052186] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:40:50.128995] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-30T21:40:50.140859] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-09-30T21:40:50.141007] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-30T21:40:50.614852] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-30T21:40:50.614951] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-30T21:40:50.616068] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-30T21:40:50.616134] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-30T21:40:50.617874] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53795 (keeping 200 days of data) [2025-09-30T21:40:50.678146] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-30T21:40:50.754712] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T21:40:51.019528] [DEBUG] [LOCAL ] UNH: Primary data saved (53795 records). [2025-09-30T21:40:51.019741] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-30T21:40:51.019840] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 44.8s. Estimated remaining: 23m 21s. Rate: 7.8 symbols/min [2025-09-30T21:40:51.203604] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:51.269031] [DEBUG] [LOCAL ] UPS: Loaded 53711 existing records from primary storage. [2025-09-30T21:40:51.269483] [INFO ] [MAIN ] UPS: Loaded 53711 existing records. [2025-09-30T21:40:51.465972] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-30T21:40:51.472513] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:51.474409] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-30T21:40:51.474511] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-30T21:40:51.475278] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-30T21:40:51.475556] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-30T21:40:51.615066] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T21:40:51.940955] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:52.254346] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-30T21:40:52.725229] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T21:40:52.956395] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T21:40:53.054355] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-30T21:40:53.854335] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-30T21:40:54.015988] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T21:40:54.654338] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-30T21:40:54.839888] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T21:40:55.355061] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T21:40:55.454417] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-30T21:40:56.254417] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-30T21:40:56.317214] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T21:40:57.054388] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-30T21:40:57.241934] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T21:40:57.253370] [INFO ] [REMOTE ] UNM: Full fetch complete (70023 records). [2025-09-30T21:40:57.253527] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-30T21:40:57.694899] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-30T21:40:57.695025] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-30T21:40:57.696434] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-30T21:40:57.696528] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-30T21:40:57.723204] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:40:57.735359] [DEBUG] [LOCAL ] UNM: Trimmed 70023 records to 48524 (keeping 200 days of data) [2025-09-30T21:40:57.855084] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-30T21:40:58.044872] [DEBUG] [LOCAL ] UNM: Primary data saved (48524 records). [2025-09-30T21:40:58.045062] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-30T21:40:58.045187] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 36.3s. Estimated remaining: 23m 13s. Rate: 7.8 symbols/min [2025-09-30T21:40:58.235350] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:40:58.281168] [DEBUG] [LOCAL ] URI: Loaded 35898 existing records from primary storage. [2025-09-30T21:40:58.281475] [INFO ] [MAIN ] URI: Loaded 35898 existing records. [2025-09-30T21:40:58.467226] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:40:58.467438] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-30T21:40:58.467484] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-30T21:40:58.468055] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-30T21:40:58.468117] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-30T21:40:58.656108] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-30T21:40:58.853335] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:40:59.130409] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-30T21:40:59.392462] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T21:40:59.454347] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-30T21:41:00.254350] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-30T21:41:00.728536] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T21:41:01.054367] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-30T21:41:01.336625] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T21:41:01.627169] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T21:41:01.854396] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-30T21:41:02.654414] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-30T21:41:02.755514] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:41:03.430140] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T21:41:03.454373] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-30T21:41:04.254372] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-30T21:41:04.704102] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T21:41:05.054337] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-30T21:41:05.144983] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T21:41:05.858292] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-30T21:41:05.863724] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:41:06.654364] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-30T21:41:07.128634] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T21:41:07.140257] [INFO ] [REMOTE ] UNP: Full fetch complete (76920 records). [2025-09-30T21:41:07.140424] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-30T21:41:07.462747] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-30T21:41:07.576910] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-30T21:41:07.577003] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-30T21:41:07.578380] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-30T21:41:07.578494] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-30T21:41:07.580201] [DEBUG] [LOCAL ] UNP: Trimmed 76920 records to 53267 (keeping 200 days of data) [2025-09-30T21:41:07.935361] [DEBUG] [LOCAL ] UNP: Primary data saved (53267 records). [2025-09-30T21:41:07.935516] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-30T21:41:07.935603] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 38.1s. Estimated remaining: 23m 5s. Rate: 7.8 symbols/min [2025-09-30T21:41:08.120274] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:08.173662] [DEBUG] [LOCAL ] USA: Loaded 35934 existing records from primary storage. [2025-09-30T21:41:08.174101] [INFO ] [MAIN ] USA: Loaded 35934 existing records. [2025-09-30T21:41:08.436893] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:08.441492] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-30T21:41:08.438924] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-30T21:41:08.466818] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-30T21:41:08.483639] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-30T21:41:08.483993] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-30T21:41:08.489559] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-30T21:41:08.525273] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T21:41:08.913555] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:09.009710] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:41:09.054376] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-30T21:41:09.854394] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-30T21:41:10.642747] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-30T21:41:10.654377] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-30T21:41:11.125428] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T21:41:11.138019] [INFO ] [REMOTE ] UP: Full fetch complete (62292 records). [2025-09-30T21:41:11.138181] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-30T21:41:11.461254] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-30T21:41:11.630256] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-30T21:41:11.630598] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-30T21:41:11.631905] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-30T21:41:11.632005] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-30T21:41:11.670911] [DEBUG] [LOCAL ] UP: Trimmed 62292 records to 43136 (keeping 200 days of data) [2025-09-30T21:41:11.675806] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T21:41:11.803849] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T21:41:11.981849] [DEBUG] [LOCAL ] UP: Primary data saved (43136 records). [2025-09-30T21:41:11.982006] [INFO ] [MAIN ] UP: Full history saved. [2025-09-30T21:41:11.982153] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 26.7s. Estimated remaining: 22m 57s. Rate: 7.8 symbols/min [2025-09-30T21:41:12.169313] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:12.199044] [DEBUG] [LOCAL ] USAC: Loaded 22553 existing records from primary storage. [2025-09-30T21:41:12.199332] [INFO ] [MAIN ] USAC: Loaded 22553 existing records. [2025-09-30T21:41:12.261578] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-30T21:41:12.419093] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:12.419364] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-30T21:41:12.419414] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-30T21:41:12.420062] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-30T21:41:12.420148] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-30T21:41:12.825628] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:13.054386] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-30T21:41:13.784561] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T21:41:13.850691] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-30T21:41:13.858817] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-30T21:41:13.899361] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T21:41:14.654411] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-30T21:41:15.178409] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T21:41:15.454435] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-30T21:41:16.254428] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-30T21:41:16.936420] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T21:41:17.054344] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-30T21:41:17.151453] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-30T21:41:17.181610] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T21:41:17.854380] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-30T21:41:18.654334] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-30T21:41:18.958209] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T21:41:19.205883] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T21:41:19.454365] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-30T21:41:20.254367] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-30T21:41:20.701790] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T21:41:20.940029] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-30T21:41:20.953039] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-30T21:41:20.953226] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-30T21:41:21.059901] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-30T21:41:21.405130] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-30T21:41:21.405229] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-30T21:41:21.406508] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-30T21:41:21.406599] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-30T21:41:21.408825] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53712 (keeping 200 days of data) [2025-09-30T21:41:21.802904] [DEBUG] [LOCAL ] UPS: Primary data saved (53712 records). [2025-09-30T21:41:21.803065] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-30T21:41:21.803179] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 30.8s. Estimated remaining: 22m 50s. Rate: 7.8 symbols/min [2025-09-30T21:41:21.862080] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-30T21:41:22.025298] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:22.055292] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T21:41:22.136539] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-30T21:41:22.136930] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-30T21:41:22.349482] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:22.349755] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-30T21:41:22.349810] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-30T21:41:22.350736] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-30T21:41:22.350798] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-30T21:41:22.660992] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-30T21:41:22.798886] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:22.826145] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:41:22.986475] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T21:41:23.454363] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-30T21:41:24.145332] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T21:41:24.216184] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T21:41:24.254363] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-30T21:41:25.054353] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-30T21:41:25.353216] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T21:41:25.854391] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-30T21:41:26.613352] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:41:26.654354] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-30T21:41:27.454418] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-30T21:41:27.540474] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T21:41:27.604048] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:41:28.050118] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T21:41:28.254366] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-30T21:41:29.054377] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-30T21:41:29.239196] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T21:41:29.854361] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-30T21:41:30.242805] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T21:41:30.654368] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-30T21:41:30.968549] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T21:41:30.974575] [INFO ] [REMOTE ] USAC: Full fetch complete (35618 records). [2025-09-30T21:41:30.974723] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-30T21:41:31.375845] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-30T21:41:31.375930] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-30T21:41:31.376762] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-30T21:41:31.376830] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-30T21:41:31.377736] [DEBUG] [LOCAL ] USAC: Trimmed 35618 records to 22418 (keeping 200 days of data) [2025-09-30T21:41:31.471726] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-30T21:41:31.543597] [DEBUG] [LOCAL ] USAC: Primary data saved (22418 records). [2025-09-30T21:41:31.543843] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-30T21:41:31.544012] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. USAC took 19.6s. Estimated remaining: 22m 42s. Rate: 7.8 symbols/min [2025-09-30T21:41:31.774480] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:31.828418] [DEBUG] [LOCAL ] USFD: Loaded 51182 existing records from primary storage. [2025-09-30T21:41:31.828779] [INFO ] [MAIN ] USFD: Loaded 51182 existing records. [2025-09-30T21:41:32.020018] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:32.020992] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-30T21:41:32.021081] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-30T21:41:32.021967] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-30T21:41:32.022030] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-30T21:41:32.262188] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-30T21:41:32.423686] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:32.530195] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:41:33.054488] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-30T21:41:33.060222] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T21:41:33.733581] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T21:41:33.741400] [INFO ] [REMOTE ] URI: Full fetch complete (53522 records). [2025-09-30T21:41:33.741577] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-30T21:41:33.859431] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-30T21:41:34.163862] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-30T21:41:34.163943] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-30T21:41:34.165078] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-30T21:41:34.165142] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-30T21:41:34.166249] [DEBUG] [LOCAL ] URI: Trimmed 53522 records to 35767 (keeping 200 days of data) [2025-09-30T21:41:34.407128] [DEBUG] [LOCAL ] URI: Primary data saved (35767 records). [2025-09-30T21:41:34.407348] [INFO ] [MAIN ] URI: Full history saved. [2025-09-30T21:41:34.407528] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. URI took 36.4s. Estimated remaining: 22m 34s. Rate: 7.8 symbols/min [2025-09-30T21:41:34.617851] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:34.640435] [DEBUG] [LOCAL ] USNA: Loaded 17984 existing records from primary storage. [2025-09-30T21:41:34.640706] [INFO ] [MAIN ] USNA: Loaded 17984 existing records. [2025-09-30T21:41:34.675459] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-30T21:41:34.896060] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:34.896381] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-30T21:41:34.896534] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-30T21:41:34.897002] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-30T21:41:34.897076] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-30T21:41:35.360398] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-30T21:41:35.364029] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:35.454347] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-30T21:41:35.621613] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T21:41:36.118433] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T21:41:36.179386] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T21:41:36.254326] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-30T21:41:37.054369] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-30T21:41:37.530828] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T21:41:37.540125] [INFO ] [REMOTE ] USA: Full fetch complete (51954 records). [2025-09-30T21:41:37.540280] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-30T21:41:37.862446] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-30T21:41:37.967072] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-30T21:41:37.967166] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-30T21:41:37.968253] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-30T21:41:37.968319] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-30T21:41:37.969678] [DEBUG] [LOCAL ] USA: Trimmed 51954 records to 35964 (keeping 200 days of data) [2025-09-30T21:41:38.197510] [DEBUG] [LOCAL ] USA: Primary data saved (35964 records). [2025-09-30T21:41:38.197677] [INFO ] [MAIN ] USA: Full history saved. [2025-09-30T21:41:38.197814] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USA took 30.3s. Estimated remaining: 22m 26s. Rate: 7.8 symbols/min [2025-09-30T21:41:38.385281] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:41:38.415920] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:41:38.443600] [DEBUG] [LOCAL ] USPH: Loaded 16571 existing records from primary storage. [2025-09-30T21:41:38.443911] [INFO ] [MAIN ] USPH: Loaded 16571 existing records. [2025-09-30T21:41:38.646677] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:41:38.647191] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-30T21:41:38.647282] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-30T21:41:38.647999] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-30T21:41:38.648094] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-30T21:41:38.659755] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-30T21:41:39.026606] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T21:41:39.075358] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:41:39.454369] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-30T21:41:40.254380] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-30T21:41:40.493291] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T21:41:40.771478] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T21:41:41.055675] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-30T21:41:41.056885] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T21:41:41.854358] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-30T21:41:42.494784] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T21:41:42.654368] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-30T21:41:42.800170] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:41:43.454366] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-30T21:41:43.713330] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T21:41:44.254386] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-30T21:41:45.054375] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-30T21:41:45.362727] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T21:41:45.445167] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T21:41:45.602268] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T21:41:45.854359] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-30T21:41:46.654387] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-30T21:41:47.454358] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-30T21:41:47.824677] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T21:41:48.254372] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-30T21:41:48.426534] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:41:48.476871] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T21:41:48.768056] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T21:41:49.054403] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-30T21:41:49.854384] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-30T21:41:50.654409] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-30T21:41:51.016356] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T21:41:51.454383] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-30T21:41:51.660580] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T21:41:51.708353] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T21:41:52.254447] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-30T21:41:53.022312] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T21:41:53.054347] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-30T21:41:53.105841] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T21:41:53.854370] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-30T21:41:53.949775] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T21:41:54.654341] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-30T21:41:54.825466] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T21:41:55.339154] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T21:41:55.343512] [INFO ] [REMOTE ] USNA: Full fetch complete (26536 records). [2025-09-30T21:41:55.343708] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-30T21:41:55.460585] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-30T21:41:55.781068] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-30T21:41:55.781182] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-30T21:41:55.781874] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-30T21:41:55.781943] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-30T21:41:55.783021] [DEBUG] [LOCAL ] USNA: Trimmed 26536 records to 17910 (keeping 200 days of data) [2025-09-30T21:41:55.900202] [DEBUG] [LOCAL ] USNA: Primary data saved (17910 records). [2025-09-30T21:41:55.900421] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-30T21:41:55.900563] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USNA took 21.5s. Estimated remaining: 22m 19s. Rate: 7.8 symbols/min [2025-09-30T21:41:56.254398] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-30T21:41:56.605695] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T21:41:57.054352] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-30T21:41:57.859464] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-30T21:41:57.879676] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:41:58.008832] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T21:41:58.654361] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-30T21:41:59.454323] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-30T21:41:59.600534] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T21:42:00.254343] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-30T21:42:00.535506] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T21:42:00.752992] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T21:42:01.054411] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-30T21:42:01.737116] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:42:01.854347] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-30T21:42:02.067613] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T21:42:02.654388] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-30T21:42:03.454410] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-30T21:42:03.805743] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T21:42:03.944929] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T21:42:03.955992] [INFO ] [REMOTE ] USFD: Full fetch complete (73941 records). [2025-09-30T21:42:03.956174] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-30T21:42:04.260794] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-30T21:42:04.406306] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-30T21:42:04.412223] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-30T21:42:04.413669] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-30T21:42:04.413763] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-30T21:42:04.415494] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T21:42:04.422402] [DEBUG] [LOCAL ] USFD: Trimmed 73941 records to 51183 (keeping 200 days of data) [2025-09-30T21:42:04.750129] [DEBUG] [LOCAL ] USFD: Primary data saved (51183 records). [2025-09-30T21:42:04.750528] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-30T21:42:04.750693] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 33.2s. Estimated remaining: 22m 12s. Rate: 7.8 symbols/min [2025-09-30T21:42:05.054361] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-30T21:42:05.153033] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T21:42:05.165207] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-09-30T21:42:05.165399] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-30T21:42:05.597636] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-30T21:42:05.597757] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-30T21:42:05.598927] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-30T21:42:05.598995] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-30T21:42:05.600601] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-09-30T21:42:05.955813] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-30T21:42:05.955963] [INFO ] [MAIN ] USB: Full history saved. [2025-09-30T21:42:05.956065] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USB took 44.2s. Estimated remaining: 22m 4s. Rate: 7.8 symbols/min [2025-09-30T21:42:06.134123] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T21:42:06.138228] [INFO ] [REMOTE ] USPH: Full fetch complete (22599 records). [2025-09-30T21:42:06.138350] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-30T21:42:06.558744] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-30T21:42:06.558842] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-30T21:42:06.559527] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-30T21:42:06.559595] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-30T21:42:06.560525] [DEBUG] [LOCAL ] USPH: Trimmed 22599 records to 16572 (keeping 200 days of data) [2025-09-30T21:42:06.681586] [DEBUG] [LOCAL ] USPH: Primary data saved (16572 records). [2025-09-30T21:42:06.681775] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-30T21:42:06.681889] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 28.5s. Estimated remaining: 21m 55s. Rate: 7.8 symbols/min [2025-09-30T21:42:07.674259] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:07.673157] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:07.663117] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:07.731391] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:07.747243] [DEBUG] [LOCAL ] UTL: Loaded 11195 existing records from primary storage. [2025-09-30T21:42:07.747549] [INFO ] [MAIN ] UTL: Loaded 11195 existing records. [2025-09-30T21:42:07.936941] [DEBUG] [LOCAL ] UTF: Loaded 28893 existing records from primary storage. [2025-09-30T21:42:07.997280] [INFO ] [MAIN ] UTF: Loaded 28893 existing records. [2025-09-30T21:42:08.013911] [DEBUG] [LOCAL ] UTI: Loaded 40490 existing records from primary storage. [2025-09-30T21:42:08.054370] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:08.099135] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-30T21:42:08.099474] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-30T21:42:08.099358] [INFO ] [MAIN ] UTI: Loaded 40490 existing records. [2025-09-30T21:42:08.141935] [DEBUG] [LOCAL ] UTZ: Loaded 44683 existing records from primary storage. [2025-09-30T21:42:08.158343] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-30T21:42:08.179054] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-30T21:42:08.198814] [INFO ] [MAIN ] UTZ: Loaded 44683 existing records. [2025-09-30T21:42:08.563705] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:08.713849] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-30T21:42:08.722365] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:08.727843] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-30T21:42:08.765872] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-30T21:42:08.846352] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-30T21:42:08.817515] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-30T21:42:08.841018] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:08.885319] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-30T21:42:08.884210] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-30T21:42:08.892499] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-30T21:42:08.911878] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-30T21:42:08.917086] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-30T21:42:08.964554] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-30T21:42:09.013872] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-30T21:42:09.664717] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:09.751745] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-30T21:42:10.276143] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:10.298124] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-30T21:42:10.422933] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:10.445969] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-30T21:42:10.445686] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:10.446238] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-30T21:42:10.728998] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T21:42:10.731834] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-30T21:42:11.588004] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T21:42:11.595881] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T21:42:11.605482] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-30T21:42:11.606158] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-30T21:42:11.630177] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T21:42:11.639102] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-30T21:42:11.764528] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:42:12.254372] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-30T21:42:12.463170] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:42:12.629817] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:42:13.054340] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-30T21:42:13.214816] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T21:42:13.687021] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T21:42:13.686699] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T21:42:13.854418] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-30T21:42:14.654385] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-30T21:42:15.009479] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T21:42:15.454386] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-30T21:42:16.200369] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:42:16.254369] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-30T21:42:16.920294] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T21:42:17.054372] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-30T21:42:17.449336] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T21:42:17.854368] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-30T21:42:18.628358] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T21:42:18.654331] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-30T21:42:19.266519] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T21:42:19.313012] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T21:42:19.454355] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-30T21:42:20.254338] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-30T21:42:20.318580] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T21:42:21.054374] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-30T21:42:21.854340] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-30T21:42:21.909355] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T21:42:22.405190] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T21:42:22.654400] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-30T21:42:23.219950] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T21:42:23.454357] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-30T21:42:24.254326] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-30T21:42:24.720617] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T21:42:25.054328] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-30T21:42:25.326894] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T21:42:25.854348] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-30T21:42:26.092545] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (5.04 seconds). [2025-09-30T21:42:26.524543] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T21:42:26.528546] [INFO ] [REMOTE ] UTL: Full fetch complete (15362 records). [2025-09-30T21:42:26.528627] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-30T21:42:26.659520] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-30T21:42:26.938841] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-30T21:42:26.938939] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-30T21:42:26.939289] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-30T21:42:26.939360] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-30T21:42:26.963814] [DEBUG] [LOCAL ] UTL: Trimmed 15362 records to 11256 (keeping 200 days of data) [2025-09-30T21:42:26.966133] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T21:42:27.049265] [DEBUG] [LOCAL ] UTL: Primary data saved (11256 records). [2025-09-30T21:42:27.049441] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-30T21:42:27.049553] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 20.4s. Estimated remaining: 21m 49s. Rate: 7.8 symbols/min [2025-09-30T21:42:27.243689] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:27.270498] [DEBUG] [LOCAL ] UVE: Loaded 21806 existing records from primary storage. [2025-09-30T21:42:27.270771] [INFO ] [MAIN ] UVE: Loaded 21806 existing records. [2025-09-30T21:42:27.460319] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-30T21:42:27.466512] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:27.467592] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-30T21:42:27.467673] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-30T21:42:27.468137] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-30T21:42:27.468198] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-30T21:42:27.847961] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:28.254335] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-30T21:42:28.310602] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T21:42:28.741969] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T21:42:29.054356] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-30T21:42:29.193932] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:42:29.854371] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-30T21:42:30.500729] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T21:42:30.654356] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-30T21:42:31.193502] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T21:42:31.454368] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-30T21:42:32.198952] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T21:42:32.254355] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-30T21:42:32.369241] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T21:42:33.020800] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T21:42:33.054354] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-30T21:42:33.854375] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-30T21:42:34.594995] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T21:42:34.649797] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T21:42:34.659125] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-30T21:42:34.660927] [INFO ] [REMOTE ] UTZ: Full fetch complete (64167 records). [2025-09-30T21:42:34.661019] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-30T21:42:35.094401] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-30T21:42:35.094504] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-30T21:42:35.095714] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-30T21:42:35.095794] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-30T21:42:35.097265] [DEBUG] [LOCAL ] UTZ: Trimmed 64167 records to 44723 (keeping 200 days of data) [2025-09-30T21:42:35.404636] [DEBUG] [LOCAL ] UTZ: Primary data saved (44723 records). [2025-09-30T21:42:35.404843] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-30T21:42:35.404955] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTZ took 28.7s. Estimated remaining: 21m 41s. Rate: 7.8 symbols/min [2025-09-30T21:42:35.462103] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-30T21:42:35.605400] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:35.631597] [DEBUG] [LOCAL ] UVV: Loaded 22450 existing records from primary storage. [2025-09-30T21:42:35.631902] [INFO ] [MAIN ] UVV: Loaded 22450 existing records. [2025-09-30T21:42:35.747064] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:42:35.847049] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:35.847671] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-30T21:42:35.847743] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-30T21:42:35.848481] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-30T21:42:35.848554] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-30T21:42:36.238402] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:36.254393] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-30T21:42:36.749280] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T21:42:37.054362] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-30T21:42:37.417368] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T21:42:37.854380] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-30T21:42:38.067491] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T21:42:38.640929] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T21:42:38.654310] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-30T21:42:39.454322] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-30T21:42:39.679042] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:42:40.254355] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-30T21:42:40.950434] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T21:42:41.054400] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-30T21:42:41.170887] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T21:42:41.854353] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-30T21:42:41.878215] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:42:42.654372] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-30T21:42:43.397545] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T21:42:43.407492] [INFO ] [REMOTE ] UTI: Full fetch complete (58233 records). [2025-09-30T21:42:43.407639] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-30T21:42:43.460374] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-30T21:42:43.747739] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T21:42:43.873558] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-30T21:42:43.873665] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-30T21:42:43.874812] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-30T21:42:43.874907] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-30T21:42:43.876267] [DEBUG] [LOCAL ] UTI: Trimmed 58233 records to 40477 (keeping 200 days of data) [2025-09-30T21:42:44.134553] [DEBUG] [LOCAL ] UTI: Primary data saved (40477 records). [2025-09-30T21:42:44.134734] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-30T21:42:44.134825] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTI took 37.5s. Estimated remaining: 21m 33s. Rate: 7.8 symbols/min [2025-09-30T21:42:44.272636] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-30T21:42:44.326520] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:44.340158] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T21:42:44.398258] [DEBUG] [LOCAL ] UWMC: Loaded 52754 existing records from primary storage. [2025-09-30T21:42:44.398598] [INFO ] [MAIN ] UWMC: Loaded 52754 existing records. [2025-09-30T21:42:44.587286] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:44.587511] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-30T21:42:44.587563] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-30T21:42:44.588469] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-30T21:42:44.588533] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-30T21:42:44.998235] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:45.054357] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-30T21:42:45.488087] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T21:42:45.498559] [INFO ] [REMOTE ] UTF: Full fetch complete (41851 records). [2025-09-30T21:42:45.498744] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-30T21:42:45.859544] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-30T21:42:45.913778] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-30T21:42:45.913873] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-30T21:42:45.914712] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-30T21:42:45.914778] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-30T21:42:45.915848] [DEBUG] [LOCAL ] UTF: Trimmed 41851 records to 29075 (keeping 200 days of data) [2025-09-30T21:42:46.125000] [DEBUG] [LOCAL ] UTF: Primary data saved (29075 records). [2025-09-30T21:42:46.125160] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-30T21:42:46.125262] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTF took 39.4s. Estimated remaining: 21m 25s. Rate: 7.8 symbols/min [2025-09-30T21:42:46.313015] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:46.321903] [DEBUG] [LOCAL ] UZD: Loaded 6366 existing records from primary storage. [2025-09-30T21:42:46.322104] [INFO ] [MAIN ] UZD: Loaded 6366 existing records. [2025-09-30T21:42:46.534816] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:46.535087] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-30T21:42:46.535136] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-30T21:42:46.535595] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-30T21:42:46.535911] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-30T21:42:46.657348] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-30T21:42:46.963860] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:42:47.004545] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T21:42:47.072714] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T21:42:47.454363] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-30T21:42:47.771627] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T21:42:48.166100] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T21:42:48.254412] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-30T21:42:49.054328] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-30T21:42:49.095392] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T21:42:49.838213] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T21:42:49.854339] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-30T21:42:50.462682] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T21:42:50.654356] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-30T21:42:51.351667] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T21:42:51.454396] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-30T21:42:52.254361] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-30T21:42:52.611680] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T21:42:53.054388] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-30T21:42:53.854412] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-30T21:42:54.018401] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T21:42:54.078967] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T21:42:54.654325] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-30T21:42:54.730343] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T21:42:55.354730] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T21:42:55.454389] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-30T21:42:56.254330] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-30T21:42:56.434800] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T21:42:57.054344] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-30T21:42:57.256287] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T21:42:57.854325] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-30T21:42:58.253807] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T21:42:58.562352] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T21:42:58.568241] [INFO ] [REMOTE ] UVE: Full fetch complete (29692 records). [2025-09-30T21:42:58.568362] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-30T21:42:58.659504] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-30T21:42:58.975598] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-30T21:42:58.975735] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-30T21:42:58.976447] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-30T21:42:58.976545] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-30T21:42:58.977540] [DEBUG] [LOCAL ] UVE: Trimmed 29692 records to 21795 (keeping 200 days of data) [2025-09-30T21:42:59.116579] [DEBUG] [LOCAL ] UVE: Primary data saved (21795 records). [2025-09-30T21:42:59.116744] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-30T21:42:59.116839] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 32.1s. Estimated remaining: 21m 18s. Rate: 7.8 symbols/min [2025-09-30T21:42:59.321011] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:42:59.330955] [DEBUG] [LOCAL ] UZE: Loaded 7414 existing records from primary storage. [2025-09-30T21:42:59.331208] [INFO ] [MAIN ] UZE: Loaded 7414 existing records. [2025-09-30T21:42:59.459607] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-30T21:42:59.547770] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:42:59.548058] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-30T21:42:59.548161] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-30T21:42:59.548480] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-30T21:42:59.548556] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-30T21:43:00.149931] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:00.254409] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-30T21:43:00.300939] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:43:00.768822] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T21:43:00.773892] [INFO ] [REMOTE ] UVV: Full fetch complete (29865 records). [2025-09-30T21:43:00.774002] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-30T21:43:01.060017] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-30T21:43:01.059943] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T21:43:01.197593] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-30T21:43:01.197697] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-30T21:43:01.198415] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-30T21:43:01.198477] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-30T21:43:01.199253] [DEBUG] [LOCAL ] UVV: Trimmed 29865 records to 22456 (keeping 200 days of data) [2025-09-30T21:43:01.347380] [DEBUG] [LOCAL ] UVV: Primary data saved (22456 records). [2025-09-30T21:43:01.347543] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-30T21:43:01.347669] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 25.9s. Estimated remaining: 21m 10s. Rate: 7.8 symbols/min [2025-09-30T21:43:01.556230] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:01.568719] [DEBUG] [LOCAL ] UZF: Loaded 6423 existing records from primary storage. [2025-09-30T21:43:01.569023] [INFO ] [MAIN ] UZF: Loaded 6423 existing records. [2025-09-30T21:43:01.823807] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:01.824235] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-30T21:43:01.832158] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-30T21:43:01.832785] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T21:43:01.833908] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-30T21:43:01.836807] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-30T21:43:01.860010] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-30T21:43:02.254316] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:02.540035] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T21:43:02.654362] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-30T21:43:03.188537] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T21:43:03.454387] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-30T21:43:04.198344] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T21:43:04.254330] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-30T21:43:04.803074] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T21:43:05.054379] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-30T21:43:05.761287] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T21:43:05.854362] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-30T21:43:06.654383] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-30T21:43:07.341921] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T21:43:07.454367] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-30T21:43:07.493566] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T21:43:08.053830] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T21:43:08.254365] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-30T21:43:08.831162] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:43:08.832964] [INFO ] [REMOTE ] UZD: Full fetch complete (9536 records). [2025-09-30T21:43:08.833043] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-30T21:43:09.061321] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-30T21:43:09.270602] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-30T21:43:09.270708] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-30T21:43:09.270972] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-30T21:43:09.271033] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-30T21:43:09.271481] [DEBUG] [LOCAL ] UZD: Trimmed 9536 records to 6448 (keeping 200 days of data) [2025-09-30T21:43:09.315192] [DEBUG] [LOCAL ] UZD: Primary data saved (6448 records). [2025-09-30T21:43:09.315328] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-30T21:43:09.315414] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZD took 23.2s. Estimated remaining: 21m 2s. Rate: 7.8 symbols/min [2025-09-30T21:43:09.508950] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:09.579231] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-09-30T21:43:09.579630] [INFO ] [MAIN ] V: Loaded 53755 existing records. [2025-09-30T21:43:09.751268] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T21:43:09.788074] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:09.788313] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-30T21:43:09.788364] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-30T21:43:09.789225] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-30T21:43:09.789288] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-30T21:43:09.859490] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-30T21:43:10.184597] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:10.654368] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-30T21:43:11.424437] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T21:43:11.454368] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-30T21:43:11.834798] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T21:43:12.183746] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T21:43:12.254356] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-30T21:43:13.054379] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-30T21:43:13.854372] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-30T21:43:14.088022] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T21:43:14.530978] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T21:43:14.654409] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-30T21:43:14.787128] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T21:43:15.454384] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-30T21:43:15.532867] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T21:43:16.254373] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-30T21:43:17.054413] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-30T21:43:17.564950] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-30T21:43:17.653939] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T21:43:17.854341] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-30T21:43:17.983808] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:43:18.654359] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-30T21:43:19.387335] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T21:43:19.454365] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-30T21:43:19.806685] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T21:43:19.827139] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-30T21:43:20.254396] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-30T21:43:21.054361] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-30T21:43:21.676047] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T21:43:21.854360] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-30T21:43:22.184841] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T21:43:22.524729] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T21:43:22.654366] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-30T21:43:23.454367] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-30T21:43:24.254350] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-30T21:43:24.550850] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T21:43:24.842914] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T21:43:24.844687] [INFO ] [REMOTE ] UZF: Full fetch complete (8870 records). [2025-09-30T21:43:24.844764] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-30T21:43:25.059404] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-30T21:43:25.255946] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-30T21:43:25.256204] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-30T21:43:25.256547] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-30T21:43:25.256680] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-30T21:43:25.257780] [DEBUG] [LOCAL ] UZF: Trimmed 8870 records to 6467 (keeping 200 days of data) [2025-09-30T21:43:25.337257] [DEBUG] [LOCAL ] UZF: Primary data saved (6467 records). [2025-09-30T21:43:25.339861] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:43:25.338183] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-30T21:43:25.351136] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZF took 24.0s. Estimated remaining: 20m 55s. Rate: 7.8 symbols/min [2025-09-30T21:43:25.539004] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:25.579891] [DEBUG] [LOCAL ] VAC: Loaded 34360 existing records from primary storage. [2025-09-30T21:43:25.580183] [INFO ] [MAIN ] VAC: Loaded 34360 existing records. [2025-09-30T21:43:25.701414] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T21:43:25.821682] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:25.821968] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-30T21:43:25.822143] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-30T21:43:25.822844] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-30T21:43:25.822904] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-30T21:43:25.859448] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-30T21:43:26.205146] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:26.654363] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-30T21:43:27.245732] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T21:43:27.454347] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-30T21:43:27.804550] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T21:43:28.254373] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-30T21:43:29.054368] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-30T21:43:29.308906] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:43:29.320582] [INFO ] [REMOTE ] UWMC: Full fetch complete (75562 records). [2025-09-30T21:43:29.320781] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-30T21:43:29.740412] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-30T21:43:29.740500] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-30T21:43:29.741730] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-30T21:43:29.741802] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-30T21:43:29.743401] [DEBUG] [LOCAL ] UWMC: Trimmed 75562 records to 52765 (keeping 200 days of data) [2025-09-30T21:43:29.854894] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-30T21:43:29.980173] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T21:43:30.091051] [DEBUG] [LOCAL ] UWMC: Primary data saved (52765 records). [2025-09-30T21:43:30.091198] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-30T21:43:30.091304] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 46.0s. Estimated remaining: 20m 47s. Rate: 7.8 symbols/min [2025-09-30T21:43:30.288238] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:30.344552] [DEBUG] [LOCAL ] VAL: Loaded 50344 existing records from primary storage. [2025-09-30T21:43:30.344906] [INFO ] [MAIN ] VAL: Loaded 50344 existing records. [2025-09-30T21:43:30.517689] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-30T21:43:30.587544] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:30.587818] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-30T21:43:30.587869] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-30T21:43:30.588699] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-30T21:43:30.588771] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-30T21:43:30.656355] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-30T21:43:30.983946] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:30.994924] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T21:43:31.140279] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T21:43:31.142319] [INFO ] [REMOTE ] UZE: Full fetch complete (10113 records). [2025-09-30T21:43:31.142393] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-30T21:43:31.454600] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-30T21:43:31.544138] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-30T21:43:31.544241] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-30T21:43:31.544537] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-30T21:43:31.544579] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-30T21:43:31.545395] [DEBUG] [LOCAL ] UZE: Trimmed 10113 records to 7436 (keeping 200 days of data) [2025-09-30T21:43:31.595202] [DEBUG] [LOCAL ] UZE: Primary data saved (7436 records). [2025-09-30T21:43:31.595355] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-30T21:43:31.595446] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZE took 32.5s. Estimated remaining: 20m 39s. Rate: 7.8 symbols/min [2025-09-30T21:43:31.804711] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:31.870392] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-30T21:43:31.870828] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-09-30T21:43:32.061771] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:32.062055] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-30T21:43:32.062107] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-30T21:43:32.063556] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-30T21:43:32.063620] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-30T21:43:32.261071] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-30T21:43:32.447437] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:33.062174] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-30T21:43:33.068108] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T21:43:33.787068] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T21:43:33.854349] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-30T21:43:34.654374] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-30T21:43:35.004707] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T21:43:35.172397] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T21:43:35.454409] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-30T21:43:36.254442] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-30T21:43:36.675587] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T21:43:37.054422] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-30T21:43:37.352417] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T21:43:37.580363] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T21:43:37.854363] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-30T21:43:38.646754] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T21:43:38.656419] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-30T21:43:39.456411] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-30T21:43:39.459445] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:43:40.254398] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-30T21:43:40.719951] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T21:43:40.934196] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T21:43:41.054412] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-30T21:43:41.854397] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-30T21:43:42.358442] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-30T21:43:42.654329] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-30T21:43:42.714889] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T21:43:43.010904] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T21:43:43.454395] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-30T21:43:44.254338] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-30T21:43:44.500097] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T21:43:45.054363] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-30T21:43:45.667923] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-30T21:43:45.710969] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T21:43:45.854341] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-30T21:43:46.654416] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-30T21:43:47.232231] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T21:43:47.454368] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-30T21:43:48.081178] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:43:48.154076] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-30T21:43:48.165745] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-09-30T21:43:48.165940] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-30T21:43:48.259516] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-30T21:43:48.632000] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-30T21:43:48.632126] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-30T21:43:48.633851] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-30T21:43:48.633962] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-30T21:43:48.636059] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 53755 (keeping 200 days of data) [2025-09-30T21:43:48.999758] [DEBUG] [LOCAL ] V: Primary data saved (53755 records). [2025-09-30T21:43:48.999926] [INFO ] [MAIN ] V: Full history saved. [2025-09-30T21:43:49.000055] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. V took 39.7s. Estimated remaining: 20m 32s. Rate: 7.8 symbols/min [2025-09-30T21:43:49.065566] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-30T21:43:49.203964] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:49.238720] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:43:49.242359] [DEBUG] [LOCAL ] VATE: Loaded 5353 existing records from primary storage. [2025-09-30T21:43:49.254046] [INFO ] [MAIN ] VATE: Loaded 5353 existing records. [2025-09-30T21:43:49.449986] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:49.450240] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-30T21:43:49.450301] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-30T21:43:49.450526] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-30T21:43:49.450585] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-30T21:43:49.830234] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:49.854339] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-30T21:43:50.041832] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:43:50.641848] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T21:43:50.654319] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-30T21:43:51.454387] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-30T21:43:51.957542] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T21:43:52.132600] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T21:43:52.254453] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-30T21:43:53.054346] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-30T21:43:53.262727] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T21:43:53.662475] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T21:43:53.854411] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-30T21:43:54.487740] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-30T21:43:54.654450] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-30T21:43:54.970220] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:43:55.454347] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-30T21:43:55.675883] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:43:56.254379] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-30T21:43:56.446528] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T21:43:57.054445] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-30T21:43:57.854437] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-30T21:43:57.934192] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:43:58.400395] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T21:43:58.407971] [INFO ] [REMOTE ] VAC: Full fetch complete (48070 records). [2025-09-30T21:43:58.408159] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-30T21:43:58.660410] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-30T21:43:58.833279] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-30T21:43:58.833405] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-30T21:43:58.834496] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-30T21:43:58.834591] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-30T21:43:58.836373] [DEBUG] [LOCAL ] VAC: Trimmed 48070 records to 34398 (keeping 200 days of data) [2025-09-30T21:43:59.061290] [DEBUG] [LOCAL ] VAC: Primary data saved (34398 records). [2025-09-30T21:43:59.061442] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-30T21:43:59.061549] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAC took 33.7s. Estimated remaining: 20m 25s. Rate: 7.8 symbols/min [2025-09-30T21:43:59.240063] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:43:59.250176] [DEBUG] [LOCAL ] VBF: Loaded 6989 existing records from primary storage. [2025-09-30T21:43:59.250518] [INFO ] [MAIN ] VBF: Loaded 6989 existing records. [2025-09-30T21:43:59.443155] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:43:59.443637] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-30T21:43:59.443832] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-30T21:43:59.444091] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-30T21:43:59.444167] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-30T21:43:59.482577] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-30T21:43:59.840186] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:43:59.873966] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T21:43:59.886406] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-30T21:43:59.886582] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-30T21:44:00.262940] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-30T21:44:00.333514] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T21:44:00.366206] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-30T21:44:00.366382] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-30T21:44:00.368003] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-30T21:44:00.368573] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-30T21:44:00.370682] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-09-30T21:44:00.515360] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:44:00.531767] [INFO ] [REMOTE ] VAL: Full fetch complete (73238 records). [2025-09-30T21:44:00.533638] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-30T21:44:01.064859] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-30T21:44:01.151396] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-30T21:44:01.152068] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T21:44:01.154315] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-30T21:44:01.157195] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-30T21:44:01.158360] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-30T21:44:01.164762] [DEBUG] [LOCAL ] VAL: Trimmed 73238 records to 50312 (keeping 200 days of data) [2025-09-30T21:44:01.493190] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-30T21:44:01.495032] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-30T21:44:01.495399] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VALE took 29.9s. Estimated remaining: 20m 16s. Rate: 7.8 symbols/min [2025-09-30T21:44:01.721568] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:01.786222] [DEBUG] [LOCAL ] VCV: Loaded 13647 existing records from primary storage. [2025-09-30T21:44:01.800700] [INFO ] [MAIN ] VCV: Loaded 13647 existing records. [2025-09-30T21:44:01.856589] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-30T21:44:01.891422] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T21:44:02.040428] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:02.042543] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-30T21:44:02.043173] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-30T21:44:02.044350] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-30T21:44:02.044462] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-30T21:44:02.189387] [DEBUG] [LOCAL ] VAL: Primary data saved (50312 records). [2025-09-30T21:44:02.190098] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-30T21:44:02.195676] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VAL took 32.1s. Estimated remaining: 20m 8s. Rate: 7.8 symbols/min [2025-09-30T21:44:02.598265] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T21:44:02.596864] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:02.663482] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-30T21:44:02.687123] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:02.744886] [DEBUG] [LOCAL ] VEEV: Loaded 47036 existing records from primary storage. [2025-09-30T21:44:02.745238] [INFO ] [MAIN ] VEEV: Loaded 47036 existing records. [2025-09-30T21:44:02.945262] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:02.945501] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-30T21:44:02.945551] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-30T21:44:02.946381] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-30T21:44:02.946450] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-30T21:44:03.345084] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:03.454381] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-30T21:44:03.478857] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T21:44:04.202557] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T21:44:04.254383] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-30T21:44:05.054370] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-30T21:44:05.719875] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T21:44:05.854351] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-30T21:44:06.011185] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T21:44:06.654412] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-30T21:44:06.862679] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T21:44:07.454416] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-30T21:44:08.250676] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T21:44:08.254299] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-30T21:44:08.298701] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T21:44:08.821057] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T21:44:09.054413] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-30T21:44:09.832434] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T21:44:09.854414] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-30T21:44:10.654373] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-30T21:44:11.101897] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T21:44:11.148485] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T21:44:11.454402] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-30T21:44:12.187223] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T21:44:12.254370] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-30T21:44:13.054352] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-30T21:44:13.175438] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T21:44:13.639189] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T21:44:13.854370] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-30T21:44:14.456779] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T21:44:14.654370] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-30T21:44:15.454403] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-30T21:44:16.254351] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-30T21:44:16.311016] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T21:44:16.424604] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T21:44:16.669874] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T21:44:17.054445] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-30T21:44:17.446328] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T21:44:17.854371] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-30T21:44:18.654377] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-30T21:44:18.833441] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T21:44:19.454365] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-30T21:44:19.468473] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T21:44:20.085577] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T21:44:20.087614] [INFO ] [REMOTE ] VATE: Full fetch complete (10510 records). [2025-09-30T21:44:20.087754] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-30T21:44:20.260130] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-30T21:44:20.493584] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-30T21:44:20.493705] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-30T21:44:20.493986] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-30T21:44:20.494053] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-30T21:44:20.494532] [DEBUG] [LOCAL ] VATE: Trimmed 10510 records to 5321 (keeping 200 days of data) [2025-09-30T21:44:20.525658] [DEBUG] [LOCAL ] VATE: Primary data saved (5321 records). [2025-09-30T21:44:20.525789] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-30T21:44:20.525895] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 31.5s. Estimated remaining: 20m 1s. Rate: 7.8 symbols/min [2025-09-30T21:44:20.711036] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:20.727976] [DEBUG] [LOCAL ] VEL: Loaded 12859 existing records from primary storage. [2025-09-30T21:44:20.728246] [INFO ] [MAIN ] VEL: Loaded 12859 existing records. [2025-09-30T21:44:20.935288] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:20.935589] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-30T21:44:20.935668] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-30T21:44:20.936033] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-30T21:44:20.936118] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-30T21:44:21.051457] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T21:44:21.061770] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-30T21:44:21.419302] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:21.854370] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-30T21:44:22.654363] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-30T21:44:22.796042] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T21:44:22.887190] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T21:44:23.454334] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-30T21:44:23.608667] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T21:44:24.194432] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T21:44:24.254357] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-30T21:44:25.054347] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-30T21:44:25.320113] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T21:44:25.854365] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-30T21:44:26.654330] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-30T21:44:26.665254] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T21:44:26.844862] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T21:44:27.454332] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-30T21:44:27.660061] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T21:44:27.664129] [INFO ] [REMOTE ] VCV: Full fetch complete (19658 records). [2025-09-30T21:44:27.664225] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-30T21:44:28.068899] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-30T21:44:28.068988] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-30T21:44:28.069534] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-30T21:44:28.069611] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-30T21:44:28.070370] [DEBUG] [LOCAL ] VCV: Trimmed 19658 records to 13695 (keeping 200 days of data) [2025-09-30T21:44:28.161590] [DEBUG] [LOCAL ] VCV: Primary data saved (13695 records). [2025-09-30T21:44:28.161757] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-30T21:44:28.161847] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VCV took 26.7s. Estimated remaining: 19m 54s. Rate: 7.8 symbols/min [2025-09-30T21:44:28.247917] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T21:44:28.254967] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-30T21:44:28.305804] [INFO ] [REMOTE ] VBF: Full fetch complete (10451 records). [2025-09-30T21:44:28.311198] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-30T21:44:28.480026] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:28.790408] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-30T21:44:28.790238] [DEBUG] [LOCAL ] VET: Loaded 43955 existing records from primary storage. [2025-09-30T21:44:28.790731] [INFO ] [MAIN ] VET: Loaded 43955 existing records. [2025-09-30T21:44:28.790587] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-30T21:44:28.826211] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-30T21:44:28.854392] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-30T21:44:28.896903] [DEBUG] [LOCAL ] VBF: Trimmed 10451 records to 6945 (keeping 200 days of data) [2025-09-30T21:44:29.034345] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:29.038033] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-30T21:44:29.039910] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-30T21:44:29.041911] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-30T21:44:29.042605] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-30T21:44:29.059466] [DEBUG] [LOCAL ] VBF: Primary data saved (6945 records). [2025-09-30T21:44:29.061735] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-30T21:44:29.062706] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-30T21:44:29.085377] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VBF took 30.0s. Estimated remaining: 19m 45s. Rate: 7.8 symbols/min [2025-09-30T21:44:29.597169] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:29.706498] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:29.758609] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-30T21:44:29.758972] [INFO ] [MAIN ] VFC: Loaded 53610 existing records. [2025-09-30T21:44:29.855979] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-30T21:44:29.879571] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T21:44:29.975053] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:29.975408] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-30T21:44:29.975534] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-30T21:44:29.985950] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-30T21:44:30.002284] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-30T21:44:30.039118] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:44:30.403005] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:30.654367] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-30T21:44:31.454329] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-30T21:44:31.491032] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T21:44:32.254358] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-30T21:44:32.415006] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:44:32.504979] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T21:44:33.054402] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-30T21:44:33.619319] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:44:33.639497] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T21:44:33.854389] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-30T21:44:34.654397] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-30T21:44:34.845532] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T21:44:35.454410] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-30T21:44:36.254365] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-30T21:44:36.504563] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T21:44:37.054345] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-30T21:44:37.155697] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T21:44:37.209193] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:44:37.854369] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-30T21:44:38.531625] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:44:38.654411] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-30T21:44:39.454336] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-30T21:44:39.636716] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T21:44:39.646735] [INFO ] [REMOTE ] VEEV: Full fetch complete (68251 records). [2025-09-30T21:44:39.646923] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-30T21:44:40.079312] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-30T21:44:40.079466] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-30T21:44:40.080663] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-30T21:44:40.080758] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-30T21:44:40.082521] [DEBUG] [LOCAL ] VEEV: Trimmed 68251 records to 47070 (keeping 200 days of data) [2025-09-30T21:44:40.210208] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T21:44:40.299740] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-30T21:44:40.354454] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T21:44:40.433164] [DEBUG] [LOCAL ] VEEV: Primary data saved (47070 records). [2025-09-30T21:44:40.433313] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-30T21:44:40.433398] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEEV took 38.2s. Estimated remaining: 19m 38s. Rate: 7.8 symbols/min [2025-09-30T21:44:40.628750] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:40.628954] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-30T21:44:40.628996] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-30T21:44:40.629138] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-30T21:44:40.629180] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-30T21:44:40.629225] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-30T21:44:40.629258] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-30T21:44:41.021227] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:41.054372] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-30T21:44:41.259407] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:44:41.259793] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-30T21:44:41.259887] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:44:41.259939] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-30T21:44:41.259998] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:44:41.260069] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-30T21:44:41.260150] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-30T21:44:41.260217] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-30T21:44:41.260298] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-30T21:44:41.260371] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 0.8s. Estimated remaining: 19m 30s. Rate: 7.8 symbols/min [2025-09-30T21:44:41.443868] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:41.452295] [DEBUG] [LOCAL ] VGI: Loaded 5132 existing records from primary storage. [2025-09-30T21:44:41.452511] [INFO ] [MAIN ] VGI: Loaded 5132 existing records. [2025-09-30T21:44:41.683460] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:41.683711] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-30T21:44:41.683769] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-30T21:44:41.683971] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-30T21:44:41.684046] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-30T21:44:41.854342] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-30T21:44:42.074660] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:42.261208] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T21:44:42.654401] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-30T21:44:43.454355] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-30T21:44:43.499970] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:44:44.254332] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-30T21:44:44.271417] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T21:44:44.635143] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T21:44:45.054397] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-30T21:44:45.660775] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T21:44:45.854354] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-30T21:44:45.992810] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:44:46.654363] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-30T21:44:47.281245] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T21:44:47.454342] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-30T21:44:47.567470] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:44:47.811056] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T21:44:48.254386] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-30T21:44:49.043259] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T21:44:49.046329] [INFO ] [REMOTE ] VEL: Full fetch complete (17009 records). [2025-09-30T21:44:49.046410] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-30T21:44:49.059492] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-30T21:44:49.445765] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-30T21:44:49.445881] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-30T21:44:49.446309] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-30T21:44:49.446353] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-30T21:44:49.447196] [DEBUG] [LOCAL ] VEL: Trimmed 17009 records to 12826 (keeping 200 days of data) [2025-09-30T21:44:49.530148] [DEBUG] [LOCAL ] VEL: Primary data saved (12826 records). [2025-09-30T21:44:49.530314] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-30T21:44:49.530401] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VEL took 29.0s. Estimated remaining: 19m 22s. Rate: 7.8 symbols/min [2025-09-30T21:44:49.707294] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:44:49.728799] [DEBUG] [LOCAL ] VGM: Loaded 18241 existing records from primary storage. [2025-09-30T21:44:49.729057] [INFO ] [MAIN ] VGM: Loaded 18241 existing records. [2025-09-30T21:44:49.859498] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-30T21:44:49.931121] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:44:49.931490] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-30T21:44:49.931556] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-30T21:44:49.931956] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-30T21:44:49.932058] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-30T21:44:50.324755] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:44:50.654391] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-30T21:44:51.130864] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-30T21:44:51.454348] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-30T21:44:51.621035] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T21:44:51.696348] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T21:44:52.254366] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-30T21:44:53.059067] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-30T21:44:53.062597] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T21:44:53.318332] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T21:44:53.585210] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T21:44:53.854386] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-30T21:44:54.654385] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-30T21:44:55.418532] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:44:55.454324] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-30T21:44:56.265512] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-30T21:44:56.272007] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T21:44:56.703952] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-30T21:44:57.029853] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T21:44:57.054331] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-30T21:44:57.854362] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-30T21:44:58.444633] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T21:44:58.529251] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T21:44:58.654400] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-30T21:44:59.454389] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-30T21:45:00.099450] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T21:45:00.254385] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-30T21:45:00.531222] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:45:01.054386] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-30T21:45:01.650957] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T21:45:01.665242] [INFO ] [REMOTE ] VET: Full fetch complete (64531 records). [2025-09-30T21:45:01.665461] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-30T21:45:01.866923] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-30T21:45:02.287495] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-30T21:45:02.287608] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-30T21:45:02.289528] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-30T21:45:02.289696] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-30T21:45:02.291532] [DEBUG] [LOCAL ] VET: Trimmed 64531 records to 43932 (keeping 200 days of data) [2025-09-30T21:45:02.621182] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T21:45:02.669045] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-30T21:45:02.693566] [DEBUG] [LOCAL ] VET: Primary data saved (43932 records). [2025-09-30T21:45:02.693793] [INFO ] [MAIN ] VET: Full history saved. [2025-09-30T21:45:02.693919] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VET took 34.5s. Estimated remaining: 19m 15s. Rate: 7.8 symbols/min [2025-09-30T21:45:02.945980] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:02.951327] [DEBUG] [LOCAL ] VHI: Loaded 2784 existing records from primary storage. [2025-09-30T21:45:02.951533] [INFO ] [MAIN ] VHI: Loaded 2784 existing records. [2025-09-30T21:45:03.163185] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:03.163675] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-30T21:45:03.163880] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-30T21:45:03.182700] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-30T21:45:03.194429] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-30T21:45:03.296868] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-30T21:45:03.357014] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-09-30T21:45:03.367541] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-30T21:45:03.463674] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-30T21:45:03.774120] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T21:45:03.951984] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:04.157608] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-30T21:45:04.157734] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-30T21:45:04.158924] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-30T21:45:04.158999] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-30T21:45:04.161371] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 53611 (keeping 200 days of data) [2025-09-30T21:45:04.257789] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-30T21:45:04.369879] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T21:45:04.529440] [DEBUG] [LOCAL ] VFC: Primary data saved (53611 records). [2025-09-30T21:45:04.529591] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-30T21:45:04.529709] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VFC took 35.4s. Estimated remaining: 19m 7s. Rate: 7.8 symbols/min [2025-09-30T21:45:04.715867] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:04.716076] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-30T21:45:04.716126] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-30T21:45:04.716239] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-30T21:45:04.716280] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-30T21:45:04.716321] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-30T21:45:04.716353] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-30T21:45:05.054629] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-30T21:45:05.096228] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T21:45:05.120560] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:05.507899] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T21:45:05.854397] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-30T21:45:06.477675] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T21:45:06.654386] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-30T21:45:07.162682] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T21:45:07.454392] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-30T21:45:07.980907] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T21:45:08.254366] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-30T21:45:09.054384] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-30T21:45:09.067455] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T21:45:09.070437] [INFO ] [REMOTE ] VGI: Full fetch complete (7793 records). [2025-09-30T21:45:09.070539] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-30T21:45:09.336023] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:45:09.364460] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-30T21:45:09.387003] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:45:09.389999] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-30T21:45:09.390078] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:45:09.390130] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-30T21:45:09.401023] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-30T21:45:09.406224] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-30T21:45:09.416531] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-30T21:45:09.421757] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 4.9s. Estimated remaining: 18m 59s. Rate: 7.8 symbols/min [2025-09-30T21:45:09.577874] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-30T21:45:09.595589] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-30T21:45:09.607807] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-30T21:45:09.608029] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-30T21:45:09.619880] [DEBUG] [LOCAL ] VGI: Trimmed 7793 records to 5138 (keeping 200 days of data) [2025-09-30T21:45:09.710448] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:09.725339] [DEBUG] [LOCAL ] VGI: Primary data saved (5138 records). [2025-09-30T21:45:09.725513] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-30T21:45:09.725625] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VGI took 28.5s. Estimated remaining: 18m 51s. Rate: 7.8 symbols/min [2025-09-30T21:45:09.855919] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-30T21:45:09.938798] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:09.959400] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-09-30T21:45:09.959851] [INFO ] [MAIN ] VICI: Loaded 53647 existing records. [2025-09-30T21:45:10.175146] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:10.175411] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-30T21:45:10.175461] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-30T21:45:10.176436] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-30T21:45:10.176501] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-30T21:45:10.313003] [DEBUG] [LOCAL ] VIK: Loaded 52469 existing records from primary storage. [2025-09-30T21:45:10.344071] [INFO ] [MAIN ] VIK: Loaded 52469 existing records. [2025-09-30T21:45:10.673762] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-30T21:45:10.758843] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:10.824350] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-30T21:45:10.841466] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-30T21:45:10.848077] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:10.849028] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-30T21:45:10.849097] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-30T21:45:11.203681] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T21:45:11.311293] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:11.394697] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T21:45:11.454341] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-30T21:45:12.254398] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-30T21:45:13.054348] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-30T21:45:13.399744] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T21:45:13.854337] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-30T21:45:13.944978] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T21:45:14.089871] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T21:45:14.261074] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T21:45:14.654366] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-30T21:45:15.454392] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-30T21:45:15.803465] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T21:45:16.254417] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-30T21:45:17.054371] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-30T21:45:17.542197] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-30T21:45:17.784339] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T21:45:17.854416] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-30T21:45:17.960160] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T21:45:18.654336] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-30T21:45:18.894985] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T21:45:19.454382] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-30T21:45:20.254370] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-30T21:45:20.569885] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T21:45:20.683968] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T21:45:20.688508] [INFO ] [REMOTE ] VGM: Full fetch complete (26139 records). [2025-09-30T21:45:20.688596] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-30T21:45:21.064185] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-30T21:45:21.106874] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-30T21:45:21.106973] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-30T21:45:21.107639] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-30T21:45:21.107792] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-30T21:45:21.108942] [DEBUG] [LOCAL ] VGM: Trimmed 26139 records to 18249 (keeping 200 days of data) [2025-09-30T21:45:21.232530] [DEBUG] [LOCAL ] VGM: Primary data saved (18249 records). [2025-09-30T21:45:21.232783] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-30T21:45:21.232913] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 31.7s. Estimated remaining: 18m 43s. Rate: 7.8 symbols/min [2025-09-30T21:45:21.426237] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:21.494403] [DEBUG] [LOCAL ] VIPS: Loaded 51313 existing records from primary storage. [2025-09-30T21:45:21.494818] [INFO ] [MAIN ] VIPS: Loaded 51313 existing records. [2025-09-30T21:45:21.633418] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T21:45:21.705342] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:21.705610] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-30T21:45:21.705696] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-30T21:45:21.706330] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-30T21:45:21.706394] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-30T21:45:21.857110] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-30T21:45:22.103634] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:22.135892] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T21:45:22.654380] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-30T21:45:23.454385] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-30T21:45:23.966661] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T21:45:24.254355] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-30T21:45:24.444556] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T21:45:24.961569] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T21:45:25.054294] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-30T21:45:25.484384] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T21:45:25.854363] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-30T21:45:26.358664] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T21:45:26.654453] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-30T21:45:27.214340] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T21:45:27.454368] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-30T21:45:28.254348] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-30T21:45:28.377144] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T21:45:29.054411] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-30T21:45:29.174975] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T21:45:29.531484] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T21:45:29.806531] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T21:45:29.854389] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-30T21:45:30.654401] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-30T21:45:31.454344] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-30T21:45:31.645454] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T21:45:32.035457] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T21:45:32.036587] [INFO ] [REMOTE ] VHI: Full fetch complete (4505 records). [2025-09-30T21:45:32.036690] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-30T21:45:32.262963] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-30T21:45:32.441969] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-30T21:45:32.442172] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-30T21:45:32.442424] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-30T21:45:32.442505] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-30T21:45:32.443135] [DEBUG] [LOCAL ] VHI: Trimmed 4505 records to 2768 (keeping 200 days of data) [2025-09-30T21:45:32.461836] [DEBUG] [LOCAL ] VHI: Primary data saved (2768 records). [2025-09-30T21:45:32.461954] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-30T21:45:32.462085] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 29.8s. Estimated remaining: 18m 36s. Rate: 7.8 symbols/min [2025-09-30T21:45:32.644022] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:32.683892] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T21:45:32.739458] [DEBUG] [LOCAL ] VIRT: Loaded 46674 existing records from primary storage. [2025-09-30T21:45:32.739818] [INFO ] [MAIN ] VIRT: Loaded 46674 existing records. [2025-09-30T21:45:32.940039] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:32.940346] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-30T21:45:32.940396] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-30T21:45:32.941598] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-30T21:45:32.941699] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-30T21:45:33.059301] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-30T21:45:33.347740] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:33.854366] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-30T21:45:34.013265] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T21:45:34.551970] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T21:45:34.654381] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-30T21:45:35.139734] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T21:45:35.454411] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-30T21:45:35.872636] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T21:45:36.254378] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-30T21:45:36.880184] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:45:37.054410] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-30T21:45:37.843096] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:45:37.854326] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-30T21:45:38.654353] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-30T21:45:39.055799] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T21:45:39.455122] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-30T21:45:39.460902] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:45:40.254327] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-30T21:45:40.468687] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T21:45:41.054344] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-30T21:45:41.430035] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T21:45:41.859507] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-30T21:45:41.881975] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:45:42.412227] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T21:45:42.654411] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-30T21:45:43.454350] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-30T21:45:43.665727] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:45:44.254374] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-30T21:45:44.411457] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T21:45:45.054479] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-30T21:45:45.182574] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T21:45:45.194874] [INFO ] [REMOTE ] VICI: Full fetch complete (77656 records). [2025-09-30T21:45:45.195048] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-30T21:45:45.636207] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-30T21:45:45.636358] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-30T21:45:45.637676] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-30T21:45:45.637779] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-30T21:45:45.639809] [DEBUG] [LOCAL ] VICI: Trimmed 77656 records to 53647 (keeping 200 days of data) [2025-09-30T21:45:45.767752] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:45:45.787283] [INFO ] [REMOTE ] VIK: Full fetch complete (75857 records). [2025-09-30T21:45:45.788618] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-30T21:45:45.859077] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-30T21:45:46.417733] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-30T21:45:46.418805] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-30T21:45:46.424448] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-30T21:45:46.425355] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-30T21:45:46.448067] [DEBUG] [LOCAL ] VIK: Trimmed 75857 records to 52483 (keeping 200 days of data) [2025-09-30T21:45:46.660796] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:45:46.676621] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-30T21:45:46.707963] [DEBUG] [LOCAL ] VICI: Primary data saved (53647 records). [2025-09-30T21:45:46.708772] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-30T21:45:46.709220] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VICI took 37.3s. Estimated remaining: 18m 28s. Rate: 7.8 symbols/min [2025-09-30T21:45:46.897472] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:47.052218] [DEBUG] [LOCAL ] VIST: Loaded 45967 existing records from primary storage. [2025-09-30T21:45:47.056268] [INFO ] [MAIN ] VIST: Loaded 45967 existing records. [2025-09-30T21:45:47.323619] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:47.324713] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-30T21:45:47.324892] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-30T21:45:47.327561] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-30T21:45:47.327947] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-30T21:45:47.561246] [DEBUG] [LOCAL ] VIK: Primary data saved (52483 records). [2025-09-30T21:45:47.576262] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-30T21:45:47.603354] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIK took 37.9s. Estimated remaining: 18m 20s. Rate: 7.8 symbols/min [2025-09-30T21:45:47.961821] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:47.970220] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-30T21:45:48.002010] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T21:45:48.071806] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:48.126481] [DEBUG] [LOCAL ] VIV: Loaded 44940 existing records from primary storage. [2025-09-30T21:45:48.126876] [INFO ] [MAIN ] VIV: Loaded 44940 existing records. [2025-09-30T21:45:48.264115] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-30T21:45:48.345684] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:48.345971] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-30T21:45:48.346149] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-30T21:45:48.356790] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-30T21:45:48.357370] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-30T21:45:48.474095] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T21:45:48.773139] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:49.054400] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-30T21:45:49.671058] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T21:45:49.854430] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-30T21:45:49.922147] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:45:50.568584] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:45:50.581214] [INFO ] [REMOTE ] VIPS: Full fetch complete (74600 records). [2025-09-30T21:45:50.581404] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-30T21:45:50.660253] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-30T21:45:51.015724] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-30T21:45:51.015836] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-30T21:45:51.017174] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-30T21:45:51.017245] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-30T21:45:51.018957] [DEBUG] [LOCAL ] VIPS: Trimmed 74600 records to 51330 (keeping 200 days of data) [2025-09-30T21:45:51.294637] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T21:45:51.397857] [DEBUG] [LOCAL ] VIPS: Primary data saved (51330 records). [2025-09-30T21:45:51.398037] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-30T21:45:51.398157] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 30.2s. Estimated remaining: 18m 12s. Rate: 7.8 symbols/min [2025-09-30T21:45:51.459635] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-30T21:45:51.613122] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:45:51.633823] [DEBUG] [LOCAL ] VKQ: Loaded 17477 existing records from primary storage. [2025-09-30T21:45:51.634153] [INFO ] [MAIN ] VKQ: Loaded 17477 existing records. [2025-09-30T21:45:51.866609] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:45:51.866845] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-30T21:45:51.866909] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-30T21:45:51.867268] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-30T21:45:51.867326] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-30T21:45:52.256724] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-30T21:45:52.286754] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:45:52.316962] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T21:45:53.054344] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-30T21:45:53.132472] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T21:45:53.854339] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-30T21:45:53.972287] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T21:45:54.642943] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:45:54.660511] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-30T21:45:55.169598] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T21:45:55.454414] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-30T21:45:55.977557] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:45:56.254373] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-30T21:45:56.453258] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T21:45:57.054370] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-30T21:45:57.453703] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T21:45:57.737898] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T21:45:57.854411] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-30T21:45:58.654398] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-30T21:45:58.678747] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T21:45:59.454376] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-30T21:46:00.254384] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-30T21:46:00.365686] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T21:46:00.548778] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:46:01.054400] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-30T21:46:01.786758] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T21:46:01.798102] [INFO ] [REMOTE ] VIRT: Full fetch complete (67024 records). [2025-09-30T21:46:01.798324] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-30T21:46:01.859494] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-30T21:46:02.237562] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T21:46:02.265847] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-30T21:46:02.266355] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-30T21:46:02.267561] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-30T21:46:02.267660] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-30T21:46:02.269210] [DEBUG] [LOCAL ] VIRT: Trimmed 67024 records to 46656 (keeping 200 days of data) [2025-09-30T21:46:02.577808] [DEBUG] [LOCAL ] VIRT: Primary data saved (46656 records). [2025-09-30T21:46:02.577992] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-30T21:46:02.578108] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 30.1s. Estimated remaining: 18m 5s. Rate: 7.8 symbols/min [2025-09-30T21:46:02.659450] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-30T21:46:02.770162] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:02.807727] [DEBUG] [LOCAL ] VLN: Loaded 28862 existing records from primary storage. [2025-09-30T21:46:02.808079] [INFO ] [MAIN ] VLN: Loaded 28862 existing records. [2025-09-30T21:46:03.010858] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:03.011099] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-30T21:46:03.011171] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-30T21:46:03.011966] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-30T21:46:03.012078] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-30T21:46:03.406488] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:03.454399] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-30T21:46:03.504723] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T21:46:04.254334] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-30T21:46:04.362194] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T21:46:04.997764] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T21:46:05.054367] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-30T21:46:05.179489] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T21:46:05.854385] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-30T21:46:06.654419] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-30T21:46:06.692171] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T21:46:07.460059] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-30T21:46:07.472854] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T21:46:07.706670] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T21:46:08.254381] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-30T21:46:08.899980] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T21:46:09.054344] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-30T21:46:09.213350] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T21:46:09.854319] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-30T21:46:10.014129] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T21:46:10.565349] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T21:46:10.654373] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-30T21:46:11.454366] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-30T21:46:11.681250] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T21:46:12.254370] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-30T21:46:12.458151] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T21:46:13.054360] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-30T21:46:13.759250] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T21:46:13.854359] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-30T21:46:14.061823] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T21:46:14.066490] [INFO ] [REMOTE ] VKQ: Full fetch complete (24663 records). [2025-09-30T21:46:14.066619] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-30T21:46:14.490182] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-30T21:46:14.490295] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-30T21:46:14.490928] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-30T21:46:14.490993] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-30T21:46:14.491947] [DEBUG] [LOCAL ] VKQ: Trimmed 24663 records to 17592 (keeping 200 days of data) [2025-09-30T21:46:14.605834] [DEBUG] [LOCAL ] VKQ: Primary data saved (17592 records). [2025-09-30T21:46:14.605988] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-30T21:46:14.606091] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VKQ took 23.2s. Estimated remaining: 17m 58s. Rate: 7.8 symbols/min [2025-09-30T21:46:14.662789] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-30T21:46:14.788066] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:14.858786] [DEBUG] [LOCAL ] VLO: Loaded 53086 existing records from primary storage. [2025-09-30T21:46:14.859201] [INFO ] [MAIN ] VLO: Loaded 53086 existing records. [2025-09-30T21:46:15.112064] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:15.112411] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-30T21:46:15.112493] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-30T21:46:15.113796] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-30T21:46:15.113905] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-30T21:46:15.459861] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-30T21:46:15.507421] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:15.672945] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T21:46:15.683622] [INFO ] [REMOTE ] VIST: Full fetch complete (66867 records). [2025-09-30T21:46:15.683804] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-30T21:46:16.125921] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-30T21:46:16.126035] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-30T21:46:16.127191] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-30T21:46:16.127257] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-30T21:46:16.128697] [DEBUG] [LOCAL ] VIST: Trimmed 66867 records to 45959 (keeping 200 days of data) [2025-09-30T21:46:16.242911] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:46:16.254509] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-30T21:46:16.439453] [DEBUG] [LOCAL ] VIST: Primary data saved (45959 records). [2025-09-30T21:46:16.439598] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-30T21:46:16.439707] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 29.7s. Estimated remaining: 17m 49s. Rate: 7.8 symbols/min [2025-09-30T21:46:16.617418] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:16.679848] [DEBUG] [LOCAL ] VLRS: Loaded 40414 existing records from primary storage. [2025-09-30T21:46:16.680283] [INFO ] [MAIN ] VLRS: Loaded 40414 existing records. [2025-09-30T21:46:16.885510] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:16.886160] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-30T21:46:16.886288] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-30T21:46:16.886924] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-30T21:46:16.886991] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-30T21:46:17.055110] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-30T21:46:17.293340] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:17.321566] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T21:46:17.414123] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T21:46:17.854357] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-30T21:46:18.654364] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-30T21:46:18.996714] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T21:46:19.356584] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T21:46:19.454316] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-30T21:46:19.845219] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T21:46:20.254366] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-30T21:46:20.854029] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T21:46:21.054352] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-30T21:46:21.654936] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T21:46:21.854352] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-30T21:46:22.469545] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T21:46:22.654351] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-30T21:46:23.296844] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:46:23.454363] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-30T21:46:24.254360] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-30T21:46:24.559662] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T21:46:24.996273] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:46:25.054334] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-30T21:46:25.854329] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-30T21:46:25.955830] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T21:46:26.654400] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-30T21:46:26.705460] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T21:46:27.436333] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T21:46:27.454308] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-30T21:46:27.933282] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T21:46:28.254365] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-30T21:46:28.868504] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T21:46:28.876935] [INFO ] [REMOTE ] VLN: Full fetch complete (43190 records). [2025-09-30T21:46:28.877054] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-30T21:46:29.056682] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-30T21:46:29.317566] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-30T21:46:29.317672] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-30T21:46:29.318659] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-30T21:46:29.318724] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-30T21:46:29.320073] [DEBUG] [LOCAL ] VLN: Trimmed 43190 records to 28918 (keeping 200 days of data) [2025-09-30T21:46:29.494667] [DEBUG] [LOCAL ] VLN: Primary data saved (28918 records). [2025-09-30T21:46:29.494820] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-30T21:46:29.494910] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VLN took 26.9s. Estimated remaining: 17m 42s. Rate: 7.8 symbols/min [2025-09-30T21:46:29.710707] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:29.741358] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T21:46:29.753685] [DEBUG] [LOCAL ] VLT: Loaded 4558 existing records from primary storage. [2025-09-30T21:46:29.754244] [INFO ] [MAIN ] VLT: Loaded 4558 existing records. [2025-09-30T21:46:29.859699] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-30T21:46:29.942719] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:29.942940] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-30T21:46:29.942990] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-30T21:46:29.943241] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-30T21:46:29.943298] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-30T21:46:30.338950] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:30.654382] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-30T21:46:31.033910] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T21:46:31.327194] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T21:46:31.454381] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-30T21:46:31.877865] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T21:46:32.259440] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-30T21:46:32.276174] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T21:46:32.285623] [INFO ] [REMOTE ] VIV: Full fetch complete (64696 records). [2025-09-30T21:46:32.285808] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-30T21:46:32.709847] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-30T21:46:32.709942] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-30T21:46:32.711066] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-30T21:46:32.711135] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-30T21:46:32.712849] [DEBUG] [LOCAL ] VIV: Trimmed 64696 records to 45002 (keeping 200 days of data) [2025-09-30T21:46:33.008717] [DEBUG] [LOCAL ] VIV: Primary data saved (45002 records). [2025-09-30T21:46:33.008889] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-30T21:46:33.009020] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VIV took 45.4s. Estimated remaining: 17m 34s. Rate: 7.8 symbols/min [2025-09-30T21:46:33.059517] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-30T21:46:33.208836] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:33.261864] [DEBUG] [LOCAL ] VLTO: Loaded 45975 existing records from primary storage. [2025-09-30T21:46:33.262248] [INFO ] [MAIN ] VLTO: Loaded 45975 existing records. [2025-09-30T21:46:33.463089] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:33.463373] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-30T21:46:33.463423] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-30T21:46:33.464121] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-30T21:46:33.464210] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-30T21:46:33.853268] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:33.854313] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-30T21:46:34.325612] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-30T21:46:34.638535] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T21:46:34.654320] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-30T21:46:35.193082] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T21:46:35.366918] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T21:46:35.454366] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-30T21:46:36.254369] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-30T21:46:37.054397] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-30T21:46:37.302091] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T21:46:37.575334] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:46:37.854403] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-30T21:46:38.654355] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-30T21:46:38.689314] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T21:46:39.243802] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T21:46:39.252346] [INFO ] [REMOTE ] VLRS: Full fetch complete (58529 records). [2025-09-30T21:46:39.252514] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-30T21:46:39.459987] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-30T21:46:39.677108] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-30T21:46:39.677194] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-30T21:46:39.678320] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-30T21:46:39.678391] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-30T21:46:39.679742] [DEBUG] [LOCAL ] VLRS: Trimmed 58529 records to 40400 (keeping 200 days of data) [2025-09-30T21:46:39.922672] [DEBUG] [LOCAL ] VLRS: Primary data saved (40400 records). [2025-09-30T21:46:39.922811] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-30T21:46:39.922911] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLRS took 23.5s. Estimated remaining: 17m 26s. Rate: 7.8 symbols/min [2025-09-30T21:46:40.108355] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:40.154096] [DEBUG] [LOCAL ] VMC: Loaded 43401 existing records from primary storage. [2025-09-30T21:46:40.154404] [INFO ] [MAIN ] VMC: Loaded 43401 existing records. [2025-09-30T21:46:40.266157] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-30T21:46:40.268404] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T21:46:40.355171] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:40.355485] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-30T21:46:40.355540] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-30T21:46:40.356164] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-30T21:46:40.356228] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-30T21:46:40.763799] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:40.800002] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-30T21:46:41.054352] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-30T21:46:41.854385] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-30T21:46:41.902092] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:46:42.479671] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T21:46:42.654374] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-30T21:46:42.990824] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T21:46:43.454418] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-30T21:46:44.254328] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-30T21:46:44.454565] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T21:46:44.473427] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T21:46:45.054366] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-30T21:46:45.854403] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-30T21:46:45.880257] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T21:46:46.450017] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T21:46:46.654390] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-30T21:46:46.996286] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T21:46:47.454443] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-30T21:46:48.070785] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T21:46:48.254419] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-30T21:46:48.420459] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:46:49.054382] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-30T21:46:49.690878] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T21:46:49.850292] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T21:46:49.858792] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-30T21:46:50.654406] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-30T21:46:51.454341] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-30T21:46:51.639045] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T21:46:52.254340] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-30T21:46:52.318458] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T21:46:53.054392] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-30T21:46:53.100877] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:46:53.638144] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T21:46:53.854343] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-30T21:46:54.328182] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T21:46:54.340458] [INFO ] [REMOTE ] VLO: Full fetch complete (76925 records). [2025-09-30T21:46:54.340756] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-30T21:46:54.662469] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-30T21:46:54.786803] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-30T21:46:54.786921] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-30T21:46:54.788178] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-30T21:46:54.788249] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-30T21:46:54.794154] [DEBUG] [LOCAL ] VLO: Trimmed 76925 records to 53077 (keeping 200 days of data) [2025-09-30T21:46:55.171581] [DEBUG] [LOCAL ] VLO: Primary data saved (53077 records). [2025-09-30T21:46:55.171786] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-30T21:46:55.171896] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 40.6s. Estimated remaining: 17m 19s. Rate: 7.8 symbols/min [2025-09-30T21:46:55.368982] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:46:55.370378] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T21:46:55.373335] [INFO ] [REMOTE ] VLT: Full fetch complete (7518 records). [2025-09-30T21:46:55.373467] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-30T21:46:55.469400] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-30T21:46:55.543003] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T21:46:55.561557] [DEBUG] [LOCAL ] VMI: Loaded 15416 existing records from primary storage. [2025-09-30T21:46:55.567077] [INFO ] [MAIN ] VMI: Loaded 15416 existing records. [2025-09-30T21:46:56.010363] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:46:56.046374] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-30T21:46:56.076029] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-30T21:46:56.076272] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-30T21:46:56.076332] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-30T21:46:56.076569] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-30T21:46:56.076663] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-30T21:46:56.076802] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-30T21:46:56.076741] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-30T21:46:56.146879] [DEBUG] [LOCAL ] VLT: Trimmed 7518 records to 4554 (keeping 200 days of data) [2025-09-30T21:46:56.254807] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-30T21:46:56.397125] [DEBUG] [LOCAL ] VLT: Primary data saved (4554 records). [2025-09-30T21:46:56.408929] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-30T21:46:56.433549] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 26.9s. Estimated remaining: 17m 11s. Rate: 7.8 symbols/min [2025-09-30T21:46:56.525396] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:46:57.054336] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-30T21:46:57.415947] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T21:46:57.854358] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-30T21:46:57.995323] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:46:58.042298] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T21:46:58.654408] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-30T21:46:59.367953] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T21:46:59.454396] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-30T21:46:59.559502] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:47:00.254407] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-30T21:47:00.864595] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T21:47:01.054421] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-30T21:47:01.525785] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T21:47:01.854379] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-30T21:47:02.508206] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T21:47:02.518350] [INFO ] [REMOTE ] VLTO: Full fetch complete (66886 records). [2025-09-30T21:47:02.518485] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-30T21:47:02.659497] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-30T21:47:02.945547] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-30T21:47:02.945730] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-30T21:47:02.946907] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-30T21:47:02.947023] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-30T21:47:02.948798] [DEBUG] [LOCAL ] VLTO: Trimmed 66886 records to 45995 (keeping 200 days of data) [2025-09-30T21:47:03.077629] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T21:47:03.293083] [DEBUG] [LOCAL ] VLTO: Primary data saved (45995 records). [2025-09-30T21:47:03.293220] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-30T21:47:03.293307] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 30.3s. Estimated remaining: 17m 3s. Rate: 7.8 symbols/min [2025-09-30T21:47:03.416888] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T21:47:03.454413] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-30T21:47:04.254380] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-30T21:47:04.524041] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T21:47:05.054359] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-30T21:47:05.929109] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:47:05.939188] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-30T21:47:06.113879] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T21:47:06.654362] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-30T21:47:07.555587] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T21:47:07.572860] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-30T21:47:07.573746] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T21:47:08.254374] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-30T21:47:09.124533] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T21:47:09.134149] [INFO ] [REMOTE ] VMC: Full fetch complete (62557 records). [2025-09-30T21:47:09.134334] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-30T21:47:09.497878] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T21:47:09.554508] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-30T21:47:09.599855] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-30T21:47:09.599945] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-30T21:47:09.601025] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-30T21:47:09.601093] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-30T21:47:09.602478] [DEBUG] [LOCAL ] VMC: Trimmed 62557 records to 43331 (keeping 200 days of data) [2025-09-30T21:47:09.893861] [DEBUG] [LOCAL ] VMC: Primary data saved (43331 records). [2025-09-30T21:47:09.894015] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-30T21:47:09.894111] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMC took 30.0s. Estimated remaining: 16m 56s. Rate: 7.8 symbols/min [2025-09-30T21:47:10.385811] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T21:47:10.389980] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-30T21:47:11.511887] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T21:47:11.515611] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-30T21:47:12.506184] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T21:47:12.509961] [INFO ] [REMOTE ] VMI: Full fetch complete (21215 records). [2025-09-30T21:47:12.510081] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-30T21:47:12.911224] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-30T21:47:12.911326] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-30T21:47:12.911824] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-30T21:47:12.911887] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-30T21:47:12.912813] [DEBUG] [LOCAL ] VMI: Trimmed 21215 records to 15382 (keeping 200 days of data) [2025-09-30T21:47:13.015990] [DEBUG] [LOCAL ] VMI: Primary data saved (15382 records). [2025-09-30T21:47:13.016151] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-30T21:47:13.016245] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMI took 17.8s. Estimated remaining: 16m 48s. Rate: 7.8 symbols/min [2025-09-30T21:47:13.743790] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:13.802549] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:13.798379] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:13.803764] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:13.816448] [DEBUG] [LOCAL ] VNCE: Loaded 7694 existing records from primary storage. [2025-09-30T21:47:13.816804] [INFO ] [MAIN ] VNCE: Loaded 7694 existing records. [2025-09-30T21:47:13.981532] [DEBUG] [LOCAL ] VMO: Loaded 20979 existing records from primary storage. [2025-09-30T21:47:14.020038] [INFO ] [MAIN ] VMO: Loaded 20979 existing records. [2025-09-30T21:47:14.082465] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:14.089384] [DEBUG] [LOCAL ] VNT: Loaded 43608 existing records from primary storage. [2025-09-30T21:47:14.090437] [DEBUG] [LOCAL ] VNO: Loaded 48911 existing records from primary storage. [2025-09-30T21:47:14.096005] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-30T21:47:14.120863] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-30T21:47:14.121087] [INFO ] [MAIN ] VNO: Loaded 48911 existing records. [2025-09-30T21:47:14.126510] [INFO ] [MAIN ] VNT: Loaded 43608 existing records. [2025-09-30T21:47:14.252163] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-30T21:47:14.375715] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-30T21:47:14.763284] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:14.843345] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:14.843750] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-30T21:47:14.843914] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-30T21:47:14.785828] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:14.865222] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-30T21:47:14.870540] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-30T21:47:14.870599] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-30T21:47:14.905857] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-30T21:47:14.936760] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-30T21:47:14.936567] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-30T21:47:15.006421] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-30T21:47:15.022960] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-30T21:47:15.066596] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-30T21:47:15.071873] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-30T21:47:15.562808] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:15.707865] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-30T21:47:16.277082] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:16.296902] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-30T21:47:16.291391] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:16.333009] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-30T21:47:16.369475] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:16.369925] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-30T21:47:17.124021] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T21:47:17.128301] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-30T21:47:17.515627] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T21:47:17.521309] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-30T21:47:17.682130] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T21:47:17.692500] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-30T21:47:17.861043] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T21:47:17.869634] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-30T21:47:18.510306] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T21:47:18.515823] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-30T21:47:18.544057] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:47:18.654373] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-30T21:47:19.082748] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T21:47:19.220474] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T21:47:19.322136] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T21:47:19.454340] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-30T21:47:19.812155] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T21:47:20.254357] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-30T21:47:20.870738] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T21:47:21.017694] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T21:47:21.054355] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-30T21:47:21.854363] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-30T21:47:22.651496] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T21:47:22.655129] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-30T21:47:22.899131] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T21:47:23.261940] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T21:47:23.454362] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-30T21:47:24.254350] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-30T21:47:24.676292] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T21:47:24.917382] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:47:25.054422] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-30T21:47:25.854369] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-30T21:47:26.661475] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-30T21:47:26.668675] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T21:47:26.831318] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T21:47:27.454372] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-30T21:47:27.615546] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:47:28.254383] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-30T21:47:28.585617] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T21:47:29.042607] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T21:47:29.054323] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-30T21:47:29.854350] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-30T21:47:30.146861] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T21:47:30.654365] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-30T21:47:31.378297] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T21:47:31.454338] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-30T21:47:31.560514] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:47:32.254370] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-30T21:47:32.848207] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T21:47:32.854550] [INFO ] [REMOTE ] VNCE: Full fetch complete (15747 records). [2025-09-30T21:47:32.854737] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-30T21:47:33.062523] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-30T21:47:33.253350] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-30T21:47:33.253436] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-30T21:47:33.253884] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-30T21:47:33.253949] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-30T21:47:33.254571] [DEBUG] [LOCAL ] VNCE: Trimmed 15747 records to 7820 (keeping 200 days of data) [2025-09-30T21:47:33.303152] [DEBUG] [LOCAL ] VNCE: Primary data saved (7820 records). [2025-09-30T21:47:33.303303] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-30T21:47:33.303390] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 20.3s. Estimated remaining: 16m 41s. Rate: 7.8 symbols/min [2025-09-30T21:47:33.491492] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:33.503688] [DEBUG] [LOCAL ] VOC: Loaded 8895 existing records from primary storage. [2025-09-30T21:47:33.503925] [INFO ] [MAIN ] VOC: Loaded 8895 existing records. [2025-09-30T21:47:33.719209] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:33.719576] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-30T21:47:33.719742] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-30T21:47:33.720154] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-30T21:47:33.720229] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-30T21:47:33.856728] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-30T21:47:33.858285] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T21:47:34.169973] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:34.243940] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T21:47:34.654356] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-30T21:47:35.454340] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-30T21:47:35.486941] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T21:47:35.933915] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T21:47:36.253684] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T21:47:36.255733] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-30T21:47:36.260782] [INFO ] [REMOTE ] VMO: Full fetch complete (31423 records). [2025-09-30T21:47:36.260885] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-30T21:47:36.667228] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-30T21:47:36.667323] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-30T21:47:36.668070] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-30T21:47:36.668135] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-30T21:47:36.669134] [DEBUG] [LOCAL ] VMO: Trimmed 31423 records to 21036 (keeping 200 days of data) [2025-09-30T21:47:36.808730] [DEBUG] [LOCAL ] VMO: Primary data saved (21036 records). [2025-09-30T21:47:36.808879] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-30T21:47:36.809027] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 23.8s. Estimated remaining: 16m 33s. Rate: 7.8 symbols/min [2025-09-30T21:47:37.013197] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:37.054387] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-30T21:47:37.069615] [DEBUG] [LOCAL ] VOYA: Loaded 42548 existing records from primary storage. [2025-09-30T21:47:37.069978] [INFO ] [MAIN ] VOYA: Loaded 42548 existing records. [2025-09-30T21:47:37.173393] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T21:47:37.269027] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:37.269242] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-30T21:47:37.269293] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-30T21:47:37.270414] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-30T21:47:37.270477] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-30T21:47:37.632133] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:37.854355] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-30T21:47:38.659490] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-30T21:47:38.678721] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T21:47:39.194591] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T21:47:39.454285] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-30T21:47:39.519159] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T21:47:40.254381] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-30T21:47:41.054320] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-30T21:47:41.119480] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T21:47:41.138240] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T21:47:41.854376] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-30T21:47:42.653483] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T21:47:42.661718] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-30T21:47:42.663358] [INFO ] [REMOTE ] VNT: Full fetch complete (63389 records). [2025-09-30T21:47:42.663446] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-30T21:47:43.059928] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-30T21:47:43.060118] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-30T21:47:43.061177] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-30T21:47:43.061244] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-30T21:47:43.062618] [DEBUG] [LOCAL ] VNT: Trimmed 63389 records to 43548 (keeping 200 days of data) [2025-09-30T21:47:43.342437] [DEBUG] [LOCAL ] VNT: Primary data saved (43548 records). [2025-09-30T21:47:43.342572] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-30T21:47:43.345484] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 30.3s. Estimated remaining: 16m 25s. Rate: 7.8 symbols/min [2025-09-30T21:47:43.455035] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-30T21:47:43.532244] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:43.532542] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-30T21:47:43.532613] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-30T21:47:43.532806] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-30T21:47:43.532864] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-30T21:47:43.533004] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-30T21:47:43.533071] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-30T21:47:43.633305] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T21:47:43.756585] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T21:47:43.951473] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:44.254373] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-30T21:47:45.026434] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T21:47:45.054321] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-30T21:47:45.104273] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T21:47:45.854355] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-30T21:47:46.535945] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:47:46.647486] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T21:47:46.654303] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-30T21:47:47.454377] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-30T21:47:47.486893] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T21:47:48.254358] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-30T21:47:48.999016] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T21:47:49.025825] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T21:47:49.054313] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-30T21:47:49.854355] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-30T21:47:50.636882] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T21:47:50.653875] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T21:47:50.654767] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-30T21:47:51.454396] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-30T21:47:51.621437] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:47:51.621811] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-30T21:47:51.621906] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:47:51.621956] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-30T21:47:51.622015] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:47:51.622087] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-30T21:47:51.622152] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-30T21:47:51.622189] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-30T21:47:51.622246] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-30T21:47:51.622318] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOYG took 8.3s. Estimated remaining: 16m 17s. Rate: 7.8 symbols/min [2025-09-30T21:47:51.822815] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:51.843149] [DEBUG] [LOCAL ] VPG: Loaded 17049 existing records from primary storage. [2025-09-30T21:47:51.843419] [INFO ] [MAIN ] VPG: Loaded 17049 existing records. [2025-09-30T21:47:52.041278] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:52.041609] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-30T21:47:52.041692] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-30T21:47:52.042003] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-30T21:47:52.042062] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-30T21:47:52.259407] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-30T21:47:52.457479] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:52.468549] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T21:47:53.054391] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-30T21:47:53.077157] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T21:47:53.079453] [INFO ] [REMOTE ] VOC: Full fetch complete (13125 records). [2025-09-30T21:47:53.079571] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-30T21:47:53.459621] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-30T21:47:53.459728] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-30T21:47:53.460030] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-30T21:47:53.460069] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-30T21:47:53.460566] [DEBUG] [LOCAL ] VOC: Trimmed 13125 records to 8915 (keeping 200 days of data) [2025-09-30T21:47:53.513605] [DEBUG] [LOCAL ] VOC: Primary data saved (8915 records). [2025-09-30T21:47:53.513761] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-30T21:47:53.513878] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOC took 20.2s. Estimated remaining: 16m 9s. Rate: 7.8 symbols/min [2025-09-30T21:47:53.696880] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:47:53.704930] [DEBUG] [LOCAL ] VPV: Loaded 5403 existing records from primary storage. [2025-09-30T21:47:53.705199] [INFO ] [MAIN ] VPV: Loaded 5403 existing records. [2025-09-30T21:47:53.860799] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-30T21:47:53.904513] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:47:53.904762] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-30T21:47:53.904816] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-30T21:47:53.905084] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-30T21:47:53.905144] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-30T21:47:54.289476] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:47:54.654358] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-30T21:47:54.727279] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T21:47:55.259915] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T21:47:55.454364] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-30T21:47:55.478137] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T21:47:56.254442] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-30T21:47:56.391217] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T21:47:57.054413] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-30T21:47:57.854384] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-30T21:47:57.897463] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T21:47:57.954220] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T21:47:58.654362] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-30T21:47:59.226073] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T21:47:59.437408] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T21:47:59.454340] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-30T21:47:59.853527] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T21:48:00.254395] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-30T21:48:00.976819] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T21:48:01.054361] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-30T21:48:01.717949] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T21:48:01.854377] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-30T21:48:02.654390] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-30T21:48:02.802396] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T21:48:03.037250] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-30T21:48:03.454376] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-30T21:48:04.254380] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-30T21:48:05.054328] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-30T21:48:05.167212] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T21:48:05.179295] [INFO ] [REMOTE ] VNO: Full fetch complete (70444 records). [2025-09-30T21:48:05.179491] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-30T21:48:05.655152] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-30T21:48:05.655348] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-30T21:48:05.657461] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-30T21:48:05.657570] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-30T21:48:05.659402] [DEBUG] [LOCAL ] VNO: Trimmed 70444 records to 48866 (keeping 200 days of data) [2025-09-30T21:48:05.808995] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T21:48:05.872062] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-30T21:48:05.925404] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T21:48:06.021084] [DEBUG] [LOCAL ] VNO: Primary data saved (48866 records). [2025-09-30T21:48:06.021240] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-30T21:48:06.021473] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VNO took 53.0s. Estimated remaining: 16m 2s. Rate: 7.8 symbols/min [2025-09-30T21:48:06.212610] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:06.257519] [DEBUG] [LOCAL ] VRE: Loaded 34845 existing records from primary storage. [2025-09-30T21:48:06.257864] [INFO ] [MAIN ] VRE: Loaded 34845 existing records. [2025-09-30T21:48:06.448752] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:06.449027] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-30T21:48:06.449115] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-30T21:48:06.450062] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-30T21:48:06.450145] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-30T21:48:06.562838] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T21:48:06.659453] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-30T21:48:06.851555] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:07.454377] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-30T21:48:07.745165] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T21:48:08.254370] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-30T21:48:08.449898] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T21:48:09.054366] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-30T21:48:09.185257] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T21:48:09.854357] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-30T21:48:10.458168] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T21:48:10.654371] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-30T21:48:11.119436] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T21:48:11.454365] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-30T21:48:11.654915] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T21:48:12.252311] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T21:48:12.254319] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-30T21:48:12.255221] [INFO ] [REMOTE ] VPV: Full fetch complete (9348 records). [2025-09-30T21:48:12.255297] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-30T21:48:12.660703] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-30T21:48:12.660792] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-30T21:48:12.661064] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-30T21:48:12.661128] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-30T21:48:12.661764] [DEBUG] [LOCAL ] VPV: Trimmed 9348 records to 5428 (keeping 200 days of data) [2025-09-30T21:48:12.699044] [DEBUG] [LOCAL ] VPV: Primary data saved (5428 records). [2025-09-30T21:48:12.699217] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-30T21:48:12.699335] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPV took 19.2s. Estimated remaining: 15m 54s. Rate: 7.8 symbols/min [2025-09-30T21:48:12.883142] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:12.966290] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-30T21:48:12.966699] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-30T21:48:13.059544] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-30T21:48:13.177182] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:13.177409] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-30T21:48:13.177461] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-30T21:48:13.179102] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-30T21:48:13.179199] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-30T21:48:13.567449] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:13.593477] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T21:48:13.854361] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-30T21:48:14.607248] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T21:48:14.654327] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-30T21:48:14.965353] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T21:48:15.454373] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-30T21:48:16.254363] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-30T21:48:16.298993] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T21:48:16.308617] [INFO ] [REMOTE ] VOYA: Full fetch complete (62018 records). [2025-09-30T21:48:16.308799] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-30T21:48:16.531766] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T21:48:16.788799] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-30T21:48:16.788903] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-30T21:48:16.790203] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-30T21:48:16.790297] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-30T21:48:16.791733] [DEBUG] [LOCAL ] VOYA: Trimmed 62018 records to 42561 (keeping 200 days of data) [2025-09-30T21:48:17.054714] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-30T21:48:17.089207] [DEBUG] [LOCAL ] VOYA: Primary data saved (42561 records). [2025-09-30T21:48:17.089393] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-30T21:48:17.089525] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VOYA took 40.3s. Estimated remaining: 15m 46s. Rate: 7.8 symbols/min [2025-09-30T21:48:17.317714] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:17.331382] [DEBUG] [LOCAL ] VRTS: Loaded 9211 existing records from primary storage. [2025-09-30T21:48:17.331609] [INFO ] [MAIN ] VRTS: Loaded 9211 existing records. [2025-09-30T21:48:17.541065] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:17.541509] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-30T21:48:17.541575] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-30T21:48:17.541926] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-30T21:48:17.541987] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-30T21:48:17.688745] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T21:48:17.859537] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-30T21:48:17.947161] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:18.654369] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-30T21:48:19.107769] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:48:19.454325] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-30T21:48:19.521581] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-30T21:48:20.113961] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T21:48:20.142004] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T21:48:20.254354] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-30T21:48:21.054360] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-30T21:48:21.854357] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-30T21:48:21.987086] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T21:48:22.654427] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-30T21:48:22.686437] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-30T21:48:23.300809] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T21:48:23.454347] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-30T21:48:23.521099] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T21:48:23.524685] [INFO ] [REMOTE ] VPG: Full fetch complete (22882 records). [2025-09-30T21:48:23.524792] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-30T21:48:23.935057] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-30T21:48:23.935141] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-30T21:48:23.935689] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-30T21:48:23.935752] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-30T21:48:23.936485] [DEBUG] [LOCAL ] VPG: Trimmed 22882 records to 17041 (keeping 200 days of data) [2025-09-30T21:48:24.045455] [DEBUG] [LOCAL ] VPG: Primary data saved (17041 records). [2025-09-30T21:48:24.045606] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-30T21:48:24.045748] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VPG took 32.4s. Estimated remaining: 15m 38s. Rate: 7.8 symbols/min [2025-09-30T21:48:24.230907] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:24.268203] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-30T21:48:24.292335] [DEBUG] [LOCAL ] VSCO: Loaded 52776 existing records from primary storage. [2025-09-30T21:48:24.292741] [INFO ] [MAIN ] VSCO: Loaded 52776 existing records. [2025-09-30T21:48:24.492318] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:24.492568] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-30T21:48:24.492626] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-30T21:48:24.493043] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-30T21:48:24.493100] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-30T21:48:24.803566] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T21:48:24.843683] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T21:48:24.953763] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:25.054353] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-30T21:48:25.720723] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T21:48:25.854373] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-30T21:48:26.654385] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-30T21:48:27.316521] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T21:48:27.454340] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-30T21:48:27.651265] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T21:48:28.254361] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-30T21:48:28.916829] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:48:29.054391] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-30T21:48:29.854368] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-30T21:48:30.471313] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T21:48:30.574371] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-30T21:48:30.606692] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T21:48:30.654314] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-30T21:48:31.224701] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T21:48:31.454398] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-30T21:48:32.254407] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-30T21:48:33.054351] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-30T21:48:33.855862] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-30T21:48:33.861784] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T21:48:34.001535] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-30T21:48:34.002718] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:48:34.654415] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-30T21:48:35.310914] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T21:48:35.394213] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T21:48:35.403591] [INFO ] [REMOTE ] VRE: Full fetch complete (48058 records). [2025-09-30T21:48:35.403845] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-30T21:48:35.461596] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-30T21:48:35.823080] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-30T21:48:35.823209] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-30T21:48:35.824145] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-30T21:48:35.824210] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-30T21:48:35.825359] [DEBUG] [LOCAL ] VRE: Trimmed 48058 records to 34907 (keeping 200 days of data) [2025-09-30T21:48:36.052028] [DEBUG] [LOCAL ] VRE: Primary data saved (34907 records). [2025-09-30T21:48:36.052177] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-30T21:48:36.052272] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 30.0s. Estimated remaining: 15m 31s. Rate: 7.8 symbols/min [2025-09-30T21:48:36.241565] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:36.254385] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-30T21:48:36.296724] [DEBUG] [LOCAL ] VSH: Loaded 48383 existing records from primary storage. [2025-09-30T21:48:36.297045] [INFO ] [MAIN ] VSH: Loaded 48383 existing records. [2025-09-30T21:48:36.513473] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:36.513704] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-30T21:48:36.513781] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-30T21:48:36.514619] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-30T21:48:36.514716] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-30T21:48:37.057719] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-30T21:48:37.101925] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T21:48:37.159747] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T21:48:37.158233] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:37.854395] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-30T21:48:38.565879] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T21:48:38.568242] [INFO ] [REMOTE ] VRTS: Full fetch complete (11425 records). [2025-09-30T21:48:38.568317] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-30T21:48:38.659535] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-30T21:48:38.997462] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-30T21:48:38.997564] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-30T21:48:38.997949] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-30T21:48:38.998026] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-30T21:48:38.998594] [DEBUG] [LOCAL ] VRTS: Trimmed 11425 records to 9286 (keeping 200 days of data) [2025-09-30T21:48:39.060349] [DEBUG] [LOCAL ] VRTS: Primary data saved (9286 records). [2025-09-30T21:48:39.060492] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-30T21:48:39.060589] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRTS took 22.0s. Estimated remaining: 15m 23s. Rate: 7.8 symbols/min [2025-09-30T21:48:39.248368] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:39.309586] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-09-30T21:48:39.309971] [INFO ] [MAIN ] VST: Loaded 53718 existing records. [2025-09-30T21:48:39.470587] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-30T21:48:39.522182] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:39.522423] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-30T21:48:39.522479] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-30T21:48:39.523929] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-30T21:48:39.523992] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-30T21:48:39.922535] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:39.957936] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-30T21:48:40.254361] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-30T21:48:40.559606] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T21:48:40.955299] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T21:48:41.054346] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-30T21:48:41.854397] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-30T21:48:42.654038] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T21:48:42.663499] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-30T21:48:42.747406] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-30T21:48:43.454418] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-30T21:48:43.994904] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-30T21:48:44.254407] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-30T21:48:44.572605] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T21:48:45.054370] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-30T21:48:45.604369] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-30T21:48:45.671125] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T21:48:45.854362] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-30T21:48:46.654412] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-30T21:48:46.764214] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:48:47.464379] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-30T21:48:47.485299] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:48:48.254334] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-30T21:48:49.054423] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-30T21:48:49.253482] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-30T21:48:49.377075] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T21:48:49.642201] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T21:48:49.854435] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-30T21:48:50.654404] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-30T21:48:51.454338] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-30T21:48:51.702923] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-30T21:48:52.254340] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-30T21:48:52.420563] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-30T21:48:52.561479] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T21:48:52.834494] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T21:48:53.054396] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-30T21:48:53.854375] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-30T21:48:54.566788] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-30T21:48:54.654375] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-30T21:48:54.877302] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T21:48:55.454381] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-30T21:48:56.254353] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-30T21:48:56.537753] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-30T21:48:57.054357] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-30T21:48:57.209455] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-30T21:48:57.222167] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-30T21:48:57.222325] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-30T21:48:57.711430] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-30T21:48:57.711875] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-30T21:48:57.715775] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-30T21:48:57.714107] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-30T21:48:57.716060] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-30T21:48:57.730964] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-09-30T21:48:57.772236] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T21:48:57.862373] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-30T21:48:58.154899] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-30T21:48:58.155088] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-30T21:48:58.155195] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 45.5s. Estimated remaining: 15m 16s. Rate: 7.8 symbols/min [2025-09-30T21:48:58.349623] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:48:58.395829] [DEBUG] [LOCAL ] VSTS: Loaded 49016 existing records from primary storage. [2025-09-30T21:48:58.396180] [INFO ] [MAIN ] VSTS: Loaded 49016 existing records. [2025-09-30T21:48:58.598307] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:48:58.598556] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-30T21:48:58.598603] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-30T21:48:58.599636] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-30T21:48:58.599746] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-30T21:48:58.665668] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-30T21:48:58.990714] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:48:59.454343] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-30T21:48:59.673465] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-30T21:48:59.792188] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T21:48:59.803816] [INFO ] [REMOTE ] VSCO: Full fetch complete (76167 records). [2025-09-30T21:48:59.803992] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-30T21:49:00.236458] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-30T21:49:00.236679] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-30T21:49:00.238065] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-30T21:49:00.238158] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-30T21:49:00.239927] [DEBUG] [LOCAL ] VSCO: Trimmed 76167 records to 52767 (keeping 200 days of data) [2025-09-30T21:49:00.295291] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-30T21:49:00.383984] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T21:49:00.619347] [DEBUG] [LOCAL ] VSCO: Primary data saved (52767 records). [2025-09-30T21:49:00.619519] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-30T21:49:00.619629] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 36.6s. Estimated remaining: 15m 8s. Rate: 7.8 symbols/min [2025-09-30T21:49:00.819730] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:00.875950] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T21:49:00.902908] [DEBUG] [LOCAL ] VTEX: Loaded 43304 existing records from primary storage. [2025-09-30T21:49:00.903266] [INFO ] [MAIN ] VTEX: Loaded 43304 existing records. [2025-09-30T21:49:01.067873] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-30T21:49:01.120343] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:01.120704] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-30T21:49:01.120764] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-30T21:49:01.121577] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-30T21:49:01.121710] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-30T21:49:01.499254] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:01.854366] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-30T21:49:02.622254] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:49:02.654323] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-30T21:49:02.930559] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-30T21:49:03.162177] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T21:49:03.172108] [INFO ] [REMOTE ] VSH: Full fetch complete (71018 records). [2025-09-30T21:49:03.172269] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-30T21:49:03.461810] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-30T21:49:03.624548] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-30T21:49:03.624637] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-30T21:49:03.625763] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-30T21:49:03.625828] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-30T21:49:03.627238] [DEBUG] [LOCAL ] VSH: Trimmed 71018 records to 48382 (keeping 200 days of data) [2025-09-30T21:49:03.780004] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T21:49:03.978800] [DEBUG] [LOCAL ] VSH: Primary data saved (48382 records). [2025-09-30T21:49:03.978948] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-30T21:49:03.979036] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 27.9s. Estimated remaining: 15m 0s. Rate: 7.8 symbols/min [2025-09-30T21:49:04.171132] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:04.218256] [DEBUG] [LOCAL ] VTLE: Loaded 48538 existing records from primary storage. [2025-09-30T21:49:04.218604] [INFO ] [MAIN ] VTLE: Loaded 48538 existing records. [2025-09-30T21:49:04.259444] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-30T21:49:04.419637] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:04.419900] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-30T21:49:04.419960] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-30T21:49:04.420953] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-30T21:49:04.421016] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-30T21:49:04.804850] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:05.055889] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-30T21:49:05.061342] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:49:05.854365] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-30T21:49:06.596200] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T21:49:06.641574] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-30T21:49:06.654346] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-30T21:49:06.990337] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T21:49:07.454369] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-30T21:49:08.256418] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-30T21:49:08.262050] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T21:49:09.054370] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-30T21:49:09.835311] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T21:49:09.854299] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-30T21:49:09.995375] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-30T21:49:10.654370] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-30T21:49:10.709600] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T21:49:11.451497] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T21:49:11.460929] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-30T21:49:12.242501] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T21:49:12.254306] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-30T21:49:12.881136] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T21:49:13.054377] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-30T21:49:13.720552] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T21:49:13.854337] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-30T21:49:14.663618] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-30T21:49:14.684111] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:49:15.097462] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T21:49:15.454333] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-30T21:49:16.254362] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-30T21:49:16.666999] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T21:49:16.870527] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-30T21:49:17.054364] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-30T21:49:17.854344] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-30T21:49:17.921588] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:49:18.536043] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T21:49:18.654359] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-30T21:49:19.343845] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T21:49:19.454364] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-30T21:49:20.254344] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-30T21:49:20.418709] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T21:49:21.055996] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T21:49:21.054733] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-30T21:49:21.854360] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-30T21:49:22.654749] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-30T21:49:22.657169] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-30T21:49:22.670848] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-09-30T21:49:22.671084] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-30T21:49:23.109331] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T21:49:23.132254] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-30T21:49:23.136264] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-30T21:49:23.143633] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-30T21:49:23.143768] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-30T21:49:23.147065] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 53718 (keeping 200 days of data) [2025-09-30T21:49:23.276073] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T21:49:23.290041] [INFO ] [REMOTE ] VSTS: Full fetch complete (69792 records). [2025-09-30T21:49:23.290752] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-30T21:49:23.455515] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-30T21:49:23.834859] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-30T21:49:23.845126] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-30T21:49:23.846834] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-30T21:49:23.873062] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-30T21:49:23.877786] [DEBUG] [LOCAL ] VSTS: Trimmed 69792 records to 49011 (keeping 200 days of data) [2025-09-30T21:49:24.236565] [DEBUG] [LOCAL ] VST: Primary data saved (53718 records). [2025-09-30T21:49:24.240088] [INFO ] [MAIN ] VST: Full history saved. [2025-09-30T21:49:24.240212] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VST took 45.2s. Estimated remaining: 14m 53s. Rate: 7.8 symbols/min [2025-09-30T21:49:24.509418] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T21:49:24.515588] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:24.519410] [DEBUG] [LOCAL ] VSTS: Primary data saved (49011 records). [2025-09-30T21:49:24.526793] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-30T21:49:24.526931] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VSTS took 26.4s. Estimated remaining: 14m 45s. Rate: 7.8 symbols/min [2025-09-30T21:49:24.532867] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-30T21:49:24.678857] [DEBUG] [LOCAL ] VTMX: Loaded 17534 existing records from primary storage. [2025-09-30T21:49:24.694781] [INFO ] [MAIN ] VTMX: Loaded 17534 existing records. [2025-09-30T21:49:24.764977] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:24.877785] [DEBUG] [LOCAL ] VTN: Loaded 7072 existing records from primary storage. [2025-09-30T21:49:24.889199] [INFO ] [MAIN ] VTN: Loaded 7072 existing records. [2025-09-30T21:49:25.011078] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:25.046981] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-30T21:49:25.052414] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-30T21:49:25.067205] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-30T21:49:25.081012] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-30T21:49:25.303744] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:25.328607] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-30T21:49:25.339055] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-30T21:49:25.369050] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-30T21:49:25.388672] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-30T21:49:25.639241] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T21:49:25.748388] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-30T21:49:25.897386] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:25.926874] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-30T21:49:26.070908] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:26.096501] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T21:49:26.106101] [INFO ] [REMOTE ] VTEX: Full fetch complete (60724 records). [2025-09-30T21:49:26.106280] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-30T21:49:26.528851] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-30T21:49:26.528937] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-30T21:49:26.529938] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-30T21:49:26.530004] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-30T21:49:26.531359] [DEBUG] [LOCAL ] VTEX: Trimmed 60724 records to 43294 (keeping 200 days of data) [2025-09-30T21:49:26.657990] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-30T21:49:26.797689] [DEBUG] [LOCAL ] VTEX: Primary data saved (43294 records). [2025-09-30T21:49:26.797844] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-30T21:49:26.798002] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 26.2s. Estimated remaining: 14m 37s. Rate: 7.8 symbols/min [2025-09-30T21:49:26.980805] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:27.001803] [DEBUG] [LOCAL ] VTOL: Loaded 19534 existing records from primary storage. [2025-09-30T21:49:27.002149] [INFO ] [MAIN ] VTOL: Loaded 19534 existing records. [2025-09-30T21:49:27.190892] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T21:49:27.226206] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:27.232445] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-30T21:49:27.232526] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-30T21:49:27.233082] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-30T21:49:27.233147] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-30T21:49:27.459489] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-30T21:49:27.636172] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T21:49:27.657033] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:27.664486] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T21:49:28.254393] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-30T21:49:28.503520] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T21:49:28.995712] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T21:49:29.054357] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-30T21:49:29.854373] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-30T21:49:29.948977] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T21:49:30.654362] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-30T21:49:31.314234] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:49:31.384859] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T21:49:31.454356] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-30T21:49:32.254382] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-30T21:49:32.445611] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T21:49:33.054368] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-30T21:49:33.117821] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:49:33.854374] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-30T21:49:34.558246] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T21:49:34.654367] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-30T21:49:34.741812] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:49:35.454347] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-30T21:49:35.605423] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T21:49:36.254419] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-30T21:49:37.048036] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T21:49:37.054305] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-30T21:49:37.155685] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T21:49:37.165906] [INFO ] [REMOTE ] VTLE: Full fetch complete (68845 records). [2025-09-30T21:49:37.166122] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-30T21:49:37.600180] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-30T21:49:37.600271] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-30T21:49:37.601462] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-30T21:49:37.601531] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-30T21:49:37.603129] [DEBUG] [LOCAL ] VTLE: Trimmed 68845 records to 48502 (keeping 200 days of data) [2025-09-30T21:49:37.856100] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-30T21:49:37.915801] [DEBUG] [LOCAL ] VTLE: Primary data saved (48502 records). [2025-09-30T21:49:37.915951] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-30T21:49:37.916036] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 33.9s. Estimated remaining: 14m 29s. Rate: 7.8 symbols/min [2025-09-30T21:49:38.103018] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T21:49:38.106359] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:38.160923] [DEBUG] [LOCAL ] VTR: Loaded 52839 existing records from primary storage. [2025-09-30T21:49:38.161293] [INFO ] [MAIN ] VTR: Loaded 52839 existing records. [2025-09-30T21:49:38.344617] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:38.344874] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-30T21:49:38.344923] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-30T21:49:38.345954] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-30T21:49:38.346016] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-30T21:49:38.532461] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T21:49:38.659485] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-30T21:49:38.733247] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:39.454379] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-30T21:49:39.903859] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T21:49:39.964012] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T21:49:40.254376] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-30T21:49:41.054335] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-30T21:49:41.416365] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T21:49:41.854432] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-30T21:49:41.854356] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T21:49:42.654418] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-30T21:49:43.310418] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T21:49:43.454361] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-30T21:49:43.729303] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T21:49:44.190014] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T21:49:44.254348] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-30T21:49:45.054368] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-30T21:49:45.333156] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T21:49:45.488445] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T21:49:45.854365] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-30T21:49:46.654393] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-30T21:49:47.330372] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:49:47.454365] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-30T21:49:47.826930] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T21:49:48.239896] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T21:49:48.254383] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-30T21:49:49.051724] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T21:49:49.054986] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-30T21:49:49.854399] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-30T21:49:50.193439] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T21:49:50.654341] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-30T21:49:50.856967] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T21:49:50.861071] [INFO ] [REMOTE ] VTMX: Full fetch complete (25984 records). [2025-09-30T21:49:50.861170] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-30T21:49:51.278372] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-30T21:49:51.278478] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-30T21:49:51.279061] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-30T21:49:51.279123] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-30T21:49:51.279835] [DEBUG] [LOCAL ] VTMX: Trimmed 25984 records to 17513 (keeping 200 days of data) [2025-09-30T21:49:51.394761] [DEBUG] [LOCAL ] VTMX: Primary data saved (17513 records). [2025-09-30T21:49:51.394928] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-30T21:49:51.395020] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTMX took 27.2s. Estimated remaining: 14m 22s. Rate: 7.8 symbols/min [2025-09-30T21:49:51.456343] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-30T21:49:51.535370] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T21:49:51.571136] [INFO ] [REMOTE ] VTN: Full fetch complete (11462 records). [2025-09-30T21:49:51.599768] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:51.598441] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-30T21:49:51.925969] [DEBUG] [LOCAL ] VTS: Loaded 30560 existing records from primary storage. [2025-09-30T21:49:51.937571] [INFO ] [MAIN ] VTS: Loaded 30560 existing records. [2025-09-30T21:49:52.165402] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-30T21:49:52.186333] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-30T21:49:52.195199] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-30T21:49:52.211352] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-30T21:49:52.226198] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:52.226543] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-30T21:49:52.226830] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-30T21:49:52.227263] [DEBUG] [LOCAL ] VTN: Trimmed 11462 records to 7051 (keeping 200 days of data) [2025-09-30T21:49:52.227789] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-30T21:49:52.227852] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-30T21:49:52.260556] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-30T21:49:52.449718] [DEBUG] [LOCAL ] VTN: Primary data saved (7051 records). [2025-09-30T21:49:52.478757] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-30T21:49:52.502469] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTN took 28.0s. Estimated remaining: 14m 14s. Rate: 7.8 symbols/min [2025-09-30T21:49:52.707387] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:49:52.870104] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:52.892697] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:52.921278] [DEBUG] [LOCAL ] VVR: Loaded 31013 existing records from primary storage. [2025-09-30T21:49:52.921572] [INFO ] [MAIN ] VVR: Loaded 31013 existing records. [2025-09-30T21:49:53.069553] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-30T21:49:53.117773] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:53.118100] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-30T21:49:53.118204] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-30T21:49:53.118898] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-30T21:49:53.118962] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-30T21:49:53.495845] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:53.854366] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-30T21:49:54.012774] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T21:49:54.204348] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T21:49:54.654376] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-30T21:49:54.677256] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T21:49:55.454334] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-30T21:49:55.692295] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T21:49:55.697837] [INFO ] [REMOTE ] VTOL: Full fetch complete (25943 records). [2025-09-30T21:49:55.697993] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-30T21:49:56.089484] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-30T21:49:56.089563] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-30T21:49:56.090119] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-30T21:49:56.090181] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-30T21:49:56.092059] [DEBUG] [LOCAL ] VTOL: Trimmed 25943 records to 19562 (keeping 200 days of data) [2025-09-30T21:49:56.212478] [DEBUG] [LOCAL ] VTOL: Primary data saved (19562 records). [2025-09-30T21:49:56.212661] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-30T21:49:56.212768] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 29.4s. Estimated remaining: 14m 6s. Rate: 7.8 symbols/min [2025-09-30T21:49:56.263351] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-30T21:49:56.392013] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T21:49:56.425257] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:49:56.479208] [DEBUG] [LOCAL ] VVV: Loaded 50186 existing records from primary storage. [2025-09-30T21:49:56.479569] [INFO ] [MAIN ] VVV: Loaded 50186 existing records. [2025-09-30T21:49:56.668390] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:49:56.668630] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-30T21:49:56.668715] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-30T21:49:56.669795] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-30T21:49:56.669858] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-30T21:49:57.047941] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:49:57.054351] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-30T21:49:57.854357] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-30T21:49:58.136219] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:49:58.171965] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T21:49:58.654365] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-30T21:49:59.223755] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T21:49:59.454377] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-30T21:50:00.254380] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-30T21:50:00.441201] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T21:50:01.054377] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-30T21:50:01.119189] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T21:50:01.854422] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-30T21:50:02.096637] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T21:50:02.171977] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T21:50:02.654370] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-30T21:50:03.413314] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T21:50:03.454325] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-30T21:50:03.822817] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T21:50:04.254372] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-30T21:50:05.054337] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-30T21:50:05.467031] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T21:50:05.697542] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T21:50:05.854360] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-30T21:50:06.073867] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T21:50:06.654388] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-30T21:50:07.454365] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-30T21:50:07.809339] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T21:50:08.105498] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T21:50:08.254385] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-30T21:50:09.056143] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-30T21:50:09.062100] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T21:50:09.854423] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-30T21:50:10.061220] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T21:50:10.411519] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T21:50:10.654413] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-30T21:50:10.954202] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T21:50:11.454400] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-30T21:50:12.167284] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T21:50:12.178607] [INFO ] [REMOTE ] VTR: Full fetch complete (76343 records). [2025-09-30T21:50:12.178786] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-30T21:50:12.259505] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-30T21:50:12.603731] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-30T21:50:12.603831] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-30T21:50:12.605086] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-30T21:50:12.605155] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-30T21:50:12.606809] [DEBUG] [LOCAL ] VTR: Trimmed 76343 records to 52816 (keeping 200 days of data) [2025-09-30T21:50:12.941176] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T21:50:13.000866] [DEBUG] [LOCAL ] VTR: Primary data saved (52816 records). [2025-09-30T21:50:13.001051] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-30T21:50:13.001157] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTR took 35.1s. Estimated remaining: 13m 59s. Rate: 7.8 symbols/min [2025-09-30T21:50:13.060797] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-30T21:50:13.192870] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:13.214624] [DEBUG] [LOCAL ] VVX: Loaded 23189 existing records from primary storage. [2025-09-30T21:50:13.214917] [INFO ] [MAIN ] VVX: Loaded 23189 existing records. [2025-09-30T21:50:13.427414] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:13.427711] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-30T21:50:13.427773] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-30T21:50:13.428350] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-30T21:50:13.428411] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-30T21:50:13.855451] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-30T21:50:13.863098] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:13.867567] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T21:50:14.654428] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-30T21:50:14.690684] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T21:50:15.454398] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-30T21:50:15.653450] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:50:15.813467] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T21:50:16.254367] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-30T21:50:16.812103] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T21:50:16.968991] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T21:50:17.054362] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-30T21:50:17.854381] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-30T21:50:18.416315] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T21:50:18.654361] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-30T21:50:18.709246] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T21:50:19.454366] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-30T21:50:19.921372] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T21:50:20.254386] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-30T21:50:20.611702] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T21:50:21.054393] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-30T21:50:21.345176] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:50:21.854395] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-30T21:50:22.654366] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-30T21:50:22.697632] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T21:50:23.317738] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T21:50:23.325315] [INFO ] [REMOTE ] VTS: Full fetch complete (41235 records). [2025-09-30T21:50:23.325456] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-30T21:50:23.459458] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-30T21:50:23.767797] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-30T21:50:23.768011] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-30T21:50:23.768965] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-30T21:50:23.769114] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-30T21:50:23.778444] [DEBUG] [LOCAL ] VTS: Trimmed 41235 records to 30509 (keeping 200 days of data) [2025-09-30T21:50:23.794105] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T21:50:23.803158] [INFO ] [REMOTE ] VVR: Full fetch complete (46160 records). [2025-09-30T21:50:23.803340] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-30T21:50:24.257759] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-30T21:50:24.418840] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-30T21:50:24.419504] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-30T21:50:24.420707] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-30T21:50:24.422685] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-30T21:50:24.441298] [DEBUG] [LOCAL ] VTS: Primary data saved (30509 records). [2025-09-30T21:50:24.437755] [DEBUG] [LOCAL ] VVR: Trimmed 46160 records to 31144 (keeping 200 days of data) [2025-09-30T21:50:24.441542] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-30T21:50:24.441940] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 33.0s. Estimated remaining: 13m 51s. Rate: 7.8 symbols/min [2025-09-30T21:50:24.742558] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:24.809274] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T21:50:24.858989] [DEBUG] [LOCAL ] VVR: Primary data saved (31144 records). [2025-09-30T21:50:24.859130] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-30T21:50:24.859217] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 32.3s. Estimated remaining: 13m 43s. Rate: 7.8 symbols/min [2025-09-30T21:50:25.043307] [DEBUG] [LOCAL ] VYX: Loaded 48802 existing records from primary storage. [2025-09-30T21:50:25.067256] [INFO ] [MAIN ] VYX: Loaded 48802 existing records. [2025-09-30T21:50:25.070549] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:25.070705] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-30T21:50:25.304606] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:25.305704] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-30T21:50:25.305825] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-30T21:50:25.322568] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-30T21:50:25.322513] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-30T21:50:25.322736] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-30T21:50:25.328121] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-30T21:50:25.741390] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:25.749637] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-30T21:50:25.772072] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-30T21:50:25.779131] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-30T21:50:25.799201] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-30T21:50:26.114994] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:26.154905] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-30T21:50:26.358669] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T21:50:26.364675] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-30T21:50:26.473096] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:26.654396] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-30T21:50:27.454331] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-30T21:50:27.731570] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T21:50:27.758172] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T21:50:28.254389] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-30T21:50:28.973245] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T21:50:29.054412] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-30T21:50:29.854373] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-30T21:50:30.328767] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:50:30.665609] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-30T21:50:30.690563] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-30T21:50:31.174758] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:50:31.456000] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-30T21:50:31.458339] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T21:50:32.254385] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-30T21:50:33.054361] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-30T21:50:33.102455] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T21:50:33.854358] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-30T21:50:33.901300] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T21:50:33.913099] [INFO ] [REMOTE ] VVV: Full fetch complete (72357 records). [2025-09-30T21:50:33.913264] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-30T21:50:34.451999] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-30T21:50:34.452264] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-30T21:50:34.454556] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-30T21:50:34.454834] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-30T21:50:34.457051] [DEBUG] [LOCAL ] VVV: Trimmed 72357 records to 50177 (keeping 200 days of data) [2025-09-30T21:50:34.689255] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-30T21:50:34.876820] [DEBUG] [LOCAL ] VVV: Primary data saved (50177 records). [2025-09-30T21:50:34.877060] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-30T21:50:34.877243] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 38.7s. Estimated remaining: 13m 36s. Rate: 7.8 symbols/min [2025-09-30T21:50:35.146745] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:35.203353] [DEBUG] [LOCAL ] W: Loaded 53489 existing records from primary storage. [2025-09-30T21:50:35.203789] [INFO ] [MAIN ] W: Loaded 53489 existing records. [2025-09-30T21:50:35.409587] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:35.410680] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-30T21:50:35.410854] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-30T21:50:35.412181] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-30T21:50:35.424067] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-30T21:50:35.516895] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-30T21:50:35.582454] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-30T21:50:35.891808] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T21:50:35.899411] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:35.924857] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T21:50:36.254377] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-30T21:50:37.054493] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-30T21:50:37.854451] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-30T21:50:37.915762] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-30T21:50:38.173083] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T21:50:38.662165] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-30T21:50:38.688500] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:50:38.950296] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T21:50:39.454371] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-30T21:50:40.216611] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:50:40.254372] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-30T21:50:41.054385] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-30T21:50:41.654572] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T21:50:41.854405] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-30T21:50:41.961131] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:50:42.247144] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T21:50:42.253522] [INFO ] [REMOTE ] VVX: Full fetch complete (33456 records). [2025-09-30T21:50:42.253631] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-30T21:50:42.665257] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-30T21:50:42.728226] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-30T21:50:42.728336] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-30T21:50:42.729350] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-30T21:50:42.729437] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-30T21:50:42.731022] [DEBUG] [LOCAL ] VVX: Trimmed 33456 records to 23117 (keeping 200 days of data) [2025-09-30T21:50:42.872481] [DEBUG] [LOCAL ] VVX: Primary data saved (23117 records). [2025-09-30T21:50:42.872619] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-30T21:50:42.872738] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 29.9s. Estimated remaining: 13m 28s. Rate: 7.8 symbols/min [2025-09-30T21:50:43.076050] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:43.122581] [DEBUG] [LOCAL ] WAB: Loaded 44166 existing records from primary storage. [2025-09-30T21:50:43.123010] [INFO ] [MAIN ] WAB: Loaded 44166 existing records. [2025-09-30T21:50:43.377307] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:43.377575] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-30T21:50:43.377638] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-30T21:50:43.378698] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-30T21:50:43.378768] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-30T21:50:43.460314] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-30T21:50:43.785025] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:43.814303] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-30T21:50:44.254378] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-30T21:50:44.808510] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T21:50:45.054385] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-30T21:50:45.187236] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-30T21:50:45.854370] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-30T21:50:46.035960] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T21:50:46.664707] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-30T21:50:46.690828] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:50:47.454385] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-30T21:50:48.068640] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T21:50:48.254407] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-30T21:50:48.556742] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T21:50:49.054414] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-30T21:50:49.535115] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-30T21:50:49.854375] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-30T21:50:50.525175] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-30T21:50:50.616336] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T21:50:50.654316] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-30T21:50:51.454336] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-30T21:50:51.942544] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T21:50:52.254342] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-30T21:50:52.506874] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T21:50:52.805080] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T21:50:53.054435] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-30T21:50:53.854356] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-30T21:50:53.955029] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T21:50:54.654434] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-30T21:50:55.193081] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T21:50:55.203884] [INFO ] [REMOTE ] VYX: Full fetch complete (70275 records). [2025-09-30T21:50:55.204115] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-30T21:50:55.473084] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-30T21:50:55.664084] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-30T21:50:55.664204] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-30T21:50:55.665633] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-30T21:50:55.665815] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-30T21:50:55.667715] [DEBUG] [LOCAL ] VYX: Trimmed 70275 records to 48784 (keeping 200 days of data) [2025-09-30T21:50:55.806246] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-30T21:50:56.017503] [DEBUG] [LOCAL ] VYX: Primary data saved (48784 records). [2025-09-30T21:50:56.017710] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-30T21:50:56.017854] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 31.6s. Estimated remaining: 13m 21s. Rate: 7.8 symbols/min [2025-09-30T21:50:56.205209] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:50:56.248587] [DEBUG] [LOCAL ] WAL: Loaded 45253 existing records from primary storage. [2025-09-30T21:50:56.249118] [INFO ] [MAIN ] WAL: Loaded 45253 existing records. [2025-09-30T21:50:56.282356] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-30T21:50:56.459327] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:50:56.459894] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-30T21:50:56.460005] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-30T21:50:56.461158] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-30T21:50:56.461228] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-30T21:50:56.781841] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T21:50:56.903798] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:50:57.054354] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-30T21:50:57.114595] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:50:57.854383] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-30T21:50:58.657194] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-30T21:50:58.682736] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-30T21:50:58.729622] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T21:50:59.266199] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T21:50:59.454407] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-30T21:51:00.254408] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-30T21:51:00.725364] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T21:51:01.054468] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-30T21:51:01.195924] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T21:51:01.854383] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-30T21:51:01.932204] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T21:51:02.654360] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-30T21:51:02.908323] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:51:02.920304] [INFO ] [REMOTE ] W: Full fetch complete (77426 records). [2025-09-30T21:51:02.920506] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-30T21:51:03.373358] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-30T21:51:03.373572] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-30T21:51:03.374905] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-30T21:51:03.375019] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-30T21:51:03.376735] [DEBUG] [LOCAL ] W: Trimmed 77426 records to 53485 (keeping 200 days of data) [2025-09-30T21:51:03.464246] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-30T21:51:03.638079] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T21:51:03.786555] [DEBUG] [LOCAL ] W: Primary data saved (53485 records). [2025-09-30T21:51:03.786819] [INFO ] [MAIN ] W: Full history saved. [2025-09-30T21:51:03.787083] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. W took 28.9s. Estimated remaining: 13m 13s. Rate: 7.8 symbols/min [2025-09-30T21:51:04.030780] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:04.071177] [DEBUG] [LOCAL ] WAT: Loaded 35125 existing records from primary storage. [2025-09-30T21:51:04.071537] [INFO ] [MAIN ] WAT: Loaded 35125 existing records. [2025-09-30T21:51:04.260708] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-30T21:51:04.267938] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:04.269900] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-30T21:51:04.269979] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-30T21:51:04.270875] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-30T21:51:04.270956] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-30T21:51:04.711710] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:04.780351] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T21:51:04.797354] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-30T21:51:04.797544] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-30T21:51:04.950584] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T21:51:05.059622] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-30T21:51:05.258765] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-30T21:51:05.258858] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-30T21:51:05.260006] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-30T21:51:05.260074] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-30T21:51:05.261675] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-09-30T21:51:05.624218] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-30T21:51:05.624502] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-30T21:51:05.624723] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. VZ took 40.8s. Estimated remaining: 13m 5s. Rate: 7.8 symbols/min [2025-09-30T21:51:05.791458] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T21:51:05.853699] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:05.854247] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-30T21:51:05.854381] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-30T21:51:05.854309] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-30T21:51:05.855077] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-30T21:51:05.856100] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-30T21:51:05.856183] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-30T21:51:05.856225] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-30T21:51:06.280535] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:06.504699] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T21:51:06.654393] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-30T21:51:06.857924] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:51:06.858325] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-30T21:51:06.858452] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:51:06.858579] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-30T21:51:06.858683] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:51:06.858824] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-30T21:51:06.858917] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-30T21:51:06.858963] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-30T21:51:06.859011] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-30T21:51:06.859095] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WBI took 1.2s. Estimated remaining: 12m 57s. Rate: 7.8 symbols/min [2025-09-30T21:51:07.048281] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:07.099268] [DEBUG] [LOCAL ] WBS: Loaded 48686 existing records from primary storage. [2025-09-30T21:51:07.099624] [INFO ] [MAIN ] WBS: Loaded 48686 existing records. [2025-09-30T21:51:07.301990] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:07.302347] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-30T21:51:07.302440] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-30T21:51:07.303421] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-30T21:51:07.303488] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-30T21:51:07.460610] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-30T21:51:07.716621] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:07.746608] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:51:08.254366] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-30T21:51:08.632246] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T21:51:09.054393] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-30T21:51:09.798215] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T21:51:09.854355] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-30T21:51:10.540817] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T21:51:10.654377] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-30T21:51:11.309915] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:51:11.454373] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-30T21:51:12.254333] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-30T21:51:12.356106] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T21:51:12.888755] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T21:51:13.054408] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-30T21:51:13.854373] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-30T21:51:13.929526] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:51:14.242579] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T21:51:14.654358] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-30T21:51:15.454343] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-30T21:51:15.514190] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T21:51:16.193949] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T21:51:16.254363] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-30T21:51:17.054393] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-30T21:51:17.138254] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T21:51:17.148873] [INFO ] [REMOTE ] WAB: Full fetch complete (64410 records). [2025-09-30T21:51:17.149081] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-30T21:51:17.603755] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-30T21:51:17.603860] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-30T21:51:17.604874] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-30T21:51:17.604963] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-30T21:51:17.606775] [DEBUG] [LOCAL ] WAB: Trimmed 64410 records to 44146 (keeping 200 days of data) [2025-09-30T21:51:17.701111] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T21:51:17.869303] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-30T21:51:17.942955] [DEBUG] [LOCAL ] WAB: Primary data saved (44146 records). [2025-09-30T21:51:17.943217] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-30T21:51:17.943338] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAB took 35.1s. Estimated remaining: 12m 49s. Rate: 7.8 symbols/min [2025-09-30T21:51:18.132837] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:18.145574] [DEBUG] [LOCAL ] WBX: Loaded 11843 existing records from primary storage. [2025-09-30T21:51:18.145811] [INFO ] [MAIN ] WBX: Loaded 11843 existing records. [2025-09-30T21:51:18.341375] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:18.341774] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-30T21:51:18.341987] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-30T21:51:18.342735] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-30T21:51:18.342802] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-30T21:51:18.659451] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-30T21:51:18.696715] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T21:51:18.792735] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:19.454361] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-30T21:51:19.604048] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T21:51:20.254381] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-30T21:51:20.403323] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:51:20.504334] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T21:51:21.054364] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-30T21:51:21.671525] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T21:51:21.854367] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-30T21:51:22.654373] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-30T21:51:22.763334] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T21:51:23.454343] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-30T21:51:23.487531] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T21:51:23.819372] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T21:51:24.254406] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-30T21:51:25.054396] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-30T21:51:25.152194] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T21:51:25.738372] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:51:25.854418] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-30T21:51:26.654464] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-30T21:51:26.696400] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T21:51:26.706968] [INFO ] [REMOTE ] WAL: Full fetch complete (66575 records). [2025-09-30T21:51:26.707152] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-30T21:51:27.146018] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T21:51:27.163189] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-30T21:51:27.169224] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-30T21:51:27.170497] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-30T21:51:27.171125] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-30T21:51:27.178970] [DEBUG] [LOCAL ] WAL: Trimmed 66575 records to 45236 (keeping 200 days of data) [2025-09-30T21:51:27.458853] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-30T21:51:27.482461] [DEBUG] [LOCAL ] WAL: Primary data saved (45236 records). [2025-09-30T21:51:27.482578] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-30T21:51:27.482688] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 31.5s. Estimated remaining: 12m 42s. Rate: 7.8 symbols/min [2025-09-30T21:51:27.671283] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:27.719773] [DEBUG] [LOCAL ] WCC: Loaded 39763 existing records from primary storage. [2025-09-30T21:51:27.720143] [INFO ] [MAIN ] WCC: Loaded 39763 existing records. [2025-09-30T21:51:27.915875] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:27.916087] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-30T21:51:27.916137] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-30T21:51:27.917156] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-30T21:51:27.917228] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-30T21:51:28.255825] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-30T21:51:28.327834] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:28.357921] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T21:51:28.598065] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T21:51:29.054403] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-30T21:51:29.854398] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-30T21:51:29.900930] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T21:51:29.909592] [INFO ] [REMOTE ] WAT: Full fetch complete (49967 records). [2025-09-30T21:51:29.909795] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-30T21:51:30.328143] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-30T21:51:30.328573] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-30T21:51:30.329590] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-30T21:51:30.329680] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-30T21:51:30.333785] [DEBUG] [LOCAL ] WAT: Trimmed 49967 records to 35132 (keeping 200 days of data) [2025-09-30T21:51:30.564478] [DEBUG] [LOCAL ] WAT: Primary data saved (35132 records). [2025-09-30T21:51:30.564666] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-30T21:51:30.564835] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 26.8s. Estimated remaining: 12m 34s. Rate: 7.8 symbols/min [2025-09-30T21:51:30.655780] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-30T21:51:30.769246] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:30.800584] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T21:51:30.866845] [DEBUG] [LOCAL ] WCN: Loaded 47959 existing records from primary storage. [2025-09-30T21:51:30.867250] [INFO ] [MAIN ] WCN: Loaded 47959 existing records. [2025-09-30T21:51:31.058546] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:31.058802] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-30T21:51:31.058852] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-30T21:51:31.060520] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-30T21:51:31.060582] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-30T21:51:31.436457] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:31.454310] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-30T21:51:31.620429] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T21:51:31.944569] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T21:51:32.254388] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-30T21:51:32.876226] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T21:51:32.898035] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T21:51:33.054380] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-30T21:51:33.854426] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-30T21:51:34.467565] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T21:51:34.654364] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-30T21:51:35.292063] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T21:51:35.454385] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-30T21:51:35.871694] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T21:51:36.254345] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-30T21:51:36.492011] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T21:51:37.054410] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-30T21:51:37.854321] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-30T21:51:37.932532] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T21:51:38.087114] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T21:51:38.654403] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-30T21:51:39.459438] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-30T21:51:39.478621] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T21:51:39.490136] [INFO ] [REMOTE ] WBS: Full fetch complete (69586 records). [2025-09-30T21:51:39.490297] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-30T21:51:39.931599] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-30T21:51:39.931721] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-30T21:51:39.932910] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-30T21:51:39.932975] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-30T21:51:39.934504] [DEBUG] [LOCAL ] WBS: Trimmed 69586 records to 48701 (keeping 200 days of data) [2025-09-30T21:51:40.242065] [DEBUG] [LOCAL ] WBS: Primary data saved (48701 records). [2025-09-30T21:51:40.242200] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-30T21:51:40.242334] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 33.4s. Estimated remaining: 12m 26s. Rate: 7.8 symbols/min [2025-09-30T21:51:40.264963] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-30T21:51:40.432204] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:40.461038] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T21:51:40.488165] [DEBUG] [LOCAL ] WD: Loaded 23224 existing records from primary storage. [2025-09-30T21:51:40.488437] [INFO ] [MAIN ] WD: Loaded 23224 existing records. [2025-09-30T21:51:40.678351] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:40.678623] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-30T21:51:40.678704] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-30T21:51:40.679310] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-30T21:51:40.679371] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-30T21:51:41.069970] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-30T21:51:41.077459] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:51:41.076981] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:41.202300] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T21:51:41.854362] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-30T21:51:42.654415] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-30T21:51:42.749320] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T21:51:43.319057] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T21:51:43.454381] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-30T21:51:43.666365] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T21:51:44.123767] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T21:51:44.254415] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-30T21:51:45.054404] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-30T21:51:45.854367] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-30T21:51:46.059894] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T21:51:46.659439] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-30T21:51:46.675929] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T21:51:46.952230] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T21:51:47.316710] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T21:51:47.318261] [INFO ] [REMOTE ] WBX: Full fetch complete (25098 records). [2025-09-30T21:51:47.318343] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-30T21:51:47.471075] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-30T21:51:47.776142] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-30T21:51:47.776223] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-30T21:51:47.776828] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-30T21:51:47.776895] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-30T21:51:47.777635] [DEBUG] [LOCAL ] WBX: Trimmed 25098 records to 11669 (keeping 200 days of data) [2025-09-30T21:51:47.846733] [DEBUG] [LOCAL ] WBX: Primary data saved (11669 records). [2025-09-30T21:51:47.846883] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-30T21:51:47.846969] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBX took 29.9s. Estimated remaining: 12m 19s. Rate: 7.8 symbols/min [2025-09-30T21:51:48.027546] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:51:48.047040] [DEBUG] [LOCAL ] WDH: Loaded 17598 existing records from primary storage. [2025-09-30T21:51:48.047268] [INFO ] [MAIN ] WDH: Loaded 17598 existing records. [2025-09-30T21:51:48.233817] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:51:48.234047] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-30T21:51:48.234095] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-30T21:51:48.234581] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-30T21:51:48.234670] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-30T21:51:48.265726] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-30T21:51:48.608254] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:51:49.054362] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-30T21:51:49.214250] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T21:51:49.854347] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-30T21:51:50.123563] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T21:51:50.266312] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T21:51:50.654328] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-30T21:51:51.051107] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T21:51:51.454372] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-30T21:51:52.254372] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-30T21:51:52.322455] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T21:51:53.044489] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T21:51:53.054324] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-30T21:51:53.390968] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T21:51:53.672966] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T21:51:53.854385] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-30T21:51:54.440664] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T21:51:54.654371] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-30T21:51:55.454478] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-30T21:51:56.014626] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T21:51:56.254355] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-30T21:51:57.060103] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-30T21:51:57.063838] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T21:51:57.447733] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T21:51:57.854408] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-30T21:51:58.135179] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T21:51:58.654362] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-30T21:51:59.368355] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T21:51:59.401930] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T21:51:59.410693] [INFO ] [REMOTE ] WCC: Full fetch complete (57954 records). [2025-09-30T21:51:59.410871] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-30T21:51:59.464373] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-30T21:51:59.826590] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-30T21:51:59.826719] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-30T21:51:59.827802] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-30T21:51:59.827868] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-30T21:51:59.829186] [DEBUG] [LOCAL ] WCC: Trimmed 57954 records to 39644 (keeping 200 days of data) [2025-09-30T21:52:00.092310] [DEBUG] [LOCAL ] WCC: Primary data saved (39644 records). [2025-09-30T21:52:00.092505] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-30T21:52:00.092595] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCC took 32.6s. Estimated remaining: 12m 11s. Rate: 7.8 symbols/min [2025-09-30T21:52:00.257482] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-30T21:52:00.284000] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:00.307776] [DEBUG] [LOCAL ] WDI: Loaded 21038 existing records from primary storage. [2025-09-30T21:52:00.308098] [INFO ] [MAIN ] WDI: Loaded 21038 existing records. [2025-09-30T21:52:00.497533] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:00.497817] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-30T21:52:00.497869] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-30T21:52:00.498209] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-30T21:52:00.498266] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-30T21:52:00.889908] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:01.054407] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-30T21:52:01.335472] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T21:52:01.391435] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T21:52:01.815565] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T21:52:01.854371] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-30T21:52:02.654390] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-30T21:52:02.745938] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T21:52:03.454354] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-30T21:52:03.972104] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T21:52:04.254373] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-30T21:52:04.657576] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T21:52:05.054351] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-30T21:52:05.338967] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T21:52:05.823853] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T21:52:05.854379] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-30T21:52:06.658171] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-30T21:52:06.663888] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:52:07.263203] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T21:52:07.454365] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-30T21:52:08.254363] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-30T21:52:08.321588] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T21:52:09.054345] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-30T21:52:09.191664] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T21:52:09.196764] [INFO ] [REMOTE ] WD: Full fetch complete (33118 records). [2025-09-30T21:52:09.196866] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-30T21:52:09.602864] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-30T21:52:09.602947] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-30T21:52:09.603684] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-30T21:52:09.603747] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-30T21:52:09.604546] [DEBUG] [LOCAL ] WD: Trimmed 33118 records to 23200 (keeping 200 days of data) [2025-09-30T21:52:09.759340] [DEBUG] [LOCAL ] WD: Primary data saved (23200 records). [2025-09-30T21:52:09.759497] [INFO ] [MAIN ] WD: Full history saved. [2025-09-30T21:52:09.759591] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WD took 29.5s. Estimated remaining: 12m 4s. Rate: 7.8 symbols/min [2025-09-30T21:52:09.854336] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-30T21:52:10.130475] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T21:52:10.654366] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-30T21:52:11.454368] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-30T21:52:11.531916] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:52:11.791439] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T21:52:12.254368] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-30T21:52:12.883561] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T21:52:12.890581] [INFO ] [REMOTE ] WDH: Full fetch complete (23169 records). [2025-09-30T21:52:12.890720] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-30T21:52:13.057143] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-30T21:52:13.298980] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-30T21:52:13.299084] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-30T21:52:13.299666] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-30T21:52:13.299731] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-30T21:52:13.300458] [DEBUG] [LOCAL ] WDH: Trimmed 23169 records to 17502 (keeping 200 days of data) [2025-09-30T21:52:13.407585] [DEBUG] [LOCAL ] WDH: Primary data saved (17502 records). [2025-09-30T21:52:13.407768] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-30T21:52:13.407865] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WDH took 25.6s. Estimated remaining: 11m 56s. Rate: 7.8 symbols/min [2025-09-30T21:52:13.725305] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T21:52:13.735813] [INFO ] [REMOTE ] WCN: Full fetch complete (69454 records). [2025-09-30T21:52:13.735955] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-30T21:52:14.154699] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-30T21:52:14.154816] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-30T21:52:14.156094] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-30T21:52:14.156166] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-30T21:52:14.159885] [DEBUG] [LOCAL ] WCN: Trimmed 69454 records to 47935 (keeping 200 days of data) [2025-09-30T21:52:14.294249] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T21:52:14.307940] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-30T21:52:14.498498] [DEBUG] [LOCAL ] WCN: Primary data saved (47935 records). [2025-09-30T21:52:14.498687] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-30T21:52:14.498804] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WCN took 43.9s. Estimated remaining: 11m 48s. Rate: 7.8 symbols/min [2025-09-30T21:52:15.483952] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T21:52:15.489185] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-30T21:52:16.611146] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T21:52:16.619115] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-30T21:52:17.632708] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T21:52:17.637631] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-30T21:52:18.385761] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T21:52:18.390450] [INFO ] [REMOTE ] WDI: Full fetch complete (30817 records). [2025-09-30T21:52:18.390562] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-30T21:52:18.788696] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-30T21:52:18.788822] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-30T21:52:18.789556] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-30T21:52:18.789621] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-30T21:52:18.790744] [DEBUG] [LOCAL ] WDI: Trimmed 30817 records to 21089 (keeping 200 days of data) [2025-09-30T21:52:18.925436] [DEBUG] [LOCAL ] WDI: Primary data saved (21089 records). [2025-09-30T21:52:18.925571] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-30T21:52:18.925673] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 18.8s. Estimated remaining: 11m 40s. Rate: 7.8 symbols/min [2025-09-30T21:52:19.598186] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:19.626060] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:19.661728] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:19.691590] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:19.701296] [DEBUG] [LOCAL ] WEA: Loaded 7302 existing records from primary storage. [2025-09-30T21:52:19.701829] [INFO ] [MAIN ] WEA: Loaded 7302 existing records. [2025-09-30T21:52:19.982414] [DEBUG] [LOCAL ] WEAV: Loaded 41848 existing records from primary storage. [2025-09-30T21:52:19.980756] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:19.994758] [INFO ] [MAIN ] WEAV: Loaded 41848 existing records. [2025-09-30T21:52:19.994967] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-30T21:52:20.029474] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-30T21:52:20.053133] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-30T21:52:20.019390] [DEBUG] [LOCAL ] WDS: Loaded 43456 existing records from primary storage. [2025-09-30T21:52:20.070321] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-30T21:52:20.081295] [INFO ] [MAIN ] WDS: Loaded 43456 existing records. [2025-09-30T21:52:20.092397] [DEBUG] [LOCAL ] WEC: Loaded 52172 existing records from primary storage. [2025-09-30T21:52:20.228777] [INFO ] [MAIN ] WEC: Loaded 52172 existing records. [2025-09-30T21:52:20.528102] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:20.629082] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-30T21:52:20.667449] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-30T21:52:20.766894] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-30T21:52:20.788886] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-30T21:52:20.937016] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:20.992264] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-30T21:52:20.961621] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:21.012818] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-30T21:52:21.038352] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-30T21:52:21.050400] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-30T21:52:21.059896] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-30T21:52:21.082238] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-30T21:52:21.076938] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-30T21:52:21.164888] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:21.141931] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-30T21:52:21.231360] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-30T21:52:22.013060] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:22.063882] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-30T21:52:22.177535] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:52:22.257177] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-30T21:52:22.254865] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:22.258399] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-30T21:52:22.343435] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:22.343771] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-30T21:52:22.940677] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T21:52:22.942571] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-30T21:52:23.535718] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T21:52:23.537476] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-30T21:52:23.806156] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T21:52:23.816570] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-30T21:52:23.845317] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T21:52:23.856293] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-30T21:52:23.928390] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T21:52:23.965003] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T21:52:24.254373] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-30T21:52:25.054331] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-30T21:52:25.394852] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T21:52:25.464926] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T21:52:25.470619] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T21:52:25.854326] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-30T21:52:26.027044] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T21:52:26.654405] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-30T21:52:27.047107] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T21:52:27.454392] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-30T21:52:28.049032] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T21:52:28.254363] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-30T21:52:29.064108] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-30T21:52:29.069982] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T21:52:29.782466] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T21:52:29.854337] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-30T21:52:30.654349] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-30T21:52:30.951677] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T21:52:31.107619] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T21:52:31.185766] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T21:52:31.454382] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-30T21:52:32.254373] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-30T21:52:32.954707] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T21:52:33.054420] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-30T21:52:33.807233] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T21:52:33.854392] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-30T21:52:34.580059] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T21:52:34.658452] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-30T21:52:34.664095] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T21:52:35.454343] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-30T21:52:35.471420] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T21:52:36.254361] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-30T21:52:37.054412] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-30T21:52:37.223874] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:52:37.298909] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T21:52:37.514384] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T21:52:37.854355] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-30T21:52:38.654377] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-30T21:52:39.428324] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T21:52:39.454384] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-30T21:52:40.254355] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-30T21:52:40.488365] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T21:52:40.527618] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T21:52:41.033964] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T21:52:41.036108] [INFO ] [REMOTE ] WEA: Full fetch complete (9783 records). [2025-09-30T21:52:41.036196] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-30T21:52:41.059494] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-30T21:52:41.552487] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-30T21:52:41.552566] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-30T21:52:41.552861] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-30T21:52:41.552926] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-30T21:52:41.553450] [DEBUG] [LOCAL ] WEA: Trimmed 9783 records to 7280 (keeping 200 days of data) [2025-09-30T21:52:41.603459] [DEBUG] [LOCAL ] WEA: Primary data saved (7280 records). [2025-09-30T21:52:41.603607] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-30T21:52:41.603734] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 22.7s. Estimated remaining: 11m 33s. Rate: 7.8 symbols/min [2025-09-30T21:52:41.803686] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:41.863760] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-30T21:52:41.868002] [DEBUG] [LOCAL ] WELL: Loaded 52365 existing records from primary storage. [2025-09-30T21:52:41.868483] [INFO ] [MAIN ] WELL: Loaded 52365 existing records. [2025-09-30T21:52:42.065678] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:42.065923] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-30T21:52:42.065973] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-30T21:52:42.066815] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-30T21:52:42.066878] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-30T21:52:42.488743] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:42.646770] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T21:52:42.655251] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-30T21:52:43.418300] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T21:52:43.454341] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-30T21:52:44.254375] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-30T21:52:44.540255] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:52:45.054394] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-30T21:52:45.325068] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T21:52:45.431091] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T21:52:45.440753] [INFO ] [REMOTE ] WDS: Full fetch complete (64621 records). [2025-09-30T21:52:45.440980] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-30T21:52:45.850937] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-30T21:52:45.851030] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-30T21:52:45.852194] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-30T21:52:45.852285] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-30T21:52:45.853740] [DEBUG] [LOCAL ] WDS: Trimmed 64621 records to 43377 (keeping 200 days of data) [2025-09-30T21:52:45.854352] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-30T21:52:46.180671] [DEBUG] [LOCAL ] WDS: Primary data saved (43377 records). [2025-09-30T21:52:46.180998] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-30T21:52:46.181330] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WDS took 27.3s. Estimated remaining: 11m 25s. Rate: 7.8 symbols/min [2025-09-30T21:52:46.253540] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T21:52:46.377567] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:46.440919] [DEBUG] [LOCAL ] WES: Loaded 47949 existing records from primary storage. [2025-09-30T21:52:46.441345] [INFO ] [MAIN ] WES: Loaded 47949 existing records. [2025-09-30T21:52:46.635973] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:46.636206] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-30T21:52:46.636254] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-30T21:52:46.637025] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-30T21:52:46.637086] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-30T21:52:46.659453] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-30T21:52:47.022905] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:47.454373] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-30T21:52:47.749229] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T21:52:47.817859] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T21:52:48.254366] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-30T21:52:48.688269] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:52:49.054398] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-30T21:52:49.746432] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T21:52:49.854383] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-30T21:52:50.657682] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-30T21:52:50.663068] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T21:52:51.252321] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T21:52:51.264126] [INFO ] [REMOTE ] WEC: Full fetch complete (75504 records). [2025-09-30T21:52:51.264355] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-30T21:52:51.459485] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-30T21:52:51.699481] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-30T21:52:51.699576] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-30T21:52:51.700849] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-30T21:52:51.700945] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-30T21:52:51.702809] [DEBUG] [LOCAL ] WEC: Trimmed 75504 records to 52179 (keeping 200 days of data) [2025-09-30T21:52:52.119198] [DEBUG] [LOCAL ] WEC: Primary data saved (52179 records). [2025-09-30T21:52:52.119461] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-30T21:52:52.119850] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WEC took 33.2s. Estimated remaining: 11m 17s. Rate: 7.8 symbols/min [2025-09-30T21:52:52.212551] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:52:52.255188] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-30T21:52:52.339970] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:52:52.384571] [DEBUG] [LOCAL ] WEX: Loaded 34822 existing records from primary storage. [2025-09-30T21:52:52.384998] [INFO ] [MAIN ] WEX: Loaded 34822 existing records. [2025-09-30T21:52:52.575542] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:52:52.575776] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-30T21:52:52.575826] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-30T21:52:52.576357] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-30T21:52:52.576434] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-30T21:52:52.984246] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:52:53.054378] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-30T21:52:53.181533] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T21:52:53.559874] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T21:52:53.854370] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-30T21:52:54.654370] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-30T21:52:54.801699] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T21:52:55.215681] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T21:52:55.454368] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-30T21:52:56.065517] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T21:52:56.254368] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-30T21:52:57.054345] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-30T21:52:57.347857] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T21:52:57.690698] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T21:52:57.854366] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-30T21:52:58.501443] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T21:52:58.654357] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-30T21:52:59.380202] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T21:52:59.390898] [INFO ] [REMOTE ] WEAV: Full fetch complete (61551 records). [2025-09-30T21:52:59.391108] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-30T21:52:59.464691] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-30T21:52:59.814342] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-30T21:52:59.814432] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-30T21:52:59.815432] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-30T21:52:59.815496] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-30T21:52:59.816755] [DEBUG] [LOCAL ] WEAV: Trimmed 61551 records to 41876 (keeping 200 days of data) [2025-09-30T21:53:00.065264] [DEBUG] [LOCAL ] WEAV: Primary data saved (41876 records). [2025-09-30T21:53:00.065398] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-30T21:53:00.065509] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEAV took 41.1s. Estimated remaining: 11m 10s. Rate: 7.8 symbols/min [2025-09-30T21:53:00.252058] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:00.254322] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-30T21:53:00.269021] [DEBUG] [LOCAL ] WF: Loaded 10719 existing records from primary storage. [2025-09-30T21:53:00.269326] [INFO ] [MAIN ] WF: Loaded 10719 existing records. [2025-09-30T21:53:00.487741] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:00.507334] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-30T21:53:00.508257] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-30T21:53:00.509733] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T21:53:00.513688] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-30T21:53:00.521192] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-30T21:53:00.915870] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:01.054356] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-30T21:53:01.389719] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T21:53:01.760761] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T21:53:01.854368] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-30T21:53:02.286210] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T21:53:02.654342] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-30T21:53:03.454361] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-30T21:53:03.659727] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T21:53:04.012829] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T21:53:04.254378] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-30T21:53:05.054326] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-30T21:53:05.170331] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:53:05.652149] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T21:53:05.854341] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-30T21:53:06.243597] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T21:53:06.654358] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-30T21:53:07.454337] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-30T21:53:07.540714] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:53:08.079637] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T21:53:08.254363] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-30T21:53:08.322342] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T21:53:09.054361] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-30T21:53:09.500465] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T21:53:09.511268] [INFO ] [REMOTE ] WES: Full fetch complete (69892 records). [2025-09-30T21:53:09.511423] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-30T21:53:09.870478] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-30T21:53:09.932503] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-30T21:53:09.932595] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-30T21:53:09.933702] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-30T21:53:09.933777] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-30T21:53:09.935258] [DEBUG] [LOCAL ] WES: Trimmed 69892 records to 48038 (keeping 200 days of data) [2025-09-30T21:53:10.233776] [DEBUG] [LOCAL ] WES: Primary data saved (48038 records). [2025-09-30T21:53:10.233917] [INFO ] [MAIN ] WES: Full history saved. [2025-09-30T21:53:10.234040] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WES took 24.1s. Estimated remaining: 11m 2s. Rate: 7.8 symbols/min [2025-09-30T21:53:10.423538] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:10.488585] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-30T21:53:10.497085] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T21:53:10.497291] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-30T21:53:10.658882] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-30T21:53:10.707059] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:10.707490] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-30T21:53:10.707622] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-30T21:53:10.724585] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-30T21:53:10.737724] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-30T21:53:10.800469] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T21:53:10.863954] [INFO ] [REMOTE ] WELL: Full fetch complete (75736 records). [2025-09-30T21:53:10.864228] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-30T21:53:11.458182] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-30T21:53:11.486136] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:11.627527] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-30T21:53:11.627627] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-30T21:53:11.628931] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-30T21:53:11.629012] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-30T21:53:11.633883] [DEBUG] [LOCAL ] WELL: Trimmed 75736 records to 52361 (keeping 200 days of data) [2025-09-30T21:53:11.988914] [DEBUG] [LOCAL ] WELL: Primary data saved (52361 records). [2025-09-30T21:53:11.989131] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-30T21:53:11.989274] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WELL took 30.4s. Estimated remaining: 10m 54s. Rate: 7.8 symbols/min [2025-09-30T21:53:12.187184] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:12.214735] [DEBUG] [LOCAL ] WFG: Loaded 24760 existing records from primary storage. [2025-09-30T21:53:12.215045] [INFO ] [MAIN ] WFG: Loaded 24760 existing records. [2025-09-30T21:53:12.263730] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-30T21:53:12.428784] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:12.429206] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-30T21:53:12.429683] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-30T21:53:12.432210] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T21:53:12.440696] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T21:53:12.443781] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-30T21:53:12.454063] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-30T21:53:12.838116] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:13.054355] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-30T21:53:13.854322] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-30T21:53:14.114097] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T21:53:14.376778] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-30T21:53:14.654354] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-30T21:53:14.856708] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T21:53:15.454360] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-30T21:53:16.254318] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-30T21:53:16.595043] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T21:53:16.767969] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-30T21:53:16.797777] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T21:53:17.054358] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-30T21:53:17.854320] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-30T21:53:18.158064] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T21:53:18.654356] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-30T21:53:19.454360] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-30T21:53:19.810150] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-30T21:53:20.031406] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T21:53:20.254354] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-30T21:53:20.273897] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T21:53:21.054384] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-30T21:53:21.566688] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T21:53:21.854326] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-30T21:53:22.185098] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T21:53:22.654329] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-30T21:53:22.829169] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T21:53:23.454408] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-30T21:53:23.881509] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T21:53:24.254405] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-30T21:53:24.963357] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T21:53:25.054329] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-30T21:53:25.642631] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T21:53:25.854401] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-30T21:53:25.978314] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T21:53:26.654360] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-30T21:53:27.454413] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-30T21:53:27.879488] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T21:53:27.904027] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T21:53:27.906747] [INFO ] [REMOTE ] WF: Full fetch complete (16309 records). [2025-09-30T21:53:27.906853] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-30T21:53:28.178412] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T21:53:28.259606] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-30T21:53:28.342998] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-30T21:53:28.343098] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-30T21:53:28.343492] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-30T21:53:28.343560] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-30T21:53:28.344126] [DEBUG] [LOCAL ] WF: Trimmed 16309 records to 10714 (keeping 200 days of data) [2025-09-30T21:53:28.418097] [DEBUG] [LOCAL ] WF: Primary data saved (10714 records). [2025-09-30T21:53:28.418326] [INFO ] [MAIN ] WF: Full history saved. [2025-09-30T21:53:28.418469] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WF took 28.4s. Estimated remaining: 10m 47s. Rate: 7.8 symbols/min [2025-09-30T21:53:28.606008] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:28.656295] [DEBUG] [LOCAL ] WGO: Loaded 39119 existing records from primary storage. [2025-09-30T21:53:28.656663] [INFO ] [MAIN ] WGO: Loaded 39119 existing records. [2025-09-30T21:53:28.865261] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:28.865553] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-30T21:53:28.865604] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-30T21:53:28.866237] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-30T21:53:28.866337] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-30T21:53:29.062357] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-30T21:53:29.389473] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:29.703397] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T21:53:29.716850] [INFO ] [REMOTE ] WEX: Full fetch complete (50641 records). [2025-09-30T21:53:29.717071] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-30T21:53:29.859510] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-30T21:53:30.185419] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-30T21:53:30.185515] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-30T21:53:30.186545] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-30T21:53:30.186612] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-30T21:53:30.188150] [DEBUG] [LOCAL ] WEX: Trimmed 50641 records to 34688 (keeping 200 days of data) [2025-09-30T21:53:30.409277] [DEBUG] [LOCAL ] WEX: Primary data saved (34688 records). [2025-09-30T21:53:30.409424] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-30T21:53:30.409505] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 38.3s. Estimated remaining: 10m 39s. Rate: 7.8 symbols/min [2025-09-30T21:53:30.592441] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:30.642417] [DEBUG] [LOCAL ] WH: Loaded 45535 existing records from primary storage. [2025-09-30T21:53:30.642754] [INFO ] [MAIN ] WH: Loaded 45535 existing records. [2025-09-30T21:53:30.676164] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-30T21:53:30.835518] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:30.835756] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-30T21:53:30.835809] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-30T21:53:30.836422] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-30T21:53:30.836487] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-30T21:53:31.241988] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:31.279274] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T21:53:31.376257] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T21:53:31.430719] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T21:53:31.454329] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-30T21:53:32.254360] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-30T21:53:33.025033] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T21:53:33.054323] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-30T21:53:33.267134] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T21:53:33.854370] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-30T21:53:34.415361] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T21:53:34.654377] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-30T21:53:34.988741] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T21:53:35.454392] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-30T21:53:36.254372] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-30T21:53:36.674921] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T21:53:36.801280] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-30T21:53:37.054366] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-30T21:53:37.854368] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-30T21:53:37.918804] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T21:53:37.977333] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T21:53:37.983175] [INFO ] [REMOTE ] WFG: Full fetch complete (35846 records). [2025-09-30T21:53:37.983289] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-30T21:53:38.385455] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-30T21:53:38.385546] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-30T21:53:38.386311] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-30T21:53:38.386376] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-30T21:53:38.387464] [DEBUG] [LOCAL ] WFG: Trimmed 35846 records to 24753 (keeping 200 days of data) [2025-09-30T21:53:38.554567] [DEBUG] [LOCAL ] WFG: Primary data saved (24753 records). [2025-09-30T21:53:38.554745] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-30T21:53:38.554844] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFG took 26.6s. Estimated remaining: 10m 31s. Rate: 7.8 symbols/min [2025-09-30T21:53:38.663011] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-30T21:53:38.742797] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:38.786932] [DEBUG] [LOCAL ] WHD: Loaded 40413 existing records from primary storage. [2025-09-30T21:53:38.787250] [INFO ] [MAIN ] WHD: Loaded 40413 existing records. [2025-09-30T21:53:38.991685] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:38.991911] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-30T21:53:38.991982] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-30T21:53:38.992829] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-30T21:53:38.992895] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-30T21:53:39.423634] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:39.454333] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-30T21:53:40.121445] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-30T21:53:40.162158] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T21:53:40.254387] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-30T21:53:40.402201] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T21:53:41.054390] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-30T21:53:41.779309] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T21:53:41.854362] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-30T21:53:42.654342] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-30T21:53:43.091852] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T21:53:43.142348] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T21:53:43.454367] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-30T21:53:43.945060] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T21:53:44.254375] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-30T21:53:45.054361] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-30T21:53:45.539534] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T21:53:45.551317] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-30T21:53:45.551452] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-30T21:53:45.865890] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-30T21:53:45.976479] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T21:53:46.017806] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-30T21:53:46.017924] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-30T21:53:46.019229] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-30T21:53:46.019298] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-30T21:53:46.020897] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-09-30T21:53:46.294577] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T21:53:46.415366] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-30T21:53:46.415518] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-30T21:53:46.415607] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFC took 36.2s. Estimated remaining: 10m 23s. Rate: 7.8 symbols/min [2025-09-30T21:53:46.613007] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:46.618085] [DEBUG] [LOCAL ] WHG: Loaded 3311 existing records from primary storage. [2025-09-30T21:53:46.618261] [INFO ] [MAIN ] WHG: Loaded 3311 existing records. [2025-09-30T21:53:46.663806] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-30T21:53:46.820150] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:46.820348] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-30T21:53:46.820396] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-30T21:53:46.820628] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-30T21:53:46.820715] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-30T21:53:47.225728] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:47.454368] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-30T21:53:47.489013] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T21:53:47.742080] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:53:48.254390] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-30T21:53:48.851022] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T21:53:49.054328] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-30T21:53:49.128503] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T21:53:49.854364] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-30T21:53:50.572095] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T21:53:50.654395] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-30T21:53:51.013356] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T21:53:51.454391] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-30T21:53:51.974858] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T21:53:52.254375] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-30T21:53:52.808572] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T21:53:53.054381] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-30T21:53:53.544996] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T21:53:53.854363] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-30T21:53:53.913180] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T21:53:54.654387] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-30T21:53:55.297717] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T21:53:55.454380] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-30T21:53:55.568546] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:53:56.014229] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T21:53:56.254406] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-30T21:53:57.054353] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-30T21:53:57.692345] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T21:53:57.700786] [INFO ] [REMOTE ] WGO: Full fetch complete (57530 records). [2025-09-30T21:53:57.700927] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-30T21:53:57.860282] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-30T21:53:58.114605] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-30T21:53:58.114728] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-30T21:53:58.115801] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-30T21:53:58.115867] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-30T21:53:58.117109] [DEBUG] [LOCAL ] WGO: Trimmed 57530 records to 39011 (keeping 200 days of data) [2025-09-30T21:53:58.351418] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T21:53:58.392084] [DEBUG] [LOCAL ] WGO: Primary data saved (39011 records). [2025-09-30T21:53:58.392427] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-30T21:53:58.392813] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 30.0s. Estimated remaining: 10m 16s. Rate: 7.8 symbols/min [2025-09-30T21:53:58.580892] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:53:58.610324] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T21:53:58.666492] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-30T21:53:58.669775] [DEBUG] [LOCAL ] WHR: Loaded 48178 existing records from primary storage. [2025-09-30T21:53:58.670205] [INFO ] [MAIN ] WHR: Loaded 48178 existing records. [2025-09-30T21:53:58.857797] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:53:58.858110] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-30T21:53:58.858159] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-30T21:53:58.858829] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-30T21:53:58.858891] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-30T21:53:59.237143] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:53:59.454387] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-30T21:54:00.026708] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T21:54:00.254346] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-30T21:54:00.352583] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T21:54:01.054405] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-30T21:54:01.774561] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T21:54:01.827266] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T21:54:01.854408] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-30T21:54:02.654388] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-30T21:54:03.434894] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T21:54:03.454355] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-30T21:54:03.785486] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T21:54:04.254358] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-30T21:54:04.935454] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T21:54:05.054358] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-30T21:54:05.146037] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T21:54:05.854366] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-30T21:54:06.320964] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T21:54:06.568758] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T21:54:06.654368] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-30T21:54:07.454424] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-30T21:54:07.782491] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-30T21:54:07.783665] [INFO ] [REMOTE ] WHG: Full fetch complete (4638 records). [2025-09-30T21:54:07.783741] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-30T21:54:08.191273] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-30T21:54:08.191487] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-30T21:54:08.191792] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-30T21:54:08.191879] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-30T21:54:08.192557] [DEBUG] [LOCAL ] WHG: Trimmed 4638 records to 3306 (keeping 200 days of data) [2025-09-30T21:54:08.214091] [DEBUG] [LOCAL ] WHG: Primary data saved (3306 records). [2025-09-30T21:54:08.214282] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-30T21:54:08.214378] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WHG took 21.8s. Estimated remaining: 10m 8s. Rate: 7.8 symbols/min [2025-09-30T21:54:08.259574] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-30T21:54:08.411425] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T21:54:08.436478] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:08.454622] [DEBUG] [LOCAL ] WIA: Loaded 4851 existing records from primary storage. [2025-09-30T21:54:08.454923] [INFO ] [MAIN ] WIA: Loaded 4851 existing records. [2025-09-30T21:54:08.660991] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:08.661296] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-30T21:54:08.661379] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-30T21:54:08.661628] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-30T21:54:08.661723] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-30T21:54:09.046252] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:09.054372] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-30T21:54:09.854372] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-30T21:54:09.927660] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T21:54:09.937975] [INFO ] [REMOTE ] WH: Full fetch complete (64968 records). [2025-09-30T21:54:09.938152] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-30T21:54:10.371334] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-30T21:54:10.371598] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-30T21:54:10.372749] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-30T21:54:10.372816] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-30T21:54:10.374322] [DEBUG] [LOCAL ] WH: Trimmed 64968 records to 45500 (keeping 200 days of data) [2025-09-30T21:54:10.533316] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T21:54:10.654434] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-30T21:54:10.725356] [DEBUG] [LOCAL ] WH: Primary data saved (45500 records). [2025-09-30T21:54:10.725513] [INFO ] [MAIN ] WH: Full history saved. [2025-09-30T21:54:10.725622] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WH took 40.3s. Estimated remaining: 10m 0s. Rate: 7.8 symbols/min [2025-09-30T21:54:10.912218] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:10.926723] [DEBUG] [LOCAL ] WINN: Loaded 11668 existing records from primary storage. [2025-09-30T21:54:10.926943] [INFO ] [MAIN ] WINN: Loaded 11668 existing records. [2025-09-30T21:54:11.113943] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:11.114150] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-30T21:54:11.114196] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-30T21:54:11.114479] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-30T21:54:11.114538] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-30T21:54:11.457724] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-30T21:54:11.522185] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:11.554245] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T21:54:11.835073] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T21:54:11.844628] [INFO ] [REMOTE ] WHD: Full fetch complete (57307 records). [2025-09-30T21:54:11.844800] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-30T21:54:12.220407] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-30T21:54:12.262795] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-30T21:54:12.314414] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-30T21:54:12.314539] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-30T21:54:12.315825] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-30T21:54:12.315915] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-30T21:54:12.317870] [DEBUG] [LOCAL ] WHD: Trimmed 57307 records to 40334 (keeping 200 days of data) [2025-09-30T21:54:12.590103] [DEBUG] [LOCAL ] WHD: Primary data saved (40334 records). [2025-09-30T21:54:12.590240] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-30T21:54:12.590324] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 34.0s. Estimated remaining: 9m 52s. Rate: 7.8 symbols/min [2025-09-30T21:54:12.781730] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:12.835869] [DEBUG] [LOCAL ] WIT: Loaded 52326 existing records from primary storage. [2025-09-30T21:54:12.836203] [INFO ] [MAIN ] WIT: Loaded 52326 existing records. [2025-09-30T21:54:13.038621] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:13.047706] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T21:54:13.047873] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-30T21:54:13.050980] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-30T21:54:13.052246] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-30T21:54:13.052311] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-30T21:54:13.063819] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-30T21:54:13.474507] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:13.854364] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-30T21:54:13.971396] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T21:54:14.654366] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-30T21:54:15.132437] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T21:54:15.228121] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T21:54:15.454352] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-30T21:54:16.254363] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-30T21:54:16.855077] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T21:54:17.054362] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-30T21:54:17.181890] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T21:54:17.850973] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T21:54:17.854258] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-30T21:54:18.662035] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-30T21:54:18.664088] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T21:54:19.454374] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-30T21:54:20.254371] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-30T21:54:20.560351] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T21:54:21.054349] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-30T21:54:21.144138] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T21:54:21.224813] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T21:54:21.854472] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-30T21:54:22.654436] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-30T21:54:22.817984] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T21:54:23.230987] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T21:54:23.455447] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-30T21:54:23.458763] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T21:54:24.135716] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T21:54:24.254345] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-30T21:54:24.856182] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T21:54:25.054404] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-30T21:54:25.622993] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T21:54:25.854399] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-30T21:54:26.654518] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-30T21:54:27.132397] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T21:54:27.265842] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T21:54:27.454376] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-30T21:54:28.056103] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T21:54:28.254363] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-30T21:54:28.930563] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T21:54:29.054378] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-30T21:54:29.854402] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-30T21:54:30.408756] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T21:54:30.654386] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-30T21:54:30.767178] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T21:54:31.454366] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-30T21:54:32.254420] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-30T21:54:32.541559] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T21:54:32.957211] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T21:54:33.054361] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-30T21:54:33.074204] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T21:54:33.732172] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T21:54:33.734048] [INFO ] [REMOTE ] WIA: Full fetch complete (7290 records). [2025-09-30T21:54:33.734123] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-30T21:54:33.859468] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-30T21:54:34.157075] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-30T21:54:34.157199] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-30T21:54:34.157469] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-30T21:54:34.157534] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-30T21:54:34.158061] [DEBUG] [LOCAL ] WIA: Trimmed 7290 records to 4823 (keeping 200 days of data) [2025-09-30T21:54:34.193481] [DEBUG] [LOCAL ] WIA: Primary data saved (4823 records). [2025-09-30T21:54:34.193624] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-30T21:54:34.193759] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 26.0s. Estimated remaining: 9m 45s. Rate: 7.8 symbols/min [2025-09-30T21:54:34.398615] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:34.422614] [DEBUG] [LOCAL ] WIW: Loaded 20346 existing records from primary storage. [2025-09-30T21:54:34.423022] [INFO ] [MAIN ] WIW: Loaded 20346 existing records. [2025-09-30T21:54:34.636289] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:34.636627] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-30T21:54:34.636717] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-30T21:54:34.637100] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-30T21:54:34.637160] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-30T21:54:34.660278] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-30T21:54:34.762437] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-30T21:54:35.041948] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:35.454409] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-30T21:54:36.254349] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-30T21:54:36.517528] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T21:54:36.943287] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T21:54:37.054383] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-30T21:54:37.474535] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T21:54:37.830227] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T21:54:37.833050] [INFO ] [REMOTE ] WINN: Full fetch complete (17606 records). [2025-09-30T21:54:37.833130] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-30T21:54:37.863329] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-30T21:54:38.236918] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-30T21:54:38.237037] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-30T21:54:38.237491] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-30T21:54:38.237535] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-30T21:54:38.238190] [DEBUG] [LOCAL ] WINN: Trimmed 17606 records to 11622 (keeping 200 days of data) [2025-09-30T21:54:38.314075] [DEBUG] [LOCAL ] WINN: Primary data saved (11622 records). [2025-09-30T21:54:38.314222] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-30T21:54:38.314309] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 27.6s. Estimated remaining: 9m 37s. Rate: 7.8 symbols/min [2025-09-30T21:54:38.492938] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:38.546346] [DEBUG] [LOCAL ] WK: Loaded 36964 existing records from primary storage. [2025-09-30T21:54:38.546811] [INFO ] [MAIN ] WK: Loaded 36964 existing records. [2025-09-30T21:54:38.662080] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-30T21:54:38.753675] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:38.753894] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-30T21:54:38.753942] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-30T21:54:38.754471] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-30T21:54:38.754537] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-30T21:54:39.138087] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:39.454338] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-30T21:54:39.593041] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T21:54:40.161638] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T21:54:40.172088] [INFO ] [REMOTE ] WHR: Full fetch complete (68510 records). [2025-09-30T21:54:40.172239] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-30T21:54:40.259519] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-30T21:54:40.599843] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-30T21:54:40.600040] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-30T21:54:40.601234] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-30T21:54:40.601303] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-30T21:54:40.605597] [DEBUG] [LOCAL ] WHR: Trimmed 68510 records to 48172 (keeping 200 days of data) [2025-09-30T21:54:40.856926] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T21:54:40.946504] [DEBUG] [LOCAL ] WHR: Primary data saved (48172 records). [2025-09-30T21:54:40.946678] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-30T21:54:40.946808] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 42.6s. Estimated remaining: 9m 29s. Rate: 7.8 symbols/min [2025-09-30T21:54:41.059463] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-30T21:54:41.152692] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:41.162886] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T21:54:41.208381] [DEBUG] [LOCAL ] WKC: Loaded 34919 existing records from primary storage. [2025-09-30T21:54:41.208767] [INFO ] [MAIN ] WKC: Loaded 34919 existing records. [2025-09-30T21:54:41.440068] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:41.440448] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-30T21:54:41.440506] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-30T21:54:41.442017] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-30T21:54:41.442092] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-30T21:54:41.817274] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:41.854312] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-30T21:54:42.560140] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T21:54:42.654327] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-30T21:54:43.332840] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T21:54:43.454395] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-30T21:54:44.087173] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T21:54:44.254406] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-30T21:54:45.054357] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-30T21:54:45.363531] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T21:54:45.389253] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T21:54:45.854368] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-30T21:54:46.068324] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T21:54:46.654327] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-30T21:54:46.887201] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T21:54:47.454379] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-30T21:54:48.085287] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T21:54:48.254350] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-30T21:54:48.625077] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T21:54:49.054380] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-30T21:54:49.759040] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T21:54:49.854326] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-30T21:54:50.618576] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T21:54:50.654389] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-30T21:54:51.454401] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-30T21:54:51.624551] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T21:54:51.636182] [INFO ] [REMOTE ] WIT: Full fetch complete (75641 records). [2025-09-30T21:54:51.636375] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-30T21:54:52.068031] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-30T21:54:52.068143] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-30T21:54:52.069340] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-30T21:54:52.069457] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-30T21:54:52.091919] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:54:52.098765] [DEBUG] [LOCAL ] WIT: Trimmed 75641 records to 52344 (keeping 200 days of data) [2025-09-30T21:54:52.266362] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-30T21:54:52.409820] [DEBUG] [LOCAL ] WIT: Primary data saved (52344 records). [2025-09-30T21:54:52.409951] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-30T21:54:52.410036] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIT took 39.8s. Estimated remaining: 9m 22s. Rate: 7.8 symbols/min [2025-09-30T21:54:52.609338] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:54:52.634301] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T21:54:52.694502] [DEBUG] [LOCAL ] WLK: Loaded 45427 existing records from primary storage. [2025-09-30T21:54:52.694871] [INFO ] [MAIN ] WLK: Loaded 45427 existing records. [2025-09-30T21:54:52.889723] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:54:52.890028] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-30T21:54:52.890128] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-30T21:54:52.890963] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-30T21:54:52.891029] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-30T21:54:53.068089] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-30T21:54:53.289146] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:54:53.319807] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T21:54:53.854382] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-30T21:54:54.654332] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-30T21:54:54.696318] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T21:54:54.823090] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T21:54:55.454374] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-30T21:54:56.096975] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T21:54:56.157962] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T21:54:56.254371] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-30T21:54:57.054358] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-30T21:54:57.754759] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T21:54:57.854368] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-30T21:54:58.325201] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T21:54:58.654386] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-30T21:54:59.179029] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T21:54:59.454367] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-30T21:54:59.832134] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T21:55:00.254406] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-30T21:55:00.396882] [DEBUG] [REMOTE ] WIW: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-30T21:55:00.397226] [WARN ] [REMOTE ] WIW: No data returned for month 2025-08 [2025-09-30T21:55:00.397332] [FATAL] [REMOTE ] WIW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:55:00.397442] [FATAL] [MAIN ] WIW: Failed to fetch primary data. [2025-09-30T21:55:00.397512] [WARN ] [MAIN ] WIW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:55:00.397588] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-30T21:55:00.397680] [DEBUG] [LOCAL ] WIW: No primary data file found to delete. [2025-09-30T21:55:00.397746] [INFO ] [LOCAL ] WIW: Starting deletion of derivative data. [2025-09-30T21:55:00.398236] [DEBUG] [LOCAL ] WIW: Deleted derivative data file. [2025-09-30T21:55:00.398352] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIW took 26.2s. Estimated remaining: 9m 14s. Rate: 7.8 symbols/min [2025-09-30T21:55:00.636886] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:00.649779] [DEBUG] [LOCAL ] WLKP: Loaded 6768 existing records from primary storage. [2025-09-30T21:55:00.650060] [INFO ] [MAIN ] WLKP: Loaded 6768 existing records. [2025-09-30T21:55:00.864913] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:00.865124] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-30T21:55:00.865173] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-30T21:55:00.865474] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-30T21:55:00.865532] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-30T21:55:01.062405] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-30T21:55:01.330388] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:01.332962] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T21:55:01.854383] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-30T21:55:02.568349] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T21:55:02.654336] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-30T21:55:03.454379] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-30T21:55:03.520934] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T21:55:04.218082] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T21:55:04.254350] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-30T21:55:04.894686] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T21:55:05.054382] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-30T21:55:05.668096] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T21:55:05.677513] [INFO ] [REMOTE ] WK: Full fetch complete (52506 records). [2025-09-30T21:55:05.677772] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-30T21:55:05.862744] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-30T21:55:06.087564] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-30T21:55:06.087708] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-30T21:55:06.088943] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-30T21:55:06.089085] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-30T21:55:06.090961] [DEBUG] [LOCAL ] WK: Trimmed 52506 records to 37053 (keeping 200 days of data) [2025-09-30T21:55:06.377551] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T21:55:06.406718] [DEBUG] [LOCAL ] WK: Primary data saved (37053 records). [2025-09-30T21:55:06.406888] [INFO ] [MAIN ] WK: Full history saved. [2025-09-30T21:55:06.407033] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 28.1s. Estimated remaining: 9m 6s. Rate: 7.8 symbols/min [2025-09-30T21:55:06.603960] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:06.604160] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-30T21:55:06.604216] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-30T21:55:06.604330] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-30T21:55:06.604561] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-30T21:55:06.604603] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-30T21:55:06.604672] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-30T21:55:06.662744] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-30T21:55:06.914028] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T21:55:07.034940] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:07.454354] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-30T21:55:08.180375] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T21:55:08.254369] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-30T21:55:08.449961] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T21:55:08.458052] [INFO ] [REMOTE ] WKC: Full fetch complete (51052 records). [2025-09-30T21:55:08.458193] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-30T21:55:08.924552] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-30T21:55:08.924686] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-30T21:55:08.925632] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-30T21:55:08.925721] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-30T21:55:08.926960] [DEBUG] [LOCAL ] WKC: Trimmed 51052 records to 34884 (keeping 200 days of data) [2025-09-30T21:55:09.002215] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T21:55:09.057490] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-30T21:55:09.173975] [DEBUG] [LOCAL ] WKC: Primary data saved (34884 records). [2025-09-30T21:55:09.174142] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-30T21:55:09.174228] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 28.2s. Estimated remaining: 8m 59s. Rate: 7.8 symbols/min [2025-09-30T21:55:09.356862] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:09.391188] [DEBUG] [LOCAL ] WLY: Loaded 29803 existing records from primary storage. [2025-09-30T21:55:09.391506] [INFO ] [MAIN ] WLY: Loaded 29803 existing records. [2025-09-30T21:55:09.600842] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:09.601241] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-30T21:55:09.601458] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-30T21:55:09.601968] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-30T21:55:09.602030] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-30T21:55:09.715279] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T21:55:09.861801] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-30T21:55:10.007182] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:10.654358] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-30T21:55:10.662348] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T21:55:11.454361] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-30T21:55:11.794296] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-30T21:55:11.955159] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T21:55:12.254356] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-30T21:55:13.054354] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-30T21:55:13.805207] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T21:55:13.833926] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T21:55:13.854327] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-30T21:55:14.199687] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T21:55:14.654341] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-30T21:55:15.454423] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-30T21:55:15.795406] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T21:55:16.225098] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:55:16.254315] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-30T21:55:17.054426] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-30T21:55:17.333601] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-30T21:55:17.854383] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-30T21:55:17.941682] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T21:55:18.654341] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-30T21:55:19.085683] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T21:55:19.454373] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-30T21:55:19.519429] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T21:55:19.969501] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T21:55:20.254393] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-30T21:55:21.054390] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-30T21:55:21.563187] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T21:55:21.854345] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-30T21:55:22.222475] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T21:55:22.654366] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-30T21:55:23.454387] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-30T21:55:23.532155] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:55:23.699750] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T21:55:23.954304] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T21:55:24.254421] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-30T21:55:24.863801] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T21:55:25.054422] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-30T21:55:25.854385] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-30T21:55:26.271427] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T21:55:26.654354] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-30T21:55:26.854073] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T21:55:26.957519] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-30T21:55:27.454402] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-30T21:55:28.254354] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-30T21:55:28.663118] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T21:55:29.054359] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-30T21:55:29.464162] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-30T21:55:29.854357] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-30T21:55:29.936542] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T21:55:29.946295] [INFO ] [REMOTE ] WLK: Full fetch complete (62919 records). [2025-09-30T21:55:29.946461] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-30T21:55:30.370558] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-30T21:55:30.370777] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-30T21:55:30.377321] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-30T21:55:30.378293] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T21:55:30.378048] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-30T21:55:30.381942] [DEBUG] [LOCAL ] WLK: Trimmed 62919 records to 45491 (keeping 200 days of data) [2025-09-30T21:55:30.663052] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-30T21:55:30.684815] [DEBUG] [LOCAL ] WLK: Primary data saved (45491 records). [2025-09-30T21:55:30.684937] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-30T21:55:30.685022] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLK took 38.3s. Estimated remaining: 8m 51s. Rate: 7.8 symbols/min [2025-09-30T21:55:30.882099] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:30.946154] [DEBUG] [LOCAL ] WM: Loaded 50916 existing records from primary storage. [2025-09-30T21:55:30.946560] [INFO ] [MAIN ] WM: Loaded 50916 existing records. [2025-09-30T21:55:31.085802] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T21:55:31.108235] [INFO ] [REMOTE ] WLTG: Full fetch complete (1666 records). [2025-09-30T21:55:31.119030] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-30T21:55:31.307184] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:31.343114] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-30T21:55:31.349072] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-30T21:55:31.355323] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-30T21:55:31.370985] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-30T21:55:31.459788] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-30T21:55:31.628517] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T21:55:31.636531] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:55:31.661561] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:55:31.701306] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-30T21:55:31.751784] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-30T21:55:31.769252] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-30T21:55:31.794120] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-30T21:55:31.823377] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLTG took 25.4s. Estimated remaining: 8m 43s. Rate: 7.8 symbols/min [2025-09-30T21:55:32.265722] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-30T21:55:32.292587] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:32.287842] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:32.302730] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T21:55:32.305418] [INFO ] [REMOTE ] WLKP: Full fetch complete (10353 records). [2025-09-30T21:55:32.305510] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-30T21:55:32.692515] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-30T21:55:32.703847] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-30T21:55:32.913181] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-30T21:55:32.918438] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-30T21:55:32.941765] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-30T21:55:32.947743] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-30T21:55:32.966168] [DEBUG] [LOCAL ] WLKP: Trimmed 10353 records to 6810 (keeping 200 days of data) [2025-09-30T21:55:32.988856] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:32.989727] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-30T21:55:32.989790] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-30T21:55:32.990827] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-30T21:55:32.990912] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-30T21:55:33.057848] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-30T21:55:33.159739] [DEBUG] [LOCAL ] WLKP: Primary data saved (6810 records). [2025-09-30T21:55:33.159969] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-30T21:55:33.165867] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLKP took 32.8s. Estimated remaining: 8m 36s. Rate: 7.8 symbols/min [2025-09-30T21:55:33.562043] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:33.649025] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:33.665184] [DEBUG] [LOCAL ] WMK: Loaded 14479 existing records from primary storage. [2025-09-30T21:55:33.665435] [INFO ] [MAIN ] WMK: Loaded 14479 existing records. [2025-09-30T21:55:33.806781] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T21:55:33.857343] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-30T21:55:33.892881] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:33.894192] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-30T21:55:33.894247] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-30T21:55:33.894575] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-30T21:55:33.894638] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-30T21:55:34.311792] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:34.654357] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-30T21:55:34.707599] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T21:55:35.255553] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T21:55:35.454398] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-30T21:55:35.601037] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T21:55:36.254354] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-30T21:55:37.006537] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:55:37.054314] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-30T21:55:37.094674] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T21:55:37.854384] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-30T21:55:38.645102] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T21:55:38.654762] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-30T21:55:39.458123] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-30T21:55:39.463228] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T21:55:40.254404] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-30T21:55:40.468669] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T21:55:40.501366] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T21:55:41.054409] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-30T21:55:41.863316] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-30T21:55:41.870065] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T21:55:42.654317] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-30T21:55:42.710389] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T21:55:42.782519] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T21:55:43.454365] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-30T21:55:43.851850] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T21:55:44.254330] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-30T21:55:44.415085] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T21:55:45.054389] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-30T21:55:45.854358] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-30T21:55:45.972946] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:55:46.294229] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T21:55:46.302167] [INFO ] [REMOTE ] WLY: Full fetch complete (42841 records). [2025-09-30T21:55:46.302329] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-30T21:55:46.659517] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-30T21:55:46.744617] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-30T21:55:46.744779] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-30T21:55:46.745710] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-30T21:55:46.745800] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-30T21:55:46.747057] [DEBUG] [LOCAL ] WLY: Trimmed 42841 records to 29706 (keeping 200 days of data) [2025-09-30T21:55:46.956602] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T21:55:46.980668] [DEBUG] [LOCAL ] WLY: Primary data saved (29706 records). [2025-09-30T21:55:46.980811] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-30T21:55:46.980935] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 37.8s. Estimated remaining: 8m 28s. Rate: 7.8 symbols/min [2025-09-30T21:55:47.163046] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:47.210931] [DEBUG] [LOCAL ] WMS: Loaded 39540 existing records from primary storage. [2025-09-30T21:55:47.211238] [INFO ] [MAIN ] WMS: Loaded 39540 existing records. [2025-09-30T21:55:47.402286] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:47.402557] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-30T21:55:47.402630] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-30T21:55:47.403708] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-30T21:55:47.403823] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-30T21:55:47.464416] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-30T21:55:47.792112] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:48.254353] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-30T21:55:48.545336] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T21:55:48.888002] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T21:55:49.054388] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-30T21:55:49.865042] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-30T21:55:49.888070] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T21:55:49.969193] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T21:55:50.654349] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-30T21:55:51.454351] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-30T21:55:51.485807] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T21:55:51.504285] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T21:55:52.254380] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-30T21:55:53.054362] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-30T21:55:53.195396] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T21:55:53.492020] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-30T21:55:53.854365] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-30T21:55:54.654354] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-30T21:55:54.771381] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T21:55:55.454403] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-30T21:55:55.636613] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T21:55:55.640869] [INFO ] [REMOTE ] WMK: Full fetch complete (19579 records). [2025-09-30T21:55:55.641034] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-30T21:55:55.907422] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T21:55:56.097964] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-30T21:55:56.098094] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-30T21:55:56.098756] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-30T21:55:56.098849] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-30T21:55:56.099897] [DEBUG] [LOCAL ] WMK: Trimmed 19579 records to 14524 (keeping 200 days of data) [2025-09-30T21:55:56.221953] [DEBUG] [LOCAL ] WMK: Primary data saved (14524 records). [2025-09-30T21:55:56.222100] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-30T21:55:56.222190] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMK took 23.1s. Estimated remaining: 8m 20s. Rate: 7.8 symbols/min [2025-09-30T21:55:56.263537] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-30T21:55:56.431177] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:55:56.504530] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-30T21:55:56.504915] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-09-30T21:55:56.721981] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:55:56.725469] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T21:55:56.725687] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-30T21:55:56.733477] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-30T21:55:56.735032] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-30T21:55:56.735097] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-30T21:55:57.059479] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-30T21:55:57.123473] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:55:57.854370] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-30T21:55:58.447864] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T21:55:58.485425] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T21:55:58.654352] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-30T21:55:59.454362] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-30T21:55:59.731953] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T21:56:00.138416] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T21:56:00.254365] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-30T21:56:01.054389] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-30T21:56:01.836127] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-30T21:56:01.854320] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-30T21:56:02.068258] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T21:56:02.654353] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-30T21:56:02.979889] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T21:56:03.454371] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-30T21:56:04.254372] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-30T21:56:04.424660] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-30T21:56:04.465278] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T21:56:05.054329] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-30T21:56:05.276803] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T21:56:05.287878] [INFO ] [REMOTE ] WM: Full fetch complete (73763 records). [2025-09-30T21:56:05.288061] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-30T21:56:05.723083] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-30T21:56:05.723178] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-30T21:56:05.724339] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-30T21:56:05.724406] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-30T21:56:05.725902] [DEBUG] [LOCAL ] WM: Trimmed 73763 records to 50915 (keeping 200 days of data) [2025-09-30T21:56:05.854870] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-30T21:56:06.069632] [DEBUG] [LOCAL ] WM: Primary data saved (50915 records). [2025-09-30T21:56:06.069860] [INFO ] [MAIN ] WM: Full history saved. [2025-09-30T21:56:06.069972] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WM took 35.4s. Estimated remaining: 8m 13s. Rate: 7.8 symbols/min [2025-09-30T21:56:06.261464] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:06.303090] [DEBUG] [LOCAL ] WNC: Loaded 39559 existing records from primary storage. [2025-09-30T21:56:06.330771] [INFO ] [MAIN ] WNC: Loaded 39559 existing records. [2025-09-30T21:56:06.425806] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-30T21:56:06.561355] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:06.561671] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-30T21:56:06.561744] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-30T21:56:06.562357] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-30T21:56:06.562420] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-30T21:56:06.664420] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-30T21:56:07.002127] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:07.078103] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T21:56:07.153523] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T21:56:07.454367] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-30T21:56:08.254343] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-30T21:56:08.595331] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T21:56:08.968257] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T21:56:09.054364] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-30T21:56:09.854394] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-30T21:56:10.654359] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-30T21:56:10.683315] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T21:56:10.768464] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-30T21:56:10.946308] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T21:56:11.454312] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-30T21:56:12.254409] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-30T21:56:12.596112] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T21:56:12.608396] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-30T21:56:12.608565] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-30T21:56:13.045846] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-30T21:56:13.045957] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-30T21:56:13.047291] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-30T21:56:13.047411] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-30T21:56:13.057324] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-30T21:56:13.076515] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-30T21:56:13.076377] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T21:56:13.088688] [INFO ] [REMOTE ] WMS: Full fetch complete (57282 records). [2025-09-30T21:56:13.088813] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-30T21:56:13.640360] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-30T21:56:13.640792] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-30T21:56:13.643663] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-30T21:56:13.644319] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-30T21:56:13.653264] [DEBUG] [LOCAL ] WMS: Trimmed 57282 records to 39528 (keeping 200 days of data) [2025-09-30T21:56:14.138208] [DEBUG] [LOCAL ] WMS: Primary data saved (39528 records). [2025-09-30T21:56:14.138894] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-30T21:56:14.139273] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 27.2s. Estimated remaining: 8m 5s. Rate: 7.8 symbols/min [2025-09-30T21:56:14.266260] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-30T21:56:14.266540] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-30T21:56:14.266821] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMB took 42.4s. Estimated remaining: 7m 57s. Rate: 7.8 symbols/min [2025-09-30T21:56:14.389422] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:14.544915] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:14.591834] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T21:56:14.601063] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-30T21:56:14.624422] [DEBUG] [LOCAL ] WNS: Loaded 40019 existing records from primary storage. [2025-09-30T21:56:14.624835] [INFO ] [MAIN ] WNS: Loaded 40019 existing records. [2025-09-30T21:56:14.872995] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:14.876081] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-09-30T21:56:14.876474] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-30T21:56:14.876887] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-30T21:56:14.877113] [INFO ] [MAIN ] WOLF: Loaded 53184 existing records. [2025-09-30T21:56:14.882458] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-30T21:56:14.891806] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-30T21:56:15.177451] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-30T21:56:15.273035] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-30T21:56:15.498237] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:15.509836] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-30T21:56:15.510235] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-30T21:56:15.516114] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-30T21:56:15.516210] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-30T21:56:15.726678] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:15.748203] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-30T21:56:16.017082] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:16.146490] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:56:16.254395] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-30T21:56:16.858094] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T21:56:17.054429] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-30T21:56:17.854343] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-30T21:56:17.934124] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-30T21:56:18.444097] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T21:56:18.537021] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-30T21:56:18.654344] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-30T21:56:19.454378] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-30T21:56:19.517002] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T21:56:20.113239] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T21:56:20.254410] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-30T21:56:21.054383] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-30T21:56:21.423572] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T21:56:21.829864] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-30T21:56:21.854324] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-30T21:56:22.654352] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-30T21:56:23.454340] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-30T21:56:23.542046] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-30T21:56:23.611884] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T21:56:24.254433] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-30T21:56:24.691245] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T21:56:25.034726] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T21:56:25.054328] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-30T21:56:25.854408] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-30T21:56:26.181685] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T21:56:26.634948] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-30T21:56:26.654342] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-30T21:56:27.454398] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-30T21:56:27.598896] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T21:56:27.774157] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T21:56:28.254376] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-30T21:56:29.036810] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T21:56:29.054333] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-30T21:56:29.854405] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-30T21:56:30.457217] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T21:56:30.576069] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-30T21:56:30.654400] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-30T21:56:31.253347] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T21:56:31.454395] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-30T21:56:32.254418] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-30T21:56:32.694483] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T21:56:33.054399] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-30T21:56:33.175327] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-30T21:56:33.862446] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-30T21:56:33.879473] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T21:56:34.509040] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T21:56:34.517453] [INFO ] [REMOTE ] WNS: Full fetch complete (54938 records). [2025-09-30T21:56:34.517614] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-30T21:56:34.659485] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-30T21:56:34.971284] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-30T21:56:34.971457] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-30T21:56:34.972475] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-30T21:56:34.972586] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-30T21:56:34.975363] [DEBUG] [LOCAL ] WNS: Trimmed 54938 records to 40001 (keeping 200 days of data) [2025-09-30T21:56:35.219517] [DEBUG] [LOCAL ] WNS: Primary data saved (40001 records). [2025-09-30T21:56:35.219678] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-30T21:56:35.219782] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNS took 21.1s. Estimated remaining: 7m 50s. Rate: 7.8 symbols/min [2025-09-30T21:56:35.405133] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:35.437889] [DEBUG] [LOCAL ] WOR: Loaded 24903 existing records from primary storage. [2025-09-30T21:56:35.438195] [INFO ] [MAIN ] WOR: Loaded 24903 existing records. [2025-09-30T21:56:35.471210] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-30T21:56:35.627833] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:35.628083] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-30T21:56:35.628137] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-30T21:56:35.628509] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-30T21:56:35.628567] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-30T21:56:36.024583] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:36.254381] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-30T21:56:36.376542] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-30T21:56:36.388428] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-30T21:56:36.388608] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-30T21:56:36.831121] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-30T21:56:36.831438] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-30T21:56:36.832614] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-30T21:56:36.832705] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-30T21:56:36.834206] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-09-30T21:56:37.100293] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T21:56:37.116378] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-30T21:56:37.236028] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-30T21:56:37.236236] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-30T21:56:37.236335] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WMT took 41.0s. Estimated remaining: 7m 42s. Rate: 7.8 symbols/min [2025-09-30T21:56:37.429920] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:37.476685] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T21:56:37.479925] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-30T21:56:37.520061] [DEBUG] [LOCAL ] WOW: Loaded 30401 existing records from primary storage. [2025-09-30T21:56:37.520388] [INFO ] [MAIN ] WOW: Loaded 30401 existing records. [2025-09-30T21:56:37.710019] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:37.710239] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-30T21:56:37.710287] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-30T21:56:37.710864] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-30T21:56:37.710925] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-30T21:56:37.859531] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-30T21:56:38.096069] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:38.392815] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T21:56:38.399895] [INFO ] [REMOTE ] WNC: Full fetch complete (57529 records). [2025-09-30T21:56:38.400066] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-30T21:56:38.659522] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-30T21:56:38.834608] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-30T21:56:38.834780] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-30T21:56:38.836130] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-30T21:56:38.836323] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-30T21:56:38.837985] [DEBUG] [LOCAL ] WNC: Trimmed 57529 records to 39463 (keeping 200 days of data) [2025-09-30T21:56:38.951605] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T21:56:39.116195] [DEBUG] [LOCAL ] WNC: Primary data saved (39463 records). [2025-09-30T21:56:39.116349] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-30T21:56:39.116433] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WNC took 33.0s. Estimated remaining: 7m 34s. Rate: 7.8 symbols/min [2025-09-30T21:56:39.299923] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:39.358435] [DEBUG] [LOCAL ] WPC: Loaded 48399 existing records from primary storage. [2025-09-30T21:56:39.358835] [INFO ] [MAIN ] WPC: Loaded 48399 existing records. [2025-09-30T21:56:39.459585] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-30T21:56:39.557450] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:39.557809] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-30T21:56:39.557991] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-30T21:56:39.559042] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-30T21:56:39.559123] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-30T21:56:39.977778] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:40.254351] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-30T21:56:40.831238] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T21:56:41.059432] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-30T21:56:41.079022] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-30T21:56:41.113576] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T21:56:41.854363] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-30T21:56:42.190051] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T21:56:42.654396] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-30T21:56:43.454369] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-30T21:56:44.099197] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T21:56:44.254328] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-30T21:56:44.604514] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-30T21:56:44.618328] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T21:56:45.054362] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-30T21:56:45.572040] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T21:56:45.854362] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-30T21:56:46.654348] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-30T21:56:46.771899] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T21:56:46.821542] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T21:56:47.402683] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T21:56:47.454349] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-30T21:56:48.254394] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-30T21:56:49.054330] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-30T21:56:49.423041] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T21:56:49.696364] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-30T21:56:49.854353] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-30T21:56:50.342515] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T21:56:50.654389] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-30T21:56:51.207963] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T21:56:51.454359] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-30T21:56:51.510069] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T21:56:52.254371] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-30T21:56:53.064550] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-30T21:56:53.065985] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T21:56:53.348271] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T21:56:53.854371] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-30T21:56:54.654310] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-30T21:56:55.127250] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T21:56:55.454339] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-30T21:56:55.531202] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-30T21:56:55.542426] [INFO ] [REMOTE ] WOLF: Full fetch complete (77252 records). [2025-09-30T21:56:55.542578] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-30T21:56:55.991943] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-30T21:56:55.992178] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-30T21:56:55.993416] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-30T21:56:55.993513] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-30T21:56:56.010107] [DEBUG] [LOCAL ] WOLF: Trimmed 77252 records to 53184 (keeping 200 days of data) [2025-09-30T21:56:56.024503] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T21:56:56.254559] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-30T21:56:56.371967] [DEBUG] [LOCAL ] WOLF: Primary data saved (53184 records). [2025-09-30T21:56:56.372110] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-30T21:56:56.372196] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 42.1s. Estimated remaining: 7m 27s. Rate: 7.8 symbols/min [2025-09-30T21:56:56.554064] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:56.567972] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T21:56:56.640476] [DEBUG] [LOCAL ] WPM: Loaded 52729 existing records from primary storage. [2025-09-30T21:56:56.640991] [INFO ] [MAIN ] WPM: Loaded 52729 existing records. [2025-09-30T21:56:56.843325] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:56.843566] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-30T21:56:56.843616] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-30T21:56:56.844690] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-30T21:56:56.844754] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-30T21:56:57.059474] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-30T21:56:57.274005] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:57.828331] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T21:56:57.854335] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-30T21:56:57.977090] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T21:56:57.982814] [INFO ] [REMOTE ] WOR: Full fetch complete (36526 records). [2025-09-30T21:56:57.982925] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-30T21:56:58.392058] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-30T21:56:58.392212] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-30T21:56:58.393129] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-30T21:56:58.393200] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-30T21:56:58.394347] [DEBUG] [LOCAL ] WOR: Trimmed 36526 records to 24907 (keeping 200 days of data) [2025-09-30T21:56:58.553134] [DEBUG] [LOCAL ] WOR: Primary data saved (24907 records). [2025-09-30T21:56:58.553272] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-30T21:56:58.553367] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOR took 23.3s. Estimated remaining: 7m 19s. Rate: 7.8 symbols/min [2025-09-30T21:56:58.662321] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-30T21:56:58.753083] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:56:58.798760] [DEBUG] [LOCAL ] WPP: Loaded 33859 existing records from primary storage. [2025-09-30T21:56:58.799068] [INFO ] [MAIN ] WPP: Loaded 33859 existing records. [2025-09-30T21:56:58.997941] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:56:58.998241] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-30T21:56:58.998292] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-30T21:56:58.999069] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-30T21:56:58.999152] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-30T21:56:59.384215] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:56:59.459483] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-30T21:56:59.477739] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T21:57:00.145109] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T21:57:00.153920] [INFO ] [REMOTE ] WOW: Full fetch complete (42137 records). [2025-09-30T21:57:00.154056] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-30T21:57:00.259410] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-30T21:57:00.565978] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-30T21:57:00.566064] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-30T21:57:00.566928] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-30T21:57:00.567005] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-30T21:57:00.568173] [DEBUG] [LOCAL ] WOW: Trimmed 42137 records to 30470 (keeping 200 days of data) [2025-09-30T21:57:00.746419] [DEBUG] [LOCAL ] WOW: Primary data saved (30470 records). [2025-09-30T21:57:00.746565] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-30T21:57:00.746673] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 23.5s. Estimated remaining: 7m 11s. Rate: 7.8 symbols/min [2025-09-30T21:57:00.930277] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:00.990383] [DEBUG] [LOCAL ] WRB: Loaded 50549 existing records from primary storage. [2025-09-30T21:57:00.990785] [INFO ] [MAIN ] WRB: Loaded 50549 existing records. [2025-09-30T21:57:01.061770] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-30T21:57:01.181014] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:01.181219] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-30T21:57:01.181268] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-30T21:57:01.182369] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-30T21:57:01.182431] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-30T21:57:01.635473] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:01.650488] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T21:57:01.783576] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T21:57:01.854360] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-30T21:57:02.654367] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-30T21:57:02.965045] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T21:57:03.454353] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-30T21:57:03.721358] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T21:57:04.029868] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T21:57:04.254364] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-30T21:57:05.054341] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-30T21:57:05.144976] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:57:05.641540] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T21:57:05.854360] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-30T21:57:06.654368] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-30T21:57:06.735907] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T21:57:07.454370] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-30T21:57:07.534639] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T21:57:07.734767] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T21:57:08.254365] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-30T21:57:09.060975] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-30T21:57:09.068486] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T21:57:09.724124] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T21:57:09.854354] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-30T21:57:10.654329] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-30T21:57:11.035963] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T21:57:11.454395] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-30T21:57:11.627227] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T21:57:12.028568] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T21:57:12.254436] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-30T21:57:12.894198] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T21:57:13.054373] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-30T21:57:13.653316] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T21:57:13.854356] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-30T21:57:14.463834] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T21:57:14.654397] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-30T21:57:15.454379] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-30T21:57:15.794840] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T21:57:16.162528] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T21:57:16.254406] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-30T21:57:17.026578] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:57:17.054425] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-30T21:57:17.854330] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-30T21:57:18.108708] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T21:57:18.654342] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-30T21:57:18.799614] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T21:57:19.454348] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-30T21:57:19.713765] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T21:57:20.254326] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-30T21:57:20.823404] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-30T21:57:21.054361] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-30T21:57:21.139758] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T21:57:21.854321] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-30T21:57:21.890447] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T21:57:22.654326] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-30T21:57:22.917787] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T21:57:23.453157] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T21:57:23.462308] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-30T21:57:24.242347] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T21:57:24.254310] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-30T21:57:25.054337] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-30T21:57:25.291529] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T21:57:25.303630] [INFO ] [REMOTE ] WPM: Full fetch complete (75894 records). [2025-09-30T21:57:25.303850] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-30T21:57:25.736622] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-30T21:57:25.736909] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-30T21:57:25.738259] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-30T21:57:25.738354] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-30T21:57:25.740195] [DEBUG] [LOCAL ] WPM: Trimmed 75894 records to 52725 (keeping 200 days of data) [2025-09-30T21:57:25.854764] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-30T21:57:26.015676] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T21:57:26.030765] [INFO ] [REMOTE ] WPC: Full fetch complete (70778 records). [2025-09-30T21:57:26.032693] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-30T21:57:26.502111] [DEBUG] [LOCAL ] WPM: Primary data saved (52725 records). [2025-09-30T21:57:26.512878] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-30T21:57:26.520798] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPM took 30.1s. Estimated remaining: 7m 4s. Rate: 7.8 symbols/min [2025-09-30T21:57:26.636567] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-30T21:57:26.643343] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-30T21:57:26.649658] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-30T21:57:26.654932] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-30T21:57:26.696006] [DEBUG] [LOCAL ] WPC: Trimmed 70778 records to 48369 (keeping 200 days of data) [2025-09-30T21:57:26.766817] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:26.844395] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T21:57:26.885757] [INFO ] [REMOTE ] WPP: Full fetch complete (45498 records). [2025-09-30T21:57:26.886635] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-30T21:57:27.270196] [DEBUG] [LOCAL ] WRBY: Loaded 50810 existing records from primary storage. [2025-09-30T21:57:27.309823] [INFO ] [MAIN ] WRBY: Loaded 50810 existing records. [2025-09-30T21:57:27.609819] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-30T21:57:27.609958] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-30T21:57:27.611212] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-30T21:57:27.611356] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-30T21:57:27.683452] [DEBUG] [LOCAL ] WPP: Trimmed 45498 records to 33932 (keeping 200 days of data) [2025-09-30T21:57:27.706250] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:27.709973] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-30T21:57:27.712326] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-30T21:57:27.713744] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-30T21:57:27.714407] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-30T21:57:28.057304] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-30T21:57:28.151814] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-30T21:57:28.434837] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:28.439364] [DEBUG] [LOCAL ] WPC: Primary data saved (48369 records). [2025-09-30T21:57:28.439538] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-30T21:57:28.444875] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPC took 49.3s. Estimated remaining: 6m 56s. Rate: 7.8 symbols/min [2025-09-30T21:57:28.448723] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-30T21:57:28.464554] [DEBUG] [LOCAL ] WPP: Primary data saved (33932 records). [2025-09-30T21:57:28.464705] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-30T21:57:28.464853] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 29.9s. Estimated remaining: 6m 48s. Rate: 7.8 symbols/min [2025-09-30T21:57:29.914491] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T21:57:29.926393] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-30T21:57:30.330250] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T21:57:30.341045] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-30T21:57:31.694268] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T21:57:31.705737] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-30T21:57:31.741076] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T21:57:31.752412] [INFO ] [REMOTE ] WRB: Full fetch complete (73321 records). [2025-09-30T21:57:31.752581] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-30T21:57:32.195824] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-30T21:57:32.195935] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-30T21:57:32.197681] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-30T21:57:32.197759] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-30T21:57:32.201805] [DEBUG] [LOCAL ] WRB: Trimmed 73321 records to 50558 (keeping 200 days of data) [2025-09-30T21:57:32.543064] [DEBUG] [LOCAL ] WRB: Primary data saved (50558 records). [2025-09-30T21:57:32.543213] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-30T21:57:32.543333] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 31.8s. Estimated remaining: 6m 40s. Rate: 7.8 symbols/min [2025-09-30T21:57:33.018394] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T21:57:33.028549] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-30T21:57:34.741710] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T21:57:34.753239] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-30T21:57:36.303387] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T21:57:36.314938] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-30T21:57:38.099449] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:57:38.111671] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-30T21:57:39.744884] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T21:57:39.755740] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-30T21:57:41.432865] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T21:57:41.444099] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-30T21:57:43.127045] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T21:57:43.137869] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-30T21:57:44.866315] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T21:57:44.877265] [INFO ] [REMOTE ] WRBY: Full fetch complete (73402 records). [2025-09-30T21:57:44.877423] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-30T21:57:45.301798] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-30T21:57:45.301891] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-30T21:57:45.303106] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-30T21:57:45.303231] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-30T21:57:45.304850] [DEBUG] [LOCAL ] WRBY: Trimmed 73402 records to 50792 (keeping 200 days of data) [2025-09-30T21:57:45.627514] [DEBUG] [LOCAL ] WRBY: Primary data saved (50792 records). [2025-09-30T21:57:45.627696] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-30T21:57:45.627834] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 19.1s. Estimated remaining: 6m 33s. Rate: 7.8 symbols/min [2025-09-30T21:57:46.303048] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:46.328074] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:46.377036] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:46.395628] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:57:46.432535] [DEBUG] [LOCAL ] WSR: Loaded 23065 existing records from primary storage. [2025-09-30T21:57:46.438290] [INFO ] [MAIN ] WSR: Loaded 23065 existing records. [2025-09-30T21:57:46.501515] [DEBUG] [LOCAL ] WS: Loaded 24030 existing records from primary storage. [2025-09-30T21:57:46.524509] [DEBUG] [LOCAL ] WSO: Loaded 24534 existing records from primary storage. [2025-09-30T21:57:46.535080] [INFO ] [MAIN ] WS: Loaded 24030 existing records. [2025-09-30T21:57:46.573876] [INFO ] [MAIN ] WSO: Loaded 24534 existing records. [2025-09-30T21:57:46.863313] [DEBUG] [LOCAL ] WSM: Loaded 49743 existing records from primary storage. [2025-09-30T21:57:46.900042] [INFO ] [MAIN ] WSM: Loaded 49743 existing records. [2025-09-30T21:57:46.916772] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:47.091698] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-30T21:57:47.128980] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-30T21:57:47.225209] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:47.239287] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-30T21:57:47.250257] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-30T21:57:47.228742] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:47.250497] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-30T21:57:47.281397] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-30T21:57:47.250436] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-30T21:57:47.304245] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-30T21:57:47.320058] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-30T21:57:47.325960] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-30T21:57:47.340227] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-30T21:57:47.345583] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-30T21:57:47.726055] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:57:47.787595] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-30T21:57:47.831524] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-30T21:57:47.894435] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-30T21:57:47.911468] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-30T21:57:48.656040] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:48.729753] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-30T21:57:48.966252] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:48.885212] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:48.993984] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-30T21:57:48.985947] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-30T21:57:49.092402] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:57:49.092787] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-30T21:57:49.956087] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T21:57:49.961638] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-30T21:57:50.174141] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T21:57:50.178242] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-30T21:57:50.467423] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T21:57:50.473886] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-30T21:57:50.883700] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T21:57:50.895006] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-30T21:57:51.096065] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T21:57:51.101104] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-30T21:57:51.251039] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T21:57:51.255536] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-30T21:57:51.672918] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T21:57:51.679070] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-30T21:57:52.168759] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T21:57:52.173670] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-30T21:57:52.315935] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T21:57:52.326394] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-30T21:57:52.392198] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T21:57:52.397789] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-30T21:57:52.792729] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T21:57:52.798630] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-30T21:57:53.250663] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T21:57:53.256309] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-30T21:57:53.308337] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T21:57:53.314345] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-30T21:57:53.893281] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T21:57:53.905552] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-30T21:57:54.076850] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T21:57:54.083681] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-30T21:57:54.143695] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T21:57:54.151989] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-30T21:57:54.189757] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T21:57:54.196740] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-30T21:57:55.226019] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T21:57:55.231802] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-30T21:57:55.276926] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T21:57:55.282554] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-30T21:57:55.447157] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T21:57:55.453919] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-30T21:57:55.603035] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T21:57:55.615564] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-30T21:57:56.145117] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T21:57:56.254414] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-30T21:57:56.288805] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T21:57:56.393400] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T21:57:57.054376] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-30T21:57:57.447511] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T21:57:57.612404] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T21:57:57.854380] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-30T21:57:58.357390] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T21:57:58.654374] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-30T21:57:58.959714] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T21:57:59.454386] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-30T21:57:59.876246] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T21:58:00.254365] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-30T21:58:01.054464] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-30T21:58:01.362890] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T21:58:01.364306] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T21:58:01.854383] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-30T21:58:02.071054] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T21:58:02.654377] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-30T21:58:02.914480] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T21:58:02.921447] [INFO ] [REMOTE ] WSO: Full fetch complete (34386 records). [2025-09-30T21:58:02.921602] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-30T21:58:03.318211] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-30T21:58:03.318301] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-30T21:58:03.319117] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-30T21:58:03.319195] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-30T21:58:03.320146] [DEBUG] [LOCAL ] WSO: Trimmed 34386 records to 24617 (keeping 200 days of data) [2025-09-30T21:58:03.465507] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-30T21:58:03.483355] [DEBUG] [LOCAL ] WSO: Primary data saved (24617 records). [2025-09-30T21:58:03.483449] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-30T21:58:03.483530] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSO took 17.8s. Estimated remaining: 6m 25s. Rate: 7.8 symbols/min [2025-09-30T21:58:03.670138] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:03.716351] [DEBUG] [LOCAL ] WST: Loaded 37372 existing records from primary storage. [2025-09-30T21:58:03.716677] [INFO ] [MAIN ] WST: Loaded 37372 existing records. [2025-09-30T21:58:03.868285] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T21:58:03.938967] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:03.939221] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-30T21:58:03.939281] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-30T21:58:03.939920] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-30T21:58:03.939984] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-30T21:58:04.259429] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-30T21:58:04.329844] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:04.506735] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T21:58:04.511572] [INFO ] [REMOTE ] WSR: Full fetch complete (32783 records). [2025-09-30T21:58:04.511697] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-30T21:58:04.954227] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-30T21:58:04.954354] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-30T21:58:04.955372] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-30T21:58:04.955447] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-30T21:58:04.956668] [DEBUG] [LOCAL ] WSR: Trimmed 32783 records to 23021 (keeping 200 days of data) [2025-09-30T21:58:05.067166] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-30T21:58:05.135896] [DEBUG] [LOCAL ] WSR: Primary data saved (23021 records). [2025-09-30T21:58:05.136220] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-30T21:58:05.136360] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSR took 19.5s. Estimated remaining: 6m 17s. Rate: 7.8 symbols/min [2025-09-30T21:58:05.310227] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T21:58:05.348084] [INFO ] [REMOTE ] WS: Full fetch complete (36654 records). [2025-09-30T21:58:05.370041] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-30T21:58:05.369911] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:05.748300] [DEBUG] [LOCAL ] WT: Loaded 47632 existing records from primary storage. [2025-09-30T21:58:05.764108] [INFO ] [MAIN ] WT: Loaded 47632 existing records. [2025-09-30T21:58:05.883302] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-30T21:58:05.964092] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-30T21:58:05.964273] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-30T21:58:05.965604] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-30T21:58:05.976958] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-30T21:58:06.059824] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:06.060367] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-30T21:58:06.060715] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-30T21:58:06.061201] [DEBUG] [LOCAL ] WS: Trimmed 36654 records to 24022 (keeping 200 days of data) [2025-09-30T21:58:06.061737] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-30T21:58:06.061846] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-30T21:58:06.572340] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T21:58:06.660929] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:06.661041] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-30T21:58:06.668286] [DEBUG] [LOCAL ] WS: Primary data saved (24022 records). [2025-09-30T21:58:06.668381] [INFO ] [MAIN ] WS: Full history saved. [2025-09-30T21:58:06.668470] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WS took 21.0s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min [2025-09-30T21:58:06.854030] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:06.912322] [DEBUG] [LOCAL ] WTI: Loaded 43885 existing records from primary storage. [2025-09-30T21:58:06.912699] [INFO ] [MAIN ] WTI: Loaded 43885 existing records. [2025-09-30T21:58:07.110219] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:07.110451] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-30T21:58:07.110501] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-30T21:58:07.111040] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-30T21:58:07.111103] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-30T21:58:07.455981] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-30T21:58:07.549924] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:07.582855] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T21:58:07.772697] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T21:58:08.254355] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-30T21:58:08.971285] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T21:58:09.054507] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-30T21:58:09.854408] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-30T21:58:09.942524] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:58:10.654357] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-30T21:58:10.841291] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T21:58:11.454368] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-30T21:58:11.622898] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T21:58:12.254348] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-30T21:58:12.324285] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T21:58:13.054357] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-30T21:58:13.222172] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T21:58:13.570266] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T21:58:13.854349] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-30T21:58:14.654348] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-30T21:58:14.759148] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T21:58:15.058834] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T21:58:15.454356] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-30T21:58:16.254329] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-30T21:58:16.357773] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T21:58:16.368934] [INFO ] [REMOTE ] WSM: Full fetch complete (72047 records). [2025-09-30T21:58:16.369143] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-30T21:58:16.826386] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-30T21:58:16.827173] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-30T21:58:16.828381] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T21:58:16.838269] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-30T21:58:16.838764] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-30T21:58:16.841473] [DEBUG] [LOCAL ] WSM: Trimmed 72047 records to 49690 (keeping 200 days of data) [2025-09-30T21:58:17.071516] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-30T21:58:17.172584] [DEBUG] [LOCAL ] WSM: Primary data saved (49690 records). [2025-09-30T21:58:17.172791] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-30T21:58:17.172960] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 31.5s. Estimated remaining: 6m 2s. Rate: 7.8 symbols/min [2025-09-30T21:58:17.375799] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:17.376013] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-30T21:58:17.376066] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-30T21:58:17.376176] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-30T21:58:17.376225] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-30T21:58:17.376279] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-30T21:58:17.376324] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-30T21:58:17.772054] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:17.804859] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T21:58:17.854329] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-30T21:58:18.654410] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-30T21:58:18.783222] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T21:58:19.433583] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T21:58:19.454321] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-30T21:58:20.229787] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T21:58:20.254327] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-30T21:58:21.054351] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-30T21:58:21.282000] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T21:58:21.779170] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T21:58:21.854395] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-30T21:58:22.285663] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-30T21:58:22.654391] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-30T21:58:22.794944] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T21:58:23.454396] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-30T21:58:24.135359] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T21:58:24.254342] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-30T21:58:24.790622] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T21:58:24.965509] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T21:58:25.054386] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-30T21:58:25.458700] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T21:58:25.854372] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-30T21:58:26.325767] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T21:58:26.654386] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-30T21:58:27.168782] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T21:58:27.454357] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-30T21:58:28.254390] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-30T21:58:28.644397] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T21:58:28.998592] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T21:58:29.054405] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-30T21:58:29.854392] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-30T21:58:30.654365] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-30T21:58:30.778734] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T21:58:31.152796] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T21:58:31.154482] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T21:58:31.454368] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-30T21:58:31.927407] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T21:58:32.254402] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-30T21:58:33.054387] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-30T21:58:33.330246] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T21:58:33.854382] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-30T21:58:34.654371] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-30T21:58:34.716304] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T21:58:35.289848] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T21:58:35.297476] [INFO ] [REMOTE ] WST: Full fetch complete (53796 records). [2025-09-30T21:58:35.297614] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-30T21:58:35.459484] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-30T21:58:35.719817] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-30T21:58:35.719905] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-30T21:58:35.721070] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-30T21:58:35.721144] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-30T21:58:35.722412] [DEBUG] [LOCAL ] WST: Trimmed 53796 records to 37284 (keeping 200 days of data) [2025-09-30T21:58:35.978520] [DEBUG] [LOCAL ] WST: Primary data saved (37284 records). [2025-09-30T21:58:35.978704] [INFO ] [MAIN ] WST: Full history saved. [2025-09-30T21:58:35.978803] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 32.5s. Estimated remaining: 5m 54s. Rate: 7.8 symbols/min [2025-09-30T21:58:36.119709] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T21:58:36.200788] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:36.260207] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-30T21:58:36.263341] [DEBUG] [LOCAL ] WTRG: Loaded 50896 existing records from primary storage. [2025-09-30T21:58:36.263836] [INFO ] [MAIN ] WTRG: Loaded 50896 existing records. [2025-09-30T21:58:36.460663] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:36.461017] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-30T21:58:36.461081] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-30T21:58:36.462575] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-30T21:58:36.462701] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-30T21:58:36.849494] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:37.054410] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-30T21:58:37.291821] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T21:58:37.564608] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T21:58:37.640074] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T21:58:37.649974] [INFO ] [REMOTE ] WTI: Full fetch complete (64165 records). [2025-09-30T21:58:37.650163] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-30T21:58:37.859484] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-30T21:58:38.117501] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-30T21:58:38.117671] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-30T21:58:38.118902] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-30T21:58:38.118991] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-30T21:58:38.121289] [DEBUG] [LOCAL ] WTI: Trimmed 64165 records to 43900 (keeping 200 days of data) [2025-09-30T21:58:38.392463] [DEBUG] [LOCAL ] WTI: Primary data saved (43900 records). [2025-09-30T21:58:38.392639] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-30T21:58:38.392795] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTI took 31.7s. Estimated remaining: 5m 47s. Rate: 7.8 symbols/min [2025-09-30T21:58:38.597834] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:38.622528] [DEBUG] [LOCAL ] WTS: Loaded 18250 existing records from primary storage. [2025-09-30T21:58:38.622864] [INFO ] [MAIN ] WTS: Loaded 18250 existing records. [2025-09-30T21:58:38.660156] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-30T21:58:38.827945] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:38.828248] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-30T21:58:38.828298] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-30T21:58:38.828769] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-30T21:58:38.828830] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-30T21:58:39.206546] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:39.454367] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-30T21:58:39.579236] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T21:58:40.254327] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-30T21:58:40.436751] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T21:58:40.488383] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T21:58:41.054343] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-30T21:58:41.853529] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T21:58:41.863548] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-30T21:58:42.075681] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T21:58:42.654370] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-30T21:58:43.277237] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T21:58:43.278898] [INFO ] [REMOTE ] WTM: Full fetch complete (2360 records). [2025-09-30T21:58:43.278973] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-30T21:58:43.470181] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-30T21:58:43.477332] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T21:58:43.478504] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T21:58:43.478589] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T21:58:43.478749] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-30T21:58:43.478828] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-30T21:58:43.478891] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-30T21:58:43.479141] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-30T21:58:43.479313] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTM took 26.3s. Estimated remaining: 5m 39s. Rate: 7.8 symbols/min [2025-09-30T21:58:43.667907] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:43.699667] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T21:58:43.711001] [INFO ] [REMOTE ] WT: Full fetch complete (69151 records). [2025-09-30T21:58:43.711194] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-30T21:58:44.058106] [DEBUG] [LOCAL ] WTTR: Loaded 44970 existing records from primary storage. [2025-09-30T21:58:44.061509] [INFO ] [MAIN ] WTTR: Loaded 44970 existing records. [2025-09-30T21:58:44.280438] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-30T21:58:44.323036] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-30T21:58:44.328403] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-30T21:58:44.329877] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-30T21:58:44.336438] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-30T21:58:44.372773] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:44.373434] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-30T21:58:44.373518] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-30T21:58:44.374279] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-30T21:58:44.374355] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-30T21:58:44.436781] [DEBUG] [LOCAL ] WT: Trimmed 69151 records to 47662 (keeping 200 days of data) [2025-09-30T21:58:44.891003] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:45.023948] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T21:58:45.055588] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-30T21:58:45.119631] [DEBUG] [LOCAL ] WT: Primary data saved (47662 records). [2025-09-30T21:58:45.119795] [INFO ] [MAIN ] WT: Full history saved. [2025-09-30T21:58:45.119882] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WT took 40.0s. Estimated remaining: 5m 31s. Rate: 7.8 symbols/min [2025-09-30T21:58:45.306852] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:58:45.369503] [DEBUG] [LOCAL ] WU: Loaded 53452 existing records from primary storage. [2025-09-30T21:58:45.369846] [INFO ] [MAIN ] WU: Loaded 53452 existing records. [2025-09-30T21:58:45.555950] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:58:45.568230] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-30T21:58:45.568384] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-30T21:58:45.569774] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-30T21:58:45.569954] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-30T21:58:45.569700] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T21:58:45.859525] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-30T21:58:45.961976] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:58:46.654345] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-30T21:58:46.813552] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T21:58:47.458336] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-30T21:58:47.464082] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T21:58:47.550810] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T21:58:48.254356] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-30T21:58:49.054350] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-30T21:58:49.261171] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T21:58:49.735968] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T21:58:49.854339] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-30T21:58:50.150601] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T21:58:50.654395] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-30T21:58:51.454352] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-30T21:58:51.562252] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T21:58:52.134935] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T21:58:52.254321] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-30T21:58:52.560948] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T21:58:53.054361] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-30T21:58:53.854348] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-30T21:58:53.947022] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T21:58:54.654358] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-30T21:58:54.857979] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T21:58:54.940042] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T21:58:55.454371] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-30T21:58:56.254338] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-30T21:58:56.466383] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T21:58:56.474332] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T21:58:57.054359] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-30T21:58:57.692829] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T21:58:57.854345] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-30T21:58:58.093009] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T21:58:58.654366] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-30T21:58:59.178701] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T21:58:59.401117] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T21:58:59.454340] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-30T21:59:00.130870] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T21:59:00.134586] [INFO ] [REMOTE ] WTS: Full fetch complete (26183 records). [2025-09-30T21:59:00.134770] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-30T21:59:00.259442] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-30T21:59:00.541870] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-30T21:59:00.541961] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-30T21:59:00.542550] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-30T21:59:00.542596] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-30T21:59:00.543346] [DEBUG] [LOCAL ] WTS: Trimmed 26183 records to 18197 (keeping 200 days of data) [2025-09-30T21:59:00.662996] [DEBUG] [LOCAL ] WTS: Primary data saved (18197 records). [2025-09-30T21:59:00.663156] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-30T21:59:00.663262] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 22.3s. Estimated remaining: 5m 23s. Rate: 7.8 symbols/min [2025-09-30T21:59:00.846032] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:00.898217] [DEBUG] [LOCAL ] WWW: Loaded 49142 existing records from primary storage. [2025-09-30T21:59:00.898718] [INFO ] [MAIN ] WWW: Loaded 49142 existing records. [2025-09-30T21:59:01.059495] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-30T21:59:01.090879] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:01.091091] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-30T21:59:01.091141] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-30T21:59:01.091859] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-30T21:59:01.091923] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-30T21:59:01.495593] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:01.854343] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-30T21:59:01.989957] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T21:59:02.566069] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T21:59:02.654376] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-30T21:59:03.452449] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T21:59:03.463147] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-30T21:59:03.990479] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T21:59:04.254358] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-30T21:59:04.714003] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T21:59:05.054354] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-30T21:59:05.591497] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T21:59:05.603494] [INFO ] [REMOTE ] WTRG: Full fetch complete (73359 records). [2025-09-30T21:59:05.603681] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-30T21:59:05.861544] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-30T21:59:06.050238] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-30T21:59:06.050330] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-30T21:59:06.051460] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-30T21:59:06.051528] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-30T21:59:06.053013] [DEBUG] [LOCAL ] WTRG: Trimmed 73359 records to 50892 (keeping 200 days of data) [2025-09-30T21:59:06.388017] [DEBUG] [LOCAL ] WTRG: Primary data saved (50892 records). [2025-09-30T21:59:06.388168] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-30T21:59:06.388251] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTRG took 30.4s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min [2025-09-30T21:59:06.572501] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:06.635794] [DEBUG] [LOCAL ] WY: Loaded 53120 existing records from primary storage. [2025-09-30T21:59:06.636295] [INFO ] [MAIN ] WY: Loaded 53120 existing records. [2025-09-30T21:59:06.659577] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-30T21:59:06.861324] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:06.877409] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-30T21:59:06.893674] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-30T21:59:06.894355] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-30T21:59:06.894780] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-30T21:59:06.896685] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T21:59:07.286403] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:07.421115] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T21:59:07.454321] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-30T21:59:08.229350] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T21:59:08.254332] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-30T21:59:08.706044] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:59:09.054421] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-30T21:59:09.596021] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T21:59:09.854387] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-30T21:59:10.654336] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-30T21:59:10.831452] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:59:11.448971] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T21:59:11.457775] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-30T21:59:12.254324] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-30T21:59:12.374112] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T21:59:13.054351] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-30T21:59:13.167974] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T21:59:13.854379] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-30T21:59:13.903409] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T21:59:13.913964] [INFO ] [REMOTE ] WTTR: Full fetch complete (65593 records). [2025-09-30T21:59:13.914170] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-30T21:59:14.340220] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-30T21:59:14.340388] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-30T21:59:14.341536] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-30T21:59:14.341634] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-30T21:59:14.343400] [DEBUG] [LOCAL ] WTTR: Trimmed 65593 records to 44935 (keeping 200 days of data) [2025-09-30T21:59:14.624043] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T21:59:14.659426] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-30T21:59:14.669898] [DEBUG] [LOCAL ] WTTR: Primary data saved (44935 records). [2025-09-30T21:59:14.670037] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-30T21:59:14.670137] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 31.2s. Estimated remaining: 5m 8s. Rate: 7.8 symbols/min [2025-09-30T21:59:14.851503] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:14.885050] [DEBUG] [LOCAL ] XFLT: Loaded 29722 existing records from primary storage. [2025-09-30T21:59:14.885323] [INFO ] [MAIN ] XFLT: Loaded 29722 existing records. [2025-09-30T21:59:15.069446] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:15.069681] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-30T21:59:15.069740] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-30T21:59:15.070267] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-30T21:59:15.070330] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-30T21:59:15.455821] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:15.456098] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-30T21:59:15.697107] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T21:59:16.254373] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-30T21:59:16.555784] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T21:59:16.791187] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T21:59:17.054396] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-30T21:59:17.854316] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-30T21:59:17.971625] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T21:59:18.600113] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T21:59:18.654314] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-30T21:59:19.419574] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T21:59:19.454412] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-30T21:59:20.124165] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T21:59:20.254443] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-30T21:59:21.054621] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-30T21:59:21.343944] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T21:59:21.395065] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T21:59:21.854352] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-30T21:59:22.459828] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T21:59:22.654359] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-30T21:59:23.454361] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-30T21:59:23.542467] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T21:59:24.099169] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T21:59:24.254351] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-30T21:59:24.314043] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T21:59:25.054357] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-30T21:59:25.854373] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-30T21:59:26.027251] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T21:59:26.038178] [INFO ] [REMOTE ] WWW: Full fetch complete (70182 records). [2025-09-30T21:59:26.038320] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-30T21:59:26.478812] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-30T21:59:26.479033] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-30T21:59:26.480307] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-30T21:59:26.480396] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-30T21:59:26.499871] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T21:59:26.507700] [DEBUG] [LOCAL ] WWW: Trimmed 70182 records to 49112 (keeping 200 days of data) [2025-09-30T21:59:26.690620] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-30T21:59:26.832566] [DEBUG] [LOCAL ] WWW: Primary data saved (49112 records). [2025-09-30T21:59:26.832875] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-30T21:59:26.833152] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WWW took 26.2s. Estimated remaining: 5m 0s. Rate: 7.8 symbols/min [2025-09-30T21:59:27.017671] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:27.068019] [DEBUG] [LOCAL ] XHR: Loaded 43843 existing records from primary storage. [2025-09-30T21:59:27.068404] [INFO ] [MAIN ] XHR: Loaded 43843 existing records. [2025-09-30T21:59:27.266129] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:27.266373] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-30T21:59:27.266455] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-30T21:59:27.267180] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-30T21:59:27.267241] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-30T21:59:27.457887] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-30T21:59:27.704413] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:27.741286] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T21:59:27.753846] [INFO ] [REMOTE ] WU: Full fetch complete (77338 records). [2025-09-30T21:59:27.754030] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-30T21:59:28.212864] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T21:59:28.245097] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-30T21:59:28.245730] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-30T21:59:28.247088] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-30T21:59:28.247311] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-30T21:59:28.249081] [DEBUG] [LOCAL ] WU: Trimmed 77338 records to 53452 (keeping 200 days of data) [2025-09-30T21:59:28.254341] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-30T21:59:28.592727] [DEBUG] [LOCAL ] WU: Primary data saved (53452 records). [2025-09-30T21:59:28.592889] [INFO ] [MAIN ] WU: Full history saved. [2025-09-30T21:59:28.593344] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WU took 43.5s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-09-30T21:59:28.782198] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:28.782369] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-30T21:59:28.782411] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-30T21:59:28.782554] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-30T21:59:28.782636] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-30T21:59:28.782733] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-30T21:59:28.782773] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-30T21:59:29.063090] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-30T21:59:29.212047] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:29.362822] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T21:59:29.576170] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T21:59:29.854356] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-30T21:59:30.256257] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T21:59:30.654371] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-30T21:59:31.454332] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-30T21:59:31.700193] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T21:59:31.703826] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-30T21:59:31.706755] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T21:59:31.706681] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T21:59:31.707001] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-30T21:59:31.718409] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T21:59:31.718823] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-30T21:59:31.719050] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-30T21:59:31.719110] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-30T21:59:31.719526] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-30T21:59:31.719625] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 3.1s. Estimated remaining: 4m 45s. Rate: 7.8 symbols/min [2025-09-30T21:59:31.896867] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:31.956996] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-30T21:59:31.957374] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-30T21:59:32.113153] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T21:59:32.177525] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:32.177756] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-30T21:59:32.177807] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-30T21:59:32.179444] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-30T21:59:32.179518] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-30T21:59:32.259518] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-30T21:59:32.544630] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:33.054356] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-30T21:59:33.854340] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-30T21:59:34.039579] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T21:59:34.516074] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T21:59:34.654394] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-30T21:59:34.925848] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T21:59:35.454369] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-30T21:59:36.055473] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T21:59:36.254357] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-30T21:59:37.054391] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-30T21:59:37.854350] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-30T21:59:37.923392] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T21:59:37.925013] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-30T21:59:38.362554] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T21:59:38.654361] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-30T21:59:39.359182] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T21:59:39.366328] [INFO ] [REMOTE ] XFLT: Full fetch complete (44214 records). [2025-09-30T21:59:39.366443] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-30T21:59:39.459595] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-30T21:59:39.779222] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-30T21:59:39.779322] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-30T21:59:39.780237] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-30T21:59:39.780302] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-30T21:59:39.781382] [DEBUG] [LOCAL ] XFLT: Trimmed 44214 records to 29795 (keeping 200 days of data) [2025-09-30T21:59:39.971680] [DEBUG] [LOCAL ] XFLT: Primary data saved (29795 records). [2025-09-30T21:59:39.971931] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-30T21:59:39.972083] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 25.3s. Estimated remaining: 4m 37s. Rate: 7.8 symbols/min [2025-09-30T21:59:40.158138] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:40.188797] [DEBUG] [LOCAL ] XPER: Loaded 29702 existing records from primary storage. [2025-09-30T21:59:40.189077] [INFO ] [MAIN ] XPER: Loaded 29702 existing records. [2025-09-30T21:59:40.262044] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-30T21:59:40.381691] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:40.381949] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-30T21:59:40.382003] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-30T21:59:40.382495] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-30T21:59:40.382555] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-30T21:59:40.843540] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:41.063693] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-30T21:59:41.090214] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-30T21:59:41.127406] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T21:59:41.854326] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-30T21:59:41.984892] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T21:59:42.457108] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T21:59:42.654389] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-30T21:59:43.169524] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T21:59:43.454435] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-30T21:59:43.853741] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T21:59:44.254365] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-30T21:59:45.054372] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-30T21:59:45.733204] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-30T21:59:45.854346] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-30T21:59:46.108886] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T21:59:46.626034] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T21:59:46.654321] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-30T21:59:46.984492] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T21:59:47.454365] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-30T21:59:47.905675] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:59:48.254355] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-30T21:59:49.054360] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-30T21:59:49.167060] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T21:59:49.305514] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T21:59:49.317115] [INFO ] [REMOTE ] WY: Full fetch complete (76854 records). [2025-09-30T21:59:49.317257] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-30T21:59:49.739968] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-30T21:59:49.740066] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-30T21:59:49.741613] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-30T21:59:49.741713] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-30T21:59:49.745845] [DEBUG] [LOCAL ] WY: Trimmed 76854 records to 53122 (keeping 200 days of data) [2025-09-30T21:59:49.854363] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-30T21:59:50.097667] [DEBUG] [LOCAL ] WY: Primary data saved (53122 records). [2025-09-30T21:59:50.097809] [INFO ] [MAIN ] WY: Full history saved. [2025-09-30T21:59:50.097965] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. WY took 43.7s. Estimated remaining: 4m 29s. Rate: 7.8 symbols/min [2025-09-30T21:59:50.276877] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:50.339848] [DEBUG] [LOCAL ] XPEV: Loaded 53637 existing records from primary storage. [2025-09-30T21:59:50.340264] [INFO ] [MAIN ] XPEV: Loaded 53637 existing records. [2025-09-30T21:59:50.526998] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:50.527284] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-30T21:59:50.527348] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-30T21:59:50.528122] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-30T21:59:50.528182] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-30T21:59:50.659449] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-30T21:59:50.921744] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:50.942091] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T21:59:51.380679] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-30T21:59:51.454337] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-30T21:59:52.254357] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-30T21:59:52.305307] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T21:59:53.054392] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-30T21:59:53.566872] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T21:59:53.854347] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-30T21:59:54.530300] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T21:59:54.539958] [INFO ] [REMOTE ] XHR: Full fetch complete (61514 records). [2025-09-30T21:59:54.540117] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-30T21:59:54.662630] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-30T21:59:54.799235] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-30T21:59:55.042613] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-30T21:59:55.042763] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-30T21:59:55.043957] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-30T21:59:55.044026] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-30T21:59:55.045439] [DEBUG] [LOCAL ] XHR: Trimmed 61514 records to 43760 (keeping 200 days of data) [2025-09-30T21:59:55.327312] [DEBUG] [LOCAL ] XHR: Primary data saved (43760 records). [2025-09-30T21:59:55.327446] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-30T21:59:55.327568] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 28.5s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min [2025-09-30T21:59:55.459543] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-30T21:59:55.521114] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T21:59:55.569861] [DEBUG] [LOCAL ] XPO: Loaded 47863 existing records from primary storage. [2025-09-30T21:59:55.570202] [INFO ] [MAIN ] XPO: Loaded 47863 existing records. [2025-09-30T21:59:55.765264] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T21:59:55.765492] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-30T21:59:55.765562] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-30T21:59:55.766585] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-30T21:59:55.766686] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-30T21:59:56.089397] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T21:59:56.182462] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T21:59:56.214882] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-30T21:59:56.254328] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-30T21:59:57.054355] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-30T21:59:57.734860] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-30T21:59:57.854359] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-30T21:59:58.211422] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T21:59:58.654388] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-30T21:59:58.715569] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T21:59:59.454361] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-30T21:59:59.900373] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T21:59:59.937724] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-30T22:00:00.254360] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-30T22:00:01.054387] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-30T22:00:01.635042] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T22:00:01.835347] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T22:00:01.854369] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-30T22:00:02.654368] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-30T22:00:03.287037] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T22:00:03.294519] [INFO ] [REMOTE ] XPER: Full fetch complete (43248 records). [2025-09-30T22:00:03.294752] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-30T22:00:03.457288] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-30T22:00:03.738206] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-30T22:00:03.738475] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-30T22:00:03.739497] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-30T22:00:03.739601] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-30T22:00:03.767325] [DEBUG] [LOCAL ] XPER: Trimmed 43248 records to 29705 (keeping 200 days of data) [2025-09-30T22:00:03.773246] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-30T22:00:03.963175] [DEBUG] [LOCAL ] XPER: Primary data saved (29705 records). [2025-09-30T22:00:03.963337] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-30T22:00:03.963444] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 24.0s. Estimated remaining: 4m 14s. Rate: 7.8 symbols/min [2025-09-30T22:00:04.156031] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:04.192637] [DEBUG] [LOCAL ] XPOF: Loaded 38417 existing records from primary storage. [2025-09-30T22:00:04.193045] [INFO ] [MAIN ] XPOF: Loaded 38417 existing records. [2025-09-30T22:00:04.259452] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-30T22:00:04.390626] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:04.390901] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-30T22:00:04.390951] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-30T22:00:04.391944] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-30T22:00:04.392028] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-30T22:00:04.801580] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:05.059515] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-30T22:00:05.082974] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-30T22:00:05.154508] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T22:00:05.854357] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-30T22:00:06.378711] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T22:00:06.564136] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T22:00:06.654362] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-30T22:00:07.454340] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-30T22:00:07.510322] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T22:00:08.254397] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-30T22:00:08.993999] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T22:00:09.006130] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-30T22:00:09.006312] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-30T22:00:09.060574] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-30T22:00:09.465518] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-30T22:00:09.465634] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-30T22:00:09.467035] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-30T22:00:09.467124] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-30T22:00:09.470104] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-09-30T22:00:09.596148] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T22:00:09.668071] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T22:00:09.864308] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-30T22:00:09.919839] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-30T22:00:09.920047] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-30T22:00:09.920185] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XOM took 38.2s. Estimated remaining: 4m 6s. Rate: 7.8 symbols/min [2025-09-30T22:00:10.104718] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:10.162203] [DEBUG] [LOCAL ] XPRO: Loaded 45851 existing records from primary storage. [2025-09-30T22:00:10.162553] [INFO ] [MAIN ] XPRO: Loaded 45851 existing records. [2025-09-30T22:00:10.355025] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:10.355275] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-30T22:00:10.355334] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-30T22:00:10.356084] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-30T22:00:10.356152] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-30T22:00:10.663772] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-30T22:00:10.787345] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:10.814041] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T22:00:11.133606] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T22:00:11.454395] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-30T22:00:12.254360] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-30T22:00:12.857446] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-30T22:00:12.907827] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T22:00:13.054425] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-30T22:00:13.854486] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-30T22:00:13.909556] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T22:00:14.654381] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-30T22:00:15.466291] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-30T22:00:15.470148] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T22:00:15.667398] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T22:00:15.827403] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T22:00:16.254401] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-30T22:00:17.054419] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-30T22:00:17.188813] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T22:00:17.854364] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-30T22:00:18.256815] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T22:00:18.592544] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T22:00:18.654396] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-30T22:00:19.397882] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T22:00:19.454422] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-30T22:00:20.254361] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-30T22:00:20.784048] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T22:00:21.054338] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-30T22:00:21.089934] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-30T22:00:21.102455] [INFO ] [REMOTE ] XPEV: Full fetch complete (77679 records). [2025-09-30T22:00:21.102621] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-30T22:00:21.564325] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-30T22:00:21.564443] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-30T22:00:21.565730] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-30T22:00:21.565817] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-30T22:00:21.591065] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T22:00:21.589775] [DEBUG] [LOCAL ] XPEV: Trimmed 77679 records to 53637 (keeping 200 days of data) [2025-09-30T22:00:21.856931] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-30T22:00:21.948149] [DEBUG] [LOCAL ] XPEV: Primary data saved (53637 records). [2025-09-30T22:00:21.948316] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-30T22:00:21.948415] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPEV took 31.9s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-09-30T22:00:22.134994] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:22.165325] [DEBUG] [LOCAL ] XYF: Loaded 28397 existing records from primary storage. [2025-09-30T22:00:22.165607] [INFO ] [MAIN ] XYF: Loaded 28397 existing records. [2025-09-30T22:00:22.360000] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:22.360207] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-30T22:00:22.360255] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-30T22:00:22.360957] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-30T22:00:22.361019] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-30T22:00:22.661620] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-30T22:00:22.802934] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:22.842434] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T22:00:23.103840] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T22:00:23.454362] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-30T22:00:23.942180] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T22:00:24.067492] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T22:00:24.254396] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-30T22:00:25.054383] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-30T22:00:25.854343] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-30T22:00:25.974299] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T22:00:26.455055] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T22:00:26.654451] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-30T22:00:26.706340] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T22:00:27.454372] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-30T22:00:28.256248] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-30T22:00:28.257581] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T22:00:28.293400] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T22:00:29.054367] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-30T22:00:29.854345] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-30T22:00:30.085186] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T22:00:30.173493] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T22:00:30.654371] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-30T22:00:31.454321] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-30T22:00:31.558821] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T22:00:32.254355] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-30T22:00:32.381886] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T22:00:32.625715] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T22:00:33.054384] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-30T22:00:33.627840] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T22:00:33.635957] [INFO ] [REMOTE ] XPOF: Full fetch complete (52168 records). [2025-09-30T22:00:33.636096] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-30T22:00:33.859550] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-30T22:00:34.084414] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-30T22:00:34.084500] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-30T22:00:34.085533] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-30T22:00:34.085615] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-30T22:00:34.086926] [DEBUG] [LOCAL ] XPOF: Trimmed 52168 records to 38259 (keeping 200 days of data) [2025-09-30T22:00:34.323319] [DEBUG] [LOCAL ] XPOF: Primary data saved (38259 records). [2025-09-30T22:00:34.323472] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-30T22:00:34.323560] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPOF took 30.4s. Estimated remaining: 3m 51s. Rate: 7.8 symbols/min [2025-09-30T22:00:34.516597] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:34.577517] [DEBUG] [LOCAL ] XYL: Loaded 47998 existing records from primary storage. [2025-09-30T22:00:34.578138] [INFO ] [MAIN ] XYL: Loaded 47998 existing records. [2025-09-30T22:00:34.658526] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-30T22:00:34.787082] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:34.787487] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-30T22:00:34.787569] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-30T22:00:34.802993] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-30T22:00:34.813325] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-30T22:00:34.863750] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T22:00:34.940451] [INFO ] [REMOTE ] XPO: Full fetch complete (69882 records). [2025-09-30T22:00:34.940676] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-30T22:00:35.644011] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:35.661597] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-30T22:00:35.706726] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-30T22:00:35.707037] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-30T22:00:35.708567] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-30T22:00:35.709399] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-30T22:00:35.744586] [DEBUG] [LOCAL ] XPO: Trimmed 69882 records to 47829 (keeping 200 days of data) [2025-09-30T22:00:35.747148] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T22:00:35.774128] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T22:00:36.087824] [DEBUG] [LOCAL ] XPO: Primary data saved (47829 records). [2025-09-30T22:00:36.087986] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-30T22:00:36.088084] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPO took 40.8s. Estimated remaining: 3m 43s. Rate: 7.8 symbols/min [2025-09-30T22:00:36.269545] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-30T22:00:36.273923] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:36.275012] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-30T22:00:36.275067] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-30T22:00:36.275181] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-30T22:00:36.275277] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-30T22:00:36.275343] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-30T22:00:36.275383] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-30T22:00:36.659792] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:37.054390] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-30T22:00:37.276157] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T22:00:37.276488] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-30T22:00:37.276598] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T22:00:37.276691] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-30T22:00:37.276763] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T22:00:37.276838] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-30T22:00:37.276942] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-30T22:00:37.277001] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-30T22:00:37.277055] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-30T22:00:37.277108] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 1.2s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-09-30T22:00:37.473110] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:37.512371] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T22:00:37.558140] [DEBUG] [LOCAL ] YALA: Loaded 37355 existing records from primary storage. [2025-09-30T22:00:37.558445] [INFO ] [MAIN ] YALA: Loaded 37355 existing records. [2025-09-30T22:00:37.756550] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:37.775176] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-30T22:00:37.776445] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T22:00:37.776543] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-30T22:00:37.784267] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-30T22:00:37.784333] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-30T22:00:37.859457] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-30T22:00:38.170090] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:38.654363] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-30T22:00:39.454337] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-30T22:00:39.488788] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T22:00:39.992804] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T22:00:40.254412] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-30T22:00:40.981057] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T22:00:41.054382] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-30T22:00:41.164178] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T22:00:41.854381] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-30T22:00:42.654365] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-30T22:00:42.733306] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T22:00:42.840451] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T22:00:43.454369] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-30T22:00:44.008013] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T22:00:44.254402] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-30T22:00:44.448773] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T22:00:45.054367] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-30T22:00:45.327449] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T22:00:45.332449] [INFO ] [REMOTE ] XYF: Full fetch complete (31818 records). [2025-09-30T22:00:45.332555] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-30T22:00:45.727766] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-30T22:00:45.727867] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-30T22:00:45.728740] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-30T22:00:45.728805] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-30T22:00:45.729620] [DEBUG] [LOCAL ] XYF: Trimmed 31818 records to 28441 (keeping 200 days of data) [2025-09-30T22:00:45.854585] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-30T22:00:45.924968] [DEBUG] [LOCAL ] XYF: Primary data saved (28441 records). [2025-09-30T22:00:45.925124] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-30T22:00:45.925214] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYF took 24.0s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-09-30T22:00:46.107319] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:46.134915] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T22:00:46.171125] [DEBUG] [LOCAL ] YELP: Loaded 45246 existing records from primary storage. [2025-09-30T22:00:46.171457] [INFO ] [MAIN ] YELP: Loaded 45246 existing records. [2025-09-30T22:00:46.353329] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:46.353541] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-30T22:00:46.353587] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-30T22:00:46.354109] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-30T22:00:46.354171] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-30T22:00:46.659446] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-30T22:00:46.731938] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:47.314249] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T22:00:47.324048] [INFO ] [REMOTE ] XPRO: Full fetch complete (66494 records). [2025-09-30T22:00:47.324193] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-30T22:00:47.459465] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-30T22:00:47.748382] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-30T22:00:47.748494] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-30T22:00:47.749731] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-30T22:00:47.749800] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-30T22:00:47.751471] [DEBUG] [LOCAL ] XPRO: Trimmed 66494 records to 45857 (keeping 200 days of data) [2025-09-30T22:00:48.031528] [DEBUG] [LOCAL ] XPRO: Primary data saved (45857 records). [2025-09-30T22:00:48.031765] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-30T22:00:48.031949] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XPRO took 38.1s. Estimated remaining: 3m 20s. Rate: 7.8 symbols/min [2025-09-30T22:00:48.213508] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:00:48.254370] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-30T22:00:48.288581] [DEBUG] [LOCAL ] YETI: Loaded 52480 existing records from primary storage. [2025-09-30T22:00:48.289194] [INFO ] [MAIN ] YETI: Loaded 52480 existing records. [2025-09-30T22:00:48.497548] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:00:48.497918] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-30T22:00:48.498018] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-30T22:00:48.498719] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-30T22:00:48.498787] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-30T22:00:48.850487] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T22:00:48.953469] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:00:48.986239] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T22:00:49.054349] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-30T22:00:49.725752] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T22:00:49.854370] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-30T22:00:50.623306] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T22:00:50.654339] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-30T22:00:51.454383] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-30T22:00:51.765529] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T22:00:52.254372] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-30T22:00:52.369386] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T22:00:53.017428] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T22:00:53.054381] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-30T22:00:53.854328] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-30T22:00:54.037445] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T22:00:54.646999] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T22:00:54.654822] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-30T22:00:54.988968] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T22:00:55.454391] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-30T22:00:56.254353] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-30T22:00:56.383141] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T22:00:57.054361] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-30T22:00:57.149133] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T22:00:57.854338] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-30T22:00:57.920242] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T22:00:58.659417] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-30T22:00:58.677276] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T22:00:59.170481] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T22:00:59.454372] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-30T22:01:00.015770] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T22:01:00.254364] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-30T22:01:01.054371] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-30T22:01:01.459666] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T22:01:01.766521] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T22:01:01.854355] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-30T22:01:02.546243] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T22:01:02.654378] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-30T22:01:03.454376] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-30T22:01:03.611777] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T22:01:04.183743] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T22:01:04.254386] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-30T22:01:05.054362] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-30T22:01:05.105575] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T22:01:05.838581] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T22:01:05.854600] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-30T22:01:06.654385] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-30T22:01:06.742853] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T22:01:06.756324] [INFO ] [REMOTE ] XYL: Full fetch complete (69812 records). [2025-09-30T22:01:06.756545] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-30T22:01:07.225083] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-30T22:01:07.225184] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-30T22:01:07.226390] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-30T22:01:07.226470] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-30T22:01:07.228119] [DEBUG] [LOCAL ] XYL: Trimmed 69812 records to 47982 (keeping 200 days of data) [2025-09-30T22:01:07.460836] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-30T22:01:07.598763] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T22:01:07.616423] [DEBUG] [LOCAL ] XYL: Primary data saved (47982 records). [2025-09-30T22:01:07.616692] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-30T22:01:07.616833] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYL took 33.3s. Estimated remaining: 3m 12s. Rate: 7.8 symbols/min [2025-09-30T22:01:07.802366] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:07.847345] [DEBUG] [LOCAL ] YEXT: Loaded 43143 existing records from primary storage. [2025-09-30T22:01:07.847674] [INFO ] [MAIN ] YEXT: Loaded 43143 existing records. [2025-09-30T22:01:08.048663] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:08.048878] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-30T22:01:08.048927] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-30T22:01:08.049348] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-30T22:01:08.049410] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-30T22:01:08.260102] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-30T22:01:08.455552] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:08.492610] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T22:01:08.707819] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T22:01:08.714261] [INFO ] [REMOTE ] YALA: Full fetch complete (46548 records). [2025-09-30T22:01:08.714366] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-30T22:01:09.059489] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-30T22:01:09.151744] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-30T22:01:09.151842] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-30T22:01:09.152757] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-30T22:01:09.152826] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-30T22:01:09.154186] [DEBUG] [LOCAL ] YALA: Trimmed 46548 records to 37240 (keeping 200 days of data) [2025-09-30T22:01:09.377301] [DEBUG] [LOCAL ] YALA: Primary data saved (37240 records). [2025-09-30T22:01:09.377456] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-30T22:01:09.377545] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 32.1s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-09-30T22:01:09.583680] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:09.650480] [DEBUG] [LOCAL ] YMM: Loaded 52637 existing records from primary storage. [2025-09-30T22:01:09.650953] [INFO ] [MAIN ] YMM: Loaded 52637 existing records. [2025-09-30T22:01:09.867061] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:09.867493] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-30T22:01:09.867157] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-30T22:01:09.868779] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-30T22:01:09.878809] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-30T22:01:09.900881] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T22:01:09.899203] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-30T22:01:09.998261] [INFO ] [REMOTE ] YELP: Full fetch complete (64285 records). [2025-09-30T22:01:10.022900] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-30T22:01:10.670908] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:10.689189] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-30T22:01:10.822293] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-30T22:01:10.822493] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-30T22:01:10.823623] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-30T22:01:10.823713] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-30T22:01:10.825311] [DEBUG] [LOCAL ] YELP: Trimmed 64285 records to 45270 (keeping 200 days of data) [2025-09-30T22:01:10.961279] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T22:01:11.155164] [DEBUG] [LOCAL ] YELP: Primary data saved (45270 records). [2025-09-30T22:01:11.155359] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-30T22:01:11.155518] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 25.2s. Estimated remaining: 2m 57s. Rate: 7.8 symbols/min [2025-09-30T22:01:11.340206] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:11.402398] [DEBUG] [LOCAL ] YOU: Loaded 49695 existing records from primary storage. [2025-09-30T22:01:11.402821] [INFO ] [MAIN ] YOU: Loaded 49695 existing records. [2025-09-30T22:01:11.462122] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-30T22:01:11.610519] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:11.610985] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-30T22:01:11.611132] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-30T22:01:11.611764] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-30T22:01:11.611829] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-30T22:01:11.957390] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T22:01:12.071548] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:12.254374] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-30T22:01:12.636121] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T22:01:12.736301] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T22:01:13.054400] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-30T22:01:13.854431] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-30T22:01:14.126772] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T22:01:14.654332] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-30T22:01:14.848502] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T22:01:15.335749] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T22:01:15.454352] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-30T22:01:16.086704] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T22:01:16.254390] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-30T22:01:17.063225] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-30T22:01:17.070385] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T22:01:17.854378] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-30T22:01:18.047786] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T22:01:18.654354] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-30T22:01:18.755552] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T22:01:19.002334] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T22:01:19.454375] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-30T22:01:20.254375] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-30T22:01:20.695909] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T22:01:21.054330] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-30T22:01:21.286792] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T22:01:21.455848] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T22:01:21.854394] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-30T22:01:22.654327] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-30T22:01:23.086834] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T22:01:23.454419] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-30T22:01:23.763221] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T22:01:24.254360] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-30T22:01:24.491394] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T22:01:24.951913] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T22:01:25.054383] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-30T22:01:25.854378] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-30T22:01:26.080526] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T22:01:26.493865] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T22:01:26.654399] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-30T22:01:27.268673] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T22:01:27.454393] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-30T22:01:28.254413] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-30T22:01:28.421713] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T22:01:28.433336] [INFO ] [REMOTE ] YETI: Full fetch complete (75469 records). [2025-09-30T22:01:28.433490] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-30T22:01:28.869172] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-30T22:01:28.869273] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-30T22:01:28.870886] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-30T22:01:28.870954] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-30T22:01:28.872995] [DEBUG] [LOCAL ] YETI: Trimmed 75469 records to 52484 (keeping 200 days of data) [2025-09-30T22:01:29.058615] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-30T22:01:29.217326] [DEBUG] [LOCAL ] YETI: Primary data saved (52484 records). [2025-09-30T22:01:29.217477] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-30T22:01:29.217573] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 41.2s. Estimated remaining: 2m 49s. Rate: 7.8 symbols/min [2025-09-30T22:01:29.443870] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:29.449995] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T22:01:29.513174] [DEBUG] [LOCAL ] YPF: Loaded 50484 existing records from primary storage. [2025-09-30T22:01:29.513585] [INFO ] [MAIN ] YPF: Loaded 50484 existing records. [2025-09-30T22:01:29.714096] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:29.714340] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-30T22:01:29.714388] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-30T22:01:29.714939] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-30T22:01:29.715000] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-30T22:01:29.869269] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-30T22:01:30.125832] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T22:01:30.160204] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:30.640694] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T22:01:30.654312] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-30T22:01:31.149296] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T22:01:31.454403] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-30T22:01:31.953767] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T22:01:32.254404] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-30T22:01:33.054379] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-30T22:01:33.242096] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T22:01:33.789780] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T22:01:33.854339] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-30T22:01:34.654326] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-30T22:01:34.827528] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T22:01:35.325074] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T22:01:35.454360] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-30T22:01:36.220983] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T22:01:36.231431] [INFO ] [REMOTE ] YEXT: Full fetch complete (63354 records). [2025-09-30T22:01:36.231610] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-30T22:01:36.259495] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-30T22:01:36.683185] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-30T22:01:36.683347] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-30T22:01:36.684866] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-30T22:01:36.684946] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-30T22:01:36.687238] [DEBUG] [LOCAL ] YEXT: Trimmed 63354 records to 43136 (keeping 200 days of data) [2025-09-30T22:01:36.954395] [DEBUG] [LOCAL ] YEXT: Primary data saved (43136 records). [2025-09-30T22:01:36.954540] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-30T22:01:36.954699] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 29.3s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-09-30T22:01:37.059467] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-30T22:01:37.152448] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:37.168860] [DEBUG] [LOCAL ] YRD: Loaded 12556 existing records from primary storage. [2025-09-30T22:01:37.169121] [INFO ] [MAIN ] YRD: Loaded 12556 existing records. [2025-09-30T22:01:37.375368] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:37.375715] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-30T22:01:37.376384] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-30T22:01:37.376824] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-30T22:01:37.377003] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-30T22:01:37.525885] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T22:01:37.826854] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:37.854358] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-30T22:01:38.101778] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T22:01:38.580980] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T22:01:38.654392] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-30T22:01:38.798336] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T22:01:39.454378] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-30T22:01:40.254356] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-30T22:01:40.303297] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T22:01:41.054368] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-30T22:01:41.081571] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T22:01:41.304619] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T22:01:41.317538] [INFO ] [REMOTE ] YMM: Full fetch complete (76401 records). [2025-09-30T22:01:41.317755] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-30T22:01:41.752675] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-30T22:01:41.752780] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-30T22:01:41.753897] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-30T22:01:41.753961] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-30T22:01:41.755422] [DEBUG] [LOCAL ] YMM: Trimmed 76401 records to 52647 (keeping 200 days of data) [2025-09-30T22:01:41.854544] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-30T22:01:42.095860] [DEBUG] [LOCAL ] YMM: Primary data saved (52647 records). [2025-09-30T22:01:42.096094] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-30T22:01:42.096425] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 32.7s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min [2025-09-30T22:01:42.287065] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:42.316157] [DEBUG] [LOCAL ] YSG: Loaded 25406 existing records from primary storage. [2025-09-30T22:01:42.316462] [INFO ] [MAIN ] YSG: Loaded 25406 existing records. [2025-09-30T22:01:42.508089] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:42.508787] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-30T22:01:42.508879] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-30T22:01:42.509473] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-30T22:01:42.509553] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-30T22:01:42.663831] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-30T22:01:42.908174] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:42.952548] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T22:01:43.454363] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-30T22:01:43.589963] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T22:01:43.602891] [INFO ] [REMOTE ] YOU: Full fetch complete (72070 records). [2025-09-30T22:01:43.603073] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-30T22:01:43.952478] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T22:01:44.049566] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-30T22:01:44.049715] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-30T22:01:44.050969] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-30T22:01:44.051049] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-30T22:01:44.055807] [DEBUG] [LOCAL ] YOU: Trimmed 72070 records to 49684 (keeping 200 days of data) [2025-09-30T22:01:44.259176] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-30T22:01:44.394108] [DEBUG] [LOCAL ] YOU: Primary data saved (49684 records). [2025-09-30T22:01:44.394300] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-30T22:01:44.394453] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 33.2s. Estimated remaining: 2m 26s. Rate: 7.8 symbols/min [2025-09-30T22:01:44.597439] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:01:44.671768] [DEBUG] [LOCAL ] YUM: Loaded 51166 existing records from primary storage. [2025-09-30T22:01:44.672186] [INFO ] [MAIN ] YUM: Loaded 51166 existing records. [2025-09-30T22:01:44.946311] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:01:44.946545] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-30T22:01:44.946623] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-30T22:01:44.947675] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-30T22:01:44.947800] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-30T22:01:45.062170] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-30T22:01:45.391886] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:01:45.406257] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T22:01:45.440921] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T22:01:45.854341] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-30T22:01:46.500894] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T22:01:46.654389] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-30T22:01:47.218487] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T22:01:47.454396] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-30T22:01:47.622060] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T22:01:48.254377] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-30T22:01:48.917179] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T22:01:48.987582] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T22:01:49.054396] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-30T22:01:49.854354] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-30T22:01:50.654344] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-30T22:01:50.774356] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T22:01:51.179826] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T22:01:51.309578] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T22:01:51.454368] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-30T22:01:52.254379] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-30T22:01:53.054340] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-30T22:01:53.131131] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T22:01:53.270413] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T22:01:53.854387] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-30T22:01:54.176027] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T22:01:54.654375] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-30T22:01:55.454384] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-30T22:01:56.254681] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-30T22:01:56.372083] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T22:01:56.392909] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T22:01:56.485586] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-30T22:01:57.054329] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-30T22:01:57.285261] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T22:01:57.854411] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-30T22:01:58.654398] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-30T22:01:58.914321] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T22:01:58.925913] [INFO ] [REMOTE ] YPF: Full fetch complete (73504 records). [2025-09-30T22:01:58.926069] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-30T22:01:59.354686] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-30T22:01:59.354792] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-30T22:01:59.356064] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-30T22:01:59.356139] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-30T22:01:59.358200] [DEBUG] [LOCAL ] YPF: Trimmed 73504 records to 50489 (keeping 200 days of data) [2025-09-30T22:01:59.458118] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-30T22:01:59.471107] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T22:01:59.710239] [DEBUG] [LOCAL ] YPF: Primary data saved (50489 records). [2025-09-30T22:01:59.710520] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-30T22:01:59.710743] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YPF took 30.5s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-09-30T22:01:59.865436] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T22:01:59.981360] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:00.051244] [DEBUG] [LOCAL ] YUMC: Loaded 52675 existing records from primary storage. [2025-09-30T22:02:00.051691] [INFO ] [MAIN ] YUMC: Loaded 52675 existing records. [2025-09-30T22:02:00.259503] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:00.260008] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-30T22:02:00.259666] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-30T22:02:00.260451] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-30T22:02:00.261898] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-30T22:02:00.261961] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-30T22:02:00.428624] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T22:02:00.720408] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:01.054374] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-30T22:02:01.854358] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-30T22:02:02.619918] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-30T22:02:02.654321] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-30T22:02:02.829458] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T22:02:03.262218] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T22:02:03.309740] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T22:02:03.454404] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-30T22:02:04.254367] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-30T22:02:05.054369] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-30T22:02:05.202664] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T22:02:05.854409] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-30T22:02:06.029476] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T22:02:06.059177] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T22:02:06.062148] [INFO ] [REMOTE ] YRD: Full fetch complete (18991 records). [2025-09-30T22:02:06.062227] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-30T22:02:06.454467] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-30T22:02:06.454562] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-30T22:02:06.455022] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-30T22:02:06.455098] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-30T22:02:06.456020] [DEBUG] [LOCAL ] YRD: Trimmed 18991 records to 12580 (keeping 200 days of data) [2025-09-30T22:02:06.541606] [DEBUG] [LOCAL ] YRD: Primary data saved (12580 records). [2025-09-30T22:02:06.541782] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-30T22:02:06.541931] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YRD took 29.6s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-09-30T22:02:06.664298] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-30T22:02:06.760983] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:06.837131] [DEBUG] [LOCAL ] ZBH: Loaded 51156 existing records from primary storage. [2025-09-30T22:02:06.837539] [INFO ] [MAIN ] ZBH: Loaded 51156 existing records. [2025-09-30T22:02:07.056750] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:07.057011] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-30T22:02:07.057102] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-30T22:02:07.058637] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-30T22:02:07.058722] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-30T22:02:07.458906] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-30T22:02:07.482746] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:07.652917] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T22:02:07.862859] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T22:02:08.254414] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-30T22:02:08.904440] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T22:02:09.054397] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-30T22:02:09.854393] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-30T22:02:10.023722] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T22:02:10.597764] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T22:02:10.654330] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-30T22:02:11.057907] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T22:02:11.454412] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-30T22:02:12.254364] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-30T22:02:12.441960] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T22:02:13.054351] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-30T22:02:13.295729] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T22:02:13.449684] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T22:02:13.455837] [INFO ] [REMOTE ] YSG: Full fetch complete (32461 records). [2025-09-30T22:02:13.455999] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-30T22:02:13.863071] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-30T22:02:13.880309] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-30T22:02:13.880410] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-30T22:02:13.881223] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-30T22:02:13.881425] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-30T22:02:13.882538] [DEBUG] [LOCAL ] YSG: Trimmed 32461 records to 25331 (keeping 200 days of data) [2025-09-30T22:02:14.037959] [DEBUG] [LOCAL ] YSG: Primary data saved (25331 records). [2025-09-30T22:02:14.038251] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-30T22:02:14.038355] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 31.9s. Estimated remaining: 2m 3s. Rate: 7.8 symbols/min [2025-09-30T22:02:14.218111] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:14.241961] [DEBUG] [LOCAL ] ZEPP: Loaded 17429 existing records from primary storage. [2025-09-30T22:02:14.242223] [INFO ] [MAIN ] ZEPP: Loaded 17429 existing records. [2025-09-30T22:02:14.432617] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:14.433038] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-30T22:02:14.433162] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-30T22:02:14.433679] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-30T22:02:14.433771] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-30T22:02:14.658170] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-30T22:02:14.933838] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:14.990007] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T22:02:15.436148] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T22:02:15.454363] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-30T22:02:16.254354] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-30T22:02:16.402145] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T22:02:16.730586] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T22:02:17.054340] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-30T22:02:17.227674] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T22:02:17.854387] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-30T22:02:18.379117] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-30T22:02:18.455328] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T22:02:18.654398] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-30T22:02:19.454410] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-30T22:02:20.254412] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-30T22:02:20.529686] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T22:02:20.753252] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T22:02:21.054331] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-30T22:02:21.258869] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T22:02:21.854409] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-30T22:02:22.592796] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T22:02:22.654370] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-30T22:02:23.023195] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T22:02:23.454412] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-30T22:02:23.783910] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T22:02:24.026412] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T22:02:24.038047] [INFO ] [REMOTE ] YUM: Full fetch complete (74427 records). [2025-09-30T22:02:24.038270] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-30T22:02:24.256057] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-30T22:02:24.486984] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-30T22:02:24.487074] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-30T22:02:24.488251] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-30T22:02:24.488318] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-30T22:02:24.489954] [DEBUG] [LOCAL ] YUM: Trimmed 74427 records to 51176 (keeping 200 days of data) [2025-09-30T22:02:24.837408] [DEBUG] [LOCAL ] YUM: Primary data saved (51176 records). [2025-09-30T22:02:24.837589] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-30T22:02:24.837730] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 40.4s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-09-30T22:02:25.028745] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:25.066753] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-30T22:02:25.091803] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-30T22:02:25.092133] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-30T22:02:25.279578] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:25.279865] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-30T22:02:25.279915] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-30T22:02:25.280789] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-30T22:02:25.280853] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-30T22:02:25.677705] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:25.854388] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-30T22:02:26.120274] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T22:02:26.495180] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T22:02:26.654416] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-30T22:02:26.875048] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T22:02:27.281022] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T22:02:27.454439] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-30T22:02:28.254421] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-30T22:02:29.061551] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-30T22:02:29.084312] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T22:02:29.096515] [INFO ] [REMOTE ] YUMC: Full fetch complete (76171 records). [2025-09-30T22:02:29.096703] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-30T22:02:29.524394] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-30T22:02:29.524772] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-30T22:02:29.526145] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-30T22:02:29.526349] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-30T22:02:29.539124] [DEBUG] [LOCAL ] YUMC: Trimmed 76171 records to 52682 (keeping 200 days of data) [2025-09-30T22:02:29.559870] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T22:02:29.861670] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-30T22:02:29.921293] [DEBUG] [LOCAL ] YUMC: Primary data saved (52682 records). [2025-09-30T22:02:29.921484] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-30T22:02:29.921627] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUMC took 30.2s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-09-30T22:02:30.654408] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-30T22:02:31.451800] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-30T22:02:31.463629] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-30T22:02:31.499490] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T22:02:32.171040] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T22:02:32.254399] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-30T22:02:33.054365] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-30T22:02:33.411573] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T22:02:33.854408] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-30T22:02:34.434198] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-30T22:02:34.654382] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-30T22:02:34.894575] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T22:02:35.454412] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-30T22:02:36.131857] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T22:02:36.144447] [INFO ] [REMOTE ] ZBH: Full fetch complete (73900 records). [2025-09-30T22:02:36.144696] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-30T22:02:36.458299] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-30T22:02:36.538929] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-30T22:02:36.659432] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-30T22:02:36.659538] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-30T22:02:36.660818] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-30T22:02:36.660889] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-30T22:02:36.665718] [DEBUG] [LOCAL ] ZBH: Trimmed 73900 records to 51129 (keeping 200 days of data) [2025-09-30T22:02:36.953165] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T22:02:36.962544] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18943 records). [2025-09-30T22:02:36.963291] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-30T22:02:37.500133] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-30T22:02:37.500896] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-30T22:02:37.501409] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-30T22:02:37.501869] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-30T22:02:37.505156] [DEBUG] [LOCAL ] ZEPP: Trimmed 18943 records to 17569 (keeping 200 days of data) [2025-09-30T22:02:37.570707] [DEBUG] [LOCAL ] ZBH: Primary data saved (51129 records). [2025-09-30T22:02:37.597547] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-30T22:02:37.600751] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZBH took 31.1s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-09-30T22:02:37.642988] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17569 records). [2025-09-30T22:02:37.643238] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-30T22:02:37.643353] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZEPP took 23.6s. Estimated remaining: 1m 32s. Rate: 7.8 symbols/min [2025-09-30T22:02:38.700703] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T22:02:38.712467] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-30T22:02:40.780251] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T22:02:40.791881] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-30T22:02:42.758817] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T22:02:42.771044] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-30T22:02:45.066054] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-30T22:02:45.077216] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-30T22:02:48.102842] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-09-30T22:02:48.115366] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-30T22:02:50.618298] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-30T22:02:50.631152] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-30T22:02:52.745069] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T22:02:52.756678] [INFO ] [REMOTE ] ZETA: Full fetch complete (77678 records). [2025-09-30T22:02:52.756862] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-30T22:02:53.194817] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-30T22:02:53.194976] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-30T22:02:53.196363] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-30T22:02:53.196467] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-30T22:02:53.198115] [DEBUG] [LOCAL ] ZETA: Trimmed 77678 records to 53595 (keeping 200 days of data) [2025-09-30T22:02:53.552398] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-30T22:02:53.552549] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-30T22:02:53.552668] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 28.7s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-09-30T22:02:54.268139] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:54.295278] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:54.351878] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:54.387187] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:02:54.412551] [DEBUG] [LOCAL ] ZH: Loaded 26791 existing records from primary storage. [2025-09-30T22:02:54.413050] [INFO ] [MAIN ] ZH: Loaded 26791 existing records. [2025-09-30T22:02:54.679311] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:54.724669] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-30T22:02:54.725667] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-30T22:02:54.724364] [DEBUG] [LOCAL ] ZIM: Loaded 53516 existing records from primary storage. [2025-09-30T22:02:54.726439] [DEBUG] [LOCAL ] ZGN: Loaded 40692 existing records from primary storage. [2025-09-30T22:02:54.726893] [INFO ] [MAIN ] ZIM: Loaded 53516 existing records. [2025-09-30T22:02:54.727088] [INFO ] [MAIN ] ZGN: Loaded 40692 existing records. [2025-09-30T22:02:54.725505] [DEBUG] [LOCAL ] ZIP: Loaded 44171 existing records from primary storage. [2025-09-30T22:02:54.768860] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-30T22:02:54.796159] [INFO ] [MAIN ] ZIP: Loaded 44171 existing records. [2025-09-30T22:02:54.811089] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-30T22:02:55.394254] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:55.409740] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:55.455636] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-30T22:02:55.487206] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-30T22:02:55.487137] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-30T22:02:55.551233] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-30T22:02:55.553597] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-30T22:02:55.551182] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:02:55.544206] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-30T22:02:55.577052] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-30T22:02:55.618374] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-30T22:02:55.623688] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-30T22:02:55.710705] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-30T22:02:55.695161] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-30T22:02:55.743621] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-30T22:02:56.564305] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:56.619154] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-30T22:02:56.756079] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:56.818323] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-30T22:02:56.974503] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:56.991884] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-30T22:02:57.034973] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:02:57.035324] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-30T22:02:57.841731] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T22:02:57.847132] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-30T22:02:58.299700] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T22:02:58.306837] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-30T22:02:58.825243] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T22:02:58.833750] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-30T22:02:58.878347] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T22:02:58.882832] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-30T22:02:59.389258] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-30T22:02:59.400750] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-30T22:02:59.552173] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T22:02:59.558930] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-30T22:03:00.348259] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T22:03:00.358462] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-30T22:03:00.446542] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T22:03:00.455213] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-30T22:03:00.739590] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T22:03:00.746754] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-30T22:03:01.119019] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T22:03:01.131088] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-30T22:03:01.736281] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T22:03:01.747371] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-30T22:03:02.050976] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T22:03:02.060070] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-30T22:03:02.502925] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T22:03:02.513575] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-30T22:03:02.780290] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T22:03:02.790040] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-30T22:03:02.876435] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T22:03:02.883987] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-30T22:03:03.149710] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T22:03:03.160789] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-30T22:03:03.606042] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T22:03:03.611305] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-30T22:03:04.032497] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T22:03:04.042284] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-30T22:03:04.549751] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T22:03:04.560539] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-30T22:03:04.709115] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T22:03:04.714607] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-30T22:03:04.987690] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T22:03:04.999480] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-30T22:03:05.553505] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T22:03:05.560122] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-30T22:03:05.598484] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T22:03:05.609523] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-30T22:03:06.156410] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T22:03:06.167144] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-30T22:03:06.648878] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T22:03:06.660898] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-30T22:03:06.731422] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T22:03:06.737795] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-30T22:03:07.150093] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T22:03:07.159374] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-30T22:03:07.400952] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T22:03:07.410924] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-30T22:03:07.692253] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T22:03:07.699561] [INFO ] [REMOTE ] ZH: Full fetch complete (40203 records). [2025-09-30T22:03:07.699806] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-30T22:03:08.187196] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-30T22:03:08.187334] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-30T22:03:08.189205] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-30T22:03:08.189341] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-30T22:03:08.190938] [DEBUG] [LOCAL ] ZH: Trimmed 40203 records to 26655 (keeping 200 days of data) [2025-09-30T22:03:08.448859] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T22:03:08.485825] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-30T22:03:08.500384] [DEBUG] [LOCAL ] ZH: Primary data saved (26655 records). [2025-09-30T22:03:08.500535] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-30T22:03:08.500628] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 14.9s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-09-30T22:03:08.746128] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:08.795543] [DEBUG] [LOCAL ] ZK: Loaded 39661 existing records from primary storage. [2025-09-30T22:03:08.795998] [INFO ] [MAIN ] ZK: Loaded 39661 existing records. [2025-09-30T22:03:09.062451] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:09.063238] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-30T22:03:09.063420] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-30T22:03:09.063900] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-30T22:03:09.063964] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-30T22:03:09.290178] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T22:03:09.399989] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-30T22:03:09.597104] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:09.601259] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-30T22:03:09.604446] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-09-30T22:03:09.854347] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-30T22:03:09.957390] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T22:03:10.654328] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-30T22:03:11.026061] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T22:03:11.163028] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T22:03:11.454404] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-30T22:03:12.143115] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-30T22:03:12.210109] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T22:03:12.219378] [INFO ] [REMOTE ] ZGN: Full fetch complete (58113 records). [2025-09-30T22:03:12.219510] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-30T22:03:12.261891] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-30T22:03:12.654763] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-30T22:03:12.654854] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-30T22:03:12.656078] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-30T22:03:12.656148] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-30T22:03:12.657535] [DEBUG] [LOCAL ] ZGN: Trimmed 58113 records to 40703 (keeping 200 days of data) [2025-09-30T22:03:12.909787] [DEBUG] [LOCAL ] ZGN: Primary data saved (40703 records). [2025-09-30T22:03:12.909916] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-30T22:03:12.910001] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 19.4s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min [2025-09-30T22:03:13.057817] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-30T22:03:13.147118] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:13.150369] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T22:03:13.160107] [INFO ] [REMOTE ] ZIP: Full fetch complete (59472 records). [2025-09-30T22:03:13.160314] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-30T22:03:13.284036] [DEBUG] [LOCAL ] ZKH: Loaded 7929 existing records from primary storage. [2025-09-30T22:03:13.287919] [INFO ] [MAIN ] ZKH: Loaded 7929 existing records. [2025-09-30T22:03:13.729092] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:13.745122] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-30T22:03:13.745393] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-30T22:03:13.787395] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-30T22:03:13.814858] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-30T22:03:13.841733] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-30T22:03:13.841865] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-30T22:03:13.843057] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-30T22:03:13.864426] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-30T22:03:13.952287] [DEBUG] [LOCAL ] ZIP: Trimmed 59472 records to 44095 (keeping 200 days of data) [2025-09-30T22:03:13.967736] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T22:03:14.056722] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-30T22:03:14.363864] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:14.541662] [DEBUG] [LOCAL ] ZIP: Primary data saved (44095 records). [2025-09-30T22:03:14.541806] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-30T22:03:14.541896] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 21.0s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-09-30T22:03:14.660113] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-30T22:03:14.742225] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:14.793572] [DEBUG] [LOCAL ] ZTO: Loaded 49966 existing records from primary storage. [2025-09-30T22:03:14.793948] [INFO ] [MAIN ] ZTO: Loaded 49966 existing records. [2025-09-30T22:03:14.994200] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:14.994491] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-30T22:03:14.994554] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-30T22:03:14.995355] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-30T22:03:14.995417] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-30T22:03:15.313218] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T22:03:15.396386] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:15.457392] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T22:03:15.455452] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-30T22:03:15.472744] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-30T22:03:16.254375] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-30T22:03:16.933733] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T22:03:17.054371] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-30T22:03:17.854340] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-30T22:03:17.954474] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T22:03:18.582633] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T22:03:18.654362] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-30T22:03:19.075756] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-30T22:03:19.149743] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T22:03:19.454366] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-30T22:03:20.007998] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T22:03:20.254357] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-30T22:03:21.054362] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-30T22:03:21.854384] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-30T22:03:22.099276] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T22:03:22.391077] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T22:03:22.654357] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-30T22:03:23.268250] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T22:03:23.454316] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-30T22:03:23.975378] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T22:03:23.990844] [INFO ] [REMOTE ] ZIM: Full fetch complete (77497 records). [2025-09-30T22:03:23.991609] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T22:03:23.991719] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-30T22:03:24.263557] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-30T22:03:24.441145] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-30T22:03:24.441228] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-30T22:03:24.442389] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-30T22:03:24.442457] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-30T22:03:24.443996] [DEBUG] [LOCAL ] ZIM: Trimmed 77497 records to 53516 (keeping 200 days of data) [2025-09-30T22:03:24.799209] [DEBUG] [LOCAL ] ZIM: Primary data saved (53516 records). [2025-09-30T22:03:24.799414] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-30T22:03:24.801578] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 31.2s. Estimated remaining: 53.9s. Rate: 7.8 symbols/min [2025-09-30T22:03:24.998540] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:25.004242] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T22:03:25.025688] [DEBUG] [LOCAL ] ZTR: Loaded 16651 existing records from primary storage. [2025-09-30T22:03:25.026029] [INFO ] [MAIN ] ZTR: Loaded 16651 existing records. [2025-09-30T22:03:25.059519] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-30T22:03:25.228805] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:25.229040] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-30T22:03:25.229089] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-30T22:03:25.229405] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-30T22:03:25.229464] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-30T22:03:25.613948] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:25.854344] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-30T22:03:26.108607] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T22:03:26.654328] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-30T22:03:26.862580] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T22:03:27.421214] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T22:03:27.454319] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-30T22:03:28.047825] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T22:03:28.050252] [INFO ] [REMOTE ] ZKH: Full fetch complete (11877 records). [2025-09-30T22:03:28.050328] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-30T22:03:28.259543] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-30T22:03:28.442172] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-30T22:03:28.442254] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-30T22:03:28.442554] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-30T22:03:28.442614] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-30T22:03:28.443247] [DEBUG] [LOCAL ] ZKH: Trimmed 11877 records to 7937 (keeping 200 days of data) [2025-09-30T22:03:28.491231] [DEBUG] [LOCAL ] ZKH: Primary data saved (7937 records). [2025-09-30T22:03:28.491378] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-30T22:03:28.491463] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 15.6s. Estimated remaining: 46.2s. Rate: 7.8 symbols/min [2025-09-30T22:03:28.666183] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:28.728844] [DEBUG] [LOCAL ] ZTS: Loaded 52993 existing records from primary storage. [2025-09-30T22:03:28.729208] [INFO ] [MAIN ] ZTS: Loaded 52993 existing records. [2025-09-30T22:03:28.917913] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:28.918171] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-30T22:03:28.918219] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-30T22:03:28.918886] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-30T22:03:28.918950] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-30T22:03:29.068612] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-30T22:03:29.308433] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:29.854402] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-30T22:03:30.005594] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T22:03:30.056698] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T22:03:30.654407] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-30T22:03:31.345626] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T22:03:31.388923] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T22:03:31.454321] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-30T22:03:32.254329] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-30T22:03:32.451284] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T22:03:33.054373] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-30T22:03:33.854341] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-30T22:03:34.191040] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T22:03:34.654385] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-30T22:03:34.742718] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T22:03:35.454331] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-30T22:03:35.621934] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T22:03:35.640809] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T22:03:36.254378] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-30T22:03:37.054332] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-30T22:03:37.118965] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T22:03:37.151168] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T22:03:37.854328] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-30T22:03:38.404439] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T22:03:38.654621] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-30T22:03:38.761673] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T22:03:39.454421] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-30T22:03:40.016031] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T22:03:40.254349] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-30T22:03:40.294055] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T22:03:41.054367] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-30T22:03:41.749861] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T22:03:41.854392] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-30T22:03:42.111965] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T22:03:42.654395] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-30T22:03:43.267023] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T22:03:43.276443] [INFO ] [REMOTE ] ZK: Full fetch complete (57103 records). [2025-09-30T22:03:43.276607] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-30T22:03:43.460254] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-30T22:03:43.708966] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-30T22:03:43.709065] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-30T22:03:43.710155] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-30T22:03:43.710225] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-30T22:03:43.711483] [DEBUG] [LOCAL ] ZK: Trimmed 57103 records to 39656 (keeping 200 days of data) [2025-09-30T22:03:43.951950] [DEBUG] [LOCAL ] ZK: Primary data saved (39656 records). [2025-09-30T22:03:43.952162] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-30T22:03:43.952299] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 35.5s. Estimated remaining: 38.5s. Rate: 7.8 symbols/min [2025-09-30T22:03:44.142233] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:44.183529] [DEBUG] [LOCAL ] ZVIA: Loaded 35419 existing records from primary storage. [2025-09-30T22:03:44.183860] [INFO ] [MAIN ] ZVIA: Loaded 35419 existing records. [2025-09-30T22:03:44.255415] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-30T22:03:44.394319] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:44.394636] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-30T22:03:44.394730] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-30T22:03:44.395461] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-30T22:03:44.395523] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-30T22:03:44.672058] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T22:03:44.711824] [INFO ] [REMOTE ] ZTR: Full fetch complete (26855 records). [2025-09-30T22:03:44.751624] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-30T22:03:45.028733] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:45.056889] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-30T22:03:45.058712] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-30T22:03:45.378901] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-30T22:03:45.378984] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-30T22:03:45.379589] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-30T22:03:45.379680] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-30T22:03:45.380462] [DEBUG] [LOCAL ] ZTR: Trimmed 26855 records to 16662 (keeping 200 days of data) [2025-09-30T22:03:45.490475] [DEBUG] [LOCAL ] ZTR: Primary data saved (16662 records). [2025-09-30T22:03:45.490628] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-30T22:03:45.490749] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 20.7s. Estimated remaining: 30.8s. Rate: 7.8 symbols/min [2025-09-30T22:03:45.677354] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T22:03:45.720884] [DEBUG] [LOCAL ] ZWS: Loaded 42344 existing records from primary storage. [2025-09-30T22:03:45.721183] [INFO ] [MAIN ] ZWS: Loaded 42344 existing records. [2025-09-30T22:03:45.875999] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-30T22:03:45.922460] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T22:03:45.923232] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-30T22:03:45.923430] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-30T22:03:45.925422] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-30T22:03:45.925501] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-30T22:03:46.185065] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T22:03:46.404964] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T22:03:46.619327] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T22:03:46.654369] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-30T22:03:47.454368] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-30T22:03:47.923499] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T22:03:48.254374] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-30T22:03:48.501844] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T22:03:48.546273] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T22:03:49.054359] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-30T22:03:49.854359] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-30T22:03:50.058244] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T22:03:50.488207] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T22:03:50.654354] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-30T22:03:51.122477] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T22:03:51.454366] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-30T22:03:52.126250] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T22:03:52.254348] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-30T22:03:52.847011] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T22:03:53.054353] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-30T22:03:53.854358] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-30T22:03:54.401538] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T22:03:54.432499] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T22:03:54.654370] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-30T22:03:55.454374] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-30T22:03:55.976091] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T22:03:56.025460] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T22:03:56.254363] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-30T22:03:57.054352] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-30T22:03:57.181370] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T22:03:57.640274] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T22:03:57.854398] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-30T22:03:58.176676] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T22:03:58.654371] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-30T22:03:59.341437] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T22:03:59.351976] [INFO ] [REMOTE ] ZTO: Full fetch complete (73123 records). [2025-09-30T22:03:59.352259] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-30T22:03:59.459920] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-30T22:03:59.814555] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-30T22:03:59.814694] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-30T22:03:59.815965] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-30T22:03:59.816044] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-30T22:03:59.820597] [DEBUG] [LOCAL ] ZTO: Trimmed 73123 records to 49965 (keeping 200 days of data) [2025-09-30T22:04:00.171616] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T22:04:00.199377] [DEBUG] [LOCAL ] ZTO: Primary data saved (49965 records). [2025-09-30T22:04:00.199613] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-30T22:04:00.199929] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 45.7s. Estimated remaining: 23.1s. Rate: 7.8 symbols/min [2025-09-30T22:04:00.254344] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-30T22:04:01.056287] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-30T22:04:01.457833] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T22:04:01.847531] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T22:04:01.857093] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-30T22:04:02.554188] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T22:04:02.654380] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-30T22:04:03.454341] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-30T22:04:03.991363] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T22:04:04.254383] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-30T22:04:04.339449] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T22:04:05.010591] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T22:04:05.019024] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52633 records). [2025-09-30T22:04:05.019200] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-30T22:04:05.066631] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-30T22:04:05.433849] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-30T22:04:05.433948] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-30T22:04:05.435084] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-30T22:04:05.435157] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-30T22:04:05.436478] [DEBUG] [LOCAL ] ZVIA: Trimmed 52633 records to 35429 (keeping 200 days of data) [2025-09-30T22:04:05.658159] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35429 records). [2025-09-30T22:04:05.658330] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-30T22:04:05.658463] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZVIA took 21.7s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-09-30T22:04:06.433436] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-30T22:04:06.445893] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-30T22:04:06.874869] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T22:04:06.883807] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-30T22:04:08.277879] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T22:04:08.287299] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-30T22:04:08.389231] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T22:04:08.400978] [INFO ] [REMOTE ] ZTS: Full fetch complete (76697 records). [2025-09-30T22:04:08.401131] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-30T22:04:08.851332] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-30T22:04:08.851473] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-30T22:04:08.852822] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-30T22:04:08.852957] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-30T22:04:08.854754] [DEBUG] [LOCAL ] ZTS: Trimmed 76697 records to 52994 (keeping 200 days of data) [2025-09-30T22:04:09.212982] [DEBUG] [LOCAL ] ZTS: Primary data saved (52994 records). [2025-09-30T22:04:09.213154] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-30T22:04:09.213298] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 40.7s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-09-30T22:04:09.959386] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T22:04:09.970739] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-30T22:04:11.508263] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T22:04:11.518166] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-30T22:04:13.253495] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T22:04:13.263169] [INFO ] [REMOTE ] ZWS: Full fetch complete (62012 records). [2025-09-30T22:04:13.263330] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-30T22:04:13.674132] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-30T22:04:13.674240] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-30T22:04:13.675668] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-30T22:04:13.675750] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-30T22:04:13.677196] [DEBUG] [LOCAL ] ZWS: Trimmed 62012 records to 42322 (keeping 200 days of data) [2025-09-30T22:04:13.942291] [DEBUG] [LOCAL ] ZWS: Primary data saved (42322 records). [2025-09-30T22:04:13.942427] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-30T22:04:13.942520] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 28.5s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-09-30T22:04:13.946951] [INFO ] [MAIN ] Parallel update completed in 5h 4m 10s [2025-09-30T22:04:13.947172] [WARN ] [MAIN ] Failed symbols (362): AAMI, AAM, AAT, AAUC, AA, ABBV, ACI, ACR, AD, ADM... [2025-09-30T22:04:13.947253] [INFO ] [MAIN ] Update success rate: 84.7% (2009/2371 symbols) [2025-09-30T22:04:14.574518] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2009/2371 @ 84.73%)' [2025-09-30T22:04:14.575042] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-09-30T22:04:14.575120] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-30T22:04:14.575178] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-30T22:04:14.575286] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-30T22:04:14.575337] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-30T22:04:16.107891] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-30T22:04:16.108082] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-30T22:04:16.108335] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-30T22:04:16.109131] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-30T22:04:16.109193] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-30T22:04:16.109227] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-30T22:04:16.109285] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-30T22:04:16.109319] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-30T22:04:16.109360] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-30T22:04:16.110012] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-30T22:04:16.110081] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-30T22:04:16.110315] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-30T22:04:16.110369] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-30T22:04:16.110429] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-30T22:04:16.110502] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-30T22:04:16.139506] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-30T22:04:16.166620] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-30T22:04:16.166847] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-30T22:04:16.166897] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-30T22:04:16.166929] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-30T22:04:16.167012] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-30T22:04:16.167047] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-30T22:04:16.167084] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-30T22:04:16.168525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-30T22:04:16.168989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-30T22:04:16.169292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-30T22:04:16.169715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-30T22:04:16.170193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-30T22:04:16.170410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-30T22:04:16.170855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-30T22:04:16.171056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-30T22:04:16.171419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-30T22:04:16.171875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-30T22:04:16.172077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-30T22:04:16.172290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-30T22:04:16.172491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-30T22:04:16.172731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-30T22:04:16.172940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-30T22:04:16.173125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-30T22:04:16.173320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-30T22:04:16.173588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-30T22:04:16.173874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-30T22:04:16.174086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-30T22:04:16.174277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-30T22:04:16.174487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-30T22:04:16.174685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-30T22:04:16.174883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-30T22:04:16.175063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-30T22:04:16.175203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-30T22:04:16.175353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-30T22:04:16.175552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-30T22:04:16.175770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-30T22:04:16.176019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-30T22:04:16.176330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-30T22:04:16.176511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-30T22:04:16.176875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-30T22:04:16.177107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-30T22:04:16.177323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-30T22:04:16.177787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-30T22:04:16.177996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-30T22:04:16.178370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-30T22:04:16.178554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-30T22:04:16.178978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-30T22:04:16.179304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-30T22:04:16.179459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-30T22:04:16.179836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-30T22:04:16.180024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-30T22:04:16.180236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-30T22:04:16.180376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-30T22:04:16.180835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-30T22:04:16.181217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-30T22:04:16.181412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-30T22:04:16.181626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-30T22:04:16.181835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-30T22:04:16.182141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-30T22:04:16.182345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-30T22:04:16.182518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-30T22:04:16.182709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-30T22:04:16.182848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-30T22:04:16.183075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-30T22:04:16.183407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-30T22:04:16.183538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-30T22:04:16.183716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-30T22:04:16.183883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-30T22:04:16.184030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-30T22:04:16.184186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-30T22:04:16.184357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-30T22:04:16.184558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-30T22:04:16.184871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-30T22:04:16.185136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-30T22:04:16.185460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-30T22:04:16.185634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-30T22:04:16.186002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-30T22:04:16.186148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-30T22:04:16.186437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-30T22:04:16.186630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-30T22:04:16.186822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-30T22:04:16.186986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-30T22:04:16.187252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-30T22:04:16.187394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-30T22:04:16.187548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-30T22:04:16.187733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-30T22:04:16.188127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-30T22:04:16.188268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-30T22:04:16.188443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-30T22:04:16.188623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-30T22:04:16.188790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-30T22:04:16.188946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-30T22:04:16.189135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-30T22:04:16.189298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-30T22:04:16.189460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-30T22:04:16.189636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-30T22:04:16.189939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-30T22:04:16.190069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-30T22:04:16.190403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-30T22:04:16.190787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-30T22:04:16.190960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-30T22:04:16.191122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-30T22:04:16.191463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-30T22:04:16.191633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-30T22:04:16.191813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-30T22:04:16.191939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-30T22:04:16.192131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-30T22:04:16.192307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-30T22:04:16.192459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-30T22:04:16.192722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-30T22:04:16.192885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-30T22:04:16.193062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-30T22:04:16.193241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-30T22:04:16.193450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-30T22:04:16.193925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-30T22:04:16.194124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-30T22:04:16.194266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-30T22:04:16.194419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-30T22:04:16.194690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-30T22:04:16.194859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-30T22:04:16.195011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-30T22:04:16.195193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-30T22:04:16.195421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-30T22:04:16.195763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-30T22:04:16.196022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-30T22:04:16.196178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-30T22:04:16.196322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-30T22:04:16.196494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-30T22:04:16.196686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-30T22:04:16.196812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-30T22:04:16.197151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-30T22:04:16.197300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-30T22:04:16.197696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-30T22:04:16.198044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-30T22:04:16.198210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-30T22:04:16.198317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-30T22:04:16.198581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-30T22:04:16.198726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-30T22:04:16.198843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-30T22:04:16.199000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-30T22:04:16.199147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-30T22:04:16.199341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-30T22:04:16.199513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-30T22:04:16.199786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-30T22:04:16.200043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-30T22:04:16.200198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-30T22:04:16.200344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-30T22:04:16.200517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-30T22:04:16.200754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-30T22:04:16.201004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-30T22:04:16.201141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-30T22:04:16.201505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-30T22:04:16.201844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-30T22:04:16.202001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-30T22:04:16.202143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-30T22:04:16.202474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-30T22:04:16.202611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-30T22:04:16.202786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-30T22:04:16.202902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-30T22:04:16.203046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-30T22:04:16.203178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-30T22:04:16.203364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-30T22:04:16.203537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-30T22:04:16.203681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-30T22:04:16.203835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-30T22:04:16.204151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-30T22:04:16.204269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-30T22:04:16.204414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-30T22:04:16.204544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-30T22:04:16.204728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-30T22:04:16.204890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-30T22:04:16.205053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-30T22:04:16.205187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-30T22:04:16.205441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-30T22:04:16.205567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-30T22:04:16.205840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-30T22:04:16.205982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-30T22:04:16.206271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-30T22:04:16.206417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-30T22:04:16.206697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-30T22:04:16.206865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-30T22:04:16.207050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-30T22:04:16.207214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-30T22:04:16.207369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-30T22:04:16.207508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-30T22:04:16.207858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-30T22:04:16.207997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-30T22:04:16.208160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-30T22:04:16.208500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-30T22:04:16.208691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-30T22:04:16.208832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-30T22:04:16.208966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-30T22:04:16.209127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-30T22:04:16.209267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-30T22:04:16.209597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-30T22:04:16.209983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-30T22:04:16.210132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-30T22:04:16.210299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-30T22:04:16.210578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-30T22:04:16.210756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-30T22:04:16.210898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-30T22:04:16.211028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-30T22:04:16.211177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-30T22:04:16.211334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-30T22:04:16.211469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-30T22:04:16.211612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-30T22:04:16.211800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-30T22:04:16.211918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-30T22:04:16.212252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-30T22:04:16.212369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-30T22:04:16.212479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-30T22:04:16.212589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-30T22:04:16.212743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-30T22:04:16.212883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-30T22:04:16.213145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-30T22:04:16.213309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-30T22:04:16.213675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-30T22:04:16.213820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-30T22:04:16.213980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-30T22:04:16.214250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-30T22:04:16.214371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-30T22:04:16.214492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-30T22:04:16.214772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-30T22:04:16.215098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-30T22:04:16.215265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-30T22:04:16.215472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-30T22:04:16.215616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-30T22:04:16.215804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-30T22:04:16.215914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-30T22:04:16.216309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-30T22:04:16.216425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-30T22:04:16.216584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-30T22:04:16.216966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-30T22:04:16.217131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-30T22:04:16.217234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-30T22:04:16.217379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-30T22:04:16.217919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-30T22:04:16.218202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-30T22:04:16.218334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-30T22:04:16.218479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-30T22:04:16.218793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-30T22:04:16.218945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-30T22:04:16.219158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-30T22:04:16.219395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-30T22:04:16.219559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-30T22:04:16.219712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-30T22:04:16.219839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-30T22:04:16.219993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-30T22:04:16.220128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-30T22:04:16.220284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-30T22:04:16.220440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-30T22:04:16.220584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-30T22:04:16.220952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-30T22:04:16.221330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-30T22:04:16.221448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-30T22:04:16.221803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-30T22:04:16.221934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-30T22:04:16.222110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-30T22:04:16.222249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-30T22:04:16.222409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-30T22:04:16.222542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-30T22:04:16.222686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-30T22:04:16.222824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-30T22:04:16.223101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-30T22:04:16.223275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-30T22:04:16.223637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-30T22:04:16.223814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-30T22:04:16.223931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-30T22:04:16.224082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-30T22:04:16.224772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-30T22:04:16.225007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-30T22:04:16.225139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-30T22:04:16.225371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-30T22:04:16.225505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-30T22:04:16.225866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-30T22:04:16.226015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-30T22:04:16.226174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-30T22:04:16.226309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-30T22:04:16.226676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-30T22:04:16.226774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-30T22:04:16.227055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-30T22:04:16.227173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-30T22:04:16.227706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-30T22:04:16.228148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-30T22:04:16.228316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-30T22:04:16.228455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-30T22:04:16.228583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-30T22:04:16.229042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-30T22:04:16.229175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-30T22:04:16.229290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-30T22:04:16.229439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-30T22:04:16.229555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-30T22:04:16.229711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-30T22:04:16.229843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-30T22:04:16.229977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-30T22:04:16.230202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-30T22:04:16.230353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-30T22:04:16.230537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-30T22:04:16.230839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-30T22:04:16.230965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-30T22:04:16.231127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-30T22:04:16.231249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-30T22:04:16.231411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-30T22:04:16.231612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-30T22:04:16.231829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-30T22:04:16.232197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-30T22:04:16.232375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-30T22:04:16.232485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-30T22:04:16.232613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-30T22:04:16.233178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-30T22:04:16.233342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-30T22:04:16.233502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-30T22:04:16.233635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-30T22:04:16.233865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-30T22:04:16.233997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-30T22:04:16.234135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-30T22:04:16.234439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-30T22:04:16.234565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-30T22:04:16.234710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-30T22:04:16.234833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-30T22:04:16.234987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-30T22:04:16.235232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-30T22:04:16.235408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-30T22:04:16.235635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-30T22:04:16.235777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-30T22:04:16.235905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-30T22:04:16.236198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-30T22:04:16.236336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-30T22:04:16.236485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-30T22:04:16.236626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-30T22:04:16.236796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-30T22:04:16.236956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-30T22:04:16.237118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-30T22:04:16.237221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-30T22:04:16.237324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-30T22:04:16.237443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-30T22:04:16.237559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-30T22:04:16.237700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-30T22:04:16.237810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-30T22:04:16.237970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-30T22:04:16.238104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-30T22:04:16.238471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-30T22:04:16.238663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-30T22:04:16.238972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-30T22:04:16.239120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-30T22:04:16.239239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-30T22:04:16.239451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-30T22:04:16.239559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-30T22:04:16.239753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-30T22:04:16.239888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-30T22:04:16.240147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-30T22:04:16.240281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-30T22:04:16.240424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-30T22:04:16.240545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-30T22:04:16.240682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-30T22:04:16.240953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-30T22:04:16.241078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-30T22:04:16.241298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-30T22:04:16.241513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-30T22:04:16.241629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-30T22:04:16.241885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-30T22:04:16.242145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-30T22:04:16.242265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-30T22:04:16.242416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-30T22:04:16.242529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-30T22:04:16.242702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-30T22:04:16.242837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-30T22:04:16.242967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-30T22:04:16.243290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-30T22:04:16.243676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-30T22:04:16.243845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-30T22:04:16.243976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-30T22:04:16.244134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-30T22:04:16.244251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-30T22:04:16.244401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-30T22:04:16.244523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-30T22:04:16.244683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-30T22:04:16.244803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-30T22:04:16.244943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-30T22:04:16.245166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-30T22:04:16.245320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-30T22:04:16.245427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-30T22:04:16.245568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-30T22:04:16.245879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-30T22:04:16.246027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-30T22:04:16.246169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-30T22:04:16.246303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-30T22:04:16.246592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-30T22:04:16.246768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-30T22:04:16.246903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-30T22:04:16.247202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-30T22:04:16.247382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-30T22:04:16.247490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-30T22:04:16.247622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-30T22:04:16.247763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-30T22:04:16.248054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-30T22:04:16.248282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-30T22:04:16.248431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-30T22:04:16.248753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-30T22:04:16.248881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-30T22:04:16.249023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-30T22:04:16.249130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-30T22:04:16.249260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-30T22:04:16.249507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-30T22:04:16.249637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-30T22:04:16.249954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-30T22:04:16.250091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-30T22:04:16.250219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-30T22:04:16.250351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-30T22:04:16.250469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-30T22:04:16.250752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-30T22:04:16.250915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-30T22:04:16.251044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-30T22:04:16.251169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-30T22:04:16.251290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-30T22:04:16.251536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-30T22:04:16.251690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-30T22:04:16.251901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-30T22:04:16.252020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-30T22:04:16.252167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-30T22:04:16.252293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-30T22:04:16.252449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-30T22:04:16.252581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-30T22:04:16.252745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-30T22:04:16.253021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-30T22:04:16.253263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-30T22:04:16.253390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-30T22:04:16.253519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-30T22:04:16.253745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-30T22:04:16.254090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-30T22:04:16.254221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-30T22:04:16.254334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-30T22:04:16.254606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-30T22:04:16.254849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-30T22:04:16.254996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-30T22:04:16.255176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-30T22:04:16.255280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-30T22:04:16.255610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-30T22:04:16.255766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-30T22:04:16.255925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-30T22:04:16.256160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-30T22:04:16.256268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-30T22:04:16.256492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-30T22:04:16.256637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-30T22:04:16.256813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-30T22:04:16.256905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-30T22:04:16.257072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-30T22:04:16.257438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-30T22:04:16.257785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-30T22:04:16.257903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-30T22:04:16.261677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-30T22:04:16.261820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-30T22:04:16.262089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-30T22:04:16.262349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-30T22:04:16.262473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-30T22:04:16.262573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-30T22:04:16.262717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-30T22:04:16.262848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-30T22:04:16.263031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-30T22:04:16.263205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-30T22:04:16.263430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-30T22:04:16.263719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-30T22:04:16.263893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-30T22:04:16.264057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-30T22:04:16.264363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-30T22:04:16.264628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-30T22:04:16.264787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-30T22:04:16.264921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-30T22:04:16.265045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-30T22:04:16.265145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-30T22:04:16.265244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-30T22:04:16.265365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-30T22:04:16.265476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-30T22:04:16.265594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-30T22:04:16.265977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-30T22:04:16.266310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-30T22:04:16.266432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-30T22:04:16.266564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-30T22:04:16.266695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-30T22:04:16.266839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-30T22:04:16.267099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-30T22:04:16.267243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-30T22:04:16.267368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-30T22:04:16.267502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-30T22:04:16.267630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-30T22:04:16.267769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-30T22:04:16.267864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-30T22:04:16.268193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-30T22:04:16.268368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-30T22:04:16.268484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-30T22:04:16.268600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-30T22:04:16.268785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-30T22:04:16.269037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-30T22:04:16.269149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-30T22:04:16.269287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-30T22:04:16.269424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-30T22:04:16.269567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-30T22:04:16.269706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-30T22:04:16.269836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-30T22:04:16.270006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-30T22:04:16.270330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-30T22:04:16.270801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-30T22:04:16.270924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-30T22:04:16.271107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-30T22:04:16.271244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-30T22:04:16.271497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-30T22:04:16.271671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-30T22:04:16.271866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-30T22:04:16.272116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-30T22:04:16.272264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-30T22:04:16.272370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-30T22:04:16.272700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-30T22:04:16.272835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-30T22:04:16.272956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-30T22:04:16.273065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-30T22:04:16.273187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-30T22:04:16.273293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-30T22:04:16.273409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-30T22:04:16.273524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-30T22:04:16.273829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-30T22:04:16.273989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-30T22:04:16.274166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-30T22:04:16.274378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-30T22:04:16.274494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-30T22:04:16.274791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-30T22:04:16.275002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-30T22:04:16.275116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-30T22:04:16.275265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-30T22:04:16.275411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-30T22:04:16.275531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-30T22:04:16.275698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-30T22:04:16.275856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-30T22:04:16.276075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-30T22:04:16.276321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-30T22:04:16.276596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-30T22:04:16.276937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-30T22:04:16.277069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-30T22:04:16.277299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-30T22:04:16.277428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-30T22:04:16.277566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-30T22:04:16.277709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-30T22:04:16.277815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-30T22:04:16.277932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-30T22:04:16.278076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-30T22:04:16.278203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-30T22:04:16.278328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-30T22:04:16.278460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-30T22:04:16.278746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-30T22:04:16.279045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-30T22:04:16.279203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-30T22:04:16.279455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-30T22:04:16.279712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-30T22:04:16.279955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-30T22:04:16.280071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-30T22:04:16.280186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-30T22:04:16.280402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-30T22:04:16.280724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-30T22:04:16.280868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-30T22:04:16.281015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-30T22:04:16.281143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-30T22:04:16.281299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-30T22:04:16.281427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-30T22:04:16.281526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-30T22:04:16.281892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-30T22:04:16.282208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-30T22:04:16.282322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-30T22:04:16.282432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-30T22:04:16.282543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-30T22:04:16.282662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-30T22:04:16.282795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-30T22:04:16.282974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-30T22:04:16.283081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-30T22:04:16.283186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-30T22:04:16.283368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-30T22:04:16.283479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-30T22:04:16.283592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-30T22:04:16.283731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-30T22:04:16.283888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-30T22:04:16.283998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-30T22:04:16.284113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-30T22:04:16.284281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-30T22:04:16.284496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-30T22:04:16.284755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-30T22:04:16.284870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-30T22:04:16.284972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-30T22:04:16.285214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-30T22:04:16.285348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-30T22:04:16.285455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-30T22:04:16.285576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-30T22:04:16.285800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-30T22:04:16.285905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-30T22:04:16.286050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-30T22:04:16.286308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-30T22:04:16.286572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-30T22:04:16.286796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-30T22:04:16.286989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-30T22:04:16.287105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-30T22:04:16.287210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-30T22:04:16.287333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-30T22:04:16.287446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-30T22:04:16.287672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-30T22:04:16.287779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-30T22:04:16.287903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-30T22:04:16.288061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-30T22:04:16.288318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-30T22:04:16.288431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-30T22:04:16.288690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-30T22:04:16.288804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-30T22:04:16.288930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-30T22:04:16.289071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-30T22:04:16.289168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-30T22:04:16.289269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-30T22:04:16.289495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-30T22:04:16.289810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-30T22:04:16.289940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-30T22:04:16.290197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-30T22:04:16.290310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-30T22:04:16.290495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-30T22:04:16.290673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-30T22:04:16.290900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-30T22:04:16.291102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-30T22:04:16.291229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-30T22:04:16.291334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-30T22:04:16.291438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-30T22:04:16.291549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-30T22:04:16.291704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-30T22:04:16.291819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-30T22:04:16.291930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-30T22:04:16.292153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-30T22:04:16.292385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-30T22:04:16.292513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-30T22:04:16.292670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-30T22:04:16.292857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-30T22:04:16.292997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-30T22:04:16.293182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-30T22:04:16.293291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-30T22:04:16.293799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-30T22:04:16.293902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-30T22:04:16.294152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-30T22:04:16.294286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-30T22:04:16.294490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-30T22:04:16.294590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-30T22:04:16.294757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-30T22:04:16.294930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-30T22:04:16.295052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-30T22:04:16.295204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-30T22:04:16.295424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-30T22:04:16.295638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-30T22:04:16.295910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-30T22:04:16.296033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-30T22:04:16.296162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-30T22:04:16.296288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-30T22:04:16.296408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-30T22:04:16.296625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-30T22:04:16.296792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-30T22:04:16.296903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-30T22:04:16.297014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-30T22:04:16.297145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-30T22:04:16.297264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-30T22:04:16.297373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-30T22:04:16.297497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-30T22:04:16.297598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-30T22:04:16.297798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-30T22:04:16.297939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-30T22:04:16.298104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-30T22:04:16.298199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-30T22:04:16.298386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-30T22:04:16.298666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-30T22:04:16.298798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-30T22:04:16.298891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-30T22:04:16.299010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-30T22:04:16.299134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-30T22:04:16.299388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-30T22:04:16.299525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-30T22:04:16.299662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-30T22:04:16.299787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-30T22:04:16.299989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-30T22:04:16.300213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-30T22:04:16.300325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-30T22:04:16.300430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-30T22:04:16.300779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-30T22:04:16.301011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-30T22:04:16.301139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-30T22:04:16.301251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-30T22:04:16.301446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-30T22:04:16.301611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-30T22:04:16.301752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-30T22:04:16.301863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-30T22:04:16.302017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-30T22:04:16.302152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-30T22:04:16.302276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-30T22:04:16.302378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-30T22:04:16.302679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-30T22:04:16.302933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-30T22:04:16.303043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-30T22:04:16.303145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-30T22:04:16.303475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-30T22:04:16.303596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-30T22:04:16.303761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-30T22:04:16.304014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-30T22:04:16.304245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-30T22:04:16.304350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-30T22:04:16.304520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-30T22:04:16.304694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-30T22:04:16.304895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-30T22:04:16.305027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-30T22:04:16.305237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-30T22:04:16.305422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-30T22:04:16.305535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-30T22:04:16.305752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-30T22:04:16.305868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-30T22:04:16.305963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-30T22:04:16.306038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-30T22:04:16.306117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-30T22:04:16.306223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-30T22:04:16.306323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-30T22:04:16.306886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-30T22:04:16.306986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-30T22:04:16.307267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-30T22:04:16.307386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-30T22:04:16.307594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-30T22:04:16.307743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-30T22:04:16.307853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-30T22:04:16.308001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-30T22:04:16.308201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-30T22:04:16.308472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-30T22:04:16.308788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-30T22:04:16.308998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-30T22:04:16.309110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-30T22:04:16.309239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-30T22:04:16.309359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-30T22:04:16.309467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-30T22:04:16.309596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-30T22:04:16.309752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-30T22:04:16.309852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-30T22:04:16.310017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-30T22:04:16.310201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-30T22:04:16.310402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-30T22:04:16.310581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-30T22:04:16.310715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-30T22:04:16.310958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-30T22:04:16.311199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-30T22:04:16.311435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-30T22:04:16.311800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-30T22:04:16.311912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-30T22:04:16.312005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-30T22:04:16.312184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-30T22:04:16.312301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-30T22:04:16.312607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-30T22:04:16.312762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-30T22:04:16.312884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-30T22:04:16.312999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-30T22:04:16.313130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-30T22:04:16.313268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-30T22:04:16.313373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-30T22:04:16.313480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-30T22:04:16.313578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-30T22:04:16.313925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-30T22:04:16.314045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-30T22:04:16.314178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-30T22:04:16.314731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-30T22:04:16.314853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-30T22:04:16.315061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-30T22:04:16.315176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-30T22:04:16.315297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-30T22:04:16.315473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-30T22:04:16.315730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-30T22:04:16.315986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-30T22:04:16.316149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-30T22:04:16.316414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-30T22:04:16.316531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-30T22:04:16.316681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-30T22:04:16.316777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-30T22:04:16.316890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-30T22:04:16.317050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-30T22:04:16.317174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-30T22:04:16.317282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-30T22:04:16.317413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-30T22:04:16.317521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-30T22:04:16.317787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-30T22:04:16.317914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-30T22:04:16.318034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-30T22:04:16.318139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-30T22:04:16.318313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-30T22:04:16.318496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-30T22:04:16.318713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-30T22:04:16.318858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-30T22:04:16.318962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-30T22:04:16.319099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-30T22:04:16.319230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-30T22:04:16.319437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-30T22:04:16.319588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-30T22:04:16.319883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-30T22:04:16.320169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-30T22:04:16.320360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-30T22:04:16.320484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-30T22:04:16.320621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-30T22:04:16.320810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-30T22:04:16.320936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-30T22:04:16.321228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-30T22:04:16.321335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-30T22:04:16.321540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-30T22:04:16.321733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-30T22:04:16.321872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-30T22:04:16.321992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-30T22:04:16.322218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-30T22:04:16.322347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-30T22:04:16.322470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-30T22:04:16.322565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-30T22:04:16.322633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-30T22:04:16.322755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-30T22:04:16.322916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-30T22:04:16.323038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-30T22:04:16.323166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-30T22:04:16.323393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-30T22:04:16.323503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-30T22:04:16.323613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-30T22:04:16.323790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-30T22:04:16.323929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-30T22:04:16.324043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-30T22:04:16.324168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-30T22:04:16.324278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-30T22:04:16.324391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-30T22:04:16.324522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-30T22:04:16.324785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-30T22:04:16.324960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-30T22:04:16.325093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-30T22:04:16.325223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-30T22:04:16.325318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-30T22:04:16.325435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-30T22:04:16.325658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-30T22:04:16.325959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-30T22:04:16.326211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-30T22:04:16.326338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-30T22:04:16.326686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-30T22:04:16.326812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-30T22:04:16.327104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-30T22:04:16.327354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-30T22:04:16.327479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-30T22:04:16.327612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-30T22:04:16.327760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-30T22:04:16.328038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-30T22:04:16.328157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-30T22:04:16.328291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-30T22:04:16.328421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-30T22:04:16.328716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-30T22:04:16.328923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-30T22:04:16.329078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-30T22:04:16.329331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-30T22:04:16.329457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-30T22:04:16.329591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-30T22:04:16.329830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-30T22:04:16.329961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-30T22:04:16.330251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-30T22:04:16.330389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-30T22:04:16.330610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-30T22:04:16.330783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-30T22:04:16.330895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-30T22:04:16.331006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-30T22:04:16.331274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-30T22:04:16.331513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-30T22:04:16.331669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-30T22:04:16.331965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-30T22:04:16.332077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-30T22:04:16.332299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-30T22:04:16.332485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-30T22:04:16.332606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-30T22:04:16.332740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-30T22:04:16.332930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-30T22:04:16.333049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-30T22:04:16.333222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-30T22:04:16.333373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-30T22:04:16.333503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-30T22:04:16.333669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-30T22:04:16.333795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-30T22:04:16.334044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-30T22:04:16.334248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-30T22:04:16.334469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-30T22:04:16.334614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-30T22:04:16.334757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-30T22:04:16.334885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-30T22:04:16.334989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-30T22:04:16.335130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-30T22:04:16.335252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-30T22:04:16.335379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-30T22:04:16.335581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-30T22:04:16.335766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-30T22:04:16.335866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-30T22:04:16.336007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-30T22:04:16.336112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-30T22:04:16.336241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-30T22:04:16.336363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-30T22:04:16.336513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-30T22:04:16.336791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-30T22:04:16.336909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-30T22:04:16.337221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-30T22:04:16.337334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-30T22:04:16.337443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-30T22:04:16.337545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-30T22:04:16.337751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-30T22:04:16.337989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-30T22:04:16.338093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-30T22:04:16.338187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-30T22:04:16.338312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-30T22:04:16.338439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-30T22:04:16.338737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-30T22:04:16.338936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-30T22:04:16.339057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-30T22:04:16.339282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-30T22:04:16.339603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-30T22:04:16.339759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-30T22:04:16.340036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-30T22:04:16.340130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-30T22:04:16.340205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-30T22:04:16.340481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-30T22:04:16.340579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-30T22:04:16.340875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-30T22:04:16.341063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-30T22:04:16.341299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-30T22:04:16.341410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-30T22:04:16.341499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-30T22:04:16.341724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-30T22:04:16.341832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-30T22:04:16.342040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-30T22:04:16.342237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-30T22:04:16.342375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-30T22:04:16.342477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-30T22:04:16.342696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-30T22:04:16.342809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-30T22:04:16.342939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-30T22:04:16.343147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-30T22:04:16.343261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-30T22:04:16.343373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-30T22:04:16.343610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-30T22:04:16.343758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-30T22:04:16.344041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-30T22:04:16.344151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-30T22:04:16.344268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-30T22:04:16.344367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-30T22:04:16.344470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-30T22:04:16.344779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-30T22:04:16.345018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-30T22:04:16.345276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-30T22:04:16.345379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-30T22:04:16.345563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-30T22:04:16.345783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-30T22:04:16.346014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-30T22:04:16.346117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-30T22:04:16.346371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-30T22:04:16.346497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-30T22:04:16.346636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-30T22:04:16.346894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-30T22:04:16.347009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-30T22:04:16.347106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-30T22:04:16.347185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-30T22:04:16.347283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-30T22:04:16.347407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-30T22:04:16.347519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-30T22:04:16.347661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-30T22:04:16.347846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-30T22:04:16.348007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-30T22:04:16.348126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-30T22:04:16.348230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-30T22:04:16.348337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-30T22:04:16.348438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-30T22:04:16.348552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-30T22:04:16.348931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-30T22:04:16.349040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-30T22:04:16.349196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-30T22:04:16.349323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-30T22:04:16.349529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-30T22:04:16.349737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-30T22:04:16.349837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-30T22:04:16.349929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-30T22:04:16.350143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-30T22:04:16.350258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-30T22:04:16.350378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-30T22:04:16.350504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-30T22:04:16.350613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-30T22:04:16.350743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-30T22:04:16.350835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-30T22:04:16.350923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-30T22:04:16.351047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-30T22:04:16.351257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-30T22:04:16.351541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-30T22:04:16.351697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-30T22:04:16.351835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-30T22:04:16.352019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-30T22:04:16.352157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-30T22:04:16.352284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-30T22:04:16.352422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-30T22:04:16.352546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-30T22:04:16.352691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-30T22:04:16.352873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-30T22:04:16.352981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-30T22:04:16.353090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-30T22:04:16.353185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-30T22:04:16.353349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-30T22:04:16.353501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-30T22:04:16.353787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-30T22:04:16.353961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-30T22:04:16.354054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-30T22:04:16.354180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-30T22:04:16.354388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-30T22:04:16.354483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-30T22:04:16.354567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-30T22:04:16.354757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-30T22:04:16.354961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-30T22:04:16.355117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-30T22:04:16.355286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-30T22:04:16.355418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-30T22:04:16.355540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-30T22:04:16.355782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-30T22:04:16.356015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-30T22:04:16.356173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-30T22:04:16.356298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-30T22:04:16.356530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-30T22:04:16.356796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-30T22:04:16.356900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-30T22:04:16.356986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-30T22:04:16.357097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-30T22:04:16.357325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-30T22:04:16.357598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-30T22:04:16.357827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-30T22:04:16.357970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-30T22:04:16.358077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-30T22:04:16.358172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-30T22:04:16.358271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-30T22:04:16.358539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-30T22:04:16.358685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-30T22:04:16.358948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-30T22:04:16.359199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-30T22:04:16.359296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-30T22:04:16.359394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-30T22:04:16.359588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-30T22:04:16.359746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-30T22:04:16.359889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-30T22:04:16.360009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-30T22:04:16.360152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-30T22:04:16.360251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-30T22:04:16.360348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-30T22:04:16.360458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-30T22:04:16.360567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-30T22:04:16.360806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-30T22:04:16.360939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-30T22:04:16.361044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-30T22:04:16.361132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-30T22:04:16.361303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-30T22:04:16.361417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-30T22:04:16.361530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-30T22:04:16.361740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-30T22:04:16.361854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-30T22:04:16.361982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-30T22:04:16.362122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-30T22:04:16.362227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-30T22:04:16.362342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-30T22:04:16.362569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-30T22:04:16.362832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-30T22:04:16.363065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-30T22:04:16.363172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-30T22:04:16.363302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-30T22:04:16.363411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-30T22:04:16.363567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-30T22:04:16.363690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-30T22:04:16.363797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-30T22:04:16.363894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-30T22:04:16.364113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-30T22:04:16.364303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-30T22:04:16.364451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-30T22:04:16.364550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-30T22:04:16.364618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-30T22:04:16.364846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-30T22:04:16.365074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-30T22:04:16.365305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-30T22:04:16.365441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-30T22:04:16.365549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-30T22:04:16.365785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-30T22:04:16.365897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-30T22:04:16.366005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-30T22:04:16.366419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-30T22:04:16.366538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-30T22:04:16.366663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-30T22:04:16.366788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-30T22:04:16.366898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-30T22:04:16.367009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-30T22:04:16.367101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-30T22:04:16.367178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-30T22:04:16.367274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-30T22:04:16.367382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-30T22:04:16.367474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-30T22:04:16.367567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-30T22:04:16.367707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-30T22:04:16.367868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-30T22:04:16.368067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-30T22:04:16.368172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-30T22:04:16.368349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-30T22:04:16.368493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-30T22:04:16.368592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-30T22:04:16.368815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-30T22:04:16.369046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-30T22:04:16.369212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-30T22:04:16.369378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-30T22:04:16.369597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-30T22:04:16.369833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-30T22:04:16.369959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-30T22:04:16.370172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-30T22:04:16.370314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-30T22:04:16.370418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-30T22:04:16.370604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-30T22:04:16.370731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-30T22:04:16.370873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-30T22:04:16.371092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-30T22:04:16.371237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-30T22:04:16.371342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-30T22:04:16.371432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-30T22:04:16.371622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-30T22:04:16.371768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-30T22:04:16.371927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-30T22:04:16.372047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-30T22:04:16.372190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-30T22:04:16.372392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-30T22:04:16.372492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-30T22:04:16.372691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-30T22:04:16.372874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-30T22:04:16.372998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-30T22:04:16.373141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-30T22:04:16.373246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-30T22:04:16.373379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-30T22:04:16.373576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-30T22:04:16.373772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-30T22:04:16.373886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-30T22:04:16.374092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-30T22:04:16.374198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-30T22:04:16.374297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-30T22:04:16.374413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-30T22:04:16.374506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-30T22:04:16.374816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-30T22:04:16.374941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-30T22:04:16.375081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-30T22:04:16.375183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-30T22:04:16.375381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-30T22:04:16.375533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-30T22:04:16.375629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-30T22:04:16.375763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-30T22:04:16.375875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-30T22:04:16.375979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-30T22:04:16.376105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-30T22:04:16.376205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-30T22:04:16.376313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-30T22:04:16.376411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-30T22:04:16.376631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-30T22:04:16.376871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-30T22:04:16.376981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-30T22:04:16.377089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-30T22:04:16.377204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-30T22:04:16.377273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-30T22:04:16.377338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-30T22:04:16.377402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-30T22:04:16.377474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-30T22:04:16.377579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-30T22:04:16.377810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-30T22:04:16.377939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-30T22:04:16.378107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-30T22:04:16.378202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-30T22:04:16.378312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-30T22:04:16.378421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-30T22:04:16.378555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-30T22:04:16.378689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-30T22:04:16.378789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-30T22:04:16.378894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-30T22:04:16.379035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-30T22:04:16.379139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-30T22:04:16.379418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-30T22:04:16.379557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-30T22:04:16.379699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-30T22:04:16.379812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-30T22:04:16.379918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-30T22:04:16.380021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-30T22:04:16.380126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-30T22:04:16.380236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-30T22:04:16.380373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-30T22:04:16.380550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-30T22:04:16.380699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-30T22:04:16.380925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-30T22:04:16.381168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-30T22:04:16.381293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-30T22:04:16.381429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-30T22:04:16.381559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-30T22:04:16.381739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-30T22:04:16.381860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-30T22:04:16.381981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-30T22:04:16.382111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-30T22:04:16.382280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-30T22:04:16.382407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-30T22:04:16.382505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-30T22:04:16.382577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-30T22:04:16.382751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-30T22:04:16.382845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-30T22:04:16.382938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-30T22:04:16.383045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-30T22:04:16.383171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-30T22:04:16.383290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-30T22:04:16.383400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-30T22:04:16.383490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-30T22:04:16.383559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-30T22:04:16.383669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-30T22:04:16.383794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-30T22:04:16.383886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-30T22:04:16.383953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-30T22:04:16.384155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-30T22:04:16.384261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-30T22:04:16.384448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-30T22:04:16.384544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-30T22:04:16.384721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-30T22:04:16.384814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-30T22:04:16.384894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-30T22:04:16.384998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-30T22:04:16.385100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-30T22:04:16.385205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-30T22:04:16.385351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-30T22:04:16.385455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-30T22:04:16.385633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-30T22:04:16.385839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-30T22:04:16.386041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-30T22:04:16.386280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-30T22:04:16.386482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-30T22:04:16.386611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-30T22:04:16.386767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-30T22:04:16.386887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-30T22:04:16.387018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-30T22:04:16.387120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-30T22:04:16.387264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-30T22:04:16.387503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-30T22:04:16.387750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-30T22:04:16.387856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-30T22:04:16.388089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-30T22:04:16.388184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-30T22:04:16.388297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-30T22:04:16.388388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-30T22:04:16.388455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-30T22:04:16.388518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-30T22:04:16.388668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-30T22:04:16.388914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-30T22:04:16.389063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-30T22:04:16.389174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-30T22:04:16.389305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-30T22:04:16.389463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-30T22:04:16.389574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-30T22:04:16.389699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-30T22:04:16.389881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-30T22:04:16.390002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-30T22:04:16.390135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-30T22:04:16.390251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-30T22:04:16.390375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-30T22:04:16.390483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-30T22:04:16.390714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-30T22:04:16.390936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-30T22:04:16.391043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-30T22:04:16.391132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-30T22:04:16.391258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-30T22:04:16.391529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-30T22:04:16.391626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-30T22:04:16.391827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-30T22:04:16.391932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-30T22:04:16.392051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-30T22:04:16.392236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-30T22:04:16.392374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-30T22:04:16.392559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-30T22:04:16.392774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-30T22:04:16.392895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-30T22:04:16.393077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-30T22:04:16.393204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-30T22:04:16.393368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-30T22:04:16.393548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-30T22:04:16.393772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-30T22:04:16.393912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-30T22:04:16.394011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-30T22:04:16.394148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-30T22:04:16.394346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-30T22:04:16.394495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-30T22:04:16.394613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-30T22:04:16.394775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-30T22:04:16.394869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-30T22:04:16.395042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-30T22:04:16.395168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-30T22:04:16.395319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-30T22:04:16.395439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-30T22:04:16.395564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-30T22:04:16.395683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-30T22:04:16.395946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-30T22:04:16.396058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-30T22:04:16.396205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-30T22:04:16.396304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-30T22:04:16.396508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-30T22:04:16.396626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-30T22:04:16.396803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-30T22:04:16.396893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-30T22:04:16.396972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-30T22:04:16.397076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-30T22:04:16.397176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-30T22:04:16.397414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-30T22:04:16.397567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-30T22:04:16.397803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-30T22:04:16.397926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-30T22:04:16.398059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-30T22:04:16.398180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-30T22:04:16.398280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-30T22:04:16.398373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-30T22:04:16.398488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-30T22:04:16.398600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-30T22:04:16.398751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-30T22:04:16.398843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-30T22:04:16.399002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-30T22:04:16.399125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-30T22:04:16.399268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-30T22:04:16.399385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-30T22:04:16.399597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-30T22:04:16.399791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-30T22:04:16.399993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-30T22:04:16.400167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-30T22:04:16.400404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-30T22:04:16.400510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-30T22:04:16.400609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-30T22:04:16.400759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-30T22:04:16.400879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-30T22:04:16.400972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-30T22:04:16.401069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-30T22:04:16.401216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-30T22:04:16.401443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-30T22:04:16.401539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-30T22:04:16.401609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-30T22:04:16.401832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-30T22:04:16.402033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-30T22:04:16.402158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-30T22:04:16.402271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-30T22:04:16.402395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-30T22:04:16.402553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-30T22:04:16.402853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-30T22:04:16.403066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-30T22:04:16.403193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-30T22:04:16.403298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-30T22:04:16.403448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-30T22:04:16.403562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-30T22:04:16.403696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-30T22:04:16.403965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-30T22:04:16.404077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-30T22:04:16.404184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-30T22:04:16.404322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-30T22:04:16.404439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-30T22:04:16.404549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-30T22:04:16.404711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-30T22:04:16.404811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-30T22:04:16.404948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-30T22:04:16.405099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-30T22:04:16.405207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-30T22:04:16.405326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-30T22:04:16.405481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-30T22:04:16.405727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-30T22:04:16.405921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-30T22:04:16.406026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-30T22:04:16.406167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-30T22:04:16.406278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-30T22:04:16.406369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-30T22:04:16.406551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-30T22:04:16.406783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-30T22:04:16.406920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-30T22:04:16.407056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-30T22:04:16.407253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-30T22:04:16.407370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-30T22:04:16.407475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-30T22:04:16.407564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-30T22:04:16.407630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-30T22:04:16.407740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-30T22:04:16.407812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-30T22:04:16.407925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-30T22:04:16.408190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-30T22:04:16.408282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-30T22:04:16.408375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-30T22:04:16.408486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-30T22:04:16.408579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-30T22:04:16.408872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-30T22:04:16.409001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-30T22:04:16.409153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-30T22:04:16.409255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-30T22:04:16.409377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-30T22:04:16.409543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-30T22:04:16.409773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-30T22:04:16.409985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-30T22:04:16.410087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-30T22:04:16.410308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-30T22:04:16.410547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-30T22:04:16.410711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-30T22:04:16.410830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-30T22:04:16.410924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-30T22:04:16.411018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-30T22:04:16.411205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-30T22:04:16.411345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-30T22:04:16.411471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-30T22:04:16.411736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-30T22:04:16.411852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-30T22:04:16.412020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-30T22:04:16.412135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-30T22:04:16.412350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-30T22:04:16.412444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-30T22:04:16.412527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-30T22:04:16.412630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-30T22:04:16.412777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-30T22:04:16.412868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-30T22:04:16.412960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-30T22:04:16.413026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-30T22:04:16.413202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-30T22:04:16.413366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-30T22:04:16.413494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-30T22:04:16.413589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-30T22:04:16.413685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-30T22:04:16.413790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-30T22:04:16.413874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-30T22:04:16.414172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-30T22:04:16.414393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-30T22:04:16.414562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-30T22:04:16.414718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-30T22:04:16.414808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-30T22:04:16.414949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-30T22:04:16.415049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-30T22:04:16.415136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-30T22:04:16.415249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-30T22:04:16.415371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-30T22:04:16.415605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-30T22:04:16.415771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-30T22:04:16.415895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-30T22:04:16.416089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-30T22:04:16.416295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-30T22:04:16.416442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-30T22:04:16.416612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-30T22:04:16.416784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-30T22:04:16.416941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-30T22:04:16.417056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-30T22:04:16.417145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-30T22:04:16.417260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-30T22:04:16.417452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-30T22:04:16.417575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-30T22:04:16.417808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-30T22:04:16.417904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-30T22:04:16.418024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-30T22:04:16.418146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-30T22:04:16.418244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-30T22:04:16.418312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-30T22:04:16.418379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-30T22:04:16.418533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-30T22:04:16.418629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-30T22:04:16.418828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-30T22:04:16.418990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-30T22:04:16.419118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-30T22:04:16.419320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-30T22:04:16.419424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-30T22:04:16.419749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-30T22:04:16.419940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-30T22:04:16.420035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-30T22:04:16.420164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-30T22:04:16.420335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-30T22:04:16.420441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-30T22:04:16.420556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-30T22:04:16.420693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-30T22:04:16.420797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-30T22:04:16.420891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-30T22:04:16.420989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-30T22:04:16.421118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-30T22:04:16.421300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-30T22:04:16.421484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-30T22:04:16.421579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-30T22:04:16.421677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-30T22:04:16.421797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-30T22:04:16.421939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-30T22:04:16.422092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-30T22:04:16.422186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-30T22:04:16.422291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-30T22:04:16.422399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-30T22:04:16.422592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-30T22:04:16.422746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-30T22:04:16.422934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-30T22:04:16.423024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-30T22:04:16.423124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-30T22:04:16.423217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-30T22:04:16.423316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-30T22:04:16.423423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-30T22:04:16.423535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-30T22:04:16.423685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-30T22:04:16.423865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-30T22:04:16.423963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-30T22:04:16.424217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-30T22:04:16.424409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-30T22:04:16.424527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-30T22:04:16.424927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-30T22:04:16.425037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-30T22:04:16.425240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-30T22:04:16.425342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-30T22:04:16.425458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-30T22:04:16.425629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-30T22:04:16.425890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-30T22:04:16.425994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-30T22:04:16.426090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-30T22:04:16.426183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-30T22:04:16.426283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-30T22:04:16.426382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-30T22:04:16.426499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-30T22:04:16.426682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-30T22:04:16.426791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-30T22:04:16.426878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-30T22:04:16.426946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-30T22:04:16.427010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-30T22:04:16.427135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-30T22:04:16.427242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-30T22:04:16.427335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-30T22:04:16.427416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-30T22:04:16.427548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-30T22:04:16.427664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-30T22:04:16.427767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-30T22:04:16.427891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-30T22:04:16.428013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-30T22:04:16.428200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-30T22:04:16.428316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-30T22:04:16.428420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-30T22:04:16.428607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-30T22:04:16.428784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-30T22:04:16.428903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-30T22:04:16.429004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-30T22:04:16.429115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-30T22:04:16.429237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-30T22:04:16.429316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-30T22:04:16.429492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-30T22:04:16.429587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-30T22:04:16.429811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-30T22:04:16.429917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-30T22:04:16.430008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-30T22:04:16.430211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-30T22:04:16.430327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-30T22:04:16.430499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-30T22:04:16.430602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-30T22:04:16.430793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-30T22:04:16.430905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-30T22:04:16.431106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-30T22:04:16.431199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-30T22:04:16.431266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-30T22:04:16.431331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-30T22:04:16.431477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-30T22:04:16.431688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-30T22:04:16.431890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-30T22:04:16.432009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-30T22:04:16.432124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-30T22:04:16.432221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-30T22:04:16.432289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-30T22:04:16.432353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-30T22:04:16.432542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-30T22:04:16.432721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-30T22:04:16.432852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-30T22:04:16.433087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-30T22:04:16.433179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-30T22:04:16.433252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-30T22:04:16.433393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-30T22:04:16.433582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-30T22:04:16.433810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-30T22:04:16.433929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-30T22:04:16.434020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-30T22:04:16.434102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-30T22:04:16.434217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-30T22:04:16.434346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-30T22:04:16.434495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-30T22:04:16.434708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-30T22:04:16.434821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-30T22:04:16.434913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-30T22:04:16.435122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-30T22:04:16.435244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-30T22:04:16.435328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-30T22:04:16.435486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-30T22:04:16.435615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-30T22:04:16.435747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-30T22:04:16.435853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-30T22:04:16.435943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-30T22:04:16.436034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-30T22:04:16.436188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-30T22:04:16.436304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-30T22:04:16.436501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-30T22:04:16.436622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-30T22:04:16.436760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-30T22:04:16.437035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-30T22:04:16.437127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-30T22:04:16.437194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-30T22:04:16.437269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-30T22:04:16.437461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-30T22:04:16.437600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-30T22:04:16.437721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-30T22:04:16.438036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-30T22:04:16.438259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-30T22:04:16.438377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-30T22:04:16.438499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-30T22:04:16.438627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-30T22:04:16.438745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-30T22:04:16.438825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-30T22:04:16.438948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-30T22:04:16.439055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-30T22:04:16.439231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-30T22:04:16.439324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-30T22:04:16.439534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-30T22:04:16.439821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-30T22:04:16.439991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-30T22:04:16.440121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-30T22:04:16.440270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-30T22:04:16.440574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-30T22:04:16.440854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-30T22:04:16.441021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-30T22:04:16.441163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-30T22:04:16.441265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-30T22:04:16.441370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-30T22:04:16.441460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-30T22:04:16.441575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-30T22:04:16.441801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-30T22:04:16.441963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-30T22:04:16.442134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-30T22:04:16.442280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-30T22:04:16.442436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-30T22:04:16.442563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-30T22:04:16.442701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-30T22:04:16.442791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-30T22:04:16.442858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-30T22:04:16.442956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-30T22:04:16.443112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-30T22:04:16.443211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-30T22:04:16.443400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-30T22:04:16.443519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-30T22:04:16.443696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-30T22:04:16.443791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-30T22:04:16.443883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-30T22:04:16.444059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-30T22:04:16.444175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-30T22:04:16.444365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-30T22:04:16.444454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-30T22:04:16.444552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-30T22:04:16.444618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-30T22:04:16.444729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-30T22:04:16.444809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-30T22:04:16.444933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-30T22:04:16.445269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-30T22:04:16.445359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-30T22:04:16.445540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-30T22:04:16.445633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-30T22:04:16.445794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-30T22:04:16.445892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-30T22:04:16.445965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-30T22:04:16.446056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-30T22:04:16.446207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-30T22:04:16.446307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-30T22:04:16.446416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-30T22:04:16.446530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-30T22:04:16.446659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-30T22:04:16.446803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-30T22:04:16.446903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-30T22:04:16.446995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-30T22:04:16.447063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-30T22:04:16.447149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-30T22:04:16.447365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-30T22:04:16.447477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-30T22:04:16.447664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-30T22:04:16.447878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-30T22:04:16.448065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-30T22:04:16.448219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-30T22:04:16.448404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-30T22:04:16.448495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-30T22:04:16.448584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-30T22:04:16.448720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-30T22:04:16.448872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-30T22:04:16.448977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-30T22:04:16.449105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-30T22:04:16.449210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-30T22:04:16.449364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-30T22:04:16.449589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-30T22:04:16.449789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-30T22:04:16.449896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-30T22:04:16.450021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-30T22:04:16.450150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-30T22:04:16.450346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-30T22:04:16.450587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-30T22:04:16.450782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-30T22:04:16.450971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-30T22:04:16.451068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-30T22:04:16.451154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-30T22:04:16.451377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-30T22:04:16.451496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-30T22:04:16.451608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-30T22:04:16.451780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-30T22:04:16.451872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-30T22:04:16.451960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-30T22:04:16.452049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-30T22:04:16.452187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-30T22:04:16.452294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-30T22:04:16.452448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-30T22:04:16.452712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-30T22:04:16.452894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-30T22:04:16.452985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-30T22:04:16.453055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-30T22:04:16.453129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-30T22:04:16.453240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-30T22:04:16.453332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-30T22:04:16.453398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-30T22:04:16.453463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-30T22:04:16.453629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-30T22:04:16.453781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-30T22:04:16.453886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-30T22:04:16.453999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-30T22:04:16.454102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-30T22:04:16.454231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-30T22:04:16.454336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-30T22:04:16.454497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-30T22:04:16.454600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-30T22:04:16.454802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-30T22:04:16.454919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-30T22:04:16.455017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-30T22:04:16.455130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-30T22:04:16.455257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-30T22:04:16.455347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-30T22:04:16.455519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-30T22:04:16.455732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-30T22:04:16.455824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-30T22:04:16.455890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-30T22:04:16.456256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-30T22:04:16.456431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-30T22:04:16.456552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-30T22:04:16.456746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-30T22:04:16.456840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-30T22:04:16.456923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-30T22:04:16.457016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-30T22:04:16.457184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-30T22:04:16.457280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-30T22:04:16.457370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-30T22:04:16.457484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-30T22:04:16.457593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-30T22:04:16.457813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-30T22:04:16.457927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-30T22:04:16.458056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-30T22:04:16.458143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-30T22:04:16.458243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-30T22:04:16.458407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-30T22:04:16.458584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-30T22:04:16.458774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-30T22:04:16.458885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-30T22:04:16.458980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-30T22:04:16.459163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-30T22:04:16.459273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-30T22:04:16.459380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-30T22:04:16.459516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-30T22:04:16.459634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-30T22:04:16.459786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-30T22:04:16.459919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-30T22:04:16.460038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-30T22:04:16.460134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-30T22:04:16.460287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-30T22:04:16.460410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-30T22:04:16.460568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-30T22:04:16.460725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-30T22:04:16.460888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-30T22:04:16.460997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-30T22:04:16.461077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-30T22:04:16.461281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-30T22:04:16.461587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-30T22:04:16.461747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-30T22:04:16.461973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-30T22:04:16.462147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-30T22:04:16.462306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-30T22:04:16.462405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-30T22:04:16.462514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-30T22:04:16.462618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-30T22:04:16.462774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-30T22:04:16.462893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-30T22:04:16.463088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-30T22:04:16.463219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-30T22:04:16.463448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-30T22:04:16.463599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-30T22:04:16.463811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-30T22:04:16.463985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-30T22:04:16.464094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-30T22:04:16.464361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-30T22:04:16.464538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-30T22:04:16.464670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-30T22:04:16.464780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-30T22:04:16.464886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-30T22:04:16.464971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-30T22:04:16.465117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-30T22:04:16.465211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-30T22:04:16.465402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-30T22:04:16.465490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-30T22:04:16.465560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-30T22:04:16.465978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-30T22:04:16.466075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-30T22:04:16.466187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-30T22:04:16.466285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-30T22:04:16.466397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-30T22:04:16.466497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-30T22:04:16.466577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-30T22:04:16.466723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-30T22:04:16.466869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-30T22:04:16.467026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-30T22:04:16.467181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-30T22:04:16.467280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-30T22:04:16.467369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-30T22:04:16.467492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-30T22:04:16.467683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-30T22:04:16.467776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-30T22:04:16.467842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-30T22:04:16.468032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-30T22:04:16.468159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-30T22:04:16.468261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-30T22:04:16.468441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-30T22:04:16.468589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-30T22:04:16.468739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-30T22:04:16.468873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-30T22:04:16.468995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-30T22:04:16.469090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-30T22:04:16.469208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-30T22:04:16.469411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-30T22:04:16.469511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-30T22:04:16.469592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-30T22:04:16.469708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-30T22:04:16.469839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-30T22:04:16.469967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-30T22:04:16.470062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-30T22:04:16.470233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-30T22:04:16.470352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-30T22:04:16.470484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-30T22:04:16.470606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-30T22:04:16.470728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-30T22:04:16.470842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-30T22:04:16.470957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-30T22:04:16.471095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-30T22:04:16.471198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-30T22:04:16.471379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-30T22:04:16.471495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-30T22:04:16.471588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-30T22:04:16.471765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-30T22:04:16.471913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-30T22:04:16.472073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-30T22:04:16.472200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-30T22:04:16.472312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-30T22:04:16.472511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-30T22:04:16.472739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-30T22:04:16.472848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-30T22:04:16.472958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-30T22:04:16.473062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-30T22:04:16.473213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-30T22:04:16.473374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-30T22:04:16.473482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-30T22:04:16.473606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-30T22:04:16.473823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-30T22:04:16.473921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-30T22:04:16.474019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-30T22:04:16.474122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-30T22:04:16.474253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-30T22:04:16.474350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-30T22:04:16.474488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-30T22:04:16.474578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-30T22:04:16.474665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-30T22:04:16.474757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-30T22:04:16.474884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-30T22:04:16.475047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-30T22:04:16.475290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-30T22:04:16.475480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-30T22:04:16.475593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-30T22:04:16.475723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-30T22:04:16.475845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-30T22:04:16.476093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-30T22:04:16.476185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-30T22:04:16.476281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-30T22:04:16.476376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-30T22:04:16.476446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-30T22:04:16.476606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-30T22:04:16.476772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-30T22:04:16.476876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-30T22:04:16.476988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-30T22:04:16.477225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-30T22:04:16.477395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-30T22:04:16.477486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-30T22:04:16.477572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-30T22:04:16.477687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-30T22:04:16.477803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-30T22:04:16.477973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-30T22:04:16.478091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-30T22:04:16.478258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-30T22:04:16.478348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-30T22:04:16.478426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-30T22:04:16.478594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-30T22:04:16.478726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-30T22:04:16.478819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-30T22:04:16.478924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-30T22:04:16.479046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-30T22:04:16.479204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-30T22:04:16.479368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-30T22:04:16.479524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-30T22:04:16.479728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-30T22:04:16.479883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-30T22:04:16.480074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-30T22:04:16.480190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-30T22:04:16.480423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-30T22:04:16.480583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-30T22:04:16.480809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-30T22:04:16.480976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-30T22:04:16.481111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-30T22:04:16.481325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-30T22:04:16.481442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-30T22:04:16.481543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-30T22:04:16.481741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-30T22:04:16.481982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-30T22:04:16.482157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-30T22:04:16.482328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-30T22:04:16.482727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-30T22:04:16.482853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-30T22:04:16.482948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-30T22:04:16.483080] [INFO ] [LOCAL ] Deleted 1907 derivative data files. [2025-09-30T22:04:16.483151] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-30T22:04:16.485376] [INFO ] [LOCAL ] Found 2009 symbols with primary data. [2025-09-30T22:04:16.485843] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2009 symbols [2025-09-30T22:04:16.487125] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:16.487441] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:16.488544] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:16.563188] [DEBUG] [LOCAL ] AB: Loaded 27540 existing records from primary storage. [2025-09-30T22:04:16.563443] [INFO ] [MAIN ] AB: Loaded 27540 primary data records. [2025-09-30T22:04:16.698298] [DEBUG] [LOCAL ] AAP: Loaded 51971 existing records from primary storage. [2025-09-30T22:04:16.708882] [INFO ] [MAIN ] AAP: Loaded 51971 primary data records. [2025-09-30T22:04:16.702836] [DEBUG] [LOCAL ] A: Loaded 50719 existing records from primary storage. [2025-09-30T22:04:16.709107] [INFO ] [MAIN ] A: Loaded 50719 primary data records. [2025-09-30T22:04:17.720900] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:17.722697] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 27540 primary records. [2025-09-30T22:04:17.723003] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-30T22:04:17.742803] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-30T22:04:17.743401] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-30T22:04:17.746579] [INFO ] [MAIN ] Derivative Progress: 1/2009 symbols completed. AB took 1.3s. Estimated remaining: 42m 12s. Rate: 47.6 symbols/min [2025-09-30T22:04:17.747098] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:17.762754] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:17.765393] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51971 primary records. [2025-09-30T22:04:17.765924] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-30T22:04:17.794785] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:17.796371] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50719 primary records. [2025-09-30T22:04:17.796789] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-30T22:04:17.824212] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-09-30T22:04:17.824888] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-30T22:04:17.828118] [INFO ] [MAIN ] Derivative Progress: 2/2009 symbols completed. AAP took 1.3s. Estimated remaining: 22m 27s. Rate: 89.4 symbols/min [2025-09-30T22:04:17.829139] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:17.842852] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-09-30T22:04:17.842630] [DEBUG] [LOCAL ] ABCB: Loaded 30473 existing records from primary storage. [2025-09-30T22:04:17.843302] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-30T22:04:17.846167] [INFO ] [MAIN ] Derivative Progress: 3/2009 symbols completed. A took 1.4s. Estimated remaining: 15m 10s. Rate: 132.3 symbols/min [2025-09-30T22:04:17.843219] [INFO ] [MAIN ] ABCB: Loaded 30473 primary data records. [2025-09-30T22:04:17.846493] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:18.013024] [DEBUG] [LOCAL ] ABG: Loaded 18677 existing records from primary storage. [2025-09-30T22:04:18.045765] [INFO ] [MAIN ] ABG: Loaded 18677 primary data records. [2025-09-30T22:04:18.328998] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-09-30T22:04:18.345386] [INFO ] [MAIN ] ABEV: Loaded 53278 primary data records. [2025-09-30T22:04:18.986151] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:18.987571] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30473 primary records. [2025-09-30T22:04:18.988000] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-30T22:04:19.020034] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-30T22:04:19.026159] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:19.026331] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-30T22:04:19.029228] [INFO ] [MAIN ] Derivative Progress: 4/2009 symbols completed. ABCB took 1.3s. Estimated remaining: 21m 15s. Rate: 94.3 symbols/min [2025-09-30T22:04:19.030329] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:19.030126] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18677 primary records. [2025-09-30T22:04:19.032756] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-30T22:04:19.057633] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:19.065071] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53278 primary records. [2025-09-30T22:04:19.067510] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-30T22:04:19.067406] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-09-30T22:04:19.068411] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-30T22:04:19.070893] [INFO ] [MAIN ] Derivative Progress: 5/2009 symbols completed. ABG took 1.2s. Estimated remaining: 17m 16s. Rate: 116.0 symbols/min [2025-09-30T22:04:19.080722] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:19.099766] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-30T22:04:19.099910] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-30T22:04:19.102677] [INFO ] [MAIN ] Derivative Progress: 6/2009 symbols completed. ABEV took 1.3s. Estimated remaining: 14m 34s. Rate: 137.6 symbols/min [2025-09-30T22:04:19.103033] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:19.117670] [DEBUG] [LOCAL ] ABM: Loaded 32024 existing records from primary storage. [2025-09-30T22:04:19.118042] [INFO ] [MAIN ] ABM: Loaded 32024 primary data records. [2025-09-30T22:04:19.489408] [DEBUG] [LOCAL ] ABR: Loaded 52005 existing records from primary storage. [2025-09-30T22:04:19.489804] [INFO ] [MAIN ] ABR: Loaded 52005 primary data records. [2025-09-30T22:04:19.616106] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-30T22:04:19.637189] [INFO ] [MAIN ] ABT: Loaded 53620 primary data records. [2025-09-30T22:04:20.173165] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:20.174232] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32024 primary records. [2025-09-30T22:04:20.174519] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-30T22:04:20.193365] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-30T22:04:20.194017] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-30T22:04:20.196962] [INFO ] [MAIN ] Derivative Progress: 7/2009 symbols completed. ABM took 1.2s. Estimated remaining: 17m 41s. Rate: 113.2 symbols/min [2025-09-30T22:04:20.197536] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:20.215871] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:20.216847] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52005 primary records. [2025-09-30T22:04:20.217130] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-30T22:04:20.240132] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-30T22:04:20.240282] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-30T22:04:20.242141] [INFO ] [MAIN ] Derivative Progress: 8/2009 symbols completed. ABR took 1.2s. Estimated remaining: 15m 40s. Rate: 127.8 symbols/min [2025-09-30T22:04:20.242504] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:20.255172] [DEBUG] [LOCAL ] ACA: Loaded 23379 existing records from primary storage. [2025-09-30T22:04:20.255403] [INFO ] [MAIN ] ACA: Loaded 23379 primary data records. [2025-09-30T22:04:20.291947] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:20.316783] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53620 primary records. [2025-09-30T22:04:20.317767] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-30T22:04:20.367083] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-09-30T22:04:20.400828] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-30T22:04:20.416290] [INFO ] [MAIN ] Derivative Progress: 9/2009 symbols completed. ABT took 1.3s. Estimated remaining: 14m 34s. Rate: 137.4 symbols/min [2025-09-30T22:04:20.427855] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:20.674534] [DEBUG] [LOCAL ] ACCO: Loaded 37420 existing records from primary storage. [2025-09-30T22:04:20.675002] [INFO ] [MAIN ] ACCO: Loaded 37420 primary data records. [2025-09-30T22:04:20.820116] [DEBUG] [LOCAL ] ACEL: Loaded 26829 existing records from primary storage. [2025-09-30T22:04:20.826146] [INFO ] [MAIN ] ACEL: Loaded 26829 primary data records. [2025-09-30T22:04:21.375947] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:21.377086] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23379 primary records. [2025-09-30T22:04:21.377841] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-30T22:04:21.397573] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-30T22:04:21.398115] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-30T22:04:21.400082] [INFO ] [MAIN ] Derivative Progress: 10/2009 symbols completed. ACA took 1.2s. Estimated remaining: 16m 22s. Rate: 122.1 symbols/min [2025-09-30T22:04:21.400538] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:21.419604] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:21.420605] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37420 primary records. [2025-09-30T22:04:21.420824] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-30T22:04:21.442064] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-09-30T22:04:21.442383] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-30T22:04:21.444268] [INFO ] [MAIN ] Derivative Progress: 11/2009 symbols completed. ACCO took 1.2s. Estimated remaining: 15m 1s. Rate: 133.1 symbols/min [2025-09-30T22:04:21.444621] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:21.458465] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:21.475952] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26829 primary records. [2025-09-30T22:04:21.476093] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-30T22:04:21.493422] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-09-30T22:04:21.493756] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-30T22:04:21.497023] [INFO ] [MAIN ] Derivative Progress: 12/2009 symbols completed. ACEL took 1.1s. Estimated remaining: 13m 54s. Rate: 143.7 symbols/min [2025-09-30T22:04:21.497452] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:21.515678] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-30T22:04:21.515928] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-09-30T22:04:21.672387] [DEBUG] [LOCAL ] ACM: Loaded 42987 existing records from primary storage. [2025-09-30T22:04:21.688239] [INFO ] [MAIN ] ACM: Loaded 42987 primary data records. [2025-09-30T22:04:22.063375] [DEBUG] [LOCAL ] ACN: Loaded 53425 existing records from primary storage. [2025-09-30T22:04:22.107134] [INFO ] [MAIN ] ACN: Loaded 53425 primary data records. [2025-09-30T22:04:22.601605] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:22.603162] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-09-30T22:04:22.603700] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-30T22:04:22.627462] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-09-30T22:04:22.628334] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-30T22:04:22.643946] [INFO ] [MAIN ] Derivative Progress: 13/2009 symbols completed. ACHR took 1.2s. Estimated remaining: 15m 46s. Rate: 126.7 symbols/min [2025-09-30T22:04:22.644878] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:22.645955] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 42987 primary records. [2025-09-30T22:04:22.646119] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-30T22:04:22.669306] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-30T22:04:22.669504] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-30T22:04:22.671440] [INFO ] [MAIN ] Derivative Progress: 14/2009 symbols completed. ACM took 1.2s. Estimated remaining: 14m 42s. Rate: 135.8 symbols/min [2025-09-30T22:04:22.684703] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:22.685392] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53425 primary records. [2025-09-30T22:04:22.685456] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-30T22:04:22.702268] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-30T22:04:22.702332] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-30T22:04:22.705124] [INFO ] [MAIN ] Derivative Progress: 15/2009 symbols completed. ACN took 1.2s. Estimated remaining: 13m 47s. Rate: 144.7 symbols/min [2025-09-30T22:04:22.705684] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:22.705885] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:22.706043] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:22.722177] [DEBUG] [LOCAL ] ACV: Loaded 7194 existing records from primary storage. [2025-09-30T22:04:22.722484] [INFO ] [MAIN ] ACV: Loaded 7194 primary data records. [2025-09-30T22:04:22.926034] [DEBUG] [LOCAL ] ACRE: Loaded 33553 existing records from primary storage. [2025-09-30T22:04:22.962362] [INFO ] [MAIN ] ACRE: Loaded 33553 primary data records. [2025-09-30T22:04:23.119799] [DEBUG] [LOCAL ] ACP: Loaded 30970 existing records from primary storage. [2025-09-30T22:04:23.151055] [INFO ] [MAIN ] ACP: Loaded 30970 primary data records. [2025-09-30T22:04:23.855793] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:23.857548] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7194 primary records. [2025-09-30T22:04:23.857996] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-30T22:04:23.890316] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-30T22:04:23.904365] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-30T22:04:23.907439] [INFO ] [MAIN ] Derivative Progress: 16/2009 symbols completed. ACV took 1.2s. Estimated remaining: 15m 24s. Rate: 129.3 symbols/min [2025-09-30T22:04:23.908227] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:23.908011] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:23.909450] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33553 primary records. [2025-09-30T22:04:23.910179] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-30T22:04:23.929335] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-30T22:04:23.929718] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-30T22:04:23.933430] [INFO ] [MAIN ] Derivative Progress: 17/2009 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 33s. Rate: 137.0 symbols/min [2025-09-30T22:04:23.934807] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:23.950015] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:23.951082] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30970 primary records. [2025-09-30T22:04:23.951190] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-30T22:04:23.969316] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-09-30T22:04:23.983404] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-30T22:04:23.987015] [INFO ] [MAIN ] Derivative Progress: 18/2009 symbols completed. ACP took 1.3s. Estimated remaining: 13m 50s. Rate: 144.0 symbols/min [2025-09-30T22:04:23.987367] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:24.019464] [DEBUG] [LOCAL ] ACVA: Loaded 49249 existing records from primary storage. [2025-09-30T22:04:24.020346] [INFO ] [MAIN ] ACVA: Loaded 49249 primary data records. [2025-09-30T22:04:24.101244] [DEBUG] [LOCAL ] ADC: Loaded 46153 existing records from primary storage. [2025-09-30T22:04:24.129270] [INFO ] [MAIN ] ADC: Loaded 46153 primary data records. [2025-09-30T22:04:24.334892] [DEBUG] [LOCAL ] ADCT: Loaded 34480 existing records from primary storage. [2025-09-30T22:04:24.348995] [INFO ] [MAIN ] ADCT: Loaded 34480 primary data records. [2025-09-30T22:04:25.165363] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:25.180787] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49249 primary records. [2025-09-30T22:04:25.181590] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:25.181719] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-30T22:04:25.182939] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46153 primary records. [2025-09-30T22:04:25.185602] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-30T22:04:25.220130] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-30T22:04:25.220589] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-30T22:04:25.223016] [INFO ] [MAIN ] Derivative Progress: 19/2009 symbols completed. ACVA took 1.3s. Estimated remaining: 15m 15s. Rate: 130.5 symbols/min [2025-09-30T22:04:25.224046] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-09-30T22:04:25.224226] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:25.224364] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-30T22:04:25.226861] [INFO ] [MAIN ] Derivative Progress: 20/2009 symbols completed. ADC took 1.3s. Estimated remaining: 14m 29s. Rate: 137.3 symbols/min [2025-09-30T22:04:25.227381] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:25.245701] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:25.246626] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 34480 primary records. [2025-09-30T22:04:25.246732] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-30T22:04:25.264626] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-30T22:04:25.264902] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-30T22:04:25.267617] [INFO ] [MAIN ] Derivative Progress: 21/2009 symbols completed. ADCT took 1.3s. Estimated remaining: 13m 51s. Rate: 143.5 symbols/min [2025-09-30T22:04:25.267891] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:25.338956] [DEBUG] [LOCAL ] ADT: Loaded 53463 existing records from primary storage. [2025-09-30T22:04:25.339239] [INFO ] [MAIN ] ADT: Loaded 53463 primary data records. [2025-09-30T22:04:25.345289] [DEBUG] [LOCAL ] ADNT: Loaded 47238 existing records from primary storage. [2025-09-30T22:04:25.380671] [INFO ] [MAIN ] ADNT: Loaded 47238 primary data records. [2025-09-30T22:04:25.508061] [DEBUG] [LOCAL ] ADX: Loaded 27514 existing records from primary storage. [2025-09-30T22:04:25.574141] [INFO ] [MAIN ] ADX: Loaded 27514 primary data records. [2025-09-30T22:04:26.359389] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:26.362950] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53463 primary records. [2025-09-30T22:04:26.363248] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-30T22:04:26.400140] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:26.405526] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-30T22:04:26.406483] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47238 primary records. [2025-09-30T22:04:26.405632] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-30T22:04:26.406610] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-30T22:04:26.409515] [INFO ] [MAIN ] Derivative Progress: 22/2009 symbols completed. ADT took 1.2s. Estimated remaining: 14m 56s. Rate: 133.0 symbols/min [2025-09-30T22:04:26.411410] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:26.437684] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:26.442285] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27514 primary records. [2025-09-30T22:04:26.443620] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-09-30T22:04:26.443751] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-30T22:04:26.443838] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-30T22:04:26.446775] [INFO ] [MAIN ] Derivative Progress: 23/2009 symbols completed. ADNT took 1.2s. Estimated remaining: 14m 20s. Rate: 138.5 symbols/min [2025-09-30T22:04:26.447749] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:26.467066] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-30T22:04:26.469253] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-30T22:04:26.471691] [INFO ] [MAIN ] Derivative Progress: 24/2009 symbols completed. ADX took 1.2s. Estimated remaining: 13m 46s. Rate: 144.2 symbols/min [2025-09-30T22:04:26.472082] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:26.489313] [DEBUG] [LOCAL ] AEFC: Loaded 8535 existing records from primary storage. [2025-09-30T22:04:26.489545] [INFO ] [MAIN ] AEFC: Loaded 8535 primary data records. [2025-09-30T22:04:26.622698] [DEBUG] [LOCAL ] AEE: Loaded 50091 existing records from primary storage. [2025-09-30T22:04:26.634089] [INFO ] [MAIN ] AEE: Loaded 50091 primary data records. [2025-09-30T22:04:26.997416] [DEBUG] [LOCAL ] AEG: Loaded 49547 existing records from primary storage. [2025-09-30T22:04:27.025226] [INFO ] [MAIN ] AEG: Loaded 49547 primary data records. [2025-09-30T22:04:27.609211] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:27.610899] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8535 primary records. [2025-09-30T22:04:27.613283] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-30T22:04:27.639551] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:27.641793] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50091 primary records. [2025-09-30T22:04:27.642402] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-30T22:04:27.664242] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-30T22:04:27.664165] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-30T22:04:27.664436] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-30T22:04:27.664547] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-30T22:04:27.667104] [INFO ] [MAIN ] Derivative Progress: 25/2009 symbols completed. AEE took 1.3s. Estimated remaining: 14m 47s. Rate: 134.1 symbols/min [2025-09-30T22:04:27.667489] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:27.669962] [INFO ] [MAIN ] Derivative Progress: 26/2009 symbols completed. AEFC took 1.2s. Estimated remaining: 14m 13s. Rate: 139.5 symbols/min [2025-09-30T22:04:27.670368] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:27.691164] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:27.691898] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49547 primary records. [2025-09-30T22:04:27.691962] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-30T22:04:27.713318] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-30T22:04:27.713871] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-30T22:04:27.717446] [INFO ] [MAIN ] Derivative Progress: 27/2009 symbols completed. AEG took 1.2s. Estimated remaining: 13m 45s. Rate: 144.2 symbols/min [2025-09-30T22:04:27.719071] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:27.790499] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-09-30T22:04:27.790902] [INFO ] [MAIN ] AEO: Loaded 53557 primary data records. [2025-09-30T22:04:27.791886] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-09-30T22:04:27.798724] [INFO ] [MAIN ] AEM: Loaded 53464 primary data records. [2025-09-30T22:04:28.225972] [DEBUG] [LOCAL ] AER: Loaded 48382 existing records from primary storage. [2025-09-30T22:04:28.341105] [INFO ] [MAIN ] AER: Loaded 48382 primary data records. [2025-09-30T22:04:28.866235] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:28.867305] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53557 primary records. [2025-09-30T22:04:28.880559] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:28.879705] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-30T22:04:28.882220] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53464 primary records. [2025-09-30T22:04:28.883202] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-30T22:04:28.921733] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-30T22:04:28.922148] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-30T22:04:28.924707] [INFO ] [MAIN ] Derivative Progress: 28/2009 symbols completed. AEM took 1.3s. Estimated remaining: 14m 40s. Rate: 135.1 symbols/min [2025-09-30T22:04:28.927795] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-30T22:04:28.927889] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-30T22:04:28.929978] [INFO ] [MAIN ] Derivative Progress: 29/2009 symbols completed. AEO took 1.3s. Estimated remaining: 14m 10s. Rate: 139.8 symbols/min [2025-09-30T22:04:28.944884] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:28.945529] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48382 primary records. [2025-09-30T22:04:28.945590] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-30T22:04:28.961278] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-30T22:04:28.961385] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-30T22:04:28.964934] [INFO ] [MAIN ] Derivative Progress: 30/2009 symbols completed. AER took 1.2s. Estimated remaining: 13m 43s. Rate: 144.2 symbols/min [2025-09-30T22:04:28.965585] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:28.965774] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:28.965906] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:28.983521] [DEBUG] [LOCAL ] AFB: Loaded 11253 existing records from primary storage. [2025-09-30T22:04:28.983787] [INFO ] [MAIN ] AFB: Loaded 11253 primary data records. [2025-09-30T22:04:29.357116] [DEBUG] [LOCAL ] AESI: Loaded 49451 existing records from primary storage. [2025-09-30T22:04:29.358176] [INFO ] [MAIN ] AESI: Loaded 49451 primary data records. [2025-09-30T22:04:29.359026] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-09-30T22:04:29.360056] [INFO ] [MAIN ] AES: Loaded 53670 primary data records. [2025-09-30T22:04:30.091871] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:30.093494] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11253 primary records. [2025-09-30T22:04:30.094256] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-30T22:04:30.113141] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-30T22:04:30.113759] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-30T22:04:30.116678] [INFO ] [MAIN ] Derivative Progress: 31/2009 symbols completed. AFB took 1.2s. Estimated remaining: 14m 30s. Rate: 136.5 symbols/min [2025-09-30T22:04:30.117285] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:30.141355] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:30.142334] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53670 primary records. [2025-09-30T22:04:30.142470] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-30T22:04:30.155534] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:30.156870] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49451 primary records. [2025-09-30T22:04:30.157184] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-30T22:04:30.203746] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-30T22:04:30.200952] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-30T22:04:30.204074] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-30T22:04:30.203994] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-30T22:04:30.206822] [INFO ] [MAIN ] Derivative Progress: 32/2009 symbols completed. AES took 1.2s. Estimated remaining: 14m 8s. Rate: 139.9 symbols/min [2025-09-30T22:04:30.207536] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:30.209563] [INFO ] [MAIN ] Derivative Progress: 33/2009 symbols completed. AESI took 1.2s. Estimated remaining: 13m 42s. Rate: 144.3 symbols/min [2025-09-30T22:04:30.219931] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:30.225226] [DEBUG] [LOCAL ] AFG: Loaded 32433 existing records from primary storage. [2025-09-30T22:04:30.224274] [DEBUG] [LOCAL ] AFGD: Loaded 1830 existing records from primary storage. [2025-09-30T22:04:30.225682] [INFO ] [MAIN ] AFG: Loaded 32433 primary data records. [2025-09-30T22:04:30.225920] [INFO ] [MAIN ] AFGD: Loaded 1830 primary data records. [2025-09-30T22:04:30.939891] [DEBUG] [LOCAL ] AFL: Loaded 53145 existing records from primary storage. [2025-09-30T22:04:30.940681] [INFO ] [MAIN ] AFL: Loaded 53145 primary data records. [2025-09-30T22:04:31.311191] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:31.314353] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32433 primary records. [2025-09-30T22:04:31.315054] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-30T22:04:31.331201] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:04:31.332427] [INFO ] [MAIN ] AFGD: Generated 1793 derivative records from 1830 primary records. [2025-09-30T22:04:31.344665] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-30T22:04:31.366792] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-30T22:04:31.366998] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-30T22:04:31.366637] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1793 records). [2025-09-30T22:04:31.370204] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-30T22:04:31.369864] [INFO ] [MAIN ] Derivative Progress: 34/2009 symbols completed. AFG took 1.3s. Estimated remaining: 14m 25s. Rate: 137.1 symbols/min [2025-09-30T22:04:31.373077] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:31.373240] [INFO ] [MAIN ] Derivative Progress: 35/2009 symbols completed. AFGD took 1.2s. Estimated remaining: 13m 60s. Rate: 141.1 symbols/min [2025-09-30T22:04:31.375251] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:31.391276] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:31.392291] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53145 primary records. [2025-09-30T22:04:31.392469] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-30T22:04:31.416110] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-30T22:04:31.416345] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-30T22:04:31.419566] [INFO ] [MAIN ] Derivative Progress: 36/2009 symbols completed. AFL took 1.2s. Estimated remaining: 13m 38s. Rate: 144.6 symbols/min [2025-09-30T22:04:31.419963] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:31.432076] [DEBUG] [LOCAL ] AGD: Loaded 17925 existing records from primary storage. [2025-09-30T22:04:31.432216] [INFO ] [MAIN ] AGD: Loaded 17925 primary data records. [2025-09-30T22:04:31.826570] [DEBUG] [LOCAL ] AGCO: Loaded 42360 existing records from primary storage. [2025-09-30T22:04:31.827438] [INFO ] [MAIN ] AGCO: Loaded 42360 primary data records. [2025-09-30T22:04:31.907023] [DEBUG] [LOCAL ] AGI: Loaded 53414 existing records from primary storage. [2025-09-30T22:04:31.935631] [INFO ] [MAIN ] AGI: Loaded 53414 primary data records. [2025-09-30T22:04:32.557400] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:32.559157] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17925 primary records. [2025-09-30T22:04:32.559367] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-30T22:04:32.586882] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-30T22:04:32.602210] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-30T22:04:32.603062] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:32.606901] [INFO ] [MAIN ] Derivative Progress: 37/2009 symbols completed. AGD took 1.2s. Estimated remaining: 14m 19s. Rate: 137.7 symbols/min [2025-09-30T22:04:32.607316] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:32.609370] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42360 primary records. [2025-09-30T22:04:32.610910] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-30T22:04:32.634078] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-30T22:04:32.634440] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-30T22:04:32.637501] [INFO ] [MAIN ] Derivative Progress: 38/2009 symbols completed. AGCO took 1.3s. Estimated remaining: 13m 58s. Rate: 141.2 symbols/min [2025-09-30T22:04:32.643499] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:32.647274] [DEBUG] [LOCAL ] AGM: Loaded 10121 existing records from primary storage. [2025-09-30T22:04:32.648741] [INFO ] [MAIN ] AGM: Loaded 10121 primary data records. [2025-09-30T22:04:32.736081] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:32.763513] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53414 primary records. [2025-09-30T22:04:32.790098] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-30T22:04:32.893702] [DEBUG] [LOCAL ] AGO: Loaded 27896 existing records from primary storage. [2025-09-30T22:04:32.918586] [INFO ] [MAIN ] AGO: Loaded 27896 primary data records. [2025-09-30T22:04:32.939485] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-30T22:04:33.028038] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-30T22:04:33.180807] [INFO ] [MAIN ] Derivative Progress: 39/2009 symbols completed. AGI took 1.8s. Estimated remaining: 14m 3s. Rate: 140.2 symbols/min [2025-09-30T22:04:33.227064] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:33.499911] [DEBUG] [LOCAL ] AGRO: Loaded 33600 existing records from primary storage. [2025-09-30T22:04:33.501394] [INFO ] [MAIN ] AGRO: Loaded 33600 primary data records. [2025-09-30T22:04:33.528421] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:33.584801] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10121 primary records. [2025-09-30T22:04:33.607516] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-30T22:04:33.748412] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-30T22:04:33.752811] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:33.753190] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-30T22:04:33.814371] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27896 primary records. [2025-09-30T22:04:33.873983] [INFO ] [MAIN ] Derivative Progress: 40/2009 symbols completed. AGM took 1.3s. Estimated remaining: 14m 16s. Rate: 138.0 symbols/min [2025-09-30T22:04:33.934907] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:33.935780] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-30T22:04:33.955799] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-30T22:04:33.956236] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-30T22:04:33.958792] [INFO ] [MAIN ] Derivative Progress: 41/2009 symbols completed. AGO took 1.3s. Estimated remaining: 13m 59s. Rate: 140.8 symbols/min [2025-09-30T22:04:33.959326] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:33.995123] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:33.995905] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33600 primary records. [2025-09-30T22:04:33.996214] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-30T22:04:34.034069] [DEBUG] [LOCAL ] AGX: Loaded 33204 existing records from primary storage. [2025-09-30T22:04:34.035623] [INFO ] [MAIN ] AGX: Loaded 33204 primary data records. [2025-09-30T22:04:34.038573] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-30T22:04:34.066513] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-30T22:04:34.114370] [INFO ] [MAIN ] Derivative Progress: 42/2009 symbols completed. AGRO took 0.9s. Estimated remaining: 13m 46s. Rate: 142.9 symbols/min [2025-09-30T22:04:34.142731] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:34.172015] [DEBUG] [LOCAL ] AHH: Loaded 41175 existing records from primary storage. [2025-09-30T22:04:34.188820] [INFO ] [MAIN ] AHH: Loaded 41175 primary data records. [2025-09-30T22:04:34.740808] [DEBUG] [LOCAL ] AHR: Loaded 49168 existing records from primary storage. [2025-09-30T22:04:34.741811] [INFO ] [MAIN ] AHR: Loaded 49168 primary data records. [2025-09-30T22:04:34.928424] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:34.952748] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33204 primary records. [2025-09-30T22:04:35.075603] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-30T22:04:35.105288] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-30T22:04:35.106301] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-30T22:04:35.108581] [INFO ] [MAIN ] Derivative Progress: 43/2009 symbols completed. AGX took 1.2s. Estimated remaining: 14m 11s. Rate: 138.5 symbols/min [2025-09-30T22:04:35.124873] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:35.126459] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41175 primary records. [2025-09-30T22:04:35.126758] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-30T22:04:35.143394] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-30T22:04:35.143713] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-30T22:04:35.146218] [INFO ] [MAIN ] Derivative Progress: 44/2009 symbols completed. AHH took 1.2s. Estimated remaining: 13m 53s. Rate: 141.5 symbols/min [2025-09-30T22:04:35.163687] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:35.164373] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49168 primary records. [2025-09-30T22:04:35.164440] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-30T22:04:35.182231] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-30T22:04:35.182308] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-30T22:04:35.185703] [INFO ] [MAIN ] Derivative Progress: 45/2009 symbols completed. AHR took 1.0s. Estimated remaining: 13m 36s. Rate: 144.4 symbols/min [2025-09-30T22:04:35.186173] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:35.186115] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:35.186314] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:35.197042] [DEBUG] [LOCAL ] AHT: Loaded 6106 existing records from primary storage. [2025-09-30T22:04:35.197175] [INFO ] [MAIN ] AHT: Loaded 6106 primary data records. [2025-09-30T22:04:35.579689] [DEBUG] [LOCAL ] AIG: Loaded 53471 existing records from primary storage. [2025-09-30T22:04:35.590107] [INFO ] [MAIN ] AIG: Loaded 53471 primary data records. [2025-09-30T22:04:35.658306] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-09-30T22:04:35.682961] [INFO ] [MAIN ] AI: Loaded 53750 primary data records. [2025-09-30T22:04:36.406896] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:36.408503] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6106 primary records. [2025-09-30T22:04:36.408948] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-30T22:04:36.428093] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-09-30T22:04:36.428762] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-30T22:04:36.431149] [INFO ] [MAIN ] Derivative Progress: 46/2009 symbols completed. AHT took 1.2s. Estimated remaining: 14m 11s. Rate: 138.4 symbols/min [2025-09-30T22:04:36.431438] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:36.449251] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:36.450445] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53471 primary records. [2025-09-30T22:04:36.450623] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-30T22:04:36.467738] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-30T22:04:36.468192] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-30T22:04:36.471986] [INFO ] [MAIN ] Derivative Progress: 47/2009 symbols completed. AIG took 1.3s. Estimated remaining: 13m 54s. Rate: 141.1 symbols/min [2025-09-30T22:04:36.481377] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:36.496683] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:36.497462] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53750 primary records. [2025-09-30T22:04:36.497674] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-30T22:04:36.524105] [DEBUG] [LOCAL ] AIR: Loaded 27931 existing records from primary storage. [2025-09-30T22:04:36.525403] [INFO ] [MAIN ] AIR: Loaded 27931 primary data records. [2025-09-30T22:04:36.566730] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-30T22:04:36.594008] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-30T22:04:36.654565] [INFO ] [MAIN ] Derivative Progress: 48/2009 symbols completed. AI took 1.5s. Estimated remaining: 13m 44s. Rate: 142.8 symbols/min [2025-09-30T22:04:36.682872] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:36.682727] [DEBUG] [LOCAL ] AIT: Loaded 27638 existing records from primary storage. [2025-09-30T22:04:36.683534] [INFO ] [MAIN ] AIT: Loaded 27638 primary data records. [2025-09-30T22:04:37.264673] [DEBUG] [LOCAL ] AIV: Loaded 40347 existing records from primary storage. [2025-09-30T22:04:37.265006] [INFO ] [MAIN ] AIV: Loaded 40347 primary data records. [2025-09-30T22:04:37.619373] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:37.621321] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 27931 primary records. [2025-09-30T22:04:37.622286] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-30T22:04:37.664408] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-30T22:04:37.663235] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:37.664793] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-30T22:04:37.666844] [INFO ] [MAIN ] Derivative Progress: 49/2009 symbols completed. AIR took 1.2s. Estimated remaining: 14m 7s. Rate: 138.8 symbols/min [2025-09-30T22:04:37.667283] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:37.668363] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27638 primary records. [2025-09-30T22:04:37.668974] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-30T22:04:37.692905] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-09-30T22:04:37.693409] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-30T22:04:37.696314] [INFO ] [MAIN ] Derivative Progress: 50/2009 symbols completed. AIT took 1.2s. Estimated remaining: 13m 51s. Rate: 141.4 symbols/min [2025-09-30T22:04:37.696608] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:37.711103] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:37.712084] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40347 primary records. [2025-09-30T22:04:37.712208] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-30T22:04:37.741522] [DEBUG] [LOCAL ] AIZN: Loaded 4008 existing records from primary storage. [2025-09-30T22:04:37.742071] [INFO ] [MAIN ] AIZN: Loaded 4008 primary data records. [2025-09-30T22:04:37.765226] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-30T22:04:37.794552] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-30T22:04:37.819783] [INFO ] [MAIN ] Derivative Progress: 51/2009 symbols completed. AIV took 1.1s. Estimated remaining: 13m 39s. Rate: 143.4 symbols/min [2025-09-30T22:04:37.842638] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:37.843792] [DEBUG] [LOCAL ] AIZ: Loaded 29883 existing records from primary storage. [2025-09-30T22:04:37.854503] [INFO ] [MAIN ] AIZ: Loaded 29883 primary data records. [2025-09-30T22:04:38.520772] [DEBUG] [LOCAL ] AJG: Loaded 46898 existing records from primary storage. [2025-09-30T22:04:38.521350] [INFO ] [MAIN ] AJG: Loaded 46898 primary data records. [2025-09-30T22:04:38.787210] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:38.858389] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4008 primary records. [2025-09-30T22:04:38.873280] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-30T22:04:38.915295] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:38.916938] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29883 primary records. [2025-09-30T22:04:38.919787] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-30T22:04:38.920867] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-30T22:04:38.921923] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-30T22:04:38.924846] [INFO ] [MAIN ] Derivative Progress: 52/2009 symbols completed. AIZN took 1.2s. Estimated remaining: 14m 4s. Rate: 139.0 symbols/min [2025-09-30T22:04:38.938522] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:38.947823] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-30T22:04:38.948060] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-30T22:04:38.950514] [INFO ] [MAIN ] Derivative Progress: 53/2009 symbols completed. AIZ took 1.3s. Estimated remaining: 13m 49s. Rate: 141.6 symbols/min [2025-09-30T22:04:38.951078] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:38.975007] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:38.975889] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46898 primary records. [2025-09-30T22:04:38.976130] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-30T22:04:38.993914] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-09-30T22:04:38.994019] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-30T22:04:38.996985] [INFO ] [MAIN ] Derivative Progress: 54/2009 symbols completed. AJG took 1.2s. Estimated remaining: 13m 35s. Rate: 143.9 symbols/min [2025-09-30T22:04:38.997275] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:39.057836] [DEBUG] [LOCAL ] AKR: Loaded 45732 existing records from primary storage. [2025-09-30T22:04:39.058230] [INFO ] [MAIN ] AKR: Loaded 45732 primary data records. [2025-09-30T22:04:39.162565] [DEBUG] [LOCAL ] AL: Loaded 44215 existing records from primary storage. [2025-09-30T22:04:39.205466] [INFO ] [MAIN ] AL: Loaded 44215 primary data records. [2025-09-30T22:04:39.549053] [DEBUG] [LOCAL ] ALB: Loaded 53236 existing records from primary storage. [2025-09-30T22:04:39.572196] [INFO ] [MAIN ] ALB: Loaded 53236 primary data records. [2025-09-30T22:04:40.125367] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:40.126683] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45732 primary records. [2025-09-30T22:04:40.126991] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-30T22:04:40.146785] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-09-30T22:04:40.147409] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-30T22:04:40.150993] [INFO ] [MAIN ] Derivative Progress: 55/2009 symbols completed. AKR took 1.2s. Estimated remaining: 14m 1s. Rate: 139.4 symbols/min [2025-09-30T22:04:40.151243] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:40.173780] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:40.175015] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44215 primary records. [2025-09-30T22:04:40.175154] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-30T22:04:40.195869] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-30T22:04:40.196696] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-30T22:04:40.199445] [INFO ] [MAIN ] Derivative Progress: 56/2009 symbols completed. AL took 1.2s. Estimated remaining: 13m 47s. Rate: 141.7 symbols/min [2025-09-30T22:04:40.199973] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:40.214414] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:40.215325] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53236 primary records. [2025-09-30T22:04:40.215461] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-30T22:04:40.256377] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-30T22:04:40.257170] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-30T22:04:40.261135] [INFO ] [MAIN ] Derivative Progress: 57/2009 symbols completed. ALB took 1.3s. Estimated remaining: 13m 34s. Rate: 143.8 symbols/min [2025-09-30T22:04:40.261594] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:40.278017] [DEBUG] [LOCAL ] ALC: Loaded 50789 existing records from primary storage. [2025-09-30T22:04:40.278343] [INFO ] [MAIN ] ALC: Loaded 50789 primary data records. [2025-09-30T22:04:40.363482] [DEBUG] [LOCAL ] ALEX: Loaded 31102 existing records from primary storage. [2025-09-30T22:04:40.386104] [DEBUG] [LOCAL ] ALG: Loaded 10240 existing records from primary storage. [2025-09-30T22:04:40.399931] [INFO ] [MAIN ] ALEX: Loaded 31102 primary data records. [2025-09-30T22:04:40.413630] [INFO ] [MAIN ] ALG: Loaded 10240 primary data records. [2025-09-30T22:04:41.342733] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:41.343914] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50789 primary records. [2025-09-30T22:04:41.344310] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-30T22:04:41.392168] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:41.393406] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:41.396501] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10240 primary records. [2025-09-30T22:04:41.395069] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31102 primary records. [2025-09-30T22:04:41.396613] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-30T22:04:41.396706] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-30T22:04:41.398254] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-30T22:04:41.398395] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-30T22:04:41.400597] [INFO ] [MAIN ] Derivative Progress: 58/2009 symbols completed. ALC took 1.2s. Estimated remaining: 13m 58s. Rate: 139.7 symbols/min [2025-09-30T22:04:41.431702] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-30T22:04:41.432330] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-30T22:04:41.434973] [INFO ] [MAIN ] Derivative Progress: 59/2009 symbols completed. ALG took 1.2s. Estimated remaining: 13m 45s. Rate: 141.9 symbols/min [2025-09-30T22:04:41.437306] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-09-30T22:04:41.437379] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-30T22:04:41.440445] [INFO ] [MAIN ] Derivative Progress: 60/2009 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 31s. Rate: 144.3 symbols/min [2025-09-30T22:04:41.441005] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:41.441197] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:41.441086] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:41.532068] [DEBUG] [LOCAL ] ALK: Loaded 53053 existing records from primary storage. [2025-09-30T22:04:41.533695] [INFO ] [MAIN ] ALK: Loaded 53053 primary data records. [2025-09-30T22:04:41.534525] [DEBUG] [LOCAL ] ALL: Loaded 50072 existing records from primary storage. [2025-09-30T22:04:41.575455] [INFO ] [MAIN ] ALL: Loaded 50072 primary data records. [2025-09-30T22:04:41.674702] [DEBUG] [LOCAL ] ALLE: Loaded 44763 existing records from primary storage. [2025-09-30T22:04:41.697024] [INFO ] [MAIN ] ALLE: Loaded 44763 primary data records. [2025-09-30T22:04:42.622155] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:42.636969] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53053 primary records. [2025-09-30T22:04:42.637789] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:42.637348] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-30T22:04:42.651926] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50072 primary records. [2025-09-30T22:04:42.660542] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:42.664618] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-30T22:04:42.667178] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44763 primary records. [2025-09-30T22:04:42.668938] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-30T22:04:42.671992] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-09-30T22:04:42.680711] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-30T22:04:42.686374] [INFO ] [MAIN ] Derivative Progress: 61/2009 symbols completed. ALK took 1.2s. Estimated remaining: 13m 57s. Rate: 139.7 symbols/min [2025-09-30T22:04:42.695183] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:42.700010] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-30T22:04:42.703299] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-30T22:04:42.706394] [INFO ] [MAIN ] Derivative Progress: 62/2009 symbols completed. ALL took 1.3s. Estimated remaining: 13m 43s. Rate: 141.9 symbols/min [2025-09-30T22:04:42.707078] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:42.711499] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-30T22:04:42.711679] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-30T22:04:42.714248] [INFO ] [MAIN ] Derivative Progress: 63/2009 symbols completed. ALLE took 1.3s. Estimated remaining: 13m 30s. Rate: 144.1 symbols/min [2025-09-30T22:04:42.714580] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:42.751204] [DEBUG] [LOCAL ] ALTG: Loaded 23519 existing records from primary storage. [2025-09-30T22:04:42.761636] [INFO ] [MAIN ] ALTG: Loaded 23519 primary data records. [2025-09-30T22:04:42.922341] [DEBUG] [LOCAL ] ALSN: Loaded 43237 existing records from primary storage. [2025-09-30T22:04:42.933550] [DEBUG] [LOCAL ] ALLY: Loaded 53219 existing records from primary storage. [2025-09-30T22:04:42.944073] [INFO ] [MAIN ] ALLY: Loaded 53219 primary data records. [2025-09-30T22:04:42.938839] [INFO ] [MAIN ] ALSN: Loaded 43237 primary data records. [2025-09-30T22:04:43.810075] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:43.812759] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23519 primary records. [2025-09-30T22:04:43.813002] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-30T22:04:43.833762] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-30T22:04:43.835274] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-30T22:04:43.838039] [INFO ] [MAIN ] Derivative Progress: 64/2009 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 51s. Rate: 140.4 symbols/min [2025-09-30T22:04:43.838319] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:43.854724] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:43.855696] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43237 primary records. [2025-09-30T22:04:43.856020] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-30T22:04:43.870061] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:43.871414] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53219 primary records. [2025-09-30T22:04:43.881758] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-30T22:04:43.893111] [DEBUG] [LOCAL ] ALUR: Loaded 10769 existing records from primary storage. [2025-09-30T22:04:43.902085] [INFO ] [MAIN ] ALUR: Loaded 10769 primary data records. [2025-09-30T22:04:43.961476] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-30T22:04:43.986140] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-30T22:04:43.986028] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-30T22:04:43.988700] [INFO ] [MAIN ] Derivative Progress: 65/2009 symbols completed. ALLY took 1.3s. Estimated remaining: 13m 43s. Rate: 141.8 symbols/min [2025-09-30T22:04:44.013008] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-30T22:04:44.013196] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:44.035462] [INFO ] [MAIN ] Derivative Progress: 66/2009 symbols completed. ALSN took 1.3s. Estimated remaining: 13m 31s. Rate: 143.7 symbols/min [2025-09-30T22:04:44.040895] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:44.134047] [DEBUG] [LOCAL ] ALX: Loaded 6175 existing records from primary storage. [2025-09-30T22:04:44.243893] [INFO ] [MAIN ] ALX: Loaded 6175 primary data records. [2025-09-30T22:04:44.578871] [DEBUG] [LOCAL ] ALV: Loaded 42426 existing records from primary storage. [2025-09-30T22:04:44.609107] [INFO ] [MAIN ] ALV: Loaded 42426 primary data records. [2025-09-30T22:04:44.816524] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:04:44.841146] [INFO ] [MAIN ] ALUR: Generated 1793 derivative records from 10769 primary records. [2025-09-30T22:04:44.841418] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-30T22:04:45.036490] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1793 records). [2025-09-30T22:04:45.038472] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-30T22:04:45.040561] [INFO ] [MAIN ] Derivative Progress: 67/2009 symbols completed. ALUR took 1.2s. Estimated remaining: 13m 48s. Rate: 140.8 symbols/min [2025-09-30T22:04:45.042681] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:45.059475] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:45.060546] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6175 primary records. [2025-09-30T22:04:45.060867] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-30T22:04:45.080969] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-30T22:04:45.081429] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-30T22:04:45.083751] [INFO ] [MAIN ] Derivative Progress: 68/2009 symbols completed. ALX took 1.0s. Estimated remaining: 13m 36s. Rate: 142.7 symbols/min [2025-09-30T22:04:45.084203] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:45.102538] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:45.118173] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42426 primary records. [2025-09-30T22:04:45.118348] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-30T22:04:45.135181] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-30T22:04:45.142901] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-30T22:04:45.146867] [INFO ] [MAIN ] Derivative Progress: 69/2009 symbols completed. ALV took 1.1s. Estimated remaining: 13m 26s. Rate: 144.4 symbols/min [2025-09-30T22:04:45.147292] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:45.176319] [DEBUG] [LOCAL ] AM: Loaded 52080 existing records from primary storage. [2025-09-30T22:04:45.176624] [INFO ] [MAIN ] AM: Loaded 52080 primary data records. [2025-09-30T22:04:45.177289] [DEBUG] [LOCAL ] AMBC: Loaded 36609 existing records from primary storage. [2025-09-30T22:04:45.182927] [INFO ] [MAIN ] AMBC: Loaded 36609 primary data records. [2025-09-30T22:04:45.874522] [DEBUG] [LOCAL ] AMBP: Loaded 45060 existing records from primary storage. [2025-09-30T22:04:45.876238] [INFO ] [MAIN ] AMBP: Loaded 45060 primary data records. [2025-09-30T22:04:46.230854] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:46.233806] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52080 primary records. [2025-09-30T22:04:46.234012] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-30T22:04:46.257197] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:46.270484] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36609 primary records. [2025-09-30T22:04:46.272838] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-30T22:04:46.276626] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-30T22:04:46.290069] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-30T22:04:46.292941] [INFO ] [MAIN ] Derivative Progress: 70/2009 symbols completed. AM took 1.3s. Estimated remaining: 13m 46s. Rate: 140.9 symbols/min [2025-09-30T22:04:46.293378] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:46.296754] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-30T22:04:46.297179] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-30T22:04:46.300545] [INFO ] [MAIN ] Derivative Progress: 71/2009 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 34s. Rate: 142.9 symbols/min [2025-09-30T22:04:46.301629] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:46.315947] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:46.316711] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45060 primary records. [2025-09-30T22:04:46.316819] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-30T22:04:46.334172] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-30T22:04:46.334255] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-30T22:04:46.336547] [INFO ] [MAIN ] Derivative Progress: 72/2009 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 23s. Rate: 144.7 symbols/min [2025-09-30T22:04:46.336885] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:46.394507] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-09-30T22:04:46.395294] [INFO ] [MAIN ] AMC: Loaded 53760 primary data records. [2025-09-30T22:04:46.491114] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-30T22:04:46.512324] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-09-30T22:04:46.809813] [DEBUG] [LOCAL ] AME: Loaded 48527 existing records from primary storage. [2025-09-30T22:04:46.881439] [INFO ] [MAIN ] AME: Loaded 48527 primary data records. [2025-09-30T22:04:47.508485] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:47.510501] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53760 primary records. [2025-09-30T22:04:47.510853] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-30T22:04:47.525025] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:47.526542] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-09-30T22:04:47.538896] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-30T22:04:47.579319] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:47.580542] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48527 primary records. [2025-09-30T22:04:47.581041] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-30T22:04:47.578738] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-30T22:04:47.582036] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-30T22:04:47.585210] [INFO ] [MAIN ] Derivative Progress: 73/2009 symbols completed. AMC took 1.3s. Estimated remaining: 13m 45s. Rate: 140.8 symbols/min [2025-09-30T22:04:47.587025] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-30T22:04:47.594807] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-30T22:04:47.598214] [INFO ] [MAIN ] Derivative Progress: 74/2009 symbols completed. AMCR took 1.3s. Estimated remaining: 13m 34s. Rate: 142.7 symbols/min [2025-09-30T22:04:47.605745] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-30T22:04:47.605814] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-30T22:04:47.608415] [INFO ] [MAIN ] Derivative Progress: 75/2009 symbols completed. AME took 1.3s. Estimated remaining: 13m 23s. Rate: 144.6 symbols/min [2025-09-30T22:04:47.608830] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:47.609004] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:47.608911] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:47.640550] [DEBUG] [LOCAL ] AMG: Loaded 20444 existing records from primary storage. [2025-09-30T22:04:47.640885] [INFO ] [MAIN ] AMG: Loaded 20444 primary data records. [2025-09-30T22:04:47.833686] [DEBUG] [LOCAL ] AMN: Loaded 41757 existing records from primary storage. [2025-09-30T22:04:47.867711] [INFO ] [MAIN ] AMN: Loaded 41757 primary data records. [2025-09-30T22:04:48.118317] [DEBUG] [LOCAL ] AMH: Loaded 51702 existing records from primary storage. [2025-09-30T22:04:48.142568] [INFO ] [MAIN ] AMH: Loaded 51702 primary data records. [2025-09-30T22:04:48.712224] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:48.713384] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20444 primary records. [2025-09-30T22:04:48.713797] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-30T22:04:48.749015] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-30T22:04:48.749473] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:48.750593] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-30T22:04:48.752879] [INFO ] [MAIN ] Derivative Progress: 76/2009 symbols completed. AMG took 1.1s. Estimated remaining: 13m 41s. Rate: 141.3 symbols/min [2025-09-30T22:04:48.750494] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41757 primary records. [2025-09-30T22:04:48.753203] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-30T22:04:48.753510] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:48.774587] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-30T22:04:48.774762] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-30T22:04:48.777108] [INFO ] [MAIN ] Derivative Progress: 77/2009 symbols completed. AMN took 1.2s. Estimated remaining: 13m 30s. Rate: 143.1 symbols/min [2025-09-30T22:04:48.785357] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:48.791125] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:04:48.792148] [INFO ] [MAIN ] AMH: Generated 1793 derivative records from 51702 primary records. [2025-09-30T22:04:48.792273] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-30T22:04:48.812092] [DEBUG] [LOCAL ] AMH: Derivative data saved (1793 records). [2025-09-30T22:04:48.812249] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-30T22:04:48.815392] [INFO ] [MAIN ] Derivative Progress: 78/2009 symbols completed. AMH took 1.2s. Estimated remaining: 13m 20s. Rate: 144.8 symbols/min [2025-09-30T22:04:48.815796] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:48.875076] [DEBUG] [LOCAL ] AMPY: Loaded 37712 existing records from primary storage. [2025-09-30T22:04:48.874383] [DEBUG] [LOCAL ] AMPX: Loaded 52247 existing records from primary storage. [2025-09-30T22:04:48.882168] [INFO ] [MAIN ] AMPX: Loaded 52247 primary data records. [2025-09-30T22:04:48.882286] [INFO ] [MAIN ] AMPY: Loaded 37712 primary data records. [2025-09-30T22:04:49.117117] [DEBUG] [LOCAL ] AMR: Loaded 28930 existing records from primary storage. [2025-09-30T22:04:49.180753] [INFO ] [MAIN ] AMR: Loaded 28930 primary data records. [2025-09-30T22:04:49.917356] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:49.918177] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:49.919124] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52247 primary records. [2025-09-30T22:04:49.919893] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37712 primary records. [2025-09-30T22:04:49.919958] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-30T22:04:49.920085] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-30T22:04:49.954397] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-30T22:04:49.954905] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-30T22:04:49.957448] [INFO ] [MAIN ] Derivative Progress: 79/2009 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 38s. Rate: 141.6 symbols/min [2025-09-30T22:04:49.958065] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-09-30T22:04:49.958177] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:49.958609] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-30T22:04:49.961056] [INFO ] [MAIN ] Derivative Progress: 80/2009 symbols completed. AMPY took 1.2s. Estimated remaining: 13m 27s. Rate: 143.4 symbols/min [2025-09-30T22:04:49.961815] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:49.979602] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:49.980530] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28930 primary records. [2025-09-30T22:04:49.980675] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-30T22:04:50.000114] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-30T22:04:50.000271] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-30T22:04:50.006796] [INFO ] [MAIN ] Derivative Progress: 81/2009 symbols completed. AMR took 1.2s. Estimated remaining: 13m 18s. Rate: 145.0 symbols/min [2025-09-30T22:04:50.007072] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:50.052325] [DEBUG] [LOCAL ] AMRC: Loaded 38174 existing records from primary storage. [2025-09-30T22:04:50.052576] [INFO ] [MAIN ] AMRC: Loaded 38174 primary data records. [2025-09-30T22:04:50.120987] [DEBUG] [LOCAL ] AMTB: Loaded 20278 existing records from primary storage. [2025-09-30T22:04:50.187229] [DEBUG] [LOCAL ] AMT: Loaded 52429 existing records from primary storage. [2025-09-30T22:04:50.182586] [INFO ] [MAIN ] AMTB: Loaded 20278 primary data records. [2025-09-30T22:04:50.193692] [INFO ] [MAIN ] AMT: Loaded 52429 primary data records. [2025-09-30T22:04:51.075538] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:51.076730] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38174 primary records. [2025-09-30T22:04:51.077022] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-30T22:04:51.123870] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:51.123543] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:51.125168] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52429 primary records. [2025-09-30T22:04:51.125769] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-30T22:04:51.127285] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20278 primary records. [2025-09-30T22:04:51.127806] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-30T22:04:51.154369] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-30T22:04:51.154801] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-30T22:04:51.158403] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-30T22:04:51.161603] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-30T22:04:51.161506] [INFO ] [MAIN ] Derivative Progress: 82/2009 symbols completed. AMRC took 1.2s. Estimated remaining: 13m 35s. Rate: 141.9 symbols/min [2025-09-30T22:04:51.164697] [INFO ] [MAIN ] Derivative Progress: 83/2009 symbols completed. AMT took 1.2s. Estimated remaining: 13m 25s. Rate: 143.6 symbols/min [2025-09-30T22:04:51.164573] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:51.165154] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:51.169211] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-30T22:04:51.169372] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-30T22:04:51.171786] [INFO ] [MAIN ] Derivative Progress: 84/2009 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 15s. Rate: 145.3 symbols/min [2025-09-30T22:04:51.173188] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:51.176802] [DEBUG] [LOCAL ] AMTD: Loaded 3603 existing records from primary storage. [2025-09-30T22:04:51.177001] [INFO ] [MAIN ] AMTD: Loaded 3603 primary data records. [2025-09-30T22:04:51.299247] [DEBUG] [LOCAL ] AMWL: Loaded 8761 existing records from primary storage. [2025-09-30T22:04:51.305175] [INFO ] [MAIN ] AMWL: Loaded 8761 primary data records. [2025-09-30T22:04:51.702210] [DEBUG] [LOCAL ] AMTM: Loaded 50639 existing records from primary storage. [2025-09-30T22:04:51.741965] [INFO ] [MAIN ] AMTM: Loaded 50639 primary data records. [2025-09-30T22:04:52.237500] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:52.238938] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3603 primary records. [2025-09-30T22:04:52.239530] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-30T22:04:52.271963] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:52.274076] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8761 primary records. [2025-09-30T22:04:52.274439] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-30T22:04:52.275101] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-30T22:04:52.276352] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-30T22:04:52.278771] [INFO ] [MAIN ] Derivative Progress: 85/2009 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 30s. Rate: 142.5 symbols/min [2025-09-30T22:04:52.279225] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:52.298447] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-30T22:04:52.298777] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-30T22:04:52.301233] [INFO ] [MAIN ] Derivative Progress: 86/2009 symbols completed. AMWL took 1.1s. Estimated remaining: 13m 21s. Rate: 144.1 symbols/min [2025-09-30T22:04:52.301480] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:52.314515] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:52.315694] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50639 primary records. [2025-09-30T22:04:52.315975] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-30T22:04:52.333694] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-09-30T22:04:52.333813] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-30T22:04:52.336452] [INFO ] [MAIN ] Derivative Progress: 87/2009 symbols completed. AMTM took 1.2s. Estimated remaining: 13m 12s. Rate: 145.6 symbols/min [2025-09-30T22:04:52.336783] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:52.378571] [DEBUG] [LOCAL ] AN: Loaded 32016 existing records from primary storage. [2025-09-30T22:04:52.378747] [INFO ] [MAIN ] AN: Loaded 32016 primary data records. [2025-09-30T22:04:52.536203] [DEBUG] [LOCAL ] AMX: Loaded 49110 existing records from primary storage. [2025-09-30T22:04:52.546881] [INFO ] [MAIN ] AMX: Loaded 49110 primary data records. [2025-09-30T22:04:52.819733] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-30T22:04:52.836274] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-30T22:04:53.752345] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:53.753903] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32016 primary records. [2025-09-30T22:04:53.754132] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-30T22:04:53.776422] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-30T22:04:53.776859] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-30T22:04:53.780336] [INFO ] [MAIN ] Derivative Progress: 88/2009 symbols completed. AN took 1.5s. Estimated remaining: 13m 34s. Rate: 141.6 symbols/min [2025-09-30T22:04:53.813178] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:53.813489] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:53.814568] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-30T22:04:53.815288] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49110 primary records. [2025-09-30T22:04:53.815386] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-30T22:04:53.815454] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-30T22:04:53.847331] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-30T22:04:53.851215] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-30T22:04:53.851304] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-30T22:04:53.853747] [INFO ] [MAIN ] Derivative Progress: 89/2009 symbols completed. AMX took 1.6s. Estimated remaining: 13m 26s. Rate: 142.9 symbols/min [2025-09-30T22:04:53.850866] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-30T22:04:53.856705] [INFO ] [MAIN ] Derivative Progress: 90/2009 symbols completed. ANET took 1.5s. Estimated remaining: 13m 17s. Rate: 144.5 symbols/min [2025-09-30T22:04:53.857096] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:53.857233] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:53.857389] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:53.883329] [DEBUG] [LOCAL ] ANRO: Loaded 18824 existing records from primary storage. [2025-09-30T22:04:53.883510] [INFO ] [MAIN ] ANRO: Loaded 18824 primary data records. [2025-09-30T22:04:54.022888] [DEBUG] [LOCAL ] ANVS: Loaded 23170 existing records from primary storage. [2025-09-30T22:04:54.023137] [INFO ] [MAIN ] ANVS: Loaded 23170 primary data records. [2025-09-30T22:04:54.347689] [DEBUG] [LOCAL ] ANF: Loaded 52136 existing records from primary storage. [2025-09-30T22:04:54.375163] [INFO ] [MAIN ] ANF: Loaded 52136 primary data records. [2025-09-30T22:04:54.957420] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:54.958913] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 18824 primary records. [2025-09-30T22:04:54.959138] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-30T22:04:54.998324] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:54.997919] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-30T22:04:54.999568] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23170 primary records. [2025-09-30T22:04:54.999884] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-30T22:04:55.000133] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-30T22:04:55.002961] [INFO ] [MAIN ] Derivative Progress: 91/2009 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 32s. Rate: 141.8 symbols/min [2025-09-30T22:04:55.003779] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:55.023832] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-30T22:04:55.024135] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-30T22:04:55.026518] [INFO ] [MAIN ] Derivative Progress: 92/2009 symbols completed. ANVS took 1.2s. Estimated remaining: 13m 23s. Rate: 143.2 symbols/min [2025-09-30T22:04:55.026842] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:55.040330] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:55.041333] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52136 primary records. [2025-09-30T22:04:55.041579] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-30T22:04:55.070440] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-30T22:04:55.079326] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-30T22:04:55.088853] [INFO ] [MAIN ] Derivative Progress: 93/2009 symbols completed. ANF took 1.2s. Estimated remaining: 13m 15s. Rate: 144.5 symbols/min [2025-09-30T22:04:55.089905] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:55.091053] [DEBUG] [LOCAL ] AOD: Loaded 30085 existing records from primary storage. [2025-09-30T22:04:55.091684] [INFO ] [MAIN ] AOD: Loaded 30085 primary data records. [2025-09-30T22:04:55.091394] [DEBUG] [LOCAL ] AOMR: Loaded 16575 existing records from primary storage. [2025-09-30T22:04:55.091903] [INFO ] [MAIN ] AOMR: Loaded 16575 primary data records. [2025-09-30T22:04:55.814714] [DEBUG] [LOCAL ] AON: Loaded 45425 existing records from primary storage. [2025-09-30T22:04:55.815728] [INFO ] [MAIN ] AON: Loaded 45425 primary data records. [2025-09-30T22:04:56.168540] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:56.169552] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16575 primary records. [2025-09-30T22:04:56.169775] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-30T22:04:56.184058] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:56.185300] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30085 primary records. [2025-09-30T22:04:56.185560] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-30T22:04:56.212926] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-30T22:04:56.213102] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-30T22:04:56.217167] [INFO ] [MAIN ] Derivative Progress: 94/2009 symbols completed. AOMR took 1.2s. Estimated remaining: 13m 29s. Rate: 142.0 symbols/min [2025-09-30T22:04:56.217459] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:56.221452] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-30T22:04:56.223174] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-30T22:04:56.225374] [INFO ] [MAIN ] Derivative Progress: 95/2009 symbols completed. AOD took 1.2s. Estimated remaining: 13m 21s. Rate: 143.4 symbols/min [2025-09-30T22:04:56.225699] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:56.239617] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:56.240349] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45425 primary records. [2025-09-30T22:04:56.240501] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-30T22:04:56.257287] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-30T22:04:56.257476] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-30T22:04:56.261143] [INFO ] [MAIN ] Derivative Progress: 96/2009 symbols completed. AON took 1.2s. Estimated remaining: 13m 13s. Rate: 144.8 symbols/min [2025-09-30T22:04:56.268989] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:56.283071] [DEBUG] [LOCAL ] AORT: Loaded 29478 existing records from primary storage. [2025-09-30T22:04:56.283276] [INFO ] [MAIN ] AORT: Loaded 29478 primary data records. [2025-09-30T22:04:56.463854] [DEBUG] [LOCAL ] AOS: Loaded 48866 existing records from primary storage. [2025-09-30T22:04:56.490576] [INFO ] [MAIN ] AOS: Loaded 48866 primary data records. [2025-09-30T22:04:56.750016] [DEBUG] [LOCAL ] APAM: Loaded 36128 existing records from primary storage. [2025-09-30T22:04:56.771124] [INFO ] [MAIN ] APAM: Loaded 36128 primary data records. [2025-09-30T22:04:57.346285] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:57.347116] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29478 primary records. [2025-09-30T22:04:57.348240] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-30T22:04:57.385985] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:57.387111] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48866 primary records. [2025-09-30T22:04:57.385614] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-30T22:04:57.387510] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-30T22:04:57.387677] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-30T22:04:57.390254] [INFO ] [MAIN ] Derivative Progress: 97/2009 symbols completed. AORT took 1.2s. Estimated remaining: 13m 26s. Rate: 142.3 symbols/min [2025-09-30T22:04:57.391137] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:57.410333] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-30T22:04:57.423362] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-30T22:04:57.423304] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:57.426550] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36128 primary records. [2025-09-30T22:04:57.426729] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-30T22:04:57.425685] [INFO ] [MAIN ] Derivative Progress: 98/2009 symbols completed. AOS took 1.2s. Estimated remaining: 13m 18s. Rate: 143.6 symbols/min [2025-09-30T22:04:57.427344] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:57.450278] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-09-30T22:04:57.450693] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-30T22:04:57.453810] [INFO ] [MAIN ] Derivative Progress: 99/2009 symbols completed. APAM took 1.2s. Estimated remaining: 13m 10s. Rate: 145.0 symbols/min [2025-09-30T22:04:57.454063] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:57.491019] [DEBUG] [LOCAL ] APG: Loaded 50186 existing records from primary storage. [2025-09-30T22:04:57.504298] [INFO ] [MAIN ] APG: Loaded 50186 primary data records. [2025-09-30T22:04:57.657104] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-30T22:04:57.657404] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-09-30T22:04:57.998520] [DEBUG] [LOCAL ] APLE: Loaded 51941 existing records from primary storage. [2025-09-30T22:04:57.999083] [INFO ] [MAIN ] APLE: Loaded 51941 primary data records. [2025-09-30T22:04:58.602667] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:58.603942] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50186 primary records. [2025-09-30T22:04:58.604197] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-30T22:04:58.626210] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:58.632248] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-09-30T22:04:58.635905] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-30T22:04:58.636362] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-09-30T22:04:58.637422] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-30T22:04:58.650809] [INFO ] [MAIN ] Derivative Progress: 100/2009 symbols completed. APG took 1.3s. Estimated remaining: 13m 25s. Rate: 142.3 symbols/min [2025-09-30T22:04:58.655347] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:58.674468] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-09-30T22:04:58.674995] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:04:58.675165] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-30T22:04:58.677595] [INFO ] [MAIN ] Derivative Progress: 101/2009 symbols completed. APH took 1.3s. Estimated remaining: 13m 17s. Rate: 143.6 symbols/min [2025-09-30T22:04:58.678739] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:58.678507] [INFO ] [MAIN ] APLE: Generated 1793 derivative records from 51941 primary records. [2025-09-30T22:04:58.679402] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-30T22:04:58.702586] [DEBUG] [LOCAL ] APOS: Loaded 7580 existing records from primary storage. [2025-09-30T22:04:58.704346] [INFO ] [MAIN ] APOS: Loaded 7580 primary data records. [2025-09-30T22:04:58.760758] [DEBUG] [LOCAL ] APLE: Derivative data saved (1793 records). [2025-09-30T22:04:58.779080] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-30T22:04:58.789803] [INFO ] [MAIN ] Derivative Progress: 102/2009 symbols completed. APLE took 1.3s. Estimated remaining: 13m 11s. Rate: 144.7 symbols/min [2025-09-30T22:04:58.814622] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:58.954617] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-09-30T22:04:59.075680] [INFO ] [MAIN ] APO: Loaded 53383 primary data records. [2025-09-30T22:04:59.296715] [DEBUG] [LOCAL ] APTV: Loaded 52122 existing records from primary storage. [2025-09-30T22:04:59.322802] [INFO ] [MAIN ] APTV: Loaded 52122 primary data records. [2025-09-30T22:04:59.814017] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:59.815150] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7580 primary records. [2025-09-30T22:04:59.815377] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-30T22:04:59.835094] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-30T22:04:59.835442] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-30T22:04:59.837827] [INFO ] [MAIN ] Derivative Progress: 103/2009 symbols completed. APOS took 1.2s. Estimated remaining: 13m 22s. Rate: 142.6 symbols/min [2025-09-30T22:04:59.856239] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:59.857017] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53383 primary records. [2025-09-30T22:04:59.857201] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-30T22:04:59.874221] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-30T22:04:59.874446] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-30T22:04:59.877526] [INFO ] [MAIN ] Derivative Progress: 104/2009 symbols completed. APO took 1.2s. Estimated remaining: 13m 15s. Rate: 143.8 symbols/min [2025-09-30T22:04:59.893225] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:04:59.894069] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52122 primary records. [2025-09-30T22:04:59.894137] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-30T22:04:59.910857] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-30T22:04:59.910920] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-30T22:04:59.913629] [INFO ] [MAIN ] Derivative Progress: 105/2009 symbols completed. APTV took 1.1s. Estimated remaining: 13m 7s. Rate: 145.1 symbols/min [2025-09-30T22:04:59.914168] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:59.914111] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:59.914489] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:04:59.932217] [DEBUG] [LOCAL ] ARDC: Loaded 14721 existing records from primary storage. [2025-09-30T22:04:59.932434] [INFO ] [MAIN ] ARDC: Loaded 14721 primary data records. [2025-09-30T22:05:00.347842] [DEBUG] [LOCAL ] AQN: Loaded 51903 existing records from primary storage. [2025-09-30T22:05:00.348283] [INFO ] [MAIN ] AQN: Loaded 51903 primary data records. [2025-09-30T22:05:00.349191] [DEBUG] [LOCAL ] AR: Loaded 53584 existing records from primary storage. [2025-09-30T22:05:00.349348] [INFO ] [MAIN ] AR: Loaded 53584 primary data records. [2025-09-30T22:05:01.054557] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:01.055922] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14721 primary records. [2025-09-30T22:05:01.056596] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-30T22:05:01.081904] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-30T22:05:01.083949] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-30T22:05:01.087567] [INFO ] [MAIN ] Derivative Progress: 106/2009 symbols completed. ARDC took 1.2s. Estimated remaining: 13m 21s. Rate: 142.6 symbols/min [2025-09-30T22:05:01.088139] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:01.105141] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:01.106497] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51903 primary records. [2025-09-30T22:05:01.106835] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-30T22:05:01.121543] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:01.129798] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53584 primary records. [2025-09-30T22:05:01.131030] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-30T22:05:01.139334] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-30T22:05:01.151342] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-30T22:05:01.162558] [INFO ] [MAIN ] Derivative Progress: 107/2009 symbols completed. AQN took 1.2s. Estimated remaining: 13m 14s. Rate: 143.7 symbols/min [2025-09-30T22:05:01.167677] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:01.177006] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-30T22:05:01.177267] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-30T22:05:01.180850] [INFO ] [MAIN ] Derivative Progress: 108/2009 symbols completed. AR took 1.3s. Estimated remaining: 13m 7s. Rate: 145.0 symbols/min [2025-09-30T22:05:01.181274] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:01.193399] [DEBUG] [LOCAL ] ARDT: Loaded 27698 existing records from primary storage. [2025-09-30T22:05:01.193630] [INFO ] [MAIN ] ARDT: Loaded 27698 primary data records. [2025-09-30T22:05:01.613322] [DEBUG] [LOCAL ] ARE: Loaded 50614 existing records from primary storage. [2025-09-30T22:05:01.619024] [INFO ] [MAIN ] ARE: Loaded 50614 primary data records. [2025-09-30T22:05:01.675082] [DEBUG] [LOCAL ] ARES: Loaded 49530 existing records from primary storage. [2025-09-30T22:05:01.698771] [INFO ] [MAIN ] ARES: Loaded 49530 primary data records. [2025-09-30T22:05:02.426973] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:02.428139] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27698 primary records. [2025-09-30T22:05:02.428475] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-30T22:05:02.450374] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-09-30T22:05:02.452319] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-30T22:05:02.455264] [INFO ] [MAIN ] Derivative Progress: 109/2009 symbols completed. ARDT took 1.4s. Estimated remaining: 13m 21s. Rate: 142.3 symbols/min [2025-09-30T22:05:02.456032] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:02.470085] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:02.471333] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50614 primary records. [2025-09-30T22:05:02.471678] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-30T22:05:02.502816] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:02.504379] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49530 primary records. [2025-09-30T22:05:02.504493] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-30T22:05:02.524440] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-30T22:05:02.525175] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-30T22:05:02.528098] [INFO ] [MAIN ] Derivative Progress: 110/2009 symbols completed. ARES took 1.3s. Estimated remaining: 13m 15s. Rate: 143.3 symbols/min [2025-09-30T22:05:02.525275] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-30T22:05:02.538601] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:02.538916] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-30T22:05:02.541332] [INFO ] [MAIN ] Derivative Progress: 111/2009 symbols completed. ARE took 1.4s. Estimated remaining: 13m 8s. Rate: 144.6 symbols/min [2025-09-30T22:05:02.541621] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:02.565775] [DEBUG] [LOCAL ] ARI: Loaded 43459 existing records from primary storage. [2025-09-30T22:05:02.565936] [INFO ] [MAIN ] ARI: Loaded 43459 primary data records. [2025-09-30T22:05:02.823837] [DEBUG] [LOCAL ] ARIS: Loaded 42103 existing records from primary storage. [2025-09-30T22:05:02.830917] [INFO ] [MAIN ] ARIS: Loaded 42103 primary data records. [2025-09-30T22:05:03.055367] [DEBUG] [LOCAL ] ARR: Loaded 52041 existing records from primary storage. [2025-09-30T22:05:03.068458] [INFO ] [MAIN ] ARR: Loaded 52041 primary data records. [2025-09-30T22:05:03.644609] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:03.645752] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43459 primary records. [2025-09-30T22:05:03.645860] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-30T22:05:03.666814] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-30T22:05:03.667010] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-30T22:05:03.669295] [INFO ] [MAIN ] Derivative Progress: 112/2009 symbols completed. ARI took 1.2s. Estimated remaining: 13m 19s. Rate: 142.4 symbols/min [2025-09-30T22:05:03.669728] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:03.685697] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:03.686914] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42103 primary records. [2025-09-30T22:05:03.686999] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-30T22:05:03.717479] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:03.719194] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52041 primary records. [2025-09-30T22:05:03.722477] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-30T22:05:03.722422] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-09-30T22:05:03.723352] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-30T22:05:03.726411] [INFO ] [MAIN ] Derivative Progress: 113/2009 symbols completed. ARIS took 1.2s. Estimated remaining: 13m 13s. Rate: 143.5 symbols/min [2025-09-30T22:05:03.726981] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:03.752775] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-30T22:05:03.753029] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-30T22:05:03.755719] [INFO ] [MAIN ] Derivative Progress: 114/2009 symbols completed. ARR took 1.2s. Estimated remaining: 13m 6s. Rate: 144.7 symbols/min [2025-09-30T22:05:03.756037] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:03.770356] [DEBUG] [LOCAL ] ARW: Loaded 33054 existing records from primary storage. [2025-09-30T22:05:03.771884] [INFO ] [MAIN ] ARW: Loaded 33054 primary data records. [2025-09-30T22:05:03.811125] [DEBUG] [LOCAL ] ASBA: Loaded 3450 existing records from primary storage. [2025-09-30T22:05:03.843638] [INFO ] [MAIN ] ASBA: Loaded 3450 primary data records. [2025-09-30T22:05:04.366183] [DEBUG] [LOCAL ] AS: Loaded 53084 existing records from primary storage. [2025-09-30T22:05:04.491496] [INFO ] [MAIN ] AS: Loaded 53084 primary data records. [2025-09-30T22:05:04.921258] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:04.923168] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33054 primary records. [2025-09-30T22:05:04.923729] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-30T22:05:04.957316] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-30T22:05:04.956597] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:04.957491] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-30T22:05:04.958571] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3450 primary records. [2025-09-30T22:05:04.960948] [INFO ] [MAIN ] Derivative Progress: 115/2009 symbols completed. ARW took 1.3s. Estimated remaining: 13m 18s. Rate: 142.3 symbols/min [2025-09-30T22:05:04.958712] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-30T22:05:04.962226] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:04.986509] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-30T22:05:04.987181] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-30T22:05:04.989943] [INFO ] [MAIN ] Derivative Progress: 116/2009 symbols completed. ASBA took 1.2s. Estimated remaining: 13m 12s. Rate: 143.5 symbols/min [2025-09-30T22:05:04.990474] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:05.008488] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:05:05.009526] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53084 primary records. [2025-09-30T22:05:05.009596] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-30T22:05:05.043494] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-09-30T22:05:05.043873] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-30T22:05:05.046845] [INFO ] [MAIN ] Derivative Progress: 117/2009 symbols completed. AS took 1.3s. Estimated remaining: 13m 5s. Rate: 144.6 symbols/min [2025-09-30T22:05:05.047290] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:05.058045] [DEBUG] [LOCAL ] ASGI: Loaded 22639 existing records from primary storage. [2025-09-30T22:05:05.069838] [INFO ] [MAIN ] ASGI: Loaded 22639 primary data records. [2025-09-30T22:05:05.070544] [DEBUG] [LOCAL ] ASC: Loaded 37479 existing records from primary storage. [2025-09-30T22:05:05.070907] [INFO ] [MAIN ] ASC: Loaded 37479 primary data records. [2025-09-30T22:05:05.428385] [DEBUG] [LOCAL ] ASGN: Loaded 35994 existing records from primary storage. [2025-09-30T22:05:05.441840] [INFO ] [MAIN ] ASGN: Loaded 35994 primary data records. [2025-09-30T22:05:06.108663] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:06.115622] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37479 primary records. [2025-09-30T22:05:06.114636] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:06.115828] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-30T22:05:06.117009] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22639 primary records. [2025-09-30T22:05:06.117170] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-30T22:05:06.151728] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-30T22:05:06.152805] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-30T22:05:06.155909] [INFO ] [MAIN ] Derivative Progress: 118/2009 symbols completed. ASC took 1.2s. Estimated remaining: 13m 16s. Rate: 142.5 symbols/min [2025-09-30T22:05:06.162219] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-30T22:05:06.162512] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-30T22:05:06.164801] [INFO ] [MAIN ] Derivative Progress: 119/2009 symbols completed. ASGI took 1.2s. Estimated remaining: 13m 9s. Rate: 143.7 symbols/min [2025-09-30T22:05:06.179005] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:06.180020] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 35994 primary records. [2025-09-30T22:05:06.180098] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-30T22:05:06.196596] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-30T22:05:06.196800] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-30T22:05:06.199561] [INFO ] [MAIN ] Derivative Progress: 120/2009 symbols completed. ASGN took 1.2s. Estimated remaining: 13m 3s. Rate: 144.8 symbols/min [2025-09-30T22:05:06.200113] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:06.200388] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:06.200226] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:06.238172] [DEBUG] [LOCAL ] ASIX: Loaded 22624 existing records from primary storage. [2025-09-30T22:05:06.238418] [INFO ] [MAIN ] ASIX: Loaded 22624 primary data records. [2025-09-30T22:05:06.388840] [DEBUG] [LOCAL ] ASH: Loaded 37777 existing records from primary storage. [2025-09-30T22:05:06.389056] [INFO ] [MAIN ] ASH: Loaded 37777 primary data records. [2025-09-30T22:05:06.406181] [DEBUG] [LOCAL ] ASPN: Loaded 49569 existing records from primary storage. [2025-09-30T22:05:06.433959] [INFO ] [MAIN ] ASPN: Loaded 49569 primary data records. [2025-09-30T22:05:07.327726] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:07.328770] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22624 primary records. [2025-09-30T22:05:07.328954] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-30T22:05:07.364495] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:07.366869] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49569 primary records. [2025-09-30T22:05:07.367631] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-30T22:05:07.370867] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-09-30T22:05:07.387672] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-30T22:05:07.397418] [INFO ] [MAIN ] Derivative Progress: 121/2009 symbols completed. ASIX took 1.2s. Estimated remaining: 13m 14s. Rate: 142.6 symbols/min [2025-09-30T22:05:07.399549] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:07.403325] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-30T22:05:07.400850] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:07.404791] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-30T22:05:07.404570] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37777 primary records. [2025-09-30T22:05:07.407907] [INFO ] [MAIN ] Derivative Progress: 122/2009 symbols completed. ASPN took 1.2s. Estimated remaining: 13m 8s. Rate: 143.7 symbols/min [2025-09-30T22:05:07.408205] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:07.408329] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-30T22:05:07.429682] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-30T22:05:07.434246] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-30T22:05:07.434175] [DEBUG] [LOCAL ] ASR: Loaded 9385 existing records from primary storage. [2025-09-30T22:05:07.437917] [INFO ] [MAIN ] Derivative Progress: 123/2009 symbols completed. ASH took 1.2s. Estimated remaining: 13m 1s. Rate: 144.8 symbols/min [2025-09-30T22:05:07.438036] [INFO ] [MAIN ] ASR: Loaded 9385 primary data records. [2025-09-30T22:05:07.438305] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:07.838305] [DEBUG] [LOCAL ] ASX: Loaded 52849 existing records from primary storage. [2025-09-30T22:05:07.838480] [INFO ] [MAIN ] ASX: Loaded 52849 primary data records. [2025-09-30T22:05:07.845187] [DEBUG] [LOCAL ] ATEN: Loaded 39539 existing records from primary storage. [2025-09-30T22:05:07.852879] [INFO ] [MAIN ] ATEN: Loaded 39539 primary data records. [2025-09-30T22:05:08.530613] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:08.532748] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9385 primary records. [2025-09-30T22:05:08.534682] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-30T22:05:08.560295] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-09-30T22:05:08.560800] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-30T22:05:08.563733] [INFO ] [MAIN ] Derivative Progress: 124/2009 symbols completed. ASR took 1.2s. Estimated remaining: 13m 12s. Rate: 142.9 symbols/min [2025-09-30T22:05:08.564203] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:08.584397] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:08.585301] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52849 primary records. [2025-09-30T22:05:08.598627] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-30T22:05:08.599686] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:08.601072] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39539 primary records. [2025-09-30T22:05:08.608676] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-30T22:05:08.639993] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-30T22:05:08.640750] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-30T22:05:08.644043] [INFO ] [MAIN ] Derivative Progress: 125/2009 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 6s. Rate: 143.8 symbols/min [2025-09-30T22:05:08.653659] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:08.657198] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-30T22:05:08.658133] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-30T22:05:08.660844] [INFO ] [MAIN ] Derivative Progress: 126/2009 symbols completed. ASX took 1.3s. Estimated remaining: 12m 60s. Rate: 144.9 symbols/min [2025-09-30T22:05:08.658019] [DEBUG] [LOCAL ] ATGE: Loaded 31544 existing records from primary storage. [2025-09-30T22:05:08.661272] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:08.661923] [INFO ] [MAIN ] ATGE: Loaded 31544 primary data records. [2025-09-30T22:05:08.747804] [DEBUG] [LOCAL ] ATHS: Loaded 6995 existing records from primary storage. [2025-09-30T22:05:08.753140] [INFO ] [MAIN ] ATHS: Loaded 6995 primary data records. [2025-09-30T22:05:09.390255] [DEBUG] [LOCAL ] ATI: Loaded 51513 existing records from primary storage. [2025-09-30T22:05:09.390714] [INFO ] [MAIN ] ATI: Loaded 51513 primary data records. [2025-09-30T22:05:09.741880] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:09.744350] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6995 primary records. [2025-09-30T22:05:09.744460] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-30T22:05:09.773184] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:09.774343] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31544 primary records. [2025-09-30T22:05:09.774708] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-30T22:05:09.790667] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-30T22:05:09.791700] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-30T22:05:09.794416] [INFO ] [MAIN ] Derivative Progress: 127/2009 symbols completed. ATHS took 1.1s. Estimated remaining: 13m 10s. Rate: 142.9 symbols/min [2025-09-30T22:05:09.795074] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:09.800815] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-30T22:05:09.802084] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-30T22:05:09.806284] [INFO ] [MAIN ] Derivative Progress: 128/2009 symbols completed. ATGE took 1.2s. Estimated remaining: 13m 4s. Rate: 144.0 symbols/min [2025-09-30T22:05:09.806766] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:09.825917] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:09.827105] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51513 primary records. [2025-09-30T22:05:09.827398] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-30T22:05:09.856484] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-30T22:05:09.856724] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-30T22:05:09.859973] [INFO ] [MAIN ] Derivative Progress: 129/2009 symbols completed. ATI took 1.2s. Estimated remaining: 12m 58s. Rate: 145.0 symbols/min [2025-09-30T22:05:09.860342] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:09.883010] [DEBUG] [LOCAL ] ATKR: Loaded 35629 existing records from primary storage. [2025-09-30T22:05:09.883350] [INFO ] [MAIN ] ATKR: Loaded 35629 primary data records. [2025-09-30T22:05:10.020524] [DEBUG] [LOCAL ] ATMU: Loaded 39448 existing records from primary storage. [2025-09-30T22:05:10.026532] [INFO ] [MAIN ] ATMU: Loaded 39448 primary data records. [2025-09-30T22:05:10.377771] [DEBUG] [LOCAL ] ATO: Loaded 41879 existing records from primary storage. [2025-09-30T22:05:10.378064] [INFO ] [MAIN ] ATO: Loaded 41879 primary data records. [2025-09-30T22:05:11.097589] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:11.099525] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35629 primary records. [2025-09-30T22:05:11.099679] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-30T22:05:11.120194] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-30T22:05:11.120674] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-30T22:05:11.123750] [INFO ] [MAIN ] Derivative Progress: 130/2009 symbols completed. ATKR took 1.3s. Estimated remaining: 13m 10s. Rate: 142.8 symbols/min [2025-09-30T22:05:11.124151] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:11.146971] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:11.155694] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41879 primary records. [2025-09-30T22:05:11.160829] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-30T22:05:11.161210] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:11.162412] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39448 primary records. [2025-09-30T22:05:11.162842] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-30T22:05:11.204342] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-30T22:05:11.205238] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-30T22:05:11.205336] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-30T22:05:11.208309] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-30T22:05:11.208166] [INFO ] [MAIN ] Derivative Progress: 131/2009 symbols completed. ATMU took 1.4s. Estimated remaining: 13m 4s. Rate: 143.6 symbols/min [2025-09-30T22:05:11.211847] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:11.212005] [INFO ] [MAIN ] Derivative Progress: 132/2009 symbols completed. ATO took 1.4s. Estimated remaining: 12m 58s. Rate: 144.7 symbols/min [2025-09-30T22:05:11.212135] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:11.224454] [DEBUG] [LOCAL ] ATR: Loaded 30427 existing records from primary storage. [2025-09-30T22:05:11.224829] [INFO ] [MAIN ] ATR: Loaded 30427 primary data records. [2025-09-30T22:05:11.341681] [DEBUG] [LOCAL ] ATS: Loaded 17824 existing records from primary storage. [2025-09-30T22:05:11.354930] [INFO ] [MAIN ] ATS: Loaded 17824 primary data records. [2025-09-30T22:05:11.730360] [DEBUG] [LOCAL ] ATUS: Loaded 49257 existing records from primary storage. [2025-09-30T22:05:11.790269] [INFO ] [MAIN ] ATUS: Loaded 49257 primary data records. [2025-09-30T22:05:12.313757] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:12.317532] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30427 primary records. [2025-09-30T22:05:12.317906] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-30T22:05:12.346231] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:12.347351] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17824 primary records. [2025-09-30T22:05:12.348607] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-30T22:05:12.351681] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-30T22:05:12.359145] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-30T22:05:12.362071] [INFO ] [MAIN ] Derivative Progress: 133/2009 symbols completed. ATR took 1.2s. Estimated remaining: 13m 8s. Rate: 142.8 symbols/min [2025-09-30T22:05:12.372466] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-30T22:05:12.372607] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-30T22:05:12.375251] [INFO ] [MAIN ] Derivative Progress: 134/2009 symbols completed. ATS took 1.2s. Estimated remaining: 13m 2s. Rate: 143.9 symbols/min [2025-09-30T22:05:12.391425] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:12.392169] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49257 primary records. [2025-09-30T22:05:12.392235] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-30T22:05:12.408831] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-09-30T22:05:12.408982] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-30T22:05:12.411788] [INFO ] [MAIN ] Derivative Progress: 135/2009 symbols completed. ATUS took 1.2s. Estimated remaining: 12m 56s. Rate: 144.8 symbols/min [2025-09-30T22:05:12.412445] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:12.413113] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:12.412555] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:12.422993] [DEBUG] [LOCAL ] AUNA: Loaded 4917 existing records from primary storage. [2025-09-30T22:05:12.423335] [INFO ] [MAIN ] AUNA: Loaded 4917 primary data records. [2025-09-30T22:05:12.820543] [DEBUG] [LOCAL ] AUB: Loaded 46327 existing records from primary storage. [2025-09-30T22:05:12.822390] [DEBUG] [LOCAL ] AU: Loaded 52991 existing records from primary storage. [2025-09-30T22:05:12.822859] [INFO ] [MAIN ] AU: Loaded 52991 primary data records. [2025-09-30T22:05:12.821626] [INFO ] [MAIN ] AUB: Loaded 46327 primary data records. [2025-09-30T22:05:13.534137] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:13.535542] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4917 primary records. [2025-09-30T22:05:13.535698] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-30T22:05:13.557261] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-09-30T22:05:13.557767] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-30T22:05:13.560563] [INFO ] [MAIN ] Derivative Progress: 136/2009 symbols completed. AUNA took 1.1s. Estimated remaining: 13m 6s. Rate: 143.0 symbols/min [2025-09-30T22:05:13.561506] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:13.585287] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:13.598825] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52991 primary records. [2025-09-30T22:05:13.599163] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-30T22:05:13.599405] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:13.600073] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46327 primary records. [2025-09-30T22:05:13.601061] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-30T22:05:13.631944] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-30T22:05:13.634081] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-30T22:05:13.637414] [INFO ] [MAIN ] Derivative Progress: 137/2009 symbols completed. AU took 1.2s. Estimated remaining: 13m 1s. Rate: 143.8 symbols/min [2025-09-30T22:05:13.637699] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:13.635533] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-30T22:05:13.637927] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-30T22:05:13.641059] [INFO ] [MAIN ] Derivative Progress: 138/2009 symbols completed. AUB took 1.2s. Estimated remaining: 12m 55s. Rate: 144.9 symbols/min [2025-09-30T22:05:13.641687] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:13.661017] [DEBUG] [LOCAL ] AVAL: Loaded 8759 existing records from primary storage. [2025-09-30T22:05:13.661761] [INFO ] [MAIN ] AVAL: Loaded 8759 primary data records. [2025-09-30T22:05:13.775361] [DEBUG] [LOCAL ] AVA: Loaded 39426 existing records from primary storage. [2025-09-30T22:05:13.795767] [INFO ] [MAIN ] AVA: Loaded 39426 primary data records. [2025-09-30T22:05:13.795678] [DEBUG] [LOCAL ] AVD: Loaded 22636 existing records from primary storage. [2025-09-30T22:05:13.840581] [INFO ] [MAIN ] AVD: Loaded 22636 primary data records. [2025-09-30T22:05:14.707271] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:14.708436] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8759 primary records. [2025-09-30T22:05:14.708538] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-30T22:05:14.727578] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-30T22:05:14.727803] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-30T22:05:14.730278] [INFO ] [MAIN ] Derivative Progress: 139/2009 symbols completed. AVAL took 1.1s. Estimated remaining: 13m 4s. Rate: 143.2 symbols/min [2025-09-30T22:05:14.743259] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:14.744814] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:14.747542] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39426 primary records. [2025-09-30T22:05:14.748546] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-30T22:05:14.778588] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:14.779411] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22636 primary records. [2025-09-30T22:05:14.779489] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-30T22:05:14.804880] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-30T22:05:14.805054] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-30T22:05:14.803859] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-30T22:05:14.805166] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-30T22:05:14.807787] [INFO ] [MAIN ] Derivative Progress: 140/2009 symbols completed. AVD took 1.2s. Estimated remaining: 12m 59s. Rate: 144.0 symbols/min [2025-09-30T22:05:14.813618] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:14.816481] [INFO ] [MAIN ] Derivative Progress: 141/2009 symbols completed. AVA took 1.3s. Estimated remaining: 12m 53s. Rate: 145.0 symbols/min [2025-09-30T22:05:14.816800] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:14.818465] [DEBUG] [LOCAL ] AVK: Loaded 17882 existing records from primary storage. [2025-09-30T22:05:14.819251] [INFO ] [MAIN ] AVK: Loaded 17882 primary data records. [2025-09-30T22:05:15.178631] [DEBUG] [LOCAL ] AVNS: Loaded 33665 existing records from primary storage. [2025-09-30T22:05:15.179074] [INFO ] [MAIN ] AVNS: Loaded 33665 primary data records. [2025-09-30T22:05:15.229456] [DEBUG] [LOCAL ] AVNT: Loaded 39241 existing records from primary storage. [2025-09-30T22:05:15.263177] [INFO ] [MAIN ] AVNT: Loaded 39241 primary data records. [2025-09-30T22:05:15.909773] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:15.911258] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 17882 primary records. [2025-09-30T22:05:15.911467] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-30T22:05:15.930598] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-30T22:05:15.930739] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-30T22:05:15.933297] [INFO ] [MAIN ] Derivative Progress: 142/2009 symbols completed. AVK took 1.2s. Estimated remaining: 13m 2s. Rate: 143.3 symbols/min [2025-09-30T22:05:15.933696] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:15.954403] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:15.967390] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33665 primary records. [2025-09-30T22:05:15.967723] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:15.968420] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39241 primary records. [2025-09-30T22:05:15.968508] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-30T22:05:15.968587] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-30T22:05:16.001699] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-30T22:05:16.002219] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-30T22:05:16.002020] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-09-30T22:05:16.004802] [INFO ] [MAIN ] Derivative Progress: 143/2009 symbols completed. AVNS took 1.2s. Estimated remaining: 12m 57s. Rate: 144.2 symbols/min [2025-09-30T22:05:16.004972] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-30T22:05:16.005107] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:16.023139] [INFO ] [MAIN ] Derivative Progress: 144/2009 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 51s. Rate: 145.1 symbols/min [2025-09-30T22:05:16.023411] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:16.050425] [DEBUG] [LOCAL ] AVTR: Loaded 53562 existing records from primary storage. [2025-09-30T22:05:16.050666] [INFO ] [MAIN ] AVTR: Loaded 53562 primary data records. [2025-09-30T22:05:16.226016] [DEBUG] [LOCAL ] AVY: Loaded 37441 existing records from primary storage. [2025-09-30T22:05:16.279887] [INFO ] [MAIN ] AVY: Loaded 37441 primary data records. [2025-09-30T22:05:16.521080] [DEBUG] [LOCAL ] AWK: Loaded 48708 existing records from primary storage. [2025-09-30T22:05:16.533241] [INFO ] [MAIN ] AWK: Loaded 48708 primary data records. [2025-09-30T22:05:17.126009] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:17.127283] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53562 primary records. [2025-09-30T22:05:17.128056] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-30T22:05:17.146667] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-30T22:05:17.147590] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-30T22:05:17.150757] [INFO ] [MAIN ] Derivative Progress: 145/2009 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 60s. Rate: 143.4 symbols/min [2025-09-30T22:05:17.151138] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:17.172754] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:17.173592] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37441 primary records. [2025-09-30T22:05:17.179140] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-30T22:05:17.206534] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-30T22:05:17.206748] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-30T22:05:17.217153] [INFO ] [MAIN ] Derivative Progress: 146/2009 symbols completed. AVY took 1.2s. Estimated remaining: 12m 55s. Rate: 144.2 symbols/min [2025-09-30T22:05:17.217351] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:17.206113] [DEBUG] [LOCAL ] AWP: Loaded 21576 existing records from primary storage. [2025-09-30T22:05:17.223309] [INFO ] [MAIN ] AWP: Loaded 21576 primary data records. [2025-09-30T22:05:17.223678] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:17.230229] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48708 primary records. [2025-09-30T22:05:17.260168] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-30T22:05:17.363921] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-30T22:05:17.374604] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-30T22:05:17.396234] [INFO ] [MAIN ] Derivative Progress: 147/2009 symbols completed. AWK took 1.4s. Estimated remaining: 12m 52s. Rate: 144.8 symbols/min [2025-09-30T22:05:17.396505] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:17.419531] [DEBUG] [LOCAL ] AWR: Loaded 22569 existing records from primary storage. [2025-09-30T22:05:17.419746] [INFO ] [MAIN ] AWR: Loaded 22569 primary data records. [2025-09-30T22:05:17.789418] [DEBUG] [LOCAL ] AX: Loaded 28340 existing records from primary storage. [2025-09-30T22:05:17.789579] [INFO ] [MAIN ] AX: Loaded 28340 primary data records. [2025-09-30T22:05:18.341853] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:18.343388] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21576 primary records. [2025-09-30T22:05:18.344095] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-30T22:05:18.363329] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-30T22:05:18.363776] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-30T22:05:18.365995] [INFO ] [MAIN ] Derivative Progress: 148/2009 symbols completed. AWP took 1.2s. Estimated remaining: 12m 58s. Rate: 143.5 symbols/min [2025-09-30T22:05:18.384351] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:18.385248] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22569 primary records. [2025-09-30T22:05:18.385404] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-30T22:05:18.404538] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-30T22:05:18.404717] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-30T22:05:18.407682] [INFO ] [MAIN ] Derivative Progress: 149/2009 symbols completed. AWR took 1.2s. Estimated remaining: 12m 53s. Rate: 144.4 symbols/min [2025-09-30T22:05:18.421064] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:18.421726] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28340 primary records. [2025-09-30T22:05:18.421791] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-30T22:05:18.437182] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-30T22:05:18.437305] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-30T22:05:18.440323] [INFO ] [MAIN ] Derivative Progress: 150/2009 symbols completed. AX took 1.0s. Estimated remaining: 12m 48s. Rate: 145.3 symbols/min [2025-09-30T22:05:18.441271] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:18.441169] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:18.441367] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:18.447863] [DEBUG] [LOCAL ] AXR: Loaded 3063 existing records from primary storage. [2025-09-30T22:05:18.448107] [INFO ] [MAIN ] AXR: Loaded 3063 primary data records. [2025-09-30T22:05:18.842986] [DEBUG] [LOCAL ] AXL: Loaded 50501 existing records from primary storage. [2025-09-30T22:05:18.858027] [INFO ] [MAIN ] AXL: Loaded 50501 primary data records. [2025-09-30T22:05:18.900311] [DEBUG] [LOCAL ] AXP: Loaded 53200 existing records from primary storage. [2025-09-30T22:05:18.908068] [INFO ] [MAIN ] AXP: Loaded 53200 primary data records. [2025-09-30T22:05:19.550730] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:19.553436] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 3063 primary records. [2025-09-30T22:05:19.554256] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-30T22:05:19.574005] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-09-30T22:05:19.574332] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-30T22:05:19.577369] [INFO ] [MAIN ] Derivative Progress: 151/2009 symbols completed. AXR took 1.1s. Estimated remaining: 12m 56s. Rate: 143.6 symbols/min [2025-09-30T22:05:19.577785] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:19.601942] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:19.604137] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53200 primary records. [2025-09-30T22:05:19.604316] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-30T22:05:19.618583] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:19.627983] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50501 primary records. [2025-09-30T22:05:19.630834] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-30T22:05:19.660237] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-30T22:05:19.660915] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-30T22:05:19.664277] [INFO ] [MAIN ] Derivative Progress: 152/2009 symbols completed. AXL took 1.2s. Estimated remaining: 12m 52s. Rate: 144.4 symbols/min [2025-09-30T22:05:19.665329] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:19.667238] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-30T22:05:19.668080] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-30T22:05:19.670998] [INFO ] [MAIN ] Derivative Progress: 153/2009 symbols completed. AXP took 1.2s. Estimated remaining: 12m 46s. Rate: 145.3 symbols/min [2025-09-30T22:05:19.671174] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:19.684473] [DEBUG] [LOCAL ] AXS: Loaded 38397 existing records from primary storage. [2025-09-30T22:05:19.684686] [INFO ] [MAIN ] AXS: Loaded 38397 primary data records. [2025-09-30T22:05:19.788684] [DEBUG] [LOCAL ] AZO: Loaded 11334 existing records from primary storage. [2025-09-30T22:05:19.817532] [INFO ] [MAIN ] AZO: Loaded 11334 primary data records. [2025-09-30T22:05:19.926270] [DEBUG] [LOCAL ] AYI: Loaded 25081 existing records from primary storage. [2025-09-30T22:05:19.983531] [INFO ] [MAIN ] AYI: Loaded 25081 primary data records. [2025-09-30T22:05:20.782294] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:20.785163] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38397 primary records. [2025-09-30T22:05:20.787699] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-30T22:05:20.811201] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:20.817492] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11334 primary records. [2025-09-30T22:05:20.819320] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-30T22:05:20.837159] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-30T22:05:20.842405] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-30T22:05:20.845837] [INFO ] [MAIN ] Derivative Progress: 154/2009 symbols completed. AXS took 1.3s. Estimated remaining: 12m 55s. Rate: 143.6 symbols/min [2025-09-30T22:05:20.846108] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:20.866119] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:20.867682] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25081 primary records. [2025-09-30T22:05:20.867829] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-30T22:05:20.871527] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-30T22:05:20.882743] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-30T22:05:20.886130] [INFO ] [MAIN ] Derivative Progress: 155/2009 symbols completed. AZO took 1.2s. Estimated remaining: 12m 50s. Rate: 144.4 symbols/min [2025-09-30T22:05:20.886992] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:20.898231] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-09-30T22:05:20.898488] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-30T22:05:20.901833] [INFO ] [MAIN ] Derivative Progress: 156/2009 symbols completed. AYI took 1.2s. Estimated remaining: 12m 45s. Rate: 145.3 symbols/min [2025-09-30T22:05:20.902192] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:20.915004] [DEBUG] [LOCAL ] AZZ: Loaded 21981 existing records from primary storage. [2025-09-30T22:05:20.915190] [INFO ] [MAIN ] AZZ: Loaded 21981 primary data records. [2025-09-30T22:05:21.283377] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-09-30T22:05:21.284819] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-09-30T22:05:21.387096] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-30T22:05:21.397841] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-30T22:05:22.057004] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:22.059322] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 21981 primary records. [2025-09-30T22:05:22.059813] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-30T22:05:22.080245] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-30T22:05:22.080838] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-30T22:05:22.083576] [INFO ] [MAIN ] Derivative Progress: 157/2009 symbols completed. AZZ took 1.2s. Estimated remaining: 12m 54s. Rate: 143.6 symbols/min [2025-09-30T22:05:22.085698] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:22.107862] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:22.109075] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-09-30T22:05:22.109416] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-30T22:05:22.130894] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-30T22:05:22.131242] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-30T22:05:22.141485] [INFO ] [MAIN ] Derivative Progress: 158/2009 symbols completed. BA took 1.3s. Estimated remaining: 12m 49s. Rate: 144.4 symbols/min [2025-09-30T22:05:22.147840] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:22.148865] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:22.149698] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-30T22:05:22.149914] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-30T22:05:22.169022] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-30T22:05:22.169339] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-30T22:05:22.172491] [INFO ] [MAIN ] Derivative Progress: 159/2009 symbols completed. BAC took 1.3s. Estimated remaining: 12m 44s. Rate: 145.2 symbols/min [2025-09-30T22:05:22.186467] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:22.220931] [DEBUG] [LOCAL ] BAH: Loaded 51655 existing records from primary storage. [2025-09-30T22:05:22.221277] [INFO ] [MAIN ] BAH: Loaded 51655 primary data records. [2025-09-30T22:05:22.389908] [DEBUG] [LOCAL ] BALL: Loaded 51794 existing records from primary storage. [2025-09-30T22:05:22.434586] [INFO ] [MAIN ] BALL: Loaded 51794 primary data records. [2025-09-30T22:05:22.478969] [DEBUG] [LOCAL ] BANC: Loaded 51234 existing records from primary storage. [2025-09-30T22:05:22.615604] [INFO ] [MAIN ] BANC: Loaded 51234 primary data records. [2025-09-30T22:05:23.294914] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:23.295976] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51655 primary records. [2025-09-30T22:05:23.297476] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-30T22:05:23.327628] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-30T22:05:23.333385] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-30T22:05:23.333877] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:23.334868] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51794 primary records. [2025-09-30T22:05:23.337010] [INFO ] [MAIN ] Derivative Progress: 160/2009 symbols completed. BAH took 1.3s. Estimated remaining: 12m 53s. Rate: 143.6 symbols/min [2025-09-30T22:05:23.337285] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-30T22:05:23.338958] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:23.374575] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-30T22:05:23.375048] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-30T22:05:23.377937] [INFO ] [MAIN ] Derivative Progress: 161/2009 symbols completed. BALL took 1.2s. Estimated remaining: 12m 48s. Rate: 144.4 symbols/min [2025-09-30T22:05:23.375396] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:23.378295] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:23.379219] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51234 primary records. [2025-09-30T22:05:23.379506] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-30T22:05:23.405535] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-30T22:05:23.405698] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-30T22:05:23.409345] [INFO ] [MAIN ] Derivative Progress: 162/2009 symbols completed. BANC took 1.2s. Estimated remaining: 12m 43s. Rate: 145.2 symbols/min [2025-09-30T22:05:23.409757] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:23.424073] [DEBUG] [LOCAL ] BAP: Loaded 26131 existing records from primary storage. [2025-09-30T22:05:23.424354] [INFO ] [MAIN ] BAP: Loaded 26131 primary data records. [2025-09-30T22:05:23.714174] [DEBUG] [LOCAL ] BAX: Loaded 53492 existing records from primary storage. [2025-09-30T22:05:23.715386] [INFO ] [MAIN ] BAX: Loaded 53492 primary data records. [2025-09-30T22:05:23.899036] [DEBUG] [LOCAL ] BB: Loaded 52928 existing records from primary storage. [2025-09-30T22:05:23.916306] [INFO ] [MAIN ] BB: Loaded 52928 primary data records. [2025-09-30T22:05:24.658115] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:24.659315] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26131 primary records. [2025-09-30T22:05:24.659664] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-30T22:05:24.679962] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-30T22:05:24.680814] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-30T22:05:24.683250] [INFO ] [MAIN ] Derivative Progress: 163/2009 symbols completed. BAP took 1.3s. Estimated remaining: 12m 52s. Rate: 143.4 symbols/min [2025-09-30T22:05:24.701606] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:24.702432] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53492 primary records. [2025-09-30T22:05:24.702628] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-30T22:05:24.734623] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-30T22:05:24.733367] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:24.735425] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52928 primary records. [2025-09-30T22:05:24.735521] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-30T22:05:24.738238] [INFO ] [MAIN ] Derivative Progress: 164/2009 symbols completed. BAX took 1.4s. Estimated remaining: 12m 48s. Rate: 144.2 symbols/min [2025-09-30T22:05:24.738361] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-30T22:05:24.755157] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-30T22:05:24.755236] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-30T22:05:24.758270] [INFO ] [MAIN ] Derivative Progress: 165/2009 symbols completed. BB took 1.3s. Estimated remaining: 12m 43s. Rate: 145.0 symbols/min [2025-09-30T22:05:24.758707] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:24.758639] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:24.758972] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:24.830941] [DEBUG] [LOCAL ] BBAR: Loaded 41447 existing records from primary storage. [2025-09-30T22:05:24.845797] [INFO ] [MAIN ] BBAR: Loaded 41447 primary data records. [2025-09-30T22:05:24.865721] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-30T22:05:24.884479] [DEBUG] [LOCAL ] BBD: Loaded 53195 existing records from primary storage. [2025-09-30T22:05:24.895583] [INFO ] [MAIN ] BBD: Loaded 53195 primary data records. [2025-09-30T22:05:24.900820] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-30T22:05:25.865667] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:25.867393] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53195 primary records. [2025-09-30T22:05:25.867496] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-30T22:05:25.911003] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:25.913875] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-30T22:05:25.914472] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:25.914595] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-30T22:05:25.919004] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-30T22:05:25.917503] [INFO ] [MAIN ] Derivative Progress: 166/2009 symbols completed. BBD took 1.2s. Estimated remaining: 12m 51s. Rate: 143.4 symbols/min [2025-09-30T22:05:25.918326] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41447 primary records. [2025-09-30T22:05:25.919468] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-30T22:05:25.919340] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:25.919220] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-30T22:05:25.953249] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-30T22:05:25.953859] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-30T22:05:25.956737] [INFO ] [MAIN ] Derivative Progress: 167/2009 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 46s. Rate: 144.2 symbols/min [2025-09-30T22:05:25.957439] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-30T22:05:25.957627] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-30T22:05:25.959935] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:25.960140] [INFO ] [MAIN ] Derivative Progress: 168/2009 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 41s. Rate: 145.1 symbols/min [2025-09-30T22:05:25.960304] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:25.977343] [DEBUG] [LOCAL ] BBDO: Loaded 4915 existing records from primary storage. [2025-09-30T22:05:25.977586] [INFO ] [MAIN ] BBDO: Loaded 4915 primary data records. [2025-09-30T22:05:26.088039] [DEBUG] [LOCAL ] BBDC: Loaded 33001 existing records from primary storage. [2025-09-30T22:05:26.103242] [INFO ] [MAIN ] BBDC: Loaded 33001 primary data records. [2025-09-30T22:05:26.126392] [DEBUG] [LOCAL ] BBN: Loaded 18034 existing records from primary storage. [2025-09-30T22:05:26.147391] [INFO ] [MAIN ] BBN: Loaded 18034 primary data records. [2025-09-30T22:05:27.099342] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:27.100555] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4915 primary records. [2025-09-30T22:05:27.100805] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-30T22:05:27.119624] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-30T22:05:27.119957] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-30T22:05:27.121931] [INFO ] [MAIN ] Derivative Progress: 169/2009 symbols completed. BBDO took 1.2s. Estimated remaining: 12m 49s. Rate: 143.6 symbols/min [2025-09-30T22:05:27.122224] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:27.138148] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:27.139960] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18034 primary records. [2025-09-30T22:05:27.141226] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-30T22:05:27.166042] [DEBUG] [LOCAL ] BBU: Loaded 4648 existing records from primary storage. [2025-09-30T22:05:27.169776] [INFO ] [MAIN ] BBU: Loaded 4648 primary data records. [2025-09-30T22:05:27.181956] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:27.210379] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33001 primary records. [2025-09-30T22:05:27.247694] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-30T22:05:27.237549] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-30T22:05:27.271695] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-30T22:05:27.308152] [INFO ] [MAIN ] Derivative Progress: 170/2009 symbols completed. BBN took 1.3s. Estimated remaining: 12m 46s. Rate: 144.0 symbols/min [2025-09-30T22:05:27.305238] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-30T22:05:27.308480] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:27.314136] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-30T22:05:27.333034] [INFO ] [MAIN ] Derivative Progress: 171/2009 symbols completed. BBDC took 1.4s. Estimated remaining: 12m 42s. Rate: 144.8 symbols/min [2025-09-30T22:05:27.338483] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:27.533329] [DEBUG] [LOCAL ] BBUC: Loaded 13313 existing records from primary storage. [2025-09-30T22:05:27.534171] [INFO ] [MAIN ] BBUC: Loaded 13313 primary data records. [2025-09-30T22:05:27.894991] [DEBUG] [LOCAL ] BBVA: Loaded 49310 existing records from primary storage. [2025-09-30T22:05:27.895278] [INFO ] [MAIN ] BBVA: Loaded 49310 primary data records. [2025-09-30T22:05:28.056960] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:28.063474] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4648 primary records. [2025-09-30T22:05:28.090537] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-30T22:05:28.270624] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-09-30T22:05:28.271752] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-30T22:05:28.274210] [INFO ] [MAIN ] Derivative Progress: 172/2009 symbols completed. BBU took 1.2s. Estimated remaining: 12m 47s. Rate: 143.8 symbols/min [2025-09-30T22:05:28.276103] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:28.291839] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:28.293022] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13313 primary records. [2025-09-30T22:05:28.293249] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-30T22:05:28.311529] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-30T22:05:28.311979] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-30T22:05:28.314745] [INFO ] [MAIN ] Derivative Progress: 173/2009 symbols completed. BBUC took 1.0s. Estimated remaining: 12m 42s. Rate: 144.5 symbols/min [2025-09-30T22:05:28.314995] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:28.344104] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:28.354410] [DEBUG] [LOCAL ] BBW: Loaded 26640 existing records from primary storage. [2025-09-30T22:05:28.354515] [INFO ] [MAIN ] BBW: Loaded 26640 primary data records. [2025-09-30T22:05:28.353712] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49310 primary records. [2025-09-30T22:05:28.354677] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-30T22:05:28.538018] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-30T22:05:28.574555] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-30T22:05:28.763949] [INFO ] [MAIN ] Derivative Progress: 174/2009 symbols completed. BBVA took 1.4s. Estimated remaining: 12m 42s. Rate: 144.4 symbols/min [2025-09-30T22:05:28.778795] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:28.780958] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-30T22:05:28.781310] [INFO ] [MAIN ] BBWI: Loaded 53580 primary data records. [2025-09-30T22:05:29.146229] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:29.147851] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26640 primary records. [2025-09-30T22:05:29.164996] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-30T22:05:29.167062] [DEBUG] [LOCAL ] BBY: Loaded 53467 existing records from primary storage. [2025-09-30T22:05:29.174855] [INFO ] [MAIN ] BBY: Loaded 53467 primary data records. [2025-09-30T22:05:29.281423] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-30T22:05:29.300540] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-30T22:05:29.303045] [INFO ] [MAIN ] Derivative Progress: 175/2009 symbols completed. BBW took 1.0s. Estimated remaining: 12m 43s. Rate: 144.2 symbols/min [2025-09-30T22:05:29.314077] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:29.531878] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:29.532827] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53580 primary records. [2025-09-30T22:05:29.533629] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-30T22:05:29.553554] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-30T22:05:29.553738] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-30T22:05:29.555899] [INFO ] [MAIN ] Derivative Progress: 176/2009 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 41s. Rate: 144.5 symbols/min [2025-09-30T22:05:29.556262] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:29.583794] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:29.584884] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53467 primary records. [2025-09-30T22:05:29.595668] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-30T22:05:29.622717] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-30T22:05:29.623097] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-30T22:05:29.638158] [INFO ] [MAIN ] Derivative Progress: 177/2009 symbols completed. BBY took 0.9s. Estimated remaining: 12m 37s. Rate: 145.2 symbols/min [2025-09-30T22:05:29.639025] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:29.651338] [DEBUG] [LOCAL ] BC: Loaded 44228 existing records from primary storage. [2025-09-30T22:05:29.652054] [DEBUG] [LOCAL ] BCAT: Loaded 34276 existing records from primary storage. [2025-09-30T22:05:29.652420] [INFO ] [MAIN ] BC: Loaded 44228 primary data records. [2025-09-30T22:05:29.652524] [INFO ] [MAIN ] BCAT: Loaded 34276 primary data records. [2025-09-30T22:05:30.025596] [DEBUG] [LOCAL ] BCC: Loaded 28207 existing records from primary storage. [2025-09-30T22:05:30.094062] [INFO ] [MAIN ] BCC: Loaded 28207 primary data records. [2025-09-30T22:05:30.782772] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:30.783582] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:30.784593] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44228 primary records. [2025-09-30T22:05:30.785416] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34276 primary records. [2025-09-30T22:05:30.785711] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-30T22:05:30.785596] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-30T22:05:30.815857] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-30T22:05:30.817048] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-30T22:05:30.819208] [INFO ] [MAIN ] Derivative Progress: 178/2009 symbols completed. BC took 1.5s. Estimated remaining: 12m 45s. Rate: 143.7 symbols/min [2025-09-30T22:05:30.825573] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-09-30T22:05:30.825793] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-30T22:05:30.828560] [INFO ] [MAIN ] Derivative Progress: 179/2009 symbols completed. BCAT took 1.3s. Estimated remaining: 12m 40s. Rate: 144.5 symbols/min [2025-09-30T22:05:30.845924] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:30.846568] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28207 primary records. [2025-09-30T22:05:30.846630] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-30T22:05:30.862406] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-30T22:05:30.862485] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-30T22:05:30.866295] [INFO ] [MAIN ] Derivative Progress: 180/2009 symbols completed. BCC took 1.2s. Estimated remaining: 12m 36s. Rate: 145.2 symbols/min [2025-09-30T22:05:30.866926] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:30.867039] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:30.866862] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:30.904342] [DEBUG] [LOCAL ] BCO: Loaded 26127 existing records from primary storage. [2025-09-30T22:05:30.914803] [INFO ] [MAIN ] BCO: Loaded 26127 primary data records. [2025-09-30T22:05:30.929006] [DEBUG] [LOCAL ] BCH: Loaded 29483 existing records from primary storage. [2025-09-30T22:05:30.962098] [INFO ] [MAIN ] BCH: Loaded 29483 primary data records. [2025-09-30T22:05:31.183000] [DEBUG] [LOCAL ] BCE: Loaded 52277 existing records from primary storage. [2025-09-30T22:05:31.188815] [INFO ] [MAIN ] BCE: Loaded 52277 primary data records. [2025-09-30T22:05:31.965450] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:31.974972] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26127 primary records. [2025-09-30T22:05:31.980547] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-30T22:05:31.981636] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:31.991616] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29483 primary records. [2025-09-30T22:05:31.992008] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-30T22:05:32.000723] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-30T22:05:32.001112] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-30T22:05:32.003403] [INFO ] [MAIN ] Derivative Progress: 181/2009 symbols completed. BCO took 1.1s. Estimated remaining: 12m 43s. Rate: 143.8 symbols/min [2025-09-30T22:05:32.003702] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:32.036537] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-09-30T22:05:32.036751] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-30T22:05:32.039536] [INFO ] [MAIN ] Derivative Progress: 182/2009 symbols completed. BCH took 1.2s. Estimated remaining: 12m 38s. Rate: 144.5 symbols/min [2025-09-30T22:05:32.040183] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:32.040061] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:32.041201] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52277 primary records. [2025-09-30T22:05:32.043674] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-30T22:05:32.061824] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-30T22:05:32.061915] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-30T22:05:32.064701] [INFO ] [MAIN ] Derivative Progress: 183/2009 symbols completed. BCE took 1.2s. Estimated remaining: 12m 34s. Rate: 145.3 symbols/min [2025-09-30T22:05:32.065019] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:32.106233] [DEBUG] [LOCAL ] BCSF: Loaded 27698 existing records from primary storage. [2025-09-30T22:05:32.106446] [INFO ] [MAIN ] BCSF: Loaded 27698 primary data records. [2025-09-30T22:05:32.215241] [DEBUG] [LOCAL ] BCX: Loaded 21589 existing records from primary storage. [2025-09-30T22:05:32.242164] [INFO ] [MAIN ] BCX: Loaded 21589 primary data records. [2025-09-30T22:05:32.243117] [DEBUG] [LOCAL ] BCS: Loaded 53457 existing records from primary storage. [2025-09-30T22:05:32.249047] [INFO ] [MAIN ] BCS: Loaded 53457 primary data records. [2025-09-30T22:05:33.246589] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:33.248622] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27698 primary records. [2025-09-30T22:05:33.248754] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-30T22:05:33.280072] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:33.290496] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21589 primary records. [2025-09-30T22:05:33.291265] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-30T22:05:33.292974] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-30T22:05:33.308287] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:33.310881] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53457 primary records. [2025-09-30T22:05:33.310999] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-30T22:05:33.299668] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-30T22:05:33.328384] [INFO ] [MAIN ] Derivative Progress: 184/2009 symbols completed. BCSF took 1.3s. Estimated remaining: 12m 42s. Rate: 143.7 symbols/min [2025-09-30T22:05:33.334034] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:33.331013] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-30T22:05:33.335686] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-30T22:05:33.340839] [INFO ] [MAIN ] Derivative Progress: 185/2009 symbols completed. BCX took 1.3s. Estimated remaining: 12m 38s. Rate: 144.4 symbols/min [2025-09-30T22:05:33.341818] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-09-30T22:05:33.342156] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:33.342060] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-30T22:05:33.346106] [INFO ] [MAIN ] Derivative Progress: 186/2009 symbols completed. BCS took 1.3s. Estimated remaining: 12m 33s. Rate: 145.2 symbols/min [2025-09-30T22:05:33.346782] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:33.390800] [DEBUG] [LOCAL ] BDC: Loaded 24593 existing records from primary storage. [2025-09-30T22:05:33.391521] [INFO ] [MAIN ] BDC: Loaded 24593 primary data records. [2025-09-30T22:05:33.391362] [DEBUG] [LOCAL ] BDJ: Loaded 28950 existing records from primary storage. [2025-09-30T22:05:33.404286] [INFO ] [MAIN ] BDJ: Loaded 28950 primary data records. [2025-09-30T22:05:33.729051] [DEBUG] [LOCAL ] BDN: Loaded 47511 existing records from primary storage. [2025-09-30T22:05:33.790236] [INFO ] [MAIN ] BDN: Loaded 47511 primary data records. [2025-09-30T22:05:34.473554] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:34.474992] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24593 primary records. [2025-09-30T22:05:34.475204] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-30T22:05:34.489267] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:34.490369] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28950 primary records. [2025-09-30T22:05:34.491530] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-30T22:05:34.524587] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-30T22:05:34.526452] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-30T22:05:34.526352] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-30T22:05:34.529733] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-30T22:05:34.529613] [INFO ] [MAIN ] Derivative Progress: 187/2009 symbols completed. BDJ took 1.2s. Estimated remaining: 12m 40s. Rate: 143.8 symbols/min [2025-09-30T22:05:34.532519] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:34.533723] [INFO ] [MAIN ] Derivative Progress: 188/2009 symbols completed. BDC took 1.2s. Estimated remaining: 12m 36s. Rate: 144.5 symbols/min [2025-09-30T22:05:34.536465] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:34.551250] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:34.552024] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47511 primary records. [2025-09-30T22:05:34.552161] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-30T22:05:34.570376] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-30T22:05:34.570516] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-30T22:05:34.573929] [INFO ] [MAIN ] Derivative Progress: 189/2009 symbols completed. BDN took 1.2s. Estimated remaining: 12m 32s. Rate: 145.2 symbols/min [2025-09-30T22:05:34.574227] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:34.668816] [DEBUG] [LOCAL ] BDX: Loaded 52372 existing records from primary storage. [2025-09-30T22:05:34.684185] [INFO ] [MAIN ] BDX: Loaded 52372 primary data records. [2025-09-30T22:05:34.683980] [DEBUG] [LOCAL ] BEP: Loaded 38613 existing records from primary storage. [2025-09-30T22:05:34.686367] [INFO ] [MAIN ] BEP: Loaded 38613 primary data records. [2025-09-30T22:05:34.721557] [DEBUG] [LOCAL ] BEKE: Loaded 53241 existing records from primary storage. [2025-09-30T22:05:34.812874] [INFO ] [MAIN ] BEKE: Loaded 53241 primary data records. [2025-09-30T22:05:35.915820] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:35.917510] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52372 primary records. [2025-09-30T22:05:35.921131] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-30T22:05:35.960947] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-30T22:05:35.958819] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:35.962485] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-30T22:05:35.962297] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53241 primary records. [2025-09-30T22:05:35.976961] [INFO ] [MAIN ] Derivative Progress: 190/2009 symbols completed. BDX took 1.4s. Estimated remaining: 12m 41s. Rate: 143.4 symbols/min [2025-09-30T22:05:35.977882] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-30T22:05:35.978451] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:35.978285] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:35.982290] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38613 primary records. [2025-09-30T22:05:35.982405] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-30T22:05:36.000225] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-30T22:05:36.000621] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-30T22:05:36.003189] [INFO ] [MAIN ] Derivative Progress: 191/2009 symbols completed. BEKE took 1.5s. Estimated remaining: 12m 37s. Rate: 144.1 symbols/min [2025-09-30T22:05:36.015859] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:36.021327] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-30T22:05:36.021720] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-30T22:05:36.024905] [INFO ] [MAIN ] Derivative Progress: 192/2009 symbols completed. BEP took 1.5s. Estimated remaining: 12m 33s. Rate: 144.8 symbols/min [2025-09-30T22:05:36.025369] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:36.034791] [DEBUG] [LOCAL ] BEPH: Loaded 5285 existing records from primary storage. [2025-09-30T22:05:36.034981] [INFO ] [MAIN ] BEPH: Loaded 5285 primary data records. [2025-09-30T22:05:36.073631] [DEBUG] [LOCAL ] BEPI: Loaded 3514 existing records from primary storage. [2025-09-30T22:05:36.113457] [INFO ] [MAIN ] BEPI: Loaded 3514 primary data records. [2025-09-30T22:05:36.264027] [DEBUG] [LOCAL ] BEPC: Loaded 46429 existing records from primary storage. [2025-09-30T22:05:36.292711] [INFO ] [MAIN ] BEPC: Loaded 46429 primary data records. [2025-09-30T22:05:37.136334] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:37.136990] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:37.137825] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3514 primary records. [2025-09-30T22:05:37.138594] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5285 primary records. [2025-09-30T22:05:37.138952] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-30T22:05:37.139369] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-30T22:05:37.187235] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:37.188181] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46429 primary records. [2025-09-30T22:05:37.186466] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-30T22:05:37.188310] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-30T22:05:37.188490] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-30T22:05:37.186898] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-30T22:05:37.189430] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-30T22:05:37.192602] [INFO ] [MAIN ] Derivative Progress: 193/2009 symbols completed. BEPI took 1.2s. Estimated remaining: 12m 39s. Rate: 143.5 symbols/min [2025-09-30T22:05:37.202604] [INFO ] [MAIN ] Derivative Progress: 194/2009 symbols completed. BEPH took 1.2s. Estimated remaining: 12m 35s. Rate: 144.2 symbols/min [2025-09-30T22:05:37.210758] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-09-30T22:05:37.210855] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-30T22:05:37.213127] [INFO ] [MAIN ] Derivative Progress: 195/2009 symbols completed. BEPC took 1.2s. Estimated remaining: 12m 31s. Rate: 144.9 symbols/min [2025-09-30T22:05:37.213530] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:37.213734] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:37.213667] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:37.220720] [DEBUG] [LOCAL ] BEPJ: Loaded 3144 existing records from primary storage. [2025-09-30T22:05:37.220868] [INFO ] [MAIN ] BEPJ: Loaded 3144 primary data records. [2025-09-30T22:05:37.339404] [DEBUG] [LOCAL ] BFK: Loaded 13853 existing records from primary storage. [2025-09-30T22:05:37.352907] [INFO ] [MAIN ] BFK: Loaded 13853 primary data records. [2025-09-30T22:05:37.748011] [DEBUG] [LOCAL ] BFH: Loaded 41617 existing records from primary storage. [2025-09-30T22:05:37.758685] [INFO ] [MAIN ] BFH: Loaded 41617 primary data records. [2025-09-30T22:05:38.304711] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:38.306485] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3144 primary records. [2025-09-30T22:05:38.306579] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-30T22:05:38.338734] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:38.341045] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13853 primary records. [2025-09-30T22:05:38.341494] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-30T22:05:38.341586] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-09-30T22:05:38.342208] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-30T22:05:38.344483] [INFO ] [MAIN ] Derivative Progress: 196/2009 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 37s. Rate: 143.7 symbols/min [2025-09-30T22:05:38.345528] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:38.363272] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-30T22:05:38.363586] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-30T22:05:38.365985] [INFO ] [MAIN ] Derivative Progress: 197/2009 symbols completed. BFK took 1.2s. Estimated remaining: 12m 33s. Rate: 144.4 symbols/min [2025-09-30T22:05:38.366448] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:38.388100] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:38.389084] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41617 primary records. [2025-09-30T22:05:38.393554] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-30T22:05:38.395085] [DEBUG] [LOCAL ] BFS: Loaded 9115 existing records from primary storage. [2025-09-30T22:05:38.395599] [INFO ] [MAIN ] BFS: Loaded 9115 primary data records. [2025-09-30T22:05:38.532219] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-30T22:05:38.538024] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-30T22:05:38.554830] [INFO ] [MAIN ] Derivative Progress: 198/2009 symbols completed. BFH took 1.3s. Estimated remaining: 12m 31s. Rate: 144.8 symbols/min [2025-09-30T22:05:38.561129] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:38.656614] [DEBUG] [LOCAL ] BFLY: Loaded 51779 existing records from primary storage. [2025-09-30T22:05:38.772118] [INFO ] [MAIN ] BFLY: Loaded 51779 primary data records. [2025-09-30T22:05:38.842913] [DEBUG] [LOCAL ] BFZ: Loaded 12147 existing records from primary storage. [2025-09-30T22:05:38.886322] [INFO ] [MAIN ] BFZ: Loaded 12147 primary data records. [2025-09-30T22:05:39.484511] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:39.485719] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9115 primary records. [2025-09-30T22:05:39.486152] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-30T22:05:39.507392] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-09-30T22:05:39.507695] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-30T22:05:39.510028] [INFO ] [MAIN ] Derivative Progress: 199/2009 symbols completed. BFS took 1.1s. Estimated remaining: 12m 35s. Rate: 143.8 symbols/min [2025-09-30T22:05:39.512095] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:39.528035] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:39.529038] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51779 primary records. [2025-09-30T22:05:39.529231] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-30T22:05:39.549709] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-30T22:05:39.550154] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-30T22:05:39.554061] [INFO ] [MAIN ] Derivative Progress: 200/2009 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 31s. Rate: 144.5 symbols/min [2025-09-30T22:05:39.556689] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:39.589005] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:39.590155] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 12147 primary records. [2025-09-30T22:05:39.590384] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-30T22:05:39.618867] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-30T22:05:39.619051] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-30T22:05:39.618436] [DEBUG] [LOCAL ] BGH: Loaded 16746 existing records from primary storage. [2025-09-30T22:05:39.621675] [INFO ] [MAIN ] BGH: Loaded 16746 primary data records. [2025-09-30T22:05:39.621558] [INFO ] [MAIN ] Derivative Progress: 201/2009 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 28s. Rate: 145.1 symbols/min [2025-09-30T22:05:39.636722] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:39.670569] [DEBUG] [LOCAL ] BG: Loaded 50409 existing records from primary storage. [2025-09-30T22:05:39.676498] [INFO ] [MAIN ] BG: Loaded 50409 primary data records. [2025-09-30T22:05:40.348639] [DEBUG] [LOCAL ] BGS: Loaded 50452 existing records from primary storage. [2025-09-30T22:05:40.349520] [INFO ] [MAIN ] BGS: Loaded 50452 primary data records. [2025-09-30T22:05:40.707578] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:40.709986] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16746 primary records. [2025-09-30T22:05:40.710462] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-30T22:05:40.739027] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:40.742217] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50409 primary records. [2025-09-30T22:05:40.742853] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-30T22:05:40.752638] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-30T22:05:40.756345] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-30T22:05:40.760744] [INFO ] [MAIN ] Derivative Progress: 202/2009 symbols completed. BGH took 1.2s. Estimated remaining: 12m 34s. Rate: 143.8 symbols/min [2025-09-30T22:05:40.760989] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:40.763952] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-09-30T22:05:40.764361] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-30T22:05:40.767061] [INFO ] [MAIN ] Derivative Progress: 203/2009 symbols completed. BG took 1.3s. Estimated remaining: 12m 30s. Rate: 144.5 symbols/min [2025-09-30T22:05:40.767429] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:40.796058] [DEBUG] [LOCAL ] BGSF: Loaded 7130 existing records from primary storage. [2025-09-30T22:05:40.796371] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:40.797489] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50452 primary records. [2025-09-30T22:05:40.797671] [INFO ] [MAIN ] BGSF: Loaded 7130 primary data records. [2025-09-30T22:05:40.818899] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-30T22:05:40.849439] [DEBUG] [LOCAL ] BGT: Loaded 16599 existing records from primary storage. [2025-09-30T22:05:40.863757] [INFO ] [MAIN ] BGT: Loaded 16599 primary data records. [2025-09-30T22:05:41.029232] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-30T22:05:41.056504] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-30T22:05:41.067414] [INFO ] [MAIN ] Derivative Progress: 204/2009 symbols completed. BGS took 1.4s. Estimated remaining: 12m 28s. Rate: 144.7 symbols/min [2025-09-30T22:05:41.091143] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:41.477547] [DEBUG] [LOCAL ] BGX: Loaded 10830 existing records from primary storage. [2025-09-30T22:05:41.479172] [INFO ] [MAIN ] BGX: Loaded 10830 primary data records. [2025-09-30T22:05:41.901897] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:41.903598] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7130 primary records. [2025-09-30T22:05:41.904527] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-30T22:05:41.930860] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:41.933134] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16599 primary records. [2025-09-30T22:05:41.934050] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-30T22:05:41.936366] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-09-30T22:05:41.937289] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-30T22:05:41.939758] [INFO ] [MAIN ] Derivative Progress: 205/2009 symbols completed. BGSF took 1.2s. Estimated remaining: 12m 32s. Rate: 143.9 symbols/min [2025-09-30T22:05:41.947132] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:41.956996] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-30T22:05:41.957857] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-30T22:05:41.960594] [INFO ] [MAIN ] Derivative Progress: 206/2009 symbols completed. BGT took 1.2s. Estimated remaining: 12m 28s. Rate: 144.6 symbols/min [2025-09-30T22:05:41.960793] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:41.992060] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:41.993235] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10830 primary records. [2025-09-30T22:05:41.993881] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-30T22:05:42.002575] [DEBUG] [LOCAL ] BGY: Loaded 22377 existing records from primary storage. [2025-09-30T22:05:42.015446] [INFO ] [MAIN ] BGY: Loaded 22377 primary data records. [2025-09-30T22:05:42.025109] [DEBUG] [LOCAL ] BH: Loaded 15828 existing records from primary storage. [2025-09-30T22:05:42.032176] [INFO ] [MAIN ] BH: Loaded 15828 primary data records. [2025-09-30T22:05:42.269955] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-30T22:05:42.290003] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-30T22:05:42.292527] [INFO ] [MAIN ] Derivative Progress: 207/2009 symbols completed. BGX took 1.2s. Estimated remaining: 12m 27s. Rate: 144.7 symbols/min [2025-09-30T22:05:42.301837] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:42.724414] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:42.738691] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22377 primary records. [2025-09-30T22:05:42.740861] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-30T22:05:42.751987] [DEBUG] [LOCAL ] BHC: Loaded 46835 existing records from primary storage. [2025-09-30T22:05:42.758238] [INFO ] [MAIN ] BHC: Loaded 46835 primary data records. [2025-09-30T22:05:42.805900] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-30T22:05:42.825784] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-30T22:05:42.825616] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:42.841780] [INFO ] [MAIN ] Derivative Progress: 208/2009 symbols completed. BGY took 0.9s. Estimated remaining: 12m 28s. Rate: 144.5 symbols/min [2025-09-30T22:05:42.857563] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 15828 primary records. [2025-09-30T22:05:42.886320] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-30T22:05:43.017412] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-09-30T22:05:43.126739] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-30T22:05:43.130315] [INFO ] [MAIN ] Derivative Progress: 209/2009 symbols completed. BH took 1.2s. Estimated remaining: 12m 26s. Rate: 144.7 symbols/min [2025-09-30T22:05:43.155162] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:43.155847] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46835 primary records. [2025-09-30T22:05:43.155913] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-30T22:05:43.172000] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-09-30T22:05:43.172101] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-30T22:05:43.174481] [INFO ] [MAIN ] Derivative Progress: 210/2009 symbols completed. BHC took 0.9s. Estimated remaining: 12m 23s. Rate: 145.3 symbols/min [2025-09-30T22:05:43.175101] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:43.175023] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:43.175607] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:43.204859] [DEBUG] [LOCAL ] BHK: Loaded 23022 existing records from primary storage. [2025-09-30T22:05:43.211457] [INFO ] [MAIN ] BHK: Loaded 23022 primary data records. [2025-09-30T22:05:43.246352] [DEBUG] [LOCAL ] BHE: Loaded 24753 existing records from primary storage. [2025-09-30T22:05:43.281089] [INFO ] [MAIN ] BHE: Loaded 24753 primary data records. [2025-09-30T22:05:43.707352] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-09-30T22:05:43.712902] [INFO ] [MAIN ] BHP: Loaded 53373 primary data records. [2025-09-30T22:05:44.316099] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:44.317473] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23022 primary records. [2025-09-30T22:05:44.317777] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-30T22:05:44.338458] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-30T22:05:44.338887] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-30T22:05:44.349491] [INFO ] [MAIN ] Derivative Progress: 211/2009 symbols completed. BHK took 1.2s. Estimated remaining: 12m 29s. Rate: 144.1 symbols/min [2025-09-30T22:05:44.355761] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:44.355523] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:44.356999] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 24753 primary records. [2025-09-30T22:05:44.357165] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-30T22:05:44.378353] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-30T22:05:44.383510] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-30T22:05:44.386300] [INFO ] [MAIN ] Derivative Progress: 212/2009 symbols completed. BHE took 1.2s. Estimated remaining: 12m 25s. Rate: 144.7 symbols/min [2025-09-30T22:05:44.386699] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:44.400729] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:44.401625] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53373 primary records. [2025-09-30T22:05:44.401743] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-30T22:05:44.419377] [DEBUG] [LOCAL ] BHR: Loaded 21377 existing records from primary storage. [2025-09-30T22:05:44.423864] [INFO ] [MAIN ] BHR: Loaded 21377 primary data records. [2025-09-30T22:05:44.529631] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-30T22:05:44.554327] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-30T22:05:44.599806] [INFO ] [MAIN ] Derivative Progress: 213/2009 symbols completed. BHP took 1.4s. Estimated remaining: 12m 23s. Rate: 145.0 symbols/min [2025-09-30T22:05:44.639940] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:44.779688] [DEBUG] [LOCAL ] BHVN: Loaded 49759 existing records from primary storage. [2025-09-30T22:05:44.780623] [INFO ] [MAIN ] BHVN: Loaded 49759 primary data records. [2025-09-30T22:05:44.935570] [DEBUG] [LOCAL ] BIO: Loaded 24946 existing records from primary storage. [2025-09-30T22:05:44.942527] [INFO ] [MAIN ] BIO: Loaded 24946 primary data records. [2025-09-30T22:05:45.430304] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:45.500361] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21377 primary records. [2025-09-30T22:05:45.501166] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-30T22:05:45.525453] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-30T22:05:45.525610] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-30T22:05:45.528478] [INFO ] [MAIN ] Derivative Progress: 214/2009 symbols completed. BHR took 1.2s. Estimated remaining: 12m 27s. Rate: 144.2 symbols/min [2025-09-30T22:05:45.528888] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:45.548760] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:45.549754] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49759 primary records. [2025-09-30T22:05:45.550034] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-30T22:05:45.594118] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-30T22:05:45.592461] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:45.595191] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24946 primary records. [2025-09-30T22:05:45.595374] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-30T22:05:45.595315] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-30T22:05:45.598541] [INFO ] [MAIN ] Derivative Progress: 215/2009 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 24s. Rate: 144.8 symbols/min [2025-09-30T22:05:45.599174] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:45.637302] [DEBUG] [LOCAL ] BIP: Loaded 39540 existing records from primary storage. [2025-09-30T22:05:45.638428] [INFO ] [MAIN ] BIP: Loaded 39540 primary data records. [2025-09-30T22:05:45.663818] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-30T22:05:45.692541] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-30T22:05:45.701714] [INFO ] [MAIN ] Derivative Progress: 216/2009 symbols completed. BIO took 1.1s. Estimated remaining: 12m 21s. Rate: 145.3 symbols/min [2025-09-30T22:05:45.731164] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:45.866705] [DEBUG] [LOCAL ] BIPH: Loaded 2575 existing records from primary storage. [2025-09-30T22:05:45.894997] [INFO ] [MAIN ] BIPH: Loaded 2575 primary data records. [2025-09-30T22:05:46.077787] [DEBUG] [LOCAL ] BIPC: Loaded 41499 existing records from primary storage. [2025-09-30T22:05:46.118353] [INFO ] [MAIN ] BIPC: Loaded 41499 primary data records. [2025-09-30T22:05:46.867914] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:47.032887] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39540 primary records. [2025-09-30T22:05:47.034619] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-30T22:05:47.059668] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-30T22:05:47.060801] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-30T22:05:47.063612] [INFO ] [MAIN ] Derivative Progress: 217/2009 symbols completed. BIP took 1.5s. Estimated remaining: 12m 28s. Rate: 143.7 symbols/min [2025-09-30T22:05:47.063798] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:47.070906] [DEBUG] [LOCAL ] BIPI: Loaded 3193 existing records from primary storage. [2025-09-30T22:05:47.071386] [INFO ] [MAIN ] BIPI: Loaded 3193 primary data records. [2025-09-30T22:05:47.279331] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:47.298939] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2575 primary records. [2025-09-30T22:05:47.416451] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-30T22:05:47.425142] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:47.427593] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41499 primary records. [2025-09-30T22:05:47.435182] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-30T22:05:47.460421] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-09-30T22:05:47.461567] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-30T22:05:47.465237] [INFO ] [MAIN ] Derivative Progress: 218/2009 symbols completed. BIPH took 1.7s. Estimated remaining: 12m 27s. Rate: 143.8 symbols/min [2025-09-30T22:05:47.466282] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-30T22:05:47.467206] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:47.467517] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-30T22:05:47.470976] [INFO ] [MAIN ] Derivative Progress: 219/2009 symbols completed. BIPC took 1.9s. Estimated remaining: 12m 24s. Rate: 144.4 symbols/min [2025-09-30T22:05:47.471181] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:47.495267] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:47.496207] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3193 primary records. [2025-09-30T22:05:47.499026] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-30T22:05:47.541918] [DEBUG] [LOCAL ] BIT: Loaded 22692 existing records from primary storage. [2025-09-30T22:05:47.543528] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-30T22:05:47.543675] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-30T22:05:47.543000] [INFO ] [MAIN ] BIT: Loaded 22692 primary data records. [2025-09-30T22:05:47.546546] [INFO ] [MAIN ] Derivative Progress: 220/2009 symbols completed. BIPI took 0.5s. Estimated remaining: 12m 20s. Rate: 145.0 symbols/min [2025-09-30T22:05:47.546824] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:47.659410] [DEBUG] [LOCAL ] BIRK: Loaded 50901 existing records from primary storage. [2025-09-30T22:05:47.674149] [INFO ] [MAIN ] BIRK: Loaded 50901 primary data records. [2025-09-30T22:05:48.277625] [DEBUG] [LOCAL ] BJ: Loaded 51365 existing records from primary storage. [2025-09-30T22:05:48.278340] [INFO ] [MAIN ] BJ: Loaded 51365 primary data records. [2025-09-30T22:05:48.522314] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:48.534761] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22692 primary records. [2025-09-30T22:05:48.534934] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-30T22:05:48.765421] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-30T22:05:48.774310] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-30T22:05:48.777248] [INFO ] [MAIN ] Derivative Progress: 221/2009 symbols completed. BIT took 1.3s. Estimated remaining: 12m 27s. Rate: 143.7 symbols/min [2025-09-30T22:05:48.777542] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:48.796956] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:48.798457] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50901 primary records. [2025-09-30T22:05:48.798672] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-30T22:05:48.817474] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-30T22:05:48.817948] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-30T22:05:48.820630] [INFO ] [MAIN ] Derivative Progress: 222/2009 symbols completed. BIRK took 1.4s. Estimated remaining: 12m 23s. Rate: 144.3 symbols/min [2025-09-30T22:05:48.820979] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:48.839379] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:48.854618] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51365 primary records. [2025-09-30T22:05:48.854889] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-30T22:05:48.874446] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-09-30T22:05:48.888864] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-30T22:05:48.891166] [INFO ] [MAIN ] Derivative Progress: 223/2009 symbols completed. BJ took 1.3s. Estimated remaining: 12m 20s. Rate: 144.8 symbols/min [2025-09-30T22:05:48.904189] [DEBUG] [LOCAL ] BK: Loaded 53538 existing records from primary storage. [2025-09-30T22:05:48.904445] [INFO ] [MAIN ] BK: Loaded 53538 primary data records. [2025-09-30T22:05:49.037054] [DEBUG] [LOCAL ] BKD: Loaded 50188 existing records from primary storage. [2025-09-30T22:05:49.047739] [INFO ] [MAIN ] BKD: Loaded 50188 primary data records. [2025-09-30T22:05:49.607098] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:49.608842] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53538 primary records. [2025-09-30T22:05:49.609055] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-30T22:05:49.626140] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-30T22:05:49.626363] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-30T22:05:49.629210] [INFO ] [MAIN ] Derivative Progress: 224/2009 symbols completed. BK took 0.9s. Estimated remaining: 12m 22s. Rate: 144.3 symbols/min [2025-09-30T22:05:49.645790] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:49.646438] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50188 primary records. [2025-09-30T22:05:49.646499] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-30T22:05:49.661977] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-30T22:05:49.662069] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-30T22:05:49.664787] [INFO ] [MAIN ] Derivative Progress: 225/2009 symbols completed. BKD took 0.8s. Estimated remaining: 12m 19s. Rate: 144.9 symbols/min [2025-09-30T22:05:49.665439] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:49.665541] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:49.665324] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:49.677517] [DEBUG] [LOCAL ] BKN: Loaded 7734 existing records from primary storage. [2025-09-30T22:05:49.677695] [INFO ] [MAIN ] BKN: Loaded 7734 primary data records. [2025-09-30T22:05:49.915005] [DEBUG] [LOCAL ] BKKT: Loaded 35076 existing records from primary storage. [2025-09-30T22:05:50.037448] [INFO ] [MAIN ] BKKT: Loaded 35076 primary data records. [2025-09-30T22:05:50.038314] [DEBUG] [LOCAL ] BKH: Loaded 36624 existing records from primary storage. [2025-09-30T22:05:50.038634] [INFO ] [MAIN ] BKH: Loaded 36624 primary data records. [2025-09-30T22:05:50.757144] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:50.759931] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7734 primary records. [2025-09-30T22:05:50.760209] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-30T22:05:50.782482] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-30T22:05:50.782991] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-30T22:05:50.785910] [INFO ] [MAIN ] Derivative Progress: 226/2009 symbols completed. BKN took 1.1s. Estimated remaining: 12m 24s. Rate: 143.8 symbols/min [2025-09-30T22:05:50.786091] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:50.806520] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:50.809074] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36624 primary records. [2025-09-30T22:05:50.810075] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-30T22:05:50.838757] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:50.841479] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 35076 primary records. [2025-09-30T22:05:50.841848] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-30T22:05:50.851518] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-30T22:05:50.855420] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-30T22:05:50.858861] [INFO ] [MAIN ] Derivative Progress: 227/2009 symbols completed. BKH took 1.2s. Estimated remaining: 12m 21s. Rate: 144.3 symbols/min [2025-09-30T22:05:50.872580] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-30T22:05:50.872812] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-30T22:05:50.875752] [INFO ] [MAIN ] Derivative Progress: 228/2009 symbols completed. BKKT took 1.2s. Estimated remaining: 12m 17s. Rate: 144.9 symbols/min [2025-09-30T22:05:50.875982] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:50.872984] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:50.899125] [DEBUG] [LOCAL ] BKSY: Loaded 48205 existing records from primary storage. [2025-09-30T22:05:50.899963] [INFO ] [MAIN ] BKSY: Loaded 48205 primary data records. [2025-09-30T22:05:50.954466] [DEBUG] [LOCAL ] BKT: Loaded 11267 existing records from primary storage. [2025-09-30T22:05:50.979854] [INFO ] [MAIN ] BKT: Loaded 11267 primary data records. [2025-09-30T22:05:51.203876] [DEBUG] [LOCAL ] BKU: Loaded 41483 existing records from primary storage. [2025-09-30T22:05:51.245807] [INFO ] [MAIN ] BKU: Loaded 41483 primary data records. [2025-09-30T22:05:51.972947] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:51.975074] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48205 primary records. [2025-09-30T22:05:51.975207] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-30T22:05:51.996982] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-30T22:05:52.010770] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:52.012704] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 11267 primary records. [2025-09-30T22:05:52.012821] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-30T22:05:52.011001] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-30T22:05:52.016027] [INFO ] [MAIN ] Derivative Progress: 229/2009 symbols completed. BKSY took 1.2s. Estimated remaining: 12m 23s. Rate: 143.8 symbols/min [2025-09-30T22:05:52.017456] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:52.036071] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-30T22:05:52.037025] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-30T22:05:52.039984] [INFO ] [MAIN ] Derivative Progress: 230/2009 symbols completed. BKT took 1.2s. Estimated remaining: 12m 19s. Rate: 144.4 symbols/min [2025-09-30T22:05:52.040182] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:52.054560] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:52.055352] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41483 primary records. [2025-09-30T22:05:52.055451] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-30T22:05:52.072460] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-30T22:05:52.080902] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-30T22:05:52.083512] [INFO ] [MAIN ] Derivative Progress: 231/2009 symbols completed. BKU took 1.2s. Estimated remaining: 12m 16s. Rate: 145.0 symbols/min [2025-09-30T22:05:52.083821] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:52.098195] [DEBUG] [LOCAL ] BKV: Loaded 29775 existing records from primary storage. [2025-09-30T22:05:52.107857] [INFO ] [MAIN ] BKV: Loaded 29775 primary data records. [2025-09-30T22:05:52.256367] [DEBUG] [LOCAL ] BLD: Loaded 27707 existing records from primary storage. [2025-09-30T22:05:52.258153] [INFO ] [MAIN ] BLD: Loaded 27707 primary data records. [2025-09-30T22:05:52.258042] [DEBUG] [LOCAL ] BLCO: Loaded 35436 existing records from primary storage. [2025-09-30T22:05:52.274033] [INFO ] [MAIN ] BLCO: Loaded 35436 primary data records. [2025-09-30T22:05:53.204251] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:53.206289] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29775 primary records. [2025-09-30T22:05:53.206639] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-30T22:05:53.231460] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-30T22:05:53.232085] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-30T22:05:53.235287] [INFO ] [MAIN ] Derivative Progress: 232/2009 symbols completed. BKV took 1.2s. Estimated remaining: 12m 21s. Rate: 143.9 symbols/min [2025-09-30T22:05:53.235670] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:53.258422] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:53.259538] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27707 primary records. [2025-09-30T22:05:53.259742] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-30T22:05:53.283069] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:53.287296] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35436 primary records. [2025-09-30T22:05:53.288422] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-30T22:05:53.293247] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-30T22:05:53.305238] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-30T22:05:53.310637] [INFO ] [MAIN ] Derivative Progress: 233/2009 symbols completed. BLD took 1.2s. Estimated remaining: 12m 18s. Rate: 144.4 symbols/min [2025-09-30T22:05:53.311891] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:53.315133] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-30T22:05:53.315224] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-30T22:05:53.319078] [INFO ] [MAIN ] Derivative Progress: 234/2009 symbols completed. BLCO took 1.3s. Estimated remaining: 12m 15s. Rate: 145.0 symbols/min [2025-09-30T22:05:53.319338] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:53.347073] [DEBUG] [LOCAL ] BLE: Loaded 14340 existing records from primary storage. [2025-09-30T22:05:53.347203] [INFO ] [MAIN ] BLE: Loaded 14340 primary data records. [2025-09-30T22:05:53.476574] [DEBUG] [LOCAL ] BLDR: Loaded 51633 existing records from primary storage. [2025-09-30T22:05:53.501066] [INFO ] [MAIN ] BLDR: Loaded 51633 primary data records. [2025-09-30T22:05:53.850677] [DEBUG] [LOCAL ] BLK: Loaded 34458 existing records from primary storage. [2025-09-30T22:05:53.856781] [INFO ] [MAIN ] BLK: Loaded 34458 primary data records. [2025-09-30T22:05:54.455281] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:54.469789] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14340 primary records. [2025-09-30T22:05:54.470539] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:54.470673] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-30T22:05:54.472167] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51633 primary records. [2025-09-30T22:05:54.472853] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-30T22:05:54.509881] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-30T22:05:54.510699] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-30T22:05:54.514054] [INFO ] [MAIN ] Derivative Progress: 235/2009 symbols completed. BLDR took 1.3s. Estimated remaining: 12m 20s. Rate: 143.8 symbols/min [2025-09-30T22:05:54.514313] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:54.516188] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-30T22:05:54.516825] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-30T22:05:54.519659] [INFO ] [MAIN ] Derivative Progress: 236/2009 symbols completed. BLE took 1.2s. Estimated remaining: 12m 17s. Rate: 144.4 symbols/min [2025-09-30T22:05:54.522194] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:54.548023] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:54.549212] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34458 primary records. [2025-09-30T22:05:54.549419] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-30T22:05:54.570919] [DEBUG] [LOCAL ] BLW: Loaded 12979 existing records from primary storage. [2025-09-30T22:05:54.579547] [INFO ] [MAIN ] BLW: Loaded 12979 primary data records. [2025-09-30T22:05:54.625149] [DEBUG] [LOCAL ] BLX: Loaded 15578 existing records from primary storage. [2025-09-30T22:05:54.637439] [INFO ] [MAIN ] BLX: Loaded 15578 primary data records. [2025-09-30T22:05:54.685049] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-30T22:05:54.779401] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-30T22:05:54.828513] [INFO ] [MAIN ] Derivative Progress: 237/2009 symbols completed. BLK took 1.5s. Estimated remaining: 12m 15s. Rate: 144.6 symbols/min [2025-09-30T22:05:54.866158] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:55.395613] [DEBUG] [LOCAL ] BMA: Loaded 35166 existing records from primary storage. [2025-09-30T22:05:55.396230] [INFO ] [MAIN ] BMA: Loaded 35166 primary data records. [2025-09-30T22:05:55.508077] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:55.532708] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12979 primary records. [2025-09-30T22:05:55.538297] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-30T22:05:55.659226] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:55.773529] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15578 primary records. [2025-09-30T22:05:55.789899] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-30T22:05:55.794316] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-30T22:05:55.802291] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-30T22:05:55.812311] [INFO ] [MAIN ] Derivative Progress: 238/2009 symbols completed. BLW took 1.3s. Estimated remaining: 12m 19s. Rate: 143.8 symbols/min [2025-09-30T22:05:55.818867] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-30T22:05:55.819082] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-30T22:05:55.822269] [INFO ] [MAIN ] Derivative Progress: 239/2009 symbols completed. BLX took 1.3s. Estimated remaining: 12m 16s. Rate: 144.4 symbols/min [2025-09-30T22:05:55.842454] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:55.843255] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35166 primary records. [2025-09-30T22:05:55.843322] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-30T22:05:55.859937] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-30T22:05:55.860055] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-30T22:05:55.862844] [INFO ] [MAIN ] Derivative Progress: 240/2009 symbols completed. BMA took 1.0s. Estimated remaining: 12m 12s. Rate: 144.9 symbols/min [2025-09-30T22:05:55.863405] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:55.863524] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:55.863317] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:55.879858] [DEBUG] [LOCAL ] BME: Loaded 10880 existing records from primary storage. [2025-09-30T22:05:55.880031] [INFO ] [MAIN ] BME: Loaded 10880 primary data records. [2025-09-30T22:05:56.034789] [DEBUG] [LOCAL ] BMEZ: Loaded 26164 existing records from primary storage. [2025-09-30T22:05:56.034981] [INFO ] [MAIN ] BMEZ: Loaded 26164 primary data records. [2025-09-30T22:05:56.034154] [DEBUG] [LOCAL ] BMI: Loaded 24271 existing records from primary storage. [2025-09-30T22:05:56.040801] [INFO ] [MAIN ] BMI: Loaded 24271 primary data records. [2025-09-30T22:05:56.999203] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:57.000417] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10880 primary records. [2025-09-30T22:05:57.001165] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-30T22:05:57.035064] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:57.044817] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26164 primary records. [2025-09-30T22:05:57.051968] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:57.054116] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24271 primary records. [2025-09-30T22:05:57.054453] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-30T22:05:57.052367] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-30T22:05:57.055273] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-30T22:05:57.057061] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-30T22:05:57.067811] [INFO ] [MAIN ] Derivative Progress: 241/2009 symbols completed. BME took 1.2s. Estimated remaining: 12m 18s. Rate: 143.8 symbols/min [2025-09-30T22:05:57.072742] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:57.093864] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-30T22:05:57.094257] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-30T22:05:57.097246] [INFO ] [MAIN ] Derivative Progress: 242/2009 symbols completed. BMI took 1.2s. Estimated remaining: 12m 15s. Rate: 144.3 symbols/min [2025-09-30T22:05:57.097985] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:57.100504] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-30T22:05:57.100599] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-30T22:05:57.103360] [INFO ] [MAIN ] Derivative Progress: 243/2009 symbols completed. BMEZ took 1.2s. Estimated remaining: 12m 11s. Rate: 144.9 symbols/min [2025-09-30T22:05:57.103668] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:57.143676] [DEBUG] [LOCAL ] BMO: Loaded 41237 existing records from primary storage. [2025-09-30T22:05:57.158555] [INFO ] [MAIN ] BMO: Loaded 41237 primary data records. [2025-09-30T22:05:57.307210] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-30T22:05:57.365208] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-30T22:05:57.428057] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-09-30T22:05:57.615568] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-09-30T22:05:58.352245] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:58.354341] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41237 primary records. [2025-09-30T22:05:58.354815] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-30T22:05:58.388427] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-30T22:05:58.402407] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:58.403343] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-30T22:05:58.403531] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-30T22:05:58.401952] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-30T22:05:58.407181] [INFO ] [MAIN ] Derivative Progress: 244/2009 symbols completed. BMO took 1.3s. Estimated remaining: 12m 17s. Rate: 143.6 symbols/min [2025-09-30T22:05:58.407408] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:58.441437] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:58.443244] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-09-30T22:05:58.443689] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-30T22:05:58.444451] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-30T22:05:58.445464] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-30T22:05:58.448698] [INFO ] [MAIN ] Derivative Progress: 245/2009 symbols completed. BMY took 1.4s. Estimated remaining: 12m 14s. Rate: 144.2 symbols/min [2025-09-30T22:05:58.468099] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:58.485826] [DEBUG] [LOCAL ] BNED: Loaded 29561 existing records from primary storage. [2025-09-30T22:05:58.484161] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-30T22:05:58.486038] [INFO ] [MAIN ] BNED: Loaded 29561 primary data records. [2025-09-30T22:05:58.491440] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-30T22:05:58.496269] [INFO ] [MAIN ] Derivative Progress: 246/2009 symbols completed. BN took 1.4s. Estimated remaining: 12m 11s. Rate: 144.7 symbols/min [2025-09-30T22:05:58.527801] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:58.528286] [DEBUG] [LOCAL ] BNH: Loaded 5055 existing records from primary storage. [2025-09-30T22:05:58.541235] [INFO ] [MAIN ] BNH: Loaded 5055 primary data records. [2025-09-30T22:05:58.676330] [DEBUG] [LOCAL ] BNJ: Loaded 2607 existing records from primary storage. [2025-09-30T22:05:58.737722] [INFO ] [MAIN ] BNJ: Loaded 2607 primary data records. [2025-09-30T22:05:59.576829] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:59.579822] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29561 primary records. [2025-09-30T22:05:59.580781] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-30T22:05:59.609796] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:59.612063] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5055 primary records. [2025-09-30T22:05:59.612917] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-30T22:05:59.616872] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-30T22:05:59.617901] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-30T22:05:59.620341] [INFO ] [MAIN ] Derivative Progress: 247/2009 symbols completed. BNED took 1.2s. Estimated remaining: 12m 16s. Rate: 143.7 symbols/min [2025-09-30T22:05:59.640917] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:59.645803] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:05:59.647216] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2607 primary records. [2025-09-30T22:05:59.647619] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-30T22:05:59.664600] [DEBUG] [LOCAL ] BNT: Loaded 3373 existing records from primary storage. [2025-09-30T22:05:59.664972] [INFO ] [MAIN ] BNT: Loaded 3373 primary data records. [2025-09-30T22:05:59.664391] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-30T22:05:59.677227] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-30T22:05:59.701782] [INFO ] [MAIN ] Derivative Progress: 248/2009 symbols completed. BNH took 1.2s. Estimated remaining: 12m 13s. Rate: 144.2 symbols/min [2025-09-30T22:05:59.714587] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:05:59.797249] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-30T22:05:59.829752] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-30T22:05:59.875072] [DEBUG] [LOCAL ] BNY: Loaded 7119 existing records from primary storage. [2025-09-30T22:05:59.874700] [INFO ] [MAIN ] Derivative Progress: 249/2009 symbols completed. BNJ took 1.3s. Estimated remaining: 12m 11s. Rate: 144.5 symbols/min [2025-09-30T22:05:59.914845] [INFO ] [MAIN ] BNY: Loaded 7119 primary data records. [2025-09-30T22:06:00.006704] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:00.141979] [DEBUG] [LOCAL ] BOC: Loaded 18278 existing records from primary storage. [2025-09-30T22:06:00.181702] [INFO ] [MAIN ] BOC: Loaded 18278 primary data records. [2025-09-30T22:06:00.697494] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:00.698469] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3373 primary records. [2025-09-30T22:06:00.698803] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-30T22:06:00.733808] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:00.734929] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7119 primary records. [2025-09-30T22:06:00.735730] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-30T22:06:00.735252] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-30T22:06:00.737634] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-30T22:06:00.750133] [INFO ] [MAIN ] Derivative Progress: 250/2009 symbols completed. BNT took 1.1s. Estimated remaining: 12m 14s. Rate: 143.9 symbols/min [2025-09-30T22:06:00.750778] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:00.764272] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-30T22:06:00.764500] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-30T22:06:00.767115] [INFO ] [MAIN ] Derivative Progress: 251/2009 symbols completed. BNY took 1.1s. Estimated remaining: 12m 10s. Rate: 144.4 symbols/min [2025-09-30T22:06:00.767449] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:00.790760] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:00.791729] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18278 primary records. [2025-09-30T22:06:00.791797] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-30T22:06:00.820685] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-30T22:06:00.820981] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-30T22:06:00.824116] [INFO ] [MAIN ] Derivative Progress: 252/2009 symbols completed. BOC took 0.8s. Estimated remaining: 12m 7s. Rate: 144.9 symbols/min [2025-09-30T22:06:00.824446] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:00.846705] [DEBUG] [LOCAL ] BOND: Loaded 32125 existing records from primary storage. [2025-09-30T22:06:00.846852] [INFO ] [MAIN ] BOND: Loaded 32125 primary data records. [2025-09-30T22:06:00.978321] [DEBUG] [LOCAL ] BOOT: Loaded 40594 existing records from primary storage. [2025-09-30T22:06:00.999702] [INFO ] [MAIN ] BOOT: Loaded 40594 primary data records. [2025-09-30T22:06:01.311101] [DEBUG] [LOCAL ] BORR: Loaded 51149 existing records from primary storage. [2025-09-30T22:06:01.343594] [INFO ] [MAIN ] BORR: Loaded 51149 primary data records. [2025-09-30T22:06:01.974889] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:01.976481] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32125 primary records. [2025-09-30T22:06:01.976836] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-30T22:06:02.014881] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:02.014448] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-09-30T22:06:02.015187] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-30T22:06:02.017576] [INFO ] [MAIN ] Derivative Progress: 253/2009 symbols completed. BOND took 1.3s. Estimated remaining: 12m 12s. Rate: 143.8 symbols/min [2025-09-30T22:06:02.018555] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40594 primary records. [2025-09-30T22:06:02.019085] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-30T22:06:02.049156] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:02.050371] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51149 primary records. [2025-09-30T22:06:02.050710] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-30T22:06:02.060284] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-30T22:06:02.063805] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-30T22:06:02.067019] [INFO ] [MAIN ] Derivative Progress: 254/2009 symbols completed. BOOT took 1.3s. Estimated remaining: 12m 10s. Rate: 144.3 symbols/min [2025-09-30T22:06:02.071180] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-30T22:06:02.071247] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-30T22:06:02.074499] [INFO ] [MAIN ] Derivative Progress: 255/2009 symbols completed. BORR took 1.3s. Estimated remaining: 12m 6s. Rate: 144.9 symbols/min [2025-09-30T22:06:02.074987] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:02.075049] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:02.075200] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:02.109481] [DEBUG] [LOCAL ] BOW: Loaded 23531 existing records from primary storage. [2025-09-30T22:06:02.109725] [INFO ] [MAIN ] BOW: Loaded 23531 primary data records. [2025-09-30T22:06:02.319298] [DEBUG] [LOCAL ] BOX: Loaded 50231 existing records from primary storage. [2025-09-30T22:06:02.355442] [INFO ] [MAIN ] BOX: Loaded 50231 primary data records. [2025-09-30T22:06:02.355288] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-30T22:06:02.364986] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-30T22:06:03.224792] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:03.226480] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23531 primary records. [2025-09-30T22:06:03.226939] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-30T22:06:03.245598] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-30T22:06:03.246017] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-30T22:06:03.248128] [INFO ] [MAIN ] Derivative Progress: 256/2009 symbols completed. BOW took 1.2s. Estimated remaining: 12m 11s. Rate: 143.9 symbols/min [2025-09-30T22:06:03.248740] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:03.282260] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:03.282709] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:03.284409] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50231 primary records. [2025-09-30T22:06:03.283784] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-30T22:06:03.284703] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-30T22:06:03.284594] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-30T22:06:03.333209] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-30T22:06:03.333122] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-30T22:06:03.333447] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-30T22:06:03.336333] [INFO ] [MAIN ] Derivative Progress: 257/2009 symbols completed. BP took 1.3s. Estimated remaining: 12m 8s. Rate: 144.3 symbols/min [2025-09-30T22:06:03.336890] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:03.336555] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-30T22:06:03.340467] [INFO ] [MAIN ] Derivative Progress: 258/2009 symbols completed. BOX took 1.3s. Estimated remaining: 12m 5s. Rate: 144.9 symbols/min [2025-09-30T22:06:03.340956] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:03.355789] [DEBUG] [LOCAL ] BR: Loaded 34609 existing records from primary storage. [2025-09-30T22:06:03.356035] [INFO ] [MAIN ] BR: Loaded 34609 primary data records. [2025-09-30T22:06:03.463693] [DEBUG] [LOCAL ] BRC: Loaded 19102 existing records from primary storage. [2025-09-30T22:06:03.469253] [INFO ] [MAIN ] BRC: Loaded 19102 primary data records. [2025-09-30T22:06:03.903331] [DEBUG] [LOCAL ] BRBR: Loaded 51262 existing records from primary storage. [2025-09-30T22:06:03.932589] [INFO ] [MAIN ] BRBR: Loaded 51262 primary data records. [2025-09-30T22:06:04.470760] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:04.470388] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:04.472732] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34609 primary records. [2025-09-30T22:06:04.473505] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19102 primary records. [2025-09-30T22:06:04.473666] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-30T22:06:04.474856] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-30T22:06:04.512902] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-30T22:06:04.513995] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-30T22:06:04.516942] [INFO ] [MAIN ] Derivative Progress: 259/2009 symbols completed. BRC took 1.2s. Estimated remaining: 12m 10s. Rate: 143.8 symbols/min [2025-09-30T22:06:04.517566] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:04.522238] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-30T22:06:04.523236] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-30T22:06:04.525611] [INFO ] [MAIN ] Derivative Progress: 260/2009 symbols completed. BR took 1.3s. Estimated remaining: 12m 7s. Rate: 144.4 symbols/min [2025-09-30T22:06:04.526067] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:04.539201] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:04.540724] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51262 primary records. [2025-09-30T22:06:04.540982] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-30T22:06:04.576522] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-30T22:06:04.576702] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-30T22:06:04.581213] [INFO ] [MAIN ] Derivative Progress: 261/2009 symbols completed. BRBR took 1.2s. Estimated remaining: 12m 4s. Rate: 144.9 symbols/min [2025-09-30T22:06:04.581520] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:04.600591] [DEBUG] [LOCAL ] BRCC: Loaded 40248 existing records from primary storage. [2025-09-30T22:06:04.600778] [INFO ] [MAIN ] BRCC: Loaded 40248 primary data records. [2025-09-30T22:06:04.974409] [DEBUG] [LOCAL ] BRO: Loaded 51886 existing records from primary storage. [2025-09-30T22:06:04.974732] [INFO ] [MAIN ] BRO: Loaded 51886 primary data records. [2025-09-30T22:06:05.110227] [DEBUG] [LOCAL ] BROS: Loaded 53289 existing records from primary storage. [2025-09-30T22:06:05.142508] [INFO ] [MAIN ] BROS: Loaded 53289 primary data records. [2025-09-30T22:06:05.565894] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:05.585403] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40248 primary records. [2025-09-30T22:06:05.613245] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-30T22:06:05.762593] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-30T22:06:05.763393] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-30T22:06:05.766201] [INFO ] [MAIN ] Derivative Progress: 262/2009 symbols completed. BRCC took 1.2s. Estimated remaining: 12m 9s. Rate: 143.8 symbols/min [2025-09-30T22:06:05.767034] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:05.787838] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:05.788863] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51886 primary records. [2025-09-30T22:06:05.789199] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-30T22:06:05.812950] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-30T22:06:05.822329] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-30T22:06:05.827083] [INFO ] [MAIN ] Derivative Progress: 263/2009 symbols completed. BRO took 1.3s. Estimated remaining: 12m 6s. Rate: 144.3 symbols/min [2025-09-30T22:06:05.849191] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:05.850441] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:05.851773] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53289 primary records. [2025-09-30T22:06:05.852755] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-30T22:06:05.868353] [DEBUG] [LOCAL ] BRSP: Loaded 36799 existing records from primary storage. [2025-09-30T22:06:05.868917] [INFO ] [MAIN ] BRSP: Loaded 36799 primary data records. [2025-09-30T22:06:05.896302] [DEBUG] [LOCAL ] BRT: Loaded 4982 existing records from primary storage. [2025-09-30T22:06:05.916193] [INFO ] [MAIN ] BRT: Loaded 4982 primary data records. [2025-09-30T22:06:06.189914] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-30T22:06:06.455633] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-30T22:06:06.497815] [INFO ] [MAIN ] Derivative Progress: 264/2009 symbols completed. BROS took 1.9s. Estimated remaining: 12m 7s. Rate: 144.0 symbols/min [2025-09-30T22:06:06.504877] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:06.618583] [DEBUG] [LOCAL ] BRW: Loaded 19912 existing records from primary storage. [2025-09-30T22:06:06.620145] [INFO ] [MAIN ] BRW: Loaded 19912 primary data records. [2025-09-30T22:06:06.760154] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:06.771822] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4982 primary records. [2025-09-30T22:06:06.777169] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-30T22:06:07.000902] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:07.000360] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-09-30T22:06:07.002523] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-30T22:06:07.001890] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36799 primary records. [2025-09-30T22:06:07.004907] [INFO ] [MAIN ] Derivative Progress: 265/2009 symbols completed. BRT took 1.2s. Estimated remaining: 12m 7s. Rate: 143.9 symbols/min [2025-09-30T22:06:07.005211] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:07.005120] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-30T22:06:07.028092] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-30T22:06:07.029421] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-30T22:06:07.032276] [INFO ] [MAIN ] Derivative Progress: 266/2009 symbols completed. BRSP took 1.3s. Estimated remaining: 12m 4s. Rate: 144.4 symbols/min [2025-09-30T22:06:07.032787] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:07.055673] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:07.056470] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 19912 primary records. [2025-09-30T22:06:07.056575] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-30T22:06:07.096430] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-30T22:06:07.107457] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-30T22:06:07.126572] [DEBUG] [LOCAL ] BSAC: Loaded 32974 existing records from primary storage. [2025-09-30T22:06:07.125957] [INFO ] [MAIN ] Derivative Progress: 267/2009 symbols completed. BRW took 0.6s. Estimated remaining: 12m 2s. Rate: 144.8 symbols/min [2025-09-30T22:06:07.126848] [INFO ] [MAIN ] BSAC: Loaded 32974 primary data records. [2025-09-30T22:06:07.140234] [DEBUG] [LOCAL ] BRX: Loaded 51710 existing records from primary storage. [2025-09-30T22:06:07.127135] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:07.145574] [INFO ] [MAIN ] BRX: Loaded 51710 primary data records. [2025-09-30T22:06:07.819473] [DEBUG] [LOCAL ] BSBR: Loaded 35311 existing records from primary storage. [2025-09-30T22:06:07.819821] [INFO ] [MAIN ] BSBR: Loaded 35311 primary data records. [2025-09-30T22:06:08.167281] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:08.180880] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51710 primary records. [2025-09-30T22:06:08.181336] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:08.181471] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-30T22:06:08.182181] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32974 primary records. [2025-09-30T22:06:08.182624] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-30T22:06:08.213438] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-30T22:06:08.214738] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-30T22:06:08.217049] [INFO ] [MAIN ] Derivative Progress: 268/2009 symbols completed. BSAC took 1.2s. Estimated remaining: 12m 6s. Rate: 143.9 symbols/min [2025-09-30T22:06:08.220227] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-30T22:06:08.220412] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-30T22:06:08.222964] [INFO ] [MAIN ] Derivative Progress: 269/2009 symbols completed. BRX took 1.2s. Estimated remaining: 12m 3s. Rate: 144.4 symbols/min [2025-09-30T22:06:08.238620] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:08.239284] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35311 primary records. [2025-09-30T22:06:08.239348] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-30T22:06:08.254532] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-09-30T22:06:08.254600] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-30T22:06:08.257604] [INFO ] [MAIN ] Derivative Progress: 270/2009 symbols completed. BSBR took 1.1s. Estimated remaining: 11m 60s. Rate: 144.9 symbols/min [2025-09-30T22:06:08.258329] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:08.258240] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:08.258427] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:08.269676] [DEBUG] [LOCAL ] BSL: Loaded 8187 existing records from primary storage. [2025-09-30T22:06:08.269886] [INFO ] [MAIN ] BSL: Loaded 8187 primary data records. [2025-09-30T22:06:08.405130] [DEBUG] [LOCAL ] BST: Loaded 19010 existing records from primary storage. [2025-09-30T22:06:08.416091] [INFO ] [MAIN ] BST: Loaded 19010 primary data records. [2025-09-30T22:06:08.553570] [DEBUG] [LOCAL ] BSM: Loaded 32206 existing records from primary storage. [2025-09-30T22:06:08.732083] [INFO ] [MAIN ] BSM: Loaded 32206 primary data records. [2025-09-30T22:06:09.336015] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:09.337215] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8187 primary records. [2025-09-30T22:06:09.340522] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-30T22:06:09.365774] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:09.370743] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-30T22:06:09.369295] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19010 primary records. [2025-09-30T22:06:09.371038] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-30T22:06:09.371086] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-30T22:06:09.374234] [INFO ] [MAIN ] Derivative Progress: 271/2009 symbols completed. BSL took 1.1s. Estimated remaining: 12m 4s. Rate: 144.0 symbols/min [2025-09-30T22:06:09.374436] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:09.393489] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-30T22:06:09.393793] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-30T22:06:09.396393] [INFO ] [MAIN ] Derivative Progress: 272/2009 symbols completed. BST took 1.1s. Estimated remaining: 12m 1s. Rate: 144.5 symbols/min [2025-09-30T22:06:09.396541] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:09.410813] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:09.411633] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32206 primary records. [2025-09-30T22:06:09.411852] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-30T22:06:09.434437] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-30T22:06:09.434636] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-30T22:06:09.437324] [INFO ] [MAIN ] Derivative Progress: 273/2009 symbols completed. BSM took 1.2s. Estimated remaining: 11m 58s. Rate: 145.0 symbols/min [2025-09-30T22:06:09.437672] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:09.447218] [DEBUG] [LOCAL ] BSTZ: Loaded 24736 existing records from primary storage. [2025-09-30T22:06:09.447464] [INFO ] [MAIN ] BSTZ: Loaded 24736 primary data records. [2025-09-30T22:06:09.538970] [DEBUG] [LOCAL ] BTA: Loaded 5400 existing records from primary storage. [2025-09-30T22:06:09.544228] [INFO ] [MAIN ] BTA: Loaded 5400 primary data records. [2025-09-30T22:06:09.964464] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-30T22:06:09.994387] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-30T22:06:10.590157] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:10.591925] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24736 primary records. [2025-09-30T22:06:10.593217] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-30T22:06:10.620994] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:10.625049] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5400 primary records. [2025-09-30T22:06:10.625495] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-30T22:06:10.627508] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-30T22:06:10.628075] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-30T22:06:10.639082] [INFO ] [MAIN ] Derivative Progress: 274/2009 symbols completed. BSTZ took 1.3s. Estimated remaining: 12m 3s. Rate: 144.0 symbols/min [2025-09-30T22:06:10.642329] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:10.647999] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-30T22:06:10.648250] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-30T22:06:10.651124] [INFO ] [MAIN ] Derivative Progress: 275/2009 symbols completed. BTA took 1.2s. Estimated remaining: 11m 60s. Rate: 144.5 symbols/min [2025-09-30T22:06:10.651351] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:10.674400] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:10.681795] [DEBUG] [LOCAL ] BTCM: Loaded 15242 existing records from primary storage. [2025-09-30T22:06:10.682672] [INFO ] [MAIN ] BTCM: Loaded 15242 primary data records. [2025-09-30T22:06:10.682531] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-30T22:06:10.688008] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-30T22:06:10.815664] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-30T22:06:10.830827] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-30T22:06:10.845301] [INFO ] [MAIN ] Derivative Progress: 276/2009 symbols completed. BSX took 1.4s. Estimated remaining: 11m 58s. Rate: 144.8 symbols/min [2025-09-30T22:06:10.867044] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:11.063024] [DEBUG] [LOCAL ] BTE: Loaded 52722 existing records from primary storage. [2025-09-30T22:06:11.063294] [INFO ] [MAIN ] BTE: Loaded 52722 primary data records. [2025-09-30T22:06:11.439343] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:11.441943] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 15242 primary records. [2025-09-30T22:06:11.442278] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-30T22:06:11.443477] [DEBUG] [LOCAL ] BTI: Loaded 53556 existing records from primary storage. [2025-09-30T22:06:11.453139] [INFO ] [MAIN ] BTI: Loaded 53556 primary data records. [2025-09-30T22:06:11.460321] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-30T22:06:11.472551] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-30T22:06:11.497998] [INFO ] [MAIN ] Derivative Progress: 277/2009 symbols completed. BTCM took 0.9s. Estimated remaining: 11m 59s. Rate: 144.5 symbols/min [2025-09-30T22:06:11.503884] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:11.584819] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:11.600299] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52722 primary records. [2025-09-30T22:06:11.600532] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-30T22:06:11.637789] [DEBUG] [LOCAL ] BTO: Loaded 8761 existing records from primary storage. [2025-09-30T22:06:11.681306] [INFO ] [MAIN ] BTO: Loaded 8761 primary data records. [2025-09-30T22:06:11.952238] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-30T22:06:11.965141] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-30T22:06:11.968258] [INFO ] [MAIN ] Derivative Progress: 278/2009 symbols completed. BTE took 1.3s. Estimated remaining: 11m 59s. Rate: 144.4 symbols/min [2025-09-30T22:06:11.985184] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:12.193353] [DEBUG] [LOCAL ] BTT: Loaded 15894 existing records from primary storage. [2025-09-30T22:06:12.195977] [INFO ] [MAIN ] BTT: Loaded 15894 primary data records. [2025-09-30T22:06:12.284100] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:12.303129] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53556 primary records. [2025-09-30T22:06:12.328003] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-30T22:06:12.437450] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-30T22:06:12.645019] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-30T22:06:12.645630] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:12.648718] [INFO ] [MAIN ] Derivative Progress: 279/2009 symbols completed. BTI took 1.8s. Estimated remaining: 12m 0s. Rate: 144.1 symbols/min [2025-09-30T22:06:12.650008] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8761 primary records. [2025-09-30T22:06:12.650292] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:12.650349] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-30T22:06:12.675871] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-30T22:06:12.676669] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-30T22:06:12.679098] [INFO ] [MAIN ] Derivative Progress: 280/2009 symbols completed. BTO took 1.2s. Estimated remaining: 11m 57s. Rate: 144.6 symbols/min [2025-09-30T22:06:12.679339] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:12.707145] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:12.708065] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15894 primary records. [2025-09-30T22:06:12.708188] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-30T22:06:12.749060] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-09-30T22:06:12.749198] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-30T22:06:12.751923] [INFO ] [MAIN ] Derivative Progress: 281/2009 symbols completed. BTT took 0.8s. Estimated remaining: 11m 55s. Rate: 145.0 symbols/min [2025-09-30T22:06:12.747993] [DEBUG] [LOCAL ] BTZ: Loaded 22619 existing records from primary storage. [2025-09-30T22:06:12.752165] [INFO ] [MAIN ] BTZ: Loaded 22619 primary data records. [2025-09-30T22:06:12.752288] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:12.880946] [DEBUG] [LOCAL ] BTU: Loaded 53307 existing records from primary storage. [2025-09-30T22:06:12.922547] [INFO ] [MAIN ] BTU: Loaded 53307 primary data records. [2025-09-30T22:06:13.438217] [DEBUG] [LOCAL ] BUD: Loaded 52713 existing records from primary storage. [2025-09-30T22:06:13.438708] [INFO ] [MAIN ] BUD: Loaded 52713 primary data records. [2025-09-30T22:06:13.808440] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:13.810227] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22619 primary records. [2025-09-30T22:06:13.810804] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-30T22:06:13.832148] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-30T22:06:13.833020] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-30T22:06:13.835985] [INFO ] [MAIN ] Derivative Progress: 282/2009 symbols completed. BTZ took 1.2s. Estimated remaining: 11m 59s. Rate: 144.2 symbols/min [2025-09-30T22:06:13.836319] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:13.851209] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:13.852214] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53307 primary records. [2025-09-30T22:06:13.852458] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-30T22:06:13.873471] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-30T22:06:13.878775] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-30T22:06:13.882149] [INFO ] [MAIN ] Derivative Progress: 283/2009 symbols completed. BTU took 1.2s. Estimated remaining: 11m 56s. Rate: 144.6 symbols/min [2025-09-30T22:06:13.879124] [DEBUG] [LOCAL ] BUI: Loaded 11559 existing records from primary storage. [2025-09-30T22:06:13.882490] [INFO ] [MAIN ] BUI: Loaded 11559 primary data records. [2025-09-30T22:06:14.013437] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:14.041158] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52713 primary records. [2025-09-30T22:06:14.075871] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-30T22:06:14.240346] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-30T22:06:14.240524] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-30T22:06:14.243007] [INFO ] [MAIN ] Derivative Progress: 284/2009 symbols completed. BUD took 1.5s. Estimated remaining: 11m 55s. Rate: 144.7 symbols/min [2025-09-30T22:06:14.262295] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:14.263013] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11559 primary records. [2025-09-30T22:06:14.263079] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-30T22:06:14.279149] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-30T22:06:14.279217] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-30T22:06:14.281406] [INFO ] [MAIN ] Derivative Progress: 285/2009 symbols completed. BUI took 0.4s. Estimated remaining: 11m 53s. Rate: 145.2 symbols/min [2025-09-30T22:06:14.282368] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:14.282296] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:14.282163] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:14.302619] [DEBUG] [LOCAL ] BUXX: Loaded 15166 existing records from primary storage. [2025-09-30T22:06:14.302814] [INFO ] [MAIN ] BUXX: Loaded 15166 primary data records. [2025-09-30T22:06:14.501182] [DEBUG] [LOCAL ] BURL: Loaded 46056 existing records from primary storage. [2025-09-30T22:06:14.525777] [INFO ] [MAIN ] BURL: Loaded 46056 primary data records. [2025-09-30T22:06:14.525623] [DEBUG] [LOCAL ] BUR: Loaded 45112 existing records from primary storage. [2025-09-30T22:06:14.560299] [INFO ] [MAIN ] BUR: Loaded 45112 primary data records. [2025-09-30T22:06:15.460608] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:15.461569] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15166 primary records. [2025-09-30T22:06:15.461828] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-30T22:06:15.484107] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-30T22:06:15.484375] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-30T22:06:15.486635] [INFO ] [MAIN ] Derivative Progress: 286/2009 symbols completed. BUXX took 1.2s. Estimated remaining: 11m 57s. Rate: 144.2 symbols/min [2025-09-30T22:06:15.487084] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:15.523315] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:15.524853] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45112 primary records. [2025-09-30T22:06:15.524946] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-30T22:06:15.523979] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:15.526300] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46056 primary records. [2025-09-30T22:06:15.526666] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-30T22:06:15.561148] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-09-30T22:06:15.572722] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-30T22:06:15.576711] [INFO ] [MAIN ] Derivative Progress: 287/2009 symbols completed. BUR took 1.3s. Estimated remaining: 11m 55s. Rate: 144.6 symbols/min [2025-09-30T22:06:15.577020] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:15.578596] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-30T22:06:15.578805] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-30T22:06:15.582316] [INFO ] [MAIN ] Derivative Progress: 288/2009 symbols completed. BURL took 1.3s. Estimated remaining: 11m 52s. Rate: 145.1 symbols/min [2025-09-30T22:06:15.582844] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:15.601435] [DEBUG] [LOCAL ] BVN: Loaded 43983 existing records from primary storage. [2025-09-30T22:06:15.601720] [INFO ] [MAIN ] BVN: Loaded 43983 primary data records. [2025-09-30T22:06:15.798694] [DEBUG] [LOCAL ] BW: Loaded 39796 existing records from primary storage. [2025-09-30T22:06:15.821164] [INFO ] [MAIN ] BW: Loaded 39796 primary data records. [2025-09-30T22:06:16.053124] [DEBUG] [LOCAL ] BWA: Loaded 52185 existing records from primary storage. [2025-09-30T22:06:16.058972] [INFO ] [MAIN ] BWA: Loaded 52185 primary data records. [2025-09-30T22:06:16.702798] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:16.703892] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43983 primary records. [2025-09-30T22:06:16.703996] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-30T22:06:16.724208] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-30T22:06:16.724851] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-30T22:06:16.727603] [INFO ] [MAIN ] Derivative Progress: 289/2009 symbols completed. BVN took 1.2s. Estimated remaining: 11m 56s. Rate: 144.2 symbols/min [2025-09-30T22:06:16.728142] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:16.753428] [DEBUG] [LOCAL ] BWNB: Loaded 4448 existing records from primary storage. [2025-09-30T22:06:16.754517] [INFO ] [MAIN ] BWNB: Loaded 4448 primary data records. [2025-09-30T22:06:16.760176] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:16.770052] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39796 primary records. [2025-09-30T22:06:16.823780] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:16.823245] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-30T22:06:16.840788] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52185 primary records. [2025-09-30T22:06:16.849202] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-30T22:06:17.185479] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-30T22:06:17.185353] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-30T22:06:17.199210] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-30T22:06:17.210778] [INFO ] [MAIN ] Derivative Progress: 290/2009 symbols completed. BW took 1.6s. Estimated remaining: 11m 56s. Rate: 144.1 symbols/min [2025-09-30T22:06:17.208585] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-30T22:06:17.214107] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:17.214971] [INFO ] [MAIN ] Derivative Progress: 291/2009 symbols completed. BWA took 1.6s. Estimated remaining: 11m 53s. Rate: 144.6 symbols/min [2025-09-30T22:06:17.215302] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:17.225008] [DEBUG] [LOCAL ] BWSN: Loaded 5105 existing records from primary storage. [2025-09-30T22:06:17.225141] [INFO ] [MAIN ] BWSN: Loaded 5105 primary data records. [2025-09-30T22:06:17.400900] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:17.440616] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4448 primary records. [2025-09-30T22:06:17.470364] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-30T22:06:17.590154] [DEBUG] [LOCAL ] BWXT: Loaded 46809 existing records from primary storage. [2025-09-30T22:06:17.599384] [INFO ] [MAIN ] BWXT: Loaded 46809 primary data records. [2025-09-30T22:06:17.740827] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-09-30T22:06:17.746238] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-30T22:06:17.806074] [INFO ] [MAIN ] Derivative Progress: 292/2009 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 53s. Rate: 144.4 symbols/min [2025-09-30T22:06:17.831507] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:17.982108] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:17.983454] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5105 primary records. [2025-09-30T22:06:17.984057] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-30T22:06:18.001716] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-09-30T22:06:18.001914] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-30T22:06:18.004180] [INFO ] [MAIN ] Derivative Progress: 293/2009 symbols completed. BWSN took 0.8s. Estimated remaining: 11m 52s. Rate: 144.7 symbols/min [2025-09-30T22:06:18.004684] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:18.033093] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:18.033890] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46809 primary records. [2025-09-30T22:06:18.034000] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-30T22:06:18.066750] [DEBUG] [LOCAL ] BXP: Loaded 49851 existing records from primary storage. [2025-09-30T22:06:18.067604] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-30T22:06:18.067726] [INFO ] [MAIN ] BXP: Loaded 49851 primary data records. [2025-09-30T22:06:18.067807] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-30T22:06:18.070990] [INFO ] [MAIN ] Derivative Progress: 294/2009 symbols completed. BWXT took 0.9s. Estimated remaining: 11m 49s. Rate: 145.1 symbols/min [2025-09-30T22:06:18.084390] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:18.436984] [DEBUG] [LOCAL ] BXSL: Loaded 47607 existing records from primary storage. [2025-09-30T22:06:18.438844] [INFO ] [MAIN ] BXSL: Loaded 47607 primary data records. [2025-09-30T22:06:18.445475] [DEBUG] [LOCAL ] BY: Loaded 21722 existing records from primary storage. [2025-09-30T22:06:18.477380] [INFO ] [MAIN ] BY: Loaded 21722 primary data records. [2025-09-30T22:06:19.187548] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:19.189036] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49851 primary records. [2025-09-30T22:06:19.189176] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-30T22:06:19.221242] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-30T22:06:19.227041] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:19.227893] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47607 primary records. [2025-09-30T22:06:19.228092] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-30T22:06:19.228149] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-30T22:06:19.231872] [INFO ] [MAIN ] Derivative Progress: 295/2009 symbols completed. BXP took 1.4s. Estimated remaining: 11m 53s. Rate: 144.2 symbols/min [2025-09-30T22:06:19.244010] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:19.253103] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-30T22:06:19.253483] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-30T22:06:19.256214] [INFO ] [MAIN ] Derivative Progress: 296/2009 symbols completed. BXSL took 1.3s. Estimated remaining: 11m 50s. Rate: 144.7 symbols/min [2025-09-30T22:06:19.256723] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:19.274078] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:19.274900] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21722 primary records. [2025-09-30T22:06:19.275106] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-30T22:06:19.301043] [DEBUG] [LOCAL ] BYM: Loaded 12028 existing records from primary storage. [2025-09-30T22:06:19.301988] [INFO ] [MAIN ] BYM: Loaded 12028 primary data records. [2025-09-30T22:06:19.326741] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-30T22:06:19.343195] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-30T22:06:19.369989] [INFO ] [MAIN ] Derivative Progress: 297/2009 symbols completed. BY took 1.3s. Estimated remaining: 11m 48s. Rate: 145.0 symbols/min [2025-09-30T22:06:19.402112] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:19.499281] [DEBUG] [LOCAL ] BYD: Loaded 45002 existing records from primary storage. [2025-09-30T22:06:19.525322] [INFO ] [MAIN ] BYD: Loaded 45002 primary data records. [2025-09-30T22:06:19.802393] [DEBUG] [LOCAL ] BZH: Loaded 32445 existing records from primary storage. [2025-09-30T22:06:19.802628] [INFO ] [MAIN ] BZH: Loaded 32445 primary data records. [2025-09-30T22:06:20.364093] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:20.366172] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12028 primary records. [2025-09-30T22:06:20.367512] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-30T22:06:20.388826] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-30T22:06:20.389913] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-30T22:06:20.393311] [INFO ] [MAIN ] Derivative Progress: 298/2009 symbols completed. BYM took 1.1s. Estimated remaining: 11m 51s. Rate: 144.3 symbols/min [2025-09-30T22:06:20.408323] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:20.409172] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45002 primary records. [2025-09-30T22:06:20.409321] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-30T22:06:20.428018] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-30T22:06:20.440402] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-30T22:06:20.443161] [INFO ] [MAIN ] Derivative Progress: 299/2009 symbols completed. BYD took 1.2s. Estimated remaining: 11m 49s. Rate: 144.7 symbols/min [2025-09-30T22:06:20.440723] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:20.443960] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32445 primary records. [2025-09-30T22:06:20.444081] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-30T22:06:20.460276] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-30T22:06:20.460374] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-30T22:06:20.463202] [INFO ] [MAIN ] Derivative Progress: 300/2009 symbols completed. BZH took 1.1s. Estimated remaining: 11m 46s. Rate: 145.2 symbols/min [2025-09-30T22:06:20.463571] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:20.463628] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:20.463754] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:20.487687] [DEBUG] [LOCAL ] CABO: Loaded 17138 existing records from primary storage. [2025-09-30T22:06:20.494601] [INFO ] [MAIN ] CABO: Loaded 17138 primary data records. [2025-09-30T22:06:20.495173] [DEBUG] [LOCAL ] CAAP: Loaded 19924 existing records from primary storage. [2025-09-30T22:06:20.495343] [INFO ] [MAIN ] CAAP: Loaded 19924 primary data records. [2025-09-30T22:06:20.878283] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-30T22:06:20.886205] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-30T22:06:21.598340] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:21.614494] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17138 primary records. [2025-09-30T22:06:21.614622] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-30T22:06:21.615334] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:21.616046] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19924 primary records. [2025-09-30T22:06:21.629556] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-30T22:06:21.650093] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-09-30T22:06:21.659151] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-30T22:06:21.661461] [INFO ] [MAIN ] Derivative Progress: 301/2009 symbols completed. CABO took 1.2s. Estimated remaining: 11m 50s. Rate: 144.3 symbols/min [2025-09-30T22:06:21.662306] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:21.682568] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-30T22:06:21.682494] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:21.682695] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-30T22:06:21.686529] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-30T22:06:21.685508] [INFO ] [MAIN ] Derivative Progress: 302/2009 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 48s. Rate: 144.7 symbols/min [2025-09-30T22:06:21.686715] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-30T22:06:21.686840] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:21.725393] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-30T22:06:21.725590] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-30T22:06:21.730065] [INFO ] [MAIN ] Derivative Progress: 303/2009 symbols completed. C took 1.3s. Estimated remaining: 11m 45s. Rate: 145.2 symbols/min [2025-09-30T22:06:21.730587] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:21.743443] [DEBUG] [LOCAL ] CACI: Loaded 24598 existing records from primary storage. [2025-09-30T22:06:21.743796] [INFO ] [MAIN ] CACI: Loaded 24598 primary data records. [2025-09-30T22:06:21.977617] [DEBUG] [LOCAL ] CADE: Loaded 48810 existing records from primary storage. [2025-09-30T22:06:21.991397] [INFO ] [MAIN ] CADE: Loaded 48810 primary data records. [2025-09-30T22:06:22.108195] [DEBUG] [LOCAL ] CAE: Loaded 39024 existing records from primary storage. [2025-09-30T22:06:22.123763] [INFO ] [MAIN ] CAE: Loaded 39024 primary data records. [2025-09-30T22:06:22.834244] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:22.835631] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 24598 primary records. [2025-09-30T22:06:22.835937] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-30T22:06:22.855603] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-09-30T22:06:22.857955] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-30T22:06:22.860762] [INFO ] [MAIN ] Derivative Progress: 304/2009 symbols completed. CACI took 1.2s. Estimated remaining: 11m 49s. Rate: 144.3 symbols/min [2025-09-30T22:06:22.861258] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:22.876945] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:22.878298] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48810 primary records. [2025-09-30T22:06:22.878451] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-30T22:06:22.915882] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:22.917219] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39024 primary records. [2025-09-30T22:06:22.917570] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-30T22:06:22.921370] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-09-30T22:06:22.921926] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-30T22:06:22.936037] [INFO ] [MAIN ] Derivative Progress: 305/2009 symbols completed. CADE took 1.2s. Estimated remaining: 11m 46s. Rate: 144.7 symbols/min [2025-09-30T22:06:22.936984] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:22.943625] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-30T22:06:22.943804] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-30T22:06:22.948122] [INFO ] [MAIN ] Derivative Progress: 306/2009 symbols completed. CAE took 1.2s. Estimated remaining: 11m 44s. Rate: 145.2 symbols/min [2025-09-30T22:06:22.948602] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:22.994344] [DEBUG] [LOCAL ] CAG: Loaded 53661 existing records from primary storage. [2025-09-30T22:06:23.003392] [INFO ] [MAIN ] CAG: Loaded 53661 primary data records. [2025-09-30T22:06:23.144407] [DEBUG] [LOCAL ] CALX: Loaded 37984 existing records from primary storage. [2025-09-30T22:06:23.162308] [INFO ] [MAIN ] CALX: Loaded 37984 primary data records. [2025-09-30T22:06:23.180739] [DEBUG] [LOCAL ] CAH: Loaded 51417 existing records from primary storage. [2025-09-30T22:06:23.222973] [INFO ] [MAIN ] CAH: Loaded 51417 primary data records. [2025-09-30T22:06:24.146244] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:24.147103] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53661 primary records. [2025-09-30T22:06:24.147457] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-30T22:06:24.165566] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-30T22:06:24.167388] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-30T22:06:24.169596] [INFO ] [MAIN ] Derivative Progress: 307/2009 symbols completed. CAG took 1.3s. Estimated remaining: 11m 48s. Rate: 144.3 symbols/min [2025-09-30T22:06:24.170045] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:24.186308] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:24.187331] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51417 primary records. [2025-09-30T22:06:24.187563] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-30T22:06:24.213314] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:24.226246] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-30T22:06:24.226386] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-30T22:06:24.229488] [INFO ] [MAIN ] Derivative Progress: 308/2009 symbols completed. CAH took 1.3s. Estimated remaining: 11m 45s. Rate: 144.7 symbols/min [2025-09-30T22:06:24.224915] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37984 primary records. [2025-09-30T22:06:24.229814] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:24.230063] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-30T22:06:24.253462] [DEBUG] [LOCAL ] CANG: Loaded 27013 existing records from primary storage. [2025-09-30T22:06:24.256391] [INFO ] [MAIN ] CANG: Loaded 27013 primary data records. [2025-09-30T22:06:24.257389] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-30T22:06:24.262777] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-30T22:06:24.315411] [DEBUG] [LOCAL ] CAPL: Loaded 5788 existing records from primary storage. [2025-09-30T22:06:24.327191] [INFO ] [MAIN ] Derivative Progress: 309/2009 symbols completed. CALX took 1.4s. Estimated remaining: 11m 43s. Rate: 145.0 symbols/min [2025-09-30T22:06:24.359197] [INFO ] [MAIN ] CAPL: Loaded 5788 primary data records. [2025-09-30T22:06:24.364457] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:24.974922] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-30T22:06:24.977849] [INFO ] [MAIN ] CARR: Loaded 53594 primary data records. [2025-09-30T22:06:25.343058] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:25.344222] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 27013 primary records. [2025-09-30T22:06:25.344428] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-30T22:06:25.366260] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:25.371442] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5788 primary records. [2025-09-30T22:06:25.374017] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-30T22:06:25.377931] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-30T22:06:25.389288] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-30T22:06:25.392239] [INFO ] [MAIN ] Derivative Progress: 310/2009 symbols completed. CANG took 1.2s. Estimated remaining: 11m 46s. Rate: 144.3 symbols/min [2025-09-30T22:06:25.397034] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-30T22:06:25.397196] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-30T22:06:25.400158] [INFO ] [MAIN ] Derivative Progress: 311/2009 symbols completed. CAPL took 1.2s. Estimated remaining: 11m 44s. Rate: 144.7 symbols/min [2025-09-30T22:06:25.392889] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:25.400790] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:25.426687] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:25.427608] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53594 primary records. [2025-09-30T22:06:25.427780] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-30T22:06:25.459377] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-30T22:06:25.459592] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-30T22:06:25.462476] [INFO ] [MAIN ] Derivative Progress: 312/2009 symbols completed. CARR took 1.1s. Estimated remaining: 11m 42s. Rate: 145.1 symbols/min [2025-09-30T22:06:25.462905] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:25.477508] [DEBUG] [LOCAL ] CARS: Loaded 39829 existing records from primary storage. [2025-09-30T22:06:25.479439] [INFO ] [MAIN ] CARS: Loaded 39829 primary data records. [2025-09-30T22:06:25.550583] [DEBUG] [LOCAL ] CATO: Loaded 7042 existing records from primary storage. [2025-09-30T22:06:25.582238] [INFO ] [MAIN ] CATO: Loaded 7042 primary data records. [2025-09-30T22:06:25.854002] [DEBUG] [LOCAL ] CAT: Loaded 52912 existing records from primary storage. [2025-09-30T22:06:25.854466] [INFO ] [MAIN ] CAT: Loaded 52912 primary data records. [2025-09-30T22:06:26.583950] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:26.586303] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39829 primary records. [2025-09-30T22:06:26.587381] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-30T22:06:26.620037] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:06:26.620771] [INFO ] [MAIN ] CATO: Generated 1792 derivative records from 7042 primary records. [2025-09-30T22:06:26.619832] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-30T22:06:26.620897] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-30T22:06:26.622898] [INFO ] [MAIN ] Derivative Progress: 313/2009 symbols completed. CARS took 1.2s. Estimated remaining: 11m 45s. Rate: 144.3 symbols/min [2025-09-30T22:06:26.623470] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-30T22:06:26.652575] [DEBUG] [LOCAL ] CATO: Derivative data saved (1792 records). [2025-09-30T22:06:26.653109] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-30T22:06:26.653281] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:26.656419] [INFO ] [MAIN ] Derivative Progress: 314/2009 symbols completed. CATO took 1.2s. Estimated remaining: 11m 43s. Rate: 144.7 symbols/min [2025-09-30T22:06:26.657232] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52912 primary records. [2025-09-30T22:06:26.657446] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-30T22:06:26.673119] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-30T22:06:26.673183] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-30T22:06:26.675856] [INFO ] [MAIN ] Derivative Progress: 315/2009 symbols completed. CAT took 1.3s. Estimated remaining: 11m 40s. Rate: 145.2 symbols/min [2025-09-30T22:06:26.676303] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:26.676387] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:26.676263] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:26.689571] [DEBUG] [LOCAL ] CBAN: Loaded 10891 existing records from primary storage. [2025-09-30T22:06:26.689844] [INFO ] [MAIN ] CBAN: Loaded 10891 primary data records. [2025-09-30T22:06:27.069717] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-30T22:06:27.084548] [INFO ] [MAIN ] CAVA: Loaded 53552 primary data records. [2025-09-30T22:06:27.085626] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-09-30T22:06:27.123863] [INFO ] [MAIN ] CB: Loaded 49964 primary data records. [2025-09-30T22:06:27.828771] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:27.830713] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10891 primary records. [2025-09-30T22:06:27.831321] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-30T22:06:27.853355] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-30T22:06:27.854167] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-30T22:06:27.864698] [INFO ] [MAIN ] Derivative Progress: 316/2009 symbols completed. CBAN took 1.2s. Estimated remaining: 11m 44s. Rate: 144.3 symbols/min [2025-09-30T22:06:27.865066] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:27.871208] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:27.871945] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53552 primary records. [2025-09-30T22:06:27.872293] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-30T22:06:27.897941] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-30T22:06:27.898360] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-30T22:06:27.901289] [INFO ] [MAIN ] Derivative Progress: 317/2009 symbols completed. CAVA took 1.2s. Estimated remaining: 11m 41s. Rate: 144.7 symbols/min [2025-09-30T22:06:27.901852] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:27.916238] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:27.917299] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49964 primary records. [2025-09-30T22:06:27.923389] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-30T22:06:27.923943] [DEBUG] [LOCAL ] CBL: Loaded 16317 existing records from primary storage. [2025-09-30T22:06:27.924068] [INFO ] [MAIN ] CBL: Loaded 16317 primary data records. [2025-09-30T22:06:28.053879] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-30T22:06:28.054136] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-30T22:06:28.057075] [INFO ] [MAIN ] Derivative Progress: 318/2009 symbols completed. CB took 1.4s. Estimated remaining: 11m 40s. Rate: 145.0 symbols/min [2025-09-30T22:06:28.063005] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:28.330216] [DEBUG] [LOCAL ] CBRE: Loaded 50590 existing records from primary storage. [2025-09-30T22:06:28.339221] [INFO ] [MAIN ] CBRE: Loaded 50590 primary data records. [2025-09-30T22:06:28.465277] [DEBUG] [LOCAL ] CBT: Loaded 30830 existing records from primary storage. [2025-09-30T22:06:28.469941] [INFO ] [MAIN ] CBT: Loaded 30830 primary data records. [2025-09-30T22:06:29.030316] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:29.031303] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16317 primary records. [2025-09-30T22:06:29.031483] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-30T22:06:29.053602] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-30T22:06:29.054134] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-30T22:06:29.056231] [INFO ] [MAIN ] Derivative Progress: 319/2009 symbols completed. CBL took 1.2s. Estimated remaining: 11m 42s. Rate: 144.4 symbols/min [2025-09-30T22:06:29.056563] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:29.086308] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:29.089088] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50590 primary records. [2025-09-30T22:06:29.110770] [DEBUG] [LOCAL ] CBU: Loaded 22647 existing records from primary storage. [2025-09-30T22:06:29.111537] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-30T22:06:29.112590] [INFO ] [MAIN ] CBU: Loaded 22647 primary data records. [2025-09-30T22:06:29.111452] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:29.142589] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30830 primary records. [2025-09-30T22:06:29.145942] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-30T22:06:29.171936] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-30T22:06:29.203873] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-30T22:06:29.215773] [INFO ] [MAIN ] Derivative Progress: 320/2009 symbols completed. CBRE took 1.3s. Estimated remaining: 11m 41s. Rate: 144.7 symbols/min [2025-09-30T22:06:29.229017] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:29.253429] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-30T22:06:29.266417] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-30T22:06:29.270247] [INFO ] [MAIN ] Derivative Progress: 321/2009 symbols completed. CBT took 1.2s. Estimated remaining: 11m 38s. Rate: 145.0 symbols/min [2025-09-30T22:06:29.281081] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:29.512221] [DEBUG] [LOCAL ] CBZ: Loaded 33660 existing records from primary storage. [2025-09-30T22:06:29.512632] [INFO ] [MAIN ] CBZ: Loaded 33660 primary data records. [2025-09-30T22:06:29.860917] [DEBUG] [LOCAL ] CC: Loaded 53006 existing records from primary storage. [2025-09-30T22:06:29.874614] [INFO ] [MAIN ] CC: Loaded 53006 primary data records. [2025-09-30T22:06:29.958506] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:29.983450] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22647 primary records. [2025-09-30T22:06:30.018162] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-30T22:06:30.292277] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-30T22:06:30.292695] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-30T22:06:30.296423] [INFO ] [MAIN ] Derivative Progress: 322/2009 symbols completed. CBU took 1.2s. Estimated remaining: 11m 41s. Rate: 144.4 symbols/min [2025-09-30T22:06:30.298737] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:30.314357] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:30.316453] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33660 primary records. [2025-09-30T22:06:30.316943] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-30T22:06:30.338507] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-30T22:06:30.338717] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-30T22:06:30.341856] [INFO ] [MAIN ] Derivative Progress: 323/2009 symbols completed. CBZ took 1.1s. Estimated remaining: 11m 39s. Rate: 144.8 symbols/min [2025-09-30T22:06:30.342127] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:30.368937] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:30.369804] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53006 primary records. [2025-09-30T22:06:30.369908] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-30T22:06:30.390410] [DEBUG] [LOCAL ] CCIF: Loaded 15713 existing records from primary storage. [2025-09-30T22:06:30.394573] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-30T22:06:30.410982] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-30T22:06:30.413817] [INFO ] [MAIN ] Derivative Progress: 324/2009 symbols completed. CC took 1.1s. Estimated remaining: 11m 37s. Rate: 145.2 symbols/min [2025-09-30T22:06:30.413970] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:30.414376] [INFO ] [MAIN ] CCIF: Loaded 15713 primary data records. [2025-09-30T22:06:30.557638] [DEBUG] [LOCAL ] CCI: Loaded 53140 existing records from primary storage. [2025-09-30T22:06:30.563819] [INFO ] [MAIN ] CCI: Loaded 53140 primary data records. [2025-09-30T22:06:30.928420] [DEBUG] [LOCAL ] CCJ: Loaded 53673 existing records from primary storage. [2025-09-30T22:06:30.934726] [INFO ] [MAIN ] CCJ: Loaded 53673 primary data records. [2025-09-30T22:06:31.481451] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:31.482946] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15713 primary records. [2025-09-30T22:06:31.483248] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-30T22:06:31.500816] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-30T22:06:31.501165] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-30T22:06:31.504973] [INFO ] [MAIN ] Derivative Progress: 325/2009 symbols completed. CCIF took 1.2s. Estimated remaining: 11m 40s. Rate: 144.4 symbols/min [2025-09-30T22:06:31.505569] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:31.523819] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:31.524724] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53140 primary records. [2025-09-30T22:06:31.524984] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-30T22:06:31.565683] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:31.568586] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53673 primary records. [2025-09-30T22:06:31.581057] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-30T22:06:31.581220] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-30T22:06:31.581713] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-30T22:06:31.585637] [INFO ] [MAIN ] Derivative Progress: 326/2009 symbols completed. CCI took 1.3s. Estimated remaining: 11m 37s. Rate: 144.8 symbols/min [2025-09-30T22:06:31.586276] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:31.605216] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-30T22:06:31.606142] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-30T22:06:31.609468] [INFO ] [MAIN ] Derivative Progress: 327/2009 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 35s. Rate: 145.2 symbols/min [2025-09-30T22:06:31.609801] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:31.627274] [DEBUG] [LOCAL ] CCK: Loaded 46241 existing records from primary storage. [2025-09-30T22:06:31.627438] [INFO ] [MAIN ] CCK: Loaded 46241 primary data records. [2025-09-30T22:06:32.011279] [DEBUG] [LOCAL ] CCO: Loaded 47809 existing records from primary storage. [2025-09-30T22:06:32.011596] [INFO ] [MAIN ] CCO: Loaded 47809 primary data records. [2025-09-30T22:06:32.024728] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-30T22:06:32.089474] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-30T22:06:32.746848] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:32.748251] [INFO ] [MAIN ] CCK: Generated 1793 derivative records from 46241 primary records. [2025-09-30T22:06:32.748868] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-30T22:06:32.774957] [DEBUG] [LOCAL ] CCK: Derivative data saved (1793 records). [2025-09-30T22:06:32.776009] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-30T22:06:32.778812] [INFO ] [MAIN ] Derivative Progress: 328/2009 symbols completed. CCK took 1.3s. Estimated remaining: 11m 39s. Rate: 144.4 symbols/min [2025-09-30T22:06:32.795137] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:32.796055] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47809 primary records. [2025-09-30T22:06:32.809562] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-30T22:06:32.809897] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:32.811606] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-30T22:06:32.811723] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-30T22:06:32.844151] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-30T22:06:32.845033] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-30T22:06:32.845232] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-30T22:06:32.845144] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-30T22:06:32.848141] [INFO ] [MAIN ] Derivative Progress: 329/2009 symbols completed. CCO took 1.2s. Estimated remaining: 11m 36s. Rate: 144.8 symbols/min [2025-09-30T22:06:32.851591] [INFO ] [MAIN ] Derivative Progress: 330/2009 symbols completed. CCL took 1.3s. Estimated remaining: 11m 34s. Rate: 145.2 symbols/min [2025-09-30T22:06:32.852187] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:32.852300] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:32.852385] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:32.865284] [DEBUG] [LOCAL ] CCRD: Loaded 9062 existing records from primary storage. [2025-09-30T22:06:32.865596] [INFO ] [MAIN ] CCRD: Loaded 9062 primary data records. [2025-09-30T22:06:33.002948] [DEBUG] [LOCAL ] CCU: Loaded 23218 existing records from primary storage. [2025-09-30T22:06:33.046027] [INFO ] [MAIN ] CCU: Loaded 23218 primary data records. [2025-09-30T22:06:33.106505] [DEBUG] [LOCAL ] CCS: Loaded 30574 existing records from primary storage. [2025-09-30T22:06:33.168624] [INFO ] [MAIN ] CCS: Loaded 30574 primary data records. [2025-09-30T22:06:33.920329] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:33.922357] [INFO ] [MAIN ] CCRD: Generated 1793 derivative records from 9062 primary records. [2025-09-30T22:06:33.922820] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-30T22:06:33.943131] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1793 records). [2025-09-30T22:06:33.951944] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-30T22:06:33.960131] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:33.959327] [INFO ] [MAIN ] Derivative Progress: 331/2009 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 37s. Rate: 144.5 symbols/min [2025-09-30T22:06:33.960523] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:33.961473] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23218 primary records. [2025-09-30T22:06:33.961699] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-30T22:06:33.995556] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:33.996477] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30574 primary records. [2025-09-30T22:06:33.995262] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-30T22:06:33.996685] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-30T22:06:33.996597] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-30T22:06:33.999456] [INFO ] [MAIN ] Derivative Progress: 332/2009 symbols completed. CCU took 1.1s. Estimated remaining: 11m 35s. Rate: 144.9 symbols/min [2025-09-30T22:06:34.000513] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:34.024967] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-30T22:06:34.024869] [DEBUG] [LOCAL ] CDLR: Loaded 9816 existing records from primary storage. [2025-09-30T22:06:34.025139] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-30T22:06:34.025261] [INFO ] [MAIN ] CDLR: Loaded 9816 primary data records. [2025-09-30T22:06:34.028285] [INFO ] [MAIN ] Derivative Progress: 333/2009 symbols completed. CCS took 1.2s. Estimated remaining: 11m 32s. Rate: 145.3 symbols/min [2025-09-30T22:06:34.028548] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:34.220532] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-30T22:06:34.241571] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-30T22:06:34.658979] [DEBUG] [LOCAL ] CDP: Loaded 42529 existing records from primary storage. [2025-09-30T22:06:34.780920] [INFO ] [MAIN ] CDP: Loaded 42529 primary data records. [2025-09-30T22:06:35.141919] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:35.143377] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9816 primary records. [2025-09-30T22:06:35.143600] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-30T22:06:35.176970] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:35.179811] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-30T22:06:35.180397] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-30T22:06:35.183479] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-30T22:06:35.183627] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-30T22:06:35.194120] [INFO ] [MAIN ] Derivative Progress: 334/2009 symbols completed. CDLR took 1.2s. Estimated remaining: 11m 36s. Rate: 144.5 symbols/min [2025-09-30T22:06:35.198147] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:35.204143] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-30T22:06:35.204313] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-30T22:06:35.207281] [INFO ] [MAIN ] Derivative Progress: 335/2009 symbols completed. CDE took 1.2s. Estimated remaining: 11m 33s. Rate: 144.9 symbols/min [2025-09-30T22:06:35.207525] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:35.231941] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:35.232797] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42529 primary records. [2025-09-30T22:06:35.232899] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-30T22:06:35.259635] [DEBUG] [LOCAL ] CDRE: Loaded 25130 existing records from primary storage. [2025-09-30T22:06:35.260613] [INFO ] [MAIN ] CDRE: Loaded 25130 primary data records. [2025-09-30T22:06:35.297628] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-30T22:06:35.316086] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-30T22:06:35.327353] [INFO ] [MAIN ] Derivative Progress: 336/2009 symbols completed. CDP took 1.3s. Estimated remaining: 11m 31s. Rate: 145.2 symbols/min [2025-09-30T22:06:35.337292] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:35.611538] [DEBUG] [LOCAL ] CEE: Loaded 6103 existing records from primary storage. [2025-09-30T22:06:35.622463] [INFO ] [MAIN ] CEE: Loaded 6103 primary data records. [2025-09-30T22:06:35.635446] [DEBUG] [LOCAL ] CE: Loaded 51519 existing records from primary storage. [2025-09-30T22:06:35.671728] [INFO ] [MAIN ] CE: Loaded 51519 primary data records. [2025-09-30T22:06:36.311297] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:36.312260] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 25130 primary records. [2025-09-30T22:06:36.312448] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-30T22:06:36.339517] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-09-30T22:06:36.345023] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:36.345136] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-30T22:06:36.345882] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 6103 primary records. [2025-09-30T22:06:36.348365] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-30T22:06:36.348284] [INFO ] [MAIN ] Derivative Progress: 337/2009 symbols completed. CDRE took 1.2s. Estimated remaining: 11m 34s. Rate: 144.6 symbols/min [2025-09-30T22:06:36.349363] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:36.365836] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-30T22:06:36.366170] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-30T22:06:36.368791] [INFO ] [MAIN ] Derivative Progress: 338/2009 symbols completed. CEE took 1.0s. Estimated remaining: 11m 32s. Rate: 145.0 symbols/min [2025-09-30T22:06:36.369104] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:36.384436] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:36.385202] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51519 primary records. [2025-09-30T22:06:36.385359] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-30T22:06:36.411823] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-30T22:06:36.411963] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-30T22:06:36.415085] [INFO ] [MAIN ] Derivative Progress: 339/2009 symbols completed. CE took 1.2s. Estimated remaining: 11m 29s. Rate: 145.4 symbols/min [2025-09-30T22:06:36.415436] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:36.425542] [DEBUG] [LOCAL ] CEPU: Loaded 25948 existing records from primary storage. [2025-09-30T22:06:36.425781] [INFO ] [MAIN ] CEPU: Loaded 25948 primary data records. [2025-09-30T22:06:36.592198] [DEBUG] [LOCAL ] CF: Loaded 52186 existing records from primary storage. [2025-09-30T22:06:36.651797] [INFO ] [MAIN ] CF: Loaded 52186 primary data records. [2025-09-30T22:06:36.988489] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-30T22:06:37.032549] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-09-30T22:06:37.506942] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:37.509037] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25948 primary records. [2025-09-30T22:06:37.509765] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-30T22:06:37.544094] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-30T22:06:37.544274] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-30T22:06:37.543171] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:37.545437] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52186 primary records. [2025-09-30T22:06:37.548844] [INFO ] [MAIN ] Derivative Progress: 340/2009 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 32s. Rate: 144.6 symbols/min [2025-09-30T22:06:37.549103] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-30T22:06:37.549565] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:37.585012] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-30T22:06:37.585387] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-30T22:06:37.585710] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:37.588683] [INFO ] [MAIN ] Derivative Progress: 341/2009 symbols completed. CF took 1.2s. Estimated remaining: 11m 30s. Rate: 145.0 symbols/min [2025-09-30T22:06:37.588991] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:37.589969] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-09-30T22:06:37.590596] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-30T22:06:37.608389] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-09-30T22:06:37.608585] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-30T22:06:37.613019] [INFO ] [MAIN ] Derivative Progress: 342/2009 symbols completed. CFG took 1.2s. Estimated remaining: 11m 28s. Rate: 145.4 symbols/min [2025-09-30T22:06:37.613302] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:37.625467] [DEBUG] [LOCAL ] CGV: Loaded 1411 existing records from primary storage. [2025-09-30T22:06:37.625813] [INFO ] [MAIN ] CGV: Loaded 1411 primary data records. [2025-09-30T22:06:37.759813] [DEBUG] [LOCAL ] CFR: Loaded 33291 existing records from primary storage. [2025-09-30T22:06:37.760089] [INFO ] [MAIN ] CFR: Loaded 33291 primary data records. [2025-09-30T22:06:37.948838] [DEBUG] [LOCAL ] CGAU: Loaded 42654 existing records from primary storage. [2025-09-30T22:06:38.091878] [INFO ] [MAIN ] CGAU: Loaded 42654 primary data records. [2025-09-30T22:06:38.709711] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:38.711250] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1411 primary records. [2025-09-30T22:06:38.712834] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-30T22:06:38.733124] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-30T22:06:38.733693] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-30T22:06:38.748677] [INFO ] [MAIN ] Derivative Progress: 343/2009 symbols completed. CGV took 1.1s. Estimated remaining: 11m 31s. Rate: 144.7 symbols/min [2025-09-30T22:06:38.749529] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:38.750711] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33291 primary records. [2025-09-30T22:06:38.750810] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-30T22:06:38.769030] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-30T22:06:38.770835] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-30T22:06:38.773619] [INFO ] [MAIN ] Derivative Progress: 344/2009 symbols completed. CFR took 1.2s. Estimated remaining: 11m 29s. Rate: 145.1 symbols/min [2025-09-30T22:06:38.786528] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:38.787230] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42654 primary records. [2025-09-30T22:06:38.787295] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-30T22:06:38.803076] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-30T22:06:38.803180] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-30T22:06:38.806681] [INFO ] [MAIN ] Derivative Progress: 345/2009 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 26s. Rate: 145.4 symbols/min [2025-09-30T22:06:38.807277] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:38.807388] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:38.807846] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:38.833524] [DEBUG] [LOCAL ] CHE: Loaded 14939 existing records from primary storage. [2025-09-30T22:06:38.833699] [INFO ] [MAIN ] CHE: Loaded 14939 primary data records. [2025-09-30T22:06:38.897829] [DEBUG] [LOCAL ] CHCT: Loaded 23849 existing records from primary storage. [2025-09-30T22:06:38.929333] [INFO ] [MAIN ] CHCT: Loaded 23849 primary data records. [2025-09-30T22:06:39.201550] [DEBUG] [LOCAL ] CHD: Loaded 52070 existing records from primary storage. [2025-09-30T22:06:39.329428] [INFO ] [MAIN ] CHD: Loaded 52070 primary data records. [2025-09-30T22:06:39.911228] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:39.913814] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14939 primary records. [2025-09-30T22:06:39.914150] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-30T22:06:39.947592] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:39.950411] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 23849 primary records. [2025-09-30T22:06:39.951124] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-30T22:06:39.951285] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-30T22:06:39.952333] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-30T22:06:39.954868] [INFO ] [MAIN ] Derivative Progress: 346/2009 symbols completed. CHE took 1.1s. Estimated remaining: 11m 30s. Rate: 144.7 symbols/min [2025-09-30T22:06:39.956041] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:39.986729] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:39.988939] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52070 primary records. [2025-09-30T22:06:39.989166] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-30T22:06:39.999716] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-30T22:06:40.006891] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-30T22:06:40.011556] [INFO ] [MAIN ] Derivative Progress: 347/2009 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 27s. Rate: 145.1 symbols/min [2025-09-30T22:06:40.013099] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:40.012870] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-30T22:06:40.013410] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-30T22:06:40.017043] [INFO ] [MAIN ] Derivative Progress: 348/2009 symbols completed. CHD took 1.2s. Estimated remaining: 11m 25s. Rate: 145.5 symbols/min [2025-09-30T22:06:40.017318] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:40.052677] [DEBUG] [LOCAL ] CHMI: Loaded 21961 existing records from primary storage. [2025-09-30T22:06:40.073611] [INFO ] [MAIN ] CHMI: Loaded 21961 primary data records. [2025-09-30T22:06:40.115466] [DEBUG] [LOCAL ] CHGG: Loaded 47636 existing records from primary storage. [2025-09-30T22:06:40.157456] [INFO ] [MAIN ] CHGG: Loaded 47636 primary data records. [2025-09-30T22:06:40.158049] [DEBUG] [LOCAL ] CHH: Loaded 32027 existing records from primary storage. [2025-09-30T22:06:40.172263] [INFO ] [MAIN ] CHH: Loaded 32027 primary data records. [2025-09-30T22:06:41.141110] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:41.142356] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21961 primary records. [2025-09-30T22:06:41.142612] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-30T22:06:41.183398] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-30T22:06:41.185168] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-30T22:06:41.188405] [INFO ] [MAIN ] Derivative Progress: 349/2009 symbols completed. CHMI took 1.2s. Estimated remaining: 11m 28s. Rate: 144.7 symbols/min [2025-09-30T22:06:41.185826] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:41.188753] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:41.197782] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47636 primary records. [2025-09-30T22:06:41.203148] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-30T22:06:41.205092] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:41.218638] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32027 primary records. [2025-09-30T22:06:41.219348] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-30T22:06:41.227238] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-30T22:06:41.227764] [DEBUG] [LOCAL ] CHN: Loaded 4833 existing records from primary storage. [2025-09-30T22:06:41.235182] [INFO ] [MAIN ] CHN: Loaded 4833 primary data records. [2025-09-30T22:06:41.227942] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-30T22:06:41.238508] [INFO ] [MAIN ] Derivative Progress: 350/2009 symbols completed. CHGG took 1.3s. Estimated remaining: 11m 26s. Rate: 145.1 symbols/min [2025-09-30T22:06:41.243853] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:41.300622] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-30T22:06:41.318944] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-30T22:06:41.328241] [INFO ] [MAIN ] Derivative Progress: 351/2009 symbols completed. CHH took 1.3s. Estimated remaining: 11m 24s. Rate: 145.4 symbols/min [2025-09-30T22:06:41.340679] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:41.605577] [DEBUG] [LOCAL ] CHT: Loaded 19569 existing records from primary storage. [2025-09-30T22:06:41.605748] [INFO ] [MAIN ] CHT: Loaded 19569 primary data records. [2025-09-30T22:06:41.731884] [DEBUG] [LOCAL ] CHPT: Loaded 48767 existing records from primary storage. [2025-09-30T22:06:41.744877] [INFO ] [MAIN ] CHPT: Loaded 48767 primary data records. [2025-09-30T22:06:42.336709] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:42.338769] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4833 primary records. [2025-09-30T22:06:42.339202] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-30T22:06:42.358669] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-30T22:06:42.358834] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-30T22:06:42.361543] [INFO ] [MAIN ] Derivative Progress: 352/2009 symbols completed. CHN took 1.2s. Estimated remaining: 11m 27s. Rate: 144.8 symbols/min [2025-09-30T22:06:42.361901] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:42.383986] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:42.385157] [INFO ] [MAIN ] CHT: Generated 1793 derivative records from 19569 primary records. [2025-09-30T22:06:42.385408] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-30T22:06:42.421025] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:42.421121] [DEBUG] [LOCAL ] CHT: Derivative data saved (1793 records). [2025-09-30T22:06:42.421458] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-30T22:06:42.426406] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 48767 primary records. [2025-09-30T22:06:42.425288] [INFO ] [MAIN ] Derivative Progress: 353/2009 symbols completed. CHT took 1.1s. Estimated remaining: 11m 25s. Rate: 145.1 symbols/min [2025-09-30T22:06:42.426692] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:42.426851] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-30T22:06:42.461730] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-30T22:06:42.461889] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-30T22:06:42.464989] [INFO ] [MAIN ] Derivative Progress: 354/2009 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 22s. Rate: 145.5 symbols/min [2025-09-30T22:06:42.465323] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:42.485541] [DEBUG] [LOCAL ] CHWY: Loaded 53655 existing records from primary storage. [2025-09-30T22:06:42.485901] [INFO ] [MAIN ] CHWY: Loaded 53655 primary data records. [2025-09-30T22:06:42.625381] [DEBUG] [LOCAL ] CIA: Loaded 17030 existing records from primary storage. [2025-09-30T22:06:42.630304] [INFO ] [MAIN ] CIA: Loaded 17030 primary data records. [2025-09-30T22:06:42.971380] [DEBUG] [LOCAL ] CI: Loaded 49729 existing records from primary storage. [2025-09-30T22:06:42.976324] [INFO ] [MAIN ] CI: Loaded 49729 primary data records. [2025-09-30T22:06:43.574026] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:43.575468] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53655 primary records. [2025-09-30T22:06:43.575770] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-30T22:06:43.618536] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:43.619734] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-30T22:06:43.620421] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-30T22:06:43.623201] [INFO ] [MAIN ] Derivative Progress: 355/2009 symbols completed. CHWY took 1.3s. Estimated remaining: 11m 26s. Rate: 144.8 symbols/min [2025-09-30T22:06:43.624531] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 17030 primary records. [2025-09-30T22:06:43.624422] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:43.625088] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-30T22:06:43.647002] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-30T22:06:43.647439] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-30T22:06:43.650495] [INFO ] [MAIN ] Derivative Progress: 356/2009 symbols completed. CIA took 1.2s. Estimated remaining: 11m 23s. Rate: 145.1 symbols/min [2025-09-30T22:06:43.664357] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:43.664960] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:43.666274] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49729 primary records. [2025-09-30T22:06:43.666411] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-30T22:06:43.694304] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-30T22:06:43.694483] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-30T22:06:43.698150] [INFO ] [MAIN ] Derivative Progress: 357/2009 symbols completed. CI took 1.3s. Estimated remaining: 11m 21s. Rate: 145.5 symbols/min [2025-09-30T22:06:43.698436] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:43.712828] [DEBUG] [LOCAL ] CIB: Loaded 30856 existing records from primary storage. [2025-09-30T22:06:43.716283] [INFO ] [MAIN ] CIB: Loaded 30856 primary data records. [2025-09-30T22:06:43.716156] [DEBUG] [LOCAL ] CIF: Loaded 4251 existing records from primary storage. [2025-09-30T22:06:43.722076] [INFO ] [MAIN ] CIF: Loaded 4251 primary data records. [2025-09-30T22:06:44.012209] [DEBUG] [LOCAL ] CIEN: Loaded 52073 existing records from primary storage. [2025-09-30T22:06:44.028359] [INFO ] [MAIN ] CIEN: Loaded 52073 primary data records. [2025-09-30T22:06:44.798594] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:44.813083] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30856 primary records. [2025-09-30T22:06:44.813455] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:44.814105] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4251 primary records. [2025-09-30T22:06:44.814374] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-30T22:06:44.814430] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-30T22:06:44.847445] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-30T22:06:44.848570] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-30T22:06:44.859204] [INFO ] [MAIN ] Derivative Progress: 358/2009 symbols completed. CIF took 1.2s. Estimated remaining: 11m 24s. Rate: 144.8 symbols/min [2025-09-30T22:06:44.866223] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:44.868039] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52073 primary records. [2025-09-30T22:06:44.868116] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-30T22:06:44.868480] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-30T22:06:44.868746] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-30T22:06:44.871804] [INFO ] [MAIN ] Derivative Progress: 359/2009 symbols completed. CIB took 1.2s. Estimated remaining: 11m 22s. Rate: 145.2 symbols/min [2025-09-30T22:06:44.887182] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-30T22:06:44.887256] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-30T22:06:44.890307] [INFO ] [MAIN ] Derivative Progress: 360/2009 symbols completed. CIEN took 1.2s. Estimated remaining: 11m 20s. Rate: 145.5 symbols/min [2025-09-30T22:06:44.890866] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:44.891302] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:44.890805] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:44.910359] [DEBUG] [LOCAL ] CII: Loaded 15237 existing records from primary storage. [2025-09-30T22:06:44.910594] [INFO ] [MAIN ] CII: Loaded 15237 primary data records. [2025-09-30T22:06:45.121828] [DEBUG] [LOCAL ] CIM: Loaded 37414 existing records from primary storage. [2025-09-30T22:06:45.091548] [DEBUG] [LOCAL ] CIG: Loaded 43817 existing records from primary storage. [2025-09-30T22:06:45.133914] [INFO ] [MAIN ] CIG: Loaded 43817 primary data records. [2025-09-30T22:06:45.134022] [INFO ] [MAIN ] CIM: Loaded 37414 primary data records. [2025-09-30T22:06:46.010208] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:46.011148] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15237 primary records. [2025-09-30T22:06:46.011307] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-30T22:06:46.036591] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-30T22:06:46.037191] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-30T22:06:46.039533] [INFO ] [MAIN ] Derivative Progress: 361/2009 symbols completed. CII took 1.1s. Estimated remaining: 11m 23s. Rate: 144.8 symbols/min [2025-09-30T22:06:46.040945] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:46.077374] [DEBUG] [LOCAL ] CIMN: Loaded 2679 existing records from primary storage. [2025-09-30T22:06:46.078164] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:46.079704] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37414 primary records. [2025-09-30T22:06:46.078781] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:46.080677] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43817 primary records. [2025-09-30T22:06:46.080797] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-30T22:06:46.078233] [INFO ] [MAIN ] CIMN: Loaded 2679 primary data records. [2025-09-30T22:06:46.081276] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-30T22:06:46.206364] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-30T22:06:46.220337] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-30T22:06:46.236172] [INFO ] [MAIN ] Derivative Progress: 362/2009 symbols completed. CIG took 1.3s. Estimated remaining: 11m 21s. Rate: 145.0 symbols/min [2025-09-30T22:06:46.237729] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:46.237545] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-30T22:06:46.238679] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-30T22:06:46.253140] [INFO ] [MAIN ] Derivative Progress: 363/2009 symbols completed. CIM took 1.4s. Estimated remaining: 11m 19s. Rate: 145.4 symbols/min [2025-09-30T22:06:46.263813] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:46.467293] [DEBUG] [LOCAL ] CINT: Loaded 18629 existing records from primary storage. [2025-09-30T22:06:46.467936] [INFO ] [MAIN ] CINT: Loaded 18629 primary data records. [2025-09-30T22:06:46.535506] [DEBUG] [LOCAL ] CIO: Loaded 20234 existing records from primary storage. [2025-09-30T22:06:46.544842] [INFO ] [MAIN ] CIO: Loaded 20234 primary data records. [2025-09-30T22:06:47.213307] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:47.214409] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2679 primary records. [2025-09-30T22:06:47.214577] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-30T22:06:47.235529] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-09-30T22:06:47.236095] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-30T22:06:47.238396] [INFO ] [MAIN ] Derivative Progress: 364/2009 symbols completed. CIMN took 1.2s. Estimated remaining: 11m 21s. Rate: 144.9 symbols/min [2025-09-30T22:06:47.238789] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:47.258954] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:47.259819] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18629 primary records. [2025-09-30T22:06:47.259977] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-30T22:06:47.273164] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:47.273990] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20234 primary records. [2025-09-30T22:06:47.280830] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-30T22:06:47.310089] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-30T22:06:47.310718] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-30T22:06:47.313632] [INFO ] [MAIN ] Derivative Progress: 365/2009 symbols completed. CINT took 1.1s. Estimated remaining: 11m 19s. Rate: 145.2 symbols/min [2025-09-30T22:06:47.314096] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:47.327635] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-30T22:06:47.327773] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-30T22:06:47.326738] [DEBUG] [LOCAL ] CION: Loaded 29029 existing records from primary storage. [2025-09-30T22:06:47.330986] [INFO ] [MAIN ] Derivative Progress: 366/2009 symbols completed. CIO took 1.1s. Estimated remaining: 11m 17s. Rate: 145.6 symbols/min [2025-09-30T22:06:47.331237] [INFO ] [MAIN ] CION: Loaded 29029 primary data records. [2025-09-30T22:06:47.331403] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:47.707508] [DEBUG] [LOCAL ] CLB: Loaded 33011 existing records from primary storage. [2025-09-30T22:06:47.708291] [INFO ] [MAIN ] CLB: Loaded 33011 primary data records. [2025-09-30T22:06:47.709047] [DEBUG] [LOCAL ] CIVI: Loaded 52589 existing records from primary storage. [2025-09-30T22:06:47.709350] [INFO ] [MAIN ] CIVI: Loaded 52589 primary data records. [2025-09-30T22:06:48.387688] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:48.389215] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29029 primary records. [2025-09-30T22:06:48.389674] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-30T22:06:48.410699] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-30T22:06:48.410961] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-30T22:06:48.414049] [INFO ] [MAIN ] Derivative Progress: 367/2009 symbols completed. CION took 1.2s. Estimated remaining: 11m 20s. Rate: 144.9 symbols/min [2025-09-30T22:06:48.414361] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:48.439606] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:48.458241] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:48.459199] [DEBUG] [LOCAL ] CLCO: Loaded 12668 existing records from primary storage. [2025-09-30T22:06:48.458922] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52589 primary records. [2025-09-30T22:06:48.453230] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33011 primary records. [2025-09-30T22:06:48.459354] [INFO ] [MAIN ] CLCO: Loaded 12668 primary data records. [2025-09-30T22:06:48.459534] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-30T22:06:48.459729] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-30T22:06:48.612348] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-30T22:06:48.630744] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-30T22:06:48.642344] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-30T22:06:48.652870] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-30T22:06:48.639864] [INFO ] [MAIN ] Derivative Progress: 368/2009 symbols completed. CLB took 1.3s. Estimated remaining: 11m 18s. Rate: 145.1 symbols/min [2025-09-30T22:06:48.707118] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:48.710750] [INFO ] [MAIN ] Derivative Progress: 369/2009 symbols completed. CIVI took 1.4s. Estimated remaining: 11m 17s. Rate: 145.4 symbols/min [2025-09-30T22:06:48.711206] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:48.866977] [DEBUG] [LOCAL ] CLDT: Loaded 25444 existing records from primary storage. [2025-09-30T22:06:48.867553] [INFO ] [MAIN ] CLDT: Loaded 25444 primary data records. [2025-09-30T22:06:49.104437] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-30T22:06:49.195000] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-09-30T22:06:49.195335] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:49.281226] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12668 primary records. [2025-09-30T22:06:49.307307] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-30T22:06:49.426915] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-30T22:06:49.432205] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-30T22:06:49.434534] [INFO ] [MAIN ] Derivative Progress: 370/2009 symbols completed. CLCO took 1.0s. Estimated remaining: 11m 18s. Rate: 145.1 symbols/min [2025-09-30T22:06:49.447695] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:49.645393] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:49.646230] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25444 primary records. [2025-09-30T22:06:49.646677] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-30T22:06:49.669553] [DEBUG] [LOCAL ] CLH: Loaded 27833 existing records from primary storage. [2025-09-30T22:06:49.672053] [INFO ] [MAIN ] CLH: Loaded 27833 primary data records. [2025-09-30T22:06:49.696832] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-30T22:06:49.728830] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-30T22:06:49.792182] [INFO ] [MAIN ] Derivative Progress: 371/2009 symbols completed. CLDT took 1.1s. Estimated remaining: 11m 17s. Rate: 145.2 symbols/min [2025-09-30T22:06:49.789547] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:49.805063] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:49.806513] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-09-30T22:06:49.807093] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-30T22:06:50.037845] [DEBUG] [LOCAL ] CLPR: Loaded 11437 existing records from primary storage. [2025-09-30T22:06:50.039691] [INFO ] [MAIN ] CLPR: Loaded 11437 primary data records. [2025-09-30T22:06:50.039096] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-30T22:06:50.063248] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-30T22:06:50.087343] [INFO ] [MAIN ] Derivative Progress: 372/2009 symbols completed. CLF took 1.4s. Estimated remaining: 11m 16s. Rate: 145.3 symbols/min [2025-09-30T22:06:50.101038] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:50.390298] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:50.406464] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27833 primary records. [2025-09-30T22:06:50.406799] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-30T22:06:50.425487] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-30T22:06:50.425797] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-30T22:06:50.429103] [INFO ] [MAIN ] Derivative Progress: 373/2009 symbols completed. CLH took 1.0s. Estimated remaining: 11m 15s. Rate: 145.4 symbols/min [2025-09-30T22:06:50.461113] [DEBUG] [LOCAL ] CLS: Loaded 53623 existing records from primary storage. [2025-09-30T22:06:50.461470] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:50.461693] [INFO ] [MAIN ] CLS: Loaded 53623 primary data records. [2025-09-30T22:06:50.462433] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11437 primary records. [2025-09-30T22:06:50.462527] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-30T22:06:50.609366] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-30T22:06:50.619794] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-30T22:06:50.641414] [INFO ] [MAIN ] Derivative Progress: 374/2009 symbols completed. CLPR took 0.8s. Estimated remaining: 11m 14s. Rate: 145.6 symbols/min [2025-09-30T22:06:50.813946] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:50.814683] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53623 primary records. [2025-09-30T22:06:50.814760] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-30T22:06:50.831142] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-30T22:06:50.831203] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-30T22:06:50.833510] [INFO ] [MAIN ] Derivative Progress: 375/2009 symbols completed. CLS took 0.7s. Estimated remaining: 11m 13s. Rate: 145.8 symbols/min [2025-09-30T22:06:50.834167] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:50.834236] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:50.834074] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:50.859499] [DEBUG] [LOCAL ] CLW: Loaded 21778 existing records from primary storage. [2025-09-30T22:06:50.859701] [INFO ] [MAIN ] CLW: Loaded 21778 primary data records. [2025-09-30T22:06:51.238622] [DEBUG] [LOCAL ] CLVT: Loaded 51954 existing records from primary storage. [2025-09-30T22:06:51.239029] [INFO ] [MAIN ] CLVT: Loaded 51954 primary data records. [2025-09-30T22:06:51.252400] [DEBUG] [LOCAL ] CLX: Loaded 51484 existing records from primary storage. [2025-09-30T22:06:51.275152] [INFO ] [MAIN ] CLX: Loaded 51484 primary data records. [2025-09-30T22:06:51.961315] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:51.962613] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21778 primary records. [2025-09-30T22:06:51.963824] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-30T22:06:51.983860] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-30T22:06:51.983987] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-30T22:06:51.986763] [INFO ] [MAIN ] Derivative Progress: 376/2009 symbols completed. CLW took 1.2s. Estimated remaining: 11m 15s. Rate: 145.1 symbols/min [2025-09-30T22:06:51.987158] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:52.006013] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:52.008076] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51954 primary records. [2025-09-30T22:06:52.008954] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-30T22:06:52.031578] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:52.037347] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51484 primary records. [2025-09-30T22:06:52.038904] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-30T22:06:52.042885] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-30T22:06:52.050821] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-30T22:06:52.053012] [INFO ] [MAIN ] Derivative Progress: 377/2009 symbols completed. CLVT took 1.2s. Estimated remaining: 11m 13s. Rate: 145.4 symbols/min [2025-09-30T22:06:52.054452] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:52.073287] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-30T22:06:52.073415] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-30T22:06:52.076279] [INFO ] [MAIN ] Derivative Progress: 378/2009 symbols completed. CLX took 1.2s. Estimated remaining: 11m 11s. Rate: 145.8 symbols/min [2025-09-30T22:06:52.076693] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:52.093305] [DEBUG] [LOCAL ] CM: Loaded 48567 existing records from primary storage. [2025-09-30T22:06:52.093765] [INFO ] [MAIN ] CM: Loaded 48567 primary data records. [2025-09-30T22:06:52.276209] [DEBUG] [LOCAL ] CMBT: Loaded 23214 existing records from primary storage. [2025-09-30T22:06:52.348050] [INFO ] [MAIN ] CMBT: Loaded 23214 primary data records. [2025-09-30T22:06:52.476431] [DEBUG] [LOCAL ] CMA: Loaded 49922 existing records from primary storage. [2025-09-30T22:06:52.491161] [INFO ] [MAIN ] CMA: Loaded 49922 primary data records. [2025-09-30T22:06:53.169443] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:53.170957] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48567 primary records. [2025-09-30T22:06:53.171272] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-30T22:06:53.193478] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-09-30T22:06:53.194166] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-30T22:06:53.198222] [INFO ] [MAIN ] Derivative Progress: 379/2009 symbols completed. CM took 1.2s. Estimated remaining: 11m 14s. Rate: 145.1 symbols/min [2025-09-30T22:06:53.198733] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:53.220876] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:53.221922] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 23214 primary records. [2025-09-30T22:06:53.222475] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-30T22:06:53.240553] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-30T22:06:53.240632] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-30T22:06:53.243459] [INFO ] [MAIN ] Derivative Progress: 380/2009 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 12s. Rate: 145.4 symbols/min [2025-09-30T22:06:53.245400] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:53.265504] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:53.266669] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49922 primary records. [2025-09-30T22:06:53.269713] [DEBUG] [LOCAL ] CMCM: Loaded 4747 existing records from primary storage. [2025-09-30T22:06:53.269932] [INFO ] [MAIN ] CMCM: Loaded 4747 primary data records. [2025-09-30T22:06:53.270003] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-30T22:06:53.443827] [DEBUG] [LOCAL ] CMC: Loaded 45583 existing records from primary storage. [2025-09-30T22:06:53.466597] [INFO ] [MAIN ] CMC: Loaded 45583 primary data records. [2025-09-30T22:06:53.533100] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-30T22:06:53.734069] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-30T22:06:53.753306] [INFO ] [MAIN ] Derivative Progress: 381/2009 symbols completed. CMA took 1.7s. Estimated remaining: 11m 12s. Rate: 145.4 symbols/min [2025-09-30T22:06:53.768442] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:54.048738] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:54.049947] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4747 primary records. [2025-09-30T22:06:54.050166] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-30T22:06:54.081598] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-30T22:06:54.082854] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-09-30T22:06:54.082971] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-30T22:06:54.083044] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-09-30T22:06:54.085321] [INFO ] [MAIN ] Derivative Progress: 382/2009 symbols completed. CMCM took 0.8s. Estimated remaining: 11m 11s. Rate: 145.4 symbols/min [2025-09-30T22:06:54.113784] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:54.223417] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:54.255518] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45583 primary records. [2025-09-30T22:06:54.273282] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-30T22:06:54.461701] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-30T22:06:54.462144] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-30T22:06:54.476168] [INFO ] [MAIN ] Derivative Progress: 383/2009 symbols completed. CMC took 1.3s. Estimated remaining: 11m 11s. Rate: 145.5 symbols/min [2025-09-30T22:06:54.477388] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:54.479706] [DEBUG] [LOCAL ] CMI: Loaded 41730 existing records from primary storage. [2025-09-30T22:06:54.480270] [INFO ] [MAIN ] CMI: Loaded 41730 primary data records. [2025-09-30T22:06:54.815527] [DEBUG] [LOCAL ] CMP: Loaded 36282 existing records from primary storage. [2025-09-30T22:06:54.816866] [INFO ] [MAIN ] CMP: Loaded 36282 primary data records. [2025-09-30T22:06:54.851887] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:54.870708] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-09-30T22:06:54.882388] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-30T22:06:55.198957] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-30T22:06:55.199110] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-30T22:06:55.201229] [INFO ] [MAIN ] Derivative Progress: 384/2009 symbols completed. CMG took 1.4s. Estimated remaining: 11m 12s. Rate: 145.2 symbols/min [2025-09-30T22:06:55.201752] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:55.223961] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:55.224857] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41730 primary records. [2025-09-30T22:06:55.224992] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-30T22:06:55.244983] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-09-30T22:06:55.245262] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-30T22:06:55.248074] [INFO ] [MAIN ] Derivative Progress: 385/2009 symbols completed. CMI took 1.1s. Estimated remaining: 11m 10s. Rate: 145.5 symbols/min [2025-09-30T22:06:55.248446] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:55.271114] [DEBUG] [LOCAL ] CMSA: Loaded 3503 existing records from primary storage. [2025-09-30T22:06:55.271315] [INFO ] [MAIN ] CMSA: Loaded 3503 primary data records. [2025-09-30T22:06:55.329995] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:55.357528] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36282 primary records. [2025-09-30T22:06:55.364629] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-30T22:06:55.428555] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-09-30T22:06:55.439631] [INFO ] [MAIN ] CMS: Loaded 52610 primary data records. [2025-09-30T22:06:55.772288] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-09-30T22:06:55.790481] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-30T22:06:55.805926] [INFO ] [MAIN ] Derivative Progress: 386/2009 symbols completed. CMP took 1.3s. Estimated remaining: 11m 10s. Rate: 145.4 symbols/min [2025-09-30T22:06:55.823369] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:56.040405] [DEBUG] [LOCAL ] CMSC: Loaded 5049 existing records from primary storage. [2025-09-30T22:06:56.040942] [INFO ] [MAIN ] CMSC: Loaded 5049 primary data records. [2025-09-30T22:06:56.227507] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:06:56.239889] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3503 primary records. [2025-09-30T22:06:56.261611] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-30T22:06:56.376612] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-30T22:06:56.386530] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-30T22:06:56.526856] [INFO ] [MAIN ] Derivative Progress: 387/2009 symbols completed. CMSA took 1.3s. Estimated remaining: 11m 11s. Rate: 145.1 symbols/min [2025-09-30T22:06:56.528419] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:56.573092] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:56.575011] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52610 primary records. [2025-09-30T22:06:56.582578] [DEBUG] [LOCAL ] CMSD: Loaded 8092 existing records from primary storage. [2025-09-30T22:06:56.577223] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-30T22:06:56.582818] [INFO ] [MAIN ] CMSD: Loaded 8092 primary data records. [2025-09-30T22:06:56.743204] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-30T22:06:56.753785] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-30T22:06:56.773484] [INFO ] [MAIN ] Derivative Progress: 388/2009 symbols completed. CMS took 1.6s. Estimated remaining: 11m 10s. Rate: 145.2 symbols/min [2025-09-30T22:06:56.928578] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:57.061680] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5049 primary records. [2025-09-30T22:06:57.062748] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-30T22:06:57.086053] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-30T22:06:57.086200] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-30T22:06:57.088903] [INFO ] [MAIN ] Derivative Progress: 389/2009 symbols completed. CMSC took 1.3s. Estimated remaining: 11m 9s. Rate: 145.3 symbols/min [2025-09-30T22:06:57.108755] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:57.109365] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8092 primary records. [2025-09-30T22:06:57.109429] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-30T22:06:57.124797] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-09-30T22:06:57.124869] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-30T22:06:57.127379] [INFO ] [MAIN ] Derivative Progress: 390/2009 symbols completed. CMSD took 0.6s. Estimated remaining: 11m 7s. Rate: 145.7 symbols/min [2025-09-30T22:06:57.127833] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:57.127990] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:57.128113] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:57.141597] [DEBUG] [LOCAL ] CMU: Loaded 6938 existing records from primary storage. [2025-09-30T22:06:57.141846] [INFO ] [MAIN ] CMU: Loaded 6938 primary data records. [2025-09-30T22:06:57.489268] [DEBUG] [LOCAL ] CMTG: Loaded 36969 existing records from primary storage. [2025-09-30T22:06:57.505159] [INFO ] [MAIN ] CMTG: Loaded 36969 primary data records. [2025-09-30T22:06:57.571077] [DEBUG] [LOCAL ] CNC: Loaded 53740 existing records from primary storage. [2025-09-30T22:06:57.582236] [INFO ] [MAIN ] CNC: Loaded 53740 primary data records. [2025-09-30T22:06:58.308941] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:58.311814] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6938 primary records. [2025-09-30T22:06:58.312229] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-30T22:06:58.329962] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-30T22:06:58.331443] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-30T22:06:58.334390] [INFO ] [MAIN ] Derivative Progress: 391/2009 symbols completed. CMU took 1.2s. Estimated remaining: 11m 10s. Rate: 144.9 symbols/min [2025-09-30T22:06:58.334874] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:58.357740] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:58.358876] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53740 primary records. [2025-09-30T22:06:58.359012] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-30T22:06:58.365683] [DEBUG] [LOCAL ] CNF: Loaded 10899 existing records from primary storage. [2025-09-30T22:06:58.377535] [INFO ] [MAIN ] CNF: Loaded 10899 primary data records. [2025-09-30T22:06:58.494098] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:58.502420] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 36969 primary records. [2025-09-30T22:06:58.516212] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-30T22:06:58.517688] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-30T22:06:58.524472] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-30T22:06:58.556450] [INFO ] [MAIN ] Derivative Progress: 392/2009 symbols completed. CNC took 1.4s. Estimated remaining: 11m 9s. Rate: 145.1 symbols/min [2025-09-30T22:06:58.564597] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:58.639954] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-30T22:06:58.673254] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-30T22:06:58.785182] [INFO ] [MAIN ] Derivative Progress: 393/2009 symbols completed. CMTG took 1.7s. Estimated remaining: 11m 7s. Rate: 145.3 symbols/min [2025-09-30T22:06:58.785620] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:58.818392] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:58.819214] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 10899 primary records. [2025-09-30T22:06:58.819367] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-30T22:06:58.870388] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-09-30T22:06:58.871465] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-30T22:06:58.888194] [INFO ] [MAIN ] Derivative Progress: 394/2009 symbols completed. CNF took 0.6s. Estimated remaining: 11m 6s. Rate: 145.6 symbols/min [2025-09-30T22:06:58.906696] [DEBUG] [LOCAL ] CNH: Loaded 53555 existing records from primary storage. [2025-09-30T22:06:58.904876] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:06:58.907018] [INFO ] [MAIN ] CNH: Loaded 53555 primary data records. [2025-09-30T22:06:58.913311] [DEBUG] [LOCAL ] CNI: Loaded 51650 existing records from primary storage. [2025-09-30T22:06:58.952553] [INFO ] [MAIN ] CNI: Loaded 51650 primary data records. [2025-09-30T22:06:59.609274] [DEBUG] [LOCAL ] CNK: Loaded 52880 existing records from primary storage. [2025-09-30T22:06:59.610195] [INFO ] [MAIN ] CNK: Loaded 52880 primary data records. [2025-09-30T22:06:59.958772] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:59.968981] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53555 primary records. [2025-09-30T22:06:59.969225] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-30T22:06:59.991953] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:06:59.999924] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51650 primary records. [2025-09-30T22:07:00.001513] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-30T22:07:00.002385] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-30T22:07:00.002467] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-30T22:07:00.005846] [INFO ] [MAIN ] Derivative Progress: 395/2009 symbols completed. CNH took 1.4s. Estimated remaining: 11m 8s. Rate: 144.9 symbols/min [2025-09-30T22:07:00.014555] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:00.027041] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-30T22:07:00.027440] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-30T22:07:00.034665] [INFO ] [MAIN ] Derivative Progress: 396/2009 symbols completed. CNI took 1.2s. Estimated remaining: 11m 6s. Rate: 145.3 symbols/min [2025-09-30T22:07:00.035096] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:00.052428] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:00.053169] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52880 primary records. [2025-09-30T22:07:00.053336] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-30T22:07:00.071601] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-30T22:07:00.086012] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-30T22:07:00.089236] [INFO ] [MAIN ] Derivative Progress: 397/2009 symbols completed. CNK took 1.2s. Estimated remaining: 11m 4s. Rate: 145.6 symbols/min [2025-09-30T22:07:00.089579] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:00.126661] [DEBUG] [LOCAL ] CNM: Loaded 50981 existing records from primary storage. [2025-09-30T22:07:00.128107] [INFO ] [MAIN ] CNM: Loaded 50981 primary data records. [2025-09-30T22:07:00.133908] [DEBUG] [LOCAL ] CNMD: Loaded 32253 existing records from primary storage. [2025-09-30T22:07:00.146569] [INFO ] [MAIN ] CNMD: Loaded 32253 primary data records. [2025-09-30T22:07:00.712303] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-30T22:07:00.852704] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-30T22:07:01.222765] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:01.225182] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32253 primary records. [2025-09-30T22:07:01.225546] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-30T22:07:01.254446] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:01.256427] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50981 primary records. [2025-09-30T22:07:01.257848] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-30T22:07:01.261919] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-30T22:07:01.269873] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-30T22:07:01.273326] [INFO ] [MAIN ] Derivative Progress: 398/2009 symbols completed. CNMD took 1.2s. Estimated remaining: 11m 7s. Rate: 144.9 symbols/min [2025-09-30T22:07:01.277819] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:01.282273] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-30T22:07:01.282623] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-30T22:07:01.285541] [INFO ] [MAIN ] Derivative Progress: 399/2009 symbols completed. CNM took 1.3s. Estimated remaining: 11m 5s. Rate: 145.3 symbols/min [2025-09-30T22:07:01.286042] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:01.304820] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:01.305757] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-30T22:07:01.305910] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-30T22:07:01.329555] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-30T22:07:01.329802] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-30T22:07:01.332458] [INFO ] [MAIN ] Derivative Progress: 400/2009 symbols completed. CNP took 1.2s. Estimated remaining: 11m 3s. Rate: 145.6 symbols/min [2025-09-30T22:07:01.332859] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:01.342147] [DEBUG] [LOCAL ] CNS: Loaded 20624 existing records from primary storage. [2025-09-30T22:07:01.342318] [INFO ] [MAIN ] CNS: Loaded 20624 primary data records. [2025-09-30T22:07:01.525182] [DEBUG] [LOCAL ] CNQ: Loaded 53581 existing records from primary storage. [2025-09-30T22:07:01.556324] [INFO ] [MAIN ] CNQ: Loaded 53581 primary data records. [2025-09-30T22:07:01.659845] [DEBUG] [LOCAL ] CODI: Loaded 39921 existing records from primary storage. [2025-09-30T22:07:01.681226] [INFO ] [MAIN ] CODI: Loaded 39921 primary data records. [2025-09-30T22:07:02.512133] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:02.514215] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20624 primary records. [2025-09-30T22:07:02.514397] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-30T22:07:02.551188] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:02.552416] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53581 primary records. [2025-09-30T22:07:02.552574] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-30T22:07:02.554713] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-09-30T22:07:02.554815] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-30T22:07:02.557225] [INFO ] [MAIN ] Derivative Progress: 401/2009 symbols completed. CNS took 1.3s. Estimated remaining: 11m 6s. Rate: 144.9 symbols/min [2025-09-30T22:07:02.557376] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:02.576392] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-30T22:07:02.578007] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-30T22:07:02.580617] [INFO ] [MAIN ] Derivative Progress: 402/2009 symbols completed. CNQ took 1.3s. Estimated remaining: 11m 4s. Rate: 145.2 symbols/min [2025-09-30T22:07:02.583092] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:02.606689] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:02.607701] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39921 primary records. [2025-09-30T22:07:02.607896] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-30T22:07:02.649045] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-30T22:07:02.649251] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-30T22:07:02.652970] [INFO ] [MAIN ] Derivative Progress: 403/2009 symbols completed. CODI took 1.3s. Estimated remaining: 11m 2s. Rate: 145.5 symbols/min [2025-09-30T22:07:02.690526] [DEBUG] [LOCAL ] COHR: Loaded 53362 existing records from primary storage. [2025-09-30T22:07:02.690722] [INFO ] [MAIN ] COHR: Loaded 53362 primary data records. [2025-09-30T22:07:02.826010] [DEBUG] [LOCAL ] COLD: Loaded 52066 existing records from primary storage. [2025-09-30T22:07:02.836881] [INFO ] [MAIN ] COLD: Loaded 52066 primary data records. [2025-09-30T22:07:03.387391] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:03.389938] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53362 primary records. [2025-09-30T22:07:03.390299] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-30T22:07:03.408481] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-30T22:07:03.408744] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-30T22:07:03.410844] [INFO ] [MAIN ] Derivative Progress: 404/2009 symbols completed. COHR took 0.9s. Estimated remaining: 11m 3s. Rate: 145.2 symbols/min [2025-09-30T22:07:03.427440] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:03.428276] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52066 primary records. [2025-09-30T22:07:03.428344] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-30T22:07:03.445423] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-30T22:07:03.445547] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-30T22:07:03.449360] [INFO ] [MAIN ] Derivative Progress: 405/2009 symbols completed. COLD took 0.9s. Estimated remaining: 11m 1s. Rate: 145.5 symbols/min [2025-09-30T22:07:03.450215] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:03.450376] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:03.450506] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:03.481357] [DEBUG] [LOCAL ] COOK: Loaded 24364 existing records from primary storage. [2025-09-30T22:07:03.481579] [INFO ] [MAIN ] COOK: Loaded 24364 primary data records. [2025-09-30T22:07:03.654039] [DEBUG] [LOCAL ] CON: Loaded 38743 existing records from primary storage. [2025-09-30T22:07:03.709319] [INFO ] [MAIN ] CON: Loaded 38743 primary data records. [2025-09-30T22:07:03.922401] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-30T22:07:03.939474] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-30T22:07:04.600305] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:04.602135] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24364 primary records. [2025-09-30T22:07:04.602739] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-30T22:07:04.627912] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-30T22:07:04.628404] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-30T22:07:04.630940] [INFO ] [MAIN ] Derivative Progress: 406/2009 symbols completed. COOK took 1.2s. Estimated remaining: 11m 4s. Rate: 144.9 symbols/min [2025-09-30T22:07:04.636767] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:04.652464] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:04.654811] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38743 primary records. [2025-09-30T22:07:04.655050] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-30T22:07:04.692074] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:04.694912] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-30T22:07:04.696559] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-30T22:07:04.699793] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-30T22:07:04.700220] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-30T22:07:04.708917] [INFO ] [MAIN ] Derivative Progress: 407/2009 symbols completed. CON took 1.3s. Estimated remaining: 11m 2s. Rate: 145.2 symbols/min [2025-09-30T22:07:04.721740] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:04.727071] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-30T22:07:04.737719] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-30T22:07:04.740095] [INFO ] [MAIN ] Derivative Progress: 408/2009 symbols completed. COP took 1.3s. Estimated remaining: 11m 0s. Rate: 145.5 symbols/min [2025-09-30T22:07:04.740349] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:04.764078] [DEBUG] [LOCAL ] COR: Loaded 47089 existing records from primary storage. [2025-09-30T22:07:04.764311] [INFO ] [MAIN ] COR: Loaded 47089 primary data records. [2025-09-30T22:07:05.187537] [DEBUG] [LOCAL ] COUR: Loaded 48912 existing records from primary storage. [2025-09-30T22:07:05.185870] [DEBUG] [LOCAL ] CP: Loaded 53267 existing records from primary storage. [2025-09-30T22:07:05.187863] [INFO ] [MAIN ] COUR: Loaded 48912 primary data records. [2025-09-30T22:07:05.188181] [INFO ] [MAIN ] CP: Loaded 53267 primary data records. [2025-09-30T22:07:05.896470] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:05.899038] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47089 primary records. [2025-09-30T22:07:05.899352] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-30T22:07:05.922746] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-30T22:07:05.923005] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-30T22:07:05.925749] [INFO ] [MAIN ] Derivative Progress: 409/2009 symbols completed. COR took 1.3s. Estimated remaining: 11m 3s. Rate: 144.8 symbols/min [2025-09-30T22:07:05.927022] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:05.945431] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:05.946396] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53267 primary records. [2025-09-30T22:07:05.946555] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-30T22:07:05.974823] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:05.975889] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48912 primary records. [2025-09-30T22:07:05.976988] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-30T22:07:05.977171] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-30T22:07:05.977090] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-30T22:07:05.979260] [INFO ] [MAIN ] Derivative Progress: 410/2009 symbols completed. CP took 1.2s. Estimated remaining: 11m 1s. Rate: 145.1 symbols/min [2025-09-30T22:07:05.980527] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:06.003944] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-30T22:07:06.004126] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-30T22:07:06.007535] [INFO ] [MAIN ] Derivative Progress: 411/2009 symbols completed. COUR took 1.3s. Estimated remaining: 10m 59s. Rate: 145.5 symbols/min [2025-09-30T22:07:06.007757] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:06.020764] [DEBUG] [LOCAL ] CPA: Loaded 28403 existing records from primary storage. [2025-09-30T22:07:06.020916] [INFO ] [MAIN ] CPA: Loaded 28403 primary data records. [2025-09-30T22:07:06.145730] [DEBUG] [LOCAL ] CPK: Loaded 13455 existing records from primary storage. [2025-09-30T22:07:06.146904] [INFO ] [MAIN ] CPK: Loaded 13455 primary data records. [2025-09-30T22:07:06.189560] [DEBUG] [LOCAL ] CPAY: Loaded 30567 existing records from primary storage. [2025-09-30T22:07:06.276778] [INFO ] [MAIN ] CPAY: Loaded 30567 primary data records. [2025-09-30T22:07:07.087061] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:07.088500] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28403 primary records. [2025-09-30T22:07:07.088719] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-30T22:07:07.110483] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-30T22:07:07.110974] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-30T22:07:07.112962] [INFO ] [MAIN ] Derivative Progress: 412/2009 symbols completed. CPA took 1.2s. Estimated remaining: 11m 1s. Rate: 144.9 symbols/min [2025-09-30T22:07:07.121119] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:07.127555] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:07.128570] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13455 primary records. [2025-09-30T22:07:07.128939] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-30T22:07:07.164175] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-30T22:07:07.164888] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-30T22:07:07.164795] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:07.168867] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30567 primary records. [2025-09-30T22:07:07.167789] [INFO ] [MAIN ] Derivative Progress: 413/2009 symbols completed. CPK took 1.2s. Estimated remaining: 10m 60s. Rate: 145.2 symbols/min [2025-09-30T22:07:07.169086] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:07.169245] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-30T22:07:07.187053] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-30T22:07:07.187291] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-30T22:07:07.189896] [INFO ] [MAIN ] Derivative Progress: 414/2009 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 58s. Rate: 145.5 symbols/min [2025-09-30T22:07:07.190141] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:07.225966] [DEBUG] [LOCAL ] CPS: Loaded 25989 existing records from primary storage. [2025-09-30T22:07:07.241120] [INFO ] [MAIN ] CPS: Loaded 25989 primary data records. [2025-09-30T22:07:07.283631] [DEBUG] [LOCAL ] CPRI: Loaded 52547 existing records from primary storage. [2025-09-30T22:07:07.289101] [INFO ] [MAIN ] CPRI: Loaded 52547 primary data records. [2025-09-30T22:07:07.560948] [DEBUG] [LOCAL ] CPT: Loaded 44325 existing records from primary storage. [2025-09-30T22:07:07.561696] [INFO ] [MAIN ] CPT: Loaded 44325 primary data records. [2025-09-30T22:07:08.374043] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:08.376015] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52547 primary records. [2025-09-30T22:07:08.376173] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-30T22:07:08.402601] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:08.407514] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25989 primary records. [2025-09-30T22:07:08.408137] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-30T22:07:08.408214] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-09-30T22:07:08.408934] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-30T22:07:08.411309] [INFO ] [MAIN ] Derivative Progress: 415/2009 symbols completed. CPRI took 1.3s. Estimated remaining: 11m 0s. Rate: 144.8 symbols/min [2025-09-30T22:07:08.412280] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:08.446131] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-30T22:07:08.446233] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:08.446519] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-30T22:07:08.450073] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44325 primary records. [2025-09-30T22:07:08.449253] [INFO ] [MAIN ] Derivative Progress: 416/2009 symbols completed. CPS took 1.3s. Estimated remaining: 10m 59s. Rate: 145.1 symbols/min [2025-09-30T22:07:08.450269] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-30T22:07:08.450869] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:08.480334] [DEBUG] [LOCAL ] CQP: Loaded 19633 existing records from primary storage. [2025-09-30T22:07:08.480858] [INFO ] [MAIN ] CQP: Loaded 19633 primary data records. [2025-09-30T22:07:08.486889] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-30T22:07:08.499151] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-30T22:07:08.518767] [INFO ] [MAIN ] Derivative Progress: 417/2009 symbols completed. CPT took 1.3s. Estimated remaining: 10m 57s. Rate: 145.4 symbols/min [2025-09-30T22:07:08.550239] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:08.613793] [DEBUG] [LOCAL ] CR: Loaded 24400 existing records from primary storage. [2025-09-30T22:07:08.632070] [INFO ] [MAIN ] CR: Loaded 24400 primary data records. [2025-09-30T22:07:08.748342] [DEBUG] [LOCAL ] CRBD: Loaded 8991 existing records from primary storage. [2025-09-30T22:07:08.788048] [INFO ] [MAIN ] CRBD: Loaded 8991 primary data records. [2025-09-30T22:07:09.555358] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:09.557174] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19633 primary records. [2025-09-30T22:07:09.559741] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-30T22:07:09.589912] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-30T22:07:09.588935] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:09.590106] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-30T22:07:09.590919] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24400 primary records. [2025-09-30T22:07:09.591287] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-30T22:07:09.593283] [INFO ] [MAIN ] Derivative Progress: 418/2009 symbols completed. CQP took 1.2s. Estimated remaining: 10m 59s. Rate: 144.9 symbols/min [2025-09-30T22:07:09.626009] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:09.627624] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-09-30T22:07:09.627209] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8991 primary records. [2025-09-30T22:07:09.627801] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-30T22:07:09.630344] [INFO ] [MAIN ] Derivative Progress: 419/2009 symbols completed. CR took 1.2s. Estimated remaining: 10m 57s. Rate: 145.2 symbols/min [2025-09-30T22:07:09.630421] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-30T22:07:09.645600] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-09-30T22:07:09.645704] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-30T22:07:09.648228] [INFO ] [MAIN ] Derivative Progress: 420/2009 symbols completed. CRBD took 1.1s. Estimated remaining: 10m 55s. Rate: 145.5 symbols/min [2025-09-30T22:07:09.648682] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:09.648966] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:09.649158] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:09.719471] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-09-30T22:07:09.719762] [INFO ] [MAIN ] CRC: Loaded 44118 primary data records. [2025-09-30T22:07:09.861037] [DEBUG] [LOCAL ] CRH: Loaded 53463 existing records from primary storage. [2025-09-30T22:07:09.861844] [DEBUG] [LOCAL ] CRBG: Loaded 52349 existing records from primary storage. [2025-09-30T22:07:09.862379] [INFO ] [MAIN ] CRH: Loaded 53463 primary data records. [2025-09-30T22:07:09.873130] [INFO ] [MAIN ] CRBG: Loaded 52349 primary data records. [2025-09-30T22:07:10.748144] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:10.749170] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44118 primary records. [2025-09-30T22:07:10.749504] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-30T22:07:10.770852] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-30T22:07:10.771414] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-30T22:07:10.773725] [INFO ] [MAIN ] Derivative Progress: 421/2009 symbols completed. CRC took 1.1s. Estimated remaining: 10m 57s. Rate: 144.9 symbols/min [2025-09-30T22:07:10.774020] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:10.795575] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:10.796761] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53463 primary records. [2025-09-30T22:07:10.796859] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-30T22:07:10.811480] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:10.820196] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52349 primary records. [2025-09-30T22:07:10.824063] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-30T22:07:10.829327] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-30T22:07:10.837308] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-30T22:07:10.839949] [INFO ] [MAIN ] Derivative Progress: 422/2009 symbols completed. CRH took 1.2s. Estimated remaining: 10m 56s. Rate: 145.2 symbols/min [2025-09-30T22:07:10.844381] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:10.862134] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-30T22:07:10.862284] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-30T22:07:10.865416] [INFO ] [MAIN ] Derivative Progress: 423/2009 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 54s. Rate: 145.5 symbols/min [2025-09-30T22:07:10.865693] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:10.885553] [DEBUG] [LOCAL ] CRI: Loaded 49913 existing records from primary storage. [2025-09-30T22:07:10.885905] [INFO ] [MAIN ] CRI: Loaded 49913 primary data records. [2025-09-30T22:07:11.141096] [DEBUG] [LOCAL ] CRK: Loaded 52148 existing records from primary storage. [2025-09-30T22:07:11.301913] [INFO ] [MAIN ] CRK: Loaded 52148 primary data records. [2025-09-30T22:07:11.302973] [DEBUG] [LOCAL ] CRL: Loaded 42984 existing records from primary storage. [2025-09-30T22:07:11.363799] [INFO ] [MAIN ] CRL: Loaded 42984 primary data records. [2025-09-30T22:07:12.015439] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:12.016719] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49913 primary records. [2025-09-30T22:07:12.016835] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-30T22:07:12.034873] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-30T22:07:12.035158] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-30T22:07:12.037563] [INFO ] [MAIN ] Derivative Progress: 424/2009 symbols completed. CRI took 1.3s. Estimated remaining: 10m 56s. Rate: 144.9 symbols/min [2025-09-30T22:07:12.039253] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:12.059727] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:12.062038] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52148 primary records. [2025-09-30T22:07:12.062930] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-30T22:07:12.084946] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:12.089875] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42984 primary records. [2025-09-30T22:07:12.090231] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-30T22:07:12.108368] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-30T22:07:12.109210] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-30T22:07:12.124678] [INFO ] [MAIN ] Derivative Progress: 425/2009 symbols completed. CRK took 1.3s. Estimated remaining: 10m 55s. Rate: 145.2 symbols/min [2025-09-30T22:07:12.125504] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:12.128858] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-30T22:07:12.129040] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-30T22:07:12.131762] [INFO ] [MAIN ] Derivative Progress: 426/2009 symbols completed. CRL took 1.3s. Estimated remaining: 10m 53s. Rate: 145.5 symbols/min [2025-09-30T22:07:12.132095] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:12.151514] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-30T22:07:12.154597] [DEBUG] [LOCAL ] CRT: Loaded 4979 existing records from primary storage. [2025-09-30T22:07:12.154705] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-30T22:07:12.154941] [INFO ] [MAIN ] CRT: Loaded 4979 primary data records. [2025-09-30T22:07:12.813178] [DEBUG] [LOCAL ] CRS: Loaded 43193 existing records from primary storage. [2025-09-30T22:07:12.813605] [INFO ] [MAIN ] CRS: Loaded 43193 primary data records. [2025-09-30T22:07:13.182967] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:13.184327] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4979 primary records. [2025-09-30T22:07:13.199045] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-30T22:07:13.199897] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:13.208499] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-30T22:07:13.208611] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-30T22:07:13.226697] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-30T22:07:13.229429] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-30T22:07:13.232122] [INFO ] [MAIN ] Derivative Progress: 427/2009 symbols completed. CRT took 1.1s. Estimated remaining: 10m 55s. Rate: 145.0 symbols/min [2025-09-30T22:07:13.232512] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:13.239418] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-30T22:07:13.239587] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-30T22:07:13.241515] [INFO ] [MAIN ] Derivative Progress: 428/2009 symbols completed. CRM took 1.2s. Estimated remaining: 10m 53s. Rate: 145.3 symbols/min [2025-09-30T22:07:13.241694] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:13.258808] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:13.259527] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43193 primary records. [2025-09-30T22:07:13.259637] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-30T22:07:13.286986] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-30T22:07:13.287178] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-30T22:07:13.289473] [INFO ] [MAIN ] Derivative Progress: 429/2009 symbols completed. CRS took 1.2s. Estimated remaining: 10m 51s. Rate: 145.6 symbols/min [2025-09-30T22:07:13.289793] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:13.312278] [DEBUG] [LOCAL ] CSAN: Loaded 42417 existing records from primary storage. [2025-09-30T22:07:13.312560] [INFO ] [MAIN ] CSAN: Loaded 42417 primary data records. [2025-09-30T22:07:13.429524] [DEBUG] [LOCAL ] CSR: Loaded 12774 existing records from primary storage. [2025-09-30T22:07:13.451692] [INFO ] [MAIN ] CSR: Loaded 12774 primary data records. [2025-09-30T22:07:13.451591] [DEBUG] [LOCAL ] CSL: Loaded 31515 existing records from primary storage. [2025-09-30T22:07:13.495037] [INFO ] [MAIN ] CSL: Loaded 31515 primary data records. [2025-09-30T22:07:14.410359] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:14.412506] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42417 primary records. [2025-09-30T22:07:14.413619] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-30T22:07:14.445288] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:14.446766] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12774 primary records. [2025-09-30T22:07:14.447032] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-30T22:07:14.458346] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-30T22:07:14.463867] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-30T22:07:14.478237] [INFO ] [MAIN ] Derivative Progress: 430/2009 symbols completed. CSAN took 1.2s. Estimated remaining: 10m 54s. Rate: 144.9 symbols/min [2025-09-30T22:07:14.472399] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:14.483295] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-30T22:07:14.480897] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:14.484587] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-30T22:07:14.487556] [INFO ] [MAIN ] Derivative Progress: 431/2009 symbols completed. CSR took 1.2s. Estimated remaining: 10m 52s. Rate: 145.3 symbols/min [2025-09-30T22:07:14.484500] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31515 primary records. [2025-09-30T22:07:14.488018] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-30T22:07:14.487922] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:14.506674] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-30T22:07:14.506805] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-30T22:07:14.509514] [INFO ] [MAIN ] Derivative Progress: 432/2009 symbols completed. CSL took 1.3s. Estimated remaining: 10m 50s. Rate: 145.6 symbols/min [2025-09-30T22:07:14.515337] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:14.520286] [DEBUG] [LOCAL ] CTBB: Loaded 7058 existing records from primary storage. [2025-09-30T22:07:14.520430] [INFO ] [MAIN ] CTBB: Loaded 7058 primary data records. [2025-09-30T22:07:14.568198] [DEBUG] [LOCAL ] CTDD: Loaded 5892 existing records from primary storage. [2025-09-30T22:07:14.581904] [DEBUG] [LOCAL ] CSV: Loaded 12824 existing records from primary storage. [2025-09-30T22:07:14.605310] [INFO ] [MAIN ] CTDD: Loaded 5892 primary data records. [2025-09-30T22:07:14.618257] [INFO ] [MAIN ] CSV: Loaded 12824 primary data records. [2025-09-30T22:07:15.588317] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:15.592491] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7058 primary records. [2025-09-30T22:07:15.593662] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-30T22:07:15.608560] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:15.616677] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5892 primary records. [2025-09-30T22:07:15.620662] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-30T22:07:15.638822] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:15.648058] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12824 primary records. [2025-09-30T22:07:15.650998] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-30T22:07:15.655629] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-09-30T22:07:15.651325] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-30T22:07:15.656143] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-30T22:07:15.658893] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-30T22:07:15.658787] [INFO ] [MAIN ] Derivative Progress: 433/2009 symbols completed. CTBB took 1.2s. Estimated remaining: 10m 52s. Rate: 145.0 symbols/min [2025-09-30T22:07:15.669779] [INFO ] [MAIN ] Derivative Progress: 434/2009 symbols completed. CTDD took 1.2s. Estimated remaining: 10m 50s. Rate: 145.3 symbols/min [2025-09-30T22:07:15.676886] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-30T22:07:15.676966] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-30T22:07:15.679636] [INFO ] [MAIN ] Derivative Progress: 435/2009 symbols completed. CSV took 1.2s. Estimated remaining: 10m 48s. Rate: 145.7 symbols/min [2025-09-30T22:07:15.680199] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:15.680106] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:15.680766] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:15.750165] [DEBUG] [LOCAL ] CTOS: Loaded 36496 existing records from primary storage. [2025-09-30T22:07:15.750835] [DEBUG] [LOCAL ] CTO: Loaded 27915 existing records from primary storage. [2025-09-30T22:07:15.751180] [INFO ] [MAIN ] CTOS: Loaded 36496 primary data records. [2025-09-30T22:07:15.751295] [INFO ] [MAIN ] CTO: Loaded 27915 primary data records. [2025-09-30T22:07:15.962978] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-09-30T22:07:15.983294] [INFO ] [MAIN ] CTRA: Loaded 53648 primary data records. [2025-09-30T22:07:16.800586] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:16.801891] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27915 primary records. [2025-09-30T22:07:16.802137] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-30T22:07:16.816309] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:16.846886] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:16.841702] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53648 primary records. [2025-09-30T22:07:16.847737] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36496 primary records. [2025-09-30T22:07:16.847053] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-30T22:07:16.847889] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-30T22:07:16.848088] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-30T22:07:16.848232] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-30T22:07:16.852471] [INFO ] [MAIN ] Derivative Progress: 436/2009 symbols completed. CTO took 1.2s. Estimated remaining: 10m 51s. Rate: 145.0 symbols/min [2025-09-30T22:07:16.859482] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:16.880190] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-30T22:07:16.880841] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-30T22:07:16.883308] [INFO ] [MAIN ] Derivative Progress: 437/2009 symbols completed. CTOS took 1.2s. Estimated remaining: 10m 49s. Rate: 145.3 symbols/min [2025-09-30T22:07:16.884075] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:16.890126] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-30T22:07:16.890236] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-30T22:07:16.893020] [INFO ] [MAIN ] Derivative Progress: 438/2009 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 47s. Rate: 145.7 symbols/min [2025-09-30T22:07:16.893342] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:16.933205] [DEBUG] [LOCAL ] CTS: Loaded 19345 existing records from primary storage. [2025-09-30T22:07:16.933465] [INFO ] [MAIN ] CTS: Loaded 19345 primary data records. [2025-09-30T22:07:17.019403] [DEBUG] [LOCAL ] CTRE: Loaded 49202 existing records from primary storage. [2025-09-30T22:07:17.069878] [INFO ] [MAIN ] CTRE: Loaded 49202 primary data records. [2025-09-30T22:07:17.070467] [DEBUG] [LOCAL ] CTRI: Loaded 38422 existing records from primary storage. [2025-09-30T22:07:17.124593] [INFO ] [MAIN ] CTRI: Loaded 38422 primary data records. [2025-09-30T22:07:18.052060] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:18.054177] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:18.053769] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19345 primary records. [2025-09-30T22:07:18.055897] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49202 primary records. [2025-09-30T22:07:18.054521] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-30T22:07:18.056605] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-30T22:07:18.103495] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-30T22:07:18.104629] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-30T22:07:18.103393] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:18.109105] [INFO ] [MAIN ] Derivative Progress: 439/2009 symbols completed. CTS took 1.2s. Estimated remaining: 10m 50s. Rate: 145.0 symbols/min [2025-09-30T22:07:18.110965] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:18.110494] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 38422 primary records. [2025-09-30T22:07:18.111451] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-30T22:07:18.111814] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-30T22:07:18.114743] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-30T22:07:18.114603] [INFO ] [MAIN ] Derivative Progress: 440/2009 symbols completed. CTRE took 1.3s. Estimated remaining: 10m 48s. Rate: 145.4 symbols/min [2025-09-30T22:07:18.115900] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:18.134253] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-30T22:07:18.134493] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-30T22:07:18.137844] [INFO ] [MAIN ] Derivative Progress: 441/2009 symbols completed. CTRI took 1.3s. Estimated remaining: 10m 46s. Rate: 145.7 symbols/min [2025-09-30T22:07:18.138145] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:18.191613] [DEBUG] [LOCAL ] CUBI: Loaded 27167 existing records from primary storage. [2025-09-30T22:07:18.191860] [INFO ] [MAIN ] CUBI: Loaded 27167 primary data records. [2025-09-30T22:07:18.320922] [DEBUG] [LOCAL ] CTVA: Loaded 53236 existing records from primary storage. [2025-09-30T22:07:18.351293] [INFO ] [MAIN ] CTVA: Loaded 53236 primary data records. [2025-09-30T22:07:18.400594] [DEBUG] [LOCAL ] CUBE: Loaded 50616 existing records from primary storage. [2025-09-30T22:07:18.466427] [INFO ] [MAIN ] CUBE: Loaded 50616 primary data records. [2025-09-30T22:07:19.229622] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:19.231377] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27167 primary records. [2025-09-30T22:07:19.231489] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-30T22:07:19.252315] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-30T22:07:19.265594] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-30T22:07:19.266153] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:19.268948] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53236 primary records. [2025-09-30T22:07:19.268101] [INFO ] [MAIN ] Derivative Progress: 442/2009 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 48s. Rate: 145.1 symbols/min [2025-09-30T22:07:19.269479] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:19.269097] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-30T22:07:19.289196] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-09-30T22:07:19.289325] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-30T22:07:19.291836] [DEBUG] [LOCAL ] CULP: Loaded 2957 existing records from primary storage. [2025-09-30T22:07:19.294265] [INFO ] [MAIN ] Derivative Progress: 443/2009 symbols completed. CTVA took 1.2s. Estimated remaining: 10m 46s. Rate: 145.4 symbols/min [2025-09-30T22:07:19.294933] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:19.291987] [INFO ] [MAIN ] CULP: Loaded 2957 primary data records. [2025-09-30T22:07:19.439507] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:19.470729] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50616 primary records. [2025-09-30T22:07:19.505350] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-30T22:07:19.542195] [DEBUG] [LOCAL ] CURB: Loaded 32587 existing records from primary storage. [2025-09-30T22:07:19.679350] [INFO ] [MAIN ] CURB: Loaded 32587 primary data records. [2025-09-30T22:07:19.759950] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-30T22:07:19.778507] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-30T22:07:19.794217] [INFO ] [MAIN ] Derivative Progress: 444/2009 symbols completed. CUBE took 1.7s. Estimated remaining: 10m 46s. Rate: 145.3 symbols/min [2025-09-30T22:07:19.802997] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:20.089407] [DEBUG] [LOCAL ] CURV: Loaded 26521 existing records from primary storage. [2025-09-30T22:07:20.090102] [INFO ] [MAIN ] CURV: Loaded 26521 primary data records. [2025-09-30T22:07:20.145445] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:20.160448] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 2957 primary records. [2025-09-30T22:07:20.197785] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-30T22:07:20.260107] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-09-30T22:07:20.265633] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-30T22:07:20.284203] [INFO ] [MAIN ] Derivative Progress: 445/2009 symbols completed. CULP took 1.0s. Estimated remaining: 10m 46s. Rate: 145.3 symbols/min [2025-09-30T22:07:20.294682] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:20.473530] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:20.475714] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32587 primary records. [2025-09-30T22:07:20.476469] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-30T22:07:20.495442] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-30T22:07:20.496516] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-30T22:07:20.499113] [INFO ] [MAIN ] Derivative Progress: 446/2009 symbols completed. CURB took 1.2s. Estimated remaining: 10m 45s. Rate: 145.4 symbols/min [2025-09-30T22:07:20.499842] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:20.548673] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:20.550306] [DEBUG] [LOCAL ] CUZ: Loaded 49350 existing records from primary storage. [2025-09-30T22:07:20.550714] [INFO ] [MAIN ] CUZ: Loaded 49350 primary data records. [2025-09-30T22:07:20.551812] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26521 primary records. [2025-09-30T22:07:20.574891] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-30T22:07:20.682710] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-09-30T22:07:20.683084] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-30T22:07:20.685120] [INFO ] [MAIN ] Derivative Progress: 447/2009 symbols completed. CURV took 0.9s. Estimated remaining: 10m 44s. Rate: 145.6 symbols/min [2025-09-30T22:07:20.690982] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:20.925475] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-09-30T22:07:20.925940] [INFO ] [MAIN ] CVE: Loaded 53556 primary data records. [2025-09-30T22:07:21.156022] [DEBUG] [LOCAL ] CVI: Loaded 46463 existing records from primary storage. [2025-09-30T22:07:21.156403] [INFO ] [MAIN ] CVI: Loaded 46463 primary data records. [2025-09-30T22:07:21.608836] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:21.619055] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49350 primary records. [2025-09-30T22:07:21.619517] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-30T22:07:21.643826] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-30T22:07:21.644971] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-30T22:07:21.647214] [INFO ] [MAIN ] Derivative Progress: 448/2009 symbols completed. CUZ took 1.4s. Estimated remaining: 10m 45s. Rate: 145.2 symbols/min [2025-09-30T22:07:21.661974] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:21.662874] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53556 primary records. [2025-09-30T22:07:21.663012] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-30T22:07:21.680973] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-30T22:07:21.681361] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-30T22:07:21.683838] [INFO ] [MAIN ] Derivative Progress: 449/2009 symbols completed. CVE took 1.2s. Estimated remaining: 10m 43s. Rate: 145.5 symbols/min [2025-09-30T22:07:21.699818] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:21.700398] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46463 primary records. [2025-09-30T22:07:21.700458] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-30T22:07:21.715782] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-30T22:07:21.715859] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-30T22:07:21.718377] [INFO ] [MAIN ] Derivative Progress: 450/2009 symbols completed. CVI took 1.0s. Estimated remaining: 10m 42s. Rate: 145.8 symbols/min [2025-09-30T22:07:21.718829] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:21.718956] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:21.719075] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:21.742146] [DEBUG] [LOCAL ] CVLG: Loaded 15513 existing records from primary storage. [2025-09-30T22:07:21.742468] [INFO ] [MAIN ] CVLG: Loaded 15513 primary data records. [2025-09-30T22:07:22.145482] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-09-30T22:07:22.109356] [DEBUG] [LOCAL ] CVNA: Loaded 52980 existing records from primary storage. [2025-09-30T22:07:22.160622] [INFO ] [MAIN ] CVNA: Loaded 52980 primary data records. [2025-09-30T22:07:22.161097] [INFO ] [MAIN ] CVS: Loaded 53696 primary data records. [2025-09-30T22:07:22.829990] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:22.830949] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15513 primary records. [2025-09-30T22:07:22.831160] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-30T22:07:22.855632] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-30T22:07:22.856049] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-30T22:07:22.866714] [INFO ] [MAIN ] Derivative Progress: 451/2009 symbols completed. CVLG took 1.1s. Estimated remaining: 10m 44s. Rate: 145.2 symbols/min [2025-09-30T22:07:22.880592] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:22.886366] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:22.887918] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:22.887534] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53696 primary records. [2025-09-30T22:07:22.888925] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-30T22:07:22.888731] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52980 primary records. [2025-09-30T22:07:22.889338] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-30T22:07:22.920505] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-30T22:07:22.923491] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-30T22:07:22.925782] [INFO ] [MAIN ] Derivative Progress: 452/2009 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 42s. Rate: 145.5 symbols/min [2025-09-30T22:07:22.923369] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-30T22:07:22.926068] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:22.926279] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-30T22:07:22.933066] [INFO ] [MAIN ] Derivative Progress: 453/2009 symbols completed. CVS took 1.2s. Estimated remaining: 10m 40s. Rate: 145.8 symbols/min [2025-09-30T22:07:22.933561] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:22.957843] [DEBUG] [LOCAL ] CW: Loaded 22254 existing records from primary storage. [2025-09-30T22:07:22.970699] [INFO ] [MAIN ] CW: Loaded 22254 primary data records. [2025-09-30T22:07:23.136317] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-30T22:07:23.162706] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-30T22:07:23.411925] [DEBUG] [LOCAL ] CWAN: Loaded 52400 existing records from primary storage. [2025-09-30T22:07:23.430112] [INFO ] [MAIN ] CWAN: Loaded 52400 primary data records. [2025-09-30T22:07:24.100543] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:24.101838] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22254 primary records. [2025-09-30T22:07:24.102025] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-30T22:07:24.123311] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-09-30T22:07:24.123544] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-30T22:07:24.126118] [INFO ] [MAIN ] Derivative Progress: 454/2009 symbols completed. CW took 1.2s. Estimated remaining: 10m 43s. Rate: 145.2 symbols/min [2025-09-30T22:07:24.139451] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:24.140798] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:24.142905] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-30T22:07:24.143365] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-30T22:07:24.176861] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-30T22:07:24.177269] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:24.177363] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-30T22:07:24.181110] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52400 primary records. [2025-09-30T22:07:24.180239] [INFO ] [MAIN ] Derivative Progress: 455/2009 symbols completed. CVX took 1.3s. Estimated remaining: 10m 41s. Rate: 145.4 symbols/min [2025-09-30T22:07:24.181328] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-30T22:07:24.181525] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:24.209767] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-30T22:07:24.209845] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-30T22:07:24.212347] [INFO ] [MAIN ] Derivative Progress: 456/2009 symbols completed. CWAN took 1.3s. Estimated remaining: 10m 39s. Rate: 145.7 symbols/min [2025-09-30T22:07:24.212557] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:24.229516] [DEBUG] [LOCAL ] CWEN: Loaded 44975 existing records from primary storage. [2025-09-30T22:07:24.229754] [INFO ] [MAIN ] CWEN: Loaded 44975 primary data records. [2025-09-30T22:07:24.600562] [DEBUG] [LOCAL ] CWH: Loaded 51357 existing records from primary storage. [2025-09-30T22:07:24.600816] [INFO ] [MAIN ] CWH: Loaded 51357 primary data records. [2025-09-30T22:07:24.653601] [DEBUG] [LOCAL ] CWK: Loaded 49415 existing records from primary storage. [2025-09-30T22:07:24.659566] [INFO ] [MAIN ] CWK: Loaded 49415 primary data records. [2025-09-30T22:07:25.306998] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:25.307889] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 44975 primary records. [2025-09-30T22:07:25.308566] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-30T22:07:25.330200] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-30T22:07:25.331145] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-30T22:07:25.333500] [INFO ] [MAIN ] Derivative Progress: 457/2009 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 41s. Rate: 145.2 symbols/min [2025-09-30T22:07:25.334161] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:25.354860] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:25.356919] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51357 primary records. [2025-09-30T22:07:25.357179] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-30T22:07:25.379453] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:25.384628] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49415 primary records. [2025-09-30T22:07:25.384759] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-30T22:07:25.407705] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-30T22:07:25.414229] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-30T22:07:25.416749] [INFO ] [MAIN ] Derivative Progress: 458/2009 symbols completed. CWH took 1.2s. Estimated remaining: 10m 40s. Rate: 145.4 symbols/min [2025-09-30T22:07:25.417544] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-30T22:07:25.418079] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-30T22:07:25.417936] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:25.421068] [INFO ] [MAIN ] Derivative Progress: 459/2009 symbols completed. CWK took 1.2s. Estimated remaining: 10m 38s. Rate: 145.8 symbols/min [2025-09-30T22:07:25.421596] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:25.433375] [DEBUG] [LOCAL ] CWT: Loaded 27865 existing records from primary storage. [2025-09-30T22:07:25.435705] [INFO ] [MAIN ] CWT: Loaded 27865 primary data records. [2025-09-30T22:07:25.492622] [DEBUG] [LOCAL ] CXE: Loaded 6726 existing records from primary storage. [2025-09-30T22:07:25.521928] [INFO ] [MAIN ] CXE: Loaded 6726 primary data records. [2025-09-30T22:07:25.970951] [DEBUG] [LOCAL ] CX: Loaded 52828 existing records from primary storage. [2025-09-30T22:07:26.195882] [INFO ] [MAIN ] CX: Loaded 52828 primary data records. [2025-09-30T22:07:26.605153] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:26.607055] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27865 primary records. [2025-09-30T22:07:26.607374] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-30T22:07:26.629113] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-30T22:07:26.629779] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-30T22:07:26.650380] [INFO ] [MAIN ] Derivative Progress: 460/2009 symbols completed. CWT took 1.3s. Estimated remaining: 10m 40s. Rate: 145.1 symbols/min [2025-09-30T22:07:26.650678] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:26.651026] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:26.652108] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6726 primary records. [2025-09-30T22:07:26.652769] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-30T22:07:26.671165] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-30T22:07:26.671521] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-30T22:07:26.676791] [INFO ] [MAIN ] Derivative Progress: 461/2009 symbols completed. CXE took 1.3s. Estimated remaining: 10m 39s. Rate: 145.4 symbols/min [2025-09-30T22:07:26.677167] [DEBUG] [LOCAL ] CXH: Loaded 4412 existing records from primary storage. [2025-09-30T22:07:26.677396] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:26.678591] [INFO ] [MAIN ] CXH: Loaded 4412 primary data records. [2025-09-30T22:07:26.811128] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:26.827679] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52828 primary records. [2025-09-30T22:07:26.827873] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-30T22:07:27.050094] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-09-30T22:07:27.050282] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-30T22:07:27.053431] [INFO ] [MAIN ] Derivative Progress: 462/2009 symbols completed. CX took 1.6s. Estimated remaining: 10m 38s. Rate: 145.5 symbols/min [2025-09-30T22:07:27.054385] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:27.071797] [DEBUG] [LOCAL ] CXM: Loaded 47695 existing records from primary storage. [2025-09-30T22:07:27.072457] [INFO ] [MAIN ] CXM: Loaded 47695 primary data records. [2025-09-30T22:07:27.418816] [DEBUG] [LOCAL ] CXT: Loaded 30998 existing records from primary storage. [2025-09-30T22:07:27.434955] [INFO ] [MAIN ] CXT: Loaded 30998 primary data records. [2025-09-30T22:07:27.580334] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:07:27.592321] [INFO ] [MAIN ] CXH: Generated 1793 derivative records from 4412 primary records. [2025-09-30T22:07:27.608491] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-30T22:07:27.808147] [DEBUG] [LOCAL ] CXH: Derivative data saved (1793 records). [2025-09-30T22:07:27.809565] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-30T22:07:27.813308] [INFO ] [MAIN ] Derivative Progress: 463/2009 symbols completed. CXH took 1.2s. Estimated remaining: 10m 39s. Rate: 145.2 symbols/min [2025-09-30T22:07:27.835037] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:27.836228] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47695 primary records. [2025-09-30T22:07:27.836329] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-30T22:07:27.854735] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-30T22:07:27.854962] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-30T22:07:27.857677] [INFO ] [MAIN ] Derivative Progress: 464/2009 symbols completed. CXM took 1.2s. Estimated remaining: 10m 37s. Rate: 145.5 symbols/min [2025-09-30T22:07:27.874734] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:27.875418] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30998 primary records. [2025-09-30T22:07:27.875486] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-30T22:07:27.891193] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-30T22:07:27.891257] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-30T22:07:27.894035] [INFO ] [MAIN ] Derivative Progress: 465/2009 symbols completed. CXT took 0.8s. Estimated remaining: 10m 36s. Rate: 145.8 symbols/min [2025-09-30T22:07:27.894561] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:27.894803] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:27.894710] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:27.933789] [DEBUG] [LOCAL ] CYD: Loaded 26499 existing records from primary storage. [2025-09-30T22:07:27.933956] [INFO ] [MAIN ] CYD: Loaded 26499 primary data records. [2025-09-30T22:07:28.149987] [DEBUG] [LOCAL ] CXW: Loaded 44024 existing records from primary storage. [2025-09-30T22:07:28.153228] [INFO ] [MAIN ] CXW: Loaded 44024 primary data records. [2025-09-30T22:07:28.204257] [DEBUG] [LOCAL ] CYH: Loaded 47503 existing records from primary storage. [2025-09-30T22:07:28.382107] [INFO ] [MAIN ] CYH: Loaded 47503 primary data records. [2025-09-30T22:07:29.060986] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:29.062689] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26499 primary records. [2025-09-30T22:07:29.062996] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-30T22:07:29.084756] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-30T22:07:29.085012] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-30T22:07:29.087754] [INFO ] [MAIN ] Derivative Progress: 466/2009 symbols completed. CYD took 1.2s. Estimated remaining: 10m 38s. Rate: 145.2 symbols/min [2025-09-30T22:07:29.106023] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:29.107801] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:29.109786] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44024 primary records. [2025-09-30T22:07:29.110034] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-30T22:07:29.129224] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-30T22:07:29.129332] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-30T22:07:29.132274] [INFO ] [MAIN ] Derivative Progress: 467/2009 symbols completed. CXW took 1.2s. Estimated remaining: 10m 36s. Rate: 145.4 symbols/min [2025-09-30T22:07:29.132633] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:29.153687] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:29.154593] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47503 primary records. [2025-09-30T22:07:29.154795] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-30T22:07:29.175267] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-30T22:07:29.175457] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-30T22:07:29.178855] [INFO ] [MAIN ] Derivative Progress: 468/2009 symbols completed. CYH took 1.3s. Estimated remaining: 10m 34s. Rate: 145.7 symbols/min [2025-09-30T22:07:29.179193] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:29.186729] [DEBUG] [LOCAL ] DAC: Loaded 12536 existing records from primary storage. [2025-09-30T22:07:29.186882] [INFO ] [MAIN ] DAC: Loaded 12536 primary data records. [2025-09-30T22:07:29.397466] [DEBUG] [LOCAL ] D: Loaded 53645 existing records from primary storage. [2025-09-30T22:07:29.439323] [INFO ] [MAIN ] D: Loaded 53645 primary data records. [2025-09-30T22:07:29.680763] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-30T22:07:29.698615] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-30T22:07:30.263479] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:30.265498] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12536 primary records. [2025-09-30T22:07:30.265599] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-30T22:07:30.286020] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-09-30T22:07:30.286589] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-30T22:07:30.289403] [INFO ] [MAIN ] Derivative Progress: 469/2009 symbols completed. DAC took 1.2s. Estimated remaining: 10m 36s. Rate: 145.2 symbols/min [2025-09-30T22:07:30.289850] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:30.311498] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:30.312849] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53645 primary records. [2025-09-30T22:07:30.313202] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-30T22:07:30.334810] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-30T22:07:30.336059] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-30T22:07:30.339018] [INFO ] [MAIN ] Derivative Progress: 470/2009 symbols completed. D took 1.2s. Estimated remaining: 10m 35s. Rate: 145.5 symbols/min [2025-09-30T22:07:30.339352] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:30.353394] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:30.354259] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-30T22:07:30.354403] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-30T22:07:30.383166] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-30T22:07:30.383269] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-30T22:07:30.386125] [INFO ] [MAIN ] Derivative Progress: 471/2009 symbols completed. DAL took 1.2s. Estimated remaining: 10m 33s. Rate: 145.7 symbols/min [2025-09-30T22:07:30.386446] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:30.404947] [DEBUG] [LOCAL ] DAN: Loaded 48978 existing records from primary storage. [2025-09-30T22:07:30.405410] [INFO ] [MAIN ] DAN: Loaded 48978 primary data records. [2025-09-30T22:07:30.609204] [DEBUG] [LOCAL ] DAR: Loaded 51847 existing records from primary storage. [2025-09-30T22:07:30.741907] [INFO ] [MAIN ] DAR: Loaded 51847 primary data records. [2025-09-30T22:07:30.844380] [DEBUG] [LOCAL ] DAVA: Loaded 40904 existing records from primary storage. [2025-09-30T22:07:30.861628] [INFO ] [MAIN ] DAVA: Loaded 40904 primary data records. [2025-09-30T22:07:31.506600] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:31.508812] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 48978 primary records. [2025-09-30T22:07:31.510174] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-30T22:07:31.531401] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-30T22:07:31.531756] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-30T22:07:31.534614] [INFO ] [MAIN ] Derivative Progress: 472/2009 symbols completed. DAN took 1.2s. Estimated remaining: 10m 35s. Rate: 145.2 symbols/min [2025-09-30T22:07:31.535524] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:31.555479] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:31.556437] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51847 primary records. [2025-09-30T22:07:31.556542] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-30T22:07:31.593982] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-30T22:07:31.609491] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-30T22:07:31.610283] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:31.614216] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40904 primary records. [2025-09-30T22:07:31.613042] [INFO ] [MAIN ] Derivative Progress: 473/2009 symbols completed. DAR took 1.3s. Estimated remaining: 10m 34s. Rate: 145.4 symbols/min [2025-09-30T22:07:31.614439] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-30T22:07:31.614695] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:31.648342] [DEBUG] [LOCAL ] DAY: Loaded 49614 existing records from primary storage. [2025-09-30T22:07:31.649266] [INFO ] [MAIN ] DAY: Loaded 49614 primary data records. [2025-09-30T22:07:31.699437] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-30T22:07:31.735251] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-30T22:07:31.754985] [INFO ] [MAIN ] Derivative Progress: 474/2009 symbols completed. DAVA took 1.4s. Estimated remaining: 10m 32s. Rate: 145.6 symbols/min [2025-09-30T22:07:31.766351] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:32.013592] [DEBUG] [LOCAL ] DB: Loaded 52581 existing records from primary storage. [2025-09-30T22:07:32.014688] [INFO ] [MAIN ] DB: Loaded 52581 primary data records. [2025-09-30T22:07:32.187016] [DEBUG] [LOCAL ] DBI: Loaded 44637 existing records from primary storage. [2025-09-30T22:07:32.229901] [INFO ] [MAIN ] DBI: Loaded 44637 primary data records. [2025-09-30T22:07:32.548220] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:32.586834] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49614 primary records. [2025-09-30T22:07:32.626454] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-30T22:07:32.837482] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-30T22:07:32.839015] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-30T22:07:32.843209] [INFO ] [MAIN ] Derivative Progress: 475/2009 symbols completed. DAY took 1.3s. Estimated remaining: 10m 34s. Rate: 145.1 symbols/min [2025-09-30T22:07:32.858205] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:32.859569] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:32.861379] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52581 primary records. [2025-09-30T22:07:32.861825] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-30T22:07:32.884562] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-09-30T22:07:32.885041] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-30T22:07:32.887869] [INFO ] [MAIN ] Derivative Progress: 476/2009 symbols completed. DB took 1.3s. Estimated remaining: 10m 33s. Rate: 145.4 symbols/min [2025-09-30T22:07:32.888311] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:32.893999] [DEBUG] [LOCAL ] DBL: Loaded 9317 existing records from primary storage. [2025-09-30T22:07:32.894483] [INFO ] [MAIN ] DBL: Loaded 9317 primary data records. [2025-09-30T22:07:33.045279] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:33.070569] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44637 primary records. [2025-09-30T22:07:33.076113] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-30T22:07:33.295381] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-30T22:07:33.311264] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-30T22:07:33.312185] [DEBUG] [LOCAL ] DBRG: Loaded 49722 existing records from primary storage. [2025-09-30T22:07:33.313105] [INFO ] [MAIN ] DBRG: Loaded 49722 primary data records. [2025-09-30T22:07:33.316286] [INFO ] [MAIN ] Derivative Progress: 477/2009 symbols completed. DBI took 1.5s. Estimated remaining: 10m 32s. Rate: 145.4 symbols/min [2025-09-30T22:07:33.316717] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:33.671265] [DEBUG] [LOCAL ] DCI: Loaded 37357 existing records from primary storage. [2025-09-30T22:07:33.671742] [INFO ] [MAIN ] DCI: Loaded 37357 primary data records. [2025-09-30T22:07:33.772508] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:33.783918] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9317 primary records. [2025-09-30T22:07:33.789956] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-30T22:07:33.910960] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-30T22:07:33.958928] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-30T22:07:34.030294] [INFO ] [MAIN ] Derivative Progress: 478/2009 symbols completed. DBL took 1.2s. Estimated remaining: 10m 33s. Rate: 145.2 symbols/min [2025-09-30T22:07:34.062078] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:34.063562] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49722 primary records. [2025-09-30T22:07:34.063672] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-30T22:07:34.082580] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-09-30T22:07:34.082833] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-30T22:07:34.085439] [INFO ] [MAIN ] Derivative Progress: 479/2009 symbols completed. DBRG took 1.2s. Estimated remaining: 10m 31s. Rate: 145.4 symbols/min [2025-09-30T22:07:34.102053] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:34.102741] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37357 primary records. [2025-09-30T22:07:34.102805] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-30T22:07:34.118231] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-09-30T22:07:34.118293] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-30T22:07:34.121280] [INFO ] [MAIN ] Derivative Progress: 480/2009 symbols completed. DCI took 0.8s. Estimated remaining: 10m 30s. Rate: 145.7 symbols/min [2025-09-30T22:07:34.121876] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:34.122007] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:34.121815] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:34.138221] [DEBUG] [LOCAL ] DCO: Loaded 13877 existing records from primary storage. [2025-09-30T22:07:34.138395] [INFO ] [MAIN ] DCO: Loaded 13877 primary data records. [2025-09-30T22:07:34.529388] [DEBUG] [LOCAL ] DDD: Loaded 50892 existing records from primary storage. [2025-09-30T22:07:34.530305] [DEBUG] [LOCAL ] DD: Loaded 52829 existing records from primary storage. [2025-09-30T22:07:34.531024] [INFO ] [MAIN ] DDD: Loaded 50892 primary data records. [2025-09-30T22:07:34.531153] [INFO ] [MAIN ] DD: Loaded 52829 primary data records. [2025-09-30T22:07:35.265939] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:35.266999] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13877 primary records. [2025-09-30T22:07:35.267192] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-30T22:07:35.292154] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-30T22:07:35.292560] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-30T22:07:35.296031] [INFO ] [MAIN ] Derivative Progress: 481/2009 symbols completed. DCO took 1.2s. Estimated remaining: 10m 32s. Rate: 145.2 symbols/min [2025-09-30T22:07:35.296463] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:35.316771] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:35.318730] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50892 primary records. [2025-09-30T22:07:35.320231] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-30T22:07:35.343241] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:35.345485] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52829 primary records. [2025-09-30T22:07:35.348464] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-30T22:07:35.381517] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-09-30T22:07:35.382106] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-30T22:07:35.382847] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-09-30T22:07:35.394445] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-30T22:07:35.397275] [INFO ] [MAIN ] Derivative Progress: 482/2009 symbols completed. DD took 1.3s. Estimated remaining: 10m 30s. Rate: 145.4 symbols/min [2025-09-30T22:07:35.400998] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:35.401143] [INFO ] [MAIN ] Derivative Progress: 483/2009 symbols completed. DDD took 1.3s. Estimated remaining: 10m 28s. Rate: 145.7 symbols/min [2025-09-30T22:07:35.403063] [DEBUG] [LOCAL ] DDL: Loaded 36643 existing records from primary storage. [2025-09-30T22:07:35.403281] [INFO ] [MAIN ] DDL: Loaded 36643 primary data records. [2025-09-30T22:07:35.403519] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:35.522257] [DEBUG] [LOCAL ] DDS: Loaded 13079 existing records from primary storage. [2025-09-30T22:07:35.527778] [DEBUG] [LOCAL ] DDT: Loaded 2083 existing records from primary storage. [2025-09-30T22:07:35.528106] [INFO ] [MAIN ] DDS: Loaded 13079 primary data records. [2025-09-30T22:07:35.533923] [INFO ] [MAIN ] DDT: Loaded 2083 primary data records. [2025-09-30T22:07:36.421581] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:36.422723] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36643 primary records. [2025-09-30T22:07:36.422925] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-30T22:07:36.442874] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-30T22:07:36.443953] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-30T22:07:36.446058] [INFO ] [MAIN ] Derivative Progress: 484/2009 symbols completed. DDL took 1.1s. Estimated remaining: 10m 30s. Rate: 145.2 symbols/min [2025-09-30T22:07:36.446337] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:36.461934] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:36.462897] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2083 primary records. [2025-09-30T22:07:36.463082] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-30T22:07:36.486827] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:36.487559] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13079 primary records. [2025-09-30T22:07:36.488041] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-30T22:07:36.510543] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-30T22:07:36.511513] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-30T22:07:36.514563] [INFO ] [MAIN ] Derivative Progress: 485/2009 symbols completed. DDS took 1.1s. Estimated remaining: 10m 29s. Rate: 145.5 symbols/min [2025-09-30T22:07:36.512024] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-09-30T22:07:36.514971] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-30T22:07:36.518146] [INFO ] [MAIN ] Derivative Progress: 486/2009 symbols completed. DDT took 1.1s. Estimated remaining: 10m 27s. Rate: 145.8 symbols/min [2025-09-30T22:07:36.514785] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:36.518777] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:36.553319] [DEBUG] [LOCAL ] DE: Loaded 47556 existing records from primary storage. [2025-09-30T22:07:36.553678] [INFO ] [MAIN ] DE: Loaded 47556 primary data records. [2025-09-30T22:07:36.729682] [DEBUG] [LOCAL ] DEA: Loaded 40928 existing records from primary storage. [2025-09-30T22:07:36.740460] [INFO ] [MAIN ] DEA: Loaded 40928 primary data records. [2025-09-30T22:07:37.023618] [DEBUG] [LOCAL ] DECK: Loaded 53295 existing records from primary storage. [2025-09-30T22:07:37.044886] [INFO ] [MAIN ] DECK: Loaded 53295 primary data records. [2025-09-30T22:07:37.697023] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:37.698487] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47556 primary records. [2025-09-30T22:07:37.698740] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-30T22:07:37.720731] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-30T22:07:37.721187] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-30T22:07:37.724104] [INFO ] [MAIN ] Derivative Progress: 487/2009 symbols completed. DE took 1.3s. Estimated remaining: 10m 29s. Rate: 145.2 symbols/min [2025-09-30T22:07:37.724740] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:37.759157] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:37.766809] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:37.766296] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53295 primary records. [2025-09-30T22:07:37.767794] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40928 primary records. [2025-09-30T22:07:37.768104] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-30T22:07:37.768291] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-30T22:07:37.812636] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-09-30T22:07:37.813742] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-30T22:07:37.816563] [INFO ] [MAIN ] Derivative Progress: 488/2009 symbols completed. DECK took 1.3s. Estimated remaining: 10m 28s. Rate: 145.4 symbols/min [2025-09-30T22:07:37.817558] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:37.819134] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-30T22:07:37.819560] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-30T22:07:37.822094] [INFO ] [MAIN ] Derivative Progress: 489/2009 symbols completed. DEA took 1.3s. Estimated remaining: 10m 26s. Rate: 145.7 symbols/min [2025-09-30T22:07:37.822492] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:37.838914] [DEBUG] [LOCAL ] DEI: Loaded 48388 existing records from primary storage. [2025-09-30T22:07:37.839139] [INFO ] [MAIN ] DEI: Loaded 48388 primary data records. [2025-09-30T22:07:38.056568] [DEBUG] [LOCAL ] DFH: Loaded 32312 existing records from primary storage. [2025-09-30T22:07:38.213863] [INFO ] [MAIN ] DFH: Loaded 32312 primary data records. [2025-09-30T22:07:38.344731] [DEBUG] [LOCAL ] DEO: Loaded 49007 existing records from primary storage. [2025-09-30T22:07:38.395205] [INFO ] [MAIN ] DEO: Loaded 49007 primary data records. [2025-09-30T22:07:38.926971] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:38.927808] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48388 primary records. [2025-09-30T22:07:38.928272] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-30T22:07:38.947980] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-30T22:07:38.949791] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-30T22:07:38.952674] [INFO ] [MAIN ] Derivative Progress: 490/2009 symbols completed. DEI took 1.2s. Estimated remaining: 10m 28s. Rate: 145.2 symbols/min [2025-09-30T22:07:38.953250] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:38.971330] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:38.972281] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32312 primary records. [2025-09-30T22:07:38.972605] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-30T22:07:39.009235] [DEBUG] [LOCAL ] DFIN: Loaded 23061 existing records from primary storage. [2025-09-30T22:07:39.009525] [INFO ] [MAIN ] DFIN: Loaded 23061 primary data records. [2025-09-30T22:07:39.054682] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-30T22:07:39.066795] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-30T22:07:39.074451] [INFO ] [MAIN ] Derivative Progress: 491/2009 symbols completed. DFH took 1.3s. Estimated remaining: 10m 26s. Rate: 145.4 symbols/min [2025-09-30T22:07:39.088926] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:39.088792] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:39.109260] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49007 primary records. [2025-09-30T22:07:39.133214] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-30T22:07:39.448424] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-30T22:07:39.448601] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-30T22:07:39.452746] [INFO ] [MAIN ] Derivative Progress: 492/2009 symbols completed. DEO took 1.6s. Estimated remaining: 10m 26s. Rate: 145.4 symbols/min [2025-09-30T22:07:39.453141] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:39.508152] [DEBUG] [LOCAL ] DHF: Loaded 20733 existing records from primary storage. [2025-09-30T22:07:39.509523] [INFO ] [MAIN ] DHF: Loaded 20733 primary data records. [2025-09-30T22:07:39.509398] [DEBUG] [LOCAL ] DG: Loaded 53284 existing records from primary storage. [2025-09-30T22:07:39.511398] [INFO ] [MAIN ] DG: Loaded 53284 primary data records. [2025-09-30T22:07:39.726954] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:39.758058] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23061 primary records. [2025-09-30T22:07:39.779481] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-30T22:07:40.203118] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-30T22:07:40.203736] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-30T22:07:40.206836] [INFO ] [MAIN ] Derivative Progress: 493/2009 symbols completed. DFIN took 1.3s. Estimated remaining: 10m 26s. Rate: 145.2 symbols/min [2025-09-30T22:07:40.236764] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:40.237863] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20733 primary records. [2025-09-30T22:07:40.238000] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-30T22:07:40.259134] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:40.263903] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53284 primary records. [2025-09-30T22:07:40.269174] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-30T22:07:40.269072] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-30T22:07:40.269335] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-30T22:07:40.272269] [INFO ] [MAIN ] Derivative Progress: 494/2009 symbols completed. DHF took 0.8s. Estimated remaining: 10m 25s. Rate: 145.4 symbols/min [2025-09-30T22:07:40.289198] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-30T22:07:40.289279] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-30T22:07:40.292265] [INFO ] [MAIN ] Derivative Progress: 495/2009 symbols completed. DG took 1.2s. Estimated remaining: 10m 23s. Rate: 145.7 symbols/min [2025-09-30T22:07:40.292840] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:40.292946] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:40.293441] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:40.308675] [DEBUG] [LOCAL ] DHX: Loaded 13063 existing records from primary storage. [2025-09-30T22:07:40.308875] [INFO ] [MAIN ] DHX: Loaded 13063 primary data records. [2025-09-30T22:07:40.693620] [DEBUG] [LOCAL ] DHI: Loaded 53349 existing records from primary storage. [2025-09-30T22:07:40.693771] [DEBUG] [LOCAL ] DHR: Loaded 53365 existing records from primary storage. [2025-09-30T22:07:40.694734] [INFO ] [MAIN ] DHR: Loaded 53365 primary data records. [2025-09-30T22:07:40.694663] [INFO ] [MAIN ] DHI: Loaded 53349 primary data records. [2025-09-30T22:07:41.374932] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:41.376224] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13063 primary records. [2025-09-30T22:07:41.376417] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-30T22:07:41.398218] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-09-30T22:07:41.398747] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-30T22:07:41.401503] [INFO ] [MAIN ] Derivative Progress: 496/2009 symbols completed. DHX took 1.1s. Estimated remaining: 10m 25s. Rate: 145.2 symbols/min [2025-09-30T22:07:41.402023] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:41.420473] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:41.424585] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53349 primary records. [2025-09-30T22:07:41.424960] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-30T22:07:41.453439] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:41.456252] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53365 primary records. [2025-09-30T22:07:41.456662] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-30T22:07:41.458542] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-30T22:07:41.459250] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-30T22:07:41.462003] [INFO ] [MAIN ] Derivative Progress: 497/2009 symbols completed. DHI took 1.2s. Estimated remaining: 10m 24s. Rate: 145.5 symbols/min [2025-09-30T22:07:41.462270] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:41.487786] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-09-30T22:07:41.487931] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-30T22:07:41.490718] [INFO ] [MAIN ] Derivative Progress: 498/2009 symbols completed. DHR took 1.2s. Estimated remaining: 10m 22s. Rate: 145.8 symbols/min [2025-09-30T22:07:41.490998] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:41.505282] [DEBUG] [LOCAL ] DIN: Loaded 37165 existing records from primary storage. [2025-09-30T22:07:41.505516] [INFO ] [MAIN ] DIN: Loaded 37165 primary data records. [2025-09-30T22:07:41.919216] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-30T22:07:41.920262] [DEBUG] [LOCAL ] DK: Loaded 49340 existing records from primary storage. [2025-09-30T22:07:41.920518] [INFO ] [MAIN ] DK: Loaded 49340 primary data records. [2025-09-30T22:07:41.920443] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-30T22:07:42.618819] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:42.621729] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37165 primary records. [2025-09-30T22:07:42.624255] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-30T22:07:42.645147] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-30T22:07:42.645735] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-30T22:07:42.650310] [INFO ] [MAIN ] Derivative Progress: 499/2009 symbols completed. DIN took 1.2s. Estimated remaining: 10m 24s. Rate: 145.2 symbols/min [2025-09-30T22:07:42.651796] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:42.667065] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:42.668227] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-30T22:07:42.668338] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-30T22:07:42.701133] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:42.705015] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49340 primary records. [2025-09-30T22:07:42.705313] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-30T22:07:42.705141] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-30T22:07:42.713953] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-30T22:07:42.721817] [INFO ] [MAIN ] Derivative Progress: 500/2009 symbols completed. DIS took 1.3s. Estimated remaining: 10m 22s. Rate: 145.5 symbols/min [2025-09-30T22:07:42.722035] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:42.727910] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-09-30T22:07:42.728182] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-30T22:07:42.731000] [INFO ] [MAIN ] Derivative Progress: 501/2009 symbols completed. DK took 1.2s. Estimated remaining: 10m 21s. Rate: 145.7 symbols/min [2025-09-30T22:07:42.731414] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:42.774672] [DEBUG] [LOCAL ] DKS: Loaded 49778 existing records from primary storage. [2025-09-30T22:07:42.775021] [INFO ] [MAIN ] DKS: Loaded 49778 primary data records. [2025-09-30T22:07:42.861896] [DEBUG] [LOCAL ] DLB: Loaded 31999 existing records from primary storage. [2025-09-30T22:07:42.879598] [INFO ] [MAIN ] DLB: Loaded 31999 primary data records. [2025-09-30T22:07:43.293428] [DEBUG] [LOCAL ] DLR: Loaded 50973 existing records from primary storage. [2025-09-30T22:07:43.318681] [INFO ] [MAIN ] DLR: Loaded 50973 primary data records. [2025-09-30T22:07:43.909916] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:43.925358] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49778 primary records. [2025-09-30T22:07:43.924434] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:43.926559] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 31999 primary records. [2025-09-30T22:07:43.926866] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-30T22:07:43.927386] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-30T22:07:43.956929] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-09-30T22:07:43.957702] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-30T22:07:43.961862] [INFO ] [MAIN ] Derivative Progress: 502/2009 symbols completed. DLB took 1.2s. Estimated remaining: 10m 23s. Rate: 145.2 symbols/min [2025-09-30T22:07:43.964032] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:43.964448] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-30T22:07:43.966498] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-30T22:07:43.970360] [INFO ] [MAIN ] Derivative Progress: 503/2009 symbols completed. DKS took 1.3s. Estimated remaining: 10m 21s. Rate: 145.5 symbols/min [2025-09-30T22:07:43.970854] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:43.985349] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:43.986327] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50973 primary records. [2025-09-30T22:07:43.986501] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-30T22:07:44.004239] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-30T22:07:44.004402] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-30T22:07:44.007333] [INFO ] [MAIN ] Derivative Progress: 504/2009 symbols completed. DLR took 1.3s. Estimated remaining: 10m 20s. Rate: 145.7 symbols/min [2025-09-30T22:07:44.007774] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:44.027891] [DEBUG] [LOCAL ] DMA: Loaded 4549 existing records from primary storage. [2025-09-30T22:07:44.034743] [INFO ] [MAIN ] DMA: Loaded 4549 primary data records. [2025-09-30T22:07:44.035247] [DEBUG] [LOCAL ] DLY: Loaded 19680 existing records from primary storage. [2025-09-30T22:07:44.082159] [DEBUG] [LOCAL ] DLX: Loaded 28553 existing records from primary storage. [2025-09-30T22:07:44.087610] [INFO ] [MAIN ] DLY: Loaded 19680 primary data records. [2025-09-30T22:07:44.101074] [INFO ] [MAIN ] DLX: Loaded 28553 primary data records. [2025-09-30T22:07:45.101520] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:07:45.102305] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4549 primary records. [2025-09-30T22:07:45.102485] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-30T22:07:45.133474] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-09-30T22:07:45.135760] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:45.135836] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-30T22:07:45.140148] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28553 primary records. [2025-09-30T22:07:45.138113] [INFO ] [MAIN ] Derivative Progress: 505/2009 symbols completed. DMA took 1.1s. Estimated remaining: 10m 21s. Rate: 145.2 symbols/min [2025-09-30T22:07:45.141029] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-30T22:07:45.141156] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:45.170691] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:45.172450] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-30T22:07:45.173400] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19680 primary records. [2025-09-30T22:07:45.175732] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-30T22:07:45.175611] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-30T22:07:45.178890] [INFO ] [MAIN ] Derivative Progress: 506/2009 symbols completed. DLX took 1.2s. Estimated remaining: 10m 20s. Rate: 145.5 symbols/min [2025-09-30T22:07:45.179891] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:45.199435] [DEBUG] [LOCAL ] DMO: Loaded 9860 existing records from primary storage. [2025-09-30T22:07:45.200345] [INFO ] [MAIN ] DMO: Loaded 9860 primary data records. [2025-09-30T22:07:45.224088] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-30T22:07:45.238614] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-30T22:07:45.243116] [INFO ] [MAIN ] Derivative Progress: 507/2009 symbols completed. DLY took 1.3s. Estimated remaining: 10m 18s. Rate: 145.7 symbols/min [2025-09-30T22:07:45.254039] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:45.521687] [DEBUG] [LOCAL ] DNA: Loaded 48267 existing records from primary storage. [2025-09-30T22:07:45.521910] [INFO ] [MAIN ] DNA: Loaded 48267 primary data records. [2025-09-30T22:07:45.811749] [DEBUG] [LOCAL ] DNOW: Loaded 43657 existing records from primary storage. [2025-09-30T22:07:45.812964] [INFO ] [MAIN ] DNOW: Loaded 43657 primary data records. [2025-09-30T22:07:46.417693] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:46.421543] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9860 primary records. [2025-09-30T22:07:46.422120] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-30T22:07:46.443092] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-09-30T22:07:46.443512] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-30T22:07:46.446858] [INFO ] [MAIN ] Derivative Progress: 508/2009 symbols completed. DMO took 1.3s. Estimated remaining: 10m 20s. Rate: 145.2 symbols/min [2025-09-30T22:07:46.467732] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:46.468626] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48267 primary records. [2025-09-30T22:07:46.468732] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-30T22:07:46.502039] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:46.504013] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43657 primary records. [2025-09-30T22:07:46.505824] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-30T22:07:46.505989] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-30T22:07:46.506703] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-30T22:07:46.509296] [INFO ] [MAIN ] Derivative Progress: 509/2009 symbols completed. DNA took 1.3s. Estimated remaining: 10m 19s. Rate: 145.4 symbols/min [2025-09-30T22:07:46.531360] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-30T22:07:46.531474] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-30T22:07:46.534421] [INFO ] [MAIN ] Derivative Progress: 510/2009 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 17s. Rate: 145.7 symbols/min [2025-09-30T22:07:46.535250] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:46.535431] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:46.535338] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:46.581081] [DEBUG] [LOCAL ] DNP: Loaded 33200 existing records from primary storage. [2025-09-30T22:07:46.581352] [INFO ] [MAIN ] DNP: Loaded 33200 primary data records. [2025-09-30T22:07:46.801511] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-09-30T22:07:46.849200] [INFO ] [MAIN ] DOC: Loaded 53542 primary data records. [2025-09-30T22:07:46.972097] [DEBUG] [LOCAL ] DOCN: Loaded 50539 existing records from primary storage. [2025-09-30T22:07:46.996670] [INFO ] [MAIN ] DOCN: Loaded 50539 primary data records. [2025-09-30T22:07:47.675344] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:47.676966] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33200 primary records. [2025-09-30T22:07:47.677195] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-30T22:07:47.696696] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-09-30T22:07:47.696837] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-30T22:07:47.699245] [INFO ] [MAIN ] Derivative Progress: 511/2009 symbols completed. DNP took 1.2s. Estimated remaining: 10m 19s. Rate: 145.2 symbols/min [2025-09-30T22:07:47.699934] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:47.721546] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:47.723468] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53542 primary records. [2025-09-30T22:07:47.723627] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-30T22:07:47.752523] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:47.753552] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50539 primary records. [2025-09-30T22:07:47.755824] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-30T22:07:47.769987] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-09-30T22:07:47.772223] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-30T22:07:47.775886] [INFO ] [MAIN ] Derivative Progress: 512/2009 symbols completed. DOC took 1.2s. Estimated remaining: 10m 18s. Rate: 145.4 symbols/min [2025-09-30T22:07:47.776717] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:47.788891] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-30T22:07:47.789104] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-30T22:07:47.792076] [INFO ] [MAIN ] Derivative Progress: 513/2009 symbols completed. DOCN took 1.3s. Estimated remaining: 10m 16s. Rate: 145.7 symbols/min [2025-09-30T22:07:47.792531] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:47.809769] [DEBUG] [LOCAL ] DOLE: Loaded 38292 existing records from primary storage. [2025-09-30T22:07:47.810093] [INFO ] [MAIN ] DOLE: Loaded 38292 primary data records. [2025-09-30T22:07:47.952449] [DEBUG] [LOCAL ] DOUG: Loaded 34546 existing records from primary storage. [2025-09-30T22:07:47.958552] [INFO ] [MAIN ] DOUG: Loaded 34546 primary data records. [2025-09-30T22:07:48.306478] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-30T22:07:48.313192] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-09-30T22:07:49.008138] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:49.010028] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38292 primary records. [2025-09-30T22:07:49.010329] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-30T22:07:49.039951] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-30T22:07:49.049945] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-30T22:07:49.060554] [INFO ] [MAIN ] Derivative Progress: 514/2009 symbols completed. DOLE took 1.4s. Estimated remaining: 10m 18s. Rate: 145.1 symbols/min [2025-09-30T22:07:49.057439] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:49.062306] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:49.062046] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34546 primary records. [2025-09-30T22:07:49.062740] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-30T22:07:49.084965] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-30T22:07:49.085137] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-30T22:07:49.087835] [INFO ] [MAIN ] Derivative Progress: 515/2009 symbols completed. DOUG took 1.3s. Estimated remaining: 10m 17s. Rate: 145.3 symbols/min [2025-09-30T22:07:49.088163] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:49.118920] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:49.120054] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-09-30T22:07:49.120186] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-30T22:07:49.162822] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-09-30T22:07:49.177464] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-30T22:07:49.187595] [INFO ] [MAIN ] Derivative Progress: 516/2009 symbols completed. DOW took 1.4s. Estimated remaining: 10m 15s. Rate: 145.6 symbols/min [2025-09-30T22:07:49.187911] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:49.233128] [DEBUG] [LOCAL ] DRD: Loaded 36875 existing records from primary storage. [2025-09-30T22:07:49.233365] [INFO ] [MAIN ] DRD: Loaded 36875 primary data records. [2025-09-30T22:07:49.236002] [DEBUG] [LOCAL ] DQ: Loaded 43336 existing records from primary storage. [2025-09-30T22:07:49.241451] [INFO ] [MAIN ] DQ: Loaded 43336 primary data records. [2025-09-30T22:07:49.655090] [DEBUG] [LOCAL ] DRH: Loaded 50465 existing records from primary storage. [2025-09-30T22:07:49.713205] [INFO ] [MAIN ] DRH: Loaded 50465 primary data records. [2025-09-30T22:07:50.447265] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:50.448598] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43336 primary records. [2025-09-30T22:07:50.449759] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-30T22:07:50.488407] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:50.490351] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36875 primary records. [2025-09-30T22:07:50.493893] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-30T22:07:50.516561] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-09-30T22:07:50.531934] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-30T22:07:50.534599] [INFO ] [MAIN ] Derivative Progress: 517/2009 symbols completed. DQ took 1.5s. Estimated remaining: 10m 18s. Rate: 144.9 symbols/min [2025-09-30T22:07:50.531814] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:50.537462] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50465 primary records. [2025-09-30T22:07:50.539081] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-30T22:07:50.539210] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-30T22:07:50.537868] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-30T22:07:50.539340] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:50.543284] [INFO ] [MAIN ] Derivative Progress: 518/2009 symbols completed. DRD took 1.5s. Estimated remaining: 10m 16s. Rate: 145.2 symbols/min [2025-09-30T22:07:50.543737] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:50.561219] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-30T22:07:50.561442] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-30T22:07:50.566555] [INFO ] [MAIN ] Derivative Progress: 519/2009 symbols completed. DRH took 1.4s. Estimated remaining: 10m 15s. Rate: 145.5 symbols/min [2025-09-30T22:07:50.566995] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:50.574949] [DEBUG] [LOCAL ] DRLL: Loaded 9497 existing records from primary storage. [2025-09-30T22:07:50.575256] [INFO ] [MAIN ] DRLL: Loaded 9497 primary data records. [2025-09-30T22:07:50.850790] [DEBUG] [LOCAL ] DRI: Loaded 47780 existing records from primary storage. [2025-09-30T22:07:50.930027] [INFO ] [MAIN ] DRI: Loaded 47780 primary data records. [2025-09-30T22:07:50.998555] [DEBUG] [LOCAL ] DSL: Loaded 28412 existing records from primary storage. [2025-09-30T22:07:51.020711] [INFO ] [MAIN ] DSL: Loaded 28412 primary data records. [2025-09-30T22:07:51.712720] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:07:51.714509] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 9497 primary records. [2025-09-30T22:07:51.715211] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-30T22:07:51.736574] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-09-30T22:07:51.737864] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-30T22:07:51.741931] [INFO ] [MAIN ] Derivative Progress: 520/2009 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 16s. Rate: 144.9 symbols/min [2025-09-30T22:07:51.743172] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:51.761340] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:51.762527] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47780 primary records. [2025-09-30T22:07:51.763238] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-30T22:07:51.767761] [DEBUG] [LOCAL ] DSMC: Loaded 1896 existing records from primary storage. [2025-09-30T22:07:51.768530] [INFO ] [MAIN ] DSMC: Loaded 1896 primary data records. [2025-09-30T22:07:51.907914] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-30T22:07:51.902109] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:51.909189] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28412 primary records. [2025-09-30T22:07:51.914463] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-30T22:07:51.924887] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-30T22:07:51.947899] [INFO ] [MAIN ] Derivative Progress: 521/2009 symbols completed. DRI took 1.4s. Estimated remaining: 10m 15s. Rate: 145.1 symbols/min [2025-09-30T22:07:51.963188] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:52.197196] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-30T22:07:52.197780] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-30T22:07:52.200627] [INFO ] [MAIN ] Derivative Progress: 522/2009 symbols completed. DSL took 1.6s. Estimated remaining: 10m 14s. Rate: 145.2 symbols/min [2025-09-30T22:07:52.207039] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:52.220489] [DEBUG] [LOCAL ] DSU: Loaded 22526 existing records from primary storage. [2025-09-30T22:07:52.220694] [INFO ] [MAIN ] DSU: Loaded 22526 primary data records. [2025-09-30T22:07:52.356403] [DEBUG] [LOCAL ] DSX: Loaded 24002 existing records from primary storage. [2025-09-30T22:07:52.356689] [INFO ] [MAIN ] DSX: Loaded 24002 primary data records. [2025-09-30T22:07:52.739840] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:07:52.767455] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1896 primary records. [2025-09-30T22:07:52.939898] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-30T22:07:52.999152] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-09-30T22:07:53.000962] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-30T22:07:53.004189] [INFO ] [MAIN ] Derivative Progress: 523/2009 symbols completed. DSMC took 1.3s. Estimated remaining: 10m 15s. Rate: 144.9 symbols/min [2025-09-30T22:07:53.029414] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:53.030518] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22526 primary records. [2025-09-30T22:07:53.030818] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-30T22:07:53.063894] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-30T22:07:53.064421] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-30T22:07:53.064229] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:53.067323] [INFO ] [MAIN ] Derivative Progress: 524/2009 symbols completed. DSU took 1.1s. Estimated remaining: 10m 14s. Rate: 145.2 symbols/min [2025-09-30T22:07:53.068283] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24002 primary records. [2025-09-30T22:07:53.068389] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-30T22:07:53.085082] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-30T22:07:53.085160] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-30T22:07:53.087889] [INFO ] [MAIN ] Derivative Progress: 525/2009 symbols completed. DSX took 0.9s. Estimated remaining: 10m 12s. Rate: 145.4 symbols/min [2025-09-30T22:07:53.088825] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:53.088971] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:53.088675] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:53.102938] [DEBUG] [LOCAL ] DUKB: Loaded 6380 existing records from primary storage. [2025-09-30T22:07:53.103188] [INFO ] [MAIN ] DUKB: Loaded 6380 primary data records. [2025-09-30T22:07:53.464719] [DEBUG] [LOCAL ] DT: Loaded 52925 existing records from primary storage. [2025-09-30T22:07:53.470158] [INFO ] [MAIN ] DT: Loaded 52925 primary data records. [2025-09-30T22:07:53.569268] [DEBUG] [LOCAL ] DTM: Loaded 44156 existing records from primary storage. [2025-09-30T22:07:53.583203] [INFO ] [MAIN ] DTM: Loaded 44156 primary data records. [2025-09-30T22:07:54.181437] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:54.182480] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6380 primary records. [2025-09-30T22:07:54.182719] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-30T22:07:54.206092] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-30T22:07:54.208335] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-30T22:07:54.211685] [INFO ] [MAIN ] Derivative Progress: 526/2009 symbols completed. DUKB took 1.1s. Estimated remaining: 10m 14s. Rate: 145.0 symbols/min [2025-09-30T22:07:54.212049] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:54.228802] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:54.229726] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52925 primary records. [2025-09-30T22:07:54.230005] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-30T22:07:54.253227] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:54.257846] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44156 primary records. [2025-09-30T22:07:54.258054] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-30T22:07:54.271852] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-30T22:07:54.274713] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-30T22:07:54.278017] [INFO ] [MAIN ] Derivative Progress: 527/2009 symbols completed. DT took 1.2s. Estimated remaining: 10m 12s. Rate: 145.2 symbols/min [2025-09-30T22:07:54.278680] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:54.294417] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-30T22:07:54.294546] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-30T22:07:54.298212] [INFO ] [MAIN ] Derivative Progress: 528/2009 symbols completed. DTM took 1.2s. Estimated remaining: 10m 11s. Rate: 145.4 symbols/min [2025-09-30T22:07:54.298439] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:54.316553] [DEBUG] [LOCAL ] DVA: Loaded 41035 existing records from primary storage. [2025-09-30T22:07:54.316858] [INFO ] [MAIN ] DVA: Loaded 41035 primary data records. [2025-09-30T22:07:54.685365] [DEBUG] [LOCAL ] DX: Loaded 52469 existing records from primary storage. [2025-09-30T22:07:54.685670] [INFO ] [MAIN ] DX: Loaded 52469 primary data records. [2025-09-30T22:07:54.814687] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-30T22:07:54.819068] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-30T22:07:55.459925] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:55.460771] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41035 primary records. [2025-09-30T22:07:55.461056] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-30T22:07:55.480319] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-30T22:07:55.483456] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-30T22:07:55.486449] [INFO ] [MAIN ] Derivative Progress: 529/2009 symbols completed. DVA took 1.3s. Estimated remaining: 10m 13s. Rate: 144.9 symbols/min [2025-09-30T22:07:55.486700] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:55.500445] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:55.502202] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52469 primary records. [2025-09-30T22:07:55.502434] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-30T22:07:55.521221] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-30T22:07:55.522331] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-30T22:07:55.526075] [INFO ] [MAIN ] Derivative Progress: 530/2009 symbols completed. DX took 1.2s. Estimated remaining: 10m 11s. Rate: 145.2 symbols/min [2025-09-30T22:07:55.527154] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:55.541608] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:55.542458] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-30T22:07:55.542595] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-30T22:07:55.570298] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-30T22:07:55.570445] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-30T22:07:55.573191] [INFO ] [MAIN ] Derivative Progress: 531/2009 symbols completed. DVN took 1.3s. Estimated remaining: 10m 10s. Rate: 145.4 symbols/min [2025-09-30T22:07:55.573562] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:55.599465] [DEBUG] [LOCAL ] DXC: Loaded 49776 existing records from primary storage. [2025-09-30T22:07:55.599755] [INFO ] [MAIN ] DXC: Loaded 49776 primary data records. [2025-09-30T22:07:55.729251] [DEBUG] [LOCAL ] DXYZ: Loaded 36771 existing records from primary storage. [2025-09-30T22:07:55.740330] [INFO ] [MAIN ] DXYZ: Loaded 36771 primary data records. [2025-09-30T22:07:55.828436] [DEBUG] [LOCAL ] DY: Loaded 29287 existing records from primary storage. [2025-09-30T22:07:55.907694] [INFO ] [MAIN ] DY: Loaded 29287 primary data records. [2025-09-30T22:07:56.617086] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:56.620224] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49776 primary records. [2025-09-30T22:07:56.622142] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-30T22:07:56.648807] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:56.652147] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36771 primary records. [2025-09-30T22:07:56.652639] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-30T22:07:56.655037] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-30T22:07:56.656019] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-30T22:07:56.657945] [INFO ] [MAIN ] Derivative Progress: 532/2009 symbols completed. DXC took 1.2s. Estimated remaining: 10m 11s. Rate: 145.0 symbols/min [2025-09-30T22:07:56.658390] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:56.676052] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-30T22:07:56.676487] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-30T22:07:56.679326] [INFO ] [MAIN ] Derivative Progress: 533/2009 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 10s. Rate: 145.2 symbols/min [2025-09-30T22:07:56.680834] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:56.699139] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:56.700013] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29287 primary records. [2025-09-30T22:07:56.700199] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-30T22:07:56.735351] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-30T22:07:56.744814] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-30T22:07:56.748317] [INFO ] [MAIN ] Derivative Progress: 534/2009 symbols completed. DY took 1.2s. Estimated remaining: 10m 8s. Rate: 145.5 symbols/min [2025-09-30T22:07:56.748764] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:56.764023] [DEBUG] [LOCAL ] E: Loaded 33253 existing records from primary storage. [2025-09-30T22:07:56.777674] [DEBUG] [LOCAL ] EAI: Loaded 3945 existing records from primary storage. [2025-09-30T22:07:56.778800] [INFO ] [MAIN ] E: Loaded 33253 primary data records. [2025-09-30T22:07:56.779024] [INFO ] [MAIN ] EAI: Loaded 3945 primary data records. [2025-09-30T22:07:56.801029] [DEBUG] [LOCAL ] EAF: Loaded 43066 existing records from primary storage. [2025-09-30T22:07:56.847018] [INFO ] [MAIN ] EAF: Loaded 43066 primary data records. [2025-09-30T22:07:57.832596] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:57.834472] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33253 primary records. [2025-09-30T22:07:57.834662] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-30T22:07:57.861286] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:57.865298] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3945 primary records. [2025-09-30T22:07:57.865438] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-30T22:07:57.866261] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-30T22:07:57.867356] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-30T22:07:57.869407] [INFO ] [MAIN ] Derivative Progress: 535/2009 symbols completed. E took 1.2s. Estimated remaining: 10m 10s. Rate: 145.0 symbols/min [2025-09-30T22:07:57.869568] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:57.886865] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-30T22:07:57.888282] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-30T22:07:57.892075] [INFO ] [MAIN ] Derivative Progress: 536/2009 symbols completed. EAI took 1.1s. Estimated remaining: 10m 8s. Rate: 145.3 symbols/min [2025-09-30T22:07:57.892448] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:57.907145] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:57.907892] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 43066 primary records. [2025-09-30T22:07:57.908062] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-30T22:07:57.924567] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-30T22:07:57.924867] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-30T22:07:57.928166] [INFO ] [MAIN ] Derivative Progress: 537/2009 symbols completed. EAF took 1.2s. Estimated remaining: 10m 7s. Rate: 145.5 symbols/min [2025-09-30T22:07:57.928539] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:57.957323] [DEBUG] [LOCAL ] EARN: Loaded 29751 existing records from primary storage. [2025-09-30T22:07:57.957493] [INFO ] [MAIN ] EARN: Loaded 29751 primary data records. [2025-09-30T22:07:58.058338] [DEBUG] [LOCAL ] EBF: Loaded 19235 existing records from primary storage. [2025-09-30T22:07:58.063695] [INFO ] [MAIN ] EBF: Loaded 19235 primary data records. [2025-09-30T22:07:58.086893] [DEBUG] [LOCAL ] EB: Loaded 37197 existing records from primary storage. [2025-09-30T22:07:58.104399] [INFO ] [MAIN ] EB: Loaded 37197 primary data records. [2025-09-30T22:07:58.992514] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:58.993408] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 29751 primary records. [2025-09-30T22:07:58.993823] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-30T22:07:59.019169] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-30T22:07:59.019542] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-30T22:07:59.022113] [INFO ] [MAIN ] Derivative Progress: 538/2009 symbols completed. EARN took 1.2s. Estimated remaining: 10m 8s. Rate: 145.1 symbols/min [2025-09-30T22:07:59.036335] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:59.037348] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37197 primary records. [2025-09-30T22:07:59.037433] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-30T22:07:59.067983] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:07:59.070986] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19235 primary records. [2025-09-30T22:07:59.071074] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-30T22:07:59.070210] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-30T22:07:59.071833] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-30T22:07:59.074568] [INFO ] [MAIN ] Derivative Progress: 539/2009 symbols completed. EB took 1.2s. Estimated remaining: 10m 7s. Rate: 145.3 symbols/min [2025-09-30T22:07:59.089965] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-30T22:07:59.090041] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-30T22:07:59.092608] [INFO ] [MAIN ] Derivative Progress: 540/2009 symbols completed. EBF took 1.2s. Estimated remaining: 10m 6s. Rate: 145.5 symbols/min [2025-09-30T22:07:59.093226] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:59.093545] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:59.093370] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:07:59.153879] [DEBUG] [LOCAL ] EBR: Loaded 43075 existing records from primary storage. [2025-09-30T22:07:59.166608] [INFO ] [MAIN ] EBR: Loaded 43075 primary data records. [2025-09-30T22:07:59.190958] [DEBUG] [LOCAL ] EBS: Loaded 46630 existing records from primary storage. [2025-09-30T22:07:59.236677] [INFO ] [MAIN ] EBS: Loaded 46630 primary data records. [2025-09-30T22:07:59.277818] [DEBUG] [LOCAL ] EC: Loaded 49276 existing records from primary storage. [2025-09-30T22:07:59.296301] [INFO ] [MAIN ] EC: Loaded 49276 primary data records. [2025-09-30T22:08:00.274757] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:00.288514] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43075 primary records. [2025-09-30T22:08:00.288678] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-30T22:08:00.290223] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:00.307122] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49276 primary records. [2025-09-30T22:08:00.307339] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-30T22:08:00.310584] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-30T22:08:00.318221] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-30T22:08:00.320171] [INFO ] [MAIN ] Derivative Progress: 541/2009 symbols completed. EBR took 1.2s. Estimated remaining: 10m 7s. Rate: 145.0 symbols/min [2025-09-30T22:08:00.320430] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:00.340950] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:00.342350] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46630 primary records. [2025-09-30T22:08:00.342534] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-30T22:08:00.356185] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-30T22:08:00.357040] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-30T22:08:00.359972] [INFO ] [MAIN ] Derivative Progress: 542/2009 symbols completed. EC took 1.3s. Estimated remaining: 10m 6s. Rate: 145.3 symbols/min [2025-09-30T22:08:00.360786] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:00.365180] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-09-30T22:08:00.365341] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-30T22:08:00.368381] [INFO ] [MAIN ] Derivative Progress: 543/2009 symbols completed. EBS took 1.3s. Estimated remaining: 10m 4s. Rate: 145.5 symbols/min [2025-09-30T22:08:00.368606] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:00.393210] [DEBUG] [LOCAL ] ECAT: Loaded 29602 existing records from primary storage. [2025-09-30T22:08:00.393438] [INFO ] [MAIN ] ECAT: Loaded 29602 primary data records. [2025-09-30T22:08:00.585278] [DEBUG] [LOCAL ] ECC: Loaded 43260 existing records from primary storage. [2025-09-30T22:08:00.610758] [INFO ] [MAIN ] ECC: Loaded 43260 primary data records. [2025-09-30T22:08:00.618844] [DEBUG] [LOCAL ] ECG: Loaded 33853 existing records from primary storage. [2025-09-30T22:08:00.786490] [INFO ] [MAIN ] ECG: Loaded 33853 primary data records. [2025-09-30T22:08:01.464142] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:01.467221] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29602 primary records. [2025-09-30T22:08:01.467516] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-30T22:08:01.492849] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-30T22:08:01.493790] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-30T22:08:01.495770] [INFO ] [MAIN ] Derivative Progress: 544/2009 symbols completed. ECAT took 1.2s. Estimated remaining: 10m 6s. Rate: 145.1 symbols/min [2025-09-30T22:08:01.510844] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:01.512430] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:01.514308] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33853 primary records. [2025-09-30T22:08:01.514862] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-30T22:08:01.542420] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:01.544222] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43260 primary records. [2025-09-30T22:08:01.545677] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-30T22:08:01.562525] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-30T22:08:01.563367] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-30T22:08:01.567040] [INFO ] [MAIN ] Derivative Progress: 545/2009 symbols completed. ECG took 1.2s. Estimated remaining: 10m 5s. Rate: 145.3 symbols/min [2025-09-30T22:08:01.568448] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:01.572104] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-09-30T22:08:01.583522] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-30T22:08:01.587141] [INFO ] [MAIN ] Derivative Progress: 546/2009 symbols completed. ECC took 1.2s. Estimated remaining: 10m 3s. Rate: 145.5 symbols/min [2025-09-30T22:08:01.587504] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:01.603096] [DEBUG] [LOCAL ] ECO: Loaded 18384 existing records from primary storage. [2025-09-30T22:08:01.603430] [INFO ] [MAIN ] ECO: Loaded 18384 primary data records. [2025-09-30T22:08:01.675624] [DEBUG] [LOCAL ] ECL: Loaded 46764 existing records from primary storage. [2025-09-30T22:08:01.693225] [INFO ] [MAIN ] ECL: Loaded 46764 primary data records. [2025-09-30T22:08:01.995019] [DEBUG] [LOCAL ] ECVT: Loaded 43021 existing records from primary storage. [2025-09-30T22:08:02.090256] [INFO ] [MAIN ] ECVT: Loaded 43021 primary data records. [2025-09-30T22:08:02.752118] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:02.753495] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18384 primary records. [2025-09-30T22:08:02.755042] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-30T22:08:02.784573] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:02.786394] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46764 primary records. [2025-09-30T22:08:02.786747] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-30T22:08:02.805182] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-30T22:08:02.805437] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-30T22:08:02.808612] [INFO ] [MAIN ] Derivative Progress: 547/2009 symbols completed. ECO took 1.2s. Estimated remaining: 10m 5s. Rate: 145.0 symbols/min [2025-09-30T22:08:02.810742] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:02.829019] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-30T22:08:02.828496] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:02.830168] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43021 primary records. [2025-09-30T22:08:02.830480] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-30T22:08:02.830388] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-30T22:08:02.833476] [INFO ] [MAIN ] Derivative Progress: 548/2009 symbols completed. ECL took 1.3s. Estimated remaining: 10m 3s. Rate: 145.3 symbols/min [2025-09-30T22:08:02.833944] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:02.854585] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-30T22:08:02.854701] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-30T22:08:02.859466] [INFO ] [MAIN ] Derivative Progress: 549/2009 symbols completed. ECVT took 1.3s. Estimated remaining: 10m 2s. Rate: 145.5 symbols/min [2025-09-30T22:08:02.859841] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:02.898679] [DEBUG] [LOCAL ] EDD: Loaded 27088 existing records from primary storage. [2025-09-30T22:08:02.898902] [INFO ] [MAIN ] EDD: Loaded 27088 primary data records. [2025-09-30T22:08:02.978105] [DEBUG] [LOCAL ] EDF: Loaded 13382 existing records from primary storage. [2025-09-30T22:08:03.004150] [INFO ] [MAIN ] EDF: Loaded 13382 primary data records. [2025-09-30T22:08:03.056027] [DEBUG] [LOCAL ] ED: Loaded 52759 existing records from primary storage. [2025-09-30T22:08:03.118852] [INFO ] [MAIN ] ED: Loaded 52759 primary data records. [2025-09-30T22:08:04.007011] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:04.008763] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27088 primary records. [2025-09-30T22:08:04.009124] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-30T22:08:04.056843] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-30T22:08:04.062928] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-30T22:08:04.062717] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:04.066052] [INFO ] [MAIN ] Derivative Progress: 550/2009 symbols completed. EDD took 1.2s. Estimated remaining: 10m 4s. Rate: 145.0 symbols/min [2025-09-30T22:08:04.066391] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:04.063349] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:04.067520] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52759 primary records. [2025-09-30T22:08:04.069221] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13382 primary records. [2025-09-30T22:08:04.069340] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-30T22:08:04.070318] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-30T22:08:04.116087] [DEBUG] [LOCAL ] EDN: Loaded 18137 existing records from primary storage. [2025-09-30T22:08:04.117288] [INFO ] [MAIN ] EDN: Loaded 18137 primary data records. [2025-09-30T22:08:04.116784] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-09-30T22:08:04.117937] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-30T22:08:04.154902] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-30T22:08:04.154796] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-30T22:08:04.165122] [INFO ] [MAIN ] Derivative Progress: 551/2009 symbols completed. ED took 1.4s. Estimated remaining: 10m 2s. Rate: 145.2 symbols/min [2025-09-30T22:08:04.189823] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:04.200323] [INFO ] [MAIN ] Derivative Progress: 552/2009 symbols completed. EDF took 1.3s. Estimated remaining: 10m 1s. Rate: 145.4 symbols/min [2025-09-30T22:08:04.206402] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:04.505320] [DEBUG] [LOCAL ] EEX: Loaded 11608 existing records from primary storage. [2025-09-30T22:08:04.505905] [INFO ] [MAIN ] EEX: Loaded 11608 primary data records. [2025-09-30T22:08:04.717522] [DEBUG] [LOCAL ] EDU: Loaded 44992 existing records from primary storage. [2025-09-30T22:08:04.846618] [INFO ] [MAIN ] EDU: Loaded 44992 primary data records. [2025-09-30T22:08:05.074720] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:05.113947] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18137 primary records. [2025-09-30T22:08:05.138020] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-30T22:08:05.284481] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-30T22:08:05.285822] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-30T22:08:05.290246] [INFO ] [MAIN ] Derivative Progress: 553/2009 symbols completed. EDN took 1.2s. Estimated remaining: 10m 2s. Rate: 145.0 symbols/min [2025-09-30T22:08:05.305493] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:05.306944] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 11608 primary records. [2025-09-30T22:08:05.307219] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-30T22:08:05.325596] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-30T22:08:05.325738] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-30T22:08:05.328492] [INFO ] [MAIN ] Derivative Progress: 554/2009 symbols completed. EEX took 1.1s. Estimated remaining: 10m 1s. Rate: 145.3 symbols/min [2025-09-30T22:08:05.346284] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:05.347126] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44992 primary records. [2025-09-30T22:08:05.347197] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-30T22:08:05.363310] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-30T22:08:05.363374] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-30T22:08:05.367289] [INFO ] [MAIN ] Derivative Progress: 555/2009 symbols completed. EDU took 1.2s. Estimated remaining: 9m 60s. Rate: 145.5 symbols/min [2025-09-30T22:08:05.368159] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:05.368548] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:05.368354] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:05.390217] [DEBUG] [LOCAL ] EFT: Loaded 12856 existing records from primary storage. [2025-09-30T22:08:05.390393] [INFO ] [MAIN ] EFT: Loaded 12856 primary data records. [2025-09-30T22:08:05.736902] [DEBUG] [LOCAL ] EFC: Loaded 46224 existing records from primary storage. [2025-09-30T22:08:05.750159] [INFO ] [MAIN ] EFC: Loaded 46224 primary data records. [2025-09-30T22:08:05.775845] [DEBUG] [LOCAL ] EFX: Loaded 44541 existing records from primary storage. [2025-09-30T22:08:05.801430] [INFO ] [MAIN ] EFX: Loaded 44541 primary data records. [2025-09-30T22:08:06.469627] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:06.472195] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 12856 primary records. [2025-09-30T22:08:06.472551] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-30T22:08:06.492838] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-09-30T22:08:06.493065] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-30T22:08:06.496010] [INFO ] [MAIN ] Derivative Progress: 556/2009 symbols completed. EFT took 1.1s. Estimated remaining: 10m 1s. Rate: 145.0 symbols/min [2025-09-30T22:08:06.496509] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:06.515893] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:06.519024] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46224 primary records. [2025-09-30T22:08:06.519350] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-30T22:08:06.556477] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:06.566527] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44541 primary records. [2025-09-30T22:08:06.567796] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-30T22:08:06.571142] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-30T22:08:06.570990] [DEBUG] [LOCAL ] EFXT: Loaded 29194 existing records from primary storage. [2025-09-30T22:08:06.571851] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-30T22:08:06.574630] [INFO ] [MAIN ] Derivative Progress: 557/2009 symbols completed. EFC took 1.2s. Estimated remaining: 9m 60s. Rate: 145.2 symbols/min [2025-09-30T22:08:06.574817] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:06.575259] [INFO ] [MAIN ] EFXT: Loaded 29194 primary data records. [2025-09-30T22:08:06.627068] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-30T22:08:06.632728] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-30T22:08:06.655909] [INFO ] [MAIN ] Derivative Progress: 558/2009 symbols completed. EFX took 1.3s. Estimated remaining: 9m 59s. Rate: 145.5 symbols/min [2025-09-30T22:08:06.682488] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:06.946679] [DEBUG] [LOCAL ] EGP: Loaded 30925 existing records from primary storage. [2025-09-30T22:08:06.947580] [INFO ] [MAIN ] EGP: Loaded 30925 primary data records. [2025-09-30T22:08:07.092892] [DEBUG] [LOCAL ] EGY: Loaded 42167 existing records from primary storage. [2025-09-30T22:08:07.120760] [INFO ] [MAIN ] EGY: Loaded 42167 primary data records. [2025-09-30T22:08:07.660537] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:07.661971] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29194 primary records. [2025-09-30T22:08:07.662561] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-30T22:08:07.683512] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-30T22:08:07.684842] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-30T22:08:07.687803] [INFO ] [MAIN ] Derivative Progress: 559/2009 symbols completed. EFXT took 1.2s. Estimated remaining: 9m 60s. Rate: 145.1 symbols/min [2025-09-30T22:08:07.689169] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:07.703622] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:07.704612] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30925 primary records. [2025-09-30T22:08:07.704898] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-30T22:08:07.724398] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-09-30T22:08:07.724709] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-30T22:08:07.727514] [INFO ] [MAIN ] Derivative Progress: 560/2009 symbols completed. EGP took 1.2s. Estimated remaining: 9m 58s. Rate: 145.3 symbols/min [2025-09-30T22:08:07.727780] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:07.746934] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:07.747795] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42167 primary records. [2025-09-30T22:08:07.750919] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-30T22:08:07.781003] [DEBUG] [LOCAL ] EIC: Loaded 23631 existing records from primary storage. [2025-09-30T22:08:07.781215] [INFO ] [MAIN ] EIC: Loaded 23631 primary data records. [2025-09-30T22:08:07.780165] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-30T22:08:07.781425] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-30T22:08:07.817490] [INFO ] [MAIN ] Derivative Progress: 561/2009 symbols completed. EGY took 1.1s. Estimated remaining: 9m 57s. Rate: 145.5 symbols/min [2025-09-30T22:08:07.831119] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:07.885018] [DEBUG] [LOCAL ] EIG: Loaded 20286 existing records from primary storage. [2025-09-30T22:08:07.901220] [INFO ] [MAIN ] EIG: Loaded 20286 primary data records. [2025-09-30T22:08:08.497781] [DEBUG] [LOCAL ] ELAN: Loaded 53230 existing records from primary storage. [2025-09-30T22:08:08.498089] [INFO ] [MAIN ] ELAN: Loaded 53230 primary data records. [2025-09-30T22:08:08.844561] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:08.845914] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 23631 primary records. [2025-09-30T22:08:08.846118] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-30T22:08:08.882218] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:08.883813] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20286 primary records. [2025-09-30T22:08:08.883978] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-30T22:08:08.882880] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-30T22:08:08.886220] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-30T22:08:08.888454] [INFO ] [MAIN ] Derivative Progress: 562/2009 symbols completed. EIC took 1.2s. Estimated remaining: 9m 58s. Rate: 145.1 symbols/min [2025-09-30T22:08:08.889017] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:08.911933] [DEBUG] [LOCAL ] ELC: Loaded 3479 existing records from primary storage. [2025-09-30T22:08:08.915190] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-30T22:08:08.916382] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-30T22:08:08.919568] [INFO ] [MAIN ] Derivative Progress: 563/2009 symbols completed. EIG took 1.2s. Estimated remaining: 9m 57s. Rate: 145.3 symbols/min [2025-09-30T22:08:08.916234] [INFO ] [MAIN ] ELC: Loaded 3479 primary data records. [2025-09-30T22:08:08.920098] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:09.066082] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:09.078364] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53230 primary records. [2025-09-30T22:08:09.083779] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-30T22:08:09.331178] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-30T22:08:09.331994] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-30T22:08:09.336051] [INFO ] [MAIN ] Derivative Progress: 564/2009 symbols completed. ELAN took 1.5s. Estimated remaining: 9m 57s. Rate: 145.3 symbols/min [2025-09-30T22:08:09.337006] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:09.395606] [DEBUG] [LOCAL ] ELF: Loaded 52207 existing records from primary storage. [2025-09-30T22:08:09.403753] [INFO ] [MAIN ] ELF: Loaded 52207 primary data records. [2025-09-30T22:08:09.404114] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:09.405302] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3479 primary records. [2025-09-30T22:08:09.438556] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-30T22:08:09.576547] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-09-30T22:08:09.576002] [DEBUG] [LOCAL ] ELME: Loaded 39204 existing records from primary storage. [2025-09-30T22:08:09.597826] [INFO ] [MAIN ] ELME: Loaded 39204 primary data records. [2025-09-30T22:08:09.597682] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-30T22:08:09.626921] [INFO ] [MAIN ] Derivative Progress: 565/2009 symbols completed. ELC took 0.7s. Estimated remaining: 9m 56s. Rate: 145.4 symbols/min [2025-09-30T22:08:09.699062] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:10.104637] [DEBUG] [LOCAL ] ELP: Loaded 25714 existing records from primary storage. [2025-09-30T22:08:10.111121] [INFO ] [MAIN ] ELP: Loaded 25714 primary data records. [2025-09-30T22:08:10.629504] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:10.645606] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52207 primary records. [2025-09-30T22:08:10.645943] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-30T22:08:10.670155] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-30T22:08:10.671261] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-30T22:08:10.673760] [INFO ] [MAIN ] Derivative Progress: 566/2009 symbols completed. ELF took 1.8s. Estimated remaining: 9m 57s. Rate: 145.0 symbols/min [2025-09-30T22:08:10.687496] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:10.688348] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39204 primary records. [2025-09-30T22:08:10.688607] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-30T22:08:10.686911] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:10.707381] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-30T22:08:10.710467] [DEBUG] [LOCAL ] EMF: Loaded 3427 existing records from primary storage. [2025-09-30T22:08:10.710636] [INFO ] [MAIN ] EMF: Loaded 3427 primary data records. [2025-09-30T22:08:10.710580] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-30T22:08:10.714151] [INFO ] [MAIN ] Derivative Progress: 567/2009 symbols completed. ELME took 1.4s. Estimated remaining: 9m 56s. Rate: 145.2 symbols/min [2025-09-30T22:08:10.726214] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:10.862980] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:10.884601] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25714 primary records. [2025-09-30T22:08:11.034859] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-30T22:08:11.074731] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-30T22:08:11.075069] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-30T22:08:11.078506] [INFO ] [MAIN ] Derivative Progress: 568/2009 symbols completed. ELP took 1.4s. Estimated remaining: 9m 55s. Rate: 145.3 symbols/min [2025-09-30T22:08:11.126984] [DEBUG] [LOCAL ] EMN: Loaded 50415 existing records from primary storage. [2025-09-30T22:08:11.125898] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:11.127151] [INFO ] [MAIN ] EMN: Loaded 50415 primary data records. [2025-09-30T22:08:11.127867] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3427 primary records. [2025-09-30T22:08:11.128011] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-30T22:08:11.278290] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-30T22:08:11.307089] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-30T22:08:11.338774] [INFO ] [MAIN ] Derivative Progress: 569/2009 symbols completed. EMF took 0.7s. Estimated remaining: 9m 54s. Rate: 145.4 symbols/min [2025-09-30T22:08:11.487079] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:11.487927] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50415 primary records. [2025-09-30T22:08:11.488028] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-30T22:08:11.503738] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-30T22:08:11.503850] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-30T22:08:11.506291] [INFO ] [MAIN ] Derivative Progress: 570/2009 symbols completed. EMN took 0.8s. Estimated remaining: 9m 53s. Rate: 145.5 symbols/min [2025-09-30T22:08:11.506838] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:11.506998] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:11.506768] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:11.515428] [DEBUG] [LOCAL ] ENFY: Loaded 3099 existing records from primary storage. [2025-09-30T22:08:11.515629] [INFO ] [MAIN ] ENFY: Loaded 3099 primary data records. [2025-09-30T22:08:11.891666] [DEBUG] [LOCAL ] ENOV: Loaded 44995 existing records from primary storage. [2025-09-30T22:08:11.891898] [INFO ] [MAIN ] ENOV: Loaded 44995 primary data records. [2025-09-30T22:08:12.028394] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-09-30T22:08:12.034393] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-09-30T22:08:12.671120] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:12.672302] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3099 primary records. [2025-09-30T22:08:12.672518] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-30T22:08:12.691538] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-09-30T22:08:12.691761] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-30T22:08:12.694289] [INFO ] [MAIN ] Derivative Progress: 571/2009 symbols completed. ENFY took 1.2s. Estimated remaining: 9m 55s. Rate: 145.0 symbols/min [2025-09-30T22:08:12.694721] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:12.714716] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:12.715932] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44995 primary records. [2025-09-30T22:08:12.716377] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-30T22:08:12.738265] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-30T22:08:12.739469] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-30T22:08:12.741516] [INFO ] [MAIN ] Derivative Progress: 572/2009 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 54s. Rate: 145.3 symbols/min [2025-09-30T22:08:12.751229] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:12.765991] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:12.766905] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53511 primary records. [2025-09-30T22:08:12.767146] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-30T22:08:12.778798] [DEBUG] [LOCAL ] ENS: Loaded 29303 existing records from primary storage. [2025-09-30T22:08:12.788671] [INFO ] [MAIN ] ENS: Loaded 29303 primary data records. [2025-09-30T22:08:12.934463] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-30T22:08:12.945586] [DEBUG] [LOCAL ] ENVA: Loaded 25406 existing records from primary storage. [2025-09-30T22:08:12.950956] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-30T22:08:12.960024] [INFO ] [MAIN ] Derivative Progress: 573/2009 symbols completed. ENB took 1.5s. Estimated remaining: 9m 53s. Rate: 145.4 symbols/min [2025-09-30T22:08:12.976123] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:12.996775] [INFO ] [MAIN ] ENVA: Loaded 25406 primary data records. [2025-09-30T22:08:13.277436] [DEBUG] [LOCAL ] EOD: Loaded 14203 existing records from primary storage. [2025-09-30T22:08:13.294542] [INFO ] [MAIN ] EOD: Loaded 14203 primary data records. [2025-09-30T22:08:13.853730] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:13.856144] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29303 primary records. [2025-09-30T22:08:13.856475] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-30T22:08:13.895484] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-09-30T22:08:13.895264] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:13.896921] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-30T22:08:13.896845] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25406 primary records. [2025-09-30T22:08:13.899399] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-30T22:08:13.899294] [INFO ] [MAIN ] Derivative Progress: 574/2009 symbols completed. ENS took 1.2s. Estimated remaining: 9m 54s. Rate: 145.1 symbols/min [2025-09-30T22:08:13.899845] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:13.930811] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:13.936188] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14203 primary records. [2025-09-30T22:08:13.936546] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-30T22:08:13.936325] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-09-30T22:08:13.937544] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-30T22:08:13.940040] [INFO ] [MAIN ] Derivative Progress: 575/2009 symbols completed. ENVA took 1.2s. Estimated remaining: 9m 52s. Rate: 145.3 symbols/min [2025-09-30T22:08:13.940356] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:13.956935] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-30T22:08:13.957081] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-30T22:08:13.959955] [INFO ] [MAIN ] Derivative Progress: 576/2009 symbols completed. EOD took 1.0s. Estimated remaining: 9m 51s. Rate: 145.5 symbols/min [2025-09-30T22:08:13.960262] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:13.970827] [DEBUG] [LOCAL ] EOI: Loaded 10647 existing records from primary storage. [2025-09-30T22:08:13.970957] [INFO ] [MAIN ] EOI: Loaded 10647 primary data records. [2025-09-30T22:08:14.113152] [DEBUG] [LOCAL ] EOS: Loaded 15187 existing records from primary storage. [2025-09-30T22:08:14.119226] [INFO ] [MAIN ] EOS: Loaded 15187 primary data records. [2025-09-30T22:08:14.479197] [DEBUG] [LOCAL ] EOG: Loaded 53343 existing records from primary storage. [2025-09-30T22:08:14.485377] [INFO ] [MAIN ] EOG: Loaded 53343 primary data records. [2025-09-30T22:08:15.126760] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:15.129021] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10647 primary records. [2025-09-30T22:08:15.129366] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-30T22:08:15.153983] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-30T22:08:15.154358] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-30T22:08:15.157023] [INFO ] [MAIN ] Derivative Progress: 577/2009 symbols completed. EOI took 1.2s. Estimated remaining: 9m 52s. Rate: 145.1 symbols/min [2025-09-30T22:08:15.170390] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:15.171754] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:15.172843] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15187 primary records. [2025-09-30T22:08:15.173360] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-30T22:08:15.194780] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-30T22:08:15.203133] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-30T22:08:15.210682] [INFO ] [MAIN ] Derivative Progress: 578/2009 symbols completed. EOS took 1.3s. Estimated remaining: 9m 51s. Rate: 145.3 symbols/min [2025-09-30T22:08:15.211167] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:15.211662] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:15.220814] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53343 primary records. [2025-09-30T22:08:15.220978] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-30T22:08:15.246753] [DEBUG] [LOCAL ] EPAC: Loaded 26979 existing records from primary storage. [2025-09-30T22:08:15.248255] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-30T22:08:15.248445] [INFO ] [MAIN ] EPAC: Loaded 26979 primary data records. [2025-09-30T22:08:15.248629] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-30T22:08:15.262945] [INFO ] [MAIN ] Derivative Progress: 579/2009 symbols completed. EOG took 1.4s. Estimated remaining: 9m 50s. Rate: 145.5 symbols/min [2025-09-30T22:08:15.268842] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:15.419830] [DEBUG] [LOCAL ] EPAM: Loaded 39781 existing records from primary storage. [2025-09-30T22:08:15.440257] [INFO ] [MAIN ] EPAM: Loaded 39781 primary data records. [2025-09-30T22:08:15.860602] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-09-30T22:08:15.987636] [INFO ] [MAIN ] EPD: Loaded 53610 primary data records. [2025-09-30T22:08:16.336905] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:16.338131] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26979 primary records. [2025-09-30T22:08:16.338756] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-30T22:08:16.360823] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-30T22:08:16.375091] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:16.374467] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-30T22:08:16.375982] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39781 primary records. [2025-09-30T22:08:16.378266] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-30T22:08:16.378196] [INFO ] [MAIN ] Derivative Progress: 580/2009 symbols completed. EPAC took 1.2s. Estimated remaining: 9m 51s. Rate: 145.1 symbols/min [2025-09-30T22:08:16.379068] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:16.415083] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-30T22:08:16.415565] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-30T22:08:16.415816] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:16.419407] [INFO ] [MAIN ] Derivative Progress: 581/2009 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 50s. Rate: 145.3 symbols/min [2025-09-30T22:08:16.420443] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53610 primary records. [2025-09-30T22:08:16.420669] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:16.420741] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-30T22:08:16.438260] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-30T22:08:16.438417] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-30T22:08:16.441044] [INFO ] [MAIN ] Derivative Progress: 582/2009 symbols completed. EPD took 1.2s. Estimated remaining: 9m 48s. Rate: 145.5 symbols/min [2025-09-30T22:08:16.441224] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:16.467696] [DEBUG] [LOCAL ] EQBK: Loaded 10919 existing records from primary storage. [2025-09-30T22:08:16.467846] [INFO ] [MAIN ] EQBK: Loaded 10919 primary data records. [2025-09-30T22:08:16.564801] [DEBUG] [LOCAL ] EPR: Loaded 43924 existing records from primary storage. [2025-09-30T22:08:16.587855] [INFO ] [MAIN ] EPR: Loaded 43924 primary data records. [2025-09-30T22:08:16.879950] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-09-30T22:08:16.958990] [INFO ] [MAIN ] EPRT: Loaded 48479 primary data records. [2025-09-30T22:08:17.564899] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:08:17.566607] [INFO ] [MAIN ] EQBK: Generated 1793 derivative records from 10919 primary records. [2025-09-30T22:08:17.567877] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-30T22:08:17.604947] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:17.606934] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43924 primary records. [2025-09-30T22:08:17.607434] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1793 records). [2025-09-30T22:08:17.607489] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-30T22:08:17.607619] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-30T22:08:17.611617] [INFO ] [MAIN ] Derivative Progress: 583/2009 symbols completed. EQBK took 1.2s. Estimated remaining: 9m 50s. Rate: 145.1 symbols/min [2025-09-30T22:08:17.645428] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:17.647038] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48479 primary records. [2025-09-30T22:08:17.646279] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-30T22:08:17.647201] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-30T22:08:17.647318] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-30T22:08:17.650239] [INFO ] [MAIN ] Derivative Progress: 584/2009 symbols completed. EPR took 1.3s. Estimated remaining: 9m 48s. Rate: 145.3 symbols/min [2025-09-30T22:08:17.667282] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-30T22:08:17.667458] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-30T22:08:17.671880] [INFO ] [MAIN ] Derivative Progress: 585/2009 symbols completed. EPRT took 1.3s. Estimated remaining: 9m 47s. Rate: 145.5 symbols/min [2025-09-30T22:08:17.673024] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:17.673253] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:17.672943] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:17.753799] [DEBUG] [LOCAL ] EQH: Loaded 52651 existing records from primary storage. [2025-09-30T22:08:17.767677] [INFO ] [MAIN ] EQH: Loaded 52651 primary data records. [2025-09-30T22:08:17.842449] [DEBUG] [LOCAL ] EQNR: Loaded 53023 existing records from primary storage. [2025-09-30T22:08:17.851882] [INFO ] [MAIN ] EQNR: Loaded 53023 primary data records. [2025-09-30T22:08:17.857880] [DEBUG] [LOCAL ] EQR: Loaded 51489 existing records from primary storage. [2025-09-30T22:08:17.882148] [INFO ] [MAIN ] EQR: Loaded 51489 primary data records. [2025-09-30T22:08:18.806718] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:18.807560] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52651 primary records. [2025-09-30T22:08:18.807838] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-30T22:08:18.829559] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-30T22:08:18.830613] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-30T22:08:18.832370] [INFO ] [MAIN ] Derivative Progress: 586/2009 symbols completed. EQH took 1.2s. Estimated remaining: 9m 48s. Rate: 145.1 symbols/min [2025-09-30T22:08:18.840810] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:18.846200] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:18.847571] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53023 primary records. [2025-09-30T22:08:18.855455] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-30T22:08:18.862023] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:18.877253] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51489 primary records. [2025-09-30T22:08:18.878794] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-30T22:08:18.879023] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-30T22:08:18.883014] [INFO ] [MAIN ] Derivative Progress: 587/2009 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 47s. Rate: 145.3 symbols/min [2025-09-30T22:08:18.883160] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-30T22:08:18.883335] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:18.902093] [DEBUG] [LOCAL ] EQV: Loaded 2737 existing records from primary storage. [2025-09-30T22:08:18.902747] [INFO ] [MAIN ] EQV: Loaded 2737 primary data records. [2025-09-30T22:08:19.027297] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-30T22:08:19.031294] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-30T22:08:19.034101] [INFO ] [MAIN ] Derivative Progress: 588/2009 symbols completed. EQR took 1.4s. Estimated remaining: 9m 46s. Rate: 145.5 symbols/min [2025-09-30T22:08:19.055752] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:19.286972] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-30T22:08:19.287338] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-30T22:08:19.636825] [DEBUG] [LOCAL ] ERO: Loaded 41233 existing records from primary storage. [2025-09-30T22:08:19.637736] [INFO ] [MAIN ] ERO: Loaded 41233 primary data records. [2025-09-30T22:08:19.856890] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:19.980745] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2737 primary records. [2025-09-30T22:08:19.981726] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-30T22:08:20.000947] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-30T22:08:20.001372] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-30T22:08:20.004464] [INFO ] [MAIN ] Derivative Progress: 589/2009 symbols completed. EQV took 1.1s. Estimated remaining: 9m 47s. Rate: 145.1 symbols/min [2025-09-30T22:08:20.005549] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:20.023002] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:20.024081] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-30T22:08:20.024258] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-30T22:08:20.042062] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-30T22:08:20.042470] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-30T22:08:20.045949] [INFO ] [MAIN ] Derivative Progress: 590/2009 symbols completed. EQT took 1.2s. Estimated remaining: 9m 46s. Rate: 145.3 symbols/min [2025-09-30T22:08:20.046757] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:20.061834] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:20.062631] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41233 primary records. [2025-09-30T22:08:20.065631] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-30T22:08:20.083088] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-30T22:08:20.090902] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-30T22:08:20.093874] [INFO ] [MAIN ] Derivative Progress: 591/2009 symbols completed. ERO took 1.0s. Estimated remaining: 9m 44s. Rate: 145.6 symbols/min [2025-09-30T22:08:20.094194] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:20.119598] [DEBUG] [LOCAL ] ESAB: Loaded 26186 existing records from primary storage. [2025-09-30T22:08:20.119815] [INFO ] [MAIN ] ESAB: Loaded 26186 primary data records. [2025-09-30T22:08:20.262700] [DEBUG] [LOCAL ] ESE: Loaded 16678 existing records from primary storage. [2025-09-30T22:08:20.268423] [DEBUG] [LOCAL ] ES: Loaded 52556 existing records from primary storage. [2025-09-30T22:08:20.268631] [INFO ] [MAIN ] ESE: Loaded 16678 primary data records. [2025-09-30T22:08:20.268560] [INFO ] [MAIN ] ES: Loaded 52556 primary data records. [2025-09-30T22:08:21.208479] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:21.209610] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26186 primary records. [2025-09-30T22:08:21.209817] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-30T22:08:21.227238] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-30T22:08:21.227701] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-30T22:08:21.229631] [INFO ] [MAIN ] Derivative Progress: 592/2009 symbols completed. ESAB took 1.2s. Estimated remaining: 9m 46s. Rate: 145.1 symbols/min [2025-09-30T22:08:21.229956] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:21.250279] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:21.251231] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52556 primary records. [2025-09-30T22:08:21.263694] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-30T22:08:21.264480] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:21.265502] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16678 primary records. [2025-09-30T22:08:21.265596] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-30T22:08:21.295610] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-30T22:08:21.296470] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-30T22:08:21.299326] [INFO ] [MAIN ] Derivative Progress: 593/2009 symbols completed. ESE took 1.2s. Estimated remaining: 9m 45s. Rate: 145.3 symbols/min [2025-09-30T22:08:21.299548] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:21.301893] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-30T22:08:21.302144] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-30T22:08:21.305127] [INFO ] [MAIN ] Derivative Progress: 594/2009 symbols completed. ES took 1.3s. Estimated remaining: 9m 43s. Rate: 145.6 symbols/min [2025-09-30T22:08:21.318547] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:21.340981] [DEBUG] [LOCAL ] ESI: Loaded 50750 existing records from primary storage. [2025-09-30T22:08:21.341268] [INFO ] [MAIN ] ESI: Loaded 50750 primary data records. [2025-09-30T22:08:21.700205] [DEBUG] [LOCAL ] ESRT: Loaded 46441 existing records from primary storage. [2025-09-30T22:08:21.714577] [INFO ] [MAIN ] ESRT: Loaded 46441 primary data records. [2025-09-30T22:08:21.715994] [DEBUG] [LOCAL ] ESNT: Loaded 38357 existing records from primary storage. [2025-09-30T22:08:21.722313] [INFO ] [MAIN ] ESNT: Loaded 38357 primary data records. [2025-09-30T22:08:22.410332] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:22.411753] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50750 primary records. [2025-09-30T22:08:22.412149] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-30T22:08:22.441339] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-30T22:08:22.441786] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-30T22:08:22.444830] [INFO ] [MAIN ] Derivative Progress: 595/2009 symbols completed. ESI took 1.2s. Estimated remaining: 9m 45s. Rate: 145.1 symbols/min [2025-09-30T22:08:22.445426] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:22.464812] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:22.468553] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46441 primary records. [2025-09-30T22:08:22.469051] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-30T22:08:22.492346] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:22.497835] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38357 primary records. [2025-09-30T22:08:22.499054] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-30T22:08:22.517234] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-30T22:08:22.518262] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-30T22:08:22.521061] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-30T22:08:22.523514] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-30T22:08:22.523355] [INFO ] [MAIN ] Derivative Progress: 596/2009 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 43s. Rate: 145.3 symbols/min [2025-09-30T22:08:22.523741] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:22.526550] [INFO ] [MAIN ] Derivative Progress: 597/2009 symbols completed. ESNT took 1.2s. Estimated remaining: 9m 42s. Rate: 145.6 symbols/min [2025-09-30T22:08:22.527043] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:22.557562] [DEBUG] [LOCAL ] ETB: Loaded 12062 existing records from primary storage. [2025-09-30T22:08:22.558308] [INFO ] [MAIN ] ETB: Loaded 12062 primary data records. [2025-09-30T22:08:22.692973] [DEBUG] [LOCAL ] ESTC: Loaded 49963 existing records from primary storage. [2025-09-30T22:08:22.698918] [INFO ] [MAIN ] ESTC: Loaded 49963 primary data records. [2025-09-30T22:08:23.125885] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-30T22:08:23.246371] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-09-30T22:08:23.644983] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:23.646607] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12062 primary records. [2025-09-30T22:08:23.647140] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-30T22:08:23.677925] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-30T22:08:23.683031] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-30T22:08:23.685799] [INFO ] [MAIN ] Derivative Progress: 598/2009 symbols completed. ETB took 1.2s. Estimated remaining: 9m 43s. Rate: 145.1 symbols/min [2025-09-30T22:08:23.686197] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:23.687743] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 49963 primary records. [2025-09-30T22:08:23.688252] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-30T22:08:23.709018] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-30T22:08:23.721771] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-30T22:08:23.724406] [INFO ] [MAIN ] Derivative Progress: 599/2009 symbols completed. ESTC took 1.3s. Estimated remaining: 9m 42s. Rate: 145.4 symbols/min [2025-09-30T22:08:23.722066] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:23.725420] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-09-30T22:08:23.725488] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-30T22:08:23.741718] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-30T22:08:23.741819] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-30T22:08:23.744254] [INFO ] [MAIN ] Derivative Progress: 600/2009 symbols completed. ET took 1.2s. Estimated remaining: 9m 41s. Rate: 145.6 symbols/min [2025-09-30T22:08:23.744898] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:23.744819] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:23.745054] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:23.770672] [DEBUG] [LOCAL ] ETG: Loaded 16446 existing records from primary storage. [2025-09-30T22:08:23.770842] [INFO ] [MAIN ] ETG: Loaded 16446 primary data records. [2025-09-30T22:08:23.858371] [DEBUG] [LOCAL ] ETJ: Loaded 16740 existing records from primary storage. [2025-09-30T22:08:23.913026] [DEBUG] [LOCAL ] ETD: Loaded 27384 existing records from primary storage. [2025-09-30T22:08:23.898715] [INFO ] [MAIN ] ETJ: Loaded 16740 primary data records. [2025-09-30T22:08:23.913354] [INFO ] [MAIN ] ETD: Loaded 27384 primary data records. [2025-09-30T22:08:24.822085] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:24.822998] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16446 primary records. [2025-09-30T22:08:24.823244] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-30T22:08:24.858206] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:24.857883] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-30T22:08:24.859149] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16740 primary records. [2025-09-30T22:08:24.858443] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-30T22:08:24.861257] [INFO ] [MAIN ] Derivative Progress: 601/2009 symbols completed. ETG took 1.1s. Estimated remaining: 9m 42s. Rate: 145.2 symbols/min [2025-09-30T22:08:24.873486] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-30T22:08:24.873430] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:24.874313] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:24.875805] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27384 primary records. [2025-09-30T22:08:24.876057] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-30T22:08:24.905597] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-30T22:08:24.906178] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-30T22:08:24.908998] [INFO ] [MAIN ] Derivative Progress: 602/2009 symbols completed. ETD took 1.2s. Estimated remaining: 9m 41s. Rate: 145.4 symbols/min [2025-09-30T22:08:24.909515] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:24.912409] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-30T22:08:24.912607] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-30T22:08:24.915033] [INFO ] [MAIN ] Derivative Progress: 603/2009 symbols completed. ETJ took 1.2s. Estimated remaining: 9m 39s. Rate: 145.6 symbols/min [2025-09-30T22:08:24.915228] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:24.922908] [DEBUG] [LOCAL ] ETO: Loaded 6485 existing records from primary storage. [2025-09-30T22:08:24.923039] [INFO ] [MAIN ] ETO: Loaded 6485 primary data records. [2025-09-30T22:08:25.302265] [DEBUG] [LOCAL ] ETN: Loaded 52783 existing records from primary storage. [2025-09-30T22:08:25.302672] [INFO ] [MAIN ] ETN: Loaded 52783 primary data records. [2025-09-30T22:08:25.406834] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-09-30T22:08:25.412678] [INFO ] [MAIN ] ETR: Loaded 53225 primary data records. [2025-09-30T22:08:26.044259] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:26.045883] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6485 primary records. [2025-09-30T22:08:26.046215] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-30T22:08:26.070809] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-30T22:08:26.070981] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-30T22:08:26.086253] [INFO ] [MAIN ] Derivative Progress: 604/2009 symbols completed. ETO took 1.2s. Estimated remaining: 9m 41s. Rate: 145.2 symbols/min [2025-09-30T22:08:26.094312] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:26.095963] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:26.098499] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52783 primary records. [2025-09-30T22:08:26.099431] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-30T22:08:26.125672] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:26.127365] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53225 primary records. [2025-09-30T22:08:26.127711] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-30T22:08:26.152515] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-30T22:08:26.153143] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-30T22:08:26.156399] [INFO ] [MAIN ] Derivative Progress: 605/2009 symbols completed. ETR took 1.2s. Estimated remaining: 9m 39s. Rate: 145.4 symbols/min [2025-09-30T22:08:26.156637] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:26.156534] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-30T22:08:26.156933] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-30T22:08:26.166701] [INFO ] [MAIN ] Derivative Progress: 606/2009 symbols completed. ETN took 1.3s. Estimated remaining: 9m 38s. Rate: 145.6 symbols/min [2025-09-30T22:08:26.167265] [DEBUG] [LOCAL ] ETV: Loaded 21445 existing records from primary storage. [2025-09-30T22:08:26.167537] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:26.167808] [INFO ] [MAIN ] ETV: Loaded 21445 primary data records. [2025-09-30T22:08:26.281229] [DEBUG] [LOCAL ] ETX: Loaded 5053 existing records from primary storage. [2025-09-30T22:08:26.291824] [INFO ] [MAIN ] ETX: Loaded 5053 primary data records. [2025-09-30T22:08:26.413371] [DEBUG] [LOCAL ] ETW: Loaded 25073 existing records from primary storage. [2025-09-30T22:08:26.561252] [INFO ] [MAIN ] ETW: Loaded 25073 primary data records. [2025-09-30T22:08:27.171992] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:27.172850] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21445 primary records. [2025-09-30T22:08:27.173100] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-30T22:08:27.206113] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:27.207697] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5053 primary records. [2025-09-30T22:08:27.208502] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-30T22:08:27.208449] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-30T22:08:27.208601] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-30T22:08:27.211108] [INFO ] [MAIN ] Derivative Progress: 607/2009 symbols completed. ETV took 1.1s. Estimated remaining: 9m 39s. Rate: 145.3 symbols/min [2025-09-30T22:08:27.213679] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:27.242274] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-09-30T22:08:27.242858] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-30T22:08:27.242793] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:27.246273] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25073 primary records. [2025-09-30T22:08:27.246472] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-30T22:08:27.245476] [INFO ] [MAIN ] Derivative Progress: 608/2009 symbols completed. ETX took 1.1s. Estimated remaining: 9m 38s. Rate: 145.5 symbols/min [2025-09-30T22:08:27.247059] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:27.263925] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-30T22:08:27.269333] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-30T22:08:27.272234] [INFO ] [MAIN ] Derivative Progress: 609/2009 symbols completed. ETW took 1.1s. Estimated remaining: 9m 37s. Rate: 145.7 symbols/min [2025-09-30T22:08:27.272916] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:27.287868] [DEBUG] [LOCAL ] ETY: Loaded 22683 existing records from primary storage. [2025-09-30T22:08:27.288074] [INFO ] [MAIN ] ETY: Loaded 22683 primary data records. [2025-09-30T22:08:27.365572] [DEBUG] [LOCAL ] EVC: Loaded 18717 existing records from primary storage. [2025-09-30T22:08:27.402797] [INFO ] [MAIN ] EVC: Loaded 18717 primary data records. [2025-09-30T22:08:27.535167] [DEBUG] [LOCAL ] EVEX: Loaded 30362 existing records from primary storage. [2025-09-30T22:08:27.661896] [INFO ] [MAIN ] EVEX: Loaded 30362 primary data records. [2025-09-30T22:08:28.343416] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:28.344902] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22683 primary records. [2025-09-30T22:08:28.346073] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-30T22:08:28.379918] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:28.381200] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18717 primary records. [2025-09-30T22:08:28.382819] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-30T22:08:28.388310] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-30T22:08:28.404952] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-30T22:08:28.408780] [INFO ] [MAIN ] Derivative Progress: 610/2009 symbols completed. ETY took 1.2s. Estimated remaining: 9m 38s. Rate: 145.3 symbols/min [2025-09-30T22:08:28.411439] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:28.416408] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-30T22:08:28.416666] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-30T22:08:28.420098] [INFO ] [MAIN ] Derivative Progress: 611/2009 symbols completed. EVC took 1.2s. Estimated remaining: 9m 36s. Rate: 145.5 symbols/min [2025-09-30T22:08:28.433514] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:28.434481] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 30362 primary records. [2025-09-30T22:08:28.434671] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-30T22:08:28.433295] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:28.458206] [DEBUG] [LOCAL ] EVF: Loaded 9402 existing records from primary storage. [2025-09-30T22:08:28.457841] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-30T22:08:28.458352] [INFO ] [MAIN ] EVF: Loaded 9402 primary data records. [2025-09-30T22:08:28.458421] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-30T22:08:28.462440] [INFO ] [MAIN ] Derivative Progress: 612/2009 symbols completed. EVEX took 1.2s. Estimated remaining: 9m 35s. Rate: 145.7 symbols/min [2025-09-30T22:08:28.462603] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:28.542016] [DEBUG] [LOCAL ] EVG: Loaded 5828 existing records from primary storage. [2025-09-30T22:08:28.554283] [INFO ] [MAIN ] EVG: Loaded 5828 primary data records. [2025-09-30T22:08:29.030213] [DEBUG] [LOCAL ] EVH: Loaded 49371 existing records from primary storage. [2025-09-30T22:08:29.030885] [INFO ] [MAIN ] EVH: Loaded 49371 primary data records. [2025-09-30T22:08:29.533340] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:29.534967] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9402 primary records. [2025-09-30T22:08:29.535258] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-30T22:08:29.574025] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:29.576767] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5828 primary records. [2025-09-30T22:08:29.575772] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-30T22:08:29.577116] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-30T22:08:29.577031] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-30T22:08:29.579997] [INFO ] [MAIN ] Derivative Progress: 613/2009 symbols completed. EVF took 1.2s. Estimated remaining: 9m 36s. Rate: 145.3 symbols/min [2025-09-30T22:08:29.613453] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-30T22:08:29.614076] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-30T22:08:29.613955] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:29.616974] [INFO ] [MAIN ] Derivative Progress: 614/2009 symbols completed. EVG took 1.2s. Estimated remaining: 9m 35s. Rate: 145.5 symbols/min [2025-09-30T22:08:29.617816] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49371 primary records. [2025-09-30T22:08:29.618158] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-30T22:08:29.635331] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-30T22:08:29.635525] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-30T22:08:29.638844] [INFO ] [MAIN ] Derivative Progress: 615/2009 symbols completed. EVH took 1.2s. Estimated remaining: 9m 34s. Rate: 145.8 symbols/min [2025-09-30T22:08:29.639530] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:29.639849] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:29.639743] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:29.670632] [DEBUG] [LOCAL ] EVTC: Loaded 26224 existing records from primary storage. [2025-09-30T22:08:29.687917] [INFO ] [MAIN ] EVTC: Loaded 26224 primary data records. [2025-09-30T22:08:29.814174] [DEBUG] [LOCAL ] EVR: Loaded 35004 existing records from primary storage. [2025-09-30T22:08:29.833800] [INFO ] [MAIN ] EVR: Loaded 35004 primary data records. [2025-09-30T22:08:29.850171] [DEBUG] [LOCAL ] EVTL: Loaded 38020 existing records from primary storage. [2025-09-30T22:08:29.855478] [INFO ] [MAIN ] EVTL: Loaded 38020 primary data records. [2025-09-30T22:08:30.773055] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:30.774166] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26224 primary records. [2025-09-30T22:08:30.774281] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-30T22:08:30.808245] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-09-30T22:08:30.809357] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:30.810785] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 38020 primary records. [2025-09-30T22:08:30.810954] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-30T22:08:30.811038] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-30T22:08:30.813336] [INFO ] [MAIN ] Derivative Progress: 616/2009 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 35s. Rate: 145.3 symbols/min [2025-09-30T22:08:30.813792] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:30.839189] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:30.841184] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35004 primary records. [2025-09-30T22:08:30.842195] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-30T22:08:30.856810] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-30T22:08:30.861750] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-30T22:08:30.860375] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-30T22:08:30.864739] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-30T22:08:30.864622] [INFO ] [MAIN ] Derivative Progress: 617/2009 symbols completed. EVTL took 1.2s. Estimated remaining: 9m 34s. Rate: 145.5 symbols/min [2025-09-30T22:08:30.867773] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:30.868023] [INFO ] [MAIN ] Derivative Progress: 618/2009 symbols completed. EVR took 1.2s. Estimated remaining: 9m 33s. Rate: 145.8 symbols/min [2025-09-30T22:08:30.868205] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:30.918996] [DEBUG] [LOCAL ] EW: Loaded 53400 existing records from primary storage. [2025-09-30T22:08:30.919195] [INFO ] [MAIN ] EW: Loaded 53400 primary data records. [2025-09-30T22:08:31.024203] [DEBUG] [LOCAL ] EXG: Loaded 34116 existing records from primary storage. [2025-09-30T22:08:31.035283] [INFO ] [MAIN ] EXG: Loaded 34116 primary data records. [2025-09-30T22:08:31.414669] [DEBUG] [LOCAL ] EXK: Loaded 53127 existing records from primary storage. [2025-09-30T22:08:31.425430] [INFO ] [MAIN ] EXK: Loaded 53127 primary data records. [2025-09-30T22:08:32.008278] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:32.009404] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53400 primary records. [2025-09-30T22:08:32.010134] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-30T22:08:32.045173] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:32.047822] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-30T22:08:32.047978] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-30T22:08:32.047732] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34116 primary records. [2025-09-30T22:08:32.050819] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-30T22:08:32.050574] [INFO ] [MAIN ] Derivative Progress: 619/2009 symbols completed. EW took 1.2s. Estimated remaining: 9m 34s. Rate: 145.3 symbols/min [2025-09-30T22:08:32.050974] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:32.073277] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-30T22:08:32.073590] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-30T22:08:32.088436] [INFO ] [MAIN ] Derivative Progress: 620/2009 symbols completed. EXG took 1.2s. Estimated remaining: 9m 33s. Rate: 145.5 symbols/min [2025-09-30T22:08:32.089828] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:32.089696] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:32.091241] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53127 primary records. [2025-09-30T22:08:32.091382] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-30T22:08:32.116590] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-30T22:08:32.116875] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-30T22:08:32.120574] [INFO ] [MAIN ] Derivative Progress: 621/2009 symbols completed. EXK took 1.3s. Estimated remaining: 9m 31s. Rate: 145.8 symbols/min [2025-09-30T22:08:32.131334] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:32.132213] [DEBUG] [LOCAL ] EXP: Loaded 29652 existing records from primary storage. [2025-09-30T22:08:32.132880] [INFO ] [MAIN ] EXP: Loaded 29652 primary data records. [2025-09-30T22:08:32.495059] [DEBUG] [LOCAL ] EXPD: Loaded 47976 existing records from primary storage. [2025-09-30T22:08:32.495446] [INFO ] [MAIN ] EXPD: Loaded 47976 primary data records. [2025-09-30T22:08:32.656112] [DEBUG] [LOCAL ] EXR: Loaded 45275 existing records from primary storage. [2025-09-30T22:08:32.719615] [INFO ] [MAIN ] EXR: Loaded 45275 primary data records. [2025-09-30T22:08:33.210052] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:33.211097] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29652 primary records. [2025-09-30T22:08:33.211217] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-30T22:08:33.233797] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-30T22:08:33.234074] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-30T22:08:33.238127] [INFO ] [MAIN ] Derivative Progress: 622/2009 symbols completed. EXP took 1.2s. Estimated remaining: 9m 33s. Rate: 145.4 symbols/min [2025-09-30T22:08:33.238803] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:33.261967] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:33.263342] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47976 primary records. [2025-09-30T22:08:33.263614] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-30T22:08:33.322966] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-30T22:08:33.323886] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-30T22:08:33.323796] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:33.324962] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45275 primary records. [2025-09-30T22:08:33.327319] [INFO ] [MAIN ] Derivative Progress: 623/2009 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 31s. Rate: 145.5 symbols/min [2025-09-30T22:08:33.327580] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-30T22:08:33.328213] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:33.345932] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-30T22:08:33.347095] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-30T22:08:33.349768] [INFO ] [MAIN ] Derivative Progress: 624/2009 symbols completed. EXR took 1.2s. Estimated remaining: 9m 30s. Rate: 145.8 symbols/min [2025-09-30T22:08:33.350156] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:33.377283] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-30T22:08:33.377615] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-30T22:08:33.557873] [DEBUG] [LOCAL ] FAF: Loaded 41733 existing records from primary storage. [2025-09-30T22:08:33.563720] [INFO ] [MAIN ] FAF: Loaded 41733 primary data records. [2025-09-30T22:08:33.938911] [DEBUG] [LOCAL ] FBIN: Loaded 50325 existing records from primary storage. [2025-09-30T22:08:33.955671] [INFO ] [MAIN ] FBIN: Loaded 50325 primary data records. [2025-09-30T22:08:34.582879] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:34.584022] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-30T22:08:34.584223] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-30T22:08:34.607904] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-30T22:08:34.608741] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-30T22:08:34.611108] [INFO ] [MAIN ] Derivative Progress: 625/2009 symbols completed. F took 1.4s. Estimated remaining: 9m 32s. Rate: 145.3 symbols/min [2025-09-30T22:08:34.611382] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:34.627978] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:34.628897] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41733 primary records. [2025-09-30T22:08:34.628993] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-30T22:08:34.650902] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-30T22:08:34.651104] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-30T22:08:34.654074] [INFO ] [MAIN ] Derivative Progress: 626/2009 symbols completed. FAF took 1.3s. Estimated remaining: 9m 30s. Rate: 145.5 symbols/min [2025-09-30T22:08:34.662861] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:34.677444] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:34.678319] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50325 primary records. [2025-09-30T22:08:34.678427] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-30T22:08:34.704314] [DEBUG] [LOCAL ] FBK: Loaded 25945 existing records from primary storage. [2025-09-30T22:08:34.703734] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-30T22:08:34.704512] [INFO ] [MAIN ] FBK: Loaded 25945 primary data records. [2025-09-30T22:08:34.704590] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-30T22:08:34.707549] [INFO ] [MAIN ] Derivative Progress: 627/2009 symbols completed. FBIN took 1.4s. Estimated remaining: 9m 29s. Rate: 145.7 symbols/min [2025-09-30T22:08:34.729966] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:35.058208] [DEBUG] [LOCAL ] FBP: Loaded 46045 existing records from primary storage. [2025-09-30T22:08:35.058512] [INFO ] [MAIN ] FBP: Loaded 46045 primary data records. [2025-09-30T22:08:35.125629] [DEBUG] [LOCAL ] FBRT: Loaded 34527 existing records from primary storage. [2025-09-30T22:08:35.144949] [INFO ] [MAIN ] FBRT: Loaded 34527 primary data records. [2025-09-30T22:08:35.762751] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:35.764636] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25945 primary records. [2025-09-30T22:08:35.766586] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-30T22:08:35.787702] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-30T22:08:35.788353] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-30T22:08:35.791231] [INFO ] [MAIN ] Derivative Progress: 628/2009 symbols completed. FBK took 1.2s. Estimated remaining: 9m 30s. Rate: 145.3 symbols/min [2025-09-30T22:08:35.815637] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:35.816904] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46045 primary records. [2025-09-30T22:08:35.830356] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-30T22:08:35.830595] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:35.832343] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34527 primary records. [2025-09-30T22:08:35.832438] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-30T22:08:35.862184] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-30T22:08:35.866224] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-30T22:08:35.866322] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-30T22:08:35.866430] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-30T22:08:35.868608] [INFO ] [MAIN ] Derivative Progress: 629/2009 symbols completed. FBP took 1.2s. Estimated remaining: 9m 29s. Rate: 145.5 symbols/min [2025-09-30T22:08:35.872067] [INFO ] [MAIN ] Derivative Progress: 630/2009 symbols completed. FBRT took 1.1s. Estimated remaining: 9m 28s. Rate: 145.7 symbols/min [2025-09-30T22:08:35.872614] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:35.872539] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:35.872802] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:35.894142] [DEBUG] [LOCAL ] FC: Loaded 15429 existing records from primary storage. [2025-09-30T22:08:35.894495] [INFO ] [MAIN ] FC: Loaded 15429 primary data records. [2025-09-30T22:08:36.047329] [DEBUG] [LOCAL ] FCN: Loaded 26000 existing records from primary storage. [2025-09-30T22:08:36.047638] [INFO ] [MAIN ] FCN: Loaded 26000 primary data records. [2025-09-30T22:08:36.114702] [DEBUG] [LOCAL ] FCF: Loaded 39428 existing records from primary storage. [2025-09-30T22:08:36.143880] [INFO ] [MAIN ] FCF: Loaded 39428 primary data records. [2025-09-30T22:08:37.004709] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:37.007368] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15429 primary records. [2025-09-30T22:08:37.008379] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-30T22:08:37.035140] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:37.036623] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26000 primary records. [2025-09-30T22:08:37.037312] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-30T22:08:37.053390] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-30T22:08:37.056791] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-30T22:08:37.059175] [INFO ] [MAIN ] Derivative Progress: 631/2009 symbols completed. FC took 1.2s. Estimated remaining: 9m 29s. Rate: 145.3 symbols/min [2025-09-30T22:08:37.074488] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:37.074094] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:37.076228] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39428 primary records. [2025-09-30T22:08:37.076603] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-30T22:08:37.096513] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-30T22:08:37.097312] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-30T22:08:37.097536] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-30T22:08:37.100752] [INFO ] [MAIN ] Derivative Progress: 632/2009 symbols completed. FCF took 1.2s. Estimated remaining: 9m 28s. Rate: 145.5 symbols/min [2025-09-30T22:08:37.100992] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:37.097680] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-30T22:08:37.104058] [INFO ] [MAIN ] Derivative Progress: 633/2009 symbols completed. FCN took 1.2s. Estimated remaining: 9m 27s. Rate: 145.7 symbols/min [2025-09-30T22:08:37.104406] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:37.128802] [DEBUG] [LOCAL ] FCT: Loaded 14501 existing records from primary storage. [2025-09-30T22:08:37.129020] [INFO ] [MAIN ] FCT: Loaded 14501 primary data records. [2025-09-30T22:08:37.258772] [DEBUG] [LOCAL ] FCPT: Loaded 37298 existing records from primary storage. [2025-09-30T22:08:37.279592] [DEBUG] [LOCAL ] FDP: Loaded 30158 existing records from primary storage. [2025-09-30T22:08:37.279946] [INFO ] [MAIN ] FCPT: Loaded 37298 primary data records. [2025-09-30T22:08:37.280098] [INFO ] [MAIN ] FDP: Loaded 30158 primary data records. [2025-09-30T22:08:38.205300] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:38.206942] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14501 primary records. [2025-09-30T22:08:38.207409] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-30T22:08:38.228357] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-30T22:08:38.229547] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-30T22:08:38.251804] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:38.258731] [INFO ] [MAIN ] Derivative Progress: 634/2009 symbols completed. FCT took 1.2s. Estimated remaining: 9m 28s. Rate: 145.3 symbols/min [2025-09-30T22:08:38.259334] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:38.260873] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37298 primary records. [2025-09-30T22:08:38.260996] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-30T22:08:38.261119] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:38.260182] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30158 primary records. [2025-09-30T22:08:38.262440] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-30T22:08:38.295108] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-30T22:08:38.293736] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-30T22:08:38.295292] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-30T22:08:38.298529] [INFO ] [MAIN ] Derivative Progress: 635/2009 symbols completed. FDP took 1.2s. Estimated remaining: 9m 27s. Rate: 145.5 symbols/min [2025-09-30T22:08:38.298888] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:38.298784] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-30T22:08:38.301788] [INFO ] [MAIN ] Derivative Progress: 636/2009 symbols completed. FCPT took 1.2s. Estimated remaining: 9m 25s. Rate: 145.8 symbols/min [2025-09-30T22:08:38.301977] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:38.324111] [DEBUG] [LOCAL ] FDS: Loaded 26508 existing records from primary storage. [2025-09-30T22:08:38.324426] [INFO ] [MAIN ] FDS: Loaded 26508 primary data records. [2025-09-30T22:08:38.748420] [DEBUG] [LOCAL ] FE: Loaded 53429 existing records from primary storage. [2025-09-30T22:08:38.763510] [INFO ] [MAIN ] FE: Loaded 53429 primary data records. [2025-09-30T22:08:38.764351] [DEBUG] [LOCAL ] FDX: Loaded 51595 existing records from primary storage. [2025-09-30T22:08:38.778072] [INFO ] [MAIN ] FDX: Loaded 51595 primary data records. [2025-09-30T22:08:39.450961] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:39.451903] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26508 primary records. [2025-09-30T22:08:39.452122] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-30T22:08:39.471493] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-30T22:08:39.471693] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-30T22:08:39.474565] [INFO ] [MAIN ] Derivative Progress: 637/2009 symbols completed. FDS took 1.2s. Estimated remaining: 9m 26s. Rate: 145.3 symbols/min [2025-09-30T22:08:39.474931] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:39.492535] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:39.493444] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51595 primary records. [2025-09-30T22:08:39.493707] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-30T22:08:39.513272] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-30T22:08:39.513507] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-30T22:08:39.515462] [INFO ] [MAIN ] Derivative Progress: 638/2009 symbols completed. FDX took 1.2s. Estimated remaining: 9m 25s. Rate: 145.5 symbols/min [2025-09-30T22:08:39.515803] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:39.530249] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:39.531454] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53429 primary records. [2025-09-30T22:08:39.531625] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-30T22:08:39.554450] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-09-30T22:08:39.554710] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-30T22:08:39.557390] [INFO ] [MAIN ] Derivative Progress: 639/2009 symbols completed. FE took 1.3s. Estimated remaining: 9m 24s. Rate: 145.7 symbols/min [2025-09-30T22:08:39.557750] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:39.563917] [DEBUG] [LOCAL ] FET: Loaded 12840 existing records from primary storage. [2025-09-30T22:08:39.564201] [INFO ] [MAIN ] FET: Loaded 12840 primary data records. [2025-09-30T22:08:39.750163] [DEBUG] [LOCAL ] FERG: Loaded 48873 existing records from primary storage. [2025-09-30T22:08:39.901079] [INFO ] [MAIN ] FERG: Loaded 48873 primary data records. [2025-09-30T22:08:39.969175] [DEBUG] [LOCAL ] FFWM: Loaded 35772 existing records from primary storage. [2025-09-30T22:08:39.985444] [INFO ] [MAIN ] FFWM: Loaded 35772 primary data records. [2025-09-30T22:08:40.715002] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:40.716520] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12840 primary records. [2025-09-30T22:08:40.716799] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-30T22:08:40.752110] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-30T22:08:40.752421] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-30T22:08:40.755582] [INFO ] [MAIN ] Derivative Progress: 640/2009 symbols completed. FET took 1.2s. Estimated remaining: 9m 25s. Rate: 145.3 symbols/min [2025-09-30T22:08:40.752987] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:40.755923] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:40.757625] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48873 primary records. [2025-09-30T22:08:40.757877] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-30T22:08:40.775270] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-30T22:08:40.775467] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-30T22:08:40.779546] [INFO ] [MAIN ] Derivative Progress: 641/2009 symbols completed. FERG took 1.3s. Estimated remaining: 9m 24s. Rate: 145.5 symbols/min [2025-09-30T22:08:40.780590] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:40.805467] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:40.806443] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35772 primary records. [2025-09-30T22:08:40.807770] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-30T22:08:40.826497] [DEBUG] [LOCAL ] FG: Loaded 22827 existing records from primary storage. [2025-09-30T22:08:40.832712] [INFO ] [MAIN ] FG: Loaded 22827 primary data records. [2025-09-30T22:08:40.834393] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-30T22:08:40.847244] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-30T22:08:40.879108] [INFO ] [MAIN ] Derivative Progress: 642/2009 symbols completed. FFWM took 1.3s. Estimated remaining: 9m 23s. Rate: 145.7 symbols/min [2025-09-30T22:08:40.886048] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:41.172734] [DEBUG] [LOCAL ] FHI: Loaded 40285 existing records from primary storage. [2025-09-30T22:08:41.188783] [INFO ] [MAIN ] FHI: Loaded 40285 primary data records. [2025-09-30T22:08:41.361345] [DEBUG] [LOCAL ] FHN: Loaded 53366 existing records from primary storage. [2025-09-30T22:08:41.398048] [INFO ] [MAIN ] FHN: Loaded 53366 primary data records. [2025-09-30T22:08:41.773975] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:41.786503] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22827 primary records. [2025-09-30T22:08:41.938357] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-30T22:08:41.975574] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-30T22:08:41.976757] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-30T22:08:41.980056] [INFO ] [MAIN ] Derivative Progress: 643/2009 symbols completed. FG took 1.2s. Estimated remaining: 9m 24s. Rate: 145.3 symbols/min [2025-09-30T22:08:41.997177] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:41.998110] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40285 primary records. [2025-09-30T22:08:41.998226] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-30T22:08:42.018828] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-30T22:08:42.019939] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-30T22:08:42.023696] [INFO ] [MAIN ] Derivative Progress: 644/2009 symbols completed. FHI took 1.2s. Estimated remaining: 9m 23s. Rate: 145.5 symbols/min [2025-09-30T22:08:42.040435] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:42.041506] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53366 primary records. [2025-09-30T22:08:42.041586] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-30T22:08:42.059877] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-30T22:08:42.060085] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-30T22:08:42.063182] [INFO ] [MAIN ] Derivative Progress: 645/2009 symbols completed. FHN took 1.2s. Estimated remaining: 9m 22s. Rate: 145.7 symbols/min [2025-09-30T22:08:42.063810] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:42.063910] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:42.064021] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:42.095583] [DEBUG] [LOCAL ] FICO: Loaded 20420 existing records from primary storage. [2025-09-30T22:08:42.106568] [INFO ] [MAIN ] FICO: Loaded 20420 primary data records. [2025-09-30T22:08:42.292575] [DEBUG] [LOCAL ] FIGS: Loaded 48853 existing records from primary storage. [2025-09-30T22:08:42.316286] [INFO ] [MAIN ] FIGS: Loaded 48853 primary data records. [2025-09-30T22:08:42.326942] [DEBUG] [LOCAL ] FI: Loaded 53499 existing records from primary storage. [2025-09-30T22:08:42.363367] [INFO ] [MAIN ] FI: Loaded 53499 primary data records. [2025-09-30T22:08:43.548853] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:43.549770] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20420 primary records. [2025-09-30T22:08:43.549966] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-30T22:08:43.584038] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:43.585529] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48853 primary records. [2025-09-30T22:08:43.597845] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-30T22:08:43.597684] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-30T22:08:43.599181] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:43.600187] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53499 primary records. [2025-09-30T22:08:43.599517] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-30T22:08:43.610299] [INFO ] [MAIN ] Derivative Progress: 646/2009 symbols completed. FICO took 1.5s. Estimated remaining: 9m 24s. Rate: 145.1 symbols/min [2025-09-30T22:08:43.610512] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-30T22:08:43.613532] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:43.632367] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-30T22:08:43.633230] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-30T22:08:43.637748] [INFO ] [MAIN ] Derivative Progress: 647/2009 symbols completed. FIGS took 1.6s. Estimated remaining: 9m 22s. Rate: 145.3 symbols/min [2025-09-30T22:08:43.638205] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:43.640406] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-30T22:08:43.640610] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-30T22:08:43.643571] [INFO ] [MAIN ] Derivative Progress: 648/2009 symbols completed. FI took 1.6s. Estimated remaining: 9m 21s. Rate: 145.5 symbols/min [2025-09-30T22:08:43.643778] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:43.652404] [DEBUG] [LOCAL ] FINS: Loaded 8282 existing records from primary storage. [2025-09-30T22:08:43.652560] [INFO ] [MAIN ] FINS: Loaded 8282 primary data records. [2025-09-30T22:08:43.854222] [DEBUG] [LOCAL ] FIHL: Loaded 39905 existing records from primary storage. [2025-09-30T22:08:43.858592] [INFO ] [MAIN ] FIHL: Loaded 39905 primary data records. [2025-09-30T22:08:44.075381] [DEBUG] [LOCAL ] FINV: Loaded 45240 existing records from primary storage. [2025-09-30T22:08:44.098220] [INFO ] [MAIN ] FINV: Loaded 45240 primary data records. [2025-09-30T22:08:44.688848] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:44.689950] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8282 primary records. [2025-09-30T22:08:44.690520] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-30T22:08:44.710794] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-30T22:08:44.713523] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-30T22:08:44.716731] [INFO ] [MAIN ] Derivative Progress: 649/2009 symbols completed. FINS took 1.1s. Estimated remaining: 9m 22s. Rate: 145.2 symbols/min [2025-09-30T22:08:44.717158] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:44.735627] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:44.736760] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39905 primary records. [2025-09-30T22:08:44.736893] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-30T22:08:44.763728] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:44.769001] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45240 primary records. [2025-09-30T22:08:44.769420] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-30T22:08:44.770631] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-30T22:08:44.770739] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-30T22:08:44.773207] [INFO ] [MAIN ] Derivative Progress: 650/2009 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 21s. Rate: 145.4 symbols/min [2025-09-30T22:08:44.773994] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:44.799064] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-30T22:08:44.799234] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-30T22:08:44.802996] [INFO ] [MAIN ] Derivative Progress: 651/2009 symbols completed. FINV took 1.2s. Estimated remaining: 9m 20s. Rate: 145.6 symbols/min [2025-09-30T22:08:44.817364] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:44.843250] [DEBUG] [LOCAL ] FLC: Loaded 5462 existing records from primary storage. [2025-09-30T22:08:44.858917] [INFO ] [MAIN ] FLC: Loaded 5462 primary data records. [2025-09-30T22:08:44.857413] [DEBUG] [LOCAL ] FIX: Loaded 29896 existing records from primary storage. [2025-09-30T22:08:44.859068] [INFO ] [MAIN ] FIX: Loaded 29896 primary data records. [2025-09-30T22:08:44.962276] [DEBUG] [LOCAL ] FIS: Loaded 53363 existing records from primary storage. [2025-09-30T22:08:45.001994] [INFO ] [MAIN ] FIS: Loaded 53363 primary data records. [2025-09-30T22:08:45.918509] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:08:45.919515] [INFO ] [MAIN ] FIX: Generated 1793 derivative records from 29896 primary records. [2025-09-30T22:08:45.920106] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-30T22:08:45.959305] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:45.961686] [DEBUG] [LOCAL ] FIX: Derivative data saved (1793 records). [2025-09-30T22:08:45.962836] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5462 primary records. [2025-09-30T22:08:45.963144] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-30T22:08:45.976549] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-30T22:08:45.977892] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:45.992784] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53363 primary records. [2025-09-30T22:08:45.994701] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-30T22:08:45.991831] [INFO ] [MAIN ] Derivative Progress: 652/2009 symbols completed. FIX took 1.2s. Estimated remaining: 9m 21s. Rate: 145.2 symbols/min [2025-09-30T22:08:45.995450] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:46.011342] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-30T22:08:46.012171] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-30T22:08:46.015141] [INFO ] [MAIN ] Derivative Progress: 653/2009 symbols completed. FLC took 1.2s. Estimated remaining: 9m 20s. Rate: 145.4 symbols/min [2025-09-30T22:08:46.016348] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:46.019803] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-30T22:08:46.020027] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-30T22:08:46.023129] [INFO ] [MAIN ] Derivative Progress: 654/2009 symbols completed. FIS took 1.3s. Estimated remaining: 9m 18s. Rate: 145.6 symbols/min [2025-09-30T22:08:46.023469] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:46.088530] [DEBUG] [LOCAL ] FLNG: Loaded 33756 existing records from primary storage. [2025-09-30T22:08:46.088803] [INFO ] [MAIN ] FLNG: Loaded 33756 primary data records. [2025-09-30T22:08:46.233128] [DEBUG] [LOCAL ] FLR: Loaded 53116 existing records from primary storage. [2025-09-30T22:08:46.233943] [DEBUG] [LOCAL ] FLG: Loaded 53321 existing records from primary storage. [2025-09-30T22:08:46.239929] [INFO ] [MAIN ] FLG: Loaded 53321 primary data records. [2025-09-30T22:08:46.239836] [INFO ] [MAIN ] FLR: Loaded 53116 primary data records. [2025-09-30T22:08:47.112969] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:47.113878] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33756 primary records. [2025-09-30T22:08:47.114168] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-30T22:08:47.148874] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:47.150230] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53321 primary records. [2025-09-30T22:08:47.151015] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-30T22:08:47.151163] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-30T22:08:47.150952] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-30T22:08:47.160878] [INFO ] [MAIN ] Derivative Progress: 655/2009 symbols completed. FLNG took 1.1s. Estimated remaining: 9m 20s. Rate: 145.2 symbols/min [2025-09-30T22:08:47.166525] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:47.167354] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:08:47.176708] [INFO ] [MAIN ] FLR: Generated 1793 derivative records from 53116 primary records. [2025-09-30T22:08:47.178236] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-30T22:08:47.202246] [DEBUG] [LOCAL ] FLR: Derivative data saved (1793 records). [2025-09-30T22:08:47.202725] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-30T22:08:47.206129] [INFO ] [MAIN ] Derivative Progress: 656/2009 symbols completed. FLR took 1.2s. Estimated remaining: 9m 18s. Rate: 145.4 symbols/min [2025-09-30T22:08:47.206591] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:47.209209] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-30T22:08:47.209335] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-30T22:08:47.212189] [INFO ] [MAIN ] Derivative Progress: 657/2009 symbols completed. FLG took 1.2s. Estimated remaining: 9m 17s. Rate: 145.6 symbols/min [2025-09-30T22:08:47.212383] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:47.234739] [DEBUG] [LOCAL ] FLXR: Loaded 20265 existing records from primary storage. [2025-09-30T22:08:47.245337] [INFO ] [MAIN ] FLXR: Loaded 20265 primary data records. [2025-09-30T22:08:47.385126] [DEBUG] [LOCAL ] FLS: Loaded 50162 existing records from primary storage. [2025-09-30T22:08:47.411514] [INFO ] [MAIN ] FLS: Loaded 50162 primary data records. [2025-09-30T22:08:47.700064] [DEBUG] [LOCAL ] FLUT: Loaded 50769 existing records from primary storage. [2025-09-30T22:08:47.728182] [INFO ] [MAIN ] FLUT: Loaded 50769 primary data records. [2025-09-30T22:08:48.331109] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:48.332167] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20265 primary records. [2025-09-30T22:08:48.332689] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-30T22:08:48.368082] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:48.369571] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50162 primary records. [2025-09-30T22:08:48.370963] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-30T22:08:48.371047] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-30T22:08:48.373418] [INFO ] [MAIN ] Derivative Progress: 658/2009 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 18s. Rate: 145.2 symbols/min [2025-09-30T22:08:48.373872] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-30T22:08:48.394733] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-30T22:08:48.394985] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-30T22:08:48.410343] [INFO ] [MAIN ] Derivative Progress: 659/2009 symbols completed. FLS took 1.2s. Estimated remaining: 9m 17s. Rate: 145.4 symbols/min [2025-09-30T22:08:48.411352] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:48.412059] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50769 primary records. [2025-09-30T22:08:48.412166] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-30T22:08:48.428215] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-30T22:08:48.428310] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-30T22:08:48.431533] [INFO ] [MAIN ] Derivative Progress: 660/2009 symbols completed. FLUT took 1.2s. Estimated remaining: 9m 16s. Rate: 145.6 symbols/min [2025-09-30T22:08:48.432057] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:48.432173] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:48.432319] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:48.443130] [DEBUG] [LOCAL ] FMN: Loaded 5711 existing records from primary storage. [2025-09-30T22:08:48.443347] [INFO ] [MAIN ] FMN: Loaded 5711 primary data records. [2025-09-30T22:08:48.787586] [DEBUG] [LOCAL ] FMS: Loaded 30147 existing records from primary storage. [2025-09-30T22:08:48.803482] [INFO ] [MAIN ] FMS: Loaded 30147 primary data records. [2025-09-30T22:08:48.878693] [DEBUG] [LOCAL ] FMC: Loaded 51779 existing records from primary storage. [2025-09-30T22:08:48.898361] [INFO ] [MAIN ] FMC: Loaded 51779 primary data records. [2025-09-30T22:08:49.583677] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:49.584873] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5711 primary records. [2025-09-30T22:08:49.585379] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-30T22:08:49.611961] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-30T22:08:49.614117] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-30T22:08:49.617547] [INFO ] [MAIN ] Derivative Progress: 661/2009 symbols completed. FMN took 1.2s. Estimated remaining: 9m 17s. Rate: 145.2 symbols/min [2025-09-30T22:08:49.617911] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:49.631923] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:49.632737] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30147 primary records. [2025-09-30T22:08:49.633019] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-30T22:08:49.652461] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-30T22:08:49.653672] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-30T22:08:49.656358] [INFO ] [MAIN ] Derivative Progress: 662/2009 symbols completed. FMS took 1.2s. Estimated remaining: 9m 16s. Rate: 145.4 symbols/min [2025-09-30T22:08:49.656834] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:49.670695] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:49.671668] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51779 primary records. [2025-09-30T22:08:49.671838] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-30T22:08:49.686743] [DEBUG] [LOCAL ] FMY: Loaded 1401 existing records from primary storage. [2025-09-30T22:08:49.687280] [INFO ] [MAIN ] FMY: Loaded 1401 primary data records. [2025-09-30T22:08:49.794406] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-30T22:08:49.814411] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-30T22:08:49.822743] [INFO ] [MAIN ] Derivative Progress: 663/2009 symbols completed. FMC took 1.4s. Estimated remaining: 9m 15s. Rate: 145.5 symbols/min [2025-09-30T22:08:49.833348] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:49.890190] [DEBUG] [LOCAL ] FMX: Loaded 40706 existing records from primary storage. [2025-09-30T22:08:49.916621] [INFO ] [MAIN ] FMX: Loaded 40706 primary data records. [2025-09-30T22:08:50.403069] [DEBUG] [LOCAL ] FN: Loaded 38754 existing records from primary storage. [2025-09-30T22:08:50.404384] [INFO ] [MAIN ] FN: Loaded 38754 primary data records. [2025-09-30T22:08:50.606273] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:50.646341] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1401 primary records. [2025-09-30T22:08:50.771555] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-30T22:08:50.794481] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-09-30T22:08:50.795194] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-30T22:08:50.798389] [INFO ] [MAIN ] Derivative Progress: 664/2009 symbols completed. FMY took 1.1s. Estimated remaining: 9m 16s. Rate: 145.2 symbols/min [2025-09-30T22:08:50.799010] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:50.817901] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:50.818718] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40706 primary records. [2025-09-30T22:08:50.818969] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-30T22:08:50.836452] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-30T22:08:50.837685] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-30T22:08:50.842144] [INFO ] [MAIN ] Derivative Progress: 665/2009 symbols completed. FMX took 1.2s. Estimated remaining: 9m 14s. Rate: 145.4 symbols/min [2025-09-30T22:08:50.842385] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:50.858441] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:50.859224] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38754 primary records. [2025-09-30T22:08:50.859329] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-30T22:08:50.890047] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-30T22:08:50.890237] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-30T22:08:50.893440] [INFO ] [MAIN ] Derivative Progress: 666/2009 symbols completed. FN took 1.1s. Estimated remaining: 9m 13s. Rate: 145.6 symbols/min [2025-09-30T22:08:50.893765] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:50.913057] [DEBUG] [LOCAL ] FNB: Loaded 52455 existing records from primary storage. [2025-09-30T22:08:50.913311] [INFO ] [MAIN ] FNB: Loaded 52455 primary data records. [2025-09-30T22:08:51.290386] [DEBUG] [LOCAL ] FND: Loaded 52101 existing records from primary storage. [2025-09-30T22:08:51.290744] [INFO ] [MAIN ] FND: Loaded 52101 primary data records. [2025-09-30T22:08:51.303191] [DEBUG] [LOCAL ] FNF: Loaded 49101 existing records from primary storage. [2025-09-30T22:08:51.331316] [INFO ] [MAIN ] FNF: Loaded 49101 primary data records. [2025-09-30T22:08:52.015610] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:52.016561] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52455 primary records. [2025-09-30T22:08:52.016793] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-30T22:08:52.036326] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-30T22:08:52.038085] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-30T22:08:52.041579] [INFO ] [MAIN ] Derivative Progress: 667/2009 symbols completed. FNB took 1.2s. Estimated remaining: 9m 14s. Rate: 145.2 symbols/min [2025-09-30T22:08:52.042059] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:52.056912] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:52.057695] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52101 primary records. [2025-09-30T22:08:52.058032] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-30T22:08:52.084540] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-30T22:08:52.089759] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:52.090505] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49101 primary records. [2025-09-30T22:08:52.090589] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-30T22:08:52.091046] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-30T22:08:52.093906] [INFO ] [MAIN ] Derivative Progress: 668/2009 symbols completed. FND took 1.3s. Estimated remaining: 9m 13s. Rate: 145.4 symbols/min [2025-09-30T22:08:52.094410] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:52.115190] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-30T22:08:52.115351] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-30T22:08:52.118018] [INFO ] [MAIN ] Derivative Progress: 669/2009 symbols completed. FNF took 1.2s. Estimated remaining: 9m 12s. Rate: 145.6 symbols/min [2025-09-30T22:08:52.118281] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:52.124769] [DEBUG] [LOCAL ] FOA: Loaded 13156 existing records from primary storage. [2025-09-30T22:08:52.125043] [INFO ] [MAIN ] FOA: Loaded 13156 primary data records. [2025-09-30T22:08:52.252060] [DEBUG] [LOCAL ] FOF: Loaded 8432 existing records from primary storage. [2025-09-30T22:08:52.252352] [INFO ] [MAIN ] FOF: Loaded 8432 primary data records. [2025-09-30T22:08:52.425161] [DEBUG] [LOCAL ] FNV: Loaded 46188 existing records from primary storage. [2025-09-30T22:08:52.582483] [INFO ] [MAIN ] FNV: Loaded 46188 primary data records. [2025-09-30T22:08:53.164037] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:53.165216] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13156 primary records. [2025-09-30T22:08:53.169855] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-30T22:08:53.185171] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:53.193914] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8432 primary records. [2025-09-30T22:08:53.195407] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-30T22:08:53.203153] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-09-30T22:08:53.203569] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-30T22:08:53.205877] [INFO ] [MAIN ] Derivative Progress: 670/2009 symbols completed. FOA took 1.1s. Estimated remaining: 9m 13s. Rate: 145.3 symbols/min [2025-09-30T22:08:53.213031] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:53.223906] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-30T22:08:53.224191] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-30T22:08:53.227020] [INFO ] [MAIN ] Derivative Progress: 671/2009 symbols completed. FOF took 1.1s. Estimated remaining: 9m 12s. Rate: 145.5 symbols/min [2025-09-30T22:08:53.227610] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:53.252157] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:53.252990] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46188 primary records. [2025-09-30T22:08:53.253117] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-30T22:08:53.272671] [DEBUG] [LOCAL ] FOR: Loaded 19856 existing records from primary storage. [2025-09-30T22:08:53.277571] [INFO ] [MAIN ] FOR: Loaded 19856 primary data records. [2025-09-30T22:08:53.277769] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-30T22:08:53.299928] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-30T22:08:53.355622] [INFO ] [MAIN ] Derivative Progress: 672/2009 symbols completed. FNV took 1.3s. Estimated remaining: 9m 11s. Rate: 145.6 symbols/min [2025-09-30T22:08:53.369126] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:53.641775] [DEBUG] [LOCAL ] FOUR: Loaded 49547 existing records from primary storage. [2025-09-30T22:08:53.649589] [DEBUG] [LOCAL ] FPF: Loaded 18101 existing records from primary storage. [2025-09-30T22:08:53.649767] [INFO ] [MAIN ] FPF: Loaded 18101 primary data records. [2025-09-30T22:08:53.655195] [INFO ] [MAIN ] FOUR: Loaded 49547 primary data records. [2025-09-30T22:08:54.487912] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:54.490689] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19856 primary records. [2025-09-30T22:08:54.490900] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-30T22:08:54.512460] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-30T22:08:54.512994] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-30T22:08:54.515337] [INFO ] [MAIN ] Derivative Progress: 673/2009 symbols completed. FOR took 1.3s. Estimated remaining: 9m 12s. Rate: 145.2 symbols/min [2025-09-30T22:08:54.539519] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:54.540445] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18101 primary records. [2025-09-30T22:08:54.540610] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-30T22:08:54.555280] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:54.564073] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49547 primary records. [2025-09-30T22:08:54.568441] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-30T22:08:54.581254] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-30T22:08:54.585416] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-30T22:08:54.588336] [INFO ] [MAIN ] Derivative Progress: 674/2009 symbols completed. FPF took 1.2s. Estimated remaining: 9m 11s. Rate: 145.4 symbols/min [2025-09-30T22:08:54.593163] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-30T22:08:54.593299] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-30T22:08:54.596431] [INFO ] [MAIN ] Derivative Progress: 675/2009 symbols completed. FOUR took 1.4s. Estimated remaining: 9m 10s. Rate: 145.6 symbols/min [2025-09-30T22:08:54.596948] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:54.597069] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:54.597229] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:54.619357] [DEBUG] [LOCAL ] FPH: Loaded 19466 existing records from primary storage. [2025-09-30T22:08:54.619494] [INFO ] [MAIN ] FPH: Loaded 19466 primary data records. [2025-09-30T22:08:54.771576] [DEBUG] [LOCAL ] FPI: Loaded 31004 existing records from primary storage. [2025-09-30T22:08:54.772362] [INFO ] [MAIN ] FPI: Loaded 31004 primary data records. [2025-09-30T22:08:55.119688] [DEBUG] [LOCAL ] FR: Loaded 46417 existing records from primary storage. [2025-09-30T22:08:55.141106] [INFO ] [MAIN ] FR: Loaded 46417 primary data records. [2025-09-30T22:08:55.657294] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:55.658278] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19466 primary records. [2025-09-30T22:08:55.658457] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-30T22:08:55.678029] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-30T22:08:55.679213] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-30T22:08:55.681855] [INFO ] [MAIN ] Derivative Progress: 676/2009 symbols completed. FPH took 1.1s. Estimated remaining: 9m 11s. Rate: 145.3 symbols/min [2025-09-30T22:08:55.696181] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:55.696995] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:55.698029] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31004 primary records. [2025-09-30T22:08:55.698735] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-30T22:08:55.721825] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-30T22:08:55.723072] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-30T22:08:55.725622] [INFO ] [MAIN ] Derivative Progress: 677/2009 symbols completed. FPI took 1.1s. Estimated remaining: 9m 9s. Rate: 145.5 symbols/min [2025-09-30T22:08:55.732181] [DEBUG] [LOCAL ] FRA: Loaded 14539 existing records from primary storage. [2025-09-30T22:08:55.733347] [INFO ] [MAIN ] FRA: Loaded 14539 primary data records. [2025-09-30T22:08:55.733074] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:55.793942] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:55.810600] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46417 primary records. [2025-09-30T22:08:55.810731] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-30T22:08:55.894941] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-30T22:08:55.896138] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-30T22:08:55.899180] [INFO ] [MAIN ] Derivative Progress: 678/2009 symbols completed. FR took 1.3s. Estimated remaining: 9m 9s. Rate: 145.6 symbols/min [2025-09-30T22:08:55.904942] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:55.921141] [DEBUG] [LOCAL ] FRGE: Loaded 17802 existing records from primary storage. [2025-09-30T22:08:55.942085] [INFO ] [MAIN ] FRGE: Loaded 17802 primary data records. [2025-09-30T22:08:56.507757] [DEBUG] [LOCAL ] FRO: Loaded 51794 existing records from primary storage. [2025-09-30T22:08:56.508317] [INFO ] [MAIN ] FRO: Loaded 51794 primary data records. [2025-09-30T22:08:56.555272] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:56.583757] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14539 primary records. [2025-09-30T22:08:56.619416] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-30T22:08:56.888270] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-30T22:08:56.888400] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-30T22:08:56.890565] [INFO ] [MAIN ] Derivative Progress: 679/2009 symbols completed. FRA took 1.2s. Estimated remaining: 9m 9s. Rate: 145.3 symbols/min [2025-09-30T22:08:56.890877] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:56.887042] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:56.892480] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 17802 primary records. [2025-09-30T22:08:56.892819] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-30T22:08:56.918243] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-30T22:08:56.919234] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-30T22:08:56.923845] [INFO ] [MAIN ] Derivative Progress: 680/2009 symbols completed. FRGE took 1.2s. Estimated remaining: 9m 8s. Rate: 145.5 symbols/min [2025-09-30T22:08:56.924576] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:56.948888] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:56.960065] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51794 primary records. [2025-09-30T22:08:56.960393] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-30T22:08:56.977756] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-30T22:08:56.990290] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-30T22:08:56.993258] [INFO ] [MAIN ] Derivative Progress: 681/2009 symbols completed. FRO took 1.1s. Estimated remaining: 9m 7s. Rate: 145.7 symbols/min [2025-09-30T22:08:56.993508] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:56.994233] [DEBUG] [LOCAL ] FRT: Loaded 42039 existing records from primary storage. [2025-09-30T22:08:56.995189] [INFO ] [MAIN ] FRT: Loaded 42039 primary data records. [2025-09-30T22:08:57.155633] [DEBUG] [LOCAL ] FSCO: Loaded 37393 existing records from primary storage. [2025-09-30T22:08:57.156275] [INFO ] [MAIN ] FSCO: Loaded 37393 primary data records. [2025-09-30T22:08:57.566004] [DEBUG] [LOCAL ] FSK: Loaded 49397 existing records from primary storage. [2025-09-30T22:08:57.571802] [INFO ] [MAIN ] FSK: Loaded 49397 primary data records. [2025-09-30T22:08:58.085948] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:58.088159] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42039 primary records. [2025-09-30T22:08:58.088362] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-30T22:08:58.120489] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:58.123775] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 37393 primary records. [2025-09-30T22:08:58.124324] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-30T22:08:58.124117] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-30T22:08:58.125293] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-30T22:08:58.128488] [INFO ] [MAIN ] Derivative Progress: 682/2009 symbols completed. FRT took 1.2s. Estimated remaining: 9m 8s. Rate: 145.3 symbols/min [2025-09-30T22:08:58.137279] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:58.152253] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-30T22:08:58.152584] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-30T22:08:58.155170] [INFO ] [MAIN ] Derivative Progress: 683/2009 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 7s. Rate: 145.5 symbols/min [2025-09-30T22:08:58.155670] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:58.171033] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:58.171880] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49397 primary records. [2025-09-30T22:08:58.171978] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-30T22:08:58.192110] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-30T22:08:58.205485] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-30T22:08:58.208923] [INFO ] [MAIN ] Derivative Progress: 684/2009 symbols completed. FSK took 1.2s. Estimated remaining: 9m 6s. Rate: 145.7 symbols/min [2025-09-30T22:08:58.209251] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:58.245903] [DEBUG] [LOCAL ] FSLY: Loaded 51207 existing records from primary storage. [2025-09-30T22:08:58.246215] [INFO ] [MAIN ] FSLY: Loaded 51207 primary data records. [2025-09-30T22:08:58.385416] [DEBUG] [LOCAL ] FSM: Loaded 53286 existing records from primary storage. [2025-09-30T22:08:58.396420] [INFO ] [MAIN ] FSM: Loaded 53286 primary data records. [2025-09-30T22:08:58.413320] [DEBUG] [LOCAL ] FSS: Loaded 34149 existing records from primary storage. [2025-09-30T22:08:58.418709] [INFO ] [MAIN ] FSS: Loaded 34149 primary data records. [2025-09-30T22:08:59.322817] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:59.323930] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51207 primary records. [2025-09-30T22:08:59.324151] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-30T22:08:59.343613] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-30T22:08:59.344029] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-30T22:08:59.346412] [INFO ] [MAIN ] Derivative Progress: 685/2009 symbols completed. FSLY took 1.2s. Estimated remaining: 9m 7s. Rate: 145.3 symbols/min [2025-09-30T22:08:59.347038] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:59.371429] [DEBUG] [LOCAL ] FT: Loaded 6495 existing records from primary storage. [2025-09-30T22:08:59.371769] [INFO ] [MAIN ] FT: Loaded 6495 primary data records. [2025-09-30T22:08:59.387271] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:59.393500] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34149 primary records. [2025-09-30T22:08:59.400290] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-30T22:08:59.455188] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:08:59.483952] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53286 primary records. [2025-09-30T22:08:59.493509] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-30T22:08:59.535054] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-30T22:08:59.547165] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-30T22:08:59.589111] [INFO ] [MAIN ] Derivative Progress: 686/2009 symbols completed. FSS took 1.4s. Estimated remaining: 9m 6s. Rate: 145.4 symbols/min [2025-09-30T22:08:59.609549] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:59.632867] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-30T22:08:59.633085] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-30T22:08:59.636175] [INFO ] [MAIN ] Derivative Progress: 687/2009 symbols completed. FSM took 1.5s. Estimated remaining: 9m 5s. Rate: 145.6 symbols/min [2025-09-30T22:08:59.748982] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:08:59.771954] [DEBUG] [LOCAL ] FTHY: Loaded 11914 existing records from primary storage. [2025-09-30T22:08:59.772108] [INFO ] [MAIN ] FTHY: Loaded 11914 primary data records. [2025-09-30T22:09:00.132144] [DEBUG] [LOCAL ] FTI: Loaded 53297 existing records from primary storage. [2025-09-30T22:09:00.133109] [INFO ] [MAIN ] FTI: Loaded 53297 primary data records. [2025-09-30T22:09:00.182389] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:00.234125] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6495 primary records. [2025-09-30T22:09:00.265770] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-30T22:09:00.318195] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-30T22:09:00.328888] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-30T22:09:00.347995] [INFO ] [MAIN ] Derivative Progress: 688/2009 symbols completed. FT took 1.0s. Estimated remaining: 9m 5s. Rate: 145.4 symbols/min [2025-09-30T22:09:00.578864] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:00.580483] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11914 primary records. [2025-09-30T22:09:00.580928] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-30T22:09:00.599302] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-30T22:09:00.599463] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-30T22:09:00.602011] [INFO ] [MAIN ] Derivative Progress: 689/2009 symbols completed. FTHY took 1.0s. Estimated remaining: 9m 4s. Rate: 145.5 symbols/min [2025-09-30T22:09:00.620222] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:00.620817] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53297 primary records. [2025-09-30T22:09:00.620879] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-30T22:09:00.636567] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-30T22:09:00.636667] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-30T22:09:00.638869] [INFO ] [MAIN ] Derivative Progress: 690/2009 symbols completed. FTI took 0.9s. Estimated remaining: 9m 3s. Rate: 145.7 symbols/min [2025-09-30T22:09:00.639289] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:00.639405] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:00.639482] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:00.694236] [DEBUG] [LOCAL ] FTS: Loaded 42106 existing records from primary storage. [2025-09-30T22:09:00.694698] [INFO ] [MAIN ] FTS: Loaded 42106 primary data records. [2025-09-30T22:09:00.778206] [DEBUG] [LOCAL ] FTK: Loaded 32180 existing records from primary storage. [2025-09-30T22:09:00.793606] [INFO ] [MAIN ] FTK: Loaded 32180 primary data records. [2025-09-30T22:09:00.908260] [DEBUG] [LOCAL ] FTV: Loaded 52927 existing records from primary storage. [2025-09-30T22:09:00.956474] [INFO ] [MAIN ] FTV: Loaded 52927 primary data records. [2025-09-30T22:09:01.803794] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:01.806762] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42106 primary records. [2025-09-30T22:09:01.807120] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-30T22:09:01.847511] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:01.849331] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32180 primary records. [2025-09-30T22:09:01.849440] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-30T22:09:01.852069] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-30T22:09:01.862737] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-30T22:09:01.865920] [INFO ] [MAIN ] Derivative Progress: 691/2009 symbols completed. FTS took 1.2s. Estimated remaining: 9m 4s. Rate: 145.3 symbols/min [2025-09-30T22:09:01.866244] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:01.878165] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-30T22:09:01.883595] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-30T22:09:01.882379] [DEBUG] [LOCAL ] FTWO: Loaded 1807 existing records from primary storage. [2025-09-30T22:09:01.887711] [INFO ] [MAIN ] FTWO: Loaded 1807 primary data records. [2025-09-30T22:09:01.887387] [INFO ] [MAIN ] Derivative Progress: 692/2009 symbols completed. FTK took 1.2s. Estimated remaining: 9m 3s. Rate: 145.5 symbols/min [2025-09-30T22:09:01.900294] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:01.969190] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:01.985576] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52927 primary records. [2025-09-30T22:09:02.002436] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-30T22:09:02.245394] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-30T22:09:02.246395] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-30T22:09:02.264810] [INFO ] [MAIN ] Derivative Progress: 693/2009 symbols completed. FTV took 1.6s. Estimated remaining: 9m 3s. Rate: 145.5 symbols/min [2025-09-30T22:09:02.266176] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:02.290287] [DEBUG] [LOCAL ] FUBO: Loaded 53697 existing records from primary storage. [2025-09-30T22:09:02.290817] [INFO ] [MAIN ] FUBO: Loaded 53697 primary data records. [2025-09-30T22:09:02.482601] [DEBUG] [LOCAL ] FUL: Loaded 33034 existing records from primary storage. [2025-09-30T22:09:02.492393] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:02.492682] [INFO ] [MAIN ] FUL: Loaded 33034 primary data records. [2025-09-30T22:09:02.525748] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1807 primary records. [2025-09-30T22:09:02.551137] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-30T22:09:02.832707] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-30T22:09:02.841374] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-30T22:09:02.849606] [INFO ] [MAIN ] Derivative Progress: 694/2009 symbols completed. FTWO took 1.0s. Estimated remaining: 9m 3s. Rate: 145.4 symbols/min [2025-09-30T22:09:02.849998] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:03.121438] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:03.123363] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53697 primary records. [2025-09-30T22:09:03.124677] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-30T22:09:03.158915] [DEBUG] [LOCAL ] FUN: Loaded 51596 existing records from primary storage. [2025-09-30T22:09:03.161468] [INFO ] [MAIN ] FUN: Loaded 51596 primary data records. [2025-09-30T22:09:03.163594] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-30T22:09:03.186023] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-30T22:09:03.199614] [INFO ] [MAIN ] Derivative Progress: 695/2009 symbols completed. FUBO took 1.3s. Estimated remaining: 9m 2s. Rate: 145.4 symbols/min [2025-09-30T22:09:03.205073] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:03.248621] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:03.262446] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 33034 primary records. [2025-09-30T22:09:03.262776] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-30T22:09:03.351677] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-30T22:09:03.371094] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-30T22:09:03.381270] [INFO ] [MAIN ] Derivative Progress: 696/2009 symbols completed. FUL took 1.1s. Estimated remaining: 9m 1s. Rate: 145.6 symbols/min [2025-09-30T22:09:03.397352] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:03.535771] [DEBUG] [LOCAL ] FVR: Loaded 21794 existing records from primary storage. [2025-09-30T22:09:03.536354] [INFO ] [MAIN ] FVR: Loaded 21794 primary data records. [2025-09-30T22:09:03.780324] [DEBUG] [LOCAL ] FVRR: Loaded 40051 existing records from primary storage. [2025-09-30T22:09:03.881755] [INFO ] [MAIN ] FVRR: Loaded 40051 primary data records. [2025-09-30T22:09:03.974143] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:04.003684] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51596 primary records. [2025-09-30T22:09:04.016870] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-30T22:09:04.145148] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-30T22:09:04.269031] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-30T22:09:04.271392] [INFO ] [MAIN ] Derivative Progress: 697/2009 symbols completed. FUN took 1.4s. Estimated remaining: 9m 2s. Rate: 145.3 symbols/min [2025-09-30T22:09:04.272037] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:04.298574] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:04.299772] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21794 primary records. [2025-09-30T22:09:04.282053] [DEBUG] [LOCAL ] FXED: Loaded 1236 existing records from primary storage. [2025-09-30T22:09:04.300105] [INFO ] [MAIN ] FXED: Loaded 1236 primary data records. [2025-09-30T22:09:04.305514] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-30T22:09:04.397360] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-09-30T22:09:04.411432] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-30T22:09:04.413926] [INFO ] [MAIN ] Derivative Progress: 698/2009 symbols completed. FVR took 1.2s. Estimated remaining: 9m 1s. Rate: 145.5 symbols/min [2025-09-30T22:09:04.414304] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:04.724057] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:04.724937] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40051 primary records. [2025-09-30T22:09:04.725743] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-30T22:09:04.757514] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-30T22:09:04.757794] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-30T22:09:04.760627] [INFO ] [MAIN ] Derivative Progress: 699/2009 symbols completed. FVRR took 1.4s. Estimated remaining: 9m 0s. Rate: 145.5 symbols/min [2025-09-30T22:09:04.760934] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:04.782464] [DEBUG] [LOCAL ] G: Loaded 49805 existing records from primary storage. [2025-09-30T22:09:04.782916] [INFO ] [MAIN ] G: Loaded 49805 primary data records. [2025-09-30T22:09:04.871450] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:04.882175] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1236 primary records. [2025-09-30T22:09:04.882331] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-30T22:09:04.946596] [DEBUG] [LOCAL ] GAB: Loaded 28043 existing records from primary storage. [2025-09-30T22:09:04.953393] [INFO ] [MAIN ] GAB: Loaded 28043 primary data records. [2025-09-30T22:09:05.089853] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-09-30T22:09:05.225389] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-30T22:09:05.246788] [INFO ] [MAIN ] Derivative Progress: 700/2009 symbols completed. FXED took 1.0s. Estimated remaining: 8m 60s. Rate: 145.4 symbols/min [2025-09-30T22:09:05.247095] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:05.298587] [DEBUG] [LOCAL ] GAM: Loaded 4066 existing records from primary storage. [2025-09-30T22:09:05.314702] [INFO ] [MAIN ] GAM: Loaded 4066 primary data records. [2025-09-30T22:09:05.868817] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:05.869842] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49805 primary records. [2025-09-30T22:09:05.870103] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-30T22:09:05.888758] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-30T22:09:05.889557] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-30T22:09:05.892201] [INFO ] [MAIN ] Derivative Progress: 701/2009 symbols completed. G took 1.5s. Estimated remaining: 9m 0s. Rate: 145.3 symbols/min [2025-09-30T22:09:05.892632] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:05.911953] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:05.912745] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 28043 primary records. [2025-09-30T22:09:05.912859] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-30T22:09:05.932425] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-30T22:09:05.933323] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-30T22:09:05.935548] [INFO ] [MAIN ] Derivative Progress: 702/2009 symbols completed. GAB took 1.2s. Estimated remaining: 8m 59s. Rate: 145.5 symbols/min [2025-09-30T22:09:05.936133] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:05.950821] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:05.951903] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4066 primary records. [2025-09-30T22:09:05.952064] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-30T22:09:05.988870] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-30T22:09:05.989244] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-30T22:09:05.992514] [INFO ] [MAIN ] Derivative Progress: 703/2009 symbols completed. GAM took 0.7s. Estimated remaining: 8m 58s. Rate: 145.7 symbols/min [2025-09-30T22:09:06.001575] [DEBUG] [LOCAL ] GATX: Loaded 18178 existing records from primary storage. [2025-09-30T22:09:06.001760] [INFO ] [MAIN ] GATX: Loaded 18178 primary data records. [2025-09-30T22:09:06.143540] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-30T22:09:06.154038] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-30T22:09:06.684566] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:06.685375] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18178 primary records. [2025-09-30T22:09:06.685456] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-30T22:09:06.715915] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:06.717699] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-30T22:09:06.717029] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-30T22:09:06.717862] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-30T22:09:06.717933] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-30T22:09:06.720038] [INFO ] [MAIN ] Derivative Progress: 704/2009 symbols completed. GATX took 0.8s. Estimated remaining: 8m 58s. Rate: 145.5 symbols/min [2025-09-30T22:09:06.736536] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-30T22:09:06.736681] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-30T22:09:06.739121] [INFO ] [MAIN ] Derivative Progress: 705/2009 symbols completed. GAP took 0.8s. Estimated remaining: 8m 57s. Rate: 145.7 symbols/min [2025-09-30T22:09:06.739617] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:06.739739] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:06.739559] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:06.758089] [DEBUG] [LOCAL ] GBAB: Loaded 13066 existing records from primary storage. [2025-09-30T22:09:06.758306] [INFO ] [MAIN ] GBAB: Loaded 13066 primary data records. [2025-09-30T22:09:06.989139] [DEBUG] [LOCAL ] GBCI: Loaded 40042 existing records from primary storage. [2025-09-30T22:09:06.995813] [DEBUG] [LOCAL ] GBTG: Loaded 40050 existing records from primary storage. [2025-09-30T22:09:07.141423] [INFO ] [MAIN ] GBCI: Loaded 40042 primary data records. [2025-09-30T22:09:07.150841] [INFO ] [MAIN ] GBTG: Loaded 40050 primary data records. [2025-09-30T22:09:07.813490] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:07.814808] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13066 primary records. [2025-09-30T22:09:07.816023] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-30T22:09:07.835597] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-30T22:09:07.836080] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-30T22:09:07.839248] [INFO ] [MAIN ] Derivative Progress: 706/2009 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 58s. Rate: 145.4 symbols/min [2025-09-30T22:09:07.839490] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:07.858702] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:07.872406] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:07.872040] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40042 primary records. [2025-09-30T22:09:07.873084] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40050 primary records. [2025-09-30T22:09:07.873148] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-30T22:09:07.873251] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-30T22:09:07.918061] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-30T22:09:07.918176] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-30T22:09:07.921165] [INFO ] [MAIN ] Derivative Progress: 707/2009 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 57s. Rate: 145.6 symbols/min [2025-09-30T22:09:07.921810] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:07.925181] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-30T22:09:07.925421] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-30T22:09:07.929622] [INFO ] [MAIN ] Derivative Progress: 708/2009 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 56s. Rate: 145.8 symbols/min [2025-09-30T22:09:07.938395] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:07.940679] [DEBUG] [LOCAL ] GBX: Loaded 29176 existing records from primary storage. [2025-09-30T22:09:07.940918] [INFO ] [MAIN ] GBX: Loaded 29176 primary data records. [2025-09-30T22:09:08.297242] [DEBUG] [LOCAL ] GCO: Loaded 24721 existing records from primary storage. [2025-09-30T22:09:08.311498] [INFO ] [MAIN ] GCO: Loaded 24721 primary data records. [2025-09-30T22:09:08.317621] [DEBUG] [LOCAL ] GCI: Loaded 44090 existing records from primary storage. [2025-09-30T22:09:08.336266] [INFO ] [MAIN ] GCI: Loaded 44090 primary data records. [2025-09-30T22:09:09.063970] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:09.065967] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29176 primary records. [2025-09-30T22:09:09.066140] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-30T22:09:09.087850] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-30T22:09:09.088324] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-30T22:09:09.090971] [INFO ] [MAIN ] Derivative Progress: 709/2009 symbols completed. GBX took 1.3s. Estimated remaining: 8m 57s. Rate: 145.4 symbols/min [2025-09-30T22:09:09.091576] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:09.114411] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:09.115452] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24721 primary records. [2025-09-30T22:09:09.133154] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-30T22:09:09.133735] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:09.134986] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44090 primary records. [2025-09-30T22:09:09.135370] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-30T22:09:09.165937] [DEBUG] [LOCAL ] GCTS: Loaded 19897 existing records from primary storage. [2025-09-30T22:09:09.170124] [INFO ] [MAIN ] GCTS: Loaded 19897 primary data records. [2025-09-30T22:09:09.171412] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-30T22:09:09.186950] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-30T22:09:09.207016] [INFO ] [MAIN ] Derivative Progress: 710/2009 symbols completed. GCI took 1.3s. Estimated remaining: 8m 56s. Rate: 145.5 symbols/min [2025-09-30T22:09:09.230692] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:09.282638] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-30T22:09:09.307636] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-30T22:09:09.321413] [INFO ] [MAIN ] Derivative Progress: 711/2009 symbols completed. GCO took 1.4s. Estimated remaining: 8m 55s. Rate: 145.7 symbols/min [2025-09-30T22:09:09.367538] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:09.367373] [DEBUG] [LOCAL ] GCV: Loaded 7318 existing records from primary storage. [2025-09-30T22:09:09.510997] [INFO ] [MAIN ] GCV: Loaded 7318 primary data records. [2025-09-30T22:09:09.929106] [DEBUG] [LOCAL ] GD: Loaded 47170 existing records from primary storage. [2025-09-30T22:09:09.929546] [INFO ] [MAIN ] GD: Loaded 47170 primary data records. [2025-09-30T22:09:10.091178] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:10.111176] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19897 primary records. [2025-09-30T22:09:10.152381] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-30T22:09:10.287974] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-30T22:09:10.289252] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-30T22:09:10.291578] [INFO ] [MAIN ] Derivative Progress: 712/2009 symbols completed. GCTS took 1.2s. Estimated remaining: 8m 55s. Rate: 145.4 symbols/min [2025-09-30T22:09:10.293817] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:10.308347] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:10.309176] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7318 primary records. [2025-09-30T22:09:10.309330] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-30T22:09:10.332726] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-30T22:09:10.333011] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-30T22:09:10.336507] [INFO ] [MAIN ] Derivative Progress: 713/2009 symbols completed. GCV took 1.1s. Estimated remaining: 8m 54s. Rate: 145.6 symbols/min [2025-09-30T22:09:10.337585] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:10.351418] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:10.353306] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47170 primary records. [2025-09-30T22:09:10.353468] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-30T22:09:10.378847] [DEBUG] [LOCAL ] GDIV: Loaded 3635 existing records from primary storage. [2025-09-30T22:09:10.379404] [INFO ] [MAIN ] GDIV: Loaded 3635 primary data records. [2025-09-30T22:09:10.449598] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-30T22:09:10.455683] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-30T22:09:10.465851] [INFO ] [MAIN ] Derivative Progress: 714/2009 symbols completed. GD took 1.1s. Estimated remaining: 8m 53s. Rate: 145.7 symbols/min [2025-09-30T22:09:10.506177] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:10.514069] [DEBUG] [LOCAL ] GDDY: Loaded 49657 existing records from primary storage. [2025-09-30T22:09:10.519462] [INFO ] [MAIN ] GDDY: Loaded 49657 primary data records. [2025-09-30T22:09:10.624097] [DEBUG] [LOCAL ] GDL: Loaded 2563 existing records from primary storage. [2025-09-30T22:09:10.752495] [INFO ] [MAIN ] GDL: Loaded 2563 primary data records. [2025-09-30T22:09:11.477312] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:11.478553] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3635 primary records. [2025-09-30T22:09:11.480486] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-30T22:09:11.500669] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-30T22:09:11.500858] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-30T22:09:11.503063] [INFO ] [MAIN ] Derivative Progress: 715/2009 symbols completed. GDIV took 1.2s. Estimated remaining: 8m 54s. Rate: 145.4 symbols/min [2025-09-30T22:09:11.504254] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:11.537060] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:11.539064] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:11.538785] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49657 primary records. [2025-09-30T22:09:11.543318] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-30T22:09:11.543242] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2563 primary records. [2025-09-30T22:09:11.542454] [DEBUG] [LOCAL ] GDO: Loaded 5980 existing records from primary storage. [2025-09-30T22:09:11.543465] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-30T22:09:11.543585] [INFO ] [MAIN ] GDO: Loaded 5980 primary data records. [2025-09-30T22:09:11.652914] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-09-30T22:09:11.683970] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-30T22:09:11.703173] [INFO ] [MAIN ] Derivative Progress: 716/2009 symbols completed. GDL took 1.2s. Estimated remaining: 8m 53s. Rate: 145.5 symbols/min [2025-09-30T22:09:11.720619] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-30T22:09:11.720941] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-30T22:09:11.720845] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:11.723638] [INFO ] [MAIN ] Derivative Progress: 717/2009 symbols completed. GDDY took 1.4s. Estimated remaining: 8m 52s. Rate: 145.7 symbols/min [2025-09-30T22:09:11.756152] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:11.941062] [DEBUG] [LOCAL ] GDV: Loaded 19538 existing records from primary storage. [2025-09-30T22:09:11.941523] [INFO ] [MAIN ] GDV: Loaded 19538 primary data records. [2025-09-30T22:09:12.085306] [DEBUG] [LOCAL ] GDOT: Loaded 38364 existing records from primary storage. [2025-09-30T22:09:12.091143] [INFO ] [MAIN ] GDOT: Loaded 38364 primary data records. [2025-09-30T22:09:12.141054] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:12.203337] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5980 primary records. [2025-09-30T22:09:12.234995] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-30T22:09:12.651750] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-30T22:09:12.652075] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-30T22:09:12.654621] [INFO ] [MAIN ] Derivative Progress: 718/2009 symbols completed. GDO took 1.2s. Estimated remaining: 8m 53s. Rate: 145.5 symbols/min [2025-09-30T22:09:12.680177] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:12.680886] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19538 primary records. [2025-09-30T22:09:12.680967] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-30T22:09:12.699701] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-30T22:09:12.699850] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-30T22:09:12.702300] [INFO ] [MAIN ] Derivative Progress: 719/2009 symbols completed. GDV took 0.9s. Estimated remaining: 8m 51s. Rate: 145.6 symbols/min [2025-09-30T22:09:12.715970] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:12.716713] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38364 primary records. [2025-09-30T22:09:12.716779] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-30T22:09:12.732472] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-30T22:09:12.732575] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-30T22:09:12.735751] [INFO ] [MAIN ] Derivative Progress: 720/2009 symbols completed. GDOT took 1.0s. Estimated remaining: 8m 50s. Rate: 145.8 symbols/min [2025-09-30T22:09:12.736245] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:12.736179] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:12.736494] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:12.761827] [DEBUG] [LOCAL ] GEF: Loaded 20508 existing records from primary storage. [2025-09-30T22:09:12.762034] [INFO ] [MAIN ] GEF: Loaded 20508 primary data records. [2025-09-30T22:09:12.918925] [DEBUG] [LOCAL ] GEL: Loaded 33317 existing records from primary storage. [2025-09-30T22:09:12.934796] [INFO ] [MAIN ] GEL: Loaded 33317 primary data records. [2025-09-30T22:09:13.225168] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-30T22:09:13.239194] [INFO ] [MAIN ] GE: Loaded 53713 primary data records. [2025-09-30T22:09:13.877923] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:13.878972] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20508 primary records. [2025-09-30T22:09:13.881421] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-30T22:09:13.905941] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-30T22:09:13.906973] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-30T22:09:13.909689] [INFO ] [MAIN ] Derivative Progress: 721/2009 symbols completed. GEF took 1.2s. Estimated remaining: 8m 51s. Rate: 145.4 symbols/min [2025-09-30T22:09:13.909963] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:13.924636] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:13.925483] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 33317 primary records. [2025-09-30T22:09:13.925804] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-30T22:09:13.960118] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:13.961867] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-30T22:09:13.960846] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53713 primary records. [2025-09-30T22:09:13.962114] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-30T22:09:13.962611] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-30T22:09:13.964920] [INFO ] [MAIN ] Derivative Progress: 722/2009 symbols completed. GEL took 1.2s. Estimated remaining: 8m 50s. Rate: 145.6 symbols/min [2025-09-30T22:09:13.965461] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:13.983854] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-30T22:09:13.998052] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-30T22:09:14.000945] [INFO ] [MAIN ] Derivative Progress: 723/2009 symbols completed. GE took 1.3s. Estimated remaining: 8m 49s. Rate: 145.8 symbols/min [2025-09-30T22:09:14.001126] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:14.025140] [DEBUG] [LOCAL ] GENI: Loaded 52925 existing records from primary storage. [2025-09-30T22:09:14.025289] [INFO ] [MAIN ] GENI: Loaded 52925 primary data records. [2025-09-30T22:09:14.276421] [DEBUG] [LOCAL ] GES: Loaded 39447 existing records from primary storage. [2025-09-30T22:09:14.276695] [INFO ] [MAIN ] GES: Loaded 39447 primary data records. [2025-09-30T22:09:14.403465] [DEBUG] [LOCAL ] GEO: Loaded 51949 existing records from primary storage. [2025-09-30T22:09:14.444901] [INFO ] [MAIN ] GEO: Loaded 51949 primary data records. [2025-09-30T22:09:15.099730] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:15.101050] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52925 primary records. [2025-09-30T22:09:15.101174] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-30T22:09:15.121503] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-30T22:09:15.121841] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-30T22:09:15.124303] [INFO ] [MAIN ] Derivative Progress: 724/2009 symbols completed. GENI took 1.2s. Estimated remaining: 8m 50s. Rate: 145.5 symbols/min [2025-09-30T22:09:15.124848] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:15.144274] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:15.146694] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51949 primary records. [2025-09-30T22:09:15.146987] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-30T22:09:15.172103] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:15.173157] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 39447 primary records. [2025-09-30T22:09:15.184367] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-30T22:09:15.187246] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-30T22:09:15.187437] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-30T22:09:15.190202] [INFO ] [MAIN ] Derivative Progress: 725/2009 symbols completed. GEO took 1.2s. Estimated remaining: 8m 49s. Rate: 145.6 symbols/min [2025-09-30T22:09:15.190358] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:15.206615] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-30T22:09:15.207923] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-30T22:09:15.220883] [INFO ] [MAIN ] Derivative Progress: 726/2009 symbols completed. GES took 1.2s. Estimated remaining: 8m 48s. Rate: 145.8 symbols/min [2025-09-30T22:09:15.222916] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:15.224243] [DEBUG] [LOCAL ] GETY: Loaded 35567 existing records from primary storage. [2025-09-30T22:09:15.224515] [INFO ] [MAIN ] GETY: Loaded 35567 primary data records. [2025-09-30T22:09:15.297019] [DEBUG] [LOCAL ] GF: Loaded 2999 existing records from primary storage. [2025-09-30T22:09:15.310385] [INFO ] [MAIN ] GF: Loaded 2999 primary data records. [2025-09-30T22:09:15.950696] [DEBUG] [LOCAL ] GEV: Loaded 53059 existing records from primary storage. [2025-09-30T22:09:15.951566] [INFO ] [MAIN ] GEV: Loaded 53059 primary data records. [2025-09-30T22:09:16.342863] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:16.357196] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35567 primary records. [2025-09-30T22:09:16.358581] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-30T22:09:16.358488] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:16.369702] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2999 primary records. [2025-09-30T22:09:16.379707] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-30T22:09:16.382209] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-30T22:09:16.383237] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-30T22:09:16.391126] [INFO ] [MAIN ] Derivative Progress: 727/2009 symbols completed. GETY took 1.3s. Estimated remaining: 8m 49s. Rate: 145.4 symbols/min [2025-09-30T22:09:16.395826] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:16.400672] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-30T22:09:16.401563] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-30T22:09:16.404803] [INFO ] [MAIN ] Derivative Progress: 728/2009 symbols completed. GF took 1.2s. Estimated remaining: 8m 48s. Rate: 145.6 symbols/min [2025-09-30T22:09:16.405148] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:16.423024] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:16.423778] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53059 primary records. [2025-09-30T22:09:16.423959] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-30T22:09:16.450117] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-30T22:09:16.450272] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-30T22:09:16.452913] [INFO ] [MAIN ] Derivative Progress: 729/2009 symbols completed. GEV took 1.3s. Estimated remaining: 8m 47s. Rate: 145.8 symbols/min [2025-09-30T22:09:16.453214] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:16.465111] [DEBUG] [LOCAL ] GFF: Loaded 30408 existing records from primary storage. [2025-09-30T22:09:16.465332] [INFO ] [MAIN ] GFF: Loaded 30408 primary data records. [2025-09-30T22:09:16.663293] [DEBUG] [LOCAL ] GFI: Loaded 53102 existing records from primary storage. [2025-09-30T22:09:16.678069] [INFO ] [MAIN ] GFI: Loaded 53102 primary data records. [2025-09-30T22:09:16.932844] [DEBUG] [LOCAL ] GFL: Loaded 47943 existing records from primary storage. [2025-09-30T22:09:16.957772] [INFO ] [MAIN ] GFL: Loaded 47943 primary data records. [2025-09-30T22:09:17.594494] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:17.596151] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30408 primary records. [2025-09-30T22:09:17.596491] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-30T22:09:17.621202] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-30T22:09:17.621994] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-30T22:09:17.624609] [INFO ] [MAIN ] Derivative Progress: 730/2009 symbols completed. GFF took 1.2s. Estimated remaining: 8m 48s. Rate: 145.4 symbols/min [2025-09-30T22:09:17.641749] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:17.643131] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:17.644099] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53102 primary records. [2025-09-30T22:09:17.644279] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-30T22:09:17.681371] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:17.682786] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-30T22:09:17.681607] [DEBUG] [LOCAL ] GFR: Loaded 8366 existing records from primary storage. [2025-09-30T22:09:17.682889] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-30T22:09:17.685446] [INFO ] [MAIN ] Derivative Progress: 731/2009 symbols completed. GFI took 1.3s. Estimated remaining: 8m 47s. Rate: 145.6 symbols/min [2025-09-30T22:09:17.682996] [INFO ] [MAIN ] GFR: Loaded 8366 primary data records. [2025-09-30T22:09:17.686575] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47943 primary records. [2025-09-30T22:09:17.686743] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-30T22:09:17.685621] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:18.023516] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-30T22:09:18.024326] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-30T22:09:18.027072] [INFO ] [MAIN ] Derivative Progress: 732/2009 symbols completed. GFL took 1.6s. Estimated remaining: 8m 46s. Rate: 145.7 symbols/min [2025-09-30T22:09:18.041284] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:18.072534] [DEBUG] [LOCAL ] GGB: Loaded 51085 existing records from primary storage. [2025-09-30T22:09:18.073049] [INFO ] [MAIN ] GGB: Loaded 51085 primary data records. [2025-09-30T22:09:18.143095] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:18.177163] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8366 primary records. [2025-09-30T22:09:18.188446] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-30T22:09:18.250758] [DEBUG] [LOCAL ] GGG: Loaded 40945 existing records from primary storage. [2025-09-30T22:09:18.275204] [INFO ] [MAIN ] GGG: Loaded 40945 primary data records. [2025-09-30T22:09:18.538251] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-30T22:09:18.559677] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-30T22:09:18.566920] [INFO ] [MAIN ] Derivative Progress: 733/2009 symbols completed. GFR took 0.9s. Estimated remaining: 8m 46s. Rate: 145.6 symbols/min [2025-09-30T22:09:18.799452] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:18.800551] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51085 primary records. [2025-09-30T22:09:18.800773] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-30T22:09:18.822237] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-30T22:09:18.822407] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-30T22:09:18.836783] [INFO ] [MAIN ] Derivative Progress: 734/2009 symbols completed. GGB took 1.2s. Estimated remaining: 8m 45s. Rate: 145.7 symbols/min [2025-09-30T22:09:18.837584] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:18.838430] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40945 primary records. [2025-09-30T22:09:18.838613] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-30T22:09:18.854233] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-30T22:09:18.854296] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-30T22:09:18.859556] [INFO ] [MAIN ] Derivative Progress: 735/2009 symbols completed. GGG took 0.8s. Estimated remaining: 8m 44s. Rate: 145.8 symbols/min [2025-09-30T22:09:18.860211] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:18.860150] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:18.860381] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:18.866303] [DEBUG] [LOCAL ] GHC: Loaded 2667 existing records from primary storage. [2025-09-30T22:09:18.867222] [INFO ] [MAIN ] GHC: Loaded 2667 primary data records. [2025-09-30T22:09:18.911824] [DEBUG] [LOCAL ] GGZ: Loaded 2407 existing records from primary storage. [2025-09-30T22:09:18.942368] [INFO ] [MAIN ] GGZ: Loaded 2407 primary data records. [2025-09-30T22:09:19.041980] [DEBUG] [LOCAL ] GGT: Loaded 14105 existing records from primary storage. [2025-09-30T22:09:19.083343] [INFO ] [MAIN ] GGT: Loaded 14105 primary data records. [2025-09-30T22:09:19.939065] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:19.939451] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:09:19.940742] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2407 primary records. [2025-09-30T22:09:19.941868] [INFO ] [MAIN ] GHC: Generated 1792 derivative records from 2667 primary records. [2025-09-30T22:09:19.941063] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-30T22:09:19.941981] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-30T22:09:19.970255] [DEBUG] [LOCAL ] GHC: Derivative data saved (1792 records). [2025-09-30T22:09:19.970892] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-30T22:09:19.974467] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-30T22:09:19.976918] [INFO ] [MAIN ] Derivative Progress: 736/2009 symbols completed. GHC took 1.1s. Estimated remaining: 8m 45s. Rate: 145.5 symbols/min [2025-09-30T22:09:19.977321] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:19.977599] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-30T22:09:19.993987] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:19.993272] [INFO ] [MAIN ] Derivative Progress: 737/2009 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 44s. Rate: 145.7 symbols/min [2025-09-30T22:09:19.994950] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14105 primary records. [2025-09-30T22:09:19.995106] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:19.995248] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-30T22:09:20.013306] [DEBUG] [LOCAL ] GHG: Loaded 3182 existing records from primary storage. [2025-09-30T22:09:20.019232] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-09-30T22:09:20.019468] [INFO ] [MAIN ] GHG: Loaded 3182 primary data records. [2025-09-30T22:09:20.019413] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-30T22:09:20.037080] [INFO ] [MAIN ] Derivative Progress: 738/2009 symbols completed. GGT took 1.2s. Estimated remaining: 8m 43s. Rate: 145.9 symbols/min [2025-09-30T22:09:20.075242] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:20.079174] [DEBUG] [LOCAL ] GHI: Loaded 7001 existing records from primary storage. [2025-09-30T22:09:20.096740] [INFO ] [MAIN ] GHI: Loaded 7001 primary data records. [2025-09-30T22:09:20.258573] [DEBUG] [LOCAL ] GHLD: Loaded 4166 existing records from primary storage. [2025-09-30T22:09:20.318819] [INFO ] [MAIN ] GHLD: Loaded 4166 primary data records. [2025-09-30T22:09:21.051062] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:09:21.052336] [INFO ] [MAIN ] GHG: Generated 1792 derivative records from 3182 primary records. [2025-09-30T22:09:21.052556] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-30T22:09:21.067488] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:21.079324] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7001 primary records. [2025-09-30T22:09:21.081351] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-30T22:09:21.085335] [DEBUG] [LOCAL ] GHG: Derivative data saved (1792 records). [2025-09-30T22:09:21.086699] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-30T22:09:21.089865] [INFO ] [MAIN ] Derivative Progress: 739/2009 symbols completed. GHG took 1.1s. Estimated remaining: 8m 43s. Rate: 145.6 symbols/min [2025-09-30T22:09:21.090028] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:21.119842] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:21.121762] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4166 primary records. [2025-09-30T22:09:21.121673] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-30T22:09:21.125943] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-30T22:09:21.121928] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-30T22:09:21.129632] [INFO ] [MAIN ] Derivative Progress: 740/2009 symbols completed. GHI took 1.1s. Estimated remaining: 8m 42s. Rate: 145.7 symbols/min [2025-09-30T22:09:21.135983] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:21.151095] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-30T22:09:21.151272] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-30T22:09:21.151609] [DEBUG] [LOCAL ] GHM: Loaded 14041 existing records from primary storage. [2025-09-30T22:09:21.155298] [INFO ] [MAIN ] Derivative Progress: 741/2009 symbols completed. GHLD took 1.1s. Estimated remaining: 8m 41s. Rate: 145.9 symbols/min [2025-09-30T22:09:21.155694] [INFO ] [MAIN ] GHM: Loaded 14041 primary data records. [2025-09-30T22:09:21.155972] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:21.322620] [DEBUG] [LOCAL ] GHY: Loaded 20887 existing records from primary storage. [2025-09-30T22:09:21.335845] [INFO ] [MAIN ] GHY: Loaded 20887 primary data records. [2025-09-30T22:09:21.634799] [DEBUG] [LOCAL ] GIB: Loaded 32041 existing records from primary storage. [2025-09-30T22:09:21.646482] [INFO ] [MAIN ] GIB: Loaded 32041 primary data records. [2025-09-30T22:09:22.228285] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:22.230184] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14041 primary records. [2025-09-30T22:09:22.231040] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-30T22:09:22.251592] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-30T22:09:22.255132] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-30T22:09:22.257796] [INFO ] [MAIN ] Derivative Progress: 742/2009 symbols completed. GHM took 1.2s. Estimated remaining: 8m 42s. Rate: 145.6 symbols/min [2025-09-30T22:09:22.258102] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:22.273180] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:22.273969] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20887 primary records. [2025-09-30T22:09:22.274286] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-30T22:09:22.291239] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-30T22:09:22.293832] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-30T22:09:22.296549] [INFO ] [MAIN ] Derivative Progress: 743/2009 symbols completed. GHY took 1.2s. Estimated remaining: 8m 41s. Rate: 145.8 symbols/min [2025-09-30T22:09:22.296968] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:22.312796] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:22.313875] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32041 primary records. [2025-09-30T22:09:22.314135] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-30T22:09:22.341801] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-30T22:09:22.342026] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-30T22:09:22.344934] [INFO ] [MAIN ] Derivative Progress: 744/2009 symbols completed. GIB took 1.2s. Estimated remaining: 8m 40s. Rate: 145.9 symbols/min [2025-09-30T22:09:22.345331] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:22.362398] [DEBUG] [LOCAL ] GIL: Loaded 43330 existing records from primary storage. [2025-09-30T22:09:22.362609] [INFO ] [MAIN ] GIL: Loaded 43330 primary data records. [2025-09-30T22:09:22.740060] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-09-30T22:09:22.740317] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-09-30T22:09:22.741968] [DEBUG] [LOCAL ] GKOS: Loaded 42680 existing records from primary storage. [2025-09-30T22:09:22.742113] [INFO ] [MAIN ] GKOS: Loaded 42680 primary data records. [2025-09-30T22:09:23.421032] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:23.422448] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43330 primary records. [2025-09-30T22:09:23.422813] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-30T22:09:23.442525] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-30T22:09:23.442962] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-30T22:09:23.446106] [INFO ] [MAIN ] Derivative Progress: 745/2009 symbols completed. GIL took 1.2s. Estimated remaining: 8m 41s. Rate: 145.6 symbols/min [2025-09-30T22:09:23.446399] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:23.467431] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:23.468382] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-09-30T22:09:23.481224] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-30T22:09:23.482058] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:23.483344] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42680 primary records. [2025-09-30T22:09:23.491181] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-30T22:09:23.524852] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-30T22:09:23.525291] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-30T22:09:23.528169] [INFO ] [MAIN ] Derivative Progress: 746/2009 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 40s. Rate: 145.8 symbols/min [2025-09-30T22:09:23.529539] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-30T22:09:23.529731] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:23.529941] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-30T22:09:23.531950] [INFO ] [MAIN ] Derivative Progress: 747/2009 symbols completed. GIS took 1.2s. Estimated remaining: 8m 39s. Rate: 146.0 symbols/min [2025-09-30T22:09:23.532458] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:23.546227] [DEBUG] [LOCAL ] GL: Loaded 37779 existing records from primary storage. [2025-09-30T22:09:23.546519] [INFO ] [MAIN ] GL: Loaded 37779 primary data records. [2025-09-30T22:09:23.619480] [DEBUG] [LOCAL ] GLP: Loaded 9370 existing records from primary storage. [2025-09-30T22:09:23.649262] [INFO ] [MAIN ] GLP: Loaded 9370 primary data records. [2025-09-30T22:09:24.258682] [DEBUG] [LOCAL ] GLOB: Loaded 47516 existing records from primary storage. [2025-09-30T22:09:24.269284] [INFO ] [MAIN ] GLOB: Loaded 47516 primary data records. [2025-09-30T22:09:24.632837] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:24.634252] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37779 primary records. [2025-09-30T22:09:24.634722] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-30T22:09:24.656776] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-30T22:09:24.657153] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-30T22:09:24.660180] [INFO ] [MAIN ] Derivative Progress: 748/2009 symbols completed. GL took 1.2s. Estimated remaining: 8m 40s. Rate: 145.6 symbols/min [2025-09-30T22:09:24.674674] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:24.675701] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9370 primary records. [2025-09-30T22:09:24.675768] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-30T22:09:24.695069] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-30T22:09:24.696288] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-30T22:09:24.700959] [INFO ] [MAIN ] Derivative Progress: 749/2009 symbols completed. GLP took 1.2s. Estimated remaining: 8m 38s. Rate: 145.8 symbols/min [2025-09-30T22:09:24.714982] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:24.715768] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47516 primary records. [2025-09-30T22:09:24.715836] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-30T22:09:24.731779] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-30T22:09:24.731849] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-30T22:09:24.734735] [INFO ] [MAIN ] Derivative Progress: 750/2009 symbols completed. GLOB took 1.2s. Estimated remaining: 8m 37s. Rate: 146.0 symbols/min [2025-09-30T22:09:24.735284] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:24.735232] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:24.735479] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:24.817296] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-30T22:09:24.817630] [INFO ] [MAIN ] GME: Loaded 53762 primary data records. [2025-09-30T22:09:24.962944] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-30T22:09:24.963974] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-30T22:09:24.963847] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-30T22:09:24.996071] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-30T22:09:25.853415] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:25.859607] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:25.860856] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53762 primary records. [2025-09-30T22:09:25.862107] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-30T22:09:25.863444] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-30T22:09:25.864948] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-30T22:09:25.905124] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-30T22:09:25.907030] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:25.916180] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-30T22:09:25.910312] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-30T22:09:25.920148] [INFO ] [MAIN ] Derivative Progress: 751/2009 symbols completed. GLW took 1.2s. Estimated remaining: 8m 38s. Rate: 145.6 symbols/min [2025-09-30T22:09:25.920245] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-30T22:09:25.915197] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-30T22:09:25.920454] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:25.921540] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-30T22:09:25.923424] [INFO ] [MAIN ] Derivative Progress: 752/2009 symbols completed. GME took 1.2s. Estimated remaining: 8m 37s. Rate: 145.8 symbols/min [2025-09-30T22:09:25.923782] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:25.942263] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-30T22:09:25.942486] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-30T22:09:25.946491] [INFO ] [MAIN ] Derivative Progress: 753/2009 symbols completed. GM took 1.2s. Estimated remaining: 8m 36s. Rate: 146.0 symbols/min [2025-09-30T22:09:25.946796] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:26.000256] [DEBUG] [LOCAL ] GNE: Loaded 17787 existing records from primary storage. [2025-09-30T22:09:26.001084] [DEBUG] [LOCAL ] GMRE: Loaded 37497 existing records from primary storage. [2025-09-30T22:09:26.001501] [INFO ] [MAIN ] GMRE: Loaded 37497 primary data records. [2025-09-30T22:09:26.001200] [INFO ] [MAIN ] GNE: Loaded 17787 primary data records. [2025-09-30T22:09:26.175156] [DEBUG] [LOCAL ] GMED: Loaded 48335 existing records from primary storage. [2025-09-30T22:09:26.228460] [INFO ] [MAIN ] GMED: Loaded 48335 primary data records. [2025-09-30T22:09:27.056882] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:27.058249] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17787 primary records. [2025-09-30T22:09:27.058454] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-30T22:09:27.072728] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:27.080926] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37497 primary records. [2025-09-30T22:09:27.081133] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-30T22:09:27.106044] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-30T22:09:27.109809] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-30T22:09:27.109547] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-30T22:09:27.111896] [INFO ] [MAIN ] Derivative Progress: 754/2009 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 37s. Rate: 145.6 symbols/min [2025-09-30T22:09:27.120184] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-30T22:09:27.123126] [INFO ] [MAIN ] Derivative Progress: 755/2009 symbols completed. GNE took 1.2s. Estimated remaining: 8m 36s. Rate: 145.8 symbols/min [2025-09-30T22:09:27.129618] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:27.130234] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:27.122870] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:27.131915] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48335 primary records. [2025-09-30T22:09:27.132120] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-30T22:09:27.151203] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-30T22:09:27.151549] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-30T22:09:27.154814] [INFO ] [MAIN ] Derivative Progress: 756/2009 symbols completed. GMED took 1.2s. Estimated remaining: 8m 35s. Rate: 146.0 symbols/min [2025-09-30T22:09:27.155128] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:27.206975] [DEBUG] [LOCAL ] GNL: Loaded 46875 existing records from primary storage. [2025-09-30T22:09:27.207167] [INFO ] [MAIN ] GNL: Loaded 46875 primary data records. [2025-09-30T22:09:27.365695] [DEBUG] [LOCAL ] GNK: Loaded 40237 existing records from primary storage. [2025-09-30T22:09:27.381490] [INFO ] [MAIN ] GNK: Loaded 40237 primary data records. [2025-09-30T22:09:27.387696] [DEBUG] [LOCAL ] GNRC: Loaded 45193 existing records from primary storage. [2025-09-30T22:09:27.408214] [INFO ] [MAIN ] GNRC: Loaded 45193 primary data records. [2025-09-30T22:09:28.315759] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:28.317486] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46875 primary records. [2025-09-30T22:09:28.333708] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-30T22:09:28.334398] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:28.337715] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40237 primary records. [2025-09-30T22:09:28.337866] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-30T22:09:28.371373] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-30T22:09:28.372422] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-30T22:09:28.374881] [INFO ] [MAIN ] Derivative Progress: 757/2009 symbols completed. GNL took 1.2s. Estimated remaining: 8m 36s. Rate: 145.6 symbols/min [2025-09-30T22:09:28.379148] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:28.388377] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-30T22:09:28.388480] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-30T22:09:28.406758] [INFO ] [MAIN ] Derivative Progress: 758/2009 symbols completed. GNK took 1.3s. Estimated remaining: 8m 35s. Rate: 145.8 symbols/min [2025-09-30T22:09:28.406954] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:28.413912] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:28.420301] [DEBUG] [LOCAL ] GNT: Loaded 8082 existing records from primary storage. [2025-09-30T22:09:28.419763] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45193 primary records. [2025-09-30T22:09:28.420784] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-30T22:09:28.423755] [INFO ] [MAIN ] GNT: Loaded 8082 primary data records. [2025-09-30T22:09:28.472557] [DEBUG] [LOCAL ] GNTY: Loaded 7330 existing records from primary storage. [2025-09-30T22:09:28.491037] [INFO ] [MAIN ] GNTY: Loaded 7330 primary data records. [2025-09-30T22:09:28.493509] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-30T22:09:28.515559] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-30T22:09:28.573830] [INFO ] [MAIN ] Derivative Progress: 759/2009 symbols completed. GNRC took 1.4s. Estimated remaining: 8m 34s. Rate: 145.9 symbols/min [2025-09-30T22:09:28.613112] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:29.179087] [DEBUG] [LOCAL ] GNW: Loaded 51327 existing records from primary storage. [2025-09-30T22:09:29.180729] [INFO ] [MAIN ] GNW: Loaded 51327 primary data records. [2025-09-30T22:09:29.274375] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:29.298139] [INFO ] [MAIN ] GNTY: Generated 1794 derivative records from 7330 primary records. [2025-09-30T22:09:29.315108] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-30T22:09:29.364396] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:29.398183] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8082 primary records. [2025-09-30T22:09:29.428350] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-30T22:09:29.428228] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1794 records). [2025-09-30T22:09:29.436839] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-30T22:09:29.550839] [INFO ] [MAIN ] Derivative Progress: 760/2009 symbols completed. GNTY took 1.1s. Estimated remaining: 8m 34s. Rate: 145.7 symbols/min [2025-09-30T22:09:29.565145] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:29.575355] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-30T22:09:29.575460] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-30T22:09:29.578678] [INFO ] [MAIN ] Derivative Progress: 761/2009 symbols completed. GNT took 1.2s. Estimated remaining: 8m 33s. Rate: 145.8 symbols/min [2025-09-30T22:09:29.579792] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:29.637431] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:29.638778] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51327 primary records. [2025-09-30T22:09:29.638896] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-30T22:09:29.679095] [DEBUG] [LOCAL ] GOF: Loaded 42604 existing records from primary storage. [2025-09-30T22:09:29.680123] [INFO ] [MAIN ] GOF: Loaded 42604 primary data records. [2025-09-30T22:09:29.680960] [DEBUG] [LOCAL ] GOLF: Loaded 31236 existing records from primary storage. [2025-09-30T22:09:29.681621] [INFO ] [MAIN ] GOLF: Loaded 31236 primary data records. [2025-09-30T22:09:29.684880] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-30T22:09:29.749165] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-30T22:09:29.778144] [INFO ] [MAIN ] Derivative Progress: 762/2009 symbols completed. GNW took 1.2s. Estimated remaining: 8m 33s. Rate: 145.9 symbols/min [2025-09-30T22:09:29.826863] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:30.442500] [DEBUG] [LOCAL ] GOOS: Loaded 45062 existing records from primary storage. [2025-09-30T22:09:30.443433] [INFO ] [MAIN ] GOOS: Loaded 45062 primary data records. [2025-09-30T22:09:30.795148] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:30.798796] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31236 primary records. [2025-09-30T22:09:30.799229] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-30T22:09:30.827214] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:30.829723] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42604 primary records. [2025-09-30T22:09:30.830245] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-30T22:09:30.833578] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-30T22:09:30.834187] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-30T22:09:30.836870] [INFO ] [MAIN ] Derivative Progress: 763/2009 symbols completed. GOLF took 1.3s. Estimated remaining: 8m 33s. Rate: 145.6 symbols/min [2025-09-30T22:09:30.854741] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-30T22:09:30.855020] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-30T22:09:30.858541] [INFO ] [MAIN ] Derivative Progress: 764/2009 symbols completed. GOF took 1.3s. Estimated remaining: 8m 32s. Rate: 145.8 symbols/min [2025-09-30T22:09:30.876951] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:30.877587] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45062 primary records. [2025-09-30T22:09:30.877676] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-30T22:09:30.895727] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-30T22:09:30.895914] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-30T22:09:30.898766] [INFO ] [MAIN ] Derivative Progress: 765/2009 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 31s. Rate: 146.0 symbols/min [2025-09-30T22:09:30.899429] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:30.899616] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:30.899377] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:30.919410] [DEBUG] [LOCAL ] GPI: Loaded 14682 existing records from primary storage. [2025-09-30T22:09:30.919623] [INFO ] [MAIN ] GPI: Loaded 14682 primary data records. [2025-09-30T22:09:31.259766] [DEBUG] [LOCAL ] GOTU: Loaded 38557 existing records from primary storage. [2025-09-30T22:09:31.292516] [INFO ] [MAIN ] GOTU: Loaded 38557 primary data records. [2025-09-30T22:09:31.283172] [DEBUG] [LOCAL ] GPC: Loaded 46398 existing records from primary storage. [2025-09-30T22:09:31.292956] [INFO ] [MAIN ] GPC: Loaded 46398 primary data records. [2025-09-30T22:09:31.958177] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:31.960528] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14682 primary records. [2025-09-30T22:09:31.961288] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-30T22:09:31.985836] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-09-30T22:09:31.986123] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-30T22:09:31.989582] [INFO ] [MAIN ] Derivative Progress: 766/2009 symbols completed. GPI took 1.1s. Estimated remaining: 8m 32s. Rate: 145.7 symbols/min [2025-09-30T22:09:31.992783] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:32.008700] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:32.010570] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46398 primary records. [2025-09-30T22:09:32.010912] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-30T22:09:32.026732] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:32.027905] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 38557 primary records. [2025-09-30T22:09:32.031673] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-30T22:09:32.040013] [DEBUG] [LOCAL ] GPJA: Loaded 4219 existing records from primary storage. [2025-09-30T22:09:32.041837] [INFO ] [MAIN ] GPJA: Loaded 4219 primary data records. [2025-09-30T22:09:32.120689] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-30T22:09:32.144890] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-30T22:09:32.154695] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-30T22:09:32.162954] [INFO ] [MAIN ] Derivative Progress: 767/2009 symbols completed. GOTU took 1.3s. Estimated remaining: 8m 31s. Rate: 145.8 symbols/min [2025-09-30T22:09:32.168267] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-30T22:09:32.193506] [INFO ] [MAIN ] Derivative Progress: 768/2009 symbols completed. GPC took 1.3s. Estimated remaining: 8m 30s. Rate: 146.0 symbols/min [2025-09-30T22:09:32.194108] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:32.190842] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:32.421009] [DEBUG] [LOCAL ] GPMT: Loaded 26222 existing records from primary storage. [2025-09-30T22:09:32.421447] [INFO ] [MAIN ] GPMT: Loaded 26222 primary data records. [2025-09-30T22:09:32.825306] [DEBUG] [LOCAL ] GPK: Loaded 52664 existing records from primary storage. [2025-09-30T22:09:32.826860] [INFO ] [MAIN ] GPK: Loaded 52664 primary data records. [2025-09-30T22:09:32.885160] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:32.893728] [INFO ] [MAIN ] GPJA: Generated 1793 derivative records from 4219 primary records. [2025-09-30T22:09:32.899532] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-30T22:09:32.972236] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1793 records). [2025-09-30T22:09:32.976156] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-30T22:09:32.978795] [INFO ] [MAIN ] Derivative Progress: 769/2009 symbols completed. GPJA took 1.0s. Estimated remaining: 8m 30s. Rate: 145.8 symbols/min [2025-09-30T22:09:32.979280] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:33.229875] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:33.232241] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26222 primary records. [2025-09-30T22:09:33.232949] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-30T22:09:33.268175] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-30T22:09:33.268343] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-30T22:09:33.270864] [INFO ] [MAIN ] Derivative Progress: 770/2009 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 30s. Rate: 145.8 symbols/min [2025-09-30T22:09:33.272429] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:33.290946] [DEBUG] [LOCAL ] GPN: Loaded 52050 existing records from primary storage. [2025-09-30T22:09:33.291840] [INFO ] [MAIN ] GPN: Loaded 52050 primary data records. [2025-09-30T22:09:33.485272] [DEBUG] [LOCAL ] GPOR: Loaded 23091 existing records from primary storage. [2025-09-30T22:09:33.648888] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:33.650701] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52664 primary records. [2025-09-30T22:09:33.649071] [INFO ] [MAIN ] GPOR: Loaded 23091 primary data records. [2025-09-30T22:09:33.650987] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-30T22:09:33.776422] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-30T22:09:33.783920] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-30T22:09:33.787124] [INFO ] [MAIN ] Derivative Progress: 771/2009 symbols completed. GPK took 1.6s. Estimated remaining: 8m 29s. Rate: 145.8 symbols/min [2025-09-30T22:09:33.818496] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:34.066807] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:34.067994] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52050 primary records. [2025-09-30T22:09:34.068203] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-30T22:09:34.104897] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-30T22:09:34.105359] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-30T22:09:34.110200] [DEBUG] [LOCAL ] GPRK: Loaded 39299 existing records from primary storage. [2025-09-30T22:09:34.108721] [INFO ] [MAIN ] Derivative Progress: 772/2009 symbols completed. GPN took 1.1s. Estimated remaining: 8m 29s. Rate: 145.8 symbols/min [2025-09-30T22:09:34.111789] [INFO ] [MAIN ] GPRK: Loaded 39299 primary data records. [2025-09-30T22:09:34.111604] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:34.521192] [DEBUG] [LOCAL ] GRBK: Loaded 26887 existing records from primary storage. [2025-09-30T22:09:34.523192] [INFO ] [MAIN ] GRBK: Loaded 26887 primary data records. [2025-09-30T22:09:34.583361] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:34.603013] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23091 primary records. [2025-09-30T22:09:34.626703] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-30T22:09:34.764974] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-30T22:09:34.765224] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-30T22:09:34.771589] [INFO ] [MAIN ] Derivative Progress: 773/2009 symbols completed. GPOR took 1.5s. Estimated remaining: 8m 29s. Rate: 145.7 symbols/min [2025-09-30T22:09:34.806146] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:34.805424] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:34.820494] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39299 primary records. [2025-09-30T22:09:34.834367] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-30T22:09:35.108075] [DEBUG] [LOCAL ] GRC: Loaded 8931 existing records from primary storage. [2025-09-30T22:09:35.206869] [INFO ] [MAIN ] GRC: Loaded 8931 primary data records. [2025-09-30T22:09:35.231337] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-30T22:09:35.259151] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-30T22:09:35.286553] [INFO ] [MAIN ] Derivative Progress: 774/2009 symbols completed. GPRK took 1.5s. Estimated remaining: 8m 29s. Rate: 145.7 symbols/min [2025-09-30T22:09:35.298544] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:35.480234] [DEBUG] [LOCAL ] GRDN: Loaded 20313 existing records from primary storage. [2025-09-30T22:09:35.598383] [INFO ] [MAIN ] GRDN: Loaded 20313 primary data records. [2025-09-30T22:09:35.811073] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:35.835180] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26887 primary records. [2025-09-30T22:09:35.835330] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-30T22:09:36.006078] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-30T22:09:36.006492] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:36.006761] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-30T22:09:36.007667] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8931 primary records. [2025-09-30T22:09:36.010182] [INFO ] [MAIN ] Derivative Progress: 775/2009 symbols completed. GRBK took 1.9s. Estimated remaining: 8m 29s. Rate: 145.5 symbols/min [2025-09-30T22:09:36.010434] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:36.011846] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-30T22:09:36.032136] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-30T22:09:36.032419] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-30T22:09:36.034679] [INFO ] [MAIN ] Derivative Progress: 776/2009 symbols completed. GRC took 1.2s. Estimated remaining: 8m 28s. Rate: 145.7 symbols/min [2025-09-30T22:09:36.035115] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:36.054050] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:36.055181] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20313 primary records. [2025-09-30T22:09:36.055282] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-30T22:09:36.083902] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-30T22:09:36.084136] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-30T22:09:36.086943] [INFO ] [MAIN ] Derivative Progress: 777/2009 symbols completed. GRDN took 0.8s. Estimated remaining: 8m 27s. Rate: 145.9 symbols/min [2025-09-30T22:09:36.087296] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:36.115767] [DEBUG] [LOCAL ] GRMN: Loaded 41031 existing records from primary storage. [2025-09-30T22:09:36.116139] [INFO ] [MAIN ] GRMN: Loaded 41031 primary data records. [2025-09-30T22:09:36.256137] [DEBUG] [LOCAL ] GRND: Loaded 49918 existing records from primary storage. [2025-09-30T22:09:36.267250] [INFO ] [MAIN ] GRND: Loaded 49918 primary data records. [2025-09-30T22:09:36.379525] [DEBUG] [LOCAL ] GRNT: Loaded 33750 existing records from primary storage. [2025-09-30T22:09:36.412578] [INFO ] [MAIN ] GRNT: Loaded 33750 primary data records. [2025-09-30T22:09:37.207185] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:37.208054] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41031 primary records. [2025-09-30T22:09:37.208247] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-30T22:09:37.245256] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:37.246034] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49918 primary records. [2025-09-30T22:09:37.244875] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-30T22:09:37.246258] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-30T22:09:37.246745] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-30T22:09:37.258273] [INFO ] [MAIN ] Derivative Progress: 778/2009 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 28s. Rate: 145.5 symbols/min [2025-09-30T22:09:37.280035] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-30T22:09:37.280133] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-30T22:09:37.278940] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:37.280962] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33750 primary records. [2025-09-30T22:09:37.283174] [INFO ] [MAIN ] Derivative Progress: 779/2009 symbols completed. GRND took 1.2s. Estimated remaining: 8m 27s. Rate: 145.7 symbols/min [2025-09-30T22:09:37.283430] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-30T22:09:37.298282] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-30T22:09:37.298359] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-30T22:09:37.300970] [INFO ] [MAIN ] Derivative Progress: 780/2009 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 25s. Rate: 145.9 symbols/min [2025-09-30T22:09:37.301382] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:37.301481] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:37.301556] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:37.312875] [DEBUG] [LOCAL ] GRX: Loaded 4617 existing records from primary storage. [2025-09-30T22:09:37.313124] [INFO ] [MAIN ] GRX: Loaded 4617 primary data records. [2025-09-30T22:09:37.366849] [DEBUG] [LOCAL ] GROV: Loaded 8951 existing records from primary storage. [2025-09-30T22:09:37.380727] [INFO ] [MAIN ] GROV: Loaded 8951 primary data records. [2025-09-30T22:09:37.997769] [DEBUG] [LOCAL ] GS: Loaded 51906 existing records from primary storage. [2025-09-30T22:09:37.998111] [INFO ] [MAIN ] GS: Loaded 51906 primary data records. [2025-09-30T22:09:38.368631] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:38.381837] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8951 primary records. [2025-09-30T22:09:38.383499] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:38.384277] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4617 primary records. [2025-09-30T22:09:38.383175] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-30T22:09:38.384836] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-30T22:09:38.417781] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-30T22:09:38.418085] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-30T22:09:38.414514] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-30T22:09:38.418380] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-30T22:09:38.420767] [INFO ] [MAIN ] Derivative Progress: 781/2009 symbols completed. GROV took 1.1s. Estimated remaining: 8m 26s. Rate: 145.6 symbols/min [2025-09-30T22:09:38.423373] [INFO ] [MAIN ] Derivative Progress: 782/2009 symbols completed. GRX took 1.1s. Estimated remaining: 8m 25s. Rate: 145.7 symbols/min [2025-09-30T22:09:38.421044] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:38.423930] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:38.445435] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:38.446474] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51906 primary records. [2025-09-30T22:09:38.446619] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-30T22:09:38.473077] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-30T22:09:38.476404] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-30T22:09:38.478832] [INFO ] [MAIN ] Derivative Progress: 783/2009 symbols completed. GS took 1.2s. Estimated remaining: 8m 24s. Rate: 145.9 symbols/min [2025-09-30T22:09:38.479168] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:38.494692] [DEBUG] [LOCAL ] GSBD: Loaded 39087 existing records from primary storage. [2025-09-30T22:09:38.494931] [INFO ] [MAIN ] GSBD: Loaded 39087 primary data records. [2025-09-30T22:09:38.717151] [DEBUG] [LOCAL ] GSK: Loaded 53492 existing records from primary storage. [2025-09-30T22:09:38.846831] [DEBUG] [LOCAL ] GSL: Loaded 33345 existing records from primary storage. [2025-09-30T22:09:38.860961] [INFO ] [MAIN ] GSL: Loaded 33345 primary data records. [2025-09-30T22:09:38.860315] [INFO ] [MAIN ] GSK: Loaded 53492 primary data records. [2025-09-30T22:09:39.570319] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:39.572724] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39087 primary records. [2025-09-30T22:09:39.573100] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-30T22:09:39.593354] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-30T22:09:39.593625] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-30T22:09:39.596238] [INFO ] [MAIN ] Derivative Progress: 784/2009 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 25s. Rate: 145.6 symbols/min [2025-09-30T22:09:39.596440] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:39.613739] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:39.614836] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33345 primary records. [2025-09-30T22:09:39.615030] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-30T22:09:39.634008] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-30T22:09:39.634296] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-30T22:09:39.636605] [INFO ] [MAIN ] Derivative Progress: 785/2009 symbols completed. GSL took 1.2s. Estimated remaining: 8m 24s. Rate: 145.8 symbols/min [2025-09-30T22:09:39.649715] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:39.650875] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:39.651976] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53492 primary records. [2025-09-30T22:09:39.652206] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-30T22:09:39.669554] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-30T22:09:39.669802] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-30T22:09:39.672556] [INFO ] [MAIN ] Derivative Progress: 786/2009 symbols completed. GSK took 1.2s. Estimated remaining: 8m 23s. Rate: 145.9 symbols/min [2025-09-30T22:09:39.686450] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:39.724696] [DEBUG] [LOCAL ] GTES: Loaded 50537 existing records from primary storage. [2025-09-30T22:09:39.725011] [INFO ] [MAIN ] GTES: Loaded 50537 primary data records. [2025-09-30T22:09:39.868612] [DEBUG] [LOCAL ] GTLS: Loaded 42730 existing records from primary storage. [2025-09-30T22:09:39.884992] [INFO ] [MAIN ] GTLS: Loaded 42730 primary data records. [2025-09-30T22:09:39.988844] [DEBUG] [LOCAL ] GTN: Loaded 45533 existing records from primary storage. [2025-09-30T22:09:40.029757] [INFO ] [MAIN ] GTN: Loaded 45533 primary data records. [2025-09-30T22:09:40.778182] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:40.779206] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50537 primary records. [2025-09-30T22:09:40.779478] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-30T22:09:40.800047] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-30T22:09:40.813217] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-30T22:09:40.815739] [INFO ] [MAIN ] Derivative Progress: 787/2009 symbols completed. GTES took 1.2s. Estimated remaining: 8m 24s. Rate: 145.6 symbols/min [2025-09-30T22:09:40.816036] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:40.812956] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:40.817615] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42730 primary records. [2025-09-30T22:09:40.817822] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-30T22:09:40.851075] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-30T22:09:40.849861] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:40.851869] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-30T22:09:40.854217] [INFO ] [MAIN ] Derivative Progress: 788/2009 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 23s. Rate: 145.8 symbols/min [2025-09-30T22:09:40.854586] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45533 primary records. [2025-09-30T22:09:40.854702] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-30T22:09:40.854394] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:40.882438] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-30T22:09:40.882619] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-30T22:09:40.885182] [INFO ] [MAIN ] Derivative Progress: 789/2009 symbols completed. GTN took 1.2s. Estimated remaining: 8m 22s. Rate: 145.9 symbols/min [2025-09-30T22:09:40.885933] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:40.896419] [DEBUG] [LOCAL ] GTY: Loaded 30299 existing records from primary storage. [2025-09-30T22:09:40.901668] [DEBUG] [LOCAL ] GUG: Loaded 12048 existing records from primary storage. [2025-09-30T22:09:40.901773] [INFO ] [MAIN ] GUG: Loaded 12048 primary data records. [2025-09-30T22:09:40.901824] [INFO ] [MAIN ] GTY: Loaded 30299 primary data records. [2025-09-30T22:09:41.077896] [DEBUG] [LOCAL ] GUT: Loaded 15320 existing records from primary storage. [2025-09-30T22:09:41.136342] [INFO ] [MAIN ] GUT: Loaded 15320 primary data records. [2025-09-30T22:09:41.999321] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:42.000908] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:42.000589] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12048 primary records. [2025-09-30T22:09:42.001028] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-30T22:09:42.001714] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30299 primary records. [2025-09-30T22:09:42.002014] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-30T22:09:42.042541] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-09-30T22:09:42.043096] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-30T22:09:42.048406] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-30T22:09:42.047604] [INFO ] [MAIN ] Derivative Progress: 790/2009 symbols completed. GUG took 1.2s. Estimated remaining: 8m 22s. Rate: 145.6 symbols/min [2025-09-30T22:09:42.048972] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-30T22:09:42.048877] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:42.053583] [INFO ] [MAIN ] Derivative Progress: 791/2009 symbols completed. GTY took 1.2s. Estimated remaining: 8m 21s. Rate: 145.8 symbols/min [2025-09-30T22:09:42.054792] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:42.077350] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:42.083997] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15320 primary records. [2025-09-30T22:09:42.084289] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-30T22:09:42.109811] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-30T22:09:42.108765] [DEBUG] [LOCAL ] GWH: Loaded 15953 existing records from primary storage. [2025-09-30T22:09:42.110145] [INFO ] [MAIN ] GWH: Loaded 15953 primary data records. [2025-09-30T22:09:42.110066] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-30T22:09:42.113302] [INFO ] [MAIN ] Derivative Progress: 792/2009 symbols completed. GUT took 1.2s. Estimated remaining: 8m 20s. Rate: 145.9 symbols/min [2025-09-30T22:09:42.156150] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:42.263006] [DEBUG] [LOCAL ] GVA: Loaded 33174 existing records from primary storage. [2025-09-30T22:09:42.293178] [INFO ] [MAIN ] GVA: Loaded 33174 primary data records. [2025-09-30T22:09:42.782633] [DEBUG] [LOCAL ] GWRE: Loaded 40664 existing records from primary storage. [2025-09-30T22:09:42.813772] [INFO ] [MAIN ] GWRE: Loaded 40664 primary data records. [2025-09-30T22:09:43.181842] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:43.182793] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15953 primary records. [2025-09-30T22:09:43.182968] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-30T22:09:43.206682] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-30T22:09:43.220821] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:43.221807] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33174 primary records. [2025-09-30T22:09:43.220395] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-30T22:09:43.224071] [INFO ] [MAIN ] Derivative Progress: 793/2009 symbols completed. GWH took 1.2s. Estimated remaining: 8m 21s. Rate: 145.6 symbols/min [2025-09-30T22:09:43.224919] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-30T22:09:43.244000] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-30T22:09:43.244433] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-30T22:09:43.247088] [INFO ] [MAIN ] Derivative Progress: 794/2009 symbols completed. GVA took 1.2s. Estimated remaining: 8m 20s. Rate: 145.8 symbols/min [2025-09-30T22:09:43.264136] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:43.264833] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40664 primary records. [2025-09-30T22:09:43.264897] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-30T22:09:43.280976] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-30T22:09:43.281106] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-30T22:09:43.284005] [INFO ] [MAIN ] Derivative Progress: 795/2009 symbols completed. GWRE took 1.1s. Estimated remaining: 8m 19s. Rate: 146.0 symbols/min [2025-09-30T22:09:43.284857] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:43.285013] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:43.285203] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:43.291971] [DEBUG] [LOCAL ] GYLD: Loaded 1541 existing records from primary storage. [2025-09-30T22:09:43.292148] [INFO ] [MAIN ] GYLD: Loaded 1541 primary data records. [2025-09-30T22:09:43.421081] [DEBUG] [LOCAL ] GWW: Loaded 19483 existing records from primary storage. [2025-09-30T22:09:43.425267] [INFO ] [MAIN ] GWW: Loaded 19483 primary data records. [2025-09-30T22:09:43.669135] [DEBUG] [LOCAL ] GXO: Loaded 47460 existing records from primary storage. [2025-09-30T22:09:43.863327] [INFO ] [MAIN ] GXO: Loaded 47460 primary data records. [2025-09-30T22:09:44.456490] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:09:44.461164] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1541 primary records. [2025-09-30T22:09:44.461472] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-30T22:09:44.493052] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:44.497705] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19483 primary records. [2025-09-30T22:09:44.499148] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-30T22:09:44.517413] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-09-30T22:09:44.531362] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-30T22:09:44.533783] [INFO ] [MAIN ] Derivative Progress: 796/2009 symbols completed. GYLD took 1.2s. Estimated remaining: 8m 20s. Rate: 145.6 symbols/min [2025-09-30T22:09:44.534543] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:44.534404] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:44.536158] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47460 primary records. [2025-09-30T22:09:44.536791] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-30T22:09:44.547827] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-30T22:09:44.554381] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-30T22:09:44.558799] [INFO ] [MAIN ] Derivative Progress: 797/2009 symbols completed. GWW took 1.3s. Estimated remaining: 8m 19s. Rate: 145.8 symbols/min [2025-09-30T22:09:44.559380] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-30T22:09:44.559555] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:44.560314] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-30T22:09:44.564612] [INFO ] [MAIN ] Derivative Progress: 798/2009 symbols completed. GXO took 1.3s. Estimated remaining: 8m 18s. Rate: 145.9 symbols/min [2025-09-30T22:09:44.564975] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:44.613391] [DEBUG] [LOCAL ] HAE: Loaded 39442 existing records from primary storage. [2025-09-30T22:09:44.613674] [INFO ] [MAIN ] HAE: Loaded 39442 primary data records. [2025-09-30T22:09:44.739286] [DEBUG] [LOCAL ] H: Loaded 44651 existing records from primary storage. [2025-09-30T22:09:44.759553] [INFO ] [MAIN ] H: Loaded 44651 primary data records. [2025-09-30T22:09:44.888148] [DEBUG] [LOCAL ] HAFN: Loaded 43295 existing records from primary storage. [2025-09-30T22:09:45.005703] [INFO ] [MAIN ] HAFN: Loaded 43295 primary data records. [2025-09-30T22:09:45.770635] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:45.773133] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39442 primary records. [2025-09-30T22:09:45.773735] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-30T22:09:45.793105] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-30T22:09:45.793418] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-30T22:09:45.796120] [INFO ] [MAIN ] Derivative Progress: 799/2009 symbols completed. HAE took 1.2s. Estimated remaining: 8m 19s. Rate: 145.6 symbols/min [2025-09-30T22:09:45.798122] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:45.816493] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:45.817892] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44651 primary records. [2025-09-30T22:09:45.818139] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-30T22:09:45.836555] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-30T22:09:45.836908] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-30T22:09:45.839454] [INFO ] [MAIN ] Derivative Progress: 800/2009 symbols completed. H took 1.3s. Estimated remaining: 8m 18s. Rate: 145.7 symbols/min [2025-09-30T22:09:45.839867] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:45.867080] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:45.868375] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43295 primary records. [2025-09-30T22:09:45.868612] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-30T22:09:45.909133] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-30T22:09:45.909416] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-30T22:09:45.912767] [INFO ] [MAIN ] Derivative Progress: 801/2009 symbols completed. HAFN took 1.3s. Estimated remaining: 8m 17s. Rate: 145.9 symbols/min [2025-09-30T22:09:45.913170] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:45.944050] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-30T22:09:45.944725] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-30T22:09:46.023152] [DEBUG] [LOCAL ] HASI: Loaded 47161 existing records from primary storage. [2025-09-30T22:09:46.050028] [INFO ] [MAIN ] HASI: Loaded 47161 primary data records. [2025-09-30T22:09:46.328785] [DEBUG] [LOCAL ] HAYW: Loaded 48728 existing records from primary storage. [2025-09-30T22:09:46.376625] [INFO ] [MAIN ] HAYW: Loaded 48728 primary data records. [2025-09-30T22:09:47.054189] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:47.053783] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:47.055169] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-30T22:09:47.056183] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47161 primary records. [2025-09-30T22:09:47.056282] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-30T22:09:47.057137] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-30T22:09:47.102627] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-30T22:09:47.103539] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-30T22:09:47.107163] [INFO ] [MAIN ] Derivative Progress: 802/2009 symbols completed. HASI took 1.3s. Estimated remaining: 8m 18s. Rate: 145.5 symbols/min [2025-09-30T22:09:47.107832] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:47.119547] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-30T22:09:47.125490] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-30T22:09:47.126054] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:47.129492] [INFO ] [MAIN ] Derivative Progress: 803/2009 symbols completed. HAL took 1.3s. Estimated remaining: 8m 17s. Rate: 145.7 symbols/min [2025-09-30T22:09:47.130748] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48728 primary records. [2025-09-30T22:09:47.130995] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:47.130877] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-30T22:09:47.151025] [DEBUG] [LOCAL ] HBB: Loaded 6651 existing records from primary storage. [2025-09-30T22:09:47.152515] [INFO ] [MAIN ] HBB: Loaded 6651 primary data records. [2025-09-30T22:09:47.194196] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-30T22:09:47.201688] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-30T22:09:47.204468] [INFO ] [MAIN ] Derivative Progress: 804/2009 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 16s. Rate: 145.9 symbols/min [2025-09-30T22:09:47.209934] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:47.525373] [DEBUG] [LOCAL ] HBI: Loaded 52992 existing records from primary storage. [2025-09-30T22:09:47.525765] [INFO ] [MAIN ] HBI: Loaded 52992 primary data records. [2025-09-30T22:09:47.890478] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-09-30T22:09:47.901128] [INFO ] [MAIN ] HBM: Loaded 52903 primary data records. [2025-09-30T22:09:48.080927] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:48.138741] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6651 primary records. [2025-09-30T22:09:48.143374] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-30T22:09:48.358957] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:48.357889] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-30T22:09:48.360385] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52992 primary records. [2025-09-30T22:09:48.360611] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-30T22:09:48.360536] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-30T22:09:48.364147] [INFO ] [MAIN ] Derivative Progress: 805/2009 symbols completed. HBB took 1.3s. Estimated remaining: 8m 16s. Rate: 145.5 symbols/min [2025-09-30T22:09:48.364367] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:48.386065] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-30T22:09:48.386206] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-30T22:09:48.388883] [INFO ] [MAIN ] Derivative Progress: 806/2009 symbols completed. HBI took 1.3s. Estimated remaining: 8m 15s. Rate: 145.7 symbols/min [2025-09-30T22:09:48.389352] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:48.409052] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:48.409891] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52903 primary records. [2025-09-30T22:09:48.409979] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-30T22:09:48.444847] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-30T22:09:48.445050] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-30T22:09:48.447774] [INFO ] [MAIN ] Derivative Progress: 807/2009 symbols completed. HBM took 1.2s. Estimated remaining: 8m 14s. Rate: 145.9 symbols/min [2025-09-30T22:09:48.448206] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:48.475092] [DEBUG] [LOCAL ] HCA: Loaded 46952 existing records from primary storage. [2025-09-30T22:09:48.475344] [INFO ] [MAIN ] HCA: Loaded 46952 primary data records. [2025-09-30T22:09:48.606270] [DEBUG] [LOCAL ] HCC: Loaded 45344 existing records from primary storage. [2025-09-30T22:09:48.619575] [INFO ] [MAIN ] HCC: Loaded 45344 primary data records. [2025-09-30T22:09:48.619396] [DEBUG] [LOCAL ] HCI: Loaded 13987 existing records from primary storage. [2025-09-30T22:09:48.619755] [INFO ] [MAIN ] HCI: Loaded 13987 primary data records. [2025-09-30T22:09:49.561434] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:49.563783] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46952 primary records. [2025-09-30T22:09:49.566240] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-30T22:09:49.594938] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:49.598396] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45344 primary records. [2025-09-30T22:09:49.598495] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-30T22:09:49.599972] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-30T22:09:49.600213] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-30T22:09:49.610188] [INFO ] [MAIN ] Derivative Progress: 808/2009 symbols completed. HCA took 1.2s. Estimated remaining: 8m 15s. Rate: 145.5 symbols/min [2025-09-30T22:09:49.628067] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:49.629231] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13987 primary records. [2025-09-30T22:09:49.629519] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-30T22:09:49.650134] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-30T22:09:49.649752] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-30T22:09:49.650320] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-30T22:09:49.650397] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-30T22:09:49.653046] [INFO ] [MAIN ] Derivative Progress: 809/2009 symbols completed. HCI took 1.2s. Estimated remaining: 8m 14s. Rate: 145.7 symbols/min [2025-09-30T22:09:49.656141] [INFO ] [MAIN ] Derivative Progress: 810/2009 symbols completed. HCC took 1.3s. Estimated remaining: 8m 13s. Rate: 145.9 symbols/min [2025-09-30T22:09:49.657183] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:49.657085] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:49.657011] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:49.734142] [DEBUG] [LOCAL ] HE: Loaded 49067 existing records from primary storage. [2025-09-30T22:09:49.749464] [INFO ] [MAIN ] HE: Loaded 49067 primary data records. [2025-09-30T22:09:49.773440] [DEBUG] [LOCAL ] HD: Loaded 53497 existing records from primary storage. [2025-09-30T22:09:49.817792] [INFO ] [MAIN ] HD: Loaded 53497 primary data records. [2025-09-30T22:09:49.852491] [DEBUG] [LOCAL ] HDB: Loaded 51926 existing records from primary storage. [2025-09-30T22:09:49.864879] [INFO ] [MAIN ] HDB: Loaded 51926 primary data records. [2025-09-30T22:09:50.851213] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:50.854279] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49067 primary records. [2025-09-30T22:09:50.868587] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:50.869357] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53497 primary records. [2025-09-30T22:09:50.868107] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-30T22:09:50.869553] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-30T22:09:50.907850] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:50.910933] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51926 primary records. [2025-09-30T22:09:50.911473] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-30T22:09:50.914271] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-30T22:09:50.915977] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-30T22:09:50.917681] [INFO ] [MAIN ] Derivative Progress: 811/2009 symbols completed. HE took 1.3s. Estimated remaining: 8m 14s. Rate: 145.5 symbols/min [2025-09-30T22:09:50.918153] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:50.937492] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-30T22:09:50.938249] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-30T22:09:50.938427] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-30T22:09:50.941694] [INFO ] [MAIN ] Derivative Progress: 812/2009 symbols completed. HD took 1.3s. Estimated remaining: 8m 13s. Rate: 145.7 symbols/min [2025-09-30T22:09:50.942004] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:50.941852] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-30T22:09:50.945173] [INFO ] [MAIN ] Derivative Progress: 813/2009 symbols completed. HDB took 1.3s. Estimated remaining: 8m 12s. Rate: 145.8 symbols/min [2025-09-30T22:09:50.945617] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:50.956396] [DEBUG] [LOCAL ] HEQ: Loaded 6231 existing records from primary storage. [2025-09-30T22:09:50.956539] [INFO ] [MAIN ] HEQ: Loaded 6231 primary data records. [2025-09-30T22:09:51.104924] [DEBUG] [LOCAL ] HEI: Loaded 32152 existing records from primary storage. [2025-09-30T22:09:51.136690] [INFO ] [MAIN ] HEI: Loaded 32152 primary data records. [2025-09-30T22:09:51.386685] [DEBUG] [LOCAL ] HESM: Loaded 48247 existing records from primary storage. [2025-09-30T22:09:51.412501] [INFO ] [MAIN ] HESM: Loaded 48247 primary data records. [2025-09-30T22:09:52.013889] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:52.014850] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6231 primary records. [2025-09-30T22:09:52.014945] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-30T22:09:52.033729] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-30T22:09:52.034228] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-30T22:09:52.038725] [INFO ] [MAIN ] Derivative Progress: 814/2009 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 13s. Rate: 145.6 symbols/min [2025-09-30T22:09:52.039982] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:52.056505] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:52.057544] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 32152 primary records. [2025-09-30T22:09:52.057807] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-30T22:09:52.090275] [DEBUG] [LOCAL ] HFRO: Loaded 17720 existing records from primary storage. [2025-09-30T22:09:52.091144] [INFO ] [MAIN ] HFRO: Loaded 17720 primary data records. [2025-09-30T22:09:52.134464] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-30T22:09:52.158616] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:52.177046] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-30T22:09:52.203231] [INFO ] [MAIN ] Derivative Progress: 815/2009 symbols completed. HEI took 1.3s. Estimated remaining: 8m 12s. Rate: 145.7 symbols/min [2025-09-30T22:09:52.190231] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48247 primary records. [2025-09-30T22:09:52.218727] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:52.222559] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-30T22:09:52.501508] [DEBUG] [LOCAL ] HGER: Loaded 13442 existing records from primary storage. [2025-09-30T22:09:52.502937] [INFO ] [MAIN ] HGER: Loaded 13442 primary data records. [2025-09-30T22:09:52.503021] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-30T22:09:52.503190] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-30T22:09:52.517338] [INFO ] [MAIN ] Derivative Progress: 816/2009 symbols completed. HESM took 1.6s. Estimated remaining: 8m 11s. Rate: 145.7 symbols/min [2025-09-30T22:09:52.538946] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:52.732209] [DEBUG] [LOCAL ] HGLB: Loaded 9473 existing records from primary storage. [2025-09-30T22:09:52.823554] [INFO ] [MAIN ] HGLB: Loaded 9473 primary data records. [2025-09-30T22:09:53.016091] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:53.052169] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17720 primary records. [2025-09-30T22:09:53.069085] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-30T22:09:53.213558] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-30T22:09:53.214112] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-30T22:09:53.217432] [INFO ] [MAIN ] Derivative Progress: 817/2009 symbols completed. HFRO took 1.2s. Estimated remaining: 8m 11s. Rate: 145.6 symbols/min [2025-09-30T22:09:53.218541] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:53.239638] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:53.241073] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 13442 primary records. [2025-09-30T22:09:53.245006] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-30T22:09:53.265341] [DEBUG] [LOCAL ] HGTY: Loaded 13203 existing records from primary storage. [2025-09-30T22:09:53.266670] [INFO ] [MAIN ] HGTY: Loaded 13203 primary data records. [2025-09-30T22:09:53.354546] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-30T22:09:53.389258] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-30T22:09:53.389711] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:53.391978] [INFO ] [MAIN ] Derivative Progress: 818/2009 symbols completed. HGER took 1.2s. Estimated remaining: 8m 11s. Rate: 145.7 symbols/min [2025-09-30T22:09:53.401140] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:53.406808] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9473 primary records. [2025-09-30T22:09:53.407035] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-30T22:09:53.640183] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-30T22:09:53.640521] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-30T22:09:53.643378] [INFO ] [MAIN ] Derivative Progress: 819/2009 symbols completed. HGLB took 1.1s. Estimated remaining: 8m 10s. Rate: 145.7 symbols/min [2025-09-30T22:09:53.654795] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:53.678127] [DEBUG] [LOCAL ] HGV: Loaded 46608 existing records from primary storage. [2025-09-30T22:09:53.678305] [INFO ] [MAIN ] HGV: Loaded 46608 primary data records. [2025-09-30T22:09:53.809382] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:53.847703] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13203 primary records. [2025-09-30T22:09:53.854302] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-30T22:09:53.848632] [DEBUG] [LOCAL ] HHH: Loaded 32605 existing records from primary storage. [2025-09-30T22:09:53.870675] [INFO ] [MAIN ] HHH: Loaded 32605 primary data records. [2025-09-30T22:09:54.222415] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-09-30T22:09:54.222897] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-30T22:09:54.230984] [INFO ] [MAIN ] Derivative Progress: 820/2009 symbols completed. HGTY took 1.0s. Estimated remaining: 8m 10s. Rate: 145.7 symbols/min [2025-09-30T22:09:54.246830] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:54.469118] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:54.470421] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46608 primary records. [2025-09-30T22:09:54.470620] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-30T22:09:54.488190] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-30T22:09:54.498964] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-30T22:09:54.501381] [INFO ] [MAIN ] Derivative Progress: 821/2009 symbols completed. HGV took 1.1s. Estimated remaining: 8m 9s. Rate: 145.7 symbols/min [2025-09-30T22:09:54.501582] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:54.503342] [DEBUG] [LOCAL ] HI: Loaded 35264 existing records from primary storage. [2025-09-30T22:09:54.503462] [INFO ] [MAIN ] HI: Loaded 35264 primary data records. [2025-09-30T22:09:54.635437] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:54.636412] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32605 primary records. [2025-09-30T22:09:54.636906] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-30T22:09:54.910587] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-30T22:09:54.910829] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-30T22:09:54.912931] [INFO ] [MAIN ] Derivative Progress: 822/2009 symbols completed. HHH took 1.3s. Estimated remaining: 8m 9s. Rate: 145.7 symbols/min [2025-09-30T22:09:54.913359] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:54.935132] [DEBUG] [LOCAL ] HIG: Loaded 51228 existing records from primary storage. [2025-09-30T22:09:54.936083] [INFO ] [MAIN ] HIG: Loaded 51228 primary data records. [2025-09-30T22:09:55.098385] [DEBUG] [LOCAL ] HII: Loaded 34713 existing records from primary storage. [2025-09-30T22:09:55.130584] [INFO ] [MAIN ] HII: Loaded 34713 primary data records. [2025-09-30T22:09:55.411887] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:55.418756] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35264 primary records. [2025-09-30T22:09:55.434255] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-30T22:09:55.647633] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-30T22:09:55.650078] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-30T22:09:55.653413] [INFO ] [MAIN ] Derivative Progress: 823/2009 symbols completed. HI took 1.4s. Estimated remaining: 8m 9s. Rate: 145.6 symbols/min [2025-09-30T22:09:55.679945] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:55.681004] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51228 primary records. [2025-09-30T22:09:55.681084] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-30T22:09:55.702520] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-30T22:09:55.702800] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-30T22:09:55.705724] [INFO ] [MAIN ] Derivative Progress: 824/2009 symbols completed. HIG took 1.2s. Estimated remaining: 8m 8s. Rate: 145.7 symbols/min [2025-09-30T22:09:55.719720] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:55.720464] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 34713 primary records. [2025-09-30T22:09:55.720531] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-30T22:09:55.737610] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-30T22:09:55.737782] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-30T22:09:55.740396] [INFO ] [MAIN ] Derivative Progress: 825/2009 symbols completed. HII took 0.8s. Estimated remaining: 8m 7s. Rate: 145.9 symbols/min [2025-09-30T22:09:55.741163] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:55.741072] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:55.741250] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:55.771864] [DEBUG] [LOCAL ] HIPO: Loaded 22110 existing records from primary storage. [2025-09-30T22:09:55.780362] [INFO ] [MAIN ] HIPO: Loaded 22110 primary data records. [2025-09-30T22:09:55.780245] [DEBUG] [LOCAL ] HIO: Loaded 23693 existing records from primary storage. [2025-09-30T22:09:55.780678] [INFO ] [MAIN ] HIO: Loaded 23693 primary data records. [2025-09-30T22:09:56.347504] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-30T22:09:56.475597] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-30T22:09:56.918632] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:56.920955] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22110 primary records. [2025-09-30T22:09:56.923008] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-30T22:09:56.954027] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-30T22:09:56.953223] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:56.954982] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23693 primary records. [2025-09-30T22:09:56.955090] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-30T22:09:56.958320] [INFO ] [MAIN ] Derivative Progress: 826/2009 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 8s. Rate: 145.6 symbols/min [2025-09-30T22:09:56.955483] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-30T22:09:56.958749] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:56.977414] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-30T22:09:56.977582] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-30T22:09:56.979878] [INFO ] [MAIN ] Derivative Progress: 827/2009 symbols completed. HIO took 1.2s. Estimated remaining: 8m 7s. Rate: 145.7 symbols/min [2025-09-30T22:09:56.980336] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:57.000537] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:57.001460] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-30T22:09:57.001671] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-30T22:09:57.023370] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-30T22:09:57.023598] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-30T22:09:57.026164] [INFO ] [MAIN ] Derivative Progress: 828/2009 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 6s. Rate: 145.9 symbols/min [2025-09-30T22:09:57.026458] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:57.044597] [DEBUG] [LOCAL ] HIX: Loaded 20593 existing records from primary storage. [2025-09-30T22:09:57.044801] [INFO ] [MAIN ] HIX: Loaded 20593 primary data records. [2025-09-30T22:09:57.161897] [DEBUG] [LOCAL ] HIW: Loaded 44523 existing records from primary storage. [2025-09-30T22:09:57.179832] [INFO ] [MAIN ] HIW: Loaded 44523 primary data records. [2025-09-30T22:09:57.192975] [DEBUG] [LOCAL ] HKD: Loaded 18365 existing records from primary storage. [2025-09-30T22:09:57.198279] [INFO ] [MAIN ] HKD: Loaded 18365 primary data records. [2025-09-30T22:09:58.147556] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:58.148812] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20593 primary records. [2025-09-30T22:09:58.149119] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-30T22:09:58.183154] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:58.184108] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44523 primary records. [2025-09-30T22:09:58.177992] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-30T22:09:58.185014] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-30T22:09:58.185902] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-30T22:09:58.188469] [INFO ] [MAIN ] Derivative Progress: 829/2009 symbols completed. HIX took 1.2s. Estimated remaining: 8m 6s. Rate: 145.6 symbols/min [2025-09-30T22:09:58.197775] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:58.206212] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-30T22:09:58.206501] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-30T22:09:58.209104] [INFO ] [MAIN ] Derivative Progress: 830/2009 symbols completed. HIW took 1.3s. Estimated remaining: 8m 5s. Rate: 145.7 symbols/min [2025-09-30T22:09:58.209568] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:58.223466] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:58.224399] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18365 primary records. [2025-09-30T22:09:58.224571] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-30T22:09:58.244002] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-30T22:09:58.244271] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-30T22:09:58.247928] [INFO ] [MAIN ] Derivative Progress: 831/2009 symbols completed. HKD took 1.2s. Estimated remaining: 8m 4s. Rate: 145.9 symbols/min [2025-09-30T22:09:58.248411] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:58.309206] [DEBUG] [LOCAL ] HLF: Loaded 48536 existing records from primary storage. [2025-09-30T22:09:58.309618] [INFO ] [MAIN ] HLF: Loaded 48536 primary data records. [2025-09-30T22:09:58.349415] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-30T22:09:58.382479] [INFO ] [MAIN ] HL: Loaded 53671 primary data records. [2025-09-30T22:09:58.420053] [DEBUG] [LOCAL ] HLI: Loaded 30960 existing records from primary storage. [2025-09-30T22:09:58.477754] [INFO ] [MAIN ] HLI: Loaded 30960 primary data records. [2025-09-30T22:09:59.434601] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:59.436284] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53671 primary records. [2025-09-30T22:09:59.436732] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:59.438035] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48536 primary records. [2025-09-30T22:09:59.438710] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-30T22:09:59.438135] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-30T22:09:59.469280] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-30T22:09:59.469782] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-30T22:09:59.481505] [INFO ] [MAIN ] Derivative Progress: 832/2009 symbols completed. HL took 1.3s. Estimated remaining: 8m 5s. Rate: 145.5 symbols/min [2025-09-30T22:09:59.486989] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:59.488752] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:09:59.490974] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30960 primary records. [2025-09-30T22:09:59.491363] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-30T22:09:59.493176] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-30T22:09:59.501391] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-30T22:09:59.503575] [INFO ] [MAIN ] Derivative Progress: 833/2009 symbols completed. HLF took 1.3s. Estimated remaining: 8m 4s. Rate: 145.7 symbols/min [2025-09-30T22:09:59.507579] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:59.512875] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-30T22:09:59.513051] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-30T22:09:59.515901] [INFO ] [MAIN ] Derivative Progress: 834/2009 symbols completed. HLI took 1.3s. Estimated remaining: 8m 3s. Rate: 145.9 symbols/min [2025-09-30T22:09:59.516137] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:09:59.548382] [DEBUG] [LOCAL ] HLIO: Loaded 27935 existing records from primary storage. [2025-09-30T22:09:59.557139] [INFO ] [MAIN ] HLIO: Loaded 27935 primary data records. [2025-09-30T22:09:59.717991] [DEBUG] [LOCAL ] HLLY: Loaded 33120 existing records from primary storage. [2025-09-30T22:09:59.718226] [INFO ] [MAIN ] HLLY: Loaded 33120 primary data records. [2025-09-30T22:09:59.893394] [DEBUG] [LOCAL ] HLN: Loaded 53083 existing records from primary storage. [2025-09-30T22:09:59.932913] [INFO ] [MAIN ] HLN: Loaded 53083 primary data records. [2025-09-30T22:10:00.672906] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:00.674283] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 27935 primary records. [2025-09-30T22:10:00.674749] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-30T22:10:00.696121] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-30T22:10:00.696485] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-30T22:10:00.699395] [INFO ] [MAIN ] Derivative Progress: 835/2009 symbols completed. HLIO took 1.2s. Estimated remaining: 8m 4s. Rate: 145.5 symbols/min [2025-09-30T22:10:00.708094] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:00.714069] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:00.715745] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33120 primary records. [2025-09-30T22:10:00.716043] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-30T22:10:00.735473] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-30T22:10:00.736858] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-30T22:10:00.740109] [INFO ] [MAIN ] Derivative Progress: 836/2009 symbols completed. HLLY took 1.2s. Estimated remaining: 8m 3s. Rate: 145.7 symbols/min [2025-09-30T22:10:00.740292] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:00.755310] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:00.756271] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53083 primary records. [2025-09-30T22:10:00.756449] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-30T22:10:00.774717] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-30T22:10:00.774855] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-30T22:10:00.777164] [INFO ] [MAIN ] Derivative Progress: 837/2009 symbols completed. HLN took 1.3s. Estimated remaining: 8m 2s. Rate: 145.9 symbols/min [2025-09-30T22:10:00.777455] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:00.826974] [DEBUG] [LOCAL ] HLT: Loaded 50626 existing records from primary storage. [2025-09-30T22:10:00.827290] [INFO ] [MAIN ] HLT: Loaded 50626 primary data records. [2025-09-30T22:10:00.957566] [DEBUG] [LOCAL ] HLX: Loaded 47823 existing records from primary storage. [2025-09-30T22:10:00.963396] [INFO ] [MAIN ] HLX: Loaded 47823 primary data records. [2025-09-30T22:10:01.262765] [DEBUG] [LOCAL ] HMC: Loaded 46717 existing records from primary storage. [2025-09-30T22:10:01.268724] [INFO ] [MAIN ] HMC: Loaded 46717 primary data records. [2025-09-30T22:10:01.908713] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:01.909961] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50626 primary records. [2025-09-30T22:10:01.910179] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-30T22:10:01.929347] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-30T22:10:01.929696] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-30T22:10:01.931834] [INFO ] [MAIN ] Derivative Progress: 838/2009 symbols completed. HLT took 1.2s. Estimated remaining: 8m 3s. Rate: 145.6 symbols/min [2025-09-30T22:10:01.950632] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:01.951621] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47823 primary records. [2025-09-30T22:10:01.951821] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-30T22:10:01.970912] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-30T22:10:01.971199] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-30T22:10:01.973614] [INFO ] [MAIN ] Derivative Progress: 839/2009 symbols completed. HLX took 1.2s. Estimated remaining: 8m 2s. Rate: 145.7 symbols/min [2025-09-30T22:10:01.987219] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:01.987873] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46717 primary records. [2025-09-30T22:10:01.987976] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-30T22:10:02.004275] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-30T22:10:02.004411] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-30T22:10:02.007327] [INFO ] [MAIN ] Derivative Progress: 840/2009 symbols completed. HMC took 1.2s. Estimated remaining: 8m 1s. Rate: 145.9 symbols/min [2025-09-30T22:10:02.008201] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:02.008125] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:02.008561] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:02.057008] [DEBUG] [LOCAL ] HMN: Loaded 23372 existing records from primary storage. [2025-09-30T22:10:02.056383] [DEBUG] [LOCAL ] HNI: Loaded 29190 existing records from primary storage. [2025-09-30T22:10:02.057187] [INFO ] [MAIN ] HNI: Loaded 29190 primary data records. [2025-09-30T22:10:02.057302] [INFO ] [MAIN ] HMN: Loaded 23372 primary data records. [2025-09-30T22:10:02.437754] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-30T22:10:02.437974] [INFO ] [MAIN ] HMY: Loaded 53136 primary data records. [2025-09-30T22:10:03.123811] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:03.133204] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29190 primary records. [2025-09-30T22:10:03.138479] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-30T22:10:03.141603] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:03.143100] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23372 primary records. [2025-09-30T22:10:03.143703] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-30T22:10:03.176938] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-30T22:10:03.180618] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-30T22:10:03.185186] [INFO ] [MAIN ] Derivative Progress: 841/2009 symbols completed. HNI took 1.2s. Estimated remaining: 8m 2s. Rate: 145.5 symbols/min [2025-09-30T22:10:03.183124] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-30T22:10:03.186745] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-30T22:10:03.189422] [INFO ] [MAIN ] Derivative Progress: 842/2009 symbols completed. HMN took 1.2s. Estimated remaining: 8m 1s. Rate: 145.7 symbols/min [2025-09-30T22:10:03.186442] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:03.189822] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:03.206011] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:03.206813] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53136 primary records. [2025-09-30T22:10:03.206987] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-30T22:10:03.224849] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-30T22:10:03.225042] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-30T22:10:03.227558] [INFO ] [MAIN ] Derivative Progress: 843/2009 symbols completed. HMY took 1.2s. Estimated remaining: 7m 60s. Rate: 145.9 symbols/min [2025-09-30T22:10:03.227892] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:03.305578] [DEBUG] [LOCAL ] HOMB: Loaded 43513 existing records from primary storage. [2025-09-30T22:10:03.306389] [DEBUG] [LOCAL ] HOG: Loaded 51137 existing records from primary storage. [2025-09-30T22:10:03.319000] [INFO ] [MAIN ] HOMB: Loaded 43513 primary data records. [2025-09-30T22:10:03.319209] [INFO ] [MAIN ] HOG: Loaded 51137 primary data records. [2025-09-30T22:10:03.320011] [DEBUG] [LOCAL ] HOUS: Loaded 44419 existing records from primary storage. [2025-09-30T22:10:03.320139] [INFO ] [MAIN ] HOUS: Loaded 44419 primary data records. [2025-09-30T22:10:04.426151] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:04.430690] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51137 primary records. [2025-09-30T22:10:04.433433] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-30T22:10:04.463019] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:04.474348] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44419 primary records. [2025-09-30T22:10:04.473294] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:04.479717] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43513 primary records. [2025-09-30T22:10:04.478631] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-30T22:10:04.481007] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-30T22:10:04.494592] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-30T22:10:04.497630] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-30T22:10:04.500312] [INFO ] [MAIN ] Derivative Progress: 844/2009 symbols completed. HOG took 1.3s. Estimated remaining: 8m 0s. Rate: 145.5 symbols/min [2025-09-30T22:10:04.500489] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:04.518456] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-30T22:10:04.518673] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-30T22:10:04.521789] [INFO ] [MAIN ] Derivative Progress: 845/2009 symbols completed. HOMB took 1.3s. Estimated remaining: 7m 59s. Rate: 145.7 symbols/min [2025-09-30T22:10:04.522245] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:04.535198] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-30T22:10:04.535385] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-30T22:10:04.538236] [INFO ] [MAIN ] Derivative Progress: 846/2009 symbols completed. HOUS took 1.3s. Estimated remaining: 7m 58s. Rate: 145.8 symbols/min [2025-09-30T22:10:04.538517] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:04.546052] [DEBUG] [LOCAL ] HOV: Loaded 13796 existing records from primary storage. [2025-09-30T22:10:04.546193] [INFO ] [MAIN ] HOV: Loaded 13796 primary data records. [2025-09-30T22:10:04.936340] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-30T22:10:04.936768] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-30T22:10:04.938888] [DEBUG] [LOCAL ] HP: Loaded 51593 existing records from primary storage. [2025-09-30T22:10:04.939141] [INFO ] [MAIN ] HP: Loaded 51593 primary data records. [2025-09-30T22:10:05.227603] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:05.308308] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13796 primary records. [2025-09-30T22:10:05.450626] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-30T22:10:05.703230] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-30T22:10:05.703863] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-30T22:10:05.705898] [INFO ] [MAIN ] Derivative Progress: 847/2009 symbols completed. HOV took 1.2s. Estimated remaining: 7m 59s. Rate: 145.5 symbols/min [2025-09-30T22:10:05.706152] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:05.718174] [DEBUG] [LOCAL ] HPF: Loaded 7392 existing records from primary storage. [2025-09-30T22:10:05.720367] [INFO ] [MAIN ] HPF: Loaded 7392 primary data records. [2025-09-30T22:10:05.818787] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:05.829238] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:05.847862] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51593 primary records. [2025-09-30T22:10:05.848523] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-30T22:10:05.864806] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-30T22:10:05.869376] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-30T22:10:06.105521] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-30T22:10:06.108728] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-30T22:10:06.109001] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-30T22:10:06.111564] [INFO ] [MAIN ] Derivative Progress: 848/2009 symbols completed. HP took 1.6s. Estimated remaining: 7m 59s. Rate: 145.5 symbols/min [2025-09-30T22:10:06.112434] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:06.107806] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-30T22:10:06.114971] [INFO ] [MAIN ] Derivative Progress: 849/2009 symbols completed. HPE took 1.6s. Estimated remaining: 7m 58s. Rate: 145.7 symbols/min [2025-09-30T22:10:06.115263] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:06.129742] [DEBUG] [LOCAL ] HPI: Loaded 10334 existing records from primary storage. [2025-09-30T22:10:06.130092] [INFO ] [MAIN ] HPI: Loaded 10334 primary data records. [2025-09-30T22:10:06.500313] [DEBUG] [LOCAL ] HPP: Loaded 50907 existing records from primary storage. [2025-09-30T22:10:06.499265] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:06.500593] [INFO ] [MAIN ] HPP: Loaded 50907 primary data records. [2025-09-30T22:10:06.501402] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7392 primary records. [2025-09-30T22:10:06.501505] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-30T22:10:06.630267] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-30T22:10:06.635208] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-30T22:10:06.637352] [INFO ] [MAIN ] Derivative Progress: 850/2009 symbols completed. HPF took 0.9s. Estimated remaining: 7m 57s. Rate: 145.7 symbols/min [2025-09-30T22:10:06.670572] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:06.873524] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:06.874506] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10334 primary records. [2025-09-30T22:10:06.874704] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-30T22:10:06.892069] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-30T22:10:06.892287] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-30T22:10:06.894772] [INFO ] [MAIN ] Derivative Progress: 851/2009 symbols completed. HPI took 0.8s. Estimated remaining: 7m 57s. Rate: 145.7 symbols/min [2025-09-30T22:10:06.895017] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:06.932956] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:06.938400] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50907 primary records. [2025-09-30T22:10:06.938493] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-30T22:10:06.938793] [DEBUG] [LOCAL ] HPS: Loaded 10167 existing records from primary storage. [2025-09-30T22:10:06.940571] [INFO ] [MAIN ] HPS: Loaded 10167 primary data records. [2025-09-30T22:10:07.014797] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-30T22:10:07.030218] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-09-30T22:10:07.200339] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-30T22:10:07.244535] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-30T22:10:07.300583] [INFO ] [MAIN ] Derivative Progress: 852/2009 symbols completed. HPP took 1.2s. Estimated remaining: 7m 56s. Rate: 145.7 symbols/min [2025-09-30T22:10:07.454303] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:07.733136] [DEBUG] [LOCAL ] HQH: Loaded 25151 existing records from primary storage. [2025-09-30T22:10:07.733353] [INFO ] [MAIN ] HQH: Loaded 25151 primary data records. [2025-09-30T22:10:07.876590] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:07.893043] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10167 primary records. [2025-09-30T22:10:07.893306] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-30T22:10:07.985539] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:08.106561] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-09-30T22:10:08.115910] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-30T22:10:08.121308] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-30T22:10:08.121572] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-30T22:10:08.123629] [INFO ] [MAIN ] Derivative Progress: 853/2009 symbols completed. HPS took 1.2s. Estimated remaining: 7m 57s. Rate: 145.5 symbols/min [2025-09-30T22:10:08.142760] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-30T22:10:08.142910] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-30T22:10:08.145441] [INFO ] [MAIN ] Derivative Progress: 854/2009 symbols completed. HPQ took 1.5s. Estimated remaining: 7m 56s. Rate: 145.7 symbols/min [2025-09-30T22:10:08.166511] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:08.167185] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25151 primary records. [2025-09-30T22:10:08.167247] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-30T22:10:08.182869] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-30T22:10:08.182934] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-30T22:10:08.185179] [INFO ] [MAIN ] Derivative Progress: 855/2009 symbols completed. HQH took 0.7s. Estimated remaining: 7m 55s. Rate: 145.9 symbols/min [2025-09-30T22:10:08.185903] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:08.186007] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:08.186425] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:08.204569] [DEBUG] [LOCAL ] HQL: Loaded 16097 existing records from primary storage. [2025-09-30T22:10:08.204829] [INFO ] [MAIN ] HQL: Loaded 16097 primary data records. [2025-09-30T22:10:08.561773] [DEBUG] [LOCAL ] HRB: Loaded 48466 existing records from primary storage. [2025-09-30T22:10:08.586166] [INFO ] [MAIN ] HRB: Loaded 48466 primary data records. [2025-09-30T22:10:08.609197] [DEBUG] [LOCAL ] HR: Loaded 51939 existing records from primary storage. [2025-09-30T22:10:08.649089] [INFO ] [MAIN ] HR: Loaded 51939 primary data records. [2025-09-30T22:10:09.274046] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:09.276155] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16097 primary records. [2025-09-30T22:10:09.277795] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-30T22:10:09.297503] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-30T22:10:09.298022] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-30T22:10:09.300288] [INFO ] [MAIN ] Derivative Progress: 856/2009 symbols completed. HQL took 1.1s. Estimated remaining: 7m 55s. Rate: 145.6 symbols/min [2025-09-30T22:10:09.300524] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:09.319935] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:09.322705] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48466 primary records. [2025-09-30T22:10:09.322829] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-30T22:10:09.351638] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:09.354797] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-30T22:10:09.357255] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51939 primary records. [2025-09-30T22:10:09.357486] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-30T22:10:09.357615] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-30T22:10:09.361247] [INFO ] [MAIN ] Derivative Progress: 857/2009 symbols completed. HRB took 1.2s. Estimated remaining: 7m 54s. Rate: 145.7 symbols/min [2025-09-30T22:10:09.370352] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:09.390418] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-30T22:10:09.401376] [DEBUG] [LOCAL ] HRI: Loaded 32784 existing records from primary storage. [2025-09-30T22:10:09.401621] [INFO ] [MAIN ] HRI: Loaded 32784 primary data records. [2025-09-30T22:10:09.400565] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-30T22:10:09.404204] [INFO ] [MAIN ] Derivative Progress: 858/2009 symbols completed. HR took 1.2s. Estimated remaining: 7m 53s. Rate: 145.9 symbols/min [2025-09-30T22:10:09.427856] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:09.782795] [DEBUG] [LOCAL ] HRL: Loaded 53075 existing records from primary storage. [2025-09-30T22:10:09.784205] [INFO ] [MAIN ] HRL: Loaded 53075 primary data records. [2025-09-30T22:10:09.790434] [DEBUG] [LOCAL ] HRTG: Loaded 33359 existing records from primary storage. [2025-09-30T22:10:09.808233] [INFO ] [MAIN ] HRTG: Loaded 33359 primary data records. [2025-09-30T22:10:10.489464] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:10.490598] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32784 primary records. [2025-09-30T22:10:10.490821] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-30T22:10:10.512882] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-30T22:10:10.513270] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-30T22:10:10.516093] [INFO ] [MAIN ] Derivative Progress: 859/2009 symbols completed. HRI took 1.2s. Estimated remaining: 7m 54s. Rate: 145.6 symbols/min [2025-09-30T22:10:10.516445] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:10.548406] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:10.553612] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:10.554632] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53075 primary records. [2025-09-30T22:10:10.554859] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-30T22:10:10.555454] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33359 primary records. [2025-09-30T22:10:10.555890] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-30T22:10:10.589972] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-30T22:10:10.592169] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-30T22:10:10.592286] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-30T22:10:10.594550] [INFO ] [MAIN ] Derivative Progress: 860/2009 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 53s. Rate: 145.7 symbols/min [2025-09-30T22:10:10.594755] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-30T22:10:10.595018] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:10.597855] [INFO ] [MAIN ] Derivative Progress: 861/2009 symbols completed. HRL took 1.2s. Estimated remaining: 7m 52s. Rate: 145.9 symbols/min [2025-09-30T22:10:10.598840] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:10.613561] [DEBUG] [LOCAL ] HSHP: Loaded 15280 existing records from primary storage. [2025-09-30T22:10:10.627402] [INFO ] [MAIN ] HSHP: Loaded 15280 primary data records. [2025-09-30T22:10:10.770867] [DEBUG] [LOCAL ] HSBC: Loaded 51058 existing records from primary storage. [2025-09-30T22:10:10.798181] [INFO ] [MAIN ] HSBC: Loaded 51058 primary data records. [2025-09-30T22:10:11.143323] [DEBUG] [LOCAL ] HSY: Loaded 50351 existing records from primary storage. [2025-09-30T22:10:11.149416] [INFO ] [MAIN ] HSY: Loaded 50351 primary data records. [2025-09-30T22:10:11.720238] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:11.722470] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15280 primary records. [2025-09-30T22:10:11.722999] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-30T22:10:11.754144] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-30T22:10:11.759264] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-30T22:10:11.761317] [INFO ] [MAIN ] Derivative Progress: 862/2009 symbols completed. HSHP took 1.2s. Estimated remaining: 7m 53s. Rate: 145.6 symbols/min [2025-09-30T22:10:11.762456] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:11.762590] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:11.764183] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51058 primary records. [2025-09-30T22:10:11.764540] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-30T22:10:11.785003] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-30T22:10:11.786064] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-30T22:10:11.788401] [INFO ] [MAIN ] Derivative Progress: 863/2009 symbols completed. HSBC took 1.3s. Estimated remaining: 7m 52s. Rate: 145.7 symbols/min [2025-09-30T22:10:11.789326] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:11.808136] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:11.809027] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50351 primary records. [2025-09-30T22:10:11.809455] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-30T22:10:11.816310] [DEBUG] [LOCAL ] HTD: Loaded 13765 existing records from primary storage. [2025-09-30T22:10:11.824986] [INFO ] [MAIN ] HTD: Loaded 13765 primary data records. [2025-09-30T22:10:11.992246] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-30T22:10:11.998372] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-30T22:10:12.022866] [INFO ] [MAIN ] Derivative Progress: 864/2009 symbols completed. HSY took 1.4s. Estimated remaining: 7m 51s. Rate: 145.8 symbols/min [2025-09-30T22:10:12.210482] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:12.227860] [DEBUG] [LOCAL ] HTGC: Loaded 47389 existing records from primary storage. [2025-09-30T22:10:12.228245] [INFO ] [MAIN ] HTGC: Loaded 47389 primary data records. [2025-09-30T22:10:12.587208] [DEBUG] [LOCAL ] HTH: Loaded 32188 existing records from primary storage. [2025-09-30T22:10:12.587808] [INFO ] [MAIN ] HTH: Loaded 32188 primary data records. [2025-09-30T22:10:12.783291] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:12.810988] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13765 primary records. [2025-09-30T22:10:12.943790] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-30T22:10:12.966826] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-30T22:10:12.969460] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-30T22:10:12.972747] [INFO ] [MAIN ] Derivative Progress: 865/2009 symbols completed. HTD took 1.2s. Estimated remaining: 7m 51s. Rate: 145.6 symbols/min [2025-09-30T22:10:12.972994] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:12.988451] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:12.989372] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47389 primary records. [2025-09-30T22:10:12.989567] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-30T22:10:13.007691] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-30T22:10:13.007966] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-30T22:10:13.010431] [INFO ] [MAIN ] Derivative Progress: 866/2009 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 51s. Rate: 145.7 symbols/min [2025-09-30T22:10:13.010802] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:13.029348] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:13.030161] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32188 primary records. [2025-09-30T22:10:13.030225] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-30T22:10:13.070203] [DEBUG] [LOCAL ] HUBB: Loaded 36727 existing records from primary storage. [2025-09-30T22:10:13.070812] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-30T22:10:13.070961] [INFO ] [MAIN ] HUBB: Loaded 36727 primary data records. [2025-09-30T22:10:13.071043] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-30T22:10:13.073741] [INFO ] [MAIN ] Derivative Progress: 867/2009 symbols completed. HTH took 0.9s. Estimated remaining: 7m 50s. Rate: 145.9 symbols/min [2025-09-30T22:10:13.074108] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:13.219010] [DEBUG] [LOCAL ] HUBS: Loaded 39238 existing records from primary storage. [2025-09-30T22:10:13.225074] [INFO ] [MAIN ] HUBS: Loaded 39238 primary data records. [2025-09-30T22:10:13.781496] [DEBUG] [LOCAL ] HUM: Loaded 48794 existing records from primary storage. [2025-09-30T22:10:13.781738] [INFO ] [MAIN ] HUM: Loaded 48794 primary data records. [2025-09-30T22:10:14.185884] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:14.187881] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36727 primary records. [2025-09-30T22:10:14.188037] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-30T22:10:14.211282] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-30T22:10:14.226855] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-30T22:10:14.229412] [INFO ] [MAIN ] Derivative Progress: 868/2009 symbols completed. HUBB took 1.3s. Estimated remaining: 7m 50s. Rate: 145.6 symbols/min [2025-09-30T22:10:14.229842] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:14.231466] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39238 primary records. [2025-09-30T22:10:14.231688] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-30T22:10:14.249924] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-30T22:10:14.250055] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-30T22:10:14.253089] [INFO ] [MAIN ] Derivative Progress: 869/2009 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 49s. Rate: 145.7 symbols/min [2025-09-30T22:10:14.269145] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:14.269834] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48794 primary records. [2025-09-30T22:10:14.269899] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-30T22:10:14.286682] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-30T22:10:14.286756] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-30T22:10:14.289138] [INFO ] [MAIN ] Derivative Progress: 870/2009 symbols completed. HUM took 1.2s. Estimated remaining: 7m 48s. Rate: 145.9 symbols/min [2025-09-30T22:10:14.289684] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:14.289813] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:14.289883] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:14.315679] [DEBUG] [LOCAL ] HVT: Loaded 15579 existing records from primary storage. [2025-09-30T22:10:14.315843] [INFO ] [MAIN ] HVT: Loaded 15579 primary data records. [2025-09-30T22:10:14.499604] [DEBUG] [LOCAL ] HUYA: Loaded 44164 existing records from primary storage. [2025-09-30T22:10:14.525099] [INFO ] [MAIN ] HUYA: Loaded 44164 primary data records. [2025-09-30T22:10:14.713222] [DEBUG] [LOCAL ] HUN: Loaded 53197 existing records from primary storage. [2025-09-30T22:10:14.747727] [INFO ] [MAIN ] HUN: Loaded 53197 primary data records. [2025-09-30T22:10:15.393319] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:15.394476] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15579 primary records. [2025-09-30T22:10:15.396248] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-30T22:10:15.415869] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-30T22:10:15.416314] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-30T22:10:15.418485] [INFO ] [MAIN ] Derivative Progress: 871/2009 symbols completed. HVT took 1.1s. Estimated remaining: 7m 49s. Rate: 145.6 symbols/min [2025-09-30T22:10:15.419113] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:15.440681] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:15.441840] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44164 primary records. [2025-09-30T22:10:15.441967] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-30T22:10:15.456609] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:15.468551] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53197 primary records. [2025-09-30T22:10:15.468756] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-30T22:10:15.487201] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-30T22:10:15.490924] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-30T22:10:15.492240] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-30T22:10:15.492386] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-30T22:10:15.494981] [INFO ] [MAIN ] Derivative Progress: 872/2009 symbols completed. HUN took 1.2s. Estimated remaining: 7m 48s. Rate: 145.7 symbols/min [2025-09-30T22:10:15.495239] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:15.498161] [INFO ] [MAIN ] Derivative Progress: 873/2009 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 47s. Rate: 145.9 symbols/min [2025-09-30T22:10:15.498381] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:15.528810] [DEBUG] [LOCAL ] HY: Loaded 9962 existing records from primary storage. [2025-09-30T22:10:15.529144] [INFO ] [MAIN ] HY: Loaded 9962 primary data records. [2025-09-30T22:10:15.584515] [DEBUG] [LOCAL ] HWM: Loaded 52974 existing records from primary storage. [2025-09-30T22:10:15.632787] [INFO ] [MAIN ] HWM: Loaded 52974 primary data records. [2025-09-30T22:10:15.882829] [DEBUG] [LOCAL ] HXL: Loaded 46000 existing records from primary storage. [2025-09-30T22:10:16.026055] [INFO ] [MAIN ] HXL: Loaded 46000 primary data records. [2025-09-30T22:10:16.672605] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:16.674497] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9962 primary records. [2025-09-30T22:10:16.674609] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-30T22:10:16.707704] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:16.709793] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52974 primary records. [2025-09-30T22:10:16.710142] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-30T22:10:16.724305] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-30T22:10:16.724569] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-30T22:10:16.727733] [INFO ] [MAIN ] Derivative Progress: 874/2009 symbols completed. HY took 1.2s. Estimated remaining: 7m 48s. Rate: 145.6 symbols/min [2025-09-30T22:10:16.729038] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:16.732867] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-30T22:10:16.733233] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-30T22:10:16.737789] [INFO ] [MAIN ] Derivative Progress: 875/2009 symbols completed. HWM took 1.3s. Estimated remaining: 7m 47s. Rate: 145.7 symbols/min [2025-09-30T22:10:16.738365] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:16.756146] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:16.756997] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 46000 primary records. [2025-09-30T22:10:16.757174] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-30T22:10:16.771697] [DEBUG] [LOCAL ] HYI: Loaded 9392 existing records from primary storage. [2025-09-30T22:10:16.776689] [INFO ] [MAIN ] HYI: Loaded 9392 primary data records. [2025-09-30T22:10:16.790925] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-30T22:10:16.832471] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-30T22:10:16.868408] [INFO ] [MAIN ] Derivative Progress: 876/2009 symbols completed. HXL took 1.4s. Estimated remaining: 7m 46s. Rate: 145.8 symbols/min [2025-09-30T22:10:16.874014] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:16.928377] [DEBUG] [LOCAL ] HYT: Loaded 33686 existing records from primary storage. [2025-09-30T22:10:16.944320] [INFO ] [MAIN ] HYT: Loaded 33686 primary data records. [2025-09-30T22:10:16.994188] [DEBUG] [LOCAL ] HYTR: Loaded 3151 existing records from primary storage. [2025-09-30T22:10:17.041868] [INFO ] [MAIN ] HYTR: Loaded 3151 primary data records. [2025-09-30T22:10:17.881606] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:17.883747] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9392 primary records. [2025-09-30T22:10:17.885462] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-30T22:10:17.913815] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:17.916542] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33686 primary records. [2025-09-30T22:10:17.925759] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-30T22:10:17.934177] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-30T22:10:17.941346] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-30T22:10:17.931567] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-30T22:10:17.945525] [INFO ] [MAIN ] HYTR: Generated 1791 derivative records from 3151 primary records. [2025-09-30T22:10:17.945631] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-30T22:10:17.949203] [INFO ] [MAIN ] Derivative Progress: 877/2009 symbols completed. HYI took 1.2s. Estimated remaining: 7m 47s. Rate: 145.6 symbols/min [2025-09-30T22:10:17.951167] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:17.963838] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-30T22:10:17.964087] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-30T22:10:17.967174] [INFO ] [MAIN ] Derivative Progress: 878/2009 symbols completed. HYT took 1.2s. Estimated remaining: 7m 46s. Rate: 145.7 symbols/min [2025-09-30T22:10:17.968262] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:17.971496] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1791 records). [2025-09-30T22:10:17.971969] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-30T22:10:17.974465] [INFO ] [MAIN ] Derivative Progress: 879/2009 symbols completed. HYTR took 1.1s. Estimated remaining: 7m 45s. Rate: 145.9 symbols/min [2025-09-30T22:10:17.974863] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:17.982274] [DEBUG] [LOCAL ] IAE: Loaded 6043 existing records from primary storage. [2025-09-30T22:10:17.982417] [INFO ] [MAIN ] IAE: Loaded 6043 primary data records. [2025-09-30T22:10:18.126255] [DEBUG] [LOCAL ] HZO: Loaded 29205 existing records from primary storage. [2025-09-30T22:10:18.162806] [INFO ] [MAIN ] HZO: Loaded 29205 primary data records. [2025-09-30T22:10:18.484602] [DEBUG] [LOCAL ] IAG: Loaded 53449 existing records from primary storage. [2025-09-30T22:10:18.486572] [INFO ] [MAIN ] IAG: Loaded 53449 primary data records. [2025-09-30T22:10:19.111621] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:19.112888] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6043 primary records. [2025-09-30T22:10:19.113984] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-30T22:10:19.133801] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-30T22:10:19.133978] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-30T22:10:19.136352] [INFO ] [MAIN ] Derivative Progress: 880/2009 symbols completed. IAE took 1.2s. Estimated remaining: 7m 45s. Rate: 145.6 symbols/min [2025-09-30T22:10:19.136698] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:19.158403] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:19.159614] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29205 primary records. [2025-09-30T22:10:19.159769] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-30T22:10:19.187550] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:19.191014] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53449 primary records. [2025-09-30T22:10:19.193238] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-30T22:10:19.193350] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-30T22:10:19.193761] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-30T22:10:19.196939] [INFO ] [MAIN ] Derivative Progress: 881/2009 symbols completed. HZO took 1.2s. Estimated remaining: 7m 44s. Rate: 145.7 symbols/min [2025-09-30T22:10:19.197367] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:19.215152] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-30T22:10:19.215390] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-30T22:10:19.218476] [INFO ] [MAIN ] Derivative Progress: 882/2009 symbols completed. IAG took 1.2s. Estimated remaining: 7m 43s. Rate: 145.9 symbols/min [2025-09-30T22:10:19.218757] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:19.268415] [DEBUG] [LOCAL ] IBM: Loaded 53635 existing records from primary storage. [2025-09-30T22:10:19.283567] [INFO ] [MAIN ] IBM: Loaded 53635 primary data records. [2025-09-30T22:10:19.372388] [DEBUG] [LOCAL ] IBP: Loaded 28967 existing records from primary storage. [2025-09-30T22:10:19.391158] [INFO ] [MAIN ] IBP: Loaded 28967 primary data records. [2025-09-30T22:10:19.522886] [DEBUG] [LOCAL ] IBN: Loaded 52867 existing records from primary storage. [2025-09-30T22:10:19.578050] [INFO ] [MAIN ] IBN: Loaded 52867 primary data records. [2025-09-30T22:10:20.345881] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:20.347605] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53635 primary records. [2025-09-30T22:10:20.348802] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-30T22:10:20.376619] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:20.378944] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28967 primary records. [2025-09-30T22:10:20.379379] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-30T22:10:20.404095] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-30T22:10:20.417609] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-30T22:10:20.418183] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:20.418312] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-30T22:10:20.418396] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-30T22:10:20.419263] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52867 primary records. [2025-09-30T22:10:20.421389] [INFO ] [MAIN ] Derivative Progress: 883/2009 symbols completed. IBM took 1.3s. Estimated remaining: 7m 44s. Rate: 145.6 symbols/min [2025-09-30T22:10:20.424210] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-30T22:10:20.424426] [INFO ] [MAIN ] Derivative Progress: 884/2009 symbols completed. IBP took 1.2s. Estimated remaining: 7m 43s. Rate: 145.7 symbols/min [2025-09-30T22:10:20.441846] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-30T22:10:20.441956] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-30T22:10:20.445504] [INFO ] [MAIN ] Derivative Progress: 885/2009 symbols completed. IBN took 1.2s. Estimated remaining: 7m 42s. Rate: 145.9 symbols/min [2025-09-30T22:10:20.445986] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:20.446244] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:20.446147] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:20.513212] [DEBUG] [LOCAL ] IBTA: Loaded 37607 existing records from primary storage. [2025-09-30T22:10:20.530203] [INFO ] [MAIN ] IBTA: Loaded 37607 primary data records. [2025-09-30T22:10:20.530103] [DEBUG] [LOCAL ] ICL: Loaded 38406 existing records from primary storage. [2025-09-30T22:10:20.530497] [INFO ] [MAIN ] ICL: Loaded 38406 primary data records. [2025-09-30T22:10:20.775291] [DEBUG] [LOCAL ] ICE: Loaded 53003 existing records from primary storage. [2025-09-30T22:10:20.795374] [INFO ] [MAIN ] ICE: Loaded 53003 primary data records. [2025-09-30T22:10:21.591360] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:21.593902] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37607 primary records. [2025-09-30T22:10:21.594617] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-30T22:10:21.608951] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:21.609724] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38406 primary records. [2025-09-30T22:10:21.617411] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-30T22:10:21.643081] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-30T22:10:21.644314] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-30T22:10:21.644481] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-30T22:10:21.659984] [INFO ] [MAIN ] Derivative Progress: 886/2009 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 43s. Rate: 145.6 symbols/min [2025-09-30T22:10:21.660711] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:21.644581] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-30T22:10:21.660863] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:21.661901] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53003 primary records. [2025-09-30T22:10:21.664824] [INFO ] [MAIN ] Derivative Progress: 887/2009 symbols completed. ICL took 1.2s. Estimated remaining: 7m 42s. Rate: 145.7 symbols/min [2025-09-30T22:10:21.662193] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-30T22:10:21.665996] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:21.689162] [DEBUG] [LOCAL ] IDE: Loaded 8748 existing records from primary storage. [2025-09-30T22:10:21.690230] [INFO ] [MAIN ] IDE: Loaded 8748 primary data records. [2025-09-30T22:10:21.703830] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-30T22:10:21.720205] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-30T22:10:21.768261] [INFO ] [MAIN ] Derivative Progress: 888/2009 symbols completed. ICE took 1.3s. Estimated remaining: 7m 41s. Rate: 145.9 symbols/min [2025-09-30T22:10:21.786898] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:22.043502] [DEBUG] [LOCAL ] IDA: Loaded 32082 existing records from primary storage. [2025-09-30T22:10:22.044404] [INFO ] [MAIN ] IDA: Loaded 32082 primary data records. [2025-09-30T22:10:22.111529] [DEBUG] [LOCAL ] IDT: Loaded 17861 existing records from primary storage. [2025-09-30T22:10:22.152447] [INFO ] [MAIN ] IDT: Loaded 17861 primary data records. [2025-09-30T22:10:22.721069] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:22.722436] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8748 primary records. [2025-09-30T22:10:22.723005] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-30T22:10:22.743688] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-30T22:10:22.745040] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-30T22:10:22.747245] [INFO ] [MAIN ] Derivative Progress: 889/2009 symbols completed. IDE took 1.1s. Estimated remaining: 7m 41s. Rate: 145.6 symbols/min [2025-09-30T22:10:22.747510] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:22.761598] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:22.763444] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32082 primary records. [2025-09-30T22:10:22.763580] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-30T22:10:22.781871] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-30T22:10:22.784027] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-30T22:10:22.786584] [INFO ] [MAIN ] Derivative Progress: 890/2009 symbols completed. IDA took 1.1s. Estimated remaining: 7m 41s. Rate: 145.8 symbols/min [2025-09-30T22:10:22.787105] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:22.801172] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:22.801977] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17861 primary records. [2025-09-30T22:10:22.802091] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-30T22:10:22.827753] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-30T22:10:22.827885] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-30T22:10:22.830393] [INFO ] [MAIN ] Derivative Progress: 891/2009 symbols completed. IDT took 1.0s. Estimated remaining: 7m 40s. Rate: 145.9 symbols/min [2025-09-30T22:10:22.830677] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:22.848974] [DEBUG] [LOCAL ] IEX: Loaded 38324 existing records from primary storage. [2025-09-30T22:10:22.849332] [INFO ] [MAIN ] IEX: Loaded 38324 primary data records. [2025-09-30T22:10:22.982464] [DEBUG] [LOCAL ] IFN: Loaded 18249 existing records from primary storage. [2025-09-30T22:10:22.987463] [INFO ] [MAIN ] IFN: Loaded 18249 primary data records. [2025-09-30T22:10:23.370017] [DEBUG] [LOCAL ] IFF: Loaded 50986 existing records from primary storage. [2025-09-30T22:10:23.376002] [INFO ] [MAIN ] IFF: Loaded 50986 primary data records. [2025-09-30T22:10:23.965294] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:23.966743] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38324 primary records. [2025-09-30T22:10:23.969166] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-30T22:10:24.011339] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:24.010786] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-30T22:10:24.012880] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-30T22:10:24.015199] [INFO ] [MAIN ] Derivative Progress: 892/2009 symbols completed. IEX took 1.3s. Estimated remaining: 7m 40s. Rate: 145.6 symbols/min [2025-09-30T22:10:24.018402] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:24.018712] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18249 primary records. [2025-09-30T22:10:24.019478] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-30T22:10:24.045099] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:24.052066] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50986 primary records. [2025-09-30T22:10:24.053259] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-30T22:10:24.079356] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-30T22:10:24.080315] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-30T22:10:24.083782] [INFO ] [MAIN ] Derivative Progress: 893/2009 symbols completed. IFN took 1.3s. Estimated remaining: 7m 39s. Rate: 145.8 symbols/min [2025-09-30T22:10:24.092060] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:24.093674] [DEBUG] [LOCAL ] IFS: Loaded 22986 existing records from primary storage. [2025-09-30T22:10:24.095059] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-30T22:10:24.094537] [INFO ] [MAIN ] IFS: Loaded 22986 primary data records. [2025-09-30T22:10:24.095402] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-30T22:10:24.103137] [INFO ] [MAIN ] Derivative Progress: 894/2009 symbols completed. IFF took 1.3s. Estimated remaining: 7m 38s. Rate: 145.9 symbols/min [2025-09-30T22:10:24.159899] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:24.206388] [DEBUG] [LOCAL ] IGA: Loaded 9775 existing records from primary storage. [2025-09-30T22:10:24.220062] [INFO ] [MAIN ] IGA: Loaded 9775 primary data records. [2025-09-30T22:10:24.539965] [DEBUG] [LOCAL ] IGD: Loaded 19008 existing records from primary storage. [2025-09-30T22:10:24.559539] [INFO ] [MAIN ] IGD: Loaded 19008 primary data records. [2025-09-30T22:10:25.153544] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:25.154973] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22986 primary records. [2025-09-30T22:10:25.156897] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-30T22:10:25.186123] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:25.188600] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9775 primary records. [2025-09-30T22:10:25.190048] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-30T22:10:25.193033] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-30T22:10:25.193426] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-30T22:10:25.202982] [INFO ] [MAIN ] Derivative Progress: 895/2009 symbols completed. IFS took 1.2s. Estimated remaining: 7m 39s. Rate: 145.6 symbols/min [2025-09-30T22:10:25.209153] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:25.214944] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-30T22:10:25.215172] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-30T22:10:25.217861] [INFO ] [MAIN ] Derivative Progress: 896/2009 symbols completed. IGA took 1.1s. Estimated remaining: 7m 38s. Rate: 145.8 symbols/min [2025-09-30T22:10:25.218375] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:25.233283] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:25.234273] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19008 primary records. [2025-09-30T22:10:25.234507] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-30T22:10:25.238183] [DEBUG] [LOCAL ] IGI: Loaded 3617 existing records from primary storage. [2025-09-30T22:10:25.238678] [INFO ] [MAIN ] IGI: Loaded 3617 primary data records. [2025-09-30T22:10:25.314811] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-30T22:10:25.323498] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-30T22:10:25.348562] [INFO ] [MAIN ] Derivative Progress: 897/2009 symbols completed. IGD took 1.2s. Estimated remaining: 7m 37s. Rate: 145.9 symbols/min [2025-09-30T22:10:25.359934] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:25.433872] [DEBUG] [LOCAL ] IGR: Loaded 30505 existing records from primary storage. [2025-09-30T22:10:25.457305] [INFO ] [MAIN ] IGR: Loaded 30505 primary data records. [2025-09-30T22:10:25.456462] [DEBUG] [LOCAL ] IH: Loaded 3225 existing records from primary storage. [2025-09-30T22:10:25.473634] [INFO ] [MAIN ] IH: Loaded 3225 primary data records. [2025-09-30T22:10:26.301466] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:26.302890] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3617 primary records. [2025-09-30T22:10:26.304503] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-30T22:10:26.322279] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-30T22:10:26.322982] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-30T22:10:26.325672] [INFO ] [MAIN ] Derivative Progress: 898/2009 symbols completed. IGI took 1.1s. Estimated remaining: 7m 38s. Rate: 145.7 symbols/min [2025-09-30T22:10:26.343982] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:26.345984] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3225 primary records. [2025-09-30T22:10:26.347040] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-30T22:10:26.373328] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:26.376905] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-30T22:10:26.378034] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30505 primary records. [2025-09-30T22:10:26.378157] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-30T22:10:26.380768] [INFO ] [MAIN ] Derivative Progress: 899/2009 symbols completed. IH took 1.0s. Estimated remaining: 7m 37s. Rate: 145.8 symbols/min [2025-09-30T22:10:26.380888] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-30T22:10:26.397131] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-30T22:10:26.397232] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-30T22:10:26.399701] [INFO ] [MAIN ] Derivative Progress: 900/2009 symbols completed. IGR took 1.2s. Estimated remaining: 7m 36s. Rate: 146.0 symbols/min [2025-09-30T22:10:26.400159] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:26.400304] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:26.400458] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:26.410331] [DEBUG] [LOCAL ] IHD: Loaded 6983 existing records from primary storage. [2025-09-30T22:10:26.410498] [INFO ] [MAIN ] IHD: Loaded 6983 primary data records. [2025-09-30T22:10:26.555201] [DEBUG] [LOCAL ] IHG: Loaded 24441 existing records from primary storage. [2025-09-30T22:10:26.565771] [INFO ] [MAIN ] IHG: Loaded 24441 primary data records. [2025-09-30T22:10:26.863796] [DEBUG] [LOCAL ] IHS: Loaded 39106 existing records from primary storage. [2025-09-30T22:10:26.872404] [INFO ] [MAIN ] IHS: Loaded 39106 primary data records. [2025-09-30T22:10:27.491515] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:27.492341] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 6983 primary records. [2025-09-30T22:10:27.492681] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-30T22:10:27.512494] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-30T22:10:27.512957] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-30T22:10:27.515568] [INFO ] [MAIN ] Derivative Progress: 901/2009 symbols completed. IHD took 1.1s. Estimated remaining: 7m 36s. Rate: 145.7 symbols/min [2025-09-30T22:10:27.524038] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:27.530014] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:27.531161] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24441 primary records. [2025-09-30T22:10:27.531424] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-30T22:10:27.556365] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-30T22:10:27.554117] [DEBUG] [LOCAL ] IIF: Loaded 5721 existing records from primary storage. [2025-09-30T22:10:27.556571] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-30T22:10:27.556726] [INFO ] [MAIN ] IIF: Loaded 5721 primary data records. [2025-09-30T22:10:27.571016] [INFO ] [MAIN ] Derivative Progress: 902/2009 symbols completed. IHG took 1.2s. Estimated remaining: 7m 35s. Rate: 145.8 symbols/min [2025-09-30T22:10:27.632236] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:27.645187] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:27.672527] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39106 primary records. [2025-09-30T22:10:27.684453] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-30T22:10:27.920596] [DEBUG] [LOCAL ] IIIN: Loaded 16449 existing records from primary storage. [2025-09-30T22:10:27.921499] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-30T22:10:27.921595] [INFO ] [MAIN ] IIIN: Loaded 16449 primary data records. [2025-09-30T22:10:27.921700] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-30T22:10:27.923957] [INFO ] [MAIN ] Derivative Progress: 903/2009 symbols completed. IHS took 1.5s. Estimated remaining: 7m 35s. Rate: 145.9 symbols/min [2025-09-30T22:10:27.952853] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:28.163561] [DEBUG] [LOCAL ] IIM: Loaded 15962 existing records from primary storage. [2025-09-30T22:10:28.296523] [INFO ] [MAIN ] IIM: Loaded 15962 primary data records. [2025-09-30T22:10:28.464502] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:28.520679] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5721 primary records. [2025-09-30T22:10:28.520865] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-30T22:10:28.660771] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-30T22:10:28.661002] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-30T22:10:28.663226] [INFO ] [MAIN ] Derivative Progress: 904/2009 symbols completed. IIF took 1.1s. Estimated remaining: 7m 35s. Rate: 145.7 symbols/min [2025-09-30T22:10:28.663500] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:28.686051] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:28.687091] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16449 primary records. [2025-09-30T22:10:28.687286] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-30T22:10:28.704029] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-30T22:10:28.711524] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-30T22:10:28.714292] [INFO ] [MAIN ] Derivative Progress: 905/2009 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 34s. Rate: 145.9 symbols/min [2025-09-30T22:10:28.716470] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:28.740273] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:28.742037] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15962 primary records. [2025-09-30T22:10:28.742930] [DEBUG] [LOCAL ] IIPR: Loaded 29709 existing records from primary storage. [2025-09-30T22:10:28.742268] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-30T22:10:28.743831] [INFO ] [MAIN ] IIPR: Loaded 29709 primary data records. [2025-09-30T22:10:28.911606] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-30T22:10:28.937731] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-30T22:10:28.995600] [INFO ] [MAIN ] Derivative Progress: 906/2009 symbols completed. IIM took 1.0s. Estimated remaining: 7m 34s. Rate: 145.9 symbols/min [2025-09-30T22:10:29.138579] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:29.155748] [DEBUG] [LOCAL ] IMAX: Loaded 42737 existing records from primary storage. [2025-09-30T22:10:29.156338] [INFO ] [MAIN ] IMAX: Loaded 42737 primary data records. [2025-09-30T22:10:29.522390] [DEBUG] [LOCAL ] INFA: Loaded 49666 existing records from primary storage. [2025-09-30T22:10:29.524174] [INFO ] [MAIN ] INFA: Loaded 49666 primary data records. [2025-09-30T22:10:29.580026] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:29.607418] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29709 primary records. [2025-09-30T22:10:29.644866] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-30T22:10:29.786834] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-30T22:10:29.806546] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-30T22:10:29.889588] [INFO ] [MAIN ] Derivative Progress: 907/2009 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 34s. Rate: 145.7 symbols/min [2025-09-30T22:10:29.943231] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:29.966215] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:29.967916] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42737 primary records. [2025-09-30T22:10:29.968176] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-30T22:10:29.988102] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-30T22:10:29.988266] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-30T22:10:29.990963] [INFO ] [MAIN ] Derivative Progress: 908/2009 symbols completed. IMAX took 1.3s. Estimated remaining: 7m 33s. Rate: 145.9 symbols/min [2025-09-30T22:10:29.991489] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:30.011406] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:30.012242] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49666 primary records. [2025-09-30T22:10:30.012345] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-30T22:10:30.031246] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-30T22:10:30.031395] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-30T22:10:30.034152] [INFO ] [MAIN ] Derivative Progress: 909/2009 symbols completed. INFA took 0.9s. Estimated remaining: 7m 32s. Rate: 146.0 symbols/min [2025-09-30T22:10:30.034505] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:30.097803] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-30T22:10:30.098710] [INFO ] [MAIN ] INFY: Loaded 53598 primary data records. [2025-09-30T22:10:30.203240] [DEBUG] [LOCAL ] ING: Loaded 50722 existing records from primary storage. [2025-09-30T22:10:30.218609] [DEBUG] [LOCAL ] INGM: Loaded 28628 existing records from primary storage. [2025-09-30T22:10:30.245728] [INFO ] [MAIN ] INGM: Loaded 28628 primary data records. [2025-09-30T22:10:30.245273] [INFO ] [MAIN ] ING: Loaded 50722 primary data records. [2025-09-30T22:10:31.191803] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:31.194024] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53598 primary records. [2025-09-30T22:10:31.194563] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-30T22:10:31.216022] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-30T22:10:31.217684] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-30T22:10:31.220139] [INFO ] [MAIN ] Derivative Progress: 910/2009 symbols completed. INFY took 1.3s. Estimated remaining: 7m 33s. Rate: 145.7 symbols/min [2025-09-30T22:10:31.221849] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:31.235246] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:31.238456] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28628 primary records. [2025-09-30T22:10:31.238825] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-30T22:10:31.262485] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:31.266070] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50722 primary records. [2025-09-30T22:10:31.266970] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-30T22:10:31.288056] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-30T22:10:31.289735] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-30T22:10:31.290631] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-30T22:10:31.293186] [INFO ] [MAIN ] Derivative Progress: 911/2009 symbols completed. INGM took 1.3s. Estimated remaining: 7m 32s. Rate: 145.8 symbols/min [2025-09-30T22:10:31.293708] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:31.293577] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-30T22:10:31.306102] [INFO ] [MAIN ] Derivative Progress: 912/2009 symbols completed. ING took 1.3s. Estimated remaining: 7m 31s. Rate: 146.0 symbols/min [2025-09-30T22:10:31.306368] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:31.323601] [DEBUG] [LOCAL ] INGR: Loaded 33275 existing records from primary storage. [2025-09-30T22:10:31.323836] [INFO ] [MAIN ] INGR: Loaded 33275 primary data records. [2025-09-30T22:10:31.730897] [DEBUG] [LOCAL ] INN: Loaded 41730 existing records from primary storage. [2025-09-30T22:10:31.742776] [DEBUG] [LOCAL ] INSP: Loaded 37045 existing records from primary storage. [2025-09-30T22:10:31.742963] [INFO ] [MAIN ] INSP: Loaded 37045 primary data records. [2025-09-30T22:10:31.741408] [INFO ] [MAIN ] INN: Loaded 41730 primary data records. [2025-09-30T22:10:32.511733] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:32.513571] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33275 primary records. [2025-09-30T22:10:32.513997] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-30T22:10:32.536582] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-30T22:10:32.537133] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-30T22:10:32.540257] [INFO ] [MAIN ] Derivative Progress: 913/2009 symbols completed. INGR took 1.3s. Estimated remaining: 7m 31s. Rate: 145.7 symbols/min [2025-09-30T22:10:32.561975] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:32.564421] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 37045 primary records. [2025-09-30T22:10:32.564511] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-30T22:10:32.590486] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:32.595506] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-30T22:10:32.595771] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-30T22:10:32.599405] [INFO ] [MAIN ] Derivative Progress: 914/2009 symbols completed. INSP took 1.3s. Estimated remaining: 7m 31s. Rate: 145.8 symbols/min [2025-09-30T22:10:32.596593] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41730 primary records. [2025-09-30T22:10:32.599844] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-30T22:10:32.618004] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-30T22:10:32.618108] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-30T22:10:32.620324] [INFO ] [MAIN ] Derivative Progress: 915/2009 symbols completed. INN took 1.3s. Estimated remaining: 7m 30s. Rate: 146.0 symbols/min [2025-09-30T22:10:32.620881] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:32.621105] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:32.621024] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:32.684131] [DEBUG] [LOCAL ] INVX: Loaded 29027 existing records from primary storage. [2025-09-30T22:10:32.684382] [INFO ] [MAIN ] INVX: Loaded 29027 primary data records. [2025-09-30T22:10:32.833010] [DEBUG] [LOCAL ] INVH: Loaded 53130 existing records from primary storage. [2025-09-30T22:10:32.833519] [INFO ] [MAIN ] INVH: Loaded 53130 primary data records. [2025-09-30T22:10:32.832918] [DEBUG] [LOCAL ] INSW: Loaded 40060 existing records from primary storage. [2025-09-30T22:10:32.844112] [INFO ] [MAIN ] INSW: Loaded 40060 primary data records. [2025-09-30T22:10:33.783779] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:33.784588] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29027 primary records. [2025-09-30T22:10:33.785148] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-30T22:10:33.804152] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-30T22:10:33.804366] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-30T22:10:33.806410] [INFO ] [MAIN ] Derivative Progress: 916/2009 symbols completed. INVX took 1.2s. Estimated remaining: 7m 30s. Rate: 145.7 symbols/min [2025-09-30T22:10:33.806791] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:33.825954] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:33.827497] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53130 primary records. [2025-09-30T22:10:33.827713] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-30T22:10:33.852711] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:33.854495] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40060 primary records. [2025-09-30T22:10:33.854917] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-30T22:10:33.860491] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-09-30T22:10:33.860866] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-30T22:10:33.871713] [INFO ] [MAIN ] Derivative Progress: 917/2009 symbols completed. INVH took 1.3s. Estimated remaining: 7m 29s. Rate: 145.8 symbols/min [2025-09-30T22:10:33.874701] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:33.880227] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-30T22:10:33.894063] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-30T22:10:33.896285] [INFO ] [MAIN ] Derivative Progress: 918/2009 symbols completed. INSW took 1.3s. Estimated remaining: 7m 29s. Rate: 145.9 symbols/min [2025-09-30T22:10:33.896675] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:33.921007] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-30T22:10:33.921189] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-30T22:10:34.271702] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-30T22:10:34.313261] [INFO ] [MAIN ] IOT: Loaded 53470 primary data records. [2025-09-30T22:10:34.314345] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-09-30T22:10:34.336390] [INFO ] [MAIN ] IP: Loaded 53313 primary data records. [2025-09-30T22:10:35.001349] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:35.002397] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-30T22:10:35.002795] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-30T22:10:35.022367] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-30T22:10:35.023112] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-30T22:10:35.025267] [INFO ] [MAIN ] Derivative Progress: 919/2009 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 29s. Rate: 145.7 symbols/min [2025-09-30T22:10:35.025725] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:35.047199] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:35.048261] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53313 primary records. [2025-09-30T22:10:35.048496] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-30T22:10:35.075214] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:35.079616] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53470 primary records. [2025-09-30T22:10:35.081136] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-30T22:10:35.080933] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-30T22:10:35.081754] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-30T22:10:35.084171] [INFO ] [MAIN ] Derivative Progress: 920/2009 symbols completed. IP took 1.2s. Estimated remaining: 7m 28s. Rate: 145.8 symbols/min [2025-09-30T22:10:35.084878] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:35.101343] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-30T22:10:35.101526] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-30T22:10:35.104018] [INFO ] [MAIN ] Derivative Progress: 921/2009 symbols completed. IOT took 1.2s. Estimated remaining: 7m 27s. Rate: 146.0 symbols/min [2025-09-30T22:10:35.104270] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:35.142790] [DEBUG] [LOCAL ] IPI: Loaded 21401 existing records from primary storage. [2025-09-30T22:10:35.164055] [INFO ] [MAIN ] IPI: Loaded 21401 primary data records. [2025-09-30T22:10:35.207087] [DEBUG] [LOCAL ] IQI: Loaded 18036 existing records from primary storage. [2025-09-30T22:10:35.189763] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-09-30T22:10:35.220257] [INFO ] [MAIN ] IQI: Loaded 18036 primary data records. [2025-09-30T22:10:35.220150] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-09-30T22:10:36.233256] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:36.234400] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21401 primary records. [2025-09-30T22:10:36.234595] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-30T22:10:36.256390] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-30T22:10:36.256546] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-30T22:10:36.261205] [INFO ] [MAIN ] Derivative Progress: 922/2009 symbols completed. IPI took 1.2s. Estimated remaining: 7m 28s. Rate: 145.7 symbols/min [2025-09-30T22:10:36.263608] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:36.286027] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:36.292983] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-09-30T22:10:36.293145] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-30T22:10:36.292068] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:36.294426] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18036 primary records. [2025-09-30T22:10:36.295051] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-30T22:10:36.326900] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-30T22:10:36.328053] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-30T22:10:36.328899] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-30T22:10:36.331712] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-30T22:10:36.331577] [INFO ] [MAIN ] Derivative Progress: 923/2009 symbols completed. IQI took 1.2s. Estimated remaining: 7m 27s. Rate: 145.8 symbols/min [2025-09-30T22:10:36.334690] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:36.334845] [INFO ] [MAIN ] Derivative Progress: 924/2009 symbols completed. IPG took 1.3s. Estimated remaining: 7m 26s. Rate: 146.0 symbols/min [2025-09-30T22:10:36.335493] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:36.379638] [DEBUG] [LOCAL ] IQV: Loaded 50073 existing records from primary storage. [2025-09-30T22:10:36.390915] [INFO ] [MAIN ] IQV: Loaded 50073 primary data records. [2025-09-30T22:10:36.533610] [DEBUG] [LOCAL ] IRM: Loaded 49336 existing records from primary storage. [2025-09-30T22:10:36.544734] [INFO ] [MAIN ] IRM: Loaded 49336 primary data records. [2025-09-30T22:10:36.699777] [DEBUG] [LOCAL ] IR: Loaded 52685 existing records from primary storage. [2025-09-30T22:10:36.832348] [INFO ] [MAIN ] IR: Loaded 52685 primary data records. [2025-09-30T22:10:37.440856] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:37.442092] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50073 primary records. [2025-09-30T22:10:37.442360] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-30T22:10:37.461529] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-30T22:10:37.462984] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-30T22:10:37.466103] [INFO ] [MAIN ] Derivative Progress: 925/2009 symbols completed. IQV took 1.2s. Estimated remaining: 7m 26s. Rate: 145.7 symbols/min [2025-09-30T22:10:37.468016] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:37.501788] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:37.502241] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:37.504156] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52685 primary records. [2025-09-30T22:10:37.503220] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49336 primary records. [2025-09-30T22:10:37.504489] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-30T22:10:37.504412] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-30T22:10:37.545444] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-30T22:10:37.545565] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-30T22:10:37.548053] [INFO ] [MAIN ] Derivative Progress: 926/2009 symbols completed. IR took 1.2s. Estimated remaining: 7m 26s. Rate: 145.8 symbols/min [2025-09-30T22:10:37.548838] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:37.545046] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-30T22:10:37.557028] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-30T22:10:37.561302] [DEBUG] [LOCAL ] IRS: Loaded 21827 existing records from primary storage. [2025-09-30T22:10:37.560329] [INFO ] [MAIN ] Derivative Progress: 927/2009 symbols completed. IRM took 1.2s. Estimated remaining: 7m 25s. Rate: 146.0 symbols/min [2025-09-30T22:10:37.561687] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:37.561854] [INFO ] [MAIN ] IRS: Loaded 21827 primary data records. [2025-09-30T22:10:37.691407] [DEBUG] [LOCAL ] ISD: Loaded 15486 existing records from primary storage. [2025-09-30T22:10:37.692018] [INFO ] [MAIN ] ISD: Loaded 15486 primary data records. [2025-09-30T22:10:38.039240] [DEBUG] [LOCAL ] IRT: Loaded 50402 existing records from primary storage. [2025-09-30T22:10:38.050907] [INFO ] [MAIN ] IRT: Loaded 50402 primary data records. [2025-09-30T22:10:38.632103] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:38.634459] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21827 primary records. [2025-09-30T22:10:38.634907] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-30T22:10:38.669470] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:38.672073] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15486 primary records. [2025-09-30T22:10:38.672436] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-30T22:10:38.673983] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-30T22:10:38.676002] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-30T22:10:38.685502] [INFO ] [MAIN ] Derivative Progress: 928/2009 symbols completed. IRS took 1.2s. Estimated remaining: 7m 25s. Rate: 145.7 symbols/min [2025-09-30T22:10:38.706601] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:38.708397] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50402 primary records. [2025-09-30T22:10:38.708490] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-30T22:10:38.707609] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-30T22:10:38.708957] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-30T22:10:38.711753] [INFO ] [MAIN ] Derivative Progress: 929/2009 symbols completed. ISD took 1.2s. Estimated remaining: 7m 24s. Rate: 145.8 symbols/min [2025-09-30T22:10:38.728279] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-30T22:10:38.728385] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-30T22:10:38.731245] [INFO ] [MAIN ] Derivative Progress: 930/2009 symbols completed. IRT took 1.2s. Estimated remaining: 7m 23s. Rate: 146.0 symbols/min [2025-09-30T22:10:38.731699] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:38.733994] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:38.731623] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:38.797919] [DEBUG] [LOCAL ] ITGR: Loaded 31521 existing records from primary storage. [2025-09-30T22:10:38.798280] [INFO ] [MAIN ] ITGR: Loaded 31521 primary data records. [2025-09-30T22:10:38.799392] [DEBUG] [LOCAL ] ITT: Loaded 32807 existing records from primary storage. [2025-09-30T22:10:38.804622] [INFO ] [MAIN ] ITT: Loaded 32807 primary data records. [2025-09-30T22:10:38.886554] [DEBUG] [LOCAL ] IT: Loaded 41916 existing records from primary storage. [2025-09-30T22:10:38.938923] [INFO ] [MAIN ] IT: Loaded 41916 primary data records. [2025-09-30T22:10:39.816435] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:39.830751] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31521 primary records. [2025-09-30T22:10:39.831785] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-30T22:10:39.834035] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:39.835363] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32807 primary records. [2025-09-30T22:10:39.835491] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-30T22:10:39.865230] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-30T22:10:39.873327] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:39.874144] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 41916 primary records. [2025-09-30T22:10:39.877671] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-30T22:10:39.882565] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-30T22:10:39.882494] [INFO ] [MAIN ] Derivative Progress: 931/2009 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 24s. Rate: 145.7 symbols/min [2025-09-30T22:10:39.883754] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:39.900416] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-30T22:10:39.900814] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-30T22:10:39.903553] [INFO ] [MAIN ] Derivative Progress: 932/2009 symbols completed. ITT took 1.2s. Estimated remaining: 7m 23s. Rate: 145.8 symbols/min [2025-09-30T22:10:39.904026] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:39.909047] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-30T22:10:39.909185] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-30T22:10:39.911879] [INFO ] [MAIN ] Derivative Progress: 933/2009 symbols completed. IT took 1.2s. Estimated remaining: 7m 22s. Rate: 146.0 symbols/min [2025-09-30T22:10:39.912168] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:39.980192] [DEBUG] [LOCAL ] ITUB: Loaded 53327 existing records from primary storage. [2025-09-30T22:10:39.980875] [INFO ] [MAIN ] ITUB: Loaded 53327 primary data records. [2025-09-30T22:10:40.055291] [DEBUG] [LOCAL ] ITW: Loaded 45869 existing records from primary storage. [2025-09-30T22:10:40.091220] [INFO ] [MAIN ] ITW: Loaded 45869 primary data records. [2025-09-30T22:10:40.141484] [DEBUG] [LOCAL ] IVR: Loaded 47877 existing records from primary storage. [2025-09-30T22:10:40.153283] [INFO ] [MAIN ] IVR: Loaded 47877 primary data records. [2025-09-30T22:10:41.066111] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:41.067243] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53327 primary records. [2025-09-30T22:10:41.067465] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-30T22:10:41.112531] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:41.114572] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45869 primary records. [2025-09-30T22:10:41.113462] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:41.116164] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47877 primary records. [2025-09-30T22:10:41.115273] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-30T22:10:41.117028] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-30T22:10:41.117635] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-30T22:10:41.118819] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-30T22:10:41.121560] [INFO ] [MAIN ] Derivative Progress: 934/2009 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 23s. Rate: 145.7 symbols/min [2025-09-30T22:10:41.128978] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:41.152900] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-30T22:10:41.152438] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-30T22:10:41.152998] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-30T22:10:41.156365] [INFO ] [MAIN ] Derivative Progress: 935/2009 symbols completed. IVR took 1.2s. Estimated remaining: 7m 22s. Rate: 145.8 symbols/min [2025-09-30T22:10:41.156617] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-30T22:10:41.156792] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:41.159697] [INFO ] [MAIN ] Derivative Progress: 936/2009 symbols completed. ITW took 1.3s. Estimated remaining: 7m 21s. Rate: 146.0 symbols/min [2025-09-30T22:10:41.160135] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:41.195959] [DEBUG] [LOCAL ] IX: Loaded 22541 existing records from primary storage. [2025-09-30T22:10:41.196111] [INFO ] [MAIN ] IX: Loaded 22541 primary data records. [2025-09-30T22:10:41.308691] [DEBUG] [LOCAL ] IVT: Loaded 30715 existing records from primary storage. [2025-09-30T22:10:41.327916] [INFO ] [MAIN ] IVT: Loaded 30715 primary data records. [2025-09-30T22:10:41.517636] [DEBUG] [LOCAL ] IVZ: Loaded 53127 existing records from primary storage. [2025-09-30T22:10:41.522966] [INFO ] [MAIN ] IVZ: Loaded 53127 primary data records. [2025-09-30T22:10:42.300487] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:42.301496] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22541 primary records. [2025-09-30T22:10:42.301781] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-30T22:10:42.327700] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:42.328907] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30715 primary records. [2025-09-30T22:10:42.328992] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-30T22:10:42.347801] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-30T22:10:42.350342] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-30T22:10:42.353319] [INFO ] [MAIN ] Derivative Progress: 937/2009 symbols completed. IVT took 1.2s. Estimated remaining: 7m 21s. Rate: 145.7 symbols/min [2025-09-30T22:10:42.356484] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-30T22:10:42.356592] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-30T22:10:42.358743] [INFO ] [MAIN ] Derivative Progress: 938/2009 symbols completed. IX took 1.2s. Estimated remaining: 7m 21s. Rate: 145.9 symbols/min [2025-09-30T22:10:42.356754] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:42.359261] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:42.374906] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:42.375702] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53127 primary records. [2025-09-30T22:10:42.375814] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-30T22:10:42.393807] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-30T22:10:42.394048] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-30T22:10:42.396589] [INFO ] [MAIN ] Derivative Progress: 939/2009 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 20s. Rate: 146.0 symbols/min [2025-09-30T22:10:42.396875] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:42.449285] [DEBUG] [LOCAL ] J: Loaded 40135 existing records from primary storage. [2025-09-30T22:10:42.450076] [INFO ] [MAIN ] J: Loaded 40135 primary data records. [2025-09-30T22:10:42.475211] [DEBUG] [LOCAL ] JBGS: Loaded 42396 existing records from primary storage. [2025-09-30T22:10:42.497452] [INFO ] [MAIN ] JBGS: Loaded 42396 primary data records. [2025-09-30T22:10:42.666638] [DEBUG] [LOCAL ] JBI: Loaded 43584 existing records from primary storage. [2025-09-30T22:10:42.698280] [INFO ] [MAIN ] JBI: Loaded 43584 primary data records. [2025-09-30T22:10:43.548054] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:43.549259] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40135 primary records. [2025-09-30T22:10:43.549667] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-30T22:10:43.567599] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:43.581306] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42396 primary records. [2025-09-30T22:10:43.587163] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-30T22:10:43.587688] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-30T22:10:43.587583] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-30T22:10:43.591328] [INFO ] [MAIN ] Derivative Progress: 940/2009 symbols completed. J took 1.2s. Estimated remaining: 7m 20s. Rate: 145.7 symbols/min [2025-09-30T22:10:43.603617] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:43.631720] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-30T22:10:43.632136] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:43.633050] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-30T22:10:43.636169] [INFO ] [MAIN ] Derivative Progress: 941/2009 symbols completed. JBGS took 1.3s. Estimated remaining: 7m 19s. Rate: 145.8 symbols/min [2025-09-30T22:10:43.636538] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:43.632964] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43584 primary records. [2025-09-30T22:10:43.636770] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-30T22:10:43.656826] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-30T22:10:43.657073] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-30T22:10:43.659805] [INFO ] [MAIN ] Derivative Progress: 942/2009 symbols completed. JBI took 1.3s. Estimated remaining: 7m 19s. Rate: 146.0 symbols/min [2025-09-30T22:10:43.660173] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:43.689858] [DEBUG] [LOCAL ] JCE: Loaded 6688 existing records from primary storage. [2025-09-30T22:10:43.704322] [INFO ] [MAIN ] JCE: Loaded 6688 primary data records. [2025-09-30T22:10:43.711320] [DEBUG] [LOCAL ] JBND: Loaded 25895 existing records from primary storage. [2025-09-30T22:10:43.761227] [INFO ] [MAIN ] JBND: Loaded 25895 primary data records. [2025-09-30T22:10:43.923832] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-09-30T22:10:43.963934] [INFO ] [MAIN ] JBL: Loaded 48383 primary data records. [2025-09-30T22:10:45.082084] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:45.083526] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6688 primary records. [2025-09-30T22:10:45.083625] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-30T22:10:45.102971] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-30T22:10:45.104241] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-30T22:10:45.106308] [INFO ] [MAIN ] Derivative Progress: 943/2009 symbols completed. JCE took 1.4s. Estimated remaining: 7m 19s. Rate: 145.6 symbols/min [2025-09-30T22:10:45.121174] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:45.122084] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 25895 primary records. [2025-09-30T22:10:45.122174] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-30T22:10:45.155377] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-30T22:10:45.154188] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:45.156525] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48383 primary records. [2025-09-30T22:10:45.156628] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-30T22:10:45.155539] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-30T22:10:45.159629] [INFO ] [MAIN ] Derivative Progress: 944/2009 symbols completed. JBND took 1.5s. Estimated remaining: 7m 18s. Rate: 145.7 symbols/min [2025-09-30T22:10:45.175040] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-30T22:10:45.175118] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-30T22:10:45.178296] [INFO ] [MAIN ] Derivative Progress: 945/2009 symbols completed. JBL took 1.6s. Estimated remaining: 7m 18s. Rate: 145.9 symbols/min [2025-09-30T22:10:45.178800] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:45.178918] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:45.178993] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:45.256737] [DEBUG] [LOCAL ] JCI: Loaded 53543 existing records from primary storage. [2025-09-30T22:10:45.257495] [INFO ] [MAIN ] JCI: Loaded 53543 primary data records. [2025-09-30T22:10:45.323406] [DEBUG] [LOCAL ] JELD: Loaded 46062 existing records from primary storage. [2025-09-30T22:10:45.400757] [DEBUG] [LOCAL ] JEF: Loaded 50008 existing records from primary storage. [2025-09-30T22:10:45.378254] [INFO ] [MAIN ] JELD: Loaded 46062 primary data records. [2025-09-30T22:10:45.401225] [INFO ] [MAIN ] JEF: Loaded 50008 primary data records. [2025-09-30T22:10:46.302874] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:46.304254] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53543 primary records. [2025-09-30T22:10:46.304482] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-30T22:10:46.328452] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-30T22:10:46.328941] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-30T22:10:46.331237] [INFO ] [MAIN ] Derivative Progress: 946/2009 symbols completed. JCI took 1.2s. Estimated remaining: 7m 18s. Rate: 145.6 symbols/min [2025-09-30T22:10:46.351254] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:46.356736] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:46.358199] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46062 primary records. [2025-09-30T22:10:46.357348] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:46.359111] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50008 primary records. [2025-09-30T22:10:46.359169] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-30T22:10:46.359841] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-30T22:10:46.393436] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-30T22:10:46.395360] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-30T22:10:46.395601] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-30T22:10:46.395544] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-30T22:10:46.398187] [INFO ] [MAIN ] Derivative Progress: 947/2009 symbols completed. JELD took 1.2s. Estimated remaining: 7m 17s. Rate: 145.7 symbols/min [2025-09-30T22:10:46.401454] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:46.406154] [INFO ] [MAIN ] Derivative Progress: 948/2009 symbols completed. JEF took 1.2s. Estimated remaining: 7m 16s. Rate: 145.9 symbols/min [2025-09-30T22:10:46.406822] [DEBUG] [LOCAL ] JEQ: Loaded 8895 existing records from primary storage. [2025-09-30T22:10:46.406914] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:46.407092] [INFO ] [MAIN ] JEQ: Loaded 8895 primary data records. [2025-09-30T22:10:46.562617] [DEBUG] [LOCAL ] JGH: Loaded 11028 existing records from primary storage. [2025-09-30T22:10:46.590098] [INFO ] [MAIN ] JGH: Loaded 11028 primary data records. [2025-09-30T22:10:46.781335] [DEBUG] [LOCAL ] JFR: Loaded 30656 existing records from primary storage. [2025-09-30T22:10:46.939425] [INFO ] [MAIN ] JFR: Loaded 30656 primary data records. [2025-09-30T22:10:47.564810] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:47.568923] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8895 primary records. [2025-09-30T22:10:47.569686] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-30T22:10:47.584929] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:47.593382] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 11028 primary records. [2025-09-30T22:10:47.599269] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-30T22:10:47.609809] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-30T22:10:47.610919] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-30T22:10:47.612904] [INFO ] [MAIN ] Derivative Progress: 949/2009 symbols completed. JEQ took 1.3s. Estimated remaining: 7m 17s. Rate: 145.6 symbols/min [2025-09-30T22:10:47.616812] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:47.623257] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-30T22:10:47.623385] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-30T22:10:47.625818] [INFO ] [MAIN ] Derivative Progress: 950/2009 symbols completed. JGH took 1.2s. Estimated remaining: 7m 16s. Rate: 145.7 symbols/min [2025-09-30T22:10:47.626178] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:47.639776] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:47.640571] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30656 primary records. [2025-09-30T22:10:47.640807] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-30T22:10:47.663113] [DEBUG] [LOCAL ] JHI: Loaded 3583 existing records from primary storage. [2025-09-30T22:10:47.664000] [INFO ] [MAIN ] JHI: Loaded 3583 primary data records. [2025-09-30T22:10:47.709130] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-30T22:10:47.743423] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-30T22:10:47.762938] [INFO ] [MAIN ] Derivative Progress: 951/2009 symbols completed. JFR took 1.4s. Estimated remaining: 7m 15s. Rate: 145.8 symbols/min [2025-09-30T22:10:47.763347] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:48.029265] [DEBUG] [LOCAL ] JHS: Loaded 2831 existing records from primary storage. [2025-09-30T22:10:48.026286] [DEBUG] [LOCAL ] JHG: Loaded 47675 existing records from primary storage. [2025-09-30T22:10:48.029615] [INFO ] [MAIN ] JHG: Loaded 47675 primary data records. [2025-09-30T22:10:48.029447] [INFO ] [MAIN ] JHS: Loaded 2831 primary data records. [2025-09-30T22:10:48.703334] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:48.704702] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3583 primary records. [2025-09-30T22:10:48.704922] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-30T22:10:48.724840] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-30T22:10:48.725599] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-30T22:10:48.728576] [INFO ] [MAIN ] Derivative Progress: 952/2009 symbols completed. JHI took 1.1s. Estimated remaining: 7m 16s. Rate: 145.6 symbols/min [2025-09-30T22:10:48.729124] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:48.747666] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:10:48.749890] [INFO ] [MAIN ] JHS: Generated 1792 derivative records from 2831 primary records. [2025-09-30T22:10:48.750113] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-30T22:10:48.774791] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:48.779005] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47675 primary records. [2025-09-30T22:10:48.779184] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-30T22:10:48.780866] [DEBUG] [LOCAL ] JHS: Derivative data saved (1792 records). [2025-09-30T22:10:48.789098] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-30T22:10:48.795590] [INFO ] [MAIN ] Derivative Progress: 953/2009 symbols completed. JHS took 1.0s. Estimated remaining: 7m 15s. Rate: 145.8 symbols/min [2025-09-30T22:10:48.796522] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:48.815838] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-30T22:10:48.815968] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-30T22:10:48.818538] [INFO ] [MAIN ] Derivative Progress: 954/2009 symbols completed. JHG took 1.2s. Estimated remaining: 7m 14s. Rate: 145.9 symbols/min [2025-09-30T22:10:48.818862] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:48.834067] [DEBUG] [LOCAL ] JILL: Loaded 16637 existing records from primary storage. [2025-09-30T22:10:48.834831] [INFO ] [MAIN ] JILL: Loaded 16637 primary data records. [2025-09-30T22:10:48.950490] [DEBUG] [LOCAL ] JHX: Loaded 51603 existing records from primary storage. [2025-09-30T22:10:48.982313] [INFO ] [MAIN ] JHX: Loaded 51603 primary data records. [2025-09-30T22:10:48.995503] [DEBUG] [LOCAL ] JLL: Loaded 31661 existing records from primary storage. [2025-09-30T22:10:49.021546] [INFO ] [MAIN ] JLL: Loaded 31661 primary data records. [2025-09-30T22:10:49.926017] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:49.927333] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16637 primary records. [2025-09-30T22:10:49.927815] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-30T22:10:49.965776] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:49.967859] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 51603 primary records. [2025-09-30T22:10:49.968277] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-30T22:10:49.968612] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-30T22:10:49.968695] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-30T22:10:49.971382] [INFO ] [MAIN ] Derivative Progress: 955/2009 symbols completed. JILL took 1.2s. Estimated remaining: 7m 14s. Rate: 145.6 symbols/min [2025-09-30T22:10:49.985928] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:49.995666] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:49.999380] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31661 primary records. [2025-09-30T22:10:49.999856] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-30T22:10:50.020457] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-30T22:10:50.021147] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-30T22:10:50.024163] [DEBUG] [LOCAL ] JLS: Loaded 4126 existing records from primary storage. [2025-09-30T22:10:50.027287] [INFO ] [MAIN ] JLS: Loaded 4126 primary data records. [2025-09-30T22:10:50.027059] [INFO ] [MAIN ] Derivative Progress: 956/2009 symbols completed. JLL took 1.2s. Estimated remaining: 7m 13s. Rate: 145.8 symbols/min [2025-09-30T22:10:50.050495] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:50.062951] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-30T22:10:50.063093] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-30T22:10:50.107118] [INFO ] [MAIN ] Derivative Progress: 957/2009 symbols completed. JHX took 1.4s. Estimated remaining: 7m 13s. Rate: 145.9 symbols/min [2025-09-30T22:10:50.124312] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:50.404995] [DEBUG] [LOCAL ] JMIA: Loaded 50631 existing records from primary storage. [2025-09-30T22:10:50.405512] [INFO ] [MAIN ] JMIA: Loaded 50631 primary data records. [2025-09-30T22:10:50.601320] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-30T22:10:50.622809] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:50.626408] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4126 primary records. [2025-09-30T22:10:50.650742] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-30T22:10:50.654735] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-30T22:10:50.942726] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-30T22:10:50.959196] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-30T22:10:50.961507] [INFO ] [MAIN ] Derivative Progress: 958/2009 symbols completed. JLS took 1.0s. Estimated remaining: 7m 13s. Rate: 145.7 symbols/min [2025-09-30T22:10:51.179429] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:51.181010] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50631 primary records. [2025-09-30T22:10:51.181291] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-30T22:10:51.201930] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-30T22:10:51.215098] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-30T22:10:51.215370] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:51.218281] [INFO ] [MAIN ] Derivative Progress: 959/2009 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 12s. Rate: 145.8 symbols/min [2025-09-30T22:10:51.219268] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-30T22:10:51.219374] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-30T22:10:51.235197] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-30T22:10:51.235291] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-30T22:10:51.237386] [INFO ] [MAIN ] Derivative Progress: 960/2009 symbols completed. JNJ took 1.1s. Estimated remaining: 7m 11s. Rate: 145.9 symbols/min [2025-09-30T22:10:51.237923] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:51.237858] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:51.238081] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:51.249570] [DEBUG] [LOCAL ] JOF: Loaded 7020 existing records from primary storage. [2025-09-30T22:10:51.249767] [INFO ] [MAIN ] JOF: Loaded 7020 primary data records. [2025-09-30T22:10:51.422162] [DEBUG] [LOCAL ] JOE: Loaded 24183 existing records from primary storage. [2025-09-30T22:10:51.480915] [INFO ] [MAIN ] JOE: Loaded 24183 primary data records. [2025-09-30T22:10:51.754913] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-30T22:10:51.760704] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-09-30T22:10:52.397342] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:52.399304] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7020 primary records. [2025-09-30T22:10:52.400074] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-30T22:10:52.425342] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-30T22:10:52.425843] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-30T22:10:52.428461] [INFO ] [MAIN ] Derivative Progress: 961/2009 symbols completed. JOF took 1.2s. Estimated remaining: 7m 12s. Rate: 145.6 symbols/min [2025-09-30T22:10:52.428981] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:52.443282] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:52.444490] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24183 primary records. [2025-09-30T22:10:52.444747] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-30T22:10:52.465180] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-30T22:10:52.465397] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-30T22:10:52.468347] [INFO ] [MAIN ] Derivative Progress: 962/2009 symbols completed. JOE took 1.2s. Estimated remaining: 7m 11s. Rate: 145.8 symbols/min [2025-09-30T22:10:52.470740] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:52.487186] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:52.488051] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-09-30T22:10:52.488250] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-30T22:10:52.514495] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-30T22:10:52.514703] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-30T22:10:52.517207] [INFO ] [MAIN ] Derivative Progress: 963/2009 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 10s. Rate: 145.9 symbols/min [2025-09-30T22:10:52.517506] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:52.532624] [DEBUG] [LOCAL ] JPC: Loaded 37115 existing records from primary storage. [2025-09-30T22:10:52.533084] [INFO ] [MAIN ] JPC: Loaded 37115 primary data records. [2025-09-30T22:10:52.909879] [DEBUG] [LOCAL ] JQC: Loaded 34076 existing records from primary storage. [2025-09-30T22:10:52.911424] [INFO ] [MAIN ] JQC: Loaded 34076 primary data records. [2025-09-30T22:10:52.925186] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-30T22:10:52.931076] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-30T22:10:53.639427] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:53.641237] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37115 primary records. [2025-09-30T22:10:53.641573] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-30T22:10:53.665721] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-30T22:10:53.666106] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-30T22:10:53.668711] [INFO ] [MAIN ] Derivative Progress: 964/2009 symbols completed. JPC took 1.2s. Estimated remaining: 7m 11s. Rate: 145.6 symbols/min [2025-09-30T22:10:53.682673] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:53.682269] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:53.683864] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 34076 primary records. [2025-09-30T22:10:53.684499] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-30T22:10:53.717377] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:53.723586] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-30T22:10:53.724484] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-30T22:10:53.734623] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-30T22:10:53.749883] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-30T22:10:53.748478] [DEBUG] [LOCAL ] JRI: Loaded 14806 existing records from primary storage. [2025-09-30T22:10:53.744255] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-30T22:10:53.750158] [INFO ] [MAIN ] JRI: Loaded 14806 primary data records. [2025-09-30T22:10:53.750080] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-30T22:10:53.752473] [INFO ] [MAIN ] Derivative Progress: 965/2009 symbols completed. JQC took 1.2s. Estimated remaining: 7m 10s. Rate: 145.7 symbols/min [2025-09-30T22:10:53.755891] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:53.769341] [INFO ] [MAIN ] Derivative Progress: 966/2009 symbols completed. JPM took 1.3s. Estimated remaining: 7m 9s. Rate: 145.9 symbols/min [2025-09-30T22:10:53.794821] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:53.868711] [DEBUG] [LOCAL ] JRS: Loaded 11261 existing records from primary storage. [2025-09-30T22:10:53.883076] [INFO ] [MAIN ] JRS: Loaded 11261 primary data records. [2025-09-30T22:10:54.365860] [DEBUG] [LOCAL ] JXN: Loaded 45657 existing records from primary storage. [2025-09-30T22:10:54.479381] [INFO ] [MAIN ] JXN: Loaded 45657 primary data records. [2025-09-30T22:10:54.863519] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:54.865436] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 14806 primary records. [2025-09-30T22:10:54.865574] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-30T22:10:54.894584] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:54.899183] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11261 primary records. [2025-09-30T22:10:54.899289] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-30T22:10:54.899392] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-30T22:10:54.901948] [INFO ] [MAIN ] Derivative Progress: 967/2009 symbols completed. JRI took 1.2s. Estimated remaining: 7m 9s. Rate: 145.6 symbols/min [2025-09-30T22:10:54.902276] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:54.899581] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-30T22:10:54.922586] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-30T22:10:54.922978] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-30T22:10:54.925446] [INFO ] [MAIN ] Derivative Progress: 968/2009 symbols completed. JRS took 1.2s. Estimated remaining: 7m 8s. Rate: 145.8 symbols/min [2025-09-30T22:10:54.925733] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:54.940319] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:54.941164] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45657 primary records. [2025-09-30T22:10:54.941315] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-30T22:10:54.973697] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-30T22:10:54.979481] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-30T22:10:54.979346] [DEBUG] [LOCAL ] KAI: Loaded 13286 existing records from primary storage. [2025-09-30T22:10:54.982465] [INFO ] [MAIN ] Derivative Progress: 969/2009 symbols completed. JXN took 1.2s. Estimated remaining: 7m 8s. Rate: 145.9 symbols/min [2025-09-30T22:10:54.982995] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:54.982859] [INFO ] [MAIN ] KAI: Loaded 13286 primary data records. [2025-09-30T22:10:55.114112] [DEBUG] [LOCAL ] K: Loaded 49962 existing records from primary storage. [2025-09-30T22:10:55.114398] [INFO ] [MAIN ] K: Loaded 49962 primary data records. [2025-09-30T22:10:55.527666] [DEBUG] [LOCAL ] KAR: Loaded 39860 existing records from primary storage. [2025-09-30T22:10:55.550900] [INFO ] [MAIN ] KAR: Loaded 39860 primary data records. [2025-09-30T22:10:56.093671] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:56.095527] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13286 primary records. [2025-09-30T22:10:56.096276] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-30T22:10:56.117444] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-30T22:10:56.117795] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-30T22:10:56.121431] [INFO ] [MAIN ] Derivative Progress: 970/2009 symbols completed. KAI took 1.2s. Estimated remaining: 7m 8s. Rate: 145.6 symbols/min [2025-09-30T22:10:56.130987] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:56.137395] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:56.139441] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49962 primary records. [2025-09-30T22:10:56.139611] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-30T22:10:56.159915] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-30T22:10:56.166885] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-30T22:10:56.169571] [INFO ] [MAIN ] Derivative Progress: 971/2009 symbols completed. K took 1.3s. Estimated remaining: 7m 7s. Rate: 145.8 symbols/min [2025-09-30T22:10:56.182890] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:56.183549] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:56.184812] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39860 primary records. [2025-09-30T22:10:56.184978] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-30T22:10:56.206228] [DEBUG] [LOCAL ] KB: Loaded 24012 existing records from primary storage. [2025-09-30T22:10:56.206623] [INFO ] [MAIN ] KB: Loaded 24012 primary data records. [2025-09-30T22:10:56.210925] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-30T22:10:56.233062] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-30T22:10:56.258877] [INFO ] [MAIN ] Derivative Progress: 972/2009 symbols completed. KAR took 1.3s. Estimated remaining: 7m 7s. Rate: 145.9 symbols/min [2025-09-30T22:10:56.278328] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:56.344637] [DEBUG] [LOCAL ] KBDC: Loaded 21049 existing records from primary storage. [2025-09-30T22:10:56.361180] [INFO ] [MAIN ] KBDC: Loaded 21049 primary data records. [2025-09-30T22:10:56.918436] [DEBUG] [LOCAL ] KBH: Loaded 48913 existing records from primary storage. [2025-09-30T22:10:56.921223] [INFO ] [MAIN ] KBH: Loaded 48913 primary data records. [2025-09-30T22:10:57.274809] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:57.285471] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24012 primary records. [2025-09-30T22:10:57.285791] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-30T22:10:57.319138] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:10:57.321066] [INFO ] [MAIN ] KBDC: Generated 1793 derivative records from 21049 primary records. [2025-09-30T22:10:57.321354] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-30T22:10:57.339215] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-30T22:10:57.339637] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-30T22:10:57.342085] [INFO ] [MAIN ] Derivative Progress: 973/2009 symbols completed. KB took 1.2s. Estimated remaining: 7m 7s. Rate: 145.6 symbols/min [2025-09-30T22:10:57.345441] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1793 records). [2025-09-30T22:10:57.345623] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-30T22:10:57.348385] [INFO ] [MAIN ] Derivative Progress: 974/2009 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 6s. Rate: 145.8 symbols/min [2025-09-30T22:10:57.364864] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:57.365458] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48913 primary records. [2025-09-30T22:10:57.365518] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-30T22:10:57.381171] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-30T22:10:57.381248] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-30T22:10:57.383666] [INFO ] [MAIN ] Derivative Progress: 975/2009 symbols completed. KBH took 1.1s. Estimated remaining: 7m 5s. Rate: 145.9 symbols/min [2025-09-30T22:10:57.384159] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:57.384348] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:57.384241] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:57.393508] [DEBUG] [LOCAL ] KEN: Loaded 4740 existing records from primary storage. [2025-09-30T22:10:57.393680] [INFO ] [MAIN ] KEN: Loaded 4740 primary data records. [2025-09-30T22:10:57.767686] [DEBUG] [LOCAL ] KBR: Loaded 48052 existing records from primary storage. [2025-09-30T22:10:57.768044] [INFO ] [MAIN ] KBR: Loaded 48052 primary data records. [2025-09-30T22:10:57.828385] [DEBUG] [LOCAL ] KD: Loaded 52305 existing records from primary storage. [2025-09-30T22:10:57.852430] [INFO ] [MAIN ] KD: Loaded 52305 primary data records. [2025-09-30T22:10:58.516933] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-30T22:10:58.517849] [INFO ] [MAIN ] KEN: Generated 1791 derivative records from 4740 primary records. [2025-09-30T22:10:58.518072] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-30T22:10:58.536374] [DEBUG] [LOCAL ] KEN: Derivative data saved (1791 records). [2025-09-30T22:10:58.537090] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-30T22:10:58.540061] [INFO ] [MAIN ] Derivative Progress: 976/2009 symbols completed. KEN took 1.2s. Estimated remaining: 7m 6s. Rate: 145.7 symbols/min [2025-09-30T22:10:58.540513] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:58.567194] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:58.568397] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48052 primary records. [2025-09-30T22:10:58.568609] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-30T22:10:58.591707] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-30T22:10:58.592032] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-30T22:10:58.594303] [INFO ] [MAIN ] Derivative Progress: 977/2009 symbols completed. KBR took 1.2s. Estimated remaining: 7m 5s. Rate: 145.8 symbols/min [2025-09-30T22:10:58.594636] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:58.617452] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:58.618591] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52305 primary records. [2025-09-30T22:10:58.618824] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-30T22:10:58.636066] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-30T22:10:58.636285] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-30T22:10:58.638987] [INFO ] [MAIN ] Derivative Progress: 978/2009 symbols completed. KD took 1.3s. Estimated remaining: 7m 4s. Rate: 145.9 symbols/min [2025-09-30T22:10:58.639341] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:58.652283] [DEBUG] [LOCAL ] KEP: Loaded 30960 existing records from primary storage. [2025-09-30T22:10:58.652480] [INFO ] [MAIN ] KEP: Loaded 30960 primary data records. [2025-09-30T22:10:58.856179] [DEBUG] [LOCAL ] KEX: Loaded 38053 existing records from primary storage. [2025-09-30T22:10:58.861597] [INFO ] [MAIN ] KEX: Loaded 38053 primary data records. [2025-09-30T22:10:59.199903] [DEBUG] [LOCAL ] KEYS: Loaded 43162 existing records from primary storage. [2025-09-30T22:10:59.220986] [INFO ] [MAIN ] KEYS: Loaded 43162 primary data records. [2025-09-30T22:10:59.803809] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:59.805545] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30960 primary records. [2025-09-30T22:10:59.805922] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-30T22:10:59.833595] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:59.839289] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38053 primary records. [2025-09-30T22:10:59.839963] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-30T22:10:59.844296] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-30T22:10:59.844587] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-30T22:10:59.847016] [INFO ] [MAIN ] Derivative Progress: 979/2009 symbols completed. KEP took 1.3s. Estimated remaining: 7m 4s. Rate: 145.6 symbols/min [2025-09-30T22:10:59.847409] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:59.867911] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-30T22:10:59.873172] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-30T22:10:59.875542] [INFO ] [MAIN ] Derivative Progress: 980/2009 symbols completed. KEX took 1.3s. Estimated remaining: 7m 4s. Rate: 145.8 symbols/min [2025-09-30T22:10:59.889455] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:10:59.890353] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:10:59.891098] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43162 primary records. [2025-09-30T22:10:59.891826] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-30T22:10:59.899828] [DEBUG] [LOCAL ] KFRC: Loaded 19559 existing records from primary storage. [2025-09-30T22:10:59.907413] [INFO ] [MAIN ] KFRC: Loaded 19559 primary data records. [2025-09-30T22:10:59.968551] [DEBUG] [LOCAL ] KFS: Loaded 8472 existing records from primary storage. [2025-09-30T22:10:59.969826] [INFO ] [MAIN ] KFS: Loaded 8472 primary data records. [2025-09-30T22:10:59.971388] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-30T22:11:00.048280] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-30T22:11:00.098703] [INFO ] [MAIN ] Derivative Progress: 981/2009 symbols completed. KEYS took 1.5s. Estimated remaining: 7m 3s. Rate: 145.8 symbols/min [2025-09-30T22:11:00.120981] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:00.641117] [DEBUG] [LOCAL ] KFY: Loaded 30083 existing records from primary storage. [2025-09-30T22:11:00.644297] [INFO ] [MAIN ] KFY: Loaded 30083 primary data records. [2025-09-30T22:11:00.873284] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-30T22:11:01.004173] [INFO ] [MAIN ] KFS: Generated 1791 derivative records from 8472 primary records. [2025-09-30T22:11:01.007134] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-30T22:11:01.033177] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:01.039878] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19559 primary records. [2025-09-30T22:11:01.040266] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-30T22:11:01.060271] [DEBUG] [LOCAL ] KFS: Derivative data saved (1791 records). [2025-09-30T22:11:01.062042] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-30T22:11:01.066158] [INFO ] [MAIN ] Derivative Progress: 982/2009 symbols completed. KFS took 1.2s. Estimated remaining: 7m 3s. Rate: 145.6 symbols/min [2025-09-30T22:11:01.068707] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:01.072002] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-30T22:11:01.072186] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-30T22:11:01.074860] [INFO ] [MAIN ] Derivative Progress: 983/2009 symbols completed. KFRC took 1.2s. Estimated remaining: 7m 2s. Rate: 145.8 symbols/min [2025-09-30T22:11:01.075186] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:01.097888] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:01.098918] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30083 primary records. [2025-09-30T22:11:01.099105] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-30T22:11:01.117455] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-30T22:11:01.129067] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-30T22:11:01.132247] [INFO ] [MAIN ] Derivative Progress: 984/2009 symbols completed. KFY took 1.0s. Estimated remaining: 7m 2s. Rate: 145.9 symbols/min [2025-09-30T22:11:01.132663] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:01.168803] [DEBUG] [LOCAL ] KGS: Loaded 45721 existing records from primary storage. [2025-09-30T22:11:01.168998] [INFO ] [MAIN ] KGS: Loaded 45721 primary data records. [2025-09-30T22:11:01.295928] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-30T22:11:01.340590] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-30T22:11:01.734166] [DEBUG] [LOCAL ] KIM: Loaded 53046 existing records from primary storage. [2025-09-30T22:11:01.746758] [INFO ] [MAIN ] KIM: Loaded 53046 primary data records. [2025-09-30T22:11:02.390844] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:02.393985] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45721 primary records. [2025-09-30T22:11:02.394328] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-30T22:11:02.418629] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:02.423990] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-30T22:11:02.425078] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-30T22:11:02.431165] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-30T22:11:02.443568] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-30T22:11:02.450393] [INFO ] [MAIN ] Derivative Progress: 985/2009 symbols completed. KGS took 1.4s. Estimated remaining: 7m 2s. Rate: 145.6 symbols/min [2025-09-30T22:11:02.451581] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-30T22:11:02.451909] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-30T22:11:02.452037] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:02.454956] [INFO ] [MAIN ] Derivative Progress: 986/2009 symbols completed. KGC took 1.4s. Estimated remaining: 7m 1s. Rate: 145.7 symbols/min [2025-09-30T22:11:02.455456] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:02.474201] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:02.475073] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53046 primary records. [2025-09-30T22:11:02.475170] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-30T22:11:02.498686] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-30T22:11:02.508097] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-30T22:11:02.509612] [DEBUG] [LOCAL ] KIO: Loaded 21369 existing records from primary storage. [2025-09-30T22:11:02.509740] [INFO ] [MAIN ] KIO: Loaded 21369 primary data records. [2025-09-30T22:11:02.512435] [INFO ] [MAIN ] Derivative Progress: 987/2009 symbols completed. KIM took 1.4s. Estimated remaining: 7m 0s. Rate: 145.9 symbols/min [2025-09-30T22:11:02.524351] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:02.667395] [DEBUG] [LOCAL ] KKRS: Loaded 5689 existing records from primary storage. [2025-09-30T22:11:02.694712] [INFO ] [MAIN ] KKRS: Loaded 5689 primary data records. [2025-09-30T22:11:02.903070] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-09-30T22:11:02.925455] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-09-30T22:11:03.573486] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:03.575379] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21369 primary records. [2025-09-30T22:11:03.575610] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-30T22:11:03.604335] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-30T22:11:03.606621] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-30T22:11:03.609765] [INFO ] [MAIN ] Derivative Progress: 988/2009 symbols completed. KIO took 1.2s. Estimated remaining: 7m 1s. Rate: 145.6 symbols/min [2025-09-30T22:11:03.624026] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:03.624960] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5689 primary records. [2025-09-30T22:11:03.625047] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-30T22:11:03.641264] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-30T22:11:03.641404] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-30T22:11:03.643801] [INFO ] [MAIN ] Derivative Progress: 989/2009 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 60s. Rate: 145.7 symbols/min [2025-09-30T22:11:03.665753] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:03.666688] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53500 primary records. [2025-09-30T22:11:03.666771] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-30T22:11:03.690689] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-30T22:11:03.690847] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-30T22:11:03.694819] [INFO ] [MAIN ] Derivative Progress: 990/2009 symbols completed. KKR took 1.2s. Estimated remaining: 6m 59s. Rate: 145.9 symbols/min [2025-09-30T22:11:03.695534] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:03.695731] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:03.695426] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:03.709563] [DEBUG] [LOCAL ] KMPB: Loaded 3749 existing records from primary storage. [2025-09-30T22:11:03.709743] [INFO ] [MAIN ] KMPB: Loaded 3749 primary data records. [2025-09-30T22:11:04.066162] [DEBUG] [LOCAL ] KLC: Loaded 36676 existing records from primary storage. [2025-09-30T22:11:04.089773] [INFO ] [MAIN ] KLC: Loaded 36676 primary data records. [2025-09-30T22:11:04.227988] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-30T22:11:04.242917] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-30T22:11:04.886219] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:04.887565] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3749 primary records. [2025-09-30T22:11:04.887826] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-30T22:11:04.910614] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-09-30T22:11:04.911249] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-30T22:11:04.914123] [INFO ] [MAIN ] Derivative Progress: 991/2009 symbols completed. KMPB took 1.2s. Estimated remaining: 6m 60s. Rate: 145.6 symbols/min [2025-09-30T22:11:04.914505] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:04.941069] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:04.942979] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36676 primary records. [2025-09-30T22:11:04.943283] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-30T22:11:04.957410] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:04.958672] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-30T22:11:04.966702] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-30T22:11:05.002721] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-30T22:11:05.004383] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-30T22:11:05.007167] [INFO ] [MAIN ] Derivative Progress: 992/2009 symbols completed. KLC took 1.3s. Estimated remaining: 6m 59s. Rate: 145.7 symbols/min [2025-09-30T22:11:05.008314] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:05.009379] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-30T22:11:05.009742] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-30T22:11:05.013065] [INFO ] [MAIN ] Derivative Progress: 993/2009 symbols completed. KMI took 1.3s. Estimated remaining: 6m 58s. Rate: 145.8 symbols/min [2025-09-30T22:11:05.024857] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:05.028062] [DEBUG] [LOCAL ] KMPR: Loaded 38781 existing records from primary storage. [2025-09-30T22:11:05.028395] [INFO ] [MAIN ] KMPR: Loaded 38781 primary data records. [2025-09-30T22:11:05.409585] [DEBUG] [LOCAL ] KMT: Loaded 42940 existing records from primary storage. [2025-09-30T22:11:05.410587] [INFO ] [MAIN ] KMT: Loaded 42940 primary data records. [2025-09-30T22:11:05.531327] [DEBUG] [LOCAL ] KMX: Loaded 53148 existing records from primary storage. [2025-09-30T22:11:05.557426] [INFO ] [MAIN ] KMX: Loaded 53148 primary data records. [2025-09-30T22:11:06.139037] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:06.140086] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38781 primary records. [2025-09-30T22:11:06.140277] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-30T22:11:06.161605] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-30T22:11:06.162058] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-30T22:11:06.164597] [INFO ] [MAIN ] Derivative Progress: 994/2009 symbols completed. KMPR took 1.3s. Estimated remaining: 6m 58s. Rate: 145.6 symbols/min [2025-09-30T22:11:06.165779] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:06.183372] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:06.184281] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42940 primary records. [2025-09-30T22:11:06.184558] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-30T22:11:06.202906] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-30T22:11:06.203912] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-30T22:11:06.207107] [INFO ] [MAIN ] Derivative Progress: 995/2009 symbols completed. KMT took 1.2s. Estimated remaining: 6m 58s. Rate: 145.7 symbols/min [2025-09-30T22:11:06.207589] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:06.221281] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:06.222188] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53148 primary records. [2025-09-30T22:11:06.222365] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-30T22:11:06.248681] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-30T22:11:06.248876] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-30T22:11:06.252167] [INFO ] [MAIN ] Derivative Progress: 996/2009 symbols completed. KMX took 1.2s. Estimated remaining: 6m 57s. Rate: 145.8 symbols/min [2025-09-30T22:11:06.252974] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:06.267328] [DEBUG] [LOCAL ] KN: Loaded 38575 existing records from primary storage. [2025-09-30T22:11:06.267521] [INFO ] [MAIN ] KN: Loaded 38575 primary data records. [2025-09-30T22:11:06.371238] [DEBUG] [LOCAL ] KNOP: Loaded 10406 existing records from primary storage. [2025-09-30T22:11:06.391477] [INFO ] [MAIN ] KNOP: Loaded 10406 primary data records. [2025-09-30T22:11:06.468910] [DEBUG] [LOCAL ] KNF: Loaded 35821 existing records from primary storage. [2025-09-30T22:11:06.571496] [INFO ] [MAIN ] KNF: Loaded 35821 primary data records. [2025-09-30T22:11:07.362611] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:07.363858] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38575 primary records. [2025-09-30T22:11:07.365028] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-30T22:11:07.396593] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:07.399418] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-30T22:11:07.401887] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10406 primary records. [2025-09-30T22:11:07.400515] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-30T22:11:07.402276] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-30T22:11:07.405310] [INFO ] [MAIN ] Derivative Progress: 997/2009 symbols completed. KN took 1.2s. Estimated remaining: 6m 57s. Rate: 145.6 symbols/min [2025-09-30T22:11:07.426558] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:07.413575] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:07.430220] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35821 primary records. [2025-09-30T22:11:07.431135] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-30T22:11:07.444218] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-30T22:11:07.447906] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-30T22:11:07.451083] [INFO ] [MAIN ] Derivative Progress: 998/2009 symbols completed. KNOP took 1.2s. Estimated remaining: 6m 56s. Rate: 145.7 symbols/min [2025-09-30T22:11:07.451909] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:07.455855] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-30T22:11:07.455963] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-30T22:11:07.463580] [INFO ] [MAIN ] Derivative Progress: 999/2009 symbols completed. KNF took 1.3s. Estimated remaining: 6m 56s. Rate: 145.8 symbols/min [2025-09-30T22:11:07.464167] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:07.473574] [DEBUG] [LOCAL ] KNSL: Loaded 18106 existing records from primary storage. [2025-09-30T22:11:07.473756] [INFO ] [MAIN ] KNSL: Loaded 18106 primary data records. [2025-09-30T22:11:07.850822] [DEBUG] [LOCAL ] KNX: Loaded 52592 existing records from primary storage. [2025-09-30T22:11:07.851698] [INFO ] [MAIN ] KNX: Loaded 52592 primary data records. [2025-09-30T22:11:07.877819] [DEBUG] [LOCAL ] KNTK: Loaded 46115 existing records from primary storage. [2025-09-30T22:11:07.928187] [INFO ] [MAIN ] KNTK: Loaded 46115 primary data records. [2025-09-30T22:11:08.538967] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:08.539928] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18106 primary records. [2025-09-30T22:11:08.540090] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-30T22:11:08.562285] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-30T22:11:08.562457] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-30T22:11:08.564924] [INFO ] [MAIN ] Derivative Progress: 1000/2009 symbols completed. KNSL took 1.2s. Estimated remaining: 6m 56s. Rate: 145.6 symbols/min [2025-09-30T22:11:08.566502] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:08.585119] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:08.586114] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52592 primary records. [2025-09-30T22:11:08.586513] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-30T22:11:08.606359] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-30T22:11:08.606898] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-30T22:11:08.610860] [INFO ] [MAIN ] Derivative Progress: 1001/2009 symbols completed. KNX took 1.1s. Estimated remaining: 6m 55s. Rate: 145.7 symbols/min [2025-09-30T22:11:08.611758] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:08.639384] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:08.640338] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46115 primary records. [2025-09-30T22:11:08.640579] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-30T22:11:08.685466] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-30T22:11:08.687904] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-30T22:11:08.690698] [INFO ] [MAIN ] Derivative Progress: 1002/2009 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 54s. Rate: 145.8 symbols/min [2025-09-30T22:11:08.691230] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:08.693114] [DEBUG] [LOCAL ] KODK: Loaded 43436 existing records from primary storage. [2025-09-30T22:11:08.693589] [INFO ] [MAIN ] KODK: Loaded 43436 primary data records. [2025-09-30T22:11:08.778906] [DEBUG] [LOCAL ] KOF: Loaded 26038 existing records from primary storage. [2025-09-30T22:11:08.802775] [INFO ] [MAIN ] KOF: Loaded 26038 primary data records. [2025-09-30T22:11:08.876344] [DEBUG] [LOCAL ] KOP: Loaded 17616 existing records from primary storage. [2025-09-30T22:11:08.927192] [INFO ] [MAIN ] KOP: Loaded 17616 primary data records. [2025-09-30T22:11:09.781336] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:09.782502] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43436 primary records. [2025-09-30T22:11:09.795394] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-30T22:11:09.796011] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:09.797006] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26038 primary records. [2025-09-30T22:11:09.797181] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-30T22:11:09.830867] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-30T22:11:09.845564] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-30T22:11:09.846105] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:09.846357] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-30T22:11:09.846202] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-30T22:11:09.848449] [INFO ] [MAIN ] Derivative Progress: 1003/2009 symbols completed. KODK took 1.3s. Estimated remaining: 6m 55s. Rate: 145.6 symbols/min [2025-09-30T22:11:09.851888] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17616 primary records. [2025-09-30T22:11:09.850996] [INFO ] [MAIN ] Derivative Progress: 1004/2009 symbols completed. KOF took 1.2s. Estimated remaining: 6m 54s. Rate: 145.7 symbols/min [2025-09-30T22:11:09.852009] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-30T22:11:09.868150] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-30T22:11:09.868213] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-30T22:11:09.871007] [INFO ] [MAIN ] Derivative Progress: 1005/2009 symbols completed. KOP took 1.2s. Estimated remaining: 6m 53s. Rate: 145.9 symbols/min [2025-09-30T22:11:09.871493] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:09.871717] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:09.871600] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:09.876680] [DEBUG] [LOCAL ] KORE: Loaded 1997 existing records from primary storage. [2025-09-30T22:11:09.876796] [INFO ] [MAIN ] KORE: Loaded 1997 primary data records. [2025-09-30T22:11:10.248876] [DEBUG] [LOCAL ] KOS: Loaded 53049 existing records from primary storage. [2025-09-30T22:11:10.250487] [INFO ] [MAIN ] KOS: Loaded 53049 primary data records. [2025-09-30T22:11:10.336322] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-09-30T22:11:10.341822] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-09-30T22:11:10.912547] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:11:10.929054] [INFO ] [MAIN ] KORE: Generated 1793 derivative records from 1997 primary records. [2025-09-30T22:11:10.929288] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-30T22:11:10.945879] [DEBUG] [LOCAL ] KORE: Derivative data saved (1793 records). [2025-09-30T22:11:10.946043] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-30T22:11:10.949029] [INFO ] [MAIN ] Derivative Progress: 1006/2009 symbols completed. KORE took 1.1s. Estimated remaining: 6m 53s. Rate: 145.6 symbols/min [2025-09-30T22:11:10.950194] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:10.976070] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:10.976909] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53049 primary records. [2025-09-30T22:11:10.977040] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-30T22:11:10.998158] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-30T22:11:10.998539] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-30T22:11:11.000450] [INFO ] [MAIN ] Derivative Progress: 1007/2009 symbols completed. KOS took 1.1s. Estimated remaining: 6m 52s. Rate: 145.8 symbols/min [2025-09-30T22:11:11.008965] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:11.015903] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:11.016772] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-09-30T22:11:11.017237] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-30T22:11:11.044566] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-30T22:11:11.048690] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-30T22:11:11.065496] [INFO ] [MAIN ] Derivative Progress: 1008/2009 symbols completed. KR took 1.2s. Estimated remaining: 6m 52s. Rate: 145.9 symbols/min [2025-09-30T22:11:11.067427] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:11.068869] [DEBUG] [LOCAL ] KRC: Loaded 48305 existing records from primary storage. [2025-09-30T22:11:11.069350] [INFO ] [MAIN ] KRC: Loaded 48305 primary data records. [2025-09-30T22:11:11.270947] [DEBUG] [LOCAL ] KREF: Loaded 37396 existing records from primary storage. [2025-09-30T22:11:11.303769] [INFO ] [MAIN ] KREF: Loaded 37396 primary data records. [2025-09-30T22:11:11.626012] [DEBUG] [LOCAL ] KRG: Loaded 49160 existing records from primary storage. [2025-09-30T22:11:11.649360] [INFO ] [MAIN ] KRG: Loaded 49160 primary data records. [2025-09-30T22:11:12.175561] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:12.177419] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48305 primary records. [2025-09-30T22:11:12.178148] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-30T22:11:12.211633] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:12.213127] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37396 primary records. [2025-09-30T22:11:12.213490] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-30T22:11:12.214122] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-30T22:11:12.214512] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-30T22:11:12.217247] [INFO ] [MAIN ] Derivative Progress: 1009/2009 symbols completed. KRC took 1.3s. Estimated remaining: 6m 52s. Rate: 145.6 symbols/min [2025-09-30T22:11:12.217966] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:12.236030] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-30T22:11:12.236233] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-30T22:11:12.239099] [INFO ] [MAIN ] Derivative Progress: 1010/2009 symbols completed. KREF took 1.2s. Estimated remaining: 6m 51s. Rate: 145.8 symbols/min [2025-09-30T22:11:12.240788] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:12.257684] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:12.267368] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49160 primary records. [2025-09-30T22:11:12.267634] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-30T22:11:12.286347] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-30T22:11:12.286580] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-30T22:11:12.297228] [INFO ] [MAIN ] Derivative Progress: 1011/2009 symbols completed. KRG took 1.2s. Estimated remaining: 6m 50s. Rate: 145.9 symbols/min [2025-09-30T22:11:12.298958] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:12.300628] [DEBUG] [LOCAL ] KRO: Loaded 26036 existing records from primary storage. [2025-09-30T22:11:12.300893] [INFO ] [MAIN ] KRO: Loaded 26036 primary data records. [2025-09-30T22:11:12.535131] [DEBUG] [LOCAL ] KRP: Loaded 37125 existing records from primary storage. [2025-09-30T22:11:12.669285] [INFO ] [MAIN ] KRP: Loaded 37125 primary data records. [2025-09-30T22:11:12.813561] [DEBUG] [LOCAL ] KSS: Loaded 53603 existing records from primary storage. [2025-09-30T22:11:12.814025] [INFO ] [MAIN ] KSS: Loaded 53603 primary data records. [2025-09-30T22:11:13.443537] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:13.445192] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26036 primary records. [2025-09-30T22:11:13.445736] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-30T22:11:13.469822] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-30T22:11:13.470620] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-30T22:11:13.472670] [INFO ] [MAIN ] Derivative Progress: 1012/2009 symbols completed. KRO took 1.3s. Estimated remaining: 6m 51s. Rate: 145.6 symbols/min [2025-09-30T22:11:13.473055] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:13.488220] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:13.489414] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37125 primary records. [2025-09-30T22:11:13.489612] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-30T22:11:13.526799] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:13.526445] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-30T22:11:13.527843] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-30T22:11:13.527633] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53603 primary records. [2025-09-30T22:11:13.531193] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-30T22:11:13.531094] [INFO ] [MAIN ] Derivative Progress: 1013/2009 symbols completed. KRP took 1.3s. Estimated remaining: 6m 50s. Rate: 145.7 symbols/min [2025-09-30T22:11:13.532497] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:13.578311] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-30T22:11:13.578514] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-30T22:11:13.581337] [INFO ] [MAIN ] Derivative Progress: 1014/2009 symbols completed. KSS took 1.3s. Estimated remaining: 6m 49s. Rate: 145.9 symbols/min [2025-09-30T22:11:13.581517] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:13.582964] [DEBUG] [LOCAL ] KT: Loaded 45663 existing records from primary storage. [2025-09-30T22:11:13.583559] [INFO ] [MAIN ] KT: Loaded 45663 primary data records. [2025-09-30T22:11:13.736338] [DEBUG] [LOCAL ] KTF: Loaded 12688 existing records from primary storage. [2025-09-30T22:11:13.784035] [DEBUG] [LOCAL ] KTB: Loaded 41051 existing records from primary storage. [2025-09-30T22:11:13.773978] [INFO ] [MAIN ] KTF: Loaded 12688 primary data records. [2025-09-30T22:11:13.792308] [INFO ] [MAIN ] KTB: Loaded 41051 primary data records. [2025-09-30T22:11:14.668086] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:14.669515] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45663 primary records. [2025-09-30T22:11:14.670120] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-30T22:11:14.690447] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-30T22:11:14.691996] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-30T22:11:14.694261] [INFO ] [MAIN ] Derivative Progress: 1015/2009 symbols completed. KT took 1.2s. Estimated remaining: 6m 50s. Rate: 145.6 symbols/min [2025-09-30T22:11:14.694811] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:14.718104] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:14.719403] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12688 primary records. [2025-09-30T22:11:14.719594] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-30T22:11:14.750364] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:14.751468] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41051 primary records. [2025-09-30T22:11:14.752049] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-30T22:11:14.771609] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-30T22:11:14.772325] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-30T22:11:14.774944] [INFO ] [MAIN ] Derivative Progress: 1016/2009 symbols completed. KTB took 1.2s. Estimated remaining: 6m 49s. Rate: 145.7 symbols/min [2025-09-30T22:11:14.775571] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:14.775784] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-30T22:11:14.775899] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-30T22:11:14.779041] [INFO ] [MAIN ] Derivative Progress: 1017/2009 symbols completed. KTF took 1.2s. Estimated remaining: 6m 48s. Rate: 145.9 symbols/min [2025-09-30T22:11:14.779394] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:14.823292] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-30T22:11:14.823546] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-30T22:11:15.003887] [DEBUG] [LOCAL ] KW: Loaded 40564 existing records from primary storage. [2025-09-30T22:11:15.070607] [INFO ] [MAIN ] KW: Loaded 40564 primary data records. [2025-09-30T22:11:15.232375] [DEBUG] [LOCAL ] KVYO: Loaded 50023 existing records from primary storage. [2025-09-30T22:11:15.254460] [INFO ] [MAIN ] KVYO: Loaded 50023 primary data records. [2025-09-30T22:11:15.980035] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:15.982107] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-30T22:11:15.983247] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-30T22:11:16.011596] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-30T22:11:16.011859] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-30T22:11:16.014468] [INFO ] [MAIN ] Derivative Progress: 1018/2009 symbols completed. KVUE took 1.3s. Estimated remaining: 6m 48s. Rate: 145.6 symbols/min [2025-09-30T22:11:16.037478] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:16.038558] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50023 primary records. [2025-09-30T22:11:16.038885] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-30T22:11:16.053887] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:16.062203] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40564 primary records. [2025-09-30T22:11:16.066041] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-30T22:11:16.082445] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-30T22:11:16.082909] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-30T22:11:16.086951] [INFO ] [MAIN ] Derivative Progress: 1019/2009 symbols completed. KVYO took 1.3s. Estimated remaining: 6m 48s. Rate: 145.7 symbols/min [2025-09-30T22:11:16.091634] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-30T22:11:16.091831] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-30T22:11:16.094464] [INFO ] [MAIN ] Derivative Progress: 1020/2009 symbols completed. KW took 1.3s. Estimated remaining: 6m 47s. Rate: 145.9 symbols/min [2025-09-30T22:11:16.094920] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:16.095096] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:16.095668] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:16.116243] [DEBUG] [LOCAL ] KWR: Loaded 16599 existing records from primary storage. [2025-09-30T22:11:16.116604] [INFO ] [MAIN ] KWR: Loaded 16599 primary data records. [2025-09-30T22:11:16.259119] [DEBUG] [LOCAL ] KYN: Loaded 30028 existing records from primary storage. [2025-09-30T22:11:16.291694] [INFO ] [MAIN ] KYN: Loaded 30028 primary data records. [2025-09-30T22:11:16.351388] [DEBUG] [LOCAL ] L: Loaded 40964 existing records from primary storage. [2025-09-30T22:11:16.469861] [INFO ] [MAIN ] L: Loaded 40964 primary data records. [2025-09-30T22:11:17.193407] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:17.194849] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16599 primary records. [2025-09-30T22:11:17.195158] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-30T22:11:17.214876] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-30T22:11:17.215387] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-30T22:11:17.217482] [INFO ] [MAIN ] Derivative Progress: 1021/2009 symbols completed. KWR took 1.1s. Estimated remaining: 6m 47s. Rate: 145.6 symbols/min [2025-09-30T22:11:17.217896] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:17.253178] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:17.253857] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:17.254698] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30028 primary records. [2025-09-30T22:11:17.255496] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-30T22:11:17.255363] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40964 primary records. [2025-09-30T22:11:17.255941] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-30T22:11:17.286454] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-30T22:11:17.288105] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-30T22:11:17.305127] [INFO ] [MAIN ] Derivative Progress: 1022/2009 symbols completed. KYN took 1.2s. Estimated remaining: 6m 46s. Rate: 145.7 symbols/min [2025-09-30T22:11:17.305974] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:17.308055] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-30T22:11:17.308152] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-30T22:11:17.310898] [INFO ] [MAIN ] Derivative Progress: 1023/2009 symbols completed. L took 1.2s. Estimated remaining: 6m 46s. Rate: 145.9 symbols/min [2025-09-30T22:11:17.311230] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:17.331425] [DEBUG] [LOCAL ] LAC: Loaded 52329 existing records from primary storage. [2025-09-30T22:11:17.331753] [INFO ] [MAIN ] LAC: Loaded 52329 primary data records. [2025-09-30T22:11:17.466587] [DEBUG] [LOCAL ] LAD: Loaded 23493 existing records from primary storage. [2025-09-30T22:11:17.479998] [INFO ] [MAIN ] LAD: Loaded 23493 primary data records. [2025-09-30T22:11:17.681389] [DEBUG] [LOCAL ] LADR: Loaded 38698 existing records from primary storage. [2025-09-30T22:11:17.694978] [INFO ] [MAIN ] LADR: Loaded 38698 primary data records. [2025-09-30T22:11:18.421188] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:18.423665] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52329 primary records. [2025-09-30T22:11:18.423812] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-30T22:11:18.450093] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:18.455017] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23493 primary records. [2025-09-30T22:11:18.455385] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-30T22:11:18.454316] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-30T22:11:18.456950] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-30T22:11:18.470396] [INFO ] [MAIN ] Derivative Progress: 1024/2009 symbols completed. LAC took 1.3s. Estimated remaining: 6m 46s. Rate: 145.6 symbols/min [2025-09-30T22:11:18.473733] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:18.476015] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-30T22:11:18.476492] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-30T22:11:18.479240] [INFO ] [MAIN ] Derivative Progress: 1025/2009 symbols completed. LAD took 1.2s. Estimated remaining: 6m 45s. Rate: 145.7 symbols/min [2025-09-30T22:11:18.479484] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:18.495523] [DEBUG] [LOCAL ] LANV: Loaded 2826 existing records from primary storage. [2025-09-30T22:11:18.501362] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:18.502524] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38698 primary records. [2025-09-30T22:11:18.501759] [INFO ] [MAIN ] LANV: Loaded 2826 primary data records. [2025-09-30T22:11:18.502774] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-30T22:11:18.626464] [DEBUG] [LOCAL ] LAW: Loaded 13998 existing records from primary storage. [2025-09-30T22:11:18.632198] [INFO ] [MAIN ] LAW: Loaded 13998 primary data records. [2025-09-30T22:11:18.657425] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-30T22:11:18.696613] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-30T22:11:18.713750] [INFO ] [MAIN ] Derivative Progress: 1026/2009 symbols completed. LADR took 1.4s. Estimated remaining: 6m 45s. Rate: 145.8 symbols/min [2025-09-30T22:11:18.780633] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:19.252975] [DEBUG] [LOCAL ] LAZ: Loaded 44962 existing records from primary storage. [2025-09-30T22:11:19.266971] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-30T22:11:19.268256] [INFO ] [MAIN ] LANV: Generated 1791 derivative records from 2826 primary records. [2025-09-30T22:11:19.268827] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-30T22:11:19.266599] [INFO ] [MAIN ] LAZ: Loaded 44962 primary data records. [2025-09-30T22:11:19.370736] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:19.387759] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13998 primary records. [2025-09-30T22:11:19.400191] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-30T22:11:19.413546] [DEBUG] [LOCAL ] LANV: Derivative data saved (1791 records). [2025-09-30T22:11:19.413991] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-30T22:11:19.417480] [INFO ] [MAIN ] Derivative Progress: 1027/2009 symbols completed. LANV took 0.9s. Estimated remaining: 6m 44s. Rate: 145.7 symbols/min [2025-09-30T22:11:19.440174] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:19.545067] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-30T22:11:19.639007] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-30T22:11:19.642798] [INFO ] [MAIN ] Derivative Progress: 1028/2009 symbols completed. LAW took 1.2s. Estimated remaining: 6m 44s. Rate: 145.8 symbols/min [2025-09-30T22:11:19.643040] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:19.705401] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:19.699958] [DEBUG] [LOCAL ] LB: Loaded 37689 existing records from primary storage. [2025-09-30T22:11:19.706314] [INFO ] [MAIN ] LB: Loaded 37689 primary data records. [2025-09-30T22:11:19.706256] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44962 primary records. [2025-09-30T22:11:19.721743] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-30T22:11:19.839492] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-30T22:11:19.861099] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-30T22:11:19.864578] [INFO ] [MAIN ] Derivative Progress: 1029/2009 symbols completed. LAZ took 1.1s. Estimated remaining: 6m 43s. Rate: 145.8 symbols/min [2025-09-30T22:11:19.886777] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:20.029910] [DEBUG] [LOCAL ] LBRT: Loaded 52915 existing records from primary storage. [2025-09-30T22:11:20.129133] [INFO ] [MAIN ] LBRT: Loaded 52915 primary data records. [2025-09-30T22:11:20.495784] [DEBUG] [LOCAL ] LC: Loaded 47854 existing records from primary storage. [2025-09-30T22:11:20.496347] [INFO ] [MAIN ] LC: Loaded 47854 primary data records. [2025-09-30T22:11:20.606858] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:20.641634] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37689 primary records. [2025-09-30T22:11:20.667132] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-30T22:11:20.890111] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-30T22:11:20.890754] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-30T22:11:20.895163] [INFO ] [MAIN ] Derivative Progress: 1030/2009 symbols completed. LB took 1.5s. Estimated remaining: 6m 43s. Rate: 145.6 symbols/min [2025-09-30T22:11:20.896347] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:20.911431] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:20.912922] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52915 primary records. [2025-09-30T22:11:20.913053] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-30T22:11:20.932390] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-30T22:11:20.932815] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-30T22:11:20.935369] [INFO ] [MAIN ] Derivative Progress: 1031/2009 symbols completed. LBRT took 1.3s. Estimated remaining: 6m 43s. Rate: 145.7 symbols/min [2025-09-30T22:11:20.935787] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:20.962876] [DEBUG] [LOCAL ] LCII: Loaded 28110 existing records from primary storage. [2025-09-30T22:11:20.963114] [INFO ] [MAIN ] LCII: Loaded 28110 primary data records. [2025-09-30T22:11:21.009113] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:21.043533] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47854 primary records. [2025-09-30T22:11:21.090411] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-30T22:11:21.329964] [DEBUG] [LOCAL ] LDI: Loaded 44128 existing records from primary storage. [2025-09-30T22:11:21.331581] [INFO ] [MAIN ] LDI: Loaded 44128 primary data records. [2025-09-30T22:11:21.346206] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-30T22:11:21.346323] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-30T22:11:21.348861] [INFO ] [MAIN ] Derivative Progress: 1032/2009 symbols completed. LC took 1.5s. Estimated remaining: 6m 42s. Rate: 145.7 symbols/min [2025-09-30T22:11:21.359288] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:21.685142] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:21.687236] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28110 primary records. [2025-09-30T22:11:21.687903] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-30T22:11:21.723796] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-30T22:11:21.724022] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-30T22:11:21.725076] [DEBUG] [LOCAL ] LDOS: Loaded 45593 existing records from primary storage. [2025-09-30T22:11:21.727361] [INFO ] [MAIN ] Derivative Progress: 1033/2009 symbols completed. LCII took 0.8s. Estimated remaining: 6m 42s. Rate: 145.8 symbols/min [2025-09-30T22:11:21.727844] [INFO ] [MAIN ] LDOS: Loaded 45593 primary data records. [2025-09-30T22:11:21.920015] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:21.935991] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44128 primary records. [2025-09-30T22:11:21.950878] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-30T22:11:22.159551] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-30T22:11:22.159877] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-30T22:11:22.162301] [INFO ] [MAIN ] Derivative Progress: 1034/2009 symbols completed. LDI took 1.2s. Estimated remaining: 6m 41s. Rate: 145.7 symbols/min [2025-09-30T22:11:22.185176] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:22.185830] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45593 primary records. [2025-09-30T22:11:22.185895] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-30T22:11:22.201603] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-30T22:11:22.201697] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-30T22:11:22.204007] [INFO ] [MAIN ] Derivative Progress: 1035/2009 symbols completed. LDOS took 0.8s. Estimated remaining: 6m 41s. Rate: 145.9 symbols/min [2025-09-30T22:11:22.204373] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:22.204548] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:22.204497] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:22.220870] [DEBUG] [LOCAL ] LDP: Loaded 12967 existing records from primary storage. [2025-09-30T22:11:22.221000] [INFO ] [MAIN ] LDP: Loaded 12967 primary data records. [2025-09-30T22:11:22.621411] [DEBUG] [LOCAL ] LEG: Loaded 50291 existing records from primary storage. [2025-09-30T22:11:22.620748] [DEBUG] [LOCAL ] LEA: Loaded 41744 existing records from primary storage. [2025-09-30T22:11:22.621817] [INFO ] [MAIN ] LEA: Loaded 41744 primary data records. [2025-09-30T22:11:22.621890] [INFO ] [MAIN ] LEG: Loaded 50291 primary data records. [2025-09-30T22:11:23.320803] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:23.322619] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12967 primary records. [2025-09-30T22:11:23.323257] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-30T22:11:23.345832] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-30T22:11:23.347448] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-30T22:11:23.350278] [INFO ] [MAIN ] Derivative Progress: 1036/2009 symbols completed. LDP took 1.1s. Estimated remaining: 6m 41s. Rate: 145.6 symbols/min [2025-09-30T22:11:23.350786] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:23.374818] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:23.388765] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41744 primary records. [2025-09-30T22:11:23.389395] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:23.390787] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-30T22:11:23.390674] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50291 primary records. [2025-09-30T22:11:23.399956] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-30T22:11:23.410014] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-30T22:11:23.422060] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-30T22:11:23.428866] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-30T22:11:23.429154] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-30T22:11:23.424637] [INFO ] [MAIN ] Derivative Progress: 1037/2009 symbols completed. LEA took 1.2s. Estimated remaining: 6m 40s. Rate: 145.7 symbols/min [2025-09-30T22:11:23.432720] [INFO ] [MAIN ] Derivative Progress: 1038/2009 symbols completed. LEG took 1.2s. Estimated remaining: 6m 39s. Rate: 145.9 symbols/min [2025-09-30T22:11:23.432946] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:23.432543] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:23.469031] [DEBUG] [LOCAL ] LEO: Loaded 17325 existing records from primary storage. [2025-09-30T22:11:23.469390] [INFO ] [MAIN ] LEO: Loaded 17325 primary data records. [2025-09-30T22:11:23.604297] [DEBUG] [LOCAL ] LEN: Loaded 53188 existing records from primary storage. [2025-09-30T22:11:23.633056] [INFO ] [MAIN ] LEN: Loaded 53188 primary data records. [2025-09-30T22:11:23.974104] [DEBUG] [LOCAL ] LEVI: Loaded 51554 existing records from primary storage. [2025-09-30T22:11:23.974516] [INFO ] [MAIN ] LEVI: Loaded 51554 primary data records. [2025-09-30T22:11:24.658770] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:24.660356] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17325 primary records. [2025-09-30T22:11:24.664475] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-30T22:11:24.693182] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:24.695340] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53188 primary records. [2025-09-30T22:11:24.695927] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-30T22:11:24.714862] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-30T22:11:24.719499] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-30T22:11:24.719216] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-30T22:11:24.723260] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-30T22:11:24.721908] [INFO ] [MAIN ] Derivative Progress: 1039/2009 symbols completed. LEO took 1.3s. Estimated remaining: 6m 40s. Rate: 145.6 symbols/min [2025-09-30T22:11:24.727928] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:24.728373] [INFO ] [MAIN ] Derivative Progress: 1040/2009 symbols completed. LEN took 1.4s. Estimated remaining: 6m 39s. Rate: 145.7 symbols/min [2025-09-30T22:11:24.729338] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:24.745144] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:24.746337] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51554 primary records. [2025-09-30T22:11:24.746439] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-30T22:11:24.788033] [DEBUG] [LOCAL ] LFT: Loaded 18306 existing records from primary storage. [2025-09-30T22:11:24.787141] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-30T22:11:24.788728] [INFO ] [MAIN ] LFT: Loaded 18306 primary data records. [2025-09-30T22:11:24.788622] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-30T22:11:24.791710] [INFO ] [MAIN ] Derivative Progress: 1041/2009 symbols completed. LEVI took 1.4s. Estimated remaining: 6m 38s. Rate: 145.8 symbols/min [2025-09-30T22:11:24.788419] [DEBUG] [LOCAL ] LGI: Loaded 9828 existing records from primary storage. [2025-09-30T22:11:24.791998] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:24.805045] [INFO ] [MAIN ] LGI: Loaded 9828 primary data records. [2025-09-30T22:11:25.540958] [DEBUG] [LOCAL ] LH: Loaded 37822 existing records from primary storage. [2025-09-30T22:11:25.542802] [INFO ] [MAIN ] LH: Loaded 37822 primary data records. [2025-09-30T22:11:25.914217] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:25.915808] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9828 primary records. [2025-09-30T22:11:25.916047] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-30T22:11:25.944114] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:25.946450] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18306 primary records. [2025-09-30T22:11:25.947670] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-30T22:11:25.960474] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-30T22:11:25.963496] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-30T22:11:25.969489] [INFO ] [MAIN ] Derivative Progress: 1042/2009 symbols completed. LGI took 1.2s. Estimated remaining: 6m 39s. Rate: 145.6 symbols/min [2025-09-30T22:11:25.971298] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:25.971143] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-30T22:11:25.971826] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-30T22:11:25.976427] [INFO ] [MAIN ] Derivative Progress: 1043/2009 symbols completed. LFT took 1.2s. Estimated remaining: 6m 38s. Rate: 145.7 symbols/min [2025-09-30T22:11:25.977745] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:25.991961] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:25.992682] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37822 primary records. [2025-09-30T22:11:25.992755] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-30T22:11:26.010932] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-30T22:11:26.011144] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-30T22:11:26.014966] [INFO ] [MAIN ] Derivative Progress: 1044/2009 symbols completed. LH took 1.2s. Estimated remaining: 6m 37s. Rate: 145.8 symbols/min [2025-09-30T22:11:26.015281] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:26.037827] [DEBUG] [LOCAL ] LII: Loaded 27966 existing records from primary storage. [2025-09-30T22:11:26.038084] [INFO ] [MAIN ] LII: Loaded 27966 primary data records. [2025-09-30T22:11:26.252723] [DEBUG] [LOCAL ] LHX: Loaded 48643 existing records from primary storage. [2025-09-30T22:11:26.293242] [INFO ] [MAIN ] LHX: Loaded 48643 primary data records. [2025-09-30T22:11:26.470099] [DEBUG] [LOCAL ] LION: Loaded 44032 existing records from primary storage. [2025-09-30T22:11:26.484736] [INFO ] [MAIN ] LION: Loaded 44032 primary data records. [2025-09-30T22:11:27.160379] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:27.161956] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27966 primary records. [2025-09-30T22:11:27.162196] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-30T22:11:27.183485] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-30T22:11:27.185611] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-30T22:11:27.189560] [INFO ] [MAIN ] Derivative Progress: 1045/2009 symbols completed. LII took 1.2s. Estimated remaining: 6m 37s. Rate: 145.6 symbols/min [2025-09-30T22:11:27.203875] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:27.204735] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:27.213784] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 44032 primary records. [2025-09-30T22:11:27.214131] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-30T22:11:27.220761] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:27.231697] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48643 primary records. [2025-09-30T22:11:27.235058] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-30T22:11:27.240309] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-30T22:11:27.240687] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-30T22:11:27.250691] [INFO ] [MAIN ] Derivative Progress: 1046/2009 symbols completed. LION took 1.2s. Estimated remaining: 6m 37s. Rate: 145.7 symbols/min [2025-09-30T22:11:27.250857] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:27.258556] [DEBUG] [LOCAL ] LITB: Loaded 4352 existing records from primary storage. [2025-09-30T22:11:27.262126] [INFO ] [MAIN ] LITB: Loaded 4352 primary data records. [2025-09-30T22:11:27.326315] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-30T22:11:27.354158] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-30T22:11:27.381863] [INFO ] [MAIN ] Derivative Progress: 1047/2009 symbols completed. LHX took 1.4s. Estimated remaining: 6m 36s. Rate: 145.8 symbols/min [2025-09-30T22:11:27.382746] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:27.661725] [DEBUG] [LOCAL ] LLY: Loaded 53281 existing records from primary storage. [2025-09-30T22:11:27.662499] [INFO ] [MAIN ] LLY: Loaded 53281 primary data records. [2025-09-30T22:11:27.798727] [DEBUG] [LOCAL ] LMND: Loaded 51876 existing records from primary storage. [2025-09-30T22:11:27.841513] [INFO ] [MAIN ] LMND: Loaded 51876 primary data records. [2025-09-30T22:11:28.173074] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:28.184409] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4352 primary records. [2025-09-30T22:11:28.204091] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-30T22:11:28.393054] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-30T22:11:28.393732] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-30T22:11:28.396027] [INFO ] [MAIN ] Derivative Progress: 1048/2009 symbols completed. LITB took 1.2s. Estimated remaining: 6m 36s. Rate: 145.6 symbols/min [2025-09-30T22:11:28.417760] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:28.418577] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53281 primary records. [2025-09-30T22:11:28.418933] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-30T22:11:28.438943] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-30T22:11:28.440014] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-30T22:11:28.442166] [INFO ] [MAIN ] Derivative Progress: 1049/2009 symbols completed. LLY took 1.2s. Estimated remaining: 6m 35s. Rate: 145.7 symbols/min [2025-09-30T22:11:28.457577] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:28.458581] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51876 primary records. [2025-09-30T22:11:28.458667] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-30T22:11:28.475445] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-30T22:11:28.475587] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-30T22:11:28.478681] [INFO ] [MAIN ] Derivative Progress: 1050/2009 symbols completed. LMND took 1.1s. Estimated remaining: 6m 35s. Rate: 145.8 symbols/min [2025-09-30T22:11:28.479192] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:28.479354] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:28.479257] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:28.489905] [DEBUG] [LOCAL ] LND: Loaded 4911 existing records from primary storage. [2025-09-30T22:11:28.490075] [INFO ] [MAIN ] LND: Loaded 4911 primary data records. [2025-09-30T22:11:28.925373] [DEBUG] [LOCAL ] LMT: Loaded 49835 existing records from primary storage. [2025-09-30T22:11:28.925815] [INFO ] [MAIN ] LMT: Loaded 49835 primary data records. [2025-09-30T22:11:28.926506] [DEBUG] [LOCAL ] LNC: Loaded 51615 existing records from primary storage. [2025-09-30T22:11:28.926820] [INFO ] [MAIN ] LNC: Loaded 51615 primary data records. [2025-09-30T22:11:29.662538] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:29.663685] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4911 primary records. [2025-09-30T22:11:29.664496] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-30T22:11:29.683139] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-30T22:11:29.683679] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-30T22:11:29.686171] [INFO ] [MAIN ] Derivative Progress: 1051/2009 symbols completed. LND took 1.2s. Estimated remaining: 6m 35s. Rate: 145.6 symbols/min [2025-09-30T22:11:29.687031] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:29.710374] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:29.711764] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49835 primary records. [2025-09-30T22:11:29.725178] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-30T22:11:29.725594] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:29.726620] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51615 primary records. [2025-09-30T22:11:29.727419] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-30T22:11:29.761096] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-30T22:11:29.761521] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-30T22:11:29.761680] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-30T22:11:29.761761] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-30T22:11:29.763897] [INFO ] [MAIN ] Derivative Progress: 1052/2009 symbols completed. LMT took 1.3s. Estimated remaining: 6m 34s. Rate: 145.7 symbols/min [2025-09-30T22:11:29.766883] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:29.767029] [INFO ] [MAIN ] Derivative Progress: 1053/2009 symbols completed. LNC took 1.3s. Estimated remaining: 6m 33s. Rate: 145.8 symbols/min [2025-09-30T22:11:29.767234] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:29.796309] [DEBUG] [LOCAL ] LNN: Loaded 11224 existing records from primary storage. [2025-09-30T22:11:29.797190] [INFO ] [MAIN ] LNN: Loaded 11224 primary data records. [2025-09-30T22:11:29.876304] [DEBUG] [LOCAL ] LNG: Loaded 51406 existing records from primary storage. [2025-09-30T22:11:29.922189] [INFO ] [MAIN ] LNG: Loaded 51406 primary data records. [2025-09-30T22:11:30.081123] [DEBUG] [LOCAL ] LOAR: Loaded 41572 existing records from primary storage. [2025-09-30T22:11:30.152452] [INFO ] [MAIN ] LOAR: Loaded 41572 primary data records. [2025-09-30T22:11:30.959138] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:30.961526] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11224 primary records. [2025-09-30T22:11:30.962738] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-30T22:11:30.990758] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:30.996211] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51406 primary records. [2025-09-30T22:11:30.995229] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-30T22:11:30.996680] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-30T22:11:30.998778] [INFO ] [MAIN ] Derivative Progress: 1054/2009 symbols completed. LNN took 1.2s. Estimated remaining: 6m 34s. Rate: 145.5 symbols/min [2025-09-30T22:11:30.999151] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:30.998976] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-30T22:11:31.028348] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-30T22:11:31.033798] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:31.033956] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-30T22:11:31.034715] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41572 primary records. [2025-09-30T22:11:31.036970] [INFO ] [MAIN ] Derivative Progress: 1055/2009 symbols completed. LNG took 1.3s. Estimated remaining: 6m 33s. Rate: 145.7 symbols/min [2025-09-30T22:11:31.037136] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:31.037673] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-30T22:11:31.064017] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-30T22:11:31.064147] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-30T22:11:31.066746] [INFO ] [MAIN ] Derivative Progress: 1056/2009 symbols completed. LOAR took 1.3s. Estimated remaining: 6m 32s. Rate: 145.8 symbols/min [2025-09-30T22:11:31.067189] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:31.085124] [DEBUG] [LOCAL ] LOB: Loaded 27471 existing records from primary storage. [2025-09-30T22:11:31.085410] [INFO ] [MAIN ] LOB: Loaded 27471 primary data records. [2025-09-30T22:11:31.231809] [DEBUG] [LOCAL ] LOMA: Loaded 32080 existing records from primary storage. [2025-09-30T22:11:31.243128] [INFO ] [MAIN ] LOMA: Loaded 32080 primary data records. [2025-09-30T22:11:31.629057] [DEBUG] [LOCAL ] LOW: Loaded 52947 existing records from primary storage. [2025-09-30T22:11:31.660253] [INFO ] [MAIN ] LOW: Loaded 52947 primary data records. [2025-09-30T22:11:32.186510] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:32.187520] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27471 primary records. [2025-09-30T22:11:32.191508] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-30T22:11:32.220245] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:32.222495] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32080 primary records. [2025-09-30T22:11:32.223006] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-30T22:11:32.240575] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-30T22:11:32.243794] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-30T22:11:32.245789] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-30T22:11:32.248085] [INFO ] [MAIN ] Derivative Progress: 1057/2009 symbols completed. LOB took 1.2s. Estimated remaining: 6m 32s. Rate: 145.5 symbols/min [2025-09-30T22:11:32.248339] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:32.249198] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-30T22:11:32.251466] [INFO ] [MAIN ] Derivative Progress: 1058/2009 symbols completed. LOMA took 1.2s. Estimated remaining: 6m 32s. Rate: 145.7 symbols/min [2025-09-30T22:11:32.251899] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:32.270998] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:32.271839] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52947 primary records. [2025-09-30T22:11:32.272109] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-30T22:11:32.289982] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-30T22:11:32.291358] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-30T22:11:32.294494] [INFO ] [MAIN ] Derivative Progress: 1059/2009 symbols completed. LOW took 1.2s. Estimated remaining: 6m 31s. Rate: 145.8 symbols/min [2025-09-30T22:11:32.294873] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:32.323499] [DEBUG] [LOCAL ] LPL: Loaded 26306 existing records from primary storage. [2025-09-30T22:11:32.323684] [INFO ] [MAIN ] LPL: Loaded 26306 primary data records. [2025-09-30T22:11:32.472223] [DEBUG] [LOCAL ] LPG: Loaded 39874 existing records from primary storage. [2025-09-30T22:11:32.477533] [INFO ] [MAIN ] LPG: Loaded 39874 primary data records. [2025-09-30T22:11:32.814208] [DEBUG] [LOCAL ] LPX: Loaded 39672 existing records from primary storage. [2025-09-30T22:11:32.847413] [INFO ] [MAIN ] LPX: Loaded 39672 primary data records. [2025-09-30T22:11:33.479119] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:33.481353] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 26306 primary records. [2025-09-30T22:11:33.482201] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-30T22:11:33.500874] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-30T22:11:33.501241] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-30T22:11:33.503351] [INFO ] [MAIN ] Derivative Progress: 1060/2009 symbols completed. LPL took 1.3s. Estimated remaining: 6m 31s. Rate: 145.5 symbols/min [2025-09-30T22:11:33.503759] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:33.524351] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:33.525288] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39874 primary records. [2025-09-30T22:11:33.525489] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-30T22:11:33.546961] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-30T22:11:33.547518] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-30T22:11:33.562669] [INFO ] [MAIN ] Derivative Progress: 1061/2009 symbols completed. LPG took 1.3s. Estimated remaining: 6m 31s. Rate: 145.6 symbols/min [2025-09-30T22:11:33.563482] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:33.563673] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:33.564747] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39672 primary records. [2025-09-30T22:11:33.565218] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-30T22:11:33.591505] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-30T22:11:33.591669] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-30T22:11:33.594346] [INFO ] [MAIN ] Derivative Progress: 1062/2009 symbols completed. LPX took 1.3s. Estimated remaining: 6m 30s. Rate: 145.8 symbols/min [2025-09-30T22:11:33.594550] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:33.609423] [DEBUG] [LOCAL ] LRN: Loaded 39818 existing records from primary storage. [2025-09-30T22:11:33.609696] [INFO ] [MAIN ] LRN: Loaded 39818 primary data records. [2025-09-30T22:11:33.963627] [DEBUG] [LOCAL ] LTC: Loaded 30125 existing records from primary storage. [2025-09-30T22:11:33.963133] [DEBUG] [LOCAL ] LSPD: Loaded 42882 existing records from primary storage. [2025-09-30T22:11:33.963877] [INFO ] [MAIN ] LTC: Loaded 30125 primary data records. [2025-09-30T22:11:33.963948] [INFO ] [MAIN ] LSPD: Loaded 42882 primary data records. [2025-09-30T22:11:34.637508] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:34.638352] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39818 primary records. [2025-09-30T22:11:34.638469] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-30T22:11:34.661228] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-30T22:11:34.661615] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-30T22:11:34.676848] [INFO ] [MAIN ] Derivative Progress: 1063/2009 symbols completed. LRN took 1.2s. Estimated remaining: 6m 30s. Rate: 145.6 symbols/min [2025-09-30T22:11:34.674622] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:34.679800] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30125 primary records. [2025-09-30T22:11:34.680728] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-30T22:11:34.705502] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:34.707921] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42882 primary records. [2025-09-30T22:11:34.711201] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-30T22:11:34.711145] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-30T22:11:34.711319] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-30T22:11:34.714415] [INFO ] [MAIN ] Derivative Progress: 1064/2009 symbols completed. LTC took 1.1s. Estimated remaining: 6m 29s. Rate: 145.7 symbols/min [2025-09-30T22:11:34.729619] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-30T22:11:34.729754] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-30T22:11:34.734096] [INFO ] [MAIN ] Derivative Progress: 1065/2009 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 28s. Rate: 145.8 symbols/min [2025-09-30T22:11:34.734541] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:34.734636] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:34.735012] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:34.825699] [DEBUG] [LOCAL ] LU: Loaded 48947 existing records from primary storage. [2025-09-30T22:11:34.838429] [DEBUG] [LOCAL ] LTH: Loaded 51759 existing records from primary storage. [2025-09-30T22:11:34.839235] [DEBUG] [LOCAL ] LTM: Loaded 36826 existing records from primary storage. [2025-09-30T22:11:34.838552] [INFO ] [MAIN ] LU: Loaded 48947 primary data records. [2025-09-30T22:11:34.838746] [INFO ] [MAIN ] LTH: Loaded 51759 primary data records. [2025-09-30T22:11:34.839489] [INFO ] [MAIN ] LTM: Loaded 36826 primary data records. [2025-09-30T22:11:35.907050] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:35.908981] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48947 primary records. [2025-09-30T22:11:35.909426] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-30T22:11:35.966272] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:35.969055] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36826 primary records. [2025-09-30T22:11:35.968058] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:35.970126] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-30T22:11:35.971360] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51759 primary records. [2025-09-30T22:11:35.973198] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-30T22:11:35.974192] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-30T22:11:35.974863] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-30T22:11:35.978033] [INFO ] [MAIN ] Derivative Progress: 1066/2009 symbols completed. LU took 1.2s. Estimated remaining: 6m 29s. Rate: 145.5 symbols/min [2025-09-30T22:11:36.000557] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:36.010752] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-30T22:11:36.011880] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-30T22:11:36.014731] [INFO ] [MAIN ] Derivative Progress: 1067/2009 symbols completed. LTM took 1.3s. Estimated remaining: 6m 28s. Rate: 145.7 symbols/min [2025-09-30T22:11:36.015852] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:36.021385] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-30T22:11:36.021584] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-30T22:11:36.025571] [INFO ] [MAIN ] Derivative Progress: 1068/2009 symbols completed. LTH took 1.3s. Estimated remaining: 6m 27s. Rate: 145.8 symbols/min [2025-09-30T22:11:36.025973] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:36.103595] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-30T22:11:36.103934] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-30T22:11:36.249412] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-30T22:11:36.255028] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-30T22:11:36.334870] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-30T22:11:36.341092] [INFO ] [MAIN ] LVS: Loaded 53564 primary data records. [2025-09-30T22:11:37.537457] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:37.538926] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-30T22:11:37.539124] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-30T22:11:37.558587] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-30T22:11:37.558881] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-30T22:11:37.560772] [INFO ] [MAIN ] Derivative Progress: 1069/2009 symbols completed. LUMN took 1.6s. Estimated remaining: 6m 28s. Rate: 145.4 symbols/min [2025-09-30T22:11:37.561390] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:37.584313] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:37.593450] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-30T22:11:37.603600] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-30T22:11:37.604002] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:37.606080] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53564 primary records. [2025-09-30T22:11:37.613190] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-30T22:11:37.614800] [DEBUG] [LOCAL ] LVWR: Loaded 17657 existing records from primary storage. [2025-09-30T22:11:37.626562] [INFO ] [MAIN ] LVWR: Loaded 17657 primary data records. [2025-09-30T22:11:37.679725] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-30T22:11:37.681018] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-30T22:11:37.681270] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-30T22:11:37.681178] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-30T22:11:37.699560] [INFO ] [MAIN ] Derivative Progress: 1070/2009 symbols completed. LVS took 1.7s. Estimated remaining: 6m 27s. Rate: 145.5 symbols/min [2025-09-30T22:11:37.713734] [INFO ] [MAIN ] Derivative Progress: 1071/2009 symbols completed. LUV took 1.7s. Estimated remaining: 6m 26s. Rate: 145.6 symbols/min [2025-09-30T22:11:37.704952] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:37.730685] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:38.029241] [DEBUG] [LOCAL ] LXFR: Loaded 16855 existing records from primary storage. [2025-09-30T22:11:38.044228] [INFO ] [MAIN ] LXFR: Loaded 16855 primary data records. [2025-09-30T22:11:38.233078] [DEBUG] [LOCAL ] LW: Loaded 51157 existing records from primary storage. [2025-09-30T22:11:38.268689] [INFO ] [MAIN ] LW: Loaded 51157 primary data records. [2025-09-30T22:11:38.790769] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:38.791795] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17657 primary records. [2025-09-30T22:11:38.791951] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-30T22:11:38.810523] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-30T22:11:38.811348] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-30T22:11:38.813932] [INFO ] [MAIN ] Derivative Progress: 1072/2009 symbols completed. LVWR took 1.3s. Estimated remaining: 6m 27s. Rate: 145.4 symbols/min [2025-09-30T22:11:38.814891] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:38.834443] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:38.835559] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16855 primary records. [2025-09-30T22:11:38.835916] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-30T22:11:38.856034] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-30T22:11:38.856584] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-30T22:11:38.860435] [INFO ] [MAIN ] Derivative Progress: 1073/2009 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 26s. Rate: 145.5 symbols/min [2025-09-30T22:11:38.860808] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:38.875586] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:38.876406] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51157 primary records. [2025-09-30T22:11:38.876691] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-30T22:11:38.908633] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-30T22:11:38.909793] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-30T22:11:38.912270] [INFO ] [MAIN ] Derivative Progress: 1074/2009 symbols completed. LW took 1.2s. Estimated remaining: 6m 25s. Rate: 145.7 symbols/min [2025-09-30T22:11:38.926786] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:38.939193] [DEBUG] [LOCAL ] LXP: Loaded 50687 existing records from primary storage. [2025-09-30T22:11:38.939514] [INFO ] [MAIN ] LXP: Loaded 50687 primary data records. [2025-09-30T22:11:39.054339] [DEBUG] [LOCAL ] LXU: Loaded 31733 existing records from primary storage. [2025-09-30T22:11:39.074754] [INFO ] [MAIN ] LXU: Loaded 31733 primary data records. [2025-09-30T22:11:39.531949] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-09-30T22:11:39.644871] [INFO ] [MAIN ] LYB: Loaded 53600 primary data records. [2025-09-30T22:11:40.012773] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:40.013722] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50687 primary records. [2025-09-30T22:11:40.014155] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-30T22:11:40.048716] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:40.050473] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31733 primary records. [2025-09-30T22:11:40.050974] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-30T22:11:40.051802] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-30T22:11:40.052541] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-30T22:11:40.054637] [INFO ] [MAIN ] Derivative Progress: 1075/2009 symbols completed. LXP took 1.2s. Estimated remaining: 6m 25s. Rate: 145.4 symbols/min [2025-09-30T22:11:40.054856] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:40.075257] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-30T22:11:40.075741] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-30T22:11:40.078178] [INFO ] [MAIN ] Derivative Progress: 1076/2009 symbols completed. LXU took 1.2s. Estimated remaining: 6m 25s. Rate: 145.5 symbols/min [2025-09-30T22:11:40.078381] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:40.093560] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:40.094415] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53600 primary records. [2025-09-30T22:11:40.094596] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-30T22:11:40.112695] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-30T22:11:40.112860] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-30T22:11:40.115463] [INFO ] [MAIN ] Derivative Progress: 1077/2009 symbols completed. LYB took 1.2s. Estimated remaining: 6m 24s. Rate: 145.7 symbols/min [2025-09-30T22:11:40.115734] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:40.169629] [DEBUG] [LOCAL ] LYG: Loaded 52804 existing records from primary storage. [2025-09-30T22:11:40.169985] [INFO ] [MAIN ] LYG: Loaded 52804 primary data records. [2025-09-30T22:11:40.322817] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-09-30T22:11:40.333367] [INFO ] [MAIN ] LYV: Loaded 51121 primary data records. [2025-09-30T22:11:40.345383] [DEBUG] [LOCAL ] LZB: Loaded 35551 existing records from primary storage. [2025-09-30T22:11:40.370603] [INFO ] [MAIN ] LZB: Loaded 35551 primary data records. [2025-09-30T22:11:41.316825] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:41.318407] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52804 primary records. [2025-09-30T22:11:41.318686] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-30T22:11:41.350359] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-30T22:11:41.350833] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-30T22:11:41.355494] [INFO ] [MAIN ] Derivative Progress: 1078/2009 symbols completed. LYG took 1.3s. Estimated remaining: 6m 24s. Rate: 145.4 symbols/min [2025-09-30T22:11:41.369790] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:41.370516] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51121 primary records. [2025-09-30T22:11:41.370790] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-30T22:11:41.392878] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-30T22:11:41.406351] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:41.407103] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35551 primary records. [2025-09-30T22:11:41.406029] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-30T22:11:41.410440] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-30T22:11:41.410350] [INFO ] [MAIN ] Derivative Progress: 1079/2009 symbols completed. LYV took 1.3s. Estimated remaining: 6m 23s. Rate: 145.5 symbols/min [2025-09-30T22:11:41.427379] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-30T22:11:41.427535] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-30T22:11:41.430226] [INFO ] [MAIN ] Derivative Progress: 1080/2009 symbols completed. LZB took 1.3s. Estimated remaining: 6m 23s. Rate: 145.6 symbols/min [2025-09-30T22:11:41.431087] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:41.431022] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:41.431232] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:41.450497] [DEBUG] [LOCAL ] LZM: Loaded 13960 existing records from primary storage. [2025-09-30T22:11:41.450635] [INFO ] [MAIN ] LZM: Loaded 13960 primary data records. [2025-09-30T22:11:41.846896] [DEBUG] [LOCAL ] MA: Loaded 52531 existing records from primary storage. [2025-09-30T22:11:41.861094] [INFO ] [MAIN ] MA: Loaded 52531 primary data records. [2025-09-30T22:11:41.869263] [DEBUG] [LOCAL ] M: Loaded 53535 existing records from primary storage. [2025-09-30T22:11:41.888946] [INFO ] [MAIN ] M: Loaded 53535 primary data records. [2025-09-30T22:11:42.607562] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:42.609541] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13960 primary records. [2025-09-30T22:11:42.610120] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-30T22:11:42.629939] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-30T22:11:42.630844] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-30T22:11:42.633315] [INFO ] [MAIN ] Derivative Progress: 1081/2009 symbols completed. LZM took 1.2s. Estimated remaining: 6m 23s. Rate: 145.4 symbols/min [2025-09-30T22:11:42.633713] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:42.656988] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:42.658151] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53535 primary records. [2025-09-30T22:11:42.658346] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-30T22:11:42.672322] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:42.684971] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52531 primary records. [2025-09-30T22:11:42.685170] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-30T22:11:42.707169] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-30T22:11:42.708428] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-30T22:11:42.708628] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-30T22:11:42.711044] [INFO ] [MAIN ] Derivative Progress: 1082/2009 symbols completed. M took 1.3s. Estimated remaining: 6m 22s. Rate: 145.5 symbols/min [2025-09-30T22:11:42.708547] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-30T22:11:42.711288] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:42.713842] [INFO ] [MAIN ] Derivative Progress: 1083/2009 symbols completed. MA took 1.3s. Estimated remaining: 6m 22s. Rate: 145.6 symbols/min [2025-09-30T22:11:42.714577] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:42.764198] [DEBUG] [LOCAL ] MAA: Loaded 42672 existing records from primary storage. [2025-09-30T22:11:42.764503] [INFO ] [MAIN ] MAA: Loaded 42672 primary data records. [2025-09-30T22:11:42.896208] [DEBUG] [LOCAL ] MAGN: Loaded 34849 existing records from primary storage. [2025-09-30T22:11:42.910878] [INFO ] [MAIN ] MAGN: Loaded 34849 primary data records. [2025-09-30T22:11:43.126548] [DEBUG] [LOCAL ] MAC: Loaded 49676 existing records from primary storage. [2025-09-30T22:11:43.256942] [INFO ] [MAIN ] MAC: Loaded 49676 primary data records. [2025-09-30T22:11:43.828349] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:11:43.830466] [INFO ] [MAIN ] MAA: Generated 1793 derivative records from 42672 primary records. [2025-09-30T22:11:43.838967] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-30T22:11:43.845669] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:43.847108] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34849 primary records. [2025-09-30T22:11:43.855294] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-30T22:11:43.865564] [DEBUG] [LOCAL ] MAA: Derivative data saved (1793 records). [2025-09-30T22:11:43.865931] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-30T22:11:43.868782] [INFO ] [MAIN ] Derivative Progress: 1084/2009 symbols completed. MAA took 1.2s. Estimated remaining: 6m 22s. Rate: 145.4 symbols/min [2025-09-30T22:11:43.876558] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:43.888937] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-30T22:11:43.889324] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-30T22:11:43.891900] [INFO ] [MAIN ] Derivative Progress: 1085/2009 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 21s. Rate: 145.5 symbols/min [2025-09-30T22:11:43.892208] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:43.906041] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:43.906957] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49676 primary records. [2025-09-30T22:11:43.907093] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-30T22:11:43.924994] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-30T22:11:43.925242] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-30T22:11:43.927827] [INFO ] [MAIN ] Derivative Progress: 1086/2009 symbols completed. MAC took 1.2s. Estimated remaining: 6m 20s. Rate: 145.6 symbols/min [2025-09-30T22:11:43.928110] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:43.975588] [DEBUG] [LOCAL ] MAIN: Loaded 41190 existing records from primary storage. [2025-09-30T22:11:43.988687] [DEBUG] [LOCAL ] MAN: Loaded 43544 existing records from primary storage. [2025-09-30T22:11:43.987723] [INFO ] [MAIN ] MAIN: Loaded 41190 primary data records. [2025-09-30T22:11:43.988846] [INFO ] [MAIN ] MAN: Loaded 43544 primary data records. [2025-09-30T22:11:44.092247] [DEBUG] [LOCAL ] MANU: Loaded 27013 existing records from primary storage. [2025-09-30T22:11:44.158729] [INFO ] [MAIN ] MANU: Loaded 27013 primary data records. [2025-09-30T22:11:45.061832] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:45.075563] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43544 primary records. [2025-09-30T22:11:45.076874] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-30T22:11:45.076754] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:45.078544] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41190 primary records. [2025-09-30T22:11:45.079687] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-30T22:11:45.109121] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-30T22:11:45.113105] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-30T22:11:45.116453] [INFO ] [MAIN ] Derivative Progress: 1087/2009 symbols completed. MAN took 1.2s. Estimated remaining: 6m 21s. Rate: 145.4 symbols/min [2025-09-30T22:11:45.117281] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:45.131901] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-30T22:11:45.132304] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:45.133508] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27013 primary records. [2025-09-30T22:11:45.133609] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-30T22:11:45.132381] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-30T22:11:45.137047] [INFO ] [MAIN ] Derivative Progress: 1088/2009 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 20s. Rate: 145.5 symbols/min [2025-09-30T22:11:45.141881] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:45.159347] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-30T22:11:45.159586] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-30T22:11:45.162182] [INFO ] [MAIN ] Derivative Progress: 1089/2009 symbols completed. MANU took 1.2s. Estimated remaining: 6m 19s. Rate: 145.6 symbols/min [2025-09-30T22:11:45.162465] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:45.217475] [DEBUG] [LOCAL ] MATV: Loaded 36847 existing records from primary storage. [2025-09-30T22:11:45.217694] [INFO ] [MAIN ] MATV: Loaded 36847 primary data records. [2025-09-30T22:11:45.309700] [DEBUG] [LOCAL ] MATX: Loaded 31534 existing records from primary storage. [2025-09-30T22:11:45.325188] [DEBUG] [LOCAL ] MAS: Loaded 52338 existing records from primary storage. [2025-09-30T22:11:45.325422] [INFO ] [MAIN ] MAS: Loaded 52338 primary data records. [2025-09-30T22:11:45.325350] [INFO ] [MAIN ] MATX: Loaded 31534 primary data records. [2025-09-30T22:11:46.258053] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:46.259328] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 36847 primary records. [2025-09-30T22:11:46.259548] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-30T22:11:46.280770] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-30T22:11:46.281761] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-30T22:11:46.284818] [INFO ] [MAIN ] Derivative Progress: 1090/2009 symbols completed. MATV took 1.1s. Estimated remaining: 6m 19s. Rate: 145.4 symbols/min [2025-09-30T22:11:46.285280] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:46.307355] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:46.313843] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:46.313581] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52338 primary records. [2025-09-30T22:11:46.314548] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31534 primary records. [2025-09-30T22:11:46.314762] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-30T22:11:46.315828] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-30T22:11:46.353760] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-30T22:11:46.356629] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-30T22:11:46.360365] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-30T22:11:46.360489] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-30T22:11:46.360165] [INFO ] [MAIN ] Derivative Progress: 1091/2009 symbols completed. MATX took 1.2s. Estimated remaining: 6m 19s. Rate: 145.5 symbols/min [2025-09-30T22:11:46.362880] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:46.363142] [INFO ] [MAIN ] Derivative Progress: 1092/2009 symbols completed. MAS took 1.2s. Estimated remaining: 6m 18s. Rate: 145.6 symbols/min [2025-09-30T22:11:46.363542] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:46.375336] [DEBUG] [LOCAL ] MAX: Loaded 30628 existing records from primary storage. [2025-09-30T22:11:46.375674] [INFO ] [MAIN ] MAX: Loaded 30628 primary data records. [2025-09-30T22:11:46.518634] [DEBUG] [LOCAL ] MBI: Loaded 24289 existing records from primary storage. [2025-09-30T22:11:46.524047] [INFO ] [MAIN ] MBI: Loaded 24289 primary data records. [2025-09-30T22:11:46.848679] [DEBUG] [LOCAL ] MBC: Loaded 43179 existing records from primary storage. [2025-09-30T22:11:46.882802] [INFO ] [MAIN ] MBC: Loaded 43179 primary data records. [2025-09-30T22:11:47.450315] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:47.451587] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30628 primary records. [2025-09-30T22:11:47.451818] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-30T22:11:47.470988] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-30T22:11:47.471176] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-30T22:11:47.473271] [INFO ] [MAIN ] Derivative Progress: 1093/2009 symbols completed. MAX took 1.2s. Estimated remaining: 6m 18s. Rate: 145.4 symbols/min [2025-09-30T22:11:47.498978] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:47.500085] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24289 primary records. [2025-09-30T22:11:47.500304] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-30T22:11:47.523842] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-30T22:11:47.524085] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-30T22:11:47.526417] [INFO ] [MAIN ] Derivative Progress: 1094/2009 symbols completed. MBI took 1.2s. Estimated remaining: 6m 17s. Rate: 145.5 symbols/min [2025-09-30T22:11:47.540095] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:47.540913] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43179 primary records. [2025-09-30T22:11:47.540977] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-30T22:11:47.556737] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-30T22:11:47.556875] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-30T22:11:47.559857] [INFO ] [MAIN ] Derivative Progress: 1095/2009 symbols completed. MBC took 1.2s. Estimated remaining: 6m 17s. Rate: 145.7 symbols/min [2025-09-30T22:11:47.560371] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:47.560479] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:47.560599] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:47.582509] [DEBUG] [LOCAL ] MCB: Loaded 11531 existing records from primary storage. [2025-09-30T22:11:47.583389] [INFO ] [MAIN ] MCB: Loaded 11531 primary data records. [2025-09-30T22:11:47.583185] [DEBUG] [LOCAL ] MCI: Loaded 6378 existing records from primary storage. [2025-09-30T22:11:47.583581] [INFO ] [MAIN ] MCI: Loaded 6378 primary data records. [2025-09-30T22:11:47.951545] [DEBUG] [LOCAL ] MC: Loaded 44091 existing records from primary storage. [2025-09-30T22:11:48.034363] [INFO ] [MAIN ] MC: Loaded 44091 primary data records. [2025-09-30T22:11:48.648109] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:48.649091] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6378 primary records. [2025-09-30T22:11:48.649347] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-30T22:11:48.672850] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-30T22:11:48.687268] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-30T22:11:48.687184] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:48.689494] [INFO ] [MAIN ] Derivative Progress: 1096/2009 symbols completed. MCI took 1.1s. Estimated remaining: 6m 17s. Rate: 145.4 symbols/min [2025-09-30T22:11:48.690842] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:48.690721] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11531 primary records. [2025-09-30T22:11:48.691679] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-30T22:11:48.716389] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-30T22:11:48.734267] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-30T22:11:48.733853] [DEBUG] [LOCAL ] MCN: Loaded 8182 existing records from primary storage. [2025-09-30T22:11:48.737154] [INFO ] [MAIN ] Derivative Progress: 1097/2009 symbols completed. MCB took 1.2s. Estimated remaining: 6m 16s. Rate: 145.5 symbols/min [2025-09-30T22:11:48.737374] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:48.738044] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:48.737485] [INFO ] [MAIN ] MCN: Loaded 8182 primary data records. [2025-09-30T22:11:48.761572] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44091 primary records. [2025-09-30T22:11:48.778288] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-30T22:11:48.975013] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-30T22:11:48.975374] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-30T22:11:48.978219] [INFO ] [MAIN ] Derivative Progress: 1098/2009 symbols completed. MC took 1.4s. Estimated remaining: 6m 15s. Rate: 145.6 symbols/min [2025-09-30T22:11:49.029554] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:49.141304] [DEBUG] [LOCAL ] MCO: Loaded 39288 existing records from primary storage. [2025-09-30T22:11:49.144153] [INFO ] [MAIN ] MCO: Loaded 39288 primary data records. [2025-09-30T22:11:49.208282] [DEBUG] [LOCAL ] MCR: Loaded 8737 existing records from primary storage. [2025-09-30T22:11:49.217344] [INFO ] [MAIN ] MCR: Loaded 8737 primary data records. [2025-09-30T22:11:49.850766] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:49.854146] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8182 primary records. [2025-09-30T22:11:49.855271] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-30T22:11:49.875370] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-30T22:11:49.875898] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-30T22:11:49.878255] [INFO ] [MAIN ] Derivative Progress: 1099/2009 symbols completed. MCN took 1.2s. Estimated remaining: 6m 15s. Rate: 145.4 symbols/min [2025-09-30T22:11:49.878788] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:49.897890] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:49.898868] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39288 primary records. [2025-09-30T22:11:49.898999] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-30T22:11:49.937812] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-09-30T22:11:49.938415] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-30T22:11:49.940745] [INFO ] [MAIN ] Derivative Progress: 1100/2009 symbols completed. MCO took 1.2s. Estimated remaining: 6m 15s. Rate: 145.5 symbols/min [2025-09-30T22:11:49.940997] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:49.938328] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:49.942066] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8737 primary records. [2025-09-30T22:11:49.942862] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-30T22:11:49.968038] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-30T22:11:49.968339] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-30T22:11:49.970948] [INFO ] [MAIN ] Derivative Progress: 1101/2009 symbols completed. MCR took 0.9s. Estimated remaining: 6m 14s. Rate: 145.7 symbols/min [2025-09-30T22:11:49.968234] [DEBUG] [LOCAL ] MCS: Loaded 20933 existing records from primary storage. [2025-09-30T22:11:49.971471] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:49.971277] [INFO ] [MAIN ] MCS: Loaded 20933 primary data records. [2025-09-30T22:11:50.128061] [DEBUG] [LOCAL ] MCY: Loaded 24490 existing records from primary storage. [2025-09-30T22:11:50.168207] [INFO ] [MAIN ] MCY: Loaded 24490 primary data records. [2025-09-30T22:11:50.402015] [DEBUG] [LOCAL ] MD: Loaded 38339 existing records from primary storage. [2025-09-30T22:11:50.465125] [INFO ] [MAIN ] MD: Loaded 38339 primary data records. [2025-09-30T22:11:51.203611] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:51.206900] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20933 primary records. [2025-09-30T22:11:51.207553] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-30T22:11:51.230438] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-30T22:11:51.230721] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-30T22:11:51.241168] [INFO ] [MAIN ] Derivative Progress: 1102/2009 symbols completed. MCS took 1.4s. Estimated remaining: 6m 14s. Rate: 145.4 symbols/min [2025-09-30T22:11:51.246957] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:51.247260] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:51.248256] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 24490 primary records. [2025-09-30T22:11:51.248897] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-30T22:11:51.268273] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-30T22:11:51.271333] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-30T22:11:51.275060] [INFO ] [MAIN ] Derivative Progress: 1103/2009 symbols completed. MCY took 1.3s. Estimated remaining: 6m 14s. Rate: 145.5 symbols/min [2025-09-30T22:11:51.271813] [DEBUG] [LOCAL ] MDST: Loaded 5641 existing records from primary storage. [2025-09-30T22:11:51.275317] [INFO ] [MAIN ] MDST: Loaded 5641 primary data records. [2025-09-30T22:11:51.280638] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:51.365274] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:51.389973] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38339 primary records. [2025-09-30T22:11:51.407856] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-30T22:11:51.682362] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-30T22:11:51.699932] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-30T22:11:51.702512] [INFO ] [MAIN ] Derivative Progress: 1104/2009 symbols completed. MD took 1.7s. Estimated remaining: 6m 13s. Rate: 145.5 symbols/min [2025-09-30T22:11:51.703565] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:51.732166] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-30T22:11:51.732535] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-30T22:11:51.978500] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:52.001917] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5641 primary records. [2025-09-30T22:11:52.130782] [DEBUG] [LOCAL ] MDU: Loaded 47904 existing records from primary storage. [2025-09-30T22:11:52.131065] [INFO ] [MAIN ] MDU: Loaded 47904 primary data records. [2025-09-30T22:11:52.112851] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-30T22:11:52.225501] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-09-30T22:11:52.238369] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-30T22:11:52.246345] [INFO ] [MAIN ] Derivative Progress: 1105/2009 symbols completed. MDST took 1.0s. Estimated remaining: 6m 13s. Rate: 145.5 symbols/min [2025-09-30T22:11:52.267601] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:52.361573] [DEBUG] [LOCAL ] MDV: Loaded 8512 existing records from primary storage. [2025-09-30T22:11:52.484823] [INFO ] [MAIN ] MDV: Loaded 8512 primary data records. [2025-09-30T22:11:52.851434] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:52.852994] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-30T22:11:52.853155] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-30T22:11:52.874566] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-30T22:11:52.875182] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-30T22:11:52.889551] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:52.892920] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47904 primary records. [2025-09-30T22:11:52.891933] [INFO ] [MAIN ] Derivative Progress: 1106/2009 symbols completed. MDT took 1.6s. Estimated remaining: 6m 13s. Rate: 145.4 symbols/min [2025-09-30T22:11:52.893191] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:52.893265] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-30T22:11:52.923157] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-30T22:11:52.923562] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-30T22:11:52.925950] [INFO ] [MAIN ] Derivative Progress: 1107/2009 symbols completed. MDU took 1.2s. Estimated remaining: 6m 12s. Rate: 145.5 symbols/min [2025-09-30T22:11:52.926296] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:52.936987] [DEBUG] [LOCAL ] MEC: Loaded 16312 existing records from primary storage. [2025-09-30T22:11:52.937373] [INFO ] [MAIN ] MEC: Loaded 16312 primary data records. [2025-09-30T22:11:53.009740] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:53.021212] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8512 primary records. [2025-09-30T22:11:53.038397] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-30T22:11:53.093573] [DEBUG] [LOCAL ] MED: Loaded 21517 existing records from primary storage. [2025-09-30T22:11:53.118064] [INFO ] [MAIN ] MED: Loaded 21517 primary data records. [2025-09-30T22:11:53.322376] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-30T22:11:53.328463] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-30T22:11:53.331496] [INFO ] [MAIN ] Derivative Progress: 1108/2009 symbols completed. MDV took 1.1s. Estimated remaining: 6m 11s. Rate: 145.5 symbols/min [2025-09-30T22:11:53.874120] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:53.875302] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16312 primary records. [2025-09-30T22:11:53.875498] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-30T22:11:53.906865] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:53.912325] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21517 primary records. [2025-09-30T22:11:53.913749] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-30T22:11:53.933603] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-30T22:11:53.934814] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-30T22:11:53.940956] [INFO ] [MAIN ] Derivative Progress: 1109/2009 symbols completed. MEC took 1.0s. Estimated remaining: 6m 11s. Rate: 145.5 symbols/min [2025-09-30T22:11:53.941687] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-30T22:11:53.941830] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-30T22:11:53.944879] [INFO ] [MAIN ] Derivative Progress: 1110/2009 symbols completed. MED took 1.0s. Estimated remaining: 6m 11s. Rate: 145.6 symbols/min [2025-09-30T22:11:53.945825] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:53.946049] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:53.945752] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:53.968836] [DEBUG] [LOCAL ] MEGI: Loaded 20119 existing records from primary storage. [2025-09-30T22:11:53.969072] [INFO ] [MAIN ] MEGI: Loaded 20119 primary data records. [2025-09-30T22:11:54.118611] [DEBUG] [LOCAL ] MEG: Loaded 31793 existing records from primary storage. [2025-09-30T22:11:54.120508] [DEBUG] [LOCAL ] MEI: Loaded 32087 existing records from primary storage. [2025-09-30T22:11:54.131177] [INFO ] [MAIN ] MEI: Loaded 32087 primary data records. [2025-09-30T22:11:54.136417] [INFO ] [MAIN ] MEG: Loaded 31793 primary data records. [2025-09-30T22:11:55.069115] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:55.070617] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20119 primary records. [2025-09-30T22:11:55.070934] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-30T22:11:55.095451] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-30T22:11:55.095962] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-30T22:11:55.098615] [INFO ] [MAIN ] Derivative Progress: 1111/2009 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 11s. Rate: 145.4 symbols/min [2025-09-30T22:11:55.101996] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:55.130472] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:55.132694] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32087 primary records. [2025-09-30T22:11:55.133139] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-30T22:11:55.166460] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:55.168993] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31793 primary records. [2025-09-30T22:11:55.169689] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-30T22:11:55.188928] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-30T22:11:55.191325] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-30T22:11:55.195139] [INFO ] [MAIN ] Derivative Progress: 1112/2009 symbols completed. MEI took 1.2s. Estimated remaining: 6m 10s. Rate: 145.5 symbols/min [2025-09-30T22:11:55.196902] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:55.215064] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-30T22:11:55.215204] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-30T22:11:55.217815] [INFO ] [MAIN ] Derivative Progress: 1113/2009 symbols completed. MEG took 1.3s. Estimated remaining: 6m 9s. Rate: 145.6 symbols/min [2025-09-30T22:11:55.218117] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:55.226081] [DEBUG] [LOCAL ] MFAN: Loaded 4223 existing records from primary storage. [2025-09-30T22:11:55.227051] [INFO ] [MAIN ] MFAN: Loaded 4223 primary data records. [2025-09-30T22:11:55.329847] [DEBUG] [LOCAL ] MET: Loaded 53310 existing records from primary storage. [2025-09-30T22:11:55.365519] [INFO ] [MAIN ] MET: Loaded 53310 primary data records. [2025-09-30T22:11:55.709770] [DEBUG] [LOCAL ] MFA: Loaded 45453 existing records from primary storage. [2025-09-30T22:11:55.711141] [INFO ] [MAIN ] MFA: Loaded 45453 primary data records. [2025-09-30T22:11:56.330522] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:56.331833] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4223 primary records. [2025-09-30T22:11:56.332097] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-30T22:11:56.360983] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-30T22:11:56.366352] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-30T22:11:56.369131] [INFO ] [MAIN ] Derivative Progress: 1114/2009 symbols completed. MFAN took 1.2s. Estimated remaining: 6m 9s. Rate: 145.3 symbols/min [2025-09-30T22:11:56.369741] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:56.370138] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:56.373712] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53310 primary records. [2025-09-30T22:11:56.374780] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-30T22:11:56.398271] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:56.401394] [DEBUG] [LOCAL ] MFAO: Loaded 3793 existing records from primary storage. [2025-09-30T22:11:56.406505] [INFO ] [MAIN ] MFAO: Loaded 3793 primary data records. [2025-09-30T22:11:56.414139] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45453 primary records. [2025-09-30T22:11:56.418484] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-30T22:11:56.424273] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-30T22:11:56.427067] [INFO ] [MAIN ] Derivative Progress: 1115/2009 symbols completed. MET took 1.3s. Estimated remaining: 6m 9s. Rate: 145.5 symbols/min [2025-09-30T22:11:56.424488] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-30T22:11:56.438696] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:56.613316] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-30T22:11:56.647158] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-30T22:11:56.649941] [INFO ] [MAIN ] Derivative Progress: 1116/2009 symbols completed. MFA took 1.5s. Estimated remaining: 6m 8s. Rate: 145.5 symbols/min [2025-09-30T22:11:56.770547] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:56.820006] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:11:56.821156] [INFO ] [MAIN ] MFAO: Generated 1792 derivative records from 3793 primary records. [2025-09-30T22:11:56.821281] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-30T22:11:56.855854] [DEBUG] [LOCAL ] MFC: Loaded 51177 existing records from primary storage. [2025-09-30T22:11:56.858173] [INFO ] [MAIN ] MFC: Loaded 51177 primary data records. [2025-09-30T22:11:56.885349] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1792 records). [2025-09-30T22:11:56.920461] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-30T22:11:56.936558] [INFO ] [MAIN ] Derivative Progress: 1117/2009 symbols completed. MFAO took 0.6s. Estimated remaining: 6m 8s. Rate: 145.6 symbols/min [2025-09-30T22:11:56.946017] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:57.010886] [DEBUG] [LOCAL ] MFG: Loaded 49131 existing records from primary storage. [2025-09-30T22:11:57.017014] [INFO ] [MAIN ] MFG: Loaded 49131 primary data records. [2025-09-30T22:11:57.342962] [DEBUG] [LOCAL ] MFM: Loaded 14379 existing records from primary storage. [2025-09-30T22:11:57.363541] [INFO ] [MAIN ] MFM: Loaded 14379 primary data records. [2025-09-30T22:11:57.980524] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:57.981787] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51177 primary records. [2025-09-30T22:11:57.981985] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-30T22:11:58.003526] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-30T22:11:58.004013] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-30T22:11:58.006588] [INFO ] [MAIN ] Derivative Progress: 1118/2009 symbols completed. MFC took 1.6s. Estimated remaining: 6m 8s. Rate: 145.3 symbols/min [2025-09-30T22:11:58.024831] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:58.026342] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:58.029618] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49131 primary records. [2025-09-30T22:11:58.030451] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-30T22:11:58.066912] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-30T22:11:58.065893] [DEBUG] [LOCAL ] MFSG: Loaded 5340 existing records from primary storage. [2025-09-30T22:11:58.061777] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:58.067079] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-30T22:11:58.068415] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14379 primary records. [2025-09-30T22:11:58.068704] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-30T22:11:58.068804] [INFO ] [MAIN ] MFSG: Loaded 5340 primary data records. [2025-09-30T22:11:58.072260] [INFO ] [MAIN ] Derivative Progress: 1119/2009 symbols completed. MFG took 1.3s. Estimated remaining: 6m 7s. Rate: 145.5 symbols/min [2025-09-30T22:11:58.072593] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:58.191214] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-30T22:11:58.215238] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-30T22:11:58.229631] [INFO ] [MAIN ] Derivative Progress: 1120/2009 symbols completed. MFM took 1.3s. Estimated remaining: 6m 7s. Rate: 145.5 symbols/min [2025-09-30T22:11:58.240319] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:58.315067] [DEBUG] [LOCAL ] MFSI: Loaded 11363 existing records from primary storage. [2025-09-30T22:11:58.436617] [INFO ] [MAIN ] MFSI: Loaded 11363 primary data records. [2025-09-30T22:11:58.446564] [DEBUG] [LOCAL ] MFSV: Loaded 2521 existing records from primary storage. [2025-09-30T22:11:58.471907] [INFO ] [MAIN ] MFSV: Loaded 2521 primary data records. [2025-09-30T22:11:59.149405] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:11:59.151720] [INFO ] [MAIN ] MFSG: Generated 1792 derivative records from 5340 primary records. [2025-09-30T22:11:59.151997] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-30T22:11:59.172588] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1792 records). [2025-09-30T22:11:59.172806] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-30T22:11:59.175562] [INFO ] [MAIN ] Derivative Progress: 1121/2009 symbols completed. MFSG took 1.2s. Estimated remaining: 6m 7s. Rate: 145.4 symbols/min [2025-09-30T22:11:59.176191] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:59.194254] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:11:59.195102] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 11363 primary records. [2025-09-30T22:11:59.195281] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-30T22:11:59.233742] [DEBUG] [LOCAL ] MG: Loaded 16406 existing records from primary storage. [2025-09-30T22:11:59.236498] [INFO ] [MAIN ] MG: Loaded 16406 primary data records. [2025-09-30T22:11:59.237290] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:11:59.243527] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2521 primary records. [2025-09-30T22:11:59.250062] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-30T22:11:59.291920] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-09-30T22:11:59.328636] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-30T22:11:59.337531] [INFO ] [MAIN ] Derivative Progress: 1122/2009 symbols completed. MFSI took 1.3s. Estimated remaining: 6m 6s. Rate: 145.4 symbols/min [2025-09-30T22:11:59.345672] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:11:59.371535] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-09-30T22:11:59.382465] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-30T22:11:59.395247] [INFO ] [MAIN ] Derivative Progress: 1123/2009 symbols completed. MFSV took 1.2s. Estimated remaining: 6m 5s. Rate: 145.6 symbols/min [2025-09-30T22:11:59.635333] [DEBUG] [LOCAL ] MGA: Loaded 50634 existing records from primary storage. [2025-09-30T22:11:59.634425] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:11:59.635507] [INFO ] [MAIN ] MGA: Loaded 50634 primary data records. [2025-09-30T22:11:59.636308] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16406 primary records. [2025-09-30T22:11:59.681410] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-30T22:11:59.762144] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-30T22:11:59.768087] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-30T22:11:59.780764] [INFO ] [MAIN ] Derivative Progress: 1124/2009 symbols completed. MG took 0.6s. Estimated remaining: 6m 5s. Rate: 145.6 symbols/min [2025-09-30T22:12:00.025268] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:00.025932] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50634 primary records. [2025-09-30T22:12:00.025997] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-30T22:12:00.041610] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-30T22:12:00.041723] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-30T22:12:00.044373] [INFO ] [MAIN ] Derivative Progress: 1125/2009 symbols completed. MGA took 0.7s. Estimated remaining: 6m 4s. Rate: 145.6 symbols/min [2025-09-30T22:12:00.044826] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:00.044774] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:00.044880] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:00.053373] [DEBUG] [LOCAL ] MGF: Loaded 4201 existing records from primary storage. [2025-09-30T22:12:00.053540] [INFO ] [MAIN ] MGF: Loaded 4201 primary data records. [2025-09-30T22:12:00.138930] [DEBUG] [LOCAL ] MGR: Loaded 5591 existing records from primary storage. [2025-09-30T22:12:00.156483] [INFO ] [MAIN ] MGR: Loaded 5591 primary data records. [2025-09-30T22:12:00.749448] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-09-30T22:12:00.750156] [INFO ] [MAIN ] MGM: Loaded 53608 primary data records. [2025-09-30T22:12:01.099748] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:01.102361] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4201 primary records. [2025-09-30T22:12:01.102625] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-30T22:12:01.131000] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:01.133874] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5591 primary records. [2025-09-30T22:12:01.133966] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-30T22:12:01.138799] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-30T22:12:01.150124] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-30T22:12:01.154526] [INFO ] [MAIN ] Derivative Progress: 1126/2009 symbols completed. MGF took 1.1s. Estimated remaining: 6m 4s. Rate: 145.4 symbols/min [2025-09-30T22:12:01.154772] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:01.158733] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-09-30T22:12:01.158818] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-30T22:12:01.161724] [INFO ] [MAIN ] Derivative Progress: 1127/2009 symbols completed. MGR took 1.1s. Estimated remaining: 6m 4s. Rate: 145.5 symbols/min [2025-09-30T22:12:01.162126] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:01.172227] [DEBUG] [LOCAL ] MGRD: Loaded 2230 existing records from primary storage. [2025-09-30T22:12:01.172525] [DEBUG] [LOCAL ] MGRB: Loaded 4058 existing records from primary storage. [2025-09-30T22:12:01.172639] [INFO ] [MAIN ] MGRD: Loaded 2230 primary data records. [2025-09-30T22:12:01.184528] [INFO ] [MAIN ] MGRB: Loaded 4058 primary data records. [2025-09-30T22:12:01.407064] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:01.434046] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53608 primary records. [2025-09-30T22:12:01.443469] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-30T22:12:01.883121] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-30T22:12:01.898468] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-30T22:12:01.902219] [INFO ] [MAIN ] Derivative Progress: 1128/2009 symbols completed. MGM took 1.9s. Estimated remaining: 6m 4s. Rate: 145.4 symbols/min [2025-09-30T22:12:01.903202] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:01.916894] [DEBUG] [LOCAL ] MGRE: Loaded 6679 existing records from primary storage. [2025-09-30T22:12:01.918943] [INFO ] [MAIN ] MGRE: Loaded 6679 primary data records. [2025-09-30T22:12:02.109165] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:02.160566] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2230 primary records. [2025-09-30T22:12:02.166430] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-30T22:12:02.278799] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:02.355145] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4058 primary records. [2025-09-30T22:12:02.360341] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-30T22:12:02.366265] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-30T22:12:02.366375] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-30T22:12:02.369295] [INFO ] [MAIN ] Derivative Progress: 1129/2009 symbols completed. MGRD took 1.2s. Estimated remaining: 6m 3s. Rate: 145.4 symbols/min [2025-09-30T22:12:02.369503] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:02.389881] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-30T22:12:02.390248] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-30T22:12:02.392934] [INFO ] [MAIN ] Derivative Progress: 1130/2009 symbols completed. MGRB took 1.2s. Estimated remaining: 6m 2s. Rate: 145.5 symbols/min [2025-09-30T22:12:02.393283] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:02.426939] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:02.427882] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6679 primary records. [2025-09-30T22:12:02.428013] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-30T22:12:02.445846] [DEBUG] [LOCAL ] MHD: Loaded 12259 existing records from primary storage. [2025-09-30T22:12:02.466028] [INFO ] [MAIN ] MHD: Loaded 12259 primary data records. [2025-09-30T22:12:02.533859] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-30T22:12:02.584062] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-30T22:12:02.608259] [INFO ] [MAIN ] Derivative Progress: 1131/2009 symbols completed. MGRE took 0.7s. Estimated remaining: 6m 2s. Rate: 145.6 symbols/min [2025-09-30T22:12:02.609636] [DEBUG] [LOCAL ] MGY: Loaded 52425 existing records from primary storage. [2025-09-30T22:12:02.610304] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:02.610392] [INFO ] [MAIN ] MGY: Loaded 52425 primary data records. [2025-09-30T22:12:02.941497] [DEBUG] [LOCAL ] MHF: Loaded 8721 existing records from primary storage. [2025-09-30T22:12:02.961367] [INFO ] [MAIN ] MHF: Loaded 8721 primary data records. [2025-09-30T22:12:03.594705] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:03.595961] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12259 primary records. [2025-09-30T22:12:03.596063] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-30T22:12:03.632458] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-30T22:12:03.632854] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-30T22:12:03.635237] [INFO ] [MAIN ] Derivative Progress: 1132/2009 symbols completed. MHD took 1.2s. Estimated remaining: 6m 2s. Rate: 145.4 symbols/min [2025-09-30T22:12:03.629967] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:03.636629] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52425 primary records. [2025-09-30T22:12:03.636798] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-30T22:12:03.635522] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:03.671099] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:03.673211] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8721 primary records. [2025-09-30T22:12:03.672310] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-30T22:12:03.673442] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-30T22:12:03.673515] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-30T22:12:03.677020] [INFO ] [MAIN ] Derivative Progress: 1133/2009 symbols completed. MGY took 1.3s. Estimated remaining: 6m 1s. Rate: 145.5 symbols/min [2025-09-30T22:12:03.677436] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:03.695776] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-30T22:12:03.695969] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-30T22:12:03.698330] [INFO ] [MAIN ] Derivative Progress: 1134/2009 symbols completed. MHF took 1.1s. Estimated remaining: 6m 1s. Rate: 145.6 symbols/min [2025-09-30T22:12:03.708177] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:03.712638] [DEBUG] [LOCAL ] MHN: Loaded 7611 existing records from primary storage. [2025-09-30T22:12:03.713002] [INFO ] [MAIN ] MHN: Loaded 7611 primary data records. [2025-09-30T22:12:03.838373] [DEBUG] [LOCAL ] MHK: Loaded 42249 existing records from primary storage. [2025-09-30T22:12:03.851749] [INFO ] [MAIN ] MHK: Loaded 42249 primary data records. [2025-09-30T22:12:03.947319] [DEBUG] [LOCAL ] MHO: Loaded 24027 existing records from primary storage. [2025-09-30T22:12:04.063698] [INFO ] [MAIN ] MHO: Loaded 24027 primary data records. [2025-09-30T22:12:04.815065] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:04.816086] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7611 primary records. [2025-09-30T22:12:04.816302] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-30T22:12:04.845207] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-30T22:12:04.851233] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-30T22:12:04.851156] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:04.853897] [INFO ] [MAIN ] Derivative Progress: 1135/2009 symbols completed. MHN took 1.2s. Estimated remaining: 6m 1s. Rate: 145.4 symbols/min [2025-09-30T22:12:04.854101] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:04.855059] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42249 primary records. [2025-09-30T22:12:04.855868] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-30T22:12:04.878704] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-30T22:12:04.879075] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-30T22:12:04.881731] [INFO ] [MAIN ] Derivative Progress: 1136/2009 symbols completed. MHK took 1.2s. Estimated remaining: 5m 60s. Rate: 145.5 symbols/min [2025-09-30T22:12:04.889730] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:04.901726] [DEBUG] [LOCAL ] MIN: Loaded 13086 existing records from primary storage. [2025-09-30T22:12:04.902090] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:04.903161] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24027 primary records. [2025-09-30T22:12:04.902373] [INFO ] [MAIN ] MIN: Loaded 13086 primary data records. [2025-09-30T22:12:04.903475] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-30T22:12:05.136074] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-30T22:12:05.136218] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-30T22:12:05.258269] [INFO ] [MAIN ] Derivative Progress: 1137/2009 symbols completed. MHO took 1.6s. Estimated remaining: 5m 60s. Rate: 145.5 symbols/min [2025-09-30T22:12:05.260093] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:05.281018] [DEBUG] [LOCAL ] MIR: Loaded 50989 existing records from primary storage. [2025-09-30T22:12:05.281748] [INFO ] [MAIN ] MIR: Loaded 50989 primary data records. [2025-09-30T22:12:05.285080] [DEBUG] [LOCAL ] MITP: Loaded 2386 existing records from primary storage. [2025-09-30T22:12:05.297788] [INFO ] [MAIN ] MITP: Loaded 2386 primary data records. [2025-09-30T22:12:05.958894] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:05.960004] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13086 primary records. [2025-09-30T22:12:05.960102] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-30T22:12:05.982243] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-30T22:12:05.982466] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-30T22:12:05.984905] [INFO ] [MAIN ] Derivative Progress: 1138/2009 symbols completed. MIN took 1.1s. Estimated remaining: 5m 59s. Rate: 145.4 symbols/min [2025-09-30T22:12:06.018756] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:06.018460] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:12:06.019590] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2386 primary records. [2025-09-30T22:12:06.020230] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50989 primary records. [2025-09-30T22:12:06.020315] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-30T22:12:06.020377] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-30T22:12:06.049264] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-09-30T22:12:06.050075] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-30T22:12:06.054735] [INFO ] [MAIN ] Derivative Progress: 1139/2009 symbols completed. MITP took 0.8s. Estimated remaining: 5m 59s. Rate: 145.5 symbols/min [2025-09-30T22:12:06.055732] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-30T22:12:06.055805] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-30T22:12:06.058357] [INFO ] [MAIN ] Derivative Progress: 1140/2009 symbols completed. MIR took 1.2s. Estimated remaining: 5m 58s. Rate: 145.7 symbols/min [2025-09-30T22:12:06.058891] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:06.059005] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:06.059145] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:06.071341] [DEBUG] [LOCAL ] MIY: Loaded 5968 existing records from primary storage. [2025-09-30T22:12:06.079526] [INFO ] [MAIN ] MIY: Loaded 5968 primary data records. [2025-09-30T22:12:06.157177] [DEBUG] [LOCAL ] MITT: Loaded 22919 existing records from primary storage. [2025-09-30T22:12:06.182353] [INFO ] [MAIN ] MITT: Loaded 22919 primary data records. [2025-09-30T22:12:06.705415] [DEBUG] [LOCAL ] MKC: Loaded 52440 existing records from primary storage. [2025-09-30T22:12:06.717097] [INFO ] [MAIN ] MKC: Loaded 52440 primary data records. [2025-09-30T22:12:07.320187] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:07.321471] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 5968 primary records. [2025-09-30T22:12:07.321595] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-30T22:12:07.355962] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:07.359208] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22919 primary records. [2025-09-30T22:12:07.359419] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-30T22:12:07.364279] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-30T22:12:07.365215] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-30T22:12:07.378040] [INFO ] [MAIN ] Derivative Progress: 1141/2009 symbols completed. MIY took 1.3s. Estimated remaining: 5m 58s. Rate: 145.4 symbols/min [2025-09-30T22:12:07.384181] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:07.394885] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-30T22:12:07.401593] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-30T22:12:07.404488] [INFO ] [MAIN ] Derivative Progress: 1142/2009 symbols completed. MITT took 1.3s. Estimated remaining: 5m 58s. Rate: 145.5 symbols/min [2025-09-30T22:12:07.410781] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:07.419472] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:07.420910] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52440 primary records. [2025-09-30T22:12:07.421134] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-30T22:12:07.443498] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-30T22:12:07.443689] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-30T22:12:07.446596] [INFO ] [MAIN ] Derivative Progress: 1143/2009 symbols completed. MKC took 1.4s. Estimated remaining: 5m 57s. Rate: 145.6 symbols/min [2025-09-30T22:12:07.446879] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:07.480863] [DEBUG] [LOCAL ] MKL: Loaded 34021 existing records from primary storage. [2025-09-30T22:12:07.481160] [INFO ] [MAIN ] MKL: Loaded 34021 primary data records. [2025-09-30T22:12:07.663380] [DEBUG] [LOCAL ] MLM: Loaded 30109 existing records from primary storage. [2025-09-30T22:12:07.662697] [DEBUG] [LOCAL ] MLI: Loaded 43572 existing records from primary storage. [2025-09-30T22:12:07.674839] [INFO ] [MAIN ] MLM: Loaded 30109 primary data records. [2025-09-30T22:12:07.685255] [INFO ] [MAIN ] MLI: Loaded 43572 primary data records. [2025-09-30T22:12:08.692997] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:08.695266] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34021 primary records. [2025-09-30T22:12:08.695442] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-30T22:12:08.737695] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-30T22:12:08.738391] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:08.738738] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-30T22:12:08.739733] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43572 primary records. [2025-09-30T22:12:08.742717] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-30T22:12:08.742305] [INFO ] [MAIN ] Derivative Progress: 1144/2009 symbols completed. MKL took 1.4s. Estimated remaining: 5m 57s. Rate: 145.3 symbols/min [2025-09-30T22:12:08.744198] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:08.781042] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:08.782956] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 30109 primary records. [2025-09-30T22:12:08.783152] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-30T22:12:08.783267] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-30T22:12:08.783809] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-30T22:12:08.786725] [INFO ] [MAIN ] Derivative Progress: 1145/2009 symbols completed. MLI took 1.4s. Estimated remaining: 5m 56s. Rate: 145.5 symbols/min [2025-09-30T22:12:08.787269] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:08.815880] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-30T22:12:08.817055] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-30T22:12:08.816178] [DEBUG] [LOCAL ] MLP: Loaded 2980 existing records from primary storage. [2025-09-30T22:12:08.828288] [INFO ] [MAIN ] Derivative Progress: 1146/2009 symbols completed. MLM took 1.4s. Estimated remaining: 5m 56s. Rate: 145.6 symbols/min [2025-09-30T22:12:08.828601] [INFO ] [MAIN ] MLP: Loaded 2980 primary data records. [2025-09-30T22:12:08.828890] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:08.842427] [DEBUG] [LOCAL ] MLNK: Loaded 25422 existing records from primary storage. [2025-09-30T22:12:08.870931] [INFO ] [MAIN ] MLNK: Loaded 25422 primary data records. [2025-09-30T22:12:09.094355] [DEBUG] [LOCAL ] MLR: Loaded 12551 existing records from primary storage. [2025-09-30T22:12:09.133047] [INFO ] [MAIN ] MLR: Loaded 12551 primary data records. [2025-09-30T22:12:09.938337] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:09.941102] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25422 primary records. [2025-09-30T22:12:09.941470] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-30T22:12:09.972567] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:09.976547] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-30T22:12:09.978102] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-30T22:12:09.977797] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 2980 primary records. [2025-09-30T22:12:09.980960] [INFO ] [MAIN ] Derivative Progress: 1147/2009 symbols completed. MLNK took 1.2s. Estimated remaining: 5m 56s. Rate: 145.3 symbols/min [2025-09-30T22:12:09.981344] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:09.981197] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-30T22:12:10.009683] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-09-30T22:12:10.024055] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-30T22:12:10.027568] [INFO ] [MAIN ] Derivative Progress: 1148/2009 symbols completed. MLP took 1.2s. Estimated remaining: 5m 55s. Rate: 145.5 symbols/min [2025-09-30T22:12:10.028303] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:10.028148] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:10.029932] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12551 primary records. [2025-09-30T22:12:10.030119] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-30T22:12:10.049888] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-30T22:12:10.054172] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-30T22:12:10.057878] [INFO ] [MAIN ] Derivative Progress: 1149/2009 symbols completed. MLR took 1.2s. Estimated remaining: 5m 54s. Rate: 145.6 symbols/min [2025-09-30T22:12:10.058288] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:10.084291] [DEBUG] [LOCAL ] MMD: Loaded 11403 existing records from primary storage. [2025-09-30T22:12:10.084796] [INFO ] [MAIN ] MMD: Loaded 11403 primary data records. [2025-09-30T22:12:10.256107] [DEBUG] [LOCAL ] MMC: Loaded 51784 existing records from primary storage. [2025-09-30T22:12:10.254616] [DEBUG] [LOCAL ] MMI: Loaded 15065 existing records from primary storage. [2025-09-30T22:12:10.267341] [INFO ] [MAIN ] MMI: Loaded 15065 primary data records. [2025-09-30T22:12:10.277998] [INFO ] [MAIN ] MMC: Loaded 51784 primary data records. [2025-09-30T22:12:11.231107] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:11.233236] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11403 primary records. [2025-09-30T22:12:11.233603] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-30T22:12:11.257542] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-30T22:12:11.257748] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-30T22:12:11.261304] [INFO ] [MAIN ] Derivative Progress: 1150/2009 symbols completed. MMD took 1.2s. Estimated remaining: 5m 55s. Rate: 145.3 symbols/min [2025-09-30T22:12:11.261817] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:11.276536] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:11.278036] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15065 primary records. [2025-09-30T22:12:11.278341] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-30T22:12:11.300968] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-30T22:12:11.301245] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-30T22:12:11.305981] [INFO ] [MAIN ] Derivative Progress: 1151/2009 symbols completed. MMI took 1.2s. Estimated remaining: 5m 54s. Rate: 145.4 symbols/min [2025-09-30T22:12:11.319933] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:11.321197] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:11.322230] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51784 primary records. [2025-09-30T22:12:11.322307] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-30T22:12:11.356693] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-30T22:12:11.357078] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-30T22:12:11.368482] [INFO ] [MAIN ] Derivative Progress: 1152/2009 symbols completed. MMC took 1.4s. Estimated remaining: 5m 53s. Rate: 145.6 symbols/min [2025-09-30T22:12:11.368701] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:11.406002] [DEBUG] [LOCAL ] MMT: Loaded 10795 existing records from primary storage. [2025-09-30T22:12:11.407803] [INFO ] [MAIN ] MMT: Loaded 10795 primary data records. [2025-09-30T22:12:11.407624] [DEBUG] [LOCAL ] MMM: Loaded 53187 existing records from primary storage. [2025-09-30T22:12:11.413586] [INFO ] [MAIN ] MMM: Loaded 53187 primary data records. [2025-09-30T22:12:11.528976] [DEBUG] [LOCAL ] MMS: Loaded 33782 existing records from primary storage. [2025-09-30T22:12:11.637432] [INFO ] [MAIN ] MMS: Loaded 33782 primary data records. [2025-09-30T22:12:12.516919] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:12.517327] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:12.518316] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10795 primary records. [2025-09-30T22:12:12.519087] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53187 primary records. [2025-09-30T22:12:12.519171] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-30T22:12:12.519346] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-30T22:12:12.552133] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-30T22:12:12.553012] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-30T22:12:12.557695] [INFO ] [MAIN ] Derivative Progress: 1153/2009 symbols completed. MMM took 1.3s. Estimated remaining: 5m 53s. Rate: 145.3 symbols/min [2025-09-30T22:12:12.561204] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-30T22:12:12.561423] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-30T22:12:12.564043] [INFO ] [MAIN ] Derivative Progress: 1154/2009 symbols completed. MMT took 1.2s. Estimated remaining: 5m 53s. Rate: 145.4 symbols/min [2025-09-30T22:12:12.577516] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:12.578291] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33782 primary records. [2025-09-30T22:12:12.578358] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-30T22:12:12.594450] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-30T22:12:12.594542] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-30T22:12:12.597232] [INFO ] [MAIN ] Derivative Progress: 1155/2009 symbols completed. MMS took 1.3s. Estimated remaining: 5m 52s. Rate: 145.6 symbols/min [2025-09-30T22:12:12.597759] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:12.597875] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:12.598004] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:12.624752] [DEBUG] [LOCAL ] MMU: Loaded 16779 existing records from primary storage. [2025-09-30T22:12:12.624963] [INFO ] [MAIN ] MMU: Loaded 16779 primary data records. [2025-09-30T22:12:12.733290] [DEBUG] [LOCAL ] MNR: Loaded 24517 existing records from primary storage. [2025-09-30T22:12:12.759889] [INFO ] [MAIN ] MNR: Loaded 24517 primary data records. [2025-09-30T22:12:13.054709] [DEBUG] [LOCAL ] MNSO: Loaded 44420 existing records from primary storage. [2025-09-30T22:12:13.082241] [INFO ] [MAIN ] MNSO: Loaded 44420 primary data records. [2025-09-30T22:12:13.724724] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:13.726179] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16779 primary records. [2025-09-30T22:12:13.726386] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-30T22:12:13.756563] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-30T22:12:13.762540] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:13.763436] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24517 primary records. [2025-09-30T22:12:13.763772] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-30T22:12:13.766305] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-30T22:12:13.766222] [INFO ] [MAIN ] Derivative Progress: 1156/2009 symbols completed. MMU took 1.2s. Estimated remaining: 5m 52s. Rate: 145.3 symbols/min [2025-09-30T22:12:13.777133] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:13.799188] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:13.800690] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44420 primary records. [2025-09-30T22:12:13.801328] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-30T22:12:13.804636] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-30T22:12:13.812193] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-30T22:12:13.815781] [INFO ] [MAIN ] Derivative Progress: 1157/2009 symbols completed. MNR took 1.2s. Estimated remaining: 5m 51s. Rate: 145.4 symbols/min [2025-09-30T22:12:13.818797] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:13.826564] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-30T22:12:13.826743] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-30T22:12:13.829463] [INFO ] [MAIN ] Derivative Progress: 1158/2009 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 51s. Rate: 145.6 symbols/min [2025-09-30T22:12:13.829797] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:13.862191] [DEBUG] [LOCAL ] MOD: Loaded 45309 existing records from primary storage. [2025-09-30T22:12:13.862351] [INFO ] [MAIN ] MOD: Loaded 45309 primary data records. [2025-09-30T22:12:14.061326] [DEBUG] [LOCAL ] MODG: Loaded 51561 existing records from primary storage. [2025-09-30T22:12:14.081593] [INFO ] [MAIN ] MODG: Loaded 51561 primary data records. [2025-09-30T22:12:14.311545] [DEBUG] [LOCAL ] MOH: Loaded 41781 existing records from primary storage. [2025-09-30T22:12:14.329019] [INFO ] [MAIN ] MOH: Loaded 41781 primary data records. [2025-09-30T22:12:14.945800] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:14.947223] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45309 primary records. [2025-09-30T22:12:14.947395] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-30T22:12:14.966529] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-09-30T22:12:14.966974] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-30T22:12:14.969987] [INFO ] [MAIN ] Derivative Progress: 1159/2009 symbols completed. MOD took 1.2s. Estimated remaining: 5m 51s. Rate: 145.3 symbols/min [2025-09-30T22:12:14.970401] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:14.990990] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:14.991994] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51561 primary records. [2025-09-30T22:12:14.992242] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-30T22:12:15.024638] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:15.026195] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41781 primary records. [2025-09-30T22:12:15.027130] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-30T22:12:15.029587] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-30T22:12:15.029933] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-30T22:12:15.032365] [INFO ] [MAIN ] Derivative Progress: 1160/2009 symbols completed. MODG took 1.2s. Estimated remaining: 5m 50s. Rate: 145.4 symbols/min [2025-09-30T22:12:15.040280] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:15.065843] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-30T22:12:15.066084] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-30T22:12:15.068469] [INFO ] [MAIN ] Derivative Progress: 1161/2009 symbols completed. MOH took 1.2s. Estimated remaining: 5m 50s. Rate: 145.6 symbols/min [2025-09-30T22:12:15.068863] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:15.092329] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-09-30T22:12:15.092685] [INFO ] [MAIN ] MOS: Loaded 53504 primary data records. [2025-09-30T22:12:15.162291] [DEBUG] [LOCAL ] MOV: Loaded 21979 existing records from primary storage. [2025-09-30T22:12:15.177596] [INFO ] [MAIN ] MOV: Loaded 21979 primary data records. [2025-09-30T22:12:15.733261] [DEBUG] [LOCAL ] MP: Loaded 53675 existing records from primary storage. [2025-09-30T22:12:15.821790] [INFO ] [MAIN ] MP: Loaded 53675 primary data records. [2025-09-30T22:12:16.173522] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:16.174678] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53504 primary records. [2025-09-30T22:12:16.175777] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-30T22:12:16.215971] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:16.216815] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21979 primary records. [2025-09-30T22:12:16.215529] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-30T22:12:16.216918] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-30T22:12:16.217564] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-30T22:12:16.231496] [INFO ] [MAIN ] Derivative Progress: 1162/2009 symbols completed. MOS took 1.3s. Estimated remaining: 5m 50s. Rate: 145.3 symbols/min [2025-09-30T22:12:16.238251] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:16.241439] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-30T22:12:16.241908] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-30T22:12:16.244488] [INFO ] [MAIN ] Derivative Progress: 1163/2009 symbols completed. MOV took 1.2s. Estimated remaining: 5m 49s. Rate: 145.4 symbols/min [2025-09-30T22:12:16.244878] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:16.255423] [DEBUG] [LOCAL ] MPA: Loaded 5222 existing records from primary storage. [2025-09-30T22:12:16.255736] [INFO ] [MAIN ] MPA: Loaded 5222 primary data records. [2025-09-30T22:12:16.339452] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:16.360514] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53675 primary records. [2025-09-30T22:12:16.373206] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-30T22:12:16.620879] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-30T22:12:16.621098] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-30T22:12:16.623756] [INFO ] [MAIN ] Derivative Progress: 1164/2009 symbols completed. MP took 1.6s. Estimated remaining: 5m 49s. Rate: 145.5 symbols/min [2025-09-30T22:12:16.624166] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:16.647214] [DEBUG] [LOCAL ] MPC: Loaded 52086 existing records from primary storage. [2025-09-30T22:12:16.647679] [INFO ] [MAIN ] MPC: Loaded 52086 primary data records. [2025-09-30T22:12:17.003342] [DEBUG] [LOCAL ] MPLX: Loaded 50737 existing records from primary storage. [2025-09-30T22:12:17.003810] [INFO ] [MAIN ] MPLX: Loaded 50737 primary data records. [2025-09-30T22:12:17.067564] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:17.113776] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5222 primary records. [2025-09-30T22:12:17.114874] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-30T22:12:17.358751] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-09-30T22:12:17.367845] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-30T22:12:17.370875] [INFO ] [MAIN ] Derivative Progress: 1165/2009 symbols completed. MPA took 1.1s. Estimated remaining: 5m 48s. Rate: 145.4 symbols/min [2025-09-30T22:12:17.372470] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:17.390943] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:17.393688] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52086 primary records. [2025-09-30T22:12:17.394288] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-30T22:12:17.398826] [DEBUG] [LOCAL ] MPV: Loaded 4979 existing records from primary storage. [2025-09-30T22:12:17.399255] [INFO ] [MAIN ] MPV: Loaded 4979 primary data records. [2025-09-30T22:12:17.551790] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-30T22:12:17.591018] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-30T22:12:17.614362] [INFO ] [MAIN ] Derivative Progress: 1166/2009 symbols completed. MPC took 1.4s. Estimated remaining: 5m 48s. Rate: 145.4 symbols/min [2025-09-30T22:12:17.618801] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:17.794812] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:17.795593] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50737 primary records. [2025-09-30T22:12:17.795972] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-30T22:12:17.815422] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-30T22:12:17.816045] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-30T22:12:17.818376] [INFO ] [MAIN ] Derivative Progress: 1167/2009 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 47s. Rate: 145.5 symbols/min [2025-09-30T22:12:17.818618] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:17.827123] [DEBUG] [LOCAL ] MPX: Loaded 4071 existing records from primary storage. [2025-09-30T22:12:17.827504] [INFO ] [MAIN ] MPX: Loaded 4071 primary data records. [2025-09-30T22:12:18.064750] [DEBUG] [LOCAL ] MPW: Loaded 53495 existing records from primary storage. [2025-09-30T22:12:18.115057] [INFO ] [MAIN ] MPW: Loaded 53495 primary data records. [2025-09-30T22:12:18.232379] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:18.259042] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4979 primary records. [2025-09-30T22:12:18.273358] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-30T22:12:18.437730] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-09-30T22:12:18.549419] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-30T22:12:18.557323] [INFO ] [MAIN ] Derivative Progress: 1168/2009 symbols completed. MPV took 1.2s. Estimated remaining: 5m 47s. Rate: 145.4 symbols/min [2025-09-30T22:12:18.588869] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:18.589679] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4071 primary records. [2025-09-30T22:12:18.589783] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-30T22:12:18.607291] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-30T22:12:18.607364] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-30T22:12:18.609712] [INFO ] [MAIN ] Derivative Progress: 1169/2009 symbols completed. MPX took 0.8s. Estimated remaining: 5m 46s. Rate: 145.5 symbols/min [2025-09-30T22:12:18.627217] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:18.627977] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53495 primary records. [2025-09-30T22:12:18.628051] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-30T22:12:18.644142] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-30T22:12:18.644295] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-30T22:12:18.647236] [INFO ] [MAIN ] Derivative Progress: 1170/2009 symbols completed. MPW took 1.0s. Estimated remaining: 5m 46s. Rate: 145.6 symbols/min [2025-09-30T22:12:18.647748] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:18.647884] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:18.648400] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:18.660266] [DEBUG] [LOCAL ] MQT: Loaded 8614 existing records from primary storage. [2025-09-30T22:12:18.660568] [INFO ] [MAIN ] MQT: Loaded 8614 primary data records. [2025-09-30T22:12:18.759020] [DEBUG] [LOCAL ] MQY: Loaded 16937 existing records from primary storage. [2025-09-30T22:12:18.783951] [INFO ] [MAIN ] MQY: Loaded 16937 primary data records. [2025-09-30T22:12:19.103126] [DEBUG] [LOCAL ] MRC: Loaded 37475 existing records from primary storage. [2025-09-30T22:12:19.117385] [INFO ] [MAIN ] MRC: Loaded 37475 primary data records. [2025-09-30T22:12:19.724904] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:19.726396] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8614 primary records. [2025-09-30T22:12:19.726851] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-30T22:12:19.746363] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-30T22:12:19.747496] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-30T22:12:19.751082] [INFO ] [MAIN ] Derivative Progress: 1171/2009 symbols completed. MQT took 1.1s. Estimated remaining: 5m 46s. Rate: 145.4 symbols/min [2025-09-30T22:12:19.751565] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:19.766090] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:19.767043] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16937 primary records. [2025-09-30T22:12:19.767577] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-30T22:12:19.786599] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-30T22:12:19.786943] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-30T22:12:19.802122] [INFO ] [MAIN ] Derivative Progress: 1172/2009 symbols completed. MQY took 1.2s. Estimated remaining: 5m 45s. Rate: 145.5 symbols/min [2025-09-30T22:12:19.802752] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:19.803564] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37475 primary records. [2025-09-30T22:12:19.803680] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:19.803960] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-30T22:12:19.840209] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-30T22:12:19.840342] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-30T22:12:19.843073] [INFO ] [MAIN ] Derivative Progress: 1173/2009 symbols completed. MRC took 1.2s. Estimated remaining: 5m 44s. Rate: 145.6 symbols/min [2025-09-30T22:12:19.843301] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:19.871745] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-30T22:12:19.875897] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-30T22:12:19.950699] [DEBUG] [LOCAL ] MSA: Loaded 18880 existing records from primary storage. [2025-09-30T22:12:19.984710] [INFO ] [MAIN ] MSA: Loaded 18880 primary data records. [2025-09-30T22:12:20.186580] [DEBUG] [LOCAL ] MS: Loaded 53691 existing records from primary storage. [2025-09-30T22:12:20.215333] [INFO ] [MAIN ] MS: Loaded 53691 primary data records. [2025-09-30T22:12:20.974044] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:20.975618] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-30T22:12:20.976491] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-30T22:12:20.999462] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-30T22:12:21.014858] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:21.013760] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-30T22:12:21.016151] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18880 primary records. [2025-09-30T22:12:21.023569] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-30T22:12:21.023438] [INFO ] [MAIN ] Derivative Progress: 1174/2009 symbols completed. MRK took 1.3s. Estimated remaining: 5m 45s. Rate: 145.4 symbols/min [2025-09-30T22:12:21.024381] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:21.063349] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:21.065948] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53691 primary records. [2025-09-30T22:12:21.066855] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-30T22:12:21.069786] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-30T22:12:21.081578] [DEBUG] [LOCAL ] MSB: Loaded 7838 existing records from primary storage. [2025-09-30T22:12:21.090019] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-30T22:12:21.088839] [INFO ] [MAIN ] MSB: Loaded 7838 primary data records. [2025-09-30T22:12:21.094504] [INFO ] [MAIN ] Derivative Progress: 1175/2009 symbols completed. MSA took 1.3s. Estimated remaining: 5m 44s. Rate: 145.5 symbols/min [2025-09-30T22:12:21.148123] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-30T22:12:21.132299] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:21.191140] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-30T22:12:21.212596] [INFO ] [MAIN ] Derivative Progress: 1176/2009 symbols completed. MS took 1.4s. Estimated remaining: 5m 43s. Rate: 145.6 symbols/min [2025-09-30T22:12:21.213195] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:21.448049] [DEBUG] [LOCAL ] MSD: Loaded 15819 existing records from primary storage. [2025-09-30T22:12:21.448522] [INFO ] [MAIN ] MSD: Loaded 15819 primary data records. [2025-09-30T22:12:21.576663] [DEBUG] [LOCAL ] MSCI: Loaded 34570 existing records from primary storage. [2025-09-30T22:12:21.621333] [INFO ] [MAIN ] MSCI: Loaded 34570 primary data records. [2025-09-30T22:12:21.979971] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:22.200887] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7838 primary records. [2025-09-30T22:12:22.212421] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-30T22:12:22.232706] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-30T22:12:22.233151] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-30T22:12:22.236248] [INFO ] [MAIN ] Derivative Progress: 1177/2009 symbols completed. MSB took 1.2s. Estimated remaining: 5m 43s. Rate: 145.4 symbols/min [2025-09-30T22:12:22.237438] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:22.257053] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:22.258187] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15819 primary records. [2025-09-30T22:12:22.258505] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-30T22:12:22.280904] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-30T22:12:22.281191] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-30T22:12:22.284488] [INFO ] [MAIN ] Derivative Progress: 1178/2009 symbols completed. MSD took 1.1s. Estimated remaining: 5m 43s. Rate: 145.5 symbols/min [2025-09-30T22:12:22.292403] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:22.308891] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:22.309833] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34570 primary records. [2025-09-30T22:12:22.310031] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-30T22:12:22.328254] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-30T22:12:22.328634] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-30T22:12:22.342568] [INFO ] [MAIN ] Derivative Progress: 1179/2009 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 42s. Rate: 145.6 symbols/min [2025-09-30T22:12:22.344706] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:22.346354] [DEBUG] [LOCAL ] MSDL: Loaded 38162 existing records from primary storage. [2025-09-30T22:12:22.346572] [INFO ] [MAIN ] MSDL: Loaded 38162 primary data records. [2025-09-30T22:12:22.497006] [DEBUG] [LOCAL ] MSGE: Loaded 26818 existing records from primary storage. [2025-09-30T22:12:22.507914] [INFO ] [MAIN ] MSGE: Loaded 26818 primary data records. [2025-09-30T22:12:22.513693] [DEBUG] [LOCAL ] MSGS: Loaded 17162 existing records from primary storage. [2025-09-30T22:12:22.513818] [INFO ] [MAIN ] MSGS: Loaded 17162 primary data records. [2025-09-30T22:12:23.397122] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:23.398248] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38162 primary records. [2025-09-30T22:12:23.398430] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-30T22:12:23.419501] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-30T22:12:23.419725] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-30T22:12:23.422857] [INFO ] [MAIN ] Derivative Progress: 1180/2009 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 42s. Rate: 145.4 symbols/min [2025-09-30T22:12:23.423358] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:23.439389] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:23.441149] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 17162 primary records. [2025-09-30T22:12:23.443336] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-30T22:12:23.470152] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:23.472683] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 26818 primary records. [2025-09-30T22:12:23.472864] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-30T22:12:23.489805] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-30T22:12:23.492462] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-30T22:12:23.498080] [INFO ] [MAIN ] Derivative Progress: 1181/2009 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 41s. Rate: 145.5 symbols/min [2025-09-30T22:12:23.500435] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:23.500762] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-30T22:12:23.501440] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-30T22:12:23.505981] [INFO ] [MAIN ] Derivative Progress: 1182/2009 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 41s. Rate: 145.6 symbols/min [2025-09-30T22:12:23.507298] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:23.543418] [DEBUG] [LOCAL ] MSI: Loaded 40284 existing records from primary storage. [2025-09-30T22:12:23.543687] [INFO ] [MAIN ] MSI: Loaded 40284 primary data records. [2025-09-30T22:12:23.741795] [DEBUG] [LOCAL ] MSM: Loaded 35459 existing records from primary storage. [2025-09-30T22:12:23.759963] [INFO ] [MAIN ] MSM: Loaded 35459 primary data records. [2025-09-30T22:12:24.006500] [DEBUG] [LOCAL ] MT: Loaded 50609 existing records from primary storage. [2025-09-30T22:12:24.038243] [INFO ] [MAIN ] MT: Loaded 50609 primary data records. [2025-09-30T22:12:24.733210] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:24.734812] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40284 primary records. [2025-09-30T22:12:24.735123] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-30T22:12:24.755106] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-30T22:12:24.757568] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-30T22:12:24.761032] [INFO ] [MAIN ] Derivative Progress: 1183/2009 symbols completed. MSI took 1.3s. Estimated remaining: 5m 41s. Rate: 145.4 symbols/min [2025-09-30T22:12:24.775850] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:24.776845] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35459 primary records. [2025-09-30T22:12:24.777098] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-30T22:12:24.811868] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-30T22:12:24.812249] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:24.812412] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-30T22:12:24.814950] [INFO ] [MAIN ] Derivative Progress: 1184/2009 symbols completed. MSM took 1.3s. Estimated remaining: 5m 40s. Rate: 145.5 symbols/min [2025-09-30T22:12:24.815965] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50609 primary records. [2025-09-30T22:12:24.816051] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-30T22:12:24.835615] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-30T22:12:24.835864] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-30T22:12:24.838955] [INFO ] [MAIN ] Derivative Progress: 1185/2009 symbols completed. MT took 1.3s. Estimated remaining: 5m 40s. Rate: 145.6 symbols/min [2025-09-30T22:12:24.839681] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:24.839760] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:24.839827] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:24.864724] [DEBUG] [LOCAL ] MTD: Loaded 15091 existing records from primary storage. [2025-09-30T22:12:24.864956] [INFO ] [MAIN ] MTD: Loaded 15091 primary data records. [2025-09-30T22:12:25.038815] [DEBUG] [LOCAL ] MTAL: Loaded 36463 existing records from primary storage. [2025-09-30T22:12:25.103917] [INFO ] [MAIN ] MTAL: Loaded 36463 primary data records. [2025-09-30T22:12:25.266565] [DEBUG] [LOCAL ] MTB: Loaded 46728 existing records from primary storage. [2025-09-30T22:12:25.302201] [INFO ] [MAIN ] MTB: Loaded 46728 primary data records. [2025-09-30T22:12:25.947309] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:25.948597] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15091 primary records. [2025-09-30T22:12:25.948937] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-30T22:12:25.967734] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-30T22:12:25.967958] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-30T22:12:25.970619] [INFO ] [MAIN ] Derivative Progress: 1186/2009 symbols completed. MTD took 1.1s. Estimated remaining: 5m 40s. Rate: 145.4 symbols/min [2025-09-30T22:12:25.971177] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:25.994322] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:12:26.003838] [INFO ] [MAIN ] MTB: Generated 1793 derivative records from 46728 primary records. [2025-09-30T22:12:26.009590] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-30T22:12:26.009492] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:26.011091] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36463 primary records. [2025-09-30T22:12:26.011235] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-30T22:12:26.046013] [DEBUG] [LOCAL ] MTB: Derivative data saved (1793 records). [2025-09-30T22:12:26.045913] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-30T22:12:26.046171] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-30T22:12:26.048874] [INFO ] [MAIN ] Derivative Progress: 1187/2009 symbols completed. MTB took 1.2s. Estimated remaining: 5m 39s. Rate: 145.5 symbols/min [2025-09-30T22:12:26.049046] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:26.049334] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-30T22:12:26.051954] [INFO ] [MAIN ] Derivative Progress: 1188/2009 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 38s. Rate: 145.6 symbols/min [2025-09-30T22:12:26.052503] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:26.093550] [DEBUG] [LOCAL ] MTDR: Loaded 51570 existing records from primary storage. [2025-09-30T22:12:26.093857] [INFO ] [MAIN ] MTDR: Loaded 51570 primary data records. [2025-09-30T22:12:26.267602] [DEBUG] [LOCAL ] MTH: Loaded 43700 existing records from primary storage. [2025-09-30T22:12:26.316157] [INFO ] [MAIN ] MTH: Loaded 43700 primary data records. [2025-09-30T22:12:26.566376] [DEBUG] [LOCAL ] MTG: Loaded 51280 existing records from primary storage. [2025-09-30T22:12:26.583896] [INFO ] [MAIN ] MTG: Loaded 51280 primary data records. [2025-09-30T22:12:27.148888] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:27.150628] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51570 primary records. [2025-09-30T22:12:27.151158] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-30T22:12:27.172748] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-30T22:12:27.173980] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-30T22:12:27.176737] [INFO ] [MAIN ] Derivative Progress: 1189/2009 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 38s. Rate: 145.4 symbols/min [2025-09-30T22:12:27.177097] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:27.191184] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:27.192182] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43700 primary records. [2025-09-30T22:12:27.192459] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-30T22:12:27.213246] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-30T22:12:27.213539] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-30T22:12:27.217519] [INFO ] [MAIN ] Derivative Progress: 1190/2009 symbols completed. MTH took 1.2s. Estimated remaining: 5m 38s. Rate: 145.5 symbols/min [2025-09-30T22:12:27.218050] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:27.232840] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:27.233779] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51280 primary records. [2025-09-30T22:12:27.233990] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-30T22:12:27.264613] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-30T22:12:27.264918] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-30T22:12:27.267290] [INFO ] [MAIN ] Derivative Progress: 1191/2009 symbols completed. MTG took 1.2s. Estimated remaining: 5m 37s. Rate: 145.6 symbols/min [2025-09-30T22:12:27.267550] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:27.275282] [DEBUG] [LOCAL ] MTRN: Loaded 17990 existing records from primary storage. [2025-09-30T22:12:27.276329] [INFO ] [MAIN ] MTRN: Loaded 17990 primary data records. [2025-09-30T22:12:27.366136] [DEBUG] [LOCAL ] MTN: Loaded 39006 existing records from primary storage. [2025-09-30T22:12:27.403371] [INFO ] [MAIN ] MTN: Loaded 39006 primary data records. [2025-09-30T22:12:27.706718] [DEBUG] [LOCAL ] MTUS: Loaded 28314 existing records from primary storage. [2025-09-30T22:12:27.733404] [INFO ] [MAIN ] MTUS: Loaded 28314 primary data records. [2025-09-30T22:12:28.376328] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:28.377750] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 17990 primary records. [2025-09-30T22:12:28.378165] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-30T22:12:28.412570] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-30T22:12:28.412798] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-30T22:12:28.415939] [INFO ] [MAIN ] Derivative Progress: 1192/2009 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 37s. Rate: 145.4 symbols/min [2025-09-30T22:12:28.429119] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:28.438582] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:28.440014] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39006 primary records. [2025-09-30T22:12:28.440167] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-30T22:12:28.474580] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-30T22:12:28.483093] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-30T22:12:28.487517] [INFO ] [MAIN ] Derivative Progress: 1193/2009 symbols completed. MTN took 1.3s. Estimated remaining: 5m 37s. Rate: 145.5 symbols/min [2025-09-30T22:12:28.494008] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:28.494314] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:28.496619] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28314 primary records. [2025-09-30T22:12:28.506215] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-30T22:12:28.508521] [DEBUG] [LOCAL ] MTW: Loaded 26443 existing records from primary storage. [2025-09-30T22:12:28.508734] [INFO ] [MAIN ] MTW: Loaded 26443 primary data records. [2025-09-30T22:12:28.600121] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-30T22:12:28.648073] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-30T22:12:28.651353] [INFO ] [MAIN ] Derivative Progress: 1194/2009 symbols completed. MTUS took 1.4s. Estimated remaining: 5m 36s. Rate: 145.6 symbols/min [2025-09-30T22:12:28.671419] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:28.709467] [DEBUG] [LOCAL ] MTX: Loaded 22798 existing records from primary storage. [2025-09-30T22:12:28.724804] [INFO ] [MAIN ] MTX: Loaded 22798 primary data records. [2025-09-30T22:12:29.225173] [DEBUG] [LOCAL ] MTZ: Loaded 43080 existing records from primary storage. [2025-09-30T22:12:29.260844] [INFO ] [MAIN ] MTZ: Loaded 43080 primary data records. [2025-09-30T22:12:29.780154] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:29.781540] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26443 primary records. [2025-09-30T22:12:29.781787] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-30T22:12:29.821932] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-30T22:12:29.820823] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:29.822118] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-30T22:12:29.823076] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22798 primary records. [2025-09-30T22:12:29.825515] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-30T22:12:29.825260] [INFO ] [MAIN ] Derivative Progress: 1195/2009 symbols completed. MTW took 1.4s. Estimated remaining: 5m 36s. Rate: 145.3 symbols/min [2025-09-30T22:12:29.838467] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:29.839989] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:29.841412] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43080 primary records. [2025-09-30T22:12:29.841805] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-30T22:12:29.875979] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-30T22:12:29.876974] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-30T22:12:29.880168] [INFO ] [MAIN ] Derivative Progress: 1196/2009 symbols completed. MTX took 1.4s. Estimated remaining: 5m 35s. Rate: 145.4 symbols/min [2025-09-30T22:12:29.880363] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:29.889113] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-09-30T22:12:29.888989] [DEBUG] [LOCAL ] MUA: Loaded 12248 existing records from primary storage. [2025-09-30T22:12:29.889276] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-30T22:12:29.892046] [INFO ] [MAIN ] MUA: Loaded 12248 primary data records. [2025-09-30T22:12:29.891955] [INFO ] [MAIN ] Derivative Progress: 1197/2009 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 35s. Rate: 145.6 symbols/min [2025-09-30T22:12:29.892462] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:30.026068] [DEBUG] [LOCAL ] MUC: Loaded 20622 existing records from primary storage. [2025-09-30T22:12:30.057674] [INFO ] [MAIN ] MUC: Loaded 20622 primary data records. [2025-09-30T22:12:30.052430] [DEBUG] [LOCAL ] MUE: Loaded 11929 existing records from primary storage. [2025-09-30T22:12:30.130154] [INFO ] [MAIN ] MUE: Loaded 11929 primary data records. [2025-09-30T22:12:30.986992] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:30.988126] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12248 primary records. [2025-09-30T22:12:30.988387] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-30T22:12:31.006710] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-30T22:12:31.009191] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-30T22:12:31.011340] [INFO ] [MAIN ] Derivative Progress: 1198/2009 symbols completed. MUA took 1.2s. Estimated remaining: 5m 35s. Rate: 145.4 symbols/min [2025-09-30T22:12:31.024520] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:31.025997] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20622 primary records. [2025-09-30T22:12:31.026810] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-30T22:12:31.053905] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:31.056488] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-30T22:12:31.056583] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-30T22:12:31.057306] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11929 primary records. [2025-09-30T22:12:31.060177] [INFO ] [MAIN ] Derivative Progress: 1199/2009 symbols completed. MUC took 1.2s. Estimated remaining: 5m 34s. Rate: 145.5 symbols/min [2025-09-30T22:12:31.060294] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-30T22:12:31.076608] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-30T22:12:31.076714] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-30T22:12:31.079225] [INFO ] [MAIN ] Derivative Progress: 1200/2009 symbols completed. MUE took 1.2s. Estimated remaining: 5m 33s. Rate: 145.6 symbols/min [2025-09-30T22:12:31.079763] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:31.079862] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:31.079673] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:31.096847] [DEBUG] [LOCAL ] MUJ: Loaded 13216 existing records from primary storage. [2025-09-30T22:12:31.097134] [INFO ] [MAIN ] MUJ: Loaded 13216 primary data records. [2025-09-30T22:12:31.472160] [DEBUG] [LOCAL ] MUFG: Loaded 52571 existing records from primary storage. [2025-09-30T22:12:31.473066] [DEBUG] [LOCAL ] MUR: Loaded 52925 existing records from primary storage. [2025-09-30T22:12:31.473173] [INFO ] [MAIN ] MUR: Loaded 52925 primary data records. [2025-09-30T22:12:31.472393] [INFO ] [MAIN ] MUFG: Loaded 52571 primary data records. [2025-09-30T22:12:32.137095] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:32.139006] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13216 primary records. [2025-09-30T22:12:32.139407] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-30T22:12:32.160529] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-30T22:12:32.160962] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-30T22:12:32.163537] [INFO ] [MAIN ] Derivative Progress: 1201/2009 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 33s. Rate: 145.4 symbols/min [2025-09-30T22:12:32.164009] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:32.206756] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:32.208757] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52925 primary records. [2025-09-30T22:12:32.207789] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:32.208957] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-30T22:12:32.209879] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52571 primary records. [2025-09-30T22:12:32.209986] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-30T22:12:32.248513] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-30T22:12:32.232703] [DEBUG] [LOCAL ] MUSA: Loaded 24760 existing records from primary storage. [2025-09-30T22:12:32.249892] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-30T22:12:32.250014] [INFO ] [MAIN ] MUSA: Loaded 24760 primary data records. [2025-09-30T22:12:32.252365] [INFO ] [MAIN ] Derivative Progress: 1202/2009 symbols completed. MUR took 1.2s. Estimated remaining: 5m 33s. Rate: 145.5 symbols/min [2025-09-30T22:12:32.253034] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:32.343228] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-30T22:12:32.373731] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-30T22:12:32.380574] [INFO ] [MAIN ] Derivative Progress: 1203/2009 symbols completed. MUFG took 1.3s. Estimated remaining: 5m 32s. Rate: 145.6 symbols/min [2025-09-30T22:12:32.377565] [DEBUG] [LOCAL ] MVF: Loaded 12938 existing records from primary storage. [2025-09-30T22:12:32.381214] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:32.402339] [INFO ] [MAIN ] MVF: Loaded 12938 primary data records. [2025-09-30T22:12:32.708282] [DEBUG] [LOCAL ] MVO: Loaded 8990 existing records from primary storage. [2025-09-30T22:12:32.715479] [INFO ] [MAIN ] MVO: Loaded 8990 primary data records. [2025-09-30T22:12:33.343246] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:33.345406] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24760 primary records. [2025-09-30T22:12:33.345938] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-30T22:12:33.364997] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-30T22:12:33.365225] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-30T22:12:33.367326] [INFO ] [MAIN ] Derivative Progress: 1204/2009 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 32s. Rate: 145.4 symbols/min [2025-09-30T22:12:33.369106] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:33.388156] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:33.389084] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12938 primary records. [2025-09-30T22:12:33.389409] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-30T22:12:33.412622] [DEBUG] [LOCAL ] MVT: Loaded 10215 existing records from primary storage. [2025-09-30T22:12:33.413563] [INFO ] [MAIN ] MVT: Loaded 10215 primary data records. [2025-09-30T22:12:33.433239] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:33.444804] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8990 primary records. [2025-09-30T22:12:33.455604] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-30T22:12:33.479520] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-30T22:12:33.502121] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-30T22:12:33.504868] [INFO ] [MAIN ] Derivative Progress: 1205/2009 symbols completed. MVF took 1.3s. Estimated remaining: 5m 32s. Rate: 145.5 symbols/min [2025-09-30T22:12:33.510209] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:33.670327] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-30T22:12:33.792306] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-30T22:12:33.795616] [INFO ] [MAIN ] Derivative Progress: 1206/2009 symbols completed. MVO took 1.4s. Estimated remaining: 5m 31s. Rate: 145.5 symbols/min [2025-09-30T22:12:33.796019] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:33.853310] [DEBUG] [LOCAL ] MWA: Loaded 46658 existing records from primary storage. [2025-09-30T22:12:33.853138] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:33.853471] [INFO ] [MAIN ] MWA: Loaded 46658 primary data records. [2025-09-30T22:12:33.854191] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10215 primary records. [2025-09-30T22:12:33.854428] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-30T22:12:33.906467] [DEBUG] [LOCAL ] MX: Loaded 22873 existing records from primary storage. [2025-09-30T22:12:33.941391] [INFO ] [MAIN ] MX: Loaded 22873 primary data records. [2025-09-30T22:12:34.079397] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-30T22:12:34.124472] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-30T22:12:34.180331] [INFO ] [MAIN ] Derivative Progress: 1207/2009 symbols completed. MVT took 0.8s. Estimated remaining: 5m 31s. Rate: 145.5 symbols/min [2025-09-30T22:12:34.247325] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:34.549928] [DEBUG] [LOCAL ] MXF: Loaded 5795 existing records from primary storage. [2025-09-30T22:12:34.550213] [INFO ] [MAIN ] MXF: Loaded 5795 primary data records. [2025-09-30T22:12:34.938928] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:34.940744] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 46658 primary records. [2025-09-30T22:12:34.940886] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-30T22:12:34.967638] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:34.969409] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22873 primary records. [2025-09-30T22:12:34.969796] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-30T22:12:34.991276] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-30T22:12:34.991981] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-30T22:12:34.994600] [INFO ] [MAIN ] Derivative Progress: 1208/2009 symbols completed. MX took 1.2s. Estimated remaining: 5m 31s. Rate: 145.4 symbols/min [2025-09-30T22:12:34.994801] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:34.995349] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-30T22:12:34.996140] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-30T22:12:34.998233] [INFO ] [MAIN ] Derivative Progress: 1209/2009 symbols completed. MWA took 1.5s. Estimated remaining: 5m 30s. Rate: 145.5 symbols/min [2025-09-30T22:12:34.998789] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:35.022107] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:35.023050] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5795 primary records. [2025-09-30T22:12:35.023300] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-30T22:12:35.040361] [DEBUG] [LOCAL ] MYD: Loaded 13710 existing records from primary storage. [2025-09-30T22:12:35.044142] [INFO ] [MAIN ] MYD: Loaded 13710 primary data records. [2025-09-30T22:12:35.050408] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-30T22:12:35.050694] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-30T22:12:35.098133] [INFO ] [MAIN ] Derivative Progress: 1210/2009 symbols completed. MXF took 0.9s. Estimated remaining: 5m 29s. Rate: 145.6 symbols/min [2025-09-30T22:12:35.150533] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:35.157312] [DEBUG] [LOCAL ] MYE: Loaded 24623 existing records from primary storage. [2025-09-30T22:12:35.179799] [INFO ] [MAIN ] MYE: Loaded 24623 primary data records. [2025-09-30T22:12:35.532440] [DEBUG] [LOCAL ] MYI: Loaded 19335 existing records from primary storage. [2025-09-30T22:12:35.538442] [INFO ] [MAIN ] MYI: Loaded 19335 primary data records. [2025-09-30T22:12:36.098361] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:36.101051] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13710 primary records. [2025-09-30T22:12:36.101175] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-30T22:12:36.136274] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:36.138688] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 24623 primary records. [2025-09-30T22:12:36.139023] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-30T22:12:36.138779] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-30T22:12:36.139286] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-30T22:12:36.144141] [INFO ] [MAIN ] Derivative Progress: 1211/2009 symbols completed. MYD took 1.1s. Estimated remaining: 5m 29s. Rate: 145.4 symbols/min [2025-09-30T22:12:36.145235] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:36.173895] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:36.176005] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19335 primary records. [2025-09-30T22:12:36.176694] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-30T22:12:36.189161] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-30T22:12:36.193390] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-30T22:12:36.198099] [DEBUG] [LOCAL ] MYN: Loaded 10002 existing records from primary storage. [2025-09-30T22:12:36.198240] [INFO ] [MAIN ] MYN: Loaded 10002 primary data records. [2025-09-30T22:12:36.213027] [INFO ] [MAIN ] Derivative Progress: 1212/2009 symbols completed. MYE took 1.2s. Estimated remaining: 5m 29s. Rate: 145.5 symbols/min [2025-09-30T22:12:36.235623] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:36.317761] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-30T22:12:36.338047] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-30T22:12:36.376371] [INFO ] [MAIN ] Derivative Progress: 1213/2009 symbols completed. MYI took 1.2s. Estimated remaining: 5m 28s. Rate: 145.6 symbols/min [2025-09-30T22:12:36.556222] [DEBUG] [LOCAL ] NABL: Loaded 39395 existing records from primary storage. [2025-09-30T22:12:36.556768] [INFO ] [MAIN ] NABL: Loaded 39395 primary data records. [2025-09-30T22:12:36.899006] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:36.899846] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10002 primary records. [2025-09-30T22:12:36.900627] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-30T22:12:36.919248] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-30T22:12:36.919465] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-30T22:12:36.921906] [INFO ] [MAIN ] Derivative Progress: 1214/2009 symbols completed. MYN took 0.8s. Estimated remaining: 5m 28s. Rate: 145.6 symbols/min [2025-09-30T22:12:36.938638] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:36.939261] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39395 primary records. [2025-09-30T22:12:36.939324] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-30T22:12:36.954798] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-30T22:12:36.954873] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-30T22:12:36.957351] [INFO ] [MAIN ] Derivative Progress: 1215/2009 symbols completed. NABL took 0.7s. Estimated remaining: 5m 27s. Rate: 145.7 symbols/min [2025-09-30T22:12:36.957816] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:36.957915] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:36.958068] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:36.970299] [DEBUG] [LOCAL ] NAN: Loaded 8948 existing records from primary storage. [2025-09-30T22:12:36.970433] [INFO ] [MAIN ] NAN: Loaded 8948 primary data records. [2025-09-30T22:12:37.107444] [DEBUG] [LOCAL ] NAC: Loaded 24873 existing records from primary storage. [2025-09-30T22:12:37.124288] [INFO ] [MAIN ] NAC: Loaded 24873 primary data records. [2025-09-30T22:12:37.214698] [DEBUG] [LOCAL ] NAD: Loaded 33896 existing records from primary storage. [2025-09-30T22:12:37.286402] [INFO ] [MAIN ] NAD: Loaded 33896 primary data records. [2025-09-30T22:12:38.042364] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:38.043621] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8948 primary records. [2025-09-30T22:12:38.045207] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-30T22:12:38.068838] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-30T22:12:38.069405] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-30T22:12:38.071760] [INFO ] [MAIN ] Derivative Progress: 1216/2009 symbols completed. NAN took 1.1s. Estimated remaining: 5m 27s. Rate: 145.5 symbols/min [2025-09-30T22:12:38.072192] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:38.086575] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:38.089365] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24873 primary records. [2025-09-30T22:12:38.090311] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-30T22:12:38.117080] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:38.118486] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33896 primary records. [2025-09-30T22:12:38.118614] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-30T22:12:38.140089] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-30T22:12:38.141709] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-30T22:12:38.141885] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-30T22:12:38.140983] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-30T22:12:38.144403] [INFO ] [MAIN ] Derivative Progress: 1217/2009 symbols completed. NAD took 1.2s. Estimated remaining: 5m 26s. Rate: 145.6 symbols/min [2025-09-30T22:12:38.147495] [INFO ] [MAIN ] Derivative Progress: 1218/2009 symbols completed. NAC took 1.2s. Estimated remaining: 5m 26s. Rate: 145.7 symbols/min [2025-09-30T22:12:38.147365] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:38.147837] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:38.165494] [DEBUG] [LOCAL ] NAZ: Loaded 2627 existing records from primary storage. [2025-09-30T22:12:38.165757] [INFO ] [MAIN ] NAZ: Loaded 2627 primary data records. [2025-09-30T22:12:38.308115] [DEBUG] [LOCAL ] NAT: Loaded 49129 existing records from primary storage. [2025-09-30T22:12:38.319684] [INFO ] [MAIN ] NAT: Loaded 49129 primary data records. [2025-09-30T22:12:38.547383] [DEBUG] [LOCAL ] NATL: Loaded 32612 existing records from primary storage. [2025-09-30T22:12:38.639349] [INFO ] [MAIN ] NATL: Loaded 32612 primary data records. [2025-09-30T22:12:39.308037] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:39.309034] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2627 primary records. [2025-09-30T22:12:39.309327] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-30T22:12:39.327804] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-30T22:12:39.328441] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-30T22:12:39.343506] [INFO ] [MAIN ] Derivative Progress: 1219/2009 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 26s. Rate: 145.4 symbols/min [2025-09-30T22:12:39.344180] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:39.344440] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:39.345374] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49129 primary records. [2025-09-30T22:12:39.346726] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-30T22:12:39.366729] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-30T22:12:39.367067] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-30T22:12:39.369932] [INFO ] [MAIN ] Derivative Progress: 1220/2009 symbols completed. NAT took 1.3s. Estimated remaining: 5m 25s. Rate: 145.6 symbols/min [2025-09-30T22:12:39.382972] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:39.387317] [DEBUG] [LOCAL ] NBB: Loaded 9014 existing records from primary storage. [2025-09-30T22:12:39.387515] [INFO ] [MAIN ] NBB: Loaded 9014 primary data records. [2025-09-30T22:12:39.393276] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:39.424601] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32612 primary records. [2025-09-30T22:12:39.438589] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-30T22:12:39.577169] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-30T22:12:39.627304] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-30T22:12:39.628274] [DEBUG] [LOCAL ] NBHC: Loaded 23162 existing records from primary storage. [2025-09-30T22:12:39.749131] [INFO ] [MAIN ] NBHC: Loaded 23162 primary data records. [2025-09-30T22:12:39.743877] [INFO ] [MAIN ] Derivative Progress: 1221/2009 symbols completed. NATL took 1.6s. Estimated remaining: 5m 25s. Rate: 145.6 symbols/min [2025-09-30T22:12:39.763232] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:40.120700] [DEBUG] [LOCAL ] NBR: Loaded 34709 existing records from primary storage. [2025-09-30T22:12:40.121126] [INFO ] [MAIN ] NBR: Loaded 34709 primary data records. [2025-09-30T22:12:40.272019] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:40.303278] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9014 primary records. [2025-09-30T22:12:40.334352] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-30T22:12:40.473920] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-30T22:12:40.474714] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-30T22:12:40.477043] [INFO ] [MAIN ] Derivative Progress: 1222/2009 symbols completed. NBB took 1.1s. Estimated remaining: 5m 25s. Rate: 145.5 symbols/min [2025-09-30T22:12:40.477455] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:40.497196] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:40.498002] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23162 primary records. [2025-09-30T22:12:40.498295] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-30T22:12:40.522426] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-30T22:12:40.522665] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-30T22:12:40.525117] [INFO ] [MAIN ] Derivative Progress: 1223/2009 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 24s. Rate: 145.6 symbols/min [2025-09-30T22:12:40.525350] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:40.537337] [DEBUG] [LOCAL ] NBXG: Loaded 22277 existing records from primary storage. [2025-09-30T22:12:40.550382] [INFO ] [MAIN ] NBXG: Loaded 22277 primary data records. [2025-09-30T22:12:40.552779] [DEBUG] [LOCAL ] NC: Loaded 1925 existing records from primary storage. [2025-09-30T22:12:40.550986] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:40.552931] [INFO ] [MAIN ] NC: Loaded 1925 primary data records. [2025-09-30T22:12:40.576489] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34709 primary records. [2025-09-30T22:12:40.698526] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-30T22:12:40.937125] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-30T22:12:41.092272] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-30T22:12:41.095154] [INFO ] [MAIN ] Derivative Progress: 1224/2009 symbols completed. NBR took 1.3s. Estimated remaining: 5m 24s. Rate: 145.5 symbols/min [2025-09-30T22:12:41.245130] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:41.276907] [DEBUG] [LOCAL ] NCA: Loaded 10231 existing records from primary storage. [2025-09-30T22:12:41.277750] [INFO ] [MAIN ] NCA: Loaded 10231 primary data records. [2025-09-30T22:12:41.457377] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:12:41.468011] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1925 primary records. [2025-09-30T22:12:41.501729] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-30T22:12:41.642401] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-09-30T22:12:41.642674] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-30T22:12:41.645130] [INFO ] [MAIN ] Derivative Progress: 1225/2009 symbols completed. NC took 1.1s. Estimated remaining: 5m 23s. Rate: 145.5 symbols/min [2025-09-30T22:12:41.653791] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:41.661120] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:41.664735] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22277 primary records. [2025-09-30T22:12:41.664979] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-30T22:12:41.688386] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-30T22:12:41.688880] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-30T22:12:41.691771] [INFO ] [MAIN ] Derivative Progress: 1226/2009 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 23s. Rate: 145.6 symbols/min [2025-09-30T22:12:41.692119] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:41.704290] [DEBUG] [LOCAL ] NCDL: Loaded 21500 existing records from primary storage. [2025-09-30T22:12:41.704747] [INFO ] [MAIN ] NCDL: Loaded 21500 primary data records. [2025-09-30T22:12:41.734518] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:41.760626] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10231 primary records. [2025-09-30T22:12:41.782120] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-30T22:12:41.907086] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-30T22:12:41.921222] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-30T22:12:41.945513] [INFO ] [MAIN ] Derivative Progress: 1227/2009 symbols completed. NCA took 0.7s. Estimated remaining: 5m 22s. Rate: 145.6 symbols/min [2025-09-30T22:12:41.956942] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:42.154590] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-30T22:12:42.155703] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-30T22:12:42.253672] [DEBUG] [LOCAL ] NCV: Loaded 13535 existing records from primary storage. [2025-09-30T22:12:42.272609] [INFO ] [MAIN ] NCV: Loaded 13535 primary data records. [2025-09-30T22:12:42.836831] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:42.837882] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21500 primary records. [2025-09-30T22:12:42.838595] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-30T22:12:42.857801] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-30T22:12:42.858290] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-30T22:12:42.861328] [INFO ] [MAIN ] Derivative Progress: 1228/2009 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 22s. Rate: 145.5 symbols/min [2025-09-30T22:12:42.881623] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:42.882828] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-30T22:12:42.883012] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-30T22:12:42.901127] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-30T22:12:42.901430] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-30T22:12:42.904234] [INFO ] [MAIN ] Derivative Progress: 1229/2009 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 21s. Rate: 145.6 symbols/min [2025-09-30T22:12:42.925136] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:42.926094] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13535 primary records. [2025-09-30T22:12:42.926174] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-30T22:12:42.947605] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-30T22:12:42.947767] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-30T22:12:42.950820] [INFO ] [MAIN ] Derivative Progress: 1230/2009 symbols completed. NCV took 1.0s. Estimated remaining: 5m 21s. Rate: 145.7 symbols/min [2025-09-30T22:12:42.951501] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:42.952094] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:42.951390] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:42.973097] [DEBUG] [LOCAL ] NCZ: Loaded 11854 existing records from primary storage. [2025-09-30T22:12:42.973794] [INFO ] [MAIN ] NCZ: Loaded 11854 primary data records. [2025-09-30T22:12:43.014125] [DEBUG] [LOCAL ] NDMO: Loaded 16909 existing records from primary storage. [2025-09-30T22:12:43.026811] [INFO ] [MAIN ] NDMO: Loaded 16909 primary data records. [2025-09-30T22:12:43.574551] [DEBUG] [LOCAL ] NE: Loaded 52366 existing records from primary storage. [2025-09-30T22:12:43.581725] [INFO ] [MAIN ] NE: Loaded 52366 primary data records. [2025-09-30T22:12:44.071796] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:44.073453] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11854 primary records. [2025-09-30T22:12:44.073814] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-30T22:12:44.094996] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-30T22:12:44.103036] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-30T22:12:44.110039] [INFO ] [MAIN ] Derivative Progress: 1231/2009 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 21s. Rate: 145.5 symbols/min [2025-09-30T22:12:44.111237] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:44.111787] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:44.112804] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16909 primary records. [2025-09-30T22:12:44.113298] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-30T22:12:44.133149] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-30T22:12:44.133418] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-30T22:12:44.136156] [INFO ] [MAIN ] Derivative Progress: 1232/2009 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 20s. Rate: 145.6 symbols/min [2025-09-30T22:12:44.136333] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:44.150849] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:44.151505] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52366 primary records. [2025-09-30T22:12:44.151625] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-30T22:12:44.178097] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-30T22:12:44.178375] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-30T22:12:44.180895] [INFO ] [MAIN ] Derivative Progress: 1233/2009 symbols completed. NE took 1.2s. Estimated remaining: 5m 20s. Rate: 145.7 symbols/min [2025-09-30T22:12:44.181048] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:44.195973] [DEBUG] [LOCAL ] NEA: Loaded 35427 existing records from primary storage. [2025-09-30T22:12:44.196182] [INFO ] [MAIN ] NEA: Loaded 35427 primary data records. [2025-09-30T22:12:44.555368] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-30T22:12:44.555698] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-30T22:12:44.677838] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-30T22:12:44.692283] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-30T22:12:45.250352] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:45.251191] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35427 primary records. [2025-09-30T22:12:45.251411] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-30T22:12:45.271905] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-30T22:12:45.272190] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-30T22:12:45.275079] [INFO ] [MAIN ] Derivative Progress: 1234/2009 symbols completed. NEA took 1.2s. Estimated remaining: 5m 20s. Rate: 145.5 symbols/min [2025-09-30T22:12:45.275264] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:45.295983] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:45.297311] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-30T22:12:45.297493] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-30T22:12:45.318067] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-30T22:12:45.318276] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-30T22:12:45.320583] [INFO ] [MAIN ] Derivative Progress: 1235/2009 symbols completed. NEE took 1.2s. Estimated remaining: 5m 19s. Rate: 145.6 symbols/min [2025-09-30T22:12:45.320974] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:45.334474] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:45.335360] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-30T22:12:45.335465] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-30T22:12:45.358362] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-30T22:12:45.358739] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-30T22:12:45.359058] [DEBUG] [LOCAL ] NEU: Loaded 8252 existing records from primary storage. [2025-09-30T22:12:45.376049] [INFO ] [MAIN ] Derivative Progress: 1236/2009 symbols completed. NEM took 1.2s. Estimated remaining: 5m 18s. Rate: 145.7 symbols/min [2025-09-30T22:12:45.376398] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:45.376972] [INFO ] [MAIN ] NEU: Loaded 8252 primary data records. [2025-09-30T22:12:45.460359] [DEBUG] [LOCAL ] NEUE: Loaded 2181 existing records from primary storage. [2025-09-30T22:12:45.472865] [INFO ] [MAIN ] NEUE: Loaded 2181 primary data records. [2025-09-30T22:12:45.578252] [DEBUG] [LOCAL ] NET: Loaded 52998 existing records from primary storage. [2025-09-30T22:12:45.620236] [INFO ] [MAIN ] NET: Loaded 52998 primary data records. [2025-09-30T22:12:46.485574] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:46.486968] [INFO ] [MAIN ] NEUE: Generated 1794 derivative records from 2181 primary records. [2025-09-30T22:12:46.487209] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-30T22:12:46.486182] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:46.488779] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8252 primary records. [2025-09-30T22:12:46.489111] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-30T22:12:46.510933] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1794 records). [2025-09-30T22:12:46.514142] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-30T22:12:46.517483] [INFO ] [MAIN ] Derivative Progress: 1237/2009 symbols completed. NEUE took 1.1s. Estimated remaining: 5m 18s. Rate: 145.5 symbols/min [2025-09-30T22:12:46.518142] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:46.522945] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-30T22:12:46.523124] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-30T22:12:46.525305] [INFO ] [MAIN ] Derivative Progress: 1238/2009 symbols completed. NEU took 1.2s. Estimated remaining: 5m 18s. Rate: 145.6 symbols/min [2025-09-30T22:12:46.525593] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:46.547572] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:46.547299] [DEBUG] [LOCAL ] NEXA: Loaded 4322 existing records from primary storage. [2025-09-30T22:12:46.548454] [INFO ] [MAIN ] NEXA: Loaded 4322 primary data records. [2025-09-30T22:12:46.548375] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 52998 primary records. [2025-09-30T22:12:46.548570] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-30T22:12:46.659841] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-30T22:12:46.672531] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-30T22:12:46.675120] [INFO ] [MAIN ] Derivative Progress: 1239/2009 symbols completed. NET took 1.4s. Estimated remaining: 5m 17s. Rate: 145.7 symbols/min [2025-09-30T22:12:46.675755] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:46.900397] [DEBUG] [LOCAL ] NFG: Loaded 38473 existing records from primary storage. [2025-09-30T22:12:46.910027] [INFO ] [MAIN ] NFG: Loaded 38473 primary data records. [2025-09-30T22:12:47.008498] [DEBUG] [LOCAL ] NFJ: Loaded 20367 existing records from primary storage. [2025-09-30T22:12:47.014544] [INFO ] [MAIN ] NFJ: Loaded 20367 primary data records. [2025-09-30T22:12:47.720293] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:47.721350] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4322 primary records. [2025-09-30T22:12:47.721707] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-30T22:12:47.740787] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-30T22:12:47.741497] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-30T22:12:47.744683] [INFO ] [MAIN ] Derivative Progress: 1240/2009 symbols completed. NEXA took 1.2s. Estimated remaining: 5m 17s. Rate: 145.5 symbols/min [2025-09-30T22:12:47.745847] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:47.768808] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:47.770049] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38473 primary records. [2025-09-30T22:12:47.770279] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-30T22:12:47.804222] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:47.805143] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-30T22:12:47.806035] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20367 primary records. [2025-09-30T22:12:47.806392] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-30T22:12:47.814899] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-30T22:12:47.822282] [INFO ] [MAIN ] Derivative Progress: 1241/2009 symbols completed. NFG took 1.3s. Estimated remaining: 5m 16s. Rate: 145.6 symbols/min [2025-09-30T22:12:47.827620] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:47.827385] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-30T22:12:47.839578] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-30T22:12:47.843970] [INFO ] [MAIN ] Derivative Progress: 1242/2009 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 16s. Rate: 145.7 symbols/min [2025-09-30T22:12:47.844353] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:47.866226] [DEBUG] [LOCAL ] NGG: Loaded 46203 existing records from primary storage. [2025-09-30T22:12:47.866558] [INFO ] [MAIN ] NGG: Loaded 46203 primary data records. [2025-09-30T22:12:47.932428] [DEBUG] [LOCAL ] NGS: Loaded 11524 existing records from primary storage. [2025-09-30T22:12:47.951824] [INFO ] [MAIN ] NGS: Loaded 11524 primary data records. [2025-09-30T22:12:48.155776] [DEBUG] [LOCAL ] NGL: Loaded 30329 existing records from primary storage. [2025-09-30T22:12:48.210504] [INFO ] [MAIN ] NGL: Loaded 30329 primary data records. [2025-09-30T22:12:48.984930] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:48.987285] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46203 primary records. [2025-09-30T22:12:48.989204] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-30T22:12:49.016229] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:49.020760] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11524 primary records. [2025-09-30T22:12:49.022383] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-30T22:12:49.023118] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-30T22:12:49.023018] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-30T22:12:49.027216] [INFO ] [MAIN ] Derivative Progress: 1243/2009 symbols completed. NGG took 1.3s. Estimated remaining: 5m 16s. Rate: 145.5 symbols/min [2025-09-30T22:12:49.053301] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:49.058493] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30329 primary records. [2025-09-30T22:12:49.059031] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-30T22:12:49.058959] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-30T22:12:49.059501] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-30T22:12:49.062584] [INFO ] [MAIN ] Derivative Progress: 1244/2009 symbols completed. NGS took 1.2s. Estimated remaining: 5m 15s. Rate: 145.6 symbols/min [2025-09-30T22:12:49.078185] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-30T22:12:49.078284] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-30T22:12:49.081340] [INFO ] [MAIN ] Derivative Progress: 1245/2009 symbols completed. NGL took 1.3s. Estimated remaining: 5m 15s. Rate: 145.7 symbols/min [2025-09-30T22:12:49.082163] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:49.082280] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:49.082225] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:49.133091] [DEBUG] [LOCAL ] NHI: Loaded 21859 existing records from primary storage. [2025-09-30T22:12:49.133696] [DEBUG] [LOCAL ] NGVT: Loaded 24100 existing records from primary storage. [2025-09-30T22:12:49.141240] [INFO ] [MAIN ] NHI: Loaded 21859 primary data records. [2025-09-30T22:12:49.141165] [INFO ] [MAIN ] NGVT: Loaded 24100 primary data records. [2025-09-30T22:12:49.147038] [DEBUG] [LOCAL ] NGVC: Loaded 22357 existing records from primary storage. [2025-09-30T22:12:49.195709] [INFO ] [MAIN ] NGVC: Loaded 22357 primary data records. [2025-09-30T22:12:50.211181] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:50.212896] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21859 primary records. [2025-09-30T22:12:50.213018] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-30T22:12:50.253951] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-30T22:12:50.254346] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-30T22:12:50.252801] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:50.269922] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24100 primary records. [2025-09-30T22:12:50.272324] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-30T22:12:50.272225] [INFO ] [MAIN ] Derivative Progress: 1246/2009 symbols completed. NHI took 1.2s. Estimated remaining: 5m 15s. Rate: 145.5 symbols/min [2025-09-30T22:12:50.274298] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:50.274887] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:50.276100] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22357 primary records. [2025-09-30T22:12:50.285470] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-30T22:12:50.301924] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-30T22:12:50.309242] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-30T22:12:50.310928] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-30T22:12:50.314019] [INFO ] [MAIN ] Derivative Progress: 1247/2009 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 14s. Rate: 145.6 symbols/min [2025-09-30T22:12:50.314457] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-30T22:12:50.317531] [INFO ] [MAIN ] Derivative Progress: 1248/2009 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 13s. Rate: 145.7 symbols/min [2025-09-30T22:12:50.314250] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:50.318260] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:50.333890] [DEBUG] [LOCAL ] NIC: Loaded 8968 existing records from primary storage. [2025-09-30T22:12:50.334165] [INFO ] [MAIN ] NIC: Loaded 8968 primary data records. [2025-09-30T22:12:50.388305] [DEBUG] [LOCAL ] NIE: Loaded 11782 existing records from primary storage. [2025-09-30T22:12:50.411044] [INFO ] [MAIN ] NIE: Loaded 11782 primary data records. [2025-09-30T22:12:50.705061] [DEBUG] [LOCAL ] NI: Loaded 53419 existing records from primary storage. [2025-09-30T22:12:50.845836] [INFO ] [MAIN ] NI: Loaded 53419 primary data records. [2025-09-30T22:12:51.433674] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:51.435151] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8968 primary records. [2025-09-30T22:12:51.435921] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-30T22:12:51.458437] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-30T22:12:51.459743] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-30T22:12:51.462067] [INFO ] [MAIN ] Derivative Progress: 1249/2009 symbols completed. NIC took 1.1s. Estimated remaining: 5m 13s. Rate: 145.5 symbols/min [2025-09-30T22:12:51.462605] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:51.477016] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:51.479273] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11782 primary records. [2025-09-30T22:12:51.479504] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-30T22:12:51.484735] [DEBUG] [LOCAL ] NIM: Loaded 4105 existing records from primary storage. [2025-09-30T22:12:51.498799] [INFO ] [MAIN ] NIM: Loaded 4105 primary data records. [2025-09-30T22:12:51.501601] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-30T22:12:51.541201] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-30T22:12:51.601002] [INFO ] [MAIN ] Derivative Progress: 1250/2009 symbols completed. NIE took 1.3s. Estimated remaining: 5m 13s. Rate: 145.6 symbols/min [2025-09-30T22:12:51.625631] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:51.666845] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:51.690589] [INFO ] [MAIN ] NI: Generated 1794 derivative records from 53419 primary records. [2025-09-30T22:12:51.713374] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-30T22:12:51.896217] [DEBUG] [LOCAL ] NI: Derivative data saved (1794 records). [2025-09-30T22:12:51.896957] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-30T22:12:51.901410] [INFO ] [MAIN ] Derivative Progress: 1251/2009 symbols completed. NI took 1.6s. Estimated remaining: 5m 12s. Rate: 145.6 symbols/min [2025-09-30T22:12:51.913089] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:51.915076] [DEBUG] [LOCAL ] NINE: Loaded 28273 existing records from primary storage. [2025-09-30T22:12:51.916012] [INFO ] [MAIN ] NINE: Loaded 28273 primary data records. [2025-09-30T22:12:52.345730] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:52.364396] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4105 primary records. [2025-09-30T22:12:52.364585] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-30T22:12:52.368202] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-30T22:12:52.368916] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-30T22:12:52.426097] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-30T22:12:52.448162] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-30T22:12:52.460451] [INFO ] [MAIN ] Derivative Progress: 1252/2009 symbols completed. NIM took 1.0s. Estimated remaining: 5m 12s. Rate: 145.6 symbols/min [2025-09-30T22:12:52.479330] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:52.749933] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:52.751601] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28273 primary records. [2025-09-30T22:12:52.752026] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-30T22:12:52.779949] [DEBUG] [LOCAL ] NJR: Loaded 38069 existing records from primary storage. [2025-09-30T22:12:52.781225] [INFO ] [MAIN ] NJR: Loaded 38069 primary data records. [2025-09-30T22:12:52.862800] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-30T22:12:52.893362] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-30T22:12:52.910365] [INFO ] [MAIN ] Derivative Progress: 1253/2009 symbols completed. NINE took 1.3s. Estimated remaining: 5m 12s. Rate: 145.6 symbols/min [2025-09-30T22:12:52.911228] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:53.003194] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:53.121392] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-30T22:12:53.136512] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-30T22:12:53.159225] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-30T22:12:53.160226] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-30T22:12:53.168330] [INFO ] [MAIN ] Derivative Progress: 1254/2009 symbols completed. NIO took 1.3s. Estimated remaining: 5m 11s. Rate: 145.6 symbols/min [2025-09-30T22:12:53.168753] [DEBUG] [LOCAL ] NKX: Loaded 13662 existing records from primary storage. [2025-09-30T22:12:53.169168] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:53.169067] [INFO ] [MAIN ] NKX: Loaded 13662 primary data records. [2025-09-30T22:12:53.308090] [DEBUG] [LOCAL ] NLOP: Loaded 11771 existing records from primary storage. [2025-09-30T22:12:53.318903] [INFO ] [MAIN ] NLOP: Loaded 11771 primary data records. [2025-09-30T22:12:53.630306] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:53.637620] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38069 primary records. [2025-09-30T22:12:53.648810] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-30T22:12:53.863887] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-30T22:12:53.864721] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-30T22:12:53.867722] [INFO ] [MAIN ] Derivative Progress: 1255/2009 symbols completed. NJR took 1.4s. Estimated remaining: 5m 11s. Rate: 145.5 symbols/min [2025-09-30T22:12:53.869298] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:53.889567] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:53.890421] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13662 primary records. [2025-09-30T22:12:53.890795] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-30T22:12:53.917947] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-30T22:12:53.922284] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-30T22:12:53.925698] [INFO ] [MAIN ] Derivative Progress: 1256/2009 symbols completed. NKX took 1.0s. Estimated remaining: 5m 10s. Rate: 145.6 symbols/min [2025-09-30T22:12:53.926195] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:53.941988] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:53.942939] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11771 primary records. [2025-09-30T22:12:53.943080] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-30T22:12:53.978057] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-30T22:12:53.984807] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-30T22:12:53.985224] [DEBUG] [LOCAL ] NMAI: Loaded 12913 existing records from primary storage. [2025-09-30T22:12:53.988469] [INFO ] [MAIN ] Derivative Progress: 1257/2009 symbols completed. NLOP took 0.8s. Estimated remaining: 5m 10s. Rate: 145.7 symbols/min [2025-09-30T22:12:53.988746] [INFO ] [MAIN ] NMAI: Loaded 12913 primary data records. [2025-09-30T22:12:54.007305] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:54.050414] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-30T22:12:54.059262] [INFO ] [MAIN ] NLY: Loaded 53581 primary data records. [2025-09-30T22:12:54.289674] [DEBUG] [LOCAL ] NMCO: Loaded 16715 existing records from primary storage. [2025-09-30T22:12:54.351787] [INFO ] [MAIN ] NMCO: Loaded 16715 primary data records. [2025-09-30T22:12:55.112034] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:55.127238] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:55.126357] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12913 primary records. [2025-09-30T22:12:55.128315] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53581 primary records. [2025-09-30T22:12:55.128447] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-30T22:12:55.129109] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-30T22:12:55.160210] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-30T22:12:55.163208] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-30T22:12:55.166936] [INFO ] [MAIN ] Derivative Progress: 1258/2009 symbols completed. NLY took 1.3s. Estimated remaining: 5m 10s. Rate: 145.5 symbols/min [2025-09-30T22:12:55.167570] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-30T22:12:55.169672] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-30T22:12:55.171974] [INFO ] [MAIN ] Derivative Progress: 1259/2009 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 9s. Rate: 145.6 symbols/min [2025-09-30T22:12:55.185188] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:55.185906] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16715 primary records. [2025-09-30T22:12:55.185988] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-30T22:12:55.202117] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-30T22:12:55.202236] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-30T22:12:55.204943] [INFO ] [MAIN ] Derivative Progress: 1260/2009 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 8s. Rate: 145.7 symbols/min [2025-09-30T22:12:55.205487] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:55.205685] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:55.205823] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:55.215314] [DEBUG] [LOCAL ] NMI: Loaded 4052 existing records from primary storage. [2025-09-30T22:12:55.215525] [INFO ] [MAIN ] NMI: Loaded 4052 primary data records. [2025-09-30T22:12:55.262726] [DEBUG] [LOCAL ] NMG: Loaded 8131 existing records from primary storage. [2025-09-30T22:12:55.284137] [INFO ] [MAIN ] NMG: Loaded 8131 primary data records. [2025-09-30T22:12:55.370897] [DEBUG] [LOCAL ] NMM: Loaded 14348 existing records from primary storage. [2025-09-30T22:12:55.466194] [INFO ] [MAIN ] NMM: Loaded 14348 primary data records. [2025-09-30T22:12:56.272811] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:56.276020] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4052 primary records. [2025-09-30T22:12:56.276964] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-30T22:12:56.305399] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:56.308077] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 8131 primary records. [2025-09-30T22:12:56.308896] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-30T22:12:56.342476] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-30T22:12:56.343416] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-30T22:12:56.343301] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:56.342576] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-30T22:12:56.344501] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-30T22:12:56.344408] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14348 primary records. [2025-09-30T22:12:56.350450] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-30T22:12:56.347449] [INFO ] [MAIN ] Derivative Progress: 1261/2009 symbols completed. NMI took 1.1s. Estimated remaining: 5m 8s. Rate: 145.5 symbols/min [2025-09-30T22:12:56.350957] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:56.351123] [INFO ] [MAIN ] Derivative Progress: 1262/2009 symbols completed. NMG took 1.1s. Estimated remaining: 5m 8s. Rate: 145.7 symbols/min [2025-09-30T22:12:56.352076] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:56.373981] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-30T22:12:56.374278] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-30T22:12:56.377206] [INFO ] [MAIN ] Derivative Progress: 1263/2009 symbols completed. NMM took 1.2s. Estimated remaining: 5m 7s. Rate: 145.8 symbols/min [2025-09-30T22:12:56.377509] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:56.381315] [DEBUG] [LOCAL ] NMS: Loaded 2855 existing records from primary storage. [2025-09-30T22:12:56.381951] [INFO ] [MAIN ] NMS: Loaded 2855 primary data records. [2025-09-30T22:12:56.488447] [DEBUG] [LOCAL ] NMT: Loaded 2851 existing records from primary storage. [2025-09-30T22:12:56.514398] [INFO ] [MAIN ] NMT: Loaded 2851 primary data records. [2025-09-30T22:12:56.633374] [DEBUG] [LOCAL ] NMR: Loaded 34990 existing records from primary storage. [2025-09-30T22:12:56.757582] [INFO ] [MAIN ] NMR: Loaded 34990 primary data records. [2025-09-30T22:12:57.465110] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:57.466333] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2855 primary records. [2025-09-30T22:12:57.466893] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-30T22:12:57.481626] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:12:57.483494] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2851 primary records. [2025-09-30T22:12:57.494519] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-30T22:12:57.515858] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-09-30T22:12:57.516150] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-30T22:12:57.521333] [INFO ] [MAIN ] Derivative Progress: 1264/2009 symbols completed. NMT took 1.1s. Estimated remaining: 5m 7s. Rate: 145.6 symbols/min [2025-09-30T22:12:57.521898] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:57.539916] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:57.542579] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 34990 primary records. [2025-09-30T22:12:57.542780] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-30T22:12:57.543310] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-09-30T22:12:57.543981] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-30T22:12:57.546987] [INFO ] [MAIN ] Derivative Progress: 1265/2009 symbols completed. NMS took 1.2s. Estimated remaining: 5m 6s. Rate: 145.7 symbols/min [2025-09-30T22:12:57.547170] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:57.564389] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-30T22:12:57.574531] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-30T22:12:57.577516] [INFO ] [MAIN ] Derivative Progress: 1266/2009 symbols completed. NMR took 1.2s. Estimated remaining: 5m 6s. Rate: 145.8 symbols/min [2025-09-30T22:12:57.577880] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:57.584606] [DEBUG] [LOCAL ] NNI: Loaded 10155 existing records from primary storage. [2025-09-30T22:12:57.591919] [INFO ] [MAIN ] NNI: Loaded 10155 primary data records. [2025-09-30T22:12:57.632297] [DEBUG] [LOCAL ] NMZ: Loaded 21758 existing records from primary storage. [2025-09-30T22:12:57.661357] [INFO ] [MAIN ] NMZ: Loaded 21758 primary data records. [2025-09-30T22:12:58.181833] [DEBUG] [LOCAL ] NNN: Loaded 48365 existing records from primary storage. [2025-09-30T22:12:58.306792] [INFO ] [MAIN ] NNN: Loaded 48365 primary data records. [2025-09-30T22:12:58.786241] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:58.800214] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10155 primary records. [2025-09-30T22:12:58.800712] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:58.801427] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21758 primary records. [2025-09-30T22:12:58.801521] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-30T22:12:58.800841] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-30T22:12:58.837630] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-30T22:12:58.838682] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-30T22:12:58.842148] [INFO ] [MAIN ] Derivative Progress: 1267/2009 symbols completed. NMZ took 1.3s. Estimated remaining: 5m 6s. Rate: 145.5 symbols/min [2025-09-30T22:12:58.842758] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-30T22:12:58.845833] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:58.846115] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-30T22:12:58.849166] [INFO ] [MAIN ] Derivative Progress: 1268/2009 symbols completed. NNI took 1.3s. Estimated remaining: 5m 5s. Rate: 145.6 symbols/min [2025-09-30T22:12:58.849611] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:58.863750] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:58.864731] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48365 primary records. [2025-09-30T22:12:58.864928] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-30T22:12:58.883727] [DEBUG] [LOCAL ] NNY: Loaded 5692 existing records from primary storage. [2025-09-30T22:12:58.890783] [INFO ] [MAIN ] NNY: Loaded 5692 primary data records. [2025-09-30T22:12:58.892366] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-30T22:12:58.910902] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-30T22:12:58.921442] [INFO ] [MAIN ] Derivative Progress: 1269/2009 symbols completed. NNN took 1.3s. Estimated remaining: 5m 5s. Rate: 145.7 symbols/min [2025-09-30T22:12:58.959806] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:12:58.966903] [DEBUG] [LOCAL ] NOA: Loaded 16200 existing records from primary storage. [2025-09-30T22:12:58.985289] [INFO ] [MAIN ] NOA: Loaded 16200 primary data records. [2025-09-30T22:12:59.418618] [DEBUG] [LOCAL ] NOAH: Loaded 20279 existing records from primary storage. [2025-09-30T22:12:59.460708] [INFO ] [MAIN ] NOAH: Loaded 20279 primary data records. [2025-09-30T22:12:59.948205] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:59.949671] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5692 primary records. [2025-09-30T22:12:59.949851] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-30T22:12:59.980989] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-30T22:12:59.982435] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:12:59.982759] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-30T22:12:59.983491] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16200 primary records. [2025-09-30T22:12:59.986356] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-30T22:12:59.986260] [INFO ] [MAIN ] Derivative Progress: 1270/2009 symbols completed. NNY took 1.1s. Estimated remaining: 5m 5s. Rate: 145.6 symbols/min [2025-09-30T22:12:59.987737] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:00.007182] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-30T22:13:00.010120] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-30T22:13:00.013004] [INFO ] [MAIN ] Derivative Progress: 1271/2009 symbols completed. NOA took 1.2s. Estimated remaining: 5m 4s. Rate: 145.7 symbols/min [2025-09-30T22:13:00.013393] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:00.027509] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:00.028420] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20279 primary records. [2025-09-30T22:13:00.028567] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-30T22:13:00.056053] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-30T22:13:00.056152] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-30T22:13:00.058994] [INFO ] [MAIN ] Derivative Progress: 1272/2009 symbols completed. NOAH took 1.1s. Estimated remaining: 5m 3s. Rate: 145.8 symbols/min [2025-09-30T22:13:00.059329] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:00.075197] [DEBUG] [LOCAL ] NOC: Loaded 42237 existing records from primary storage. [2025-09-30T22:13:00.075462] [INFO ] [MAIN ] NOC: Loaded 42237 primary data records. [2025-09-30T22:13:00.292428] [DEBUG] [LOCAL ] NOG: Loaded 51183 existing records from primary storage. [2025-09-30T22:13:00.316687] [INFO ] [MAIN ] NOG: Loaded 51183 primary data records. [2025-09-30T22:13:00.555282] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-30T22:13:00.566310] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-09-30T22:13:01.212720] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:01.213889] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42237 primary records. [2025-09-30T22:13:01.214028] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-30T22:13:01.237584] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-30T22:13:01.251131] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-30T22:13:01.255499] [INFO ] [MAIN ] Derivative Progress: 1273/2009 symbols completed. NOC took 1.3s. Estimated remaining: 5m 3s. Rate: 145.5 symbols/min [2025-09-30T22:13:01.252031] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:01.256881] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51183 primary records. [2025-09-30T22:13:01.256986] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-30T22:13:01.277406] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-30T22:13:01.277864] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-30T22:13:01.294576] [INFO ] [MAIN ] Derivative Progress: 1274/2009 symbols completed. NOG took 1.3s. Estimated remaining: 5m 3s. Rate: 145.7 symbols/min [2025-09-30T22:13:01.295043] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:01.296260] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-09-30T22:13:01.296400] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-30T22:13:01.313254] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-30T22:13:01.313423] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-30T22:13:01.316749] [INFO ] [MAIN ] Derivative Progress: 1275/2009 symbols completed. NOK took 1.3s. Estimated remaining: 5m 2s. Rate: 145.8 symbols/min [2025-09-30T22:13:01.317484] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:01.317392] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:01.317638] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:01.392068] [DEBUG] [LOCAL ] NOTE: Loaded 42067 existing records from primary storage. [2025-09-30T22:13:01.392786] [INFO ] [MAIN ] NOTE: Loaded 42067 primary data records. [2025-09-30T22:13:01.477405] [DEBUG] [LOCAL ] NOMD: Loaded 41446 existing records from primary storage. [2025-09-30T22:13:01.516999] [INFO ] [MAIN ] NOMD: Loaded 41446 primary data records. [2025-09-30T22:13:01.538232] [DEBUG] [LOCAL ] NOV: Loaded 53180 existing records from primary storage. [2025-09-30T22:13:01.547420] [INFO ] [MAIN ] NOV: Loaded 53180 primary data records. [2025-09-30T22:13:02.441618] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:02.443075] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 42067 primary records. [2025-09-30T22:13:02.443191] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-30T22:13:02.489110] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:02.491447] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:02.490688] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41446 primary records. [2025-09-30T22:13:02.492412] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-30T22:13:02.492339] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53180 primary records. [2025-09-30T22:13:02.491604] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-30T22:13:02.492570] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-30T22:13:02.493386] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-30T22:13:02.495842] [INFO ] [MAIN ] Derivative Progress: 1276/2009 symbols completed. NOTE took 1.2s. Estimated remaining: 5m 2s. Rate: 145.5 symbols/min [2025-09-30T22:13:02.496042] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:02.533304] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-30T22:13:02.534472] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-30T22:13:02.537184] [INFO ] [MAIN ] Derivative Progress: 1277/2009 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 2s. Rate: 145.7 symbols/min [2025-09-30T22:13:02.538506] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:02.542600] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-30T22:13:02.542846] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-30T22:13:02.545696] [INFO ] [MAIN ] Derivative Progress: 1278/2009 symbols completed. NOV took 1.2s. Estimated remaining: 5m 1s. Rate: 145.8 symbols/min [2025-09-30T22:13:02.545992] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:02.565294] [DEBUG] [LOCAL ] NPCT: Loaded 16978 existing records from primary storage. [2025-09-30T22:13:02.565427] [INFO ] [MAIN ] NPCT: Loaded 16978 primary data records. [2025-09-30T22:13:02.665479] [DEBUG] [LOCAL ] NPFD: Loaded 9812 existing records from primary storage. [2025-09-30T22:13:02.687008] [INFO ] [MAIN ] NPFD: Loaded 9812 primary data records. [2025-09-30T22:13:02.837214] [DEBUG] [LOCAL ] NOW: Loaded 48554 existing records from primary storage. [2025-09-30T22:13:02.861036] [INFO ] [MAIN ] NOW: Loaded 48554 primary data records. [2025-09-30T22:13:03.624727] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:03.625963] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16978 primary records. [2025-09-30T22:13:03.626295] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-30T22:13:03.645951] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-30T22:13:03.646089] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-30T22:13:03.647982] [INFO ] [MAIN ] Derivative Progress: 1279/2009 symbols completed. NPCT took 1.1s. Estimated remaining: 5m 1s. Rate: 145.6 symbols/min [2025-09-30T22:13:03.648388] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:03.684912] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:03.689278] [DEBUG] [LOCAL ] NPK: Loaded 8008 existing records from primary storage. [2025-09-30T22:13:03.689827] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:03.690795] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9812 primary records. [2025-09-30T22:13:03.691545] [INFO ] [MAIN ] NOW: Generated 1794 derivative records from 48554 primary records. [2025-09-30T22:13:03.691696] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-30T22:13:03.690043] [INFO ] [MAIN ] NPK: Loaded 8008 primary data records. [2025-09-30T22:13:03.690881] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-30T22:13:03.816842] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-30T22:13:03.837378] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-30T22:13:03.841575] [INFO ] [MAIN ] Derivative Progress: 1280/2009 symbols completed. NPFD took 1.3s. Estimated remaining: 5m 0s. Rate: 145.6 symbols/min [2025-09-30T22:13:03.863048] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:03.935851] [DEBUG] [LOCAL ] NOW: Derivative data saved (1794 records). [2025-09-30T22:13:04.059176] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-30T22:13:04.061854] [INFO ] [MAIN ] Derivative Progress: 1281/2009 symbols completed. NOW took 1.6s. Estimated remaining: 4m 60s. Rate: 145.7 symbols/min [2025-09-30T22:13:04.062057] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:04.069042] [DEBUG] [LOCAL ] NPO: Loaded 12939 existing records from primary storage. [2025-09-30T22:13:04.070219] [INFO ] [MAIN ] NPO: Loaded 12939 primary data records. [2025-09-30T22:13:04.167090] [DEBUG] [LOCAL ] NPV: Loaded 5075 existing records from primary storage. [2025-09-30T22:13:04.188025] [INFO ] [MAIN ] NPV: Loaded 5075 primary data records. [2025-09-30T22:13:04.747974] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:04.749914] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8008 primary records. [2025-09-30T22:13:04.750793] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-30T22:13:04.772474] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-30T22:13:04.773047] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-30T22:13:04.775372] [INFO ] [MAIN ] Derivative Progress: 1282/2009 symbols completed. NPK took 1.1s. Estimated remaining: 4m 60s. Rate: 145.6 symbols/min [2025-09-30T22:13:04.775865] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:04.800354] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:04.804275] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12939 primary records. [2025-09-30T22:13:04.805404] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-30T22:13:04.835424] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:13:04.840391] [INFO ] [MAIN ] NPV: Generated 1793 derivative records from 5075 primary records. [2025-09-30T22:13:04.841105] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-30T22:13:04.852145] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-30T22:13:04.852878] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-30T22:13:04.856035] [INFO ] [MAIN ] Derivative Progress: 1283/2009 symbols completed. NPO took 1.0s. Estimated remaining: 4m 59s. Rate: 145.7 symbols/min [2025-09-30T22:13:04.856547] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:04.889250] [DEBUG] [LOCAL ] NPWR: Loaded 42966 existing records from primary storage. [2025-09-30T22:13:04.890883] [INFO ] [MAIN ] NPWR: Loaded 42966 primary data records. [2025-09-30T22:13:04.890762] [DEBUG] [LOCAL ] NPV: Derivative data saved (1793 records). [2025-09-30T22:13:04.895353] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-30T22:13:04.895164] [DEBUG] [LOCAL ] NQP: Loaded 9297 existing records from primary storage. [2025-09-30T22:13:04.898553] [INFO ] [MAIN ] Derivative Progress: 1284/2009 symbols completed. NPV took 0.8s. Estimated remaining: 4m 58s. Rate: 145.8 symbols/min [2025-09-30T22:13:04.903954] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:04.910743] [INFO ] [MAIN ] NQP: Loaded 9297 primary data records. [2025-09-30T22:13:05.463578] [DEBUG] [LOCAL ] NRDY: Loaded 32735 existing records from primary storage. [2025-09-30T22:13:05.503554] [INFO ] [MAIN ] NRDY: Loaded 32735 primary data records. [2025-09-30T22:13:05.995413] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:13:05.996871] [INFO ] [MAIN ] NQP: Generated 1793 derivative records from 9297 primary records. [2025-09-30T22:13:06.004942] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-30T22:13:06.011051] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:06.012924] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 42966 primary records. [2025-09-30T22:13:06.013045] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-30T22:13:06.043898] [DEBUG] [LOCAL ] NQP: Derivative data saved (1793 records). [2025-09-30T22:13:06.044992] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-30T22:13:06.047567] [INFO ] [MAIN ] Derivative Progress: 1285/2009 symbols completed. NQP took 1.2s. Estimated remaining: 4m 58s. Rate: 145.6 symbols/min [2025-09-30T22:13:06.048636] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:06.050005] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-30T22:13:06.050288] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-30T22:13:06.053401] [INFO ] [MAIN ] Derivative Progress: 1286/2009 symbols completed. NPWR took 1.3s. Estimated remaining: 4m 58s. Rate: 145.7 symbols/min [2025-09-30T22:13:06.053584] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:06.074055] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:06.075015] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32735 primary records. [2025-09-30T22:13:06.075132] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-30T22:13:06.080198] [DEBUG] [LOCAL ] NREF: Loaded 7881 existing records from primary storage. [2025-09-30T22:13:06.091352] [INFO ] [MAIN ] NREF: Loaded 7881 primary data records. [2025-09-30T22:13:06.163331] [DEBUG] [LOCAL ] NRK: Loaded 19922 existing records from primary storage. [2025-09-30T22:13:06.163806] [INFO ] [MAIN ] NRK: Loaded 19922 primary data records. [2025-09-30T22:13:06.223398] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-30T22:13:06.263691] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-30T22:13:06.297506] [INFO ] [MAIN ] Derivative Progress: 1287/2009 symbols completed. NRDY took 1.4s. Estimated remaining: 4m 57s. Rate: 145.7 symbols/min [2025-09-30T22:13:06.312517] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:06.521855] [DEBUG] [LOCAL ] NRP: Loaded 4059 existing records from primary storage. [2025-09-30T22:13:06.691849] [INFO ] [MAIN ] NRP: Loaded 4059 primary data records. [2025-09-30T22:13:07.258976] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:07.261420] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19922 primary records. [2025-09-30T22:13:07.261687] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-30T22:13:07.287887] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:07.291209] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-30T22:13:07.291316] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-30T22:13:07.294120] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7881 primary records. [2025-09-30T22:13:07.294232] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-30T22:13:07.293313] [INFO ] [MAIN ] Derivative Progress: 1288/2009 symbols completed. NRK took 1.2s. Estimated remaining: 4m 57s. Rate: 145.6 symbols/min [2025-09-30T22:13:07.313693] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-30T22:13:07.326989] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:07.326757] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-30T22:13:07.329711] [INFO ] [MAIN ] Derivative Progress: 1289/2009 symbols completed. NREF took 1.3s. Estimated remaining: 4m 57s. Rate: 145.7 symbols/min [2025-09-30T22:13:07.330495] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4059 primary records. [2025-09-30T22:13:07.330562] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-30T22:13:07.345279] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-30T22:13:07.345345] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-30T22:13:07.348304] [INFO ] [MAIN ] Derivative Progress: 1290/2009 symbols completed. NRP took 1.0s. Estimated remaining: 4m 56s. Rate: 145.8 symbols/min [2025-09-30T22:13:07.348768] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:07.348843] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:07.349059] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:07.356021] [DEBUG] [LOCAL ] NRUC: Loaded 3096 existing records from primary storage. [2025-09-30T22:13:07.356278] [INFO ] [MAIN ] NRUC: Loaded 3096 primary data records. [2025-09-30T22:13:07.397372] [DEBUG] [LOCAL ] NRT: Loaded 4961 existing records from primary storage. [2025-09-30T22:13:07.438416] [INFO ] [MAIN ] NRT: Loaded 4961 primary data records. [2025-09-30T22:13:08.017902] [DEBUG] [LOCAL ] NSA: Loaded 44689 existing records from primary storage. [2025-09-30T22:13:08.024077] [INFO ] [MAIN ] NSA: Loaded 44689 primary data records. [2025-09-30T22:13:08.381792] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:08.384797] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3096 primary records. [2025-09-30T22:13:08.385496] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-30T22:13:08.413752] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:08.415488] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4961 primary records. [2025-09-30T22:13:08.416834] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-30T22:13:08.420787] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-09-30T22:13:08.433042] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-30T22:13:08.435588] [INFO ] [MAIN ] Derivative Progress: 1291/2009 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 56s. Rate: 145.6 symbols/min [2025-09-30T22:13:08.435781] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:08.439543] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-30T22:13:08.440070] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-30T22:13:08.442953] [INFO ] [MAIN ] Derivative Progress: 1292/2009 symbols completed. NRT took 1.1s. Estimated remaining: 4m 55s. Rate: 145.7 symbols/min [2025-09-30T22:13:08.443321] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:08.463325] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:08.464138] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44689 primary records. [2025-09-30T22:13:08.464352] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-30T22:13:08.489972] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-30T22:13:08.490235] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-30T22:13:08.493506] [INFO ] [MAIN ] Derivative Progress: 1293/2009 symbols completed. NSA took 1.1s. Estimated remaining: 4m 55s. Rate: 145.8 symbols/min [2025-09-30T22:13:08.493828] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:08.512428] [DEBUG] [LOCAL ] NTB: Loaded 20264 existing records from primary storage. [2025-09-30T22:13:08.512747] [INFO ] [MAIN ] NTB: Loaded 20264 primary data records. [2025-09-30T22:13:08.617069] [DEBUG] [LOCAL ] NSP: Loaded 34943 existing records from primary storage. [2025-09-30T22:13:08.644461] [INFO ] [MAIN ] NSP: Loaded 34943 primary data records. [2025-09-30T22:13:09.065522] [DEBUG] [LOCAL ] NTR: Loaded 52573 existing records from primary storage. [2025-09-30T22:13:09.121749] [INFO ] [MAIN ] NTR: Loaded 52573 primary data records. [2025-09-30T22:13:09.659325] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:09.661285] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20264 primary records. [2025-09-30T22:13:09.662529] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-30T22:13:09.693269] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:09.696314] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-30T22:13:09.697263] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34943 primary records. [2025-09-30T22:13:09.697528] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-30T22:13:09.697468] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-30T22:13:09.700214] [INFO ] [MAIN ] Derivative Progress: 1294/2009 symbols completed. NTB took 1.3s. Estimated remaining: 4m 55s. Rate: 145.6 symbols/min [2025-09-30T22:13:09.700550] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:09.720480] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-30T22:13:09.720604] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-30T22:13:09.724577] [INFO ] [MAIN ] Derivative Progress: 1295/2009 symbols completed. NSP took 1.3s. Estimated remaining: 4m 54s. Rate: 145.7 symbols/min [2025-09-30T22:13:09.724833] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:09.744842] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:09.745558] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52573 primary records. [2025-09-30T22:13:09.748639] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-30T22:13:09.766674] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-30T22:13:09.766835] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-30T22:13:09.769834] [INFO ] [MAIN ] Derivative Progress: 1296/2009 symbols completed. NTR took 1.3s. Estimated remaining: 4m 53s. Rate: 145.8 symbols/min [2025-09-30T22:13:09.779958] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:09.813539] [DEBUG] [LOCAL ] NTST: Loaded 43461 existing records from primary storage. [2025-09-30T22:13:09.813830] [INFO ] [MAIN ] NTST: Loaded 43461 primary data records. [2025-09-30T22:13:09.968482] [DEBUG] [LOCAL ] NUS: Loaded 36380 existing records from primary storage. [2025-09-30T22:13:09.974595] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-30T22:13:09.985055] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-30T22:13:09.990294] [INFO ] [MAIN ] NUS: Loaded 36380 primary data records. [2025-09-30T22:13:10.918463] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:10.919505] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43461 primary records. [2025-09-30T22:13:10.919958] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-30T22:13:10.958323] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:10.960689] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36380 primary records. [2025-09-30T22:13:10.961144] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-30T22:13:10.962566] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-30T22:13:10.973160] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-30T22:13:10.977422] [INFO ] [MAIN ] Derivative Progress: 1297/2009 symbols completed. NTST took 1.3s. Estimated remaining: 4m 53s. Rate: 145.6 symbols/min [2025-09-30T22:13:10.981991] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:10.998955] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:11.000179] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-30T22:13:11.001696] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-30T22:13:11.000454] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-30T22:13:11.006613] [INFO ] [MAIN ] Derivative Progress: 1298/2009 symbols completed. NUS took 1.2s. Estimated remaining: 4m 53s. Rate: 145.7 symbols/min [2025-09-30T22:13:11.007060] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:11.006837] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-30T22:13:11.027616] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-30T22:13:11.027816] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-30T22:13:11.030890] [INFO ] [MAIN ] Derivative Progress: 1299/2009 symbols completed. NU took 1.3s. Estimated remaining: 4m 52s. Rate: 145.8 symbols/min [2025-09-30T22:13:11.031361] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:11.050071] [DEBUG] [LOCAL ] NUV: Loaded 23385 existing records from primary storage. [2025-09-30T22:13:11.050234] [INFO ] [MAIN ] NUV: Loaded 23385 primary data records. [2025-09-30T22:13:11.234540] [DEBUG] [LOCAL ] NVG: Loaded 27446 existing records from primary storage. [2025-09-30T22:13:11.272235] [DEBUG] [LOCAL ] NUVB: Loaded 51245 existing records from primary storage. [2025-09-30T22:13:11.272410] [INFO ] [MAIN ] NVG: Loaded 27446 primary data records. [2025-09-30T22:13:11.306388] [INFO ] [MAIN ] NUVB: Loaded 51245 primary data records. [2025-09-30T22:13:12.245491] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:12.246495] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23385 primary records. [2025-09-30T22:13:12.247306] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-30T22:13:12.271840] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-30T22:13:12.272218] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-30T22:13:12.274458] [INFO ] [MAIN ] Derivative Progress: 1300/2009 symbols completed. NUV took 1.3s. Estimated remaining: 4m 52s. Rate: 145.6 symbols/min [2025-09-30T22:13:12.274927] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:12.289206] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:12.290609] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51245 primary records. [2025-09-30T22:13:12.291108] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-30T22:13:12.332346] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:12.334484] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27446 primary records. [2025-09-30T22:13:12.342891] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-30T22:13:12.343004] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-30T22:13:12.346007] [INFO ] [MAIN ] Derivative Progress: 1301/2009 symbols completed. NUVB took 1.3s. Estimated remaining: 4m 52s. Rate: 145.7 symbols/min [2025-09-30T22:13:12.346320] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:12.342781] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-30T22:13:12.382221] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-30T22:13:12.383246] [DEBUG] [LOCAL ] NVGS: Loaded 30770 existing records from primary storage. [2025-09-30T22:13:12.382429] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-30T22:13:12.387272] [INFO ] [MAIN ] Derivative Progress: 1302/2009 symbols completed. NVG took 1.4s. Estimated remaining: 4m 51s. Rate: 145.8 symbols/min [2025-09-30T22:13:12.387788] [INFO ] [MAIN ] NVGS: Loaded 30770 primary data records. [2025-09-30T22:13:12.387625] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:12.762268] [DEBUG] [LOCAL ] NVRI: Loaded 38693 existing records from primary storage. [2025-09-30T22:13:12.774755] [INFO ] [MAIN ] NVRI: Loaded 38693 primary data records. [2025-09-30T22:13:12.781067] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-30T22:13:12.811474] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-30T22:13:13.456552] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:13.458590] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 30770 primary records. [2025-09-30T22:13:13.459044] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-30T22:13:13.482952] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-30T22:13:13.483101] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-30T22:13:13.486088] [INFO ] [MAIN ] Derivative Progress: 1303/2009 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 51s. Rate: 145.6 symbols/min [2025-09-30T22:13:13.510663] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:13.525204] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-30T22:13:13.525889] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-30T22:13:13.525680] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:13.528025] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38693 primary records. [2025-09-30T22:13:13.528424] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-30T22:13:13.558379] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-30T22:13:13.558807] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-30T22:13:13.561565] [INFO ] [MAIN ] Derivative Progress: 1304/2009 symbols completed. NVRI took 1.2s. Estimated remaining: 4m 50s. Rate: 145.7 symbols/min [2025-09-30T22:13:13.565263] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-30T22:13:13.565334] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-30T22:13:13.567807] [INFO ] [MAIN ] Derivative Progress: 1305/2009 symbols completed. NVO took 1.2s. Estimated remaining: 4m 50s. Rate: 145.8 symbols/min [2025-09-30T22:13:13.568524] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:13.568413] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:13.572633] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:13.649162] [DEBUG] [LOCAL ] NVT: Loaded 51509 existing records from primary storage. [2025-09-30T22:13:13.649397] [INFO ] [MAIN ] NVT: Loaded 51509 primary data records. [2025-09-30T22:13:13.800137] [DEBUG] [LOCAL ] NVS: Loaded 51548 existing records from primary storage. [2025-09-30T22:13:13.775373] [DEBUG] [LOCAL ] NVST: Loaded 51607 existing records from primary storage. [2025-09-30T22:13:13.811721] [INFO ] [MAIN ] NVST: Loaded 51607 primary data records. [2025-09-30T22:13:13.811912] [INFO ] [MAIN ] NVS: Loaded 51548 primary data records. [2025-09-30T22:13:14.733623] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:14.734895] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51509 primary records. [2025-09-30T22:13:14.735937] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-30T22:13:14.765568] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:14.767768] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51607 primary records. [2025-09-30T22:13:14.768706] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-30T22:13:14.787117] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-30T22:13:14.803115] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-30T22:13:14.803505] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:14.802827] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-30T22:13:14.805734] [INFO ] [MAIN ] Derivative Progress: 1306/2009 symbols completed. NVT took 1.2s. Estimated remaining: 4m 50s. Rate: 145.6 symbols/min [2025-09-30T22:13:14.806707] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-30T22:13:14.806509] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51548 primary records. [2025-09-30T22:13:14.806898] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:14.807071] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-30T22:13:14.810242] [INFO ] [MAIN ] Derivative Progress: 1307/2009 symbols completed. NVST took 1.2s. Estimated remaining: 4m 49s. Rate: 145.7 symbols/min [2025-09-30T22:13:14.810524] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:14.829458] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-30T22:13:14.829577] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-30T22:13:14.832307] [INFO ] [MAIN ] Derivative Progress: 1308/2009 symbols completed. NVS took 1.3s. Estimated remaining: 4m 49s. Rate: 145.8 symbols/min [2025-09-30T22:13:14.832527] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:14.868170] [DEBUG] [LOCAL ] NWN: Loaded 26736 existing records from primary storage. [2025-09-30T22:13:14.868374] [INFO ] [MAIN ] NWN: Loaded 26736 primary data records. [2025-09-30T22:13:15.021983] [DEBUG] [LOCAL ] NX: Loaded 33148 existing records from primary storage. [2025-09-30T22:13:15.023166] [DEBUG] [LOCAL ] NWG: Loaded 51523 existing records from primary storage. [2025-09-30T22:13:15.033993] [INFO ] [MAIN ] NX: Loaded 33148 primary data records. [2025-09-30T22:13:15.028779] [INFO ] [MAIN ] NWG: Loaded 51523 primary data records. [2025-09-30T22:13:15.985885] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:15.987015] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26736 primary records. [2025-09-30T22:13:15.987127] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-30T22:13:16.021917] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-30T22:13:16.021305] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:16.022154] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-30T22:13:16.023096] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33148 primary records. [2025-09-30T22:13:16.023284] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-30T22:13:16.027531] [INFO ] [MAIN ] Derivative Progress: 1309/2009 symbols completed. NWN took 1.2s. Estimated remaining: 4m 49s. Rate: 145.6 symbols/min [2025-09-30T22:13:16.035955] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:16.056890] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:16.058263] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51523 primary records. [2025-09-30T22:13:16.061274] [DEBUG] [LOCAL ] NXC: Loaded 4191 existing records from primary storage. [2025-09-30T22:13:16.061663] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-30T22:13:16.061611] [INFO ] [MAIN ] NXC: Loaded 4191 primary data records. [2025-09-30T22:13:16.146896] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-30T22:13:16.164841] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-30T22:13:16.173148] [INFO ] [MAIN ] Derivative Progress: 1310/2009 symbols completed. NX took 1.3s. Estimated remaining: 4m 48s. Rate: 145.6 symbols/min [2025-09-30T22:13:16.180430] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:16.402184] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-30T22:13:16.414788] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-30T22:13:16.417783] [INFO ] [MAIN ] Derivative Progress: 1311/2009 symbols completed. NWG took 1.6s. Estimated remaining: 4m 47s. Rate: 145.7 symbols/min [2025-09-30T22:13:16.418367] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:16.427437] [DEBUG] [LOCAL ] NXDT: Loaded 16164 existing records from primary storage. [2025-09-30T22:13:16.428128] [INFO ] [MAIN ] NXDT: Loaded 16164 primary data records. [2025-09-30T22:13:16.781824] [DEBUG] [LOCAL ] NXE: Loaded 52986 existing records from primary storage. [2025-09-30T22:13:16.782571] [INFO ] [MAIN ] NXE: Loaded 52986 primary data records. [2025-09-30T22:13:16.820113] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:16.887280] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4191 primary records. [2025-09-30T22:13:16.912682] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-30T22:13:17.143119] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-30T22:13:17.144122] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-30T22:13:17.147175] [INFO ] [MAIN ] Derivative Progress: 1312/2009 symbols completed. NXC took 1.1s. Estimated remaining: 4m 47s. Rate: 145.6 symbols/min [2025-09-30T22:13:17.148363] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:17.163224] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:17.164914] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16164 primary records. [2025-09-30T22:13:17.165090] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-30T22:13:17.189603] [DEBUG] [LOCAL ] NXG: Loaded 10416 existing records from primary storage. [2025-09-30T22:13:17.190260] [INFO ] [MAIN ] NXG: Loaded 10416 primary data records. [2025-09-30T22:13:17.281225] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-30T22:13:17.317761] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-30T22:13:17.357975] [INFO ] [MAIN ] Derivative Progress: 1313/2009 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 47s. Rate: 145.7 symbols/min [2025-09-30T22:13:17.515026] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:17.544234] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:17.545263] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52986 primary records. [2025-09-30T22:13:17.545470] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-30T22:13:17.570920] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-30T22:13:17.571791] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-30T22:13:17.575530] [INFO ] [MAIN ] Derivative Progress: 1314/2009 symbols completed. NXE took 1.2s. Estimated remaining: 4m 46s. Rate: 145.7 symbols/min [2025-09-30T22:13:17.581291] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:17.581750] [DEBUG] [LOCAL ] NXJ: Loaded 14895 existing records from primary storage. [2025-09-30T22:13:17.582075] [INFO ] [MAIN ] NXJ: Loaded 14895 primary data records. [2025-09-30T22:13:17.671833] [DEBUG] [LOCAL ] NXN: Loaded 2330 existing records from primary storage. [2025-09-30T22:13:17.682760] [INFO ] [MAIN ] NXN: Loaded 2330 primary data records. [2025-09-30T22:13:17.949502] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:18.047451] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10416 primary records. [2025-09-30T22:13:18.070557] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-30T22:13:18.330014] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-30T22:13:18.330544] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-30T22:13:18.332828] [INFO ] [MAIN ] Derivative Progress: 1315/2009 symbols completed. NXG took 1.2s. Estimated remaining: 4m 46s. Rate: 145.6 symbols/min [2025-09-30T22:13:18.333144] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:18.360577] [DEBUG] [LOCAL ] NXP: Loaded 12397 existing records from primary storage. [2025-09-30T22:13:18.361258] [INFO ] [MAIN ] NXP: Loaded 12397 primary data records. [2025-09-30T22:13:18.496183] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:18.537693] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14895 primary records. [2025-09-30T22:13:18.639692] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-30T22:13:18.707523] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:18.709905] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2330 primary records. [2025-09-30T22:13:18.717294] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-30T22:13:18.738408] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-30T22:13:18.739454] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-30T22:13:18.744051] [INFO ] [MAIN ] Derivative Progress: 1316/2009 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 46s. Rate: 145.6 symbols/min [2025-09-30T22:13:18.744366] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:18.745850] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-30T22:13:18.746436] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-30T22:13:18.749441] [INFO ] [MAIN ] Derivative Progress: 1317/2009 symbols completed. NXN took 1.2s. Estimated remaining: 4m 45s. Rate: 145.7 symbols/min [2025-09-30T22:13:18.749712] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:18.786912] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:18.787744] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12397 primary records. [2025-09-30T22:13:18.787850] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-30T22:13:18.788774] [DEBUG] [LOCAL ] NXRT: Loaded 19076 existing records from primary storage. [2025-09-30T22:13:18.789060] [INFO ] [MAIN ] NXRT: Loaded 19076 primary data records. [2025-09-30T22:13:18.933844] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-30T22:13:18.934125] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-30T22:13:18.936679] [INFO ] [MAIN ] Derivative Progress: 1318/2009 symbols completed. NXP took 0.6s. Estimated remaining: 4m 44s. Rate: 145.8 symbols/min [2025-09-30T22:13:18.996471] [DEBUG] [LOCAL ] NYT: Loaded 49842 existing records from primary storage. [2025-09-30T22:13:19.010245] [INFO ] [MAIN ] NYT: Loaded 49842 primary data records. [2025-09-30T22:13:19.496235] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:19.497043] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 19076 primary records. [2025-09-30T22:13:19.497214] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-30T22:13:19.513835] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-30T22:13:19.513949] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-30T22:13:19.516015] [INFO ] [MAIN ] Derivative Progress: 1319/2009 symbols completed. NXRT took 0.8s. Estimated remaining: 4m 44s. Rate: 145.7 symbols/min [2025-09-30T22:13:19.534995] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:19.535916] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49842 primary records. [2025-09-30T22:13:19.536008] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-30T22:13:19.561291] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-30T22:13:19.561411] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-30T22:13:19.564819] [INFO ] [MAIN ] Derivative Progress: 1320/2009 symbols completed. NYT took 0.8s. Estimated remaining: 4m 43s. Rate: 145.8 symbols/min [2025-09-30T22:13:19.565227] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:19.565336] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:19.565399] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:19.599931] [DEBUG] [LOCAL ] OBK: Loaded 16175 existing records from primary storage. [2025-09-30T22:13:19.600114] [INFO ] [MAIN ] OBK: Loaded 16175 primary data records. [2025-09-30T22:13:19.732295] [DEBUG] [LOCAL ] NZF: Loaded 28940 existing records from primary storage. [2025-09-30T22:13:19.753830] [DEBUG] [LOCAL ] OBDC: Loaded 51656 existing records from primary storage. [2025-09-30T22:13:19.752526] [INFO ] [MAIN ] NZF: Loaded 28940 primary data records. [2025-09-30T22:13:19.769747] [INFO ] [MAIN ] OBDC: Loaded 51656 primary data records. [2025-09-30T22:13:20.668495] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:20.669352] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16175 primary records. [2025-09-30T22:13:20.669737] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-30T22:13:20.703360] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-30T22:13:20.704301] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-30T22:13:20.707006] [INFO ] [MAIN ] Derivative Progress: 1321/2009 symbols completed. OBK took 1.1s. Estimated remaining: 4m 43s. Rate: 145.6 symbols/min [2025-09-30T22:13:20.707723] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:20.707609] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:20.723086] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 28940 primary records. [2025-09-30T22:13:20.722344] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:20.723284] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-30T22:13:20.724314] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51656 primary records. [2025-09-30T22:13:20.724635] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-30T22:13:20.753800] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-30T22:13:20.754858] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-30T22:13:20.757416] [INFO ] [MAIN ] Derivative Progress: 1322/2009 symbols completed. NZF took 1.2s. Estimated remaining: 4m 43s. Rate: 145.7 symbols/min [2025-09-30T22:13:20.757959] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:20.761046] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-30T22:13:20.761337] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-30T22:13:20.764138] [INFO ] [MAIN ] Derivative Progress: 1323/2009 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 42s. Rate: 145.8 symbols/min [2025-09-30T22:13:20.764434] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:20.773048] [DEBUG] [LOCAL ] OCFT: Loaded 8374 existing records from primary storage. [2025-09-30T22:13:20.773159] [INFO ] [MAIN ] OCFT: Loaded 8374 primary data records. [2025-09-30T22:13:20.876980] [DEBUG] [LOCAL ] ODC: Loaded 8422 existing records from primary storage. [2025-09-30T22:13:20.916555] [INFO ] [MAIN ] ODC: Loaded 8422 primary data records. [2025-09-30T22:13:20.950007] [DEBUG] [LOCAL ] OC: Loaded 44563 existing records from primary storage. [2025-09-30T22:13:20.979443] [INFO ] [MAIN ] OC: Loaded 44563 primary data records. [2025-09-30T22:13:21.953562] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:21.954938] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 8374 primary records. [2025-09-30T22:13:21.958035] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-30T22:13:21.991678] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:21.992611] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8422 primary records. [2025-09-30T22:13:21.992719] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-30T22:13:22.017290] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-30T22:13:22.017502] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-30T22:13:22.020382] [INFO ] [MAIN ] Derivative Progress: 1324/2009 symbols completed. OCFT took 1.3s. Estimated remaining: 4m 42s. Rate: 145.6 symbols/min [2025-09-30T22:13:22.021870] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:22.028185] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-30T22:13:22.031283] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-30T22:13:22.036465] [INFO ] [MAIN ] Derivative Progress: 1325/2009 symbols completed. ODC took 1.3s. Estimated remaining: 4m 42s. Rate: 145.7 symbols/min [2025-09-30T22:13:22.037056] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:22.068884] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:22.069792] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44563 primary records. [2025-09-30T22:13:22.070012] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-30T22:13:22.106581] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-30T22:13:22.106911] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-30T22:13:22.110462] [INFO ] [MAIN ] Derivative Progress: 1326/2009 symbols completed. OC took 1.4s. Estimated remaining: 4m 41s. Rate: 145.8 symbols/min [2025-09-30T22:13:22.110794] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:22.112824] [DEBUG] [LOCAL ] ODV: Loaded 26643 existing records from primary storage. [2025-09-30T22:13:22.113546] [INFO ] [MAIN ] ODV: Loaded 26643 primary data records. [2025-09-30T22:13:22.297284] [DEBUG] [LOCAL ] OEC: Loaded 37119 existing records from primary storage. [2025-09-30T22:13:22.338741] [INFO ] [MAIN ] OEC: Loaded 37119 primary data records. [2025-09-30T22:13:22.341968] [DEBUG] [LOCAL ] OFG: Loaded 21598 existing records from primary storage. [2025-09-30T22:13:22.342571] [INFO ] [MAIN ] OFG: Loaded 21598 primary data records. [2025-09-30T22:13:23.325890] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:23.326928] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 26643 primary records. [2025-09-30T22:13:23.327198] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-30T22:13:23.358905] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:23.360900] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37119 primary records. [2025-09-30T22:13:23.361898] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-30T22:13:23.391761] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-30T22:13:23.390354] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:23.392472] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-30T22:13:23.394950] [INFO ] [MAIN ] Derivative Progress: 1327/2009 symbols completed. ODV took 1.4s. Estimated remaining: 4m 41s. Rate: 145.6 symbols/min [2025-09-30T22:13:23.395559] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:23.396919] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 21598 primary records. [2025-09-30T22:13:23.397957] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-30T22:13:23.397278] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-30T22:13:23.398092] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-30T22:13:23.400698] [INFO ] [MAIN ] Derivative Progress: 1328/2009 symbols completed. OEC took 1.4s. Estimated remaining: 4m 40s. Rate: 145.7 symbols/min [2025-09-30T22:13:23.402302] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:23.418609] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-30T22:13:23.418795] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-30T22:13:23.421926] [INFO ] [MAIN ] Derivative Progress: 1329/2009 symbols completed. OFG took 1.3s. Estimated remaining: 4m 40s. Rate: 145.8 symbols/min [2025-09-30T22:13:23.422105] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:23.467975] [DEBUG] [LOCAL ] OGE: Loaded 46316 existing records from primary storage. [2025-09-30T22:13:23.481269] [INFO ] [MAIN ] OGE: Loaded 46316 primary data records. [2025-09-30T22:13:23.542911] [DEBUG] [LOCAL ] OGS: Loaded 34179 existing records from primary storage. [2025-09-30T22:13:23.551289] [INFO ] [MAIN ] OGS: Loaded 34179 primary data records. [2025-09-30T22:13:23.662524] [DEBUG] [LOCAL ] OGN: Loaded 53097 existing records from primary storage. [2025-09-30T22:13:23.669706] [INFO ] [MAIN ] OGN: Loaded 53097 primary data records. [2025-09-30T22:13:24.515947] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:24.530569] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 34179 primary records. [2025-09-30T22:13:24.531016] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:24.532012] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46316 primary records. [2025-09-30T22:13:24.532206] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-30T22:13:24.532162] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-30T22:13:24.570331] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-30T22:13:24.570508] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-30T22:13:24.573471] [INFO ] [MAIN ] Derivative Progress: 1330/2009 symbols completed. OGS took 1.2s. Estimated remaining: 4m 40s. Rate: 145.6 symbols/min [2025-09-30T22:13:24.574340] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:24.574975] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-09-30T22:13:24.575257] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-30T22:13:24.577539] [INFO ] [MAIN ] Derivative Progress: 1331/2009 symbols completed. OGE took 1.2s. Estimated remaining: 4m 39s. Rate: 145.7 symbols/min [2025-09-30T22:13:24.577793] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:24.591584] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:24.592498] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53097 primary records. [2025-09-30T22:13:24.592691] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-30T22:13:24.610013] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-30T22:13:24.610153] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-30T22:13:24.613260] [INFO ] [MAIN ] Derivative Progress: 1332/2009 symbols completed. OGN took 1.2s. Estimated remaining: 4m 39s. Rate: 145.8 symbols/min [2025-09-30T22:13:24.613730] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:24.653860] [DEBUG] [LOCAL ] OIA: Loaded 13804 existing records from primary storage. [2025-09-30T22:13:24.654042] [INFO ] [MAIN ] OIA: Loaded 13804 primary data records. [2025-09-30T22:13:24.798746] [DEBUG] [LOCAL ] OHI: Loaded 51989 existing records from primary storage. [2025-09-30T22:13:24.797416] [DEBUG] [LOCAL ] OI: Loaded 47157 existing records from primary storage. [2025-09-30T22:13:24.799409] [INFO ] [MAIN ] OI: Loaded 47157 primary data records. [2025-09-30T22:13:24.799602] [INFO ] [MAIN ] OHI: Loaded 51989 primary data records. [2025-09-30T22:13:25.723177] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:25.724091] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13804 primary records. [2025-09-30T22:13:25.724409] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-30T22:13:25.743408] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-30T22:13:25.757301] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:25.756971] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-30T22:13:25.758425] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47157 primary records. [2025-09-30T22:13:25.761314] [INFO ] [MAIN ] Derivative Progress: 1333/2009 symbols completed. OIA took 1.1s. Estimated remaining: 4m 39s. Rate: 145.6 symbols/min [2025-09-30T22:13:25.761476] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-30T22:13:25.793274] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:25.795391] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 51989 primary records. [2025-09-30T22:13:25.795260] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-30T22:13:25.795603] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-30T22:13:25.796437] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-30T22:13:25.800173] [INFO ] [MAIN ] Derivative Progress: 1334/2009 symbols completed. OI took 1.2s. Estimated remaining: 4m 38s. Rate: 145.7 symbols/min [2025-09-30T22:13:25.815816] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-30T22:13:25.815935] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-30T22:13:25.818627] [INFO ] [MAIN ] Derivative Progress: 1335/2009 symbols completed. OHI took 1.2s. Estimated remaining: 4m 37s. Rate: 145.8 symbols/min [2025-09-30T22:13:25.819245] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:25.819168] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:25.819335] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:25.884317] [DEBUG] [LOCAL ] OII: Loaded 42500 existing records from primary storage. [2025-09-30T22:13:25.884490] [INFO ] [MAIN ] OII: Loaded 42500 primary data records. [2025-09-30T22:13:26.005892] [DEBUG] [LOCAL ] OIS: Loaded 40448 existing records from primary storage. [2025-09-30T22:13:26.033222] [DEBUG] [LOCAL ] OLN: Loaded 51761 existing records from primary storage. [2025-09-30T22:13:26.032034] [INFO ] [MAIN ] OIS: Loaded 40448 primary data records. [2025-09-30T22:13:26.054289] [INFO ] [MAIN ] OLN: Loaded 51761 primary data records. [2025-09-30T22:13:26.975409] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:26.979703] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 42500 primary records. [2025-09-30T22:13:26.979972] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-30T22:13:27.023343] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-30T22:13:27.012981] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:27.028118] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-30T22:13:27.030411] [INFO ] [MAIN ] Derivative Progress: 1336/2009 symbols completed. OII took 1.2s. Estimated remaining: 4m 37s. Rate: 145.6 symbols/min [2025-09-30T22:13:27.031867] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40448 primary records. [2025-09-30T22:13:27.032053] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:27.032303] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-30T22:13:27.030853] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:27.034582] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51761 primary records. [2025-09-30T22:13:27.035103] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-30T22:13:27.066517] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-30T22:13:27.067832] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-30T22:13:27.072598] [INFO ] [MAIN ] Derivative Progress: 1337/2009 symbols completed. OIS took 1.3s. Estimated remaining: 4m 37s. Rate: 145.7 symbols/min [2025-09-30T22:13:27.078799] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:27.078319] [DEBUG] [LOCAL ] OLP: Loaded 9868 existing records from primary storage. [2025-09-30T22:13:27.080741] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-30T22:13:27.080912] [INFO ] [MAIN ] OLP: Loaded 9868 primary data records. [2025-09-30T22:13:27.081098] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-30T22:13:27.089056] [INFO ] [MAIN ] Derivative Progress: 1338/2009 symbols completed. OLN took 1.3s. Estimated remaining: 4m 36s. Rate: 145.8 symbols/min [2025-09-30T22:13:27.089217] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:27.449701] [DEBUG] [LOCAL ] OMF: Loaded 46163 existing records from primary storage. [2025-09-30T22:13:27.450842] [INFO ] [MAIN ] OMF: Loaded 46163 primary data records. [2025-09-30T22:13:27.451615] [DEBUG] [LOCAL ] OMI: Loaded 45815 existing records from primary storage. [2025-09-30T22:13:27.510478] [INFO ] [MAIN ] OMI: Loaded 45815 primary data records. [2025-09-30T22:13:28.115878] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:28.117195] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9868 primary records. [2025-09-30T22:13:28.117421] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-30T22:13:28.139076] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-30T22:13:28.140016] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-30T22:13:28.142329] [INFO ] [MAIN ] Derivative Progress: 1339/2009 symbols completed. OLP took 1.1s. Estimated remaining: 4m 36s. Rate: 145.6 symbols/min [2025-09-30T22:13:28.142822] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:28.171147] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:28.170816] [DEBUG] [LOCAL ] ONIT: Loaded 7735 existing records from primary storage. [2025-09-30T22:13:28.172254] [INFO ] [MAIN ] ONIT: Loaded 7735 primary data records. [2025-09-30T22:13:28.172097] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46163 primary records. [2025-09-30T22:13:28.173230] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-30T22:13:28.294308] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:28.321321] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-30T22:13:28.320305] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45815 primary records. [2025-09-30T22:13:28.321461] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-30T22:13:28.321902] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-30T22:13:28.340980] [INFO ] [MAIN ] Derivative Progress: 1340/2009 symbols completed. OMF took 1.3s. Estimated remaining: 4m 36s. Rate: 145.7 symbols/min [2025-09-30T22:13:28.368334] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:28.422897] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-30T22:13:28.429690] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-30T22:13:28.433246] [INFO ] [MAIN ] Derivative Progress: 1341/2009 symbols completed. OMI took 1.3s. Estimated remaining: 4m 35s. Rate: 145.8 symbols/min [2025-09-30T22:13:28.512785] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:28.598615] [DEBUG] [LOCAL ] ONL: Loaded 30730 existing records from primary storage. [2025-09-30T22:13:28.598812] [INFO ] [MAIN ] ONL: Loaded 30730 primary data records. [2025-09-30T22:13:28.755890] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:28.758042] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7735 primary records. [2025-09-30T22:13:28.758691] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-30T22:13:28.843846] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-09-30T22:13:28.867843] [INFO ] [MAIN ] ONON: Loaded 53612 primary data records. [2025-09-30T22:13:29.011988] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-30T22:13:29.047440] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-30T22:13:29.071058] [INFO ] [MAIN ] Derivative Progress: 1342/2009 symbols completed. ONIT took 0.9s. Estimated remaining: 4m 35s. Rate: 145.7 symbols/min [2025-09-30T22:13:29.098505] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:29.374216] [DEBUG] [LOCAL ] ONTF: Loaded 22578 existing records from primary storage. [2025-09-30T22:13:29.374597] [INFO ] [MAIN ] ONTF: Loaded 22578 primary data records. [2025-09-30T22:13:29.602392] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:29.610196] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 30730 primary records. [2025-09-30T22:13:29.735497] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-30T22:13:29.770172] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-30T22:13:29.770680] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-30T22:13:29.785868] [INFO ] [MAIN ] Derivative Progress: 1343/2009 symbols completed. ONL took 1.4s. Estimated remaining: 4m 34s. Rate: 145.6 symbols/min [2025-09-30T22:13:29.787510] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:29.788071] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:29.789674] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53612 primary records. [2025-09-30T22:13:29.789808] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-30T22:13:29.809381] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-30T22:13:29.809667] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-30T22:13:29.811706] [INFO ] [MAIN ] Derivative Progress: 1344/2009 symbols completed. ONON took 1.3s. Estimated remaining: 4m 34s. Rate: 145.7 symbols/min [2025-09-30T22:13:29.812039] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:29.831315] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:29.832188] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22578 primary records. [2025-09-30T22:13:29.832379] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-30T22:13:29.863745] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-30T22:13:29.870691] [DEBUG] [LOCAL ] OOMA: Loaded 18846 existing records from primary storage. [2025-09-30T22:13:29.871001] [INFO ] [MAIN ] OOMA: Loaded 18846 primary data records. [2025-09-30T22:13:29.870906] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-30T22:13:29.885506] [INFO ] [MAIN ] Derivative Progress: 1345/2009 symbols completed. ONTF took 0.8s. Estimated remaining: 4m 33s. Rate: 145.8 symbols/min [2025-09-30T22:13:29.925178] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:30.003978] [DEBUG] [LOCAL ] ONTO: Loaded 46658 existing records from primary storage. [2025-09-30T22:13:30.004242] [INFO ] [MAIN ] ONTO: Loaded 46658 primary data records. [2025-09-30T22:13:30.364226] [DEBUG] [LOCAL ] OPAD: Loaded 21396 existing records from primary storage. [2025-09-30T22:13:30.387405] [INFO ] [MAIN ] OPAD: Loaded 21396 primary data records. [2025-09-30T22:13:30.937687] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:30.938880] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 18846 primary records. [2025-09-30T22:13:30.939029] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-30T22:13:30.974817] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:30.976680] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-30T22:13:30.977588] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46658 primary records. [2025-09-30T22:13:30.978132] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-30T22:13:30.978347] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-30T22:13:30.980323] [INFO ] [MAIN ] Derivative Progress: 1346/2009 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 33s. Rate: 145.6 symbols/min [2025-09-30T22:13:30.981665] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:31.015799] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-30T22:13:31.028629] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-30T22:13:31.032861] [INFO ] [MAIN ] Derivative Progress: 1347/2009 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 33s. Rate: 145.7 symbols/min [2025-09-30T22:13:31.033257] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:31.033673] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:31.034683] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 21396 primary records. [2025-09-30T22:13:31.035313] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-30T22:13:31.065212] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-30T22:13:31.065394] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-30T22:13:31.068235] [INFO ] [MAIN ] Derivative Progress: 1348/2009 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 32s. Rate: 145.8 symbols/min [2025-09-30T22:13:31.074877] [DEBUG] [LOCAL ] OPP: Loaded 11643 existing records from primary storage. [2025-09-30T22:13:31.075043] [INFO ] [MAIN ] OPP: Loaded 11643 primary data records. [2025-09-30T22:13:31.209106] [DEBUG] [LOCAL ] OPFI: Loaded 46477 existing records from primary storage. [2025-09-30T22:13:31.220222] [INFO ] [MAIN ] OPFI: Loaded 46477 primary data records. [2025-09-30T22:13:31.797907] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:31.798955] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11643 primary records. [2025-09-30T22:13:31.799174] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-30T22:13:31.821992] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-09-30T22:13:31.822299] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-30T22:13:31.824961] [INFO ] [MAIN ] Derivative Progress: 1349/2009 symbols completed. OPP took 0.8s. Estimated remaining: 4m 32s. Rate: 145.7 symbols/min [2025-09-30T22:13:31.839617] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:13:31.840309] [INFO ] [MAIN ] OPFI: Generated 1793 derivative records from 46477 primary records. [2025-09-30T22:13:31.840372] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-30T22:13:31.856789] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1793 records). [2025-09-30T22:13:31.856883] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-30T22:13:31.859976] [INFO ] [MAIN ] Derivative Progress: 1350/2009 symbols completed. OPFI took 0.9s. Estimated remaining: 4m 31s. Rate: 145.8 symbols/min [2025-09-30T22:13:31.860725] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:31.860590] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:31.861206] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:31.912720] [DEBUG] [LOCAL ] ORA: Loaded 32445 existing records from primary storage. [2025-09-30T22:13:31.912960] [INFO ] [MAIN ] ORA: Loaded 32445 primary data records. [2025-09-30T22:13:32.050625] [DEBUG] [LOCAL ] OR: Loaded 46074 existing records from primary storage. [2025-09-30T22:13:32.076852] [INFO ] [MAIN ] OR: Loaded 46074 primary data records. [2025-09-30T22:13:32.103781] [DEBUG] [LOCAL ] ORC: Loaded 52357 existing records from primary storage. [2025-09-30T22:13:32.164074] [INFO ] [MAIN ] ORC: Loaded 52357 primary data records. [2025-09-30T22:13:33.046159] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:33.047218] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32445 primary records. [2025-09-30T22:13:33.047604] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-30T22:13:33.080914] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:33.081497] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-30T22:13:33.081613] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-30T22:13:33.084239] [INFO ] [MAIN ] Derivative Progress: 1351/2009 symbols completed. ORA took 1.2s. Estimated remaining: 4m 31s. Rate: 145.6 symbols/min [2025-09-30T22:13:33.084421] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:33.086800] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46074 primary records. [2025-09-30T22:13:33.088567] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-30T22:13:33.114455] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:33.116699] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52357 primary records. [2025-09-30T22:13:33.117072] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-30T22:13:33.128033] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-30T22:13:33.129052] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-30T22:13:33.134537] [INFO ] [MAIN ] Derivative Progress: 1352/2009 symbols completed. OR took 1.3s. Estimated remaining: 4m 31s. Rate: 145.7 symbols/min [2025-09-30T22:13:33.136810] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:33.148422] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-30T22:13:33.148602] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-30T22:13:33.151725] [INFO ] [MAIN ] Derivative Progress: 1353/2009 symbols completed. ORC took 1.3s. Estimated remaining: 4m 30s. Rate: 145.8 symbols/min [2025-09-30T22:13:33.152006] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:33.164444] [DEBUG] [LOCAL ] ORN: Loaded 31091 existing records from primary storage. [2025-09-30T22:13:33.164638] [INFO ] [MAIN ] ORN: Loaded 31091 primary data records. [2025-09-30T22:13:33.564097] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-30T22:13:33.565991] [INFO ] [MAIN ] OSCR: Loaded 53722 primary data records. [2025-09-30T22:13:33.668088] [DEBUG] [LOCAL ] OUT: Loaded 47822 existing records from primary storage. [2025-09-30T22:13:33.699969] [INFO ] [MAIN ] OUT: Loaded 47822 primary data records. [2025-09-30T22:13:34.246876] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:34.247776] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31091 primary records. [2025-09-30T22:13:34.248282] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-30T22:13:34.267524] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-30T22:13:34.268054] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-30T22:13:34.270515] [INFO ] [MAIN ] Derivative Progress: 1354/2009 symbols completed. ORN took 1.2s. Estimated remaining: 4m 30s. Rate: 145.6 symbols/min [2025-09-30T22:13:34.271021] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:34.292985] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:34.293790] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53722 primary records. [2025-09-30T22:13:34.293878] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-30T22:13:34.315499] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-30T22:13:34.315863] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-30T22:13:34.325434] [INFO ] [MAIN ] Derivative Progress: 1355/2009 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 29s. Rate: 145.7 symbols/min [2025-09-30T22:13:34.330997] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:34.331126] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:34.332141] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 47822 primary records. [2025-09-30T22:13:34.332421] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-30T22:13:34.363131] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-30T22:13:34.363284] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-30T22:13:34.366058] [INFO ] [MAIN ] Derivative Progress: 1356/2009 symbols completed. OUT took 1.2s. Estimated remaining: 4m 29s. Rate: 145.8 symbols/min [2025-09-30T22:13:34.366335] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:34.384213] [DEBUG] [LOCAL ] OVV: Loaded 53519 existing records from primary storage. [2025-09-30T22:13:34.384563] [INFO ] [MAIN ] OVV: Loaded 53519 primary data records. [2025-09-30T22:13:34.461427] [DEBUG] [LOCAL ] OWLT: Loaded 8831 existing records from primary storage. [2025-09-30T22:13:34.491739] [INFO ] [MAIN ] OWLT: Loaded 8831 primary data records. [2025-09-30T22:13:34.916764] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-30T22:13:34.941104] [INFO ] [MAIN ] OWL: Loaded 53555 primary data records. [2025-09-30T22:13:35.460472] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:35.461952] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53519 primary records. [2025-09-30T22:13:35.463275] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-30T22:13:35.493964] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:35.495561] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8831 primary records. [2025-09-30T22:13:35.496343] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-30T22:13:35.506087] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-30T22:13:35.506195] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-30T22:13:35.512033] [INFO ] [MAIN ] Derivative Progress: 1357/2009 symbols completed. OVV took 1.2s. Estimated remaining: 4m 29s. Rate: 145.6 symbols/min [2025-09-30T22:13:35.512625] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:35.521088] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-30T22:13:35.521369] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-30T22:13:35.523660] [INFO ] [MAIN ] Derivative Progress: 1358/2009 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 28s. Rate: 145.8 symbols/min [2025-09-30T22:13:35.537830] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:35.538378] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:35.539297] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53555 primary records. [2025-09-30T22:13:35.539472] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-30T22:13:35.566059] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-30T22:13:35.566186] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-30T22:13:35.569062] [INFO ] [MAIN ] Derivative Progress: 1359/2009 symbols completed. OWL took 1.2s. Estimated remaining: 4m 27s. Rate: 145.8 symbols/min [2025-09-30T22:13:35.570727] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:35.582873] [DEBUG] [LOCAL ] OXM: Loaded 33295 existing records from primary storage. [2025-09-30T22:13:35.583168] [INFO ] [MAIN ] OXM: Loaded 33295 primary data records. [2025-09-30T22:13:35.716293] [DEBUG] [LOCAL ] PAC: Loaded 11555 existing records from primary storage. [2025-09-30T22:13:35.716677] [INFO ] [MAIN ] PAC: Loaded 11555 primary data records. [2025-09-30T22:13:36.065372] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-30T22:13:36.088754] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-30T22:13:36.628452] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:36.629907] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33295 primary records. [2025-09-30T22:13:36.630445] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-30T22:13:36.664722] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:13:36.666822] [INFO ] [MAIN ] PAC: Generated 1793 derivative records from 11555 primary records. [2025-09-30T22:13:36.667180] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-30T22:13:36.670023] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-30T22:13:36.684213] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-30T22:13:36.690926] [INFO ] [MAIN ] Derivative Progress: 1360/2009 symbols completed. OXM took 1.2s. Estimated remaining: 4m 27s. Rate: 145.7 symbols/min [2025-09-30T22:13:36.704596] [DEBUG] [LOCAL ] PAC: Derivative data saved (1793 records). [2025-09-30T22:13:36.704733] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:36.705777] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:36.705904] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-30T22:13:36.707187] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-30T22:13:36.707383] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-30T22:13:36.709543] [INFO ] [MAIN ] Derivative Progress: 1361/2009 symbols completed. PAC took 1.1s. Estimated remaining: 4m 27s. Rate: 145.8 symbols/min [2025-09-30T22:13:36.710724] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:36.729844] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-30T22:13:36.730152] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-30T22:13:36.733235] [INFO ] [MAIN ] Derivative Progress: 1362/2009 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 26s. Rate: 145.9 symbols/min [2025-09-30T22:13:36.733589] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:36.783436] [DEBUG] [LOCAL ] PACK: Loaded 31771 existing records from primary storage. [2025-09-30T22:13:36.784231] [DEBUG] [LOCAL ] PACS: Loaded 34461 existing records from primary storage. [2025-09-30T22:13:36.784432] [INFO ] [MAIN ] PACS: Loaded 34461 primary data records. [2025-09-30T22:13:36.784370] [INFO ] [MAIN ] PACK: Loaded 31771 primary data records. [2025-09-30T22:13:36.864046] [DEBUG] [LOCAL ] PAG: Loaded 21779 existing records from primary storage. [2025-09-30T22:13:36.907603] [INFO ] [MAIN ] PAG: Loaded 21779 primary data records. [2025-09-30T22:13:37.887814] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:37.889055] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34461 primary records. [2025-09-30T22:13:37.889157] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-30T22:13:37.930306] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:37.938270] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21779 primary records. [2025-09-30T22:13:37.938401] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-30T22:13:37.948012] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:37.957559] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31771 primary records. [2025-09-30T22:13:37.963457] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-30T22:13:37.963385] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-30T22:13:37.964540] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-30T22:13:37.966505] [INFO ] [MAIN ] Derivative Progress: 1363/2009 symbols completed. PACS took 1.3s. Estimated remaining: 4m 26s. Rate: 145.7 symbols/min [2025-09-30T22:13:37.987713] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-09-30T22:13:37.988469] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-30T22:13:37.992470] [INFO ] [MAIN ] Derivative Progress: 1364/2009 symbols completed. PACK took 1.3s. Estimated remaining: 4m 26s. Rate: 145.8 symbols/min [2025-09-30T22:13:37.993549] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-30T22:13:37.993744] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-30T22:13:37.996710] [INFO ] [MAIN ] Derivative Progress: 1365/2009 symbols completed. PAG took 1.3s. Estimated remaining: 4m 25s. Rate: 145.9 symbols/min [2025-09-30T22:13:37.997437] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:37.997327] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:37.997577] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:38.004372] [DEBUG] [LOCAL ] PAI: Loaded 2692 existing records from primary storage. [2025-09-30T22:13:38.004606] [INFO ] [MAIN ] PAI: Loaded 2692 primary data records. [2025-09-30T22:13:38.159942] [DEBUG] [LOCAL ] PAM: Loaded 28078 existing records from primary storage. [2025-09-30T22:13:38.166343] [INFO ] [MAIN ] PAM: Loaded 28078 primary data records. [2025-09-30T22:13:38.530782] [DEBUG] [LOCAL ] PAGS: Loaded 52710 existing records from primary storage. [2025-09-30T22:13:38.536742] [INFO ] [MAIN ] PAGS: Loaded 52710 primary data records. [2025-09-30T22:13:39.124832] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:39.127179] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2692 primary records. [2025-09-30T22:13:39.129626] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-30T22:13:39.164266] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-30T22:13:39.164679] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:39.164865] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-30T22:13:39.168051] [INFO ] [MAIN ] Derivative Progress: 1366/2009 symbols completed. PAI took 1.2s. Estimated remaining: 4m 25s. Rate: 145.7 symbols/min [2025-09-30T22:13:39.165909] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 28078 primary records. [2025-09-30T22:13:39.168202] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-30T22:13:39.169501] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:39.190860] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-30T22:13:39.191335] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-30T22:13:39.194082] [INFO ] [MAIN ] Derivative Progress: 1367/2009 symbols completed. PAM took 1.2s. Estimated remaining: 4m 24s. Rate: 145.8 symbols/min [2025-09-30T22:13:39.203009] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:39.209923] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:39.210975] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52710 primary records. [2025-09-30T22:13:39.211241] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-30T22:13:39.239269] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-30T22:13:39.239363] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-30T22:13:39.242562] [INFO ] [MAIN ] Derivative Progress: 1368/2009 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 24s. Rate: 145.9 symbols/min [2025-09-30T22:13:39.242941] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:39.257379] [DEBUG] [LOCAL ] PAR: Loaded 32688 existing records from primary storage. [2025-09-30T22:13:39.257600] [INFO ] [MAIN ] PAR: Loaded 32688 primary data records. [2025-09-30T22:13:39.612567] [DEBUG] [LOCAL ] PARR: Loaded 48332 existing records from primary storage. [2025-09-30T22:13:39.622428] [INFO ] [MAIN ] PARR: Loaded 48332 primary data records. [2025-09-30T22:13:39.655748] [DEBUG] [LOCAL ] PATH: Loaded 53677 existing records from primary storage. [2025-09-30T22:13:39.690848] [INFO ] [MAIN ] PATH: Loaded 53677 primary data records. [2025-09-30T22:13:40.381903] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:40.383354] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32688 primary records. [2025-09-30T22:13:40.383543] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-30T22:13:40.401107] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-30T22:13:40.401887] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-30T22:13:40.406144] [INFO ] [MAIN ] Derivative Progress: 1369/2009 symbols completed. PAR took 1.2s. Estimated remaining: 4m 24s. Rate: 145.7 symbols/min [2025-09-30T22:13:40.406978] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:40.427813] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:40.429033] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48332 primary records. [2025-09-30T22:13:40.430240] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-30T22:13:40.464259] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:40.466022] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53677 primary records. [2025-09-30T22:13:40.466450] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-30T22:13:40.490186] [DEBUG] [LOCAL ] PAXS: Loaded 20871 existing records from primary storage. [2025-09-30T22:13:40.494786] [INFO ] [MAIN ] PAXS: Loaded 20871 primary data records. [2025-09-30T22:13:40.495612] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-30T22:13:40.496355] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-30T22:13:40.504824] [INFO ] [MAIN ] Derivative Progress: 1370/2009 symbols completed. PATH took 1.3s. Estimated remaining: 4m 23s. Rate: 145.7 symbols/min [2025-09-30T22:13:40.512938] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-30T22:13:40.513114] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:40.518386] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-30T22:13:40.526712] [INFO ] [MAIN ] Derivative Progress: 1371/2009 symbols completed. PARR took 1.3s. Estimated remaining: 4m 22s. Rate: 145.8 symbols/min [2025-09-30T22:13:40.548131] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:40.863540] [DEBUG] [LOCAL ] PAY: Loaded 38045 existing records from primary storage. [2025-09-30T22:13:40.863926] [INFO ] [MAIN ] PAY: Loaded 38045 primary data records. [2025-09-30T22:13:40.993322] [DEBUG] [LOCAL ] PB: Loaded 41405 existing records from primary storage. [2025-09-30T22:13:40.998114] [INFO ] [MAIN ] PB: Loaded 41405 primary data records. [2025-09-30T22:13:41.551540] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:41.553250] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 20871 primary records. [2025-09-30T22:13:41.553476] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-30T22:13:41.575431] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-30T22:13:41.575579] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-30T22:13:41.578036] [INFO ] [MAIN ] Derivative Progress: 1372/2009 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 22s. Rate: 145.7 symbols/min [2025-09-30T22:13:41.578486] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:41.599858] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:41.600693] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38045 primary records. [2025-09-30T22:13:41.600892] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-30T22:13:41.620555] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-30T22:13:41.620737] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-30T22:13:41.623238] [INFO ] [MAIN ] Derivative Progress: 1373/2009 symbols completed. PAY took 1.1s. Estimated remaining: 4m 22s. Rate: 145.8 symbols/min [2025-09-30T22:13:41.635733] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:41.637118] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:41.650116] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41405 primary records. [2025-09-30T22:13:41.650503] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-30T22:13:41.679792] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-30T22:13:41.681071] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-30T22:13:41.684669] [INFO ] [MAIN ] Derivative Progress: 1374/2009 symbols completed. PB took 1.1s. Estimated remaining: 4m 21s. Rate: 145.9 symbols/min [2025-09-30T22:13:41.684927] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:41.686170] [DEBUG] [LOCAL ] PBA: Loaded 48873 existing records from primary storage. [2025-09-30T22:13:41.686629] [INFO ] [MAIN ] PBA: Loaded 48873 primary data records. [2025-09-30T22:13:42.049081] [DEBUG] [LOCAL ] PBF: Loaded 53115 existing records from primary storage. [2025-09-30T22:13:42.081806] [DEBUG] [LOCAL ] PBH: Loaded 31774 existing records from primary storage. [2025-09-30T22:13:42.091566] [INFO ] [MAIN ] PBH: Loaded 31774 primary data records. [2025-09-30T22:13:42.091862] [INFO ] [MAIN ] PBF: Loaded 53115 primary data records. [2025-09-30T22:13:42.796226] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:42.797472] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48873 primary records. [2025-09-30T22:13:42.797619] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-30T22:13:42.819962] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-30T22:13:42.820269] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-30T22:13:42.822410] [INFO ] [MAIN ] Derivative Progress: 1375/2009 symbols completed. PBA took 1.2s. Estimated remaining: 4m 21s. Rate: 145.7 symbols/min [2025-09-30T22:13:42.822709] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:42.836909] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:42.837755] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53115 primary records. [2025-09-30T22:13:42.837976] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-30T22:13:42.855604] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-30T22:13:42.856689] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-30T22:13:42.859800] [INFO ] [MAIN ] Derivative Progress: 1376/2009 symbols completed. PBF took 1.2s. Estimated remaining: 4m 21s. Rate: 145.8 symbols/min [2025-09-30T22:13:42.860039] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:42.874970] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:42.875898] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31774 primary records. [2025-09-30T22:13:42.876079] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-30T22:13:42.904109] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-30T22:13:42.904248] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-30T22:13:42.907068] [INFO ] [MAIN ] Derivative Progress: 1377/2009 symbols completed. PBH took 1.2s. Estimated remaining: 4m 20s. Rate: 145.9 symbols/min [2025-09-30T22:13:42.907463] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:42.946703] [DEBUG] [LOCAL ] PBI: Loaded 49983 existing records from primary storage. [2025-09-30T22:13:42.946926] [INFO ] [MAIN ] PBI: Loaded 49983 primary data records. [2025-09-30T22:13:42.995317] [DEBUG] [LOCAL ] PBT: Loaded 17222 existing records from primary storage. [2025-09-30T22:13:43.009172] [INFO ] [MAIN ] PBT: Loaded 17222 primary data records. [2025-09-30T22:13:43.138718] [DEBUG] [LOCAL ] PBR: Loaded 53712 existing records from primary storage. [2025-09-30T22:13:43.152351] [INFO ] [MAIN ] PBR: Loaded 53712 primary data records. [2025-09-30T22:13:44.021527] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:44.023679] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 49983 primary records. [2025-09-30T22:13:44.025680] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-30T22:13:44.048176] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:44.055449] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53712 primary records. [2025-09-30T22:13:44.055942] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-30T22:13:44.060405] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-30T22:13:44.070569] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-30T22:13:44.077041] [INFO ] [MAIN ] Derivative Progress: 1378/2009 symbols completed. PBI took 1.3s. Estimated remaining: 4m 20s. Rate: 145.7 symbols/min [2025-09-30T22:13:44.100555] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:44.103132] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17222 primary records. [2025-09-30T22:13:44.103479] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-30T22:13:44.104786] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-30T22:13:44.105582] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-30T22:13:44.110302] [INFO ] [MAIN ] Derivative Progress: 1379/2009 symbols completed. PBR took 1.3s. Estimated remaining: 4m 19s. Rate: 145.8 symbols/min [2025-09-30T22:13:44.126569] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-30T22:13:44.126746] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-30T22:13:44.132288] [INFO ] [MAIN ] Derivative Progress: 1380/2009 symbols completed. PBT took 1.2s. Estimated remaining: 4m 19s. Rate: 145.9 symbols/min [2025-09-30T22:13:44.133177] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:44.133261] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:44.133503] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:44.151847] [DEBUG] [LOCAL ] PCM: Loaded 6787 existing records from primary storage. [2025-09-30T22:13:44.152022] [INFO ] [MAIN ] PCM: Loaded 6787 primary data records. [2025-09-30T22:13:44.180153] [DEBUG] [LOCAL ] PCF: Loaded 8853 existing records from primary storage. [2025-09-30T22:13:44.205061] [INFO ] [MAIN ] PCF: Loaded 8853 primary data records. [2025-09-30T22:13:44.386286] [DEBUG] [LOCAL ] PCN: Loaded 24445 existing records from primary storage. [2025-09-30T22:13:44.398166] [INFO ] [MAIN ] PCN: Loaded 24445 primary data records. [2025-09-30T22:13:45.210122] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:45.212193] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8853 primary records. [2025-09-30T22:13:45.212395] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-30T22:13:45.233480] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:45.242676] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6787 primary records. [2025-09-30T22:13:45.242855] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-30T22:13:45.241812] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-30T22:13:45.243761] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-30T22:13:45.247115] [INFO ] [MAIN ] Derivative Progress: 1381/2009 symbols completed. PCF took 1.1s. Estimated remaining: 4m 19s. Rate: 145.7 symbols/min [2025-09-30T22:13:45.249732] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:45.275410] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:45.278999] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24445 primary records. [2025-09-30T22:13:45.280107] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-30T22:13:45.280319] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-30T22:13:45.280252] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-30T22:13:45.282773] [INFO ] [MAIN ] Derivative Progress: 1382/2009 symbols completed. PCM took 1.1s. Estimated remaining: 4m 18s. Rate: 145.8 symbols/min [2025-09-30T22:13:45.283289] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:45.300424] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-30T22:13:45.300626] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-30T22:13:45.303628] [INFO ] [MAIN ] Derivative Progress: 1383/2009 symbols completed. PCN took 1.2s. Estimated remaining: 4m 17s. Rate: 145.9 symbols/min [2025-09-30T22:13:45.303945] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:45.314529] [DEBUG] [LOCAL ] PCQ: Loaded 12294 existing records from primary storage. [2025-09-30T22:13:45.314673] [INFO ] [MAIN ] PCQ: Loaded 12294 primary data records. [2025-09-30T22:13:45.515568] [DEBUG] [LOCAL ] PCOR: Loaded 48025 existing records from primary storage. [2025-09-30T22:13:45.558454] [INFO ] [MAIN ] PCOR: Loaded 48025 primary data records. [2025-09-30T22:13:45.801623] [DEBUG] [LOCAL ] PD: Loaded 47886 existing records from primary storage. [2025-09-30T22:13:45.828935] [INFO ] [MAIN ] PD: Loaded 47886 primary data records. [2025-09-30T22:13:46.494951] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:46.496989] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12294 primary records. [2025-09-30T22:13:46.497888] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-30T22:13:46.524826] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-30T22:13:46.526603] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-30T22:13:46.528873] [INFO ] [MAIN ] Derivative Progress: 1384/2009 symbols completed. PCQ took 1.2s. Estimated remaining: 4m 17s. Rate: 145.7 symbols/min [2025-09-30T22:13:46.529294] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:46.543976] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:46.545135] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48025 primary records. [2025-09-30T22:13:46.545303] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-30T22:13:46.567701] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-30T22:13:46.568095] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-30T22:13:46.570636] [INFO ] [MAIN ] Derivative Progress: 1385/2009 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 17s. Rate: 145.8 symbols/min [2025-09-30T22:13:46.579424] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:46.585737] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:46.586705] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47886 primary records. [2025-09-30T22:13:46.587069] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-30T22:13:46.607101] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-30T22:13:46.618814] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-30T22:13:46.622256] [INFO ] [MAIN ] Derivative Progress: 1386/2009 symbols completed. PD took 1.3s. Estimated remaining: 4m 16s. Rate: 145.9 symbols/min [2025-09-30T22:13:46.622701] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:46.658990] [DEBUG] [LOCAL ] PDI: Loaded 50069 existing records from primary storage. [2025-09-30T22:13:46.659455] [INFO ] [MAIN ] PDI: Loaded 50069 primary data records. [2025-09-30T22:13:46.802918] [DEBUG] [LOCAL ] PDM: Loaded 39613 existing records from primary storage. [2025-09-30T22:13:46.821793] [INFO ] [MAIN ] PDM: Loaded 39613 primary data records. [2025-09-30T22:13:46.821637] [DEBUG] [LOCAL ] PDO: Loaded 31349 existing records from primary storage. [2025-09-30T22:13:46.883393] [INFO ] [MAIN ] PDO: Loaded 31349 primary data records. [2025-09-30T22:13:47.724406] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:47.727191] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50069 primary records. [2025-09-30T22:13:47.727412] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-30T22:13:47.754135] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:47.755618] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39613 primary records. [2025-09-30T22:13:47.755748] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-30T22:13:47.777090] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-30T22:13:47.777634] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-30T22:13:47.793390] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-30T22:13:47.793683] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-30T22:13:47.793283] [INFO ] [MAIN ] Derivative Progress: 1387/2009 symbols completed. PDM took 1.2s. Estimated remaining: 4m 16s. Rate: 145.7 symbols/min [2025-09-30T22:13:47.796312] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:47.796535] [INFO ] [MAIN ] Derivative Progress: 1388/2009 symbols completed. PDI took 1.3s. Estimated remaining: 4m 16s. Rate: 145.8 symbols/min [2025-09-30T22:13:47.796686] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:47.796189] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:47.798127] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31349 primary records. [2025-09-30T22:13:47.798225] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-30T22:13:47.820693] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-30T22:13:47.820847] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-30T22:13:47.823233] [INFO ] [MAIN ] Derivative Progress: 1389/2009 symbols completed. PDO took 1.2s. Estimated remaining: 4m 15s. Rate: 145.9 symbols/min [2025-09-30T22:13:47.829025] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:47.837765] [DEBUG] [LOCAL ] PDS: Loaded 17707 existing records from primary storage. [2025-09-30T22:13:47.838022] [INFO ] [MAIN ] PDS: Loaded 17707 primary data records. [2025-09-30T22:13:47.878533] [DEBUG] [LOCAL ] PDT: Loaded 17328 existing records from primary storage. [2025-09-30T22:13:47.947717] [INFO ] [MAIN ] PDT: Loaded 17328 primary data records. [2025-09-30T22:13:47.987803] [DEBUG] [LOCAL ] PDX: Loaded 14361 existing records from primary storage. [2025-09-30T22:13:47.993819] [INFO ] [MAIN ] PDX: Loaded 14361 primary data records. [2025-09-30T22:13:48.949463] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:48.950275] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17707 primary records. [2025-09-30T22:13:48.950622] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-30T22:13:48.972991] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-30T22:13:48.974200] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-30T22:13:48.976385] [INFO ] [MAIN ] Derivative Progress: 1390/2009 symbols completed. PDS took 1.2s. Estimated remaining: 4m 15s. Rate: 145.7 symbols/min [2025-09-30T22:13:48.976892] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:49.005588] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:49.007224] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17328 primary records. [2025-09-30T22:13:49.006381] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:49.008309] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14361 primary records. [2025-09-30T22:13:49.008601] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-30T22:13:49.008547] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-30T22:13:49.039216] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-30T22:13:49.039566] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-30T22:13:49.043137] [INFO ] [MAIN ] Derivative Progress: 1391/2009 symbols completed. PDX took 1.2s. Estimated remaining: 4m 14s. Rate: 145.8 symbols/min [2025-09-30T22:13:49.043590] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:49.046005] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-30T22:13:49.046226] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-30T22:13:49.049105] [INFO ] [MAIN ] Derivative Progress: 1392/2009 symbols completed. PDT took 1.3s. Estimated remaining: 4m 14s. Rate: 145.9 symbols/min [2025-09-30T22:13:49.049847] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:49.083022] [DEBUG] [LOCAL ] PEO: Loaded 11004 existing records from primary storage. [2025-09-30T22:13:49.083177] [INFO ] [MAIN ] PEO: Loaded 11004 primary data records. [2025-09-30T22:13:49.169691] [DEBUG] [LOCAL ] PEN: Loaded 30150 existing records from primary storage. [2025-09-30T22:13:49.180445] [INFO ] [MAIN ] PEN: Loaded 30150 primary data records. [2025-09-30T22:13:49.286674] [DEBUG] [LOCAL ] PEB: Loaded 50648 existing records from primary storage. [2025-09-30T22:13:49.307722] [INFO ] [MAIN ] PEB: Loaded 50648 primary data records. [2025-09-30T22:13:50.121145] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:50.123025] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11004 primary records. [2025-09-30T22:13:50.123346] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-30T22:13:50.138100] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:50.148667] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30150 primary records. [2025-09-30T22:13:50.151539] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-30T22:13:50.156068] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-30T22:13:50.157092] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-30T22:13:50.160519] [INFO ] [MAIN ] Derivative Progress: 1393/2009 symbols completed. PEO took 1.1s. Estimated remaining: 4m 14s. Rate: 145.7 symbols/min [2025-09-30T22:13:50.190015] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-30T22:13:50.190764] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-30T22:13:50.193488] [INFO ] [MAIN ] Derivative Progress: 1394/2009 symbols completed. PEN took 1.1s. Estimated remaining: 4m 13s. Rate: 145.8 symbols/min [2025-09-30T22:13:50.190949] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:50.194527] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50648 primary records. [2025-09-30T22:13:50.194617] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-30T22:13:50.210393] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-30T22:13:50.210455] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-30T22:13:50.212972] [INFO ] [MAIN ] Derivative Progress: 1395/2009 symbols completed. PEB took 1.2s. Estimated remaining: 4m 13s. Rate: 145.9 symbols/min [2025-09-30T22:13:50.213520] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:50.213617] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:50.213985] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:50.222147] [DEBUG] [LOCAL ] PFD: Loaded 5139 existing records from primary storage. [2025-09-30T22:13:50.222431] [INFO ] [MAIN ] PFD: Loaded 5139 primary data records. [2025-09-30T22:13:50.336549] [DEBUG] [LOCAL ] PERF: Loaded 14022 existing records from primary storage. [2025-09-30T22:13:50.341406] [INFO ] [MAIN ] PERF: Loaded 14022 primary data records. [2025-09-30T22:13:50.698311] [DEBUG] [LOCAL ] PFGC: Loaded 46820 existing records from primary storage. [2025-09-30T22:13:50.715425] [INFO ] [MAIN ] PFGC: Loaded 46820 primary data records. [2025-09-30T22:13:51.335844] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:13:51.337912] [INFO ] [MAIN ] PFD: Generated 1793 derivative records from 5139 primary records. [2025-09-30T22:13:51.338582] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-30T22:13:51.358665] [DEBUG] [LOCAL ] PFD: Derivative data saved (1793 records). [2025-09-30T22:13:51.359201] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-30T22:13:51.363451] [INFO ] [MAIN ] Derivative Progress: 1396/2009 symbols completed. PFD took 1.1s. Estimated remaining: 4m 12s. Rate: 145.7 symbols/min [2025-09-30T22:13:51.364738] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:51.379805] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:51.381187] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14022 primary records. [2025-09-30T22:13:51.381476] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-30T22:13:51.401937] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-30T22:13:51.402539] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-30T22:13:51.405993] [DEBUG] [LOCAL ] PFH: Loaded 6818 existing records from primary storage. [2025-09-30T22:13:51.408476] [INFO ] [MAIN ] Derivative Progress: 1397/2009 symbols completed. PERF took 1.2s. Estimated remaining: 4m 12s. Rate: 145.8 symbols/min [2025-09-30T22:13:51.408777] [INFO ] [MAIN ] PFH: Loaded 6818 primary data records. [2025-09-30T22:13:51.414035] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:51.524420] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:51.557424] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46820 primary records. [2025-09-30T22:13:51.557671] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-30T22:13:51.558401] [DEBUG] [LOCAL ] PFL: Loaded 13601 existing records from primary storage. [2025-09-30T22:13:51.575310] [INFO ] [MAIN ] PFL: Loaded 13601 primary data records. [2025-09-30T22:13:51.676372] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-30T22:13:51.693786] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-30T22:13:51.733535] [INFO ] [MAIN ] Derivative Progress: 1398/2009 symbols completed. PFGC took 1.5s. Estimated remaining: 4m 11s. Rate: 145.8 symbols/min [2025-09-30T22:13:51.800716] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:52.200847] [DEBUG] [LOCAL ] PFLT: Loaded 43709 existing records from primary storage. [2025-09-30T22:13:52.201303] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:52.202798] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6818 primary records. [2025-09-30T22:13:52.202986] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-30T22:13:52.201691] [INFO ] [MAIN ] PFLT: Loaded 43709 primary data records. [2025-09-30T22:13:52.334144] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-30T22:13:52.345304] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-30T22:13:52.352802] [INFO ] [MAIN ] Derivative Progress: 1399/2009 symbols completed. PFH took 1.0s. Estimated remaining: 4m 11s. Rate: 145.8 symbols/min [2025-09-30T22:13:52.366030] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:52.393375] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:52.551255] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13601 primary records. [2025-09-30T22:13:52.559028] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-30T22:13:52.582083] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-30T22:13:52.582500] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-30T22:13:52.585415] [INFO ] [MAIN ] Derivative Progress: 1400/2009 symbols completed. PFL took 1.2s. Estimated remaining: 4m 11s. Rate: 145.8 symbols/min [2025-09-30T22:13:52.585605] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:52.595830] [DEBUG] [LOCAL ] PFN: Loaded 21730 existing records from primary storage. [2025-09-30T22:13:52.596902] [INFO ] [MAIN ] PFN: Loaded 21730 primary data records. [2025-09-30T22:13:53.002118] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:53.003036] [DEBUG] [LOCAL ] PFS: Loaded 35582 existing records from primary storage. [2025-09-30T22:13:53.005377] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43709 primary records. [2025-09-30T22:13:53.005807] [INFO ] [MAIN ] PFS: Loaded 35582 primary data records. [2025-09-30T22:13:53.006577] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-30T22:13:53.115447] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-30T22:13:53.142352] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-30T22:13:53.145939] [INFO ] [MAIN ] Derivative Progress: 1401/2009 symbols completed. PFLT took 1.3s. Estimated remaining: 4m 10s. Rate: 145.8 symbols/min [2025-09-30T22:13:53.146302] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:53.375700] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:53.377089] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21730 primary records. [2025-09-30T22:13:53.385859] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-30T22:13:53.388328] [DEBUG] [LOCAL ] PFSI: Loaded 28610 existing records from primary storage. [2025-09-30T22:13:53.389409] [INFO ] [MAIN ] PFSI: Loaded 28610 primary data records. [2025-09-30T22:13:53.482259] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-30T22:13:53.495795] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-30T22:13:53.510555] [INFO ] [MAIN ] Derivative Progress: 1402/2009 symbols completed. PFN took 1.1s. Estimated remaining: 4m 10s. Rate: 145.8 symbols/min [2025-09-30T22:13:53.522314] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:53.725895] [DEBUG] [LOCAL ] PGP: Loaded 5471 existing records from primary storage. [2025-09-30T22:13:53.744169] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:53.754506] [INFO ] [MAIN ] PGP: Loaded 5471 primary data records. [2025-09-30T22:13:53.754423] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35582 primary records. [2025-09-30T22:13:53.800947] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-30T22:13:53.908220] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-30T22:13:53.928498] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-30T22:13:53.939950] [INFO ] [MAIN ] Derivative Progress: 1403/2009 symbols completed. PFS took 1.4s. Estimated remaining: 4m 9s. Rate: 145.8 symbols/min [2025-09-30T22:13:53.949171] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:54.125160] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:54.126571] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28610 primary records. [2025-09-30T22:13:54.127044] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-30T22:13:54.158796] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-30T22:13:54.159879] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-30T22:13:54.163305] [INFO ] [MAIN ] Derivative Progress: 1404/2009 symbols completed. PFSI took 1.0s. Estimated remaining: 4m 9s. Rate: 145.8 symbols/min [2025-09-30T22:13:54.164263] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:54.191555] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:54.193871] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5471 primary records. [2025-09-30T22:13:54.194073] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-30T22:13:54.197387] [DEBUG] [LOCAL ] PGRE: Loaded 46650 existing records from primary storage. [2025-09-30T22:13:54.209177] [INFO ] [MAIN ] PGRE: Loaded 46650 primary data records. [2025-09-30T22:13:54.236420] [DEBUG] [LOCAL ] PGZ: Loaded 5450 existing records from primary storage. [2025-09-30T22:13:54.260322] [INFO ] [MAIN ] PGZ: Loaded 5450 primary data records. [2025-09-30T22:13:54.261424] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-30T22:13:54.298349] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-30T22:13:54.360628] [INFO ] [MAIN ] Derivative Progress: 1405/2009 symbols completed. PGP took 0.8s. Estimated remaining: 4m 8s. Rate: 145.9 symbols/min [2025-09-30T22:13:54.387293] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:54.894254] [DEBUG] [LOCAL ] PHD: Loaded 10332 existing records from primary storage. [2025-09-30T22:13:54.894475] [INFO ] [MAIN ] PHD: Loaded 10332 primary data records. [2025-09-30T22:13:55.253405] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:55.262375] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5450 primary records. [2025-09-30T22:13:55.267765] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-30T22:13:55.268613] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:55.269585] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46650 primary records. [2025-09-30T22:13:55.269732] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-30T22:13:55.294278] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-30T22:13:55.299578] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-30T22:13:55.301967] [INFO ] [MAIN ] Derivative Progress: 1406/2009 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 8s. Rate: 145.7 symbols/min [2025-09-30T22:13:55.304877] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:55.306725] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-30T22:13:55.306972] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-30T22:13:55.309715] [INFO ] [MAIN ] Derivative Progress: 1407/2009 symbols completed. PGRE took 1.4s. Estimated remaining: 4m 8s. Rate: 145.8 symbols/min [2025-09-30T22:13:55.310467] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:55.335188] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:55.336505] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 10332 primary records. [2025-09-30T22:13:55.336727] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-30T22:13:55.358939] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-30T22:13:55.359077] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-30T22:13:55.362833] [INFO ] [MAIN ] Derivative Progress: 1408/2009 symbols completed. PHD took 1.0s. Estimated remaining: 4m 7s. Rate: 145.9 symbols/min [2025-09-30T22:13:55.363321] [DEBUG] [LOCAL ] PHI: Loaded 14996 existing records from primary storage. [2025-09-30T22:13:55.363724] [INFO ] [MAIN ] PHI: Loaded 14996 primary data records. [2025-09-30T22:13:55.545708] [DEBUG] [LOCAL ] PHG: Loaded 46099 existing records from primary storage. [2025-09-30T22:13:55.570551] [INFO ] [MAIN ] PHG: Loaded 46099 primary data records. [2025-09-30T22:13:56.054607] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:56.056106] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14996 primary records. [2025-09-30T22:13:56.056517] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-30T22:13:56.073682] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-30T22:13:56.074020] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-30T22:13:56.076455] [INFO ] [MAIN ] Derivative Progress: 1409/2009 symbols completed. PHI took 0.8s. Estimated remaining: 4m 7s. Rate: 145.9 symbols/min [2025-09-30T22:13:56.094211] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:56.094899] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46099 primary records. [2025-09-30T22:13:56.094964] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-30T22:13:56.112091] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-30T22:13:56.112211] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-30T22:13:56.115298] [INFO ] [MAIN ] Derivative Progress: 1410/2009 symbols completed. PHG took 0.8s. Estimated remaining: 4m 6s. Rate: 146.0 symbols/min [2025-09-30T22:13:56.116124] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:56.115915] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:56.116032] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:56.161082] [DEBUG] [LOCAL ] PHK: Loaded 26275 existing records from primary storage. [2025-09-30T22:13:56.161358] [INFO ] [MAIN ] PHK: Loaded 26275 primary data records. [2025-09-30T22:13:56.264464] [DEBUG] [LOCAL ] PHIN: Loaded 32689 existing records from primary storage. [2025-09-30T22:13:56.287840] [INFO ] [MAIN ] PHIN: Loaded 32689 primary data records. [2025-09-30T22:13:56.379613] [DEBUG] [LOCAL ] PHR: Loaded 37388 existing records from primary storage. [2025-09-30T22:13:56.453308] [INFO ] [MAIN ] PHR: Loaded 37388 primary data records. [2025-09-30T22:13:57.279097] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:57.280444] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26275 primary records. [2025-09-30T22:13:57.280693] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-30T22:13:57.315045] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-30T22:13:57.315907] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-30T22:13:57.318195] [INFO ] [MAIN ] Derivative Progress: 1411/2009 symbols completed. PHK took 1.2s. Estimated remaining: 4m 6s. Rate: 145.8 symbols/min [2025-09-30T22:13:57.315711] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:57.319502] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 32689 primary records. [2025-09-30T22:13:57.318584] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:57.319838] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-30T22:13:57.338740] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-30T22:13:57.338842] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-30T22:13:57.341736] [INFO ] [MAIN ] Derivative Progress: 1412/2009 symbols completed. PHIN took 1.2s. Estimated remaining: 4m 6s. Rate: 145.9 symbols/min [2025-09-30T22:13:57.342733] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:57.364266] [DEBUG] [LOCAL ] PIM: Loaded 4790 existing records from primary storage. [2025-09-30T22:13:57.364725] [INFO ] [MAIN ] PIM: Loaded 4790 primary data records. [2025-09-30T22:13:57.364606] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:57.370934] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37388 primary records. [2025-09-30T22:13:57.378143] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-30T22:13:57.512064] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-30T22:13:57.542838] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-30T22:13:57.595374] [DEBUG] [LOCAL ] PII: Loaded 48956 existing records from primary storage. [2025-09-30T22:13:57.593241] [INFO ] [MAIN ] Derivative Progress: 1413/2009 symbols completed. PHR took 1.5s. Estimated remaining: 4m 5s. Rate: 145.9 symbols/min [2025-09-30T22:13:57.612709] [INFO ] [MAIN ] PII: Loaded 48956 primary data records. [2025-09-30T22:13:57.613081] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:57.882414] [DEBUG] [LOCAL ] PINE: Loaded 14075 existing records from primary storage. [2025-09-30T22:13:57.898844] [INFO ] [MAIN ] PINE: Loaded 14075 primary data records. [2025-09-30T22:13:58.445955] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:58.447536] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4790 primary records. [2025-09-30T22:13:58.448872] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-30T22:13:58.470807] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-30T22:13:58.471146] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-30T22:13:58.487264] [INFO ] [MAIN ] Derivative Progress: 1414/2009 symbols completed. PIM took 1.1s. Estimated remaining: 4m 5s. Rate: 145.8 symbols/min [2025-09-30T22:13:58.488158] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:58.488740] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:58.489716] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 48956 primary records. [2025-09-30T22:13:58.490180] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-30T22:13:58.507600] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-30T22:13:58.507807] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-30T22:13:58.510272] [INFO ] [MAIN ] Derivative Progress: 1415/2009 symbols completed. PII took 1.2s. Estimated remaining: 4m 4s. Rate: 145.9 symbols/min [2025-09-30T22:13:58.510556] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:58.531564] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:58.532566] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14075 primary records. [2025-09-30T22:13:58.532747] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-30T22:13:58.571573] [DEBUG] [LOCAL ] PIPR: Loaded 14870 existing records from primary storage. [2025-09-30T22:13:58.572064] [INFO ] [MAIN ] PIPR: Loaded 14870 primary data records. [2025-09-30T22:13:58.659689] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-30T22:13:58.680020] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-30T22:13:58.702746] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-30T22:13:58.701765] [INFO ] [MAIN ] Derivative Progress: 1416/2009 symbols completed. PINE took 1.1s. Estimated remaining: 4m 4s. Rate: 145.9 symbols/min [2025-09-30T22:13:58.708559] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-30T22:13:58.719056] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:59.296606] [DEBUG] [LOCAL ] PJT: Loaded 21762 existing records from primary storage. [2025-09-30T22:13:59.296959] [INFO ] [MAIN ] PJT: Loaded 21762 primary data records. [2025-09-30T22:13:59.558141] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:59.575503] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 14870 primary records. [2025-09-30T22:13:59.605633] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-30T22:13:59.784006] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-30T22:13:59.790794] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-30T22:13:59.794103] [INFO ] [MAIN ] Derivative Progress: 1417/2009 symbols completed. PIPR took 1.3s. Estimated remaining: 4m 4s. Rate: 145.8 symbols/min [2025-09-30T22:13:59.790623] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:59.794289] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:59.796975] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-30T22:13:59.797414] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-30T22:13:59.816858] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-30T22:13:59.817100] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-30T22:13:59.820345] [INFO ] [MAIN ] Derivative Progress: 1418/2009 symbols completed. PINS took 1.3s. Estimated remaining: 4m 3s. Rate: 145.9 symbols/min [2025-09-30T22:13:59.821468] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:13:59.845058] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:13:59.845897] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 21762 primary records. [2025-09-30T22:13:59.846021] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-30T22:13:59.852118] [DEBUG] [LOCAL ] PKE: Loaded 12852 existing records from primary storage. [2025-09-30T22:13:59.863072] [INFO ] [MAIN ] PKE: Loaded 12852 primary data records. [2025-09-30T22:13:59.903001] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-30T22:13:59.930823] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-30T22:13:59.948826] [INFO ] [MAIN ] Derivative Progress: 1419/2009 symbols completed. PJT took 1.2s. Estimated remaining: 4m 3s. Rate: 145.9 symbols/min [2025-09-30T22:13:59.957003] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:00.221508] [DEBUG] [LOCAL ] PK: Loaded 52824 existing records from primary storage. [2025-09-30T22:14:00.230445] [INFO ] [MAIN ] PK: Loaded 52824 primary data records. [2025-09-30T22:14:00.261038] [DEBUG] [LOCAL ] PKST: Loaded 18879 existing records from primary storage. [2025-09-30T22:14:00.278616] [INFO ] [MAIN ] PKST: Loaded 18879 primary data records. [2025-09-30T22:14:00.944191] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:00.945763] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12852 primary records. [2025-09-30T22:14:00.946014] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-30T22:14:00.967308] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-30T22:14:00.967963] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-30T22:14:00.970826] [INFO ] [MAIN ] Derivative Progress: 1420/2009 symbols completed. PKE took 1.1s. Estimated remaining: 4m 2s. Rate: 145.8 symbols/min [2025-09-30T22:14:00.971167] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:01.009423] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:01.016345] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:01.017350] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52824 primary records. [2025-09-30T22:14:01.017498] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-30T22:14:01.018999] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 18879 primary records. [2025-09-30T22:14:01.019405] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-30T22:14:01.048221] [DEBUG] [LOCAL ] PKX: Loaded 24346 existing records from primary storage. [2025-09-30T22:14:01.053678] [INFO ] [MAIN ] PKX: Loaded 24346 primary data records. [2025-09-30T22:14:01.065187] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-30T22:14:01.067181] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-30T22:14:01.067049] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-30T22:14:01.067431] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-30T22:14:01.070096] [INFO ] [MAIN ] Derivative Progress: 1421/2009 symbols completed. PKST took 1.1s. Estimated remaining: 4m 2s. Rate: 145.8 symbols/min [2025-09-30T22:14:01.082366] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:01.102871] [INFO ] [MAIN ] Derivative Progress: 1422/2009 symbols completed. PK took 1.3s. Estimated remaining: 4m 1s. Rate: 145.9 symbols/min [2025-09-30T22:14:01.143054] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:01.494043] [DEBUG] [LOCAL ] PL: Loaded 53131 existing records from primary storage. [2025-09-30T22:14:01.494416] [INFO ] [MAIN ] PL: Loaded 53131 primary data records. [2025-09-30T22:14:01.632753] [DEBUG] [LOCAL ] PLNT: Loaded 48308 existing records from primary storage. [2025-09-30T22:14:01.633368] [INFO ] [MAIN ] PLNT: Loaded 48308 primary data records. [2025-09-30T22:14:01.876186] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:01.944282] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 24346 primary records. [2025-09-30T22:14:01.975701] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-30T22:14:02.020162] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-30T22:14:02.040960] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-30T22:14:02.211078] [INFO ] [MAIN ] Derivative Progress: 1423/2009 symbols completed. PKX took 1.2s. Estimated remaining: 4m 1s. Rate: 145.8 symbols/min [2025-09-30T22:14:02.239568] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:02.240366] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53131 primary records. [2025-09-30T22:14:02.240573] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-30T22:14:02.259733] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-30T22:14:02.260034] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-30T22:14:02.274803] [INFO ] [MAIN ] Derivative Progress: 1424/2009 symbols completed. PL took 1.2s. Estimated remaining: 4m 1s. Rate: 145.9 symbols/min [2025-09-30T22:14:02.275146] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:02.276028] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48308 primary records. [2025-09-30T22:14:02.276096] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-30T22:14:02.292600] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-09-30T22:14:02.292712] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-30T22:14:02.295558] [INFO ] [MAIN ] Derivative Progress: 1425/2009 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 0s. Rate: 146.0 symbols/min [2025-09-30T22:14:02.296139] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:02.296054] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:02.296387] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:02.323784] [DEBUG] [LOCAL ] PML: Loaded 21122 existing records from primary storage. [2025-09-30T22:14:02.324055] [INFO ] [MAIN ] PML: Loaded 21122 primary data records. [2025-09-30T22:14:02.387413] [DEBUG] [LOCAL ] PLOW: Loaded 20380 existing records from primary storage. [2025-09-30T22:14:02.423148] [DEBUG] [LOCAL ] PLYM: Loaded 33413 existing records from primary storage. [2025-09-30T22:14:02.442179] [INFO ] [MAIN ] PLYM: Loaded 33413 primary data records. [2025-09-30T22:14:02.442001] [INFO ] [MAIN ] PLOW: Loaded 20380 primary data records. [2025-09-30T22:14:03.468962] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:03.475050] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33413 primary records. [2025-09-30T22:14:03.483420] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-30T22:14:03.502838] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:03.504713] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20380 primary records. [2025-09-30T22:14:03.503844] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:03.512347] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-30T22:14:03.513606] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21122 primary records. [2025-09-30T22:14:03.516069] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-30T22:14:03.537394] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-30T22:14:03.545180] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-30T22:14:03.549542] [INFO ] [MAIN ] Derivative Progress: 1426/2009 symbols completed. PLYM took 1.3s. Estimated remaining: 4m 0s. Rate: 145.7 symbols/min [2025-09-30T22:14:03.553033] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:03.559338] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-30T22:14:03.560577] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-30T22:14:03.562920] [INFO ] [MAIN ] Derivative Progress: 1427/2009 symbols completed. PML took 1.3s. Estimated remaining: 3m 59s. Rate: 145.8 symbols/min [2025-09-30T22:14:03.563927] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:03.569900] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-30T22:14:03.570116] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-30T22:14:03.572884] [INFO ] [MAIN ] Derivative Progress: 1428/2009 symbols completed. PLOW took 1.3s. Estimated remaining: 3m 59s. Rate: 145.9 symbols/min [2025-09-30T22:14:03.573187] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:03.582246] [DEBUG] [LOCAL ] PMM: Loaded 10685 existing records from primary storage. [2025-09-30T22:14:03.582427] [INFO ] [MAIN ] PMM: Loaded 10685 primary data records. [2025-09-30T22:14:03.640872] [DEBUG] [LOCAL ] PMO: Loaded 10528 existing records from primary storage. [2025-09-30T22:14:03.664758] [INFO ] [MAIN ] PMO: Loaded 10528 primary data records. [2025-09-30T22:14:04.067762] [DEBUG] [LOCAL ] PMT: Loaded 40156 existing records from primary storage. [2025-09-30T22:14:04.078667] [INFO ] [MAIN ] PMT: Loaded 40156 primary data records. [2025-09-30T22:14:04.644962] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:04.646155] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10685 primary records. [2025-09-30T22:14:04.646398] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-30T22:14:04.676635] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:04.678514] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10528 primary records. [2025-09-30T22:14:04.680235] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-30T22:14:04.681775] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-30T22:14:04.688967] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-30T22:14:04.691228] [INFO ] [MAIN ] Derivative Progress: 1429/2009 symbols completed. PMM took 1.1s. Estimated remaining: 3m 59s. Rate: 145.8 symbols/min [2025-09-30T22:14:04.692963] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:04.700871] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-30T22:14:04.701133] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-30T22:14:04.703396] [INFO ] [MAIN ] Derivative Progress: 1430/2009 symbols completed. PMO took 1.1s. Estimated remaining: 3m 58s. Rate: 145.9 symbols/min [2025-09-30T22:14:04.703877] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:04.733960] [DEBUG] [LOCAL ] PNI: Loaded 6775 existing records from primary storage. [2025-09-30T22:14:04.734324] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:04.735379] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40156 primary records. [2025-09-30T22:14:04.735440] [INFO ] [MAIN ] PNI: Loaded 6775 primary data records. [2025-09-30T22:14:04.747042] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-30T22:14:04.879602] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-30T22:14:04.891156] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-30T22:14:04.919522] [INFO ] [MAIN ] Derivative Progress: 1431/2009 symbols completed. PMT took 1.3s. Estimated remaining: 3m 58s. Rate: 145.9 symbols/min [2025-09-30T22:14:04.931780] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:04.989415] [DEBUG] [LOCAL ] PNNT: Loaded 32785 existing records from primary storage. [2025-09-30T22:14:05.100452] [INFO ] [MAIN ] PNNT: Loaded 32785 primary data records. [2025-09-30T22:14:05.475709] [DEBUG] [LOCAL ] POR: Loaded 47013 existing records from primary storage. [2025-09-30T22:14:05.477083] [INFO ] [MAIN ] POR: Loaded 47013 primary data records. [2025-09-30T22:14:05.612041] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:05.623927] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6775 primary records. [2025-09-30T22:14:05.635054] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-30T22:14:05.879356] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-30T22:14:05.879586] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-30T22:14:05.883031] [INFO ] [MAIN ] Derivative Progress: 1432/2009 symbols completed. PNI took 1.2s. Estimated remaining: 3m 57s. Rate: 145.8 symbols/min [2025-09-30T22:14:05.884240] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:05.900903] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:05.902016] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32785 primary records. [2025-09-30T22:14:05.902198] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-30T22:14:05.920772] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-30T22:14:05.921122] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-30T22:14:05.923762] [INFO ] [MAIN ] Derivative Progress: 1433/2009 symbols completed. PNNT took 1.2s. Estimated remaining: 3m 57s. Rate: 145.9 symbols/min [2025-09-30T22:14:05.924336] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:05.953861] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:05.954583] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 47013 primary records. [2025-09-30T22:14:05.954815] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-30T22:14:05.991261] [DEBUG] [LOCAL ] PPT: Loaded 20144 existing records from primary storage. [2025-09-30T22:14:05.995358] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-09-30T22:14:05.994352] [DEBUG] [LOCAL ] POST: Loaded 38818 existing records from primary storage. [2025-09-30T22:14:05.992322] [INFO ] [MAIN ] PPT: Loaded 20144 primary data records. [2025-09-30T22:14:05.995518] [INFO ] [MAIN ] POST: Loaded 38818 primary data records. [2025-09-30T22:14:05.995606] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-30T22:14:05.998447] [INFO ] [MAIN ] Derivative Progress: 1434/2009 symbols completed. POR took 1.1s. Estimated remaining: 3m 56s. Rate: 146.0 symbols/min [2025-09-30T22:14:05.998750] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:06.672034] [DEBUG] [LOCAL ] PR: Loaded 53610 existing records from primary storage. [2025-09-30T22:14:06.672258] [INFO ] [MAIN ] PR: Loaded 53610 primary data records. [2025-09-30T22:14:07.018065] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:07.021926] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38818 primary records. [2025-09-30T22:14:07.022803] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-30T22:14:07.049404] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:07.057566] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20144 primary records. [2025-09-30T22:14:07.058112] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-30T22:14:07.075095] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-30T22:14:07.076164] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-30T22:14:07.079000] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-30T22:14:07.082201] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-30T22:14:07.081926] [INFO ] [MAIN ] Derivative Progress: 1435/2009 symbols completed. POST took 1.2s. Estimated remaining: 3m 56s. Rate: 145.8 symbols/min [2025-09-30T22:14:07.085111] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:07.085908] [INFO ] [MAIN ] Derivative Progress: 1436/2009 symbols completed. PPT took 1.2s. Estimated remaining: 3m 56s. Rate: 145.9 symbols/min [2025-09-30T22:14:07.086223] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:07.107561] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:07.108400] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53610 primary records. [2025-09-30T22:14:07.108582] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-30T22:14:07.142080] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-30T22:14:07.142358] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-30T22:14:07.144597] [INFO ] [MAIN ] Derivative Progress: 1437/2009 symbols completed. PR took 1.1s. Estimated remaining: 3m 55s. Rate: 146.0 symbols/min [2025-09-30T22:14:07.144920] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:07.167560] [DEBUG] [LOCAL ] PRG: Loaded 29789 existing records from primary storage. [2025-09-30T22:14:07.168199] [DEBUG] [LOCAL ] PRA: Loaded 34973 existing records from primary storage. [2025-09-30T22:14:07.168498] [INFO ] [MAIN ] PRG: Loaded 29789 primary data records. [2025-09-30T22:14:07.168603] [INFO ] [MAIN ] PRA: Loaded 34973 primary data records. [2025-09-30T22:14:07.584268] [DEBUG] [LOCAL ] PRGO: Loaded 46912 existing records from primary storage. [2025-09-30T22:14:07.726237] [INFO ] [MAIN ] PRGO: Loaded 46912 primary data records. [2025-09-30T22:14:08.227136] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:08.228353] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 29789 primary records. [2025-09-30T22:14:08.228662] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-30T22:14:08.247205] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-30T22:14:08.250031] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-30T22:14:08.252544] [INFO ] [MAIN ] Derivative Progress: 1438/2009 symbols completed. PRG took 1.2s. Estimated remaining: 3m 55s. Rate: 145.8 symbols/min [2025-09-30T22:14:08.266792] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:08.267528] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34973 primary records. [2025-09-30T22:14:08.267810] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-30T22:14:08.285488] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-30T22:14:08.286074] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-30T22:14:08.289323] [INFO ] [MAIN ] Derivative Progress: 1439/2009 symbols completed. PRA took 1.2s. Estimated remaining: 3m 54s. Rate: 145.9 symbols/min [2025-09-30T22:14:08.303262] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:08.303931] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46912 primary records. [2025-09-30T22:14:08.303997] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-30T22:14:08.320426] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-30T22:14:08.320527] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-30T22:14:08.323055] [INFO ] [MAIN ] Derivative Progress: 1440/2009 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 54s. Rate: 146.0 symbols/min [2025-09-30T22:14:08.323537] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:08.323636] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:08.323475] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:08.337315] [DEBUG] [LOCAL ] PRH: Loaded 4774 existing records from primary storage. [2025-09-30T22:14:08.337569] [INFO ] [MAIN ] PRH: Loaded 4774 primary data records. [2025-09-30T22:14:08.473218] [DEBUG] [LOCAL ] PRI: Loaded 18278 existing records from primary storage. [2025-09-30T22:14:08.474091] [INFO ] [MAIN ] PRI: Loaded 18278 primary data records. [2025-09-30T22:14:08.842021] [DEBUG] [LOCAL ] PRIM: Loaded 44341 existing records from primary storage. [2025-09-30T22:14:08.865761] [INFO ] [MAIN ] PRIM: Loaded 44341 primary data records. [2025-09-30T22:14:09.433513] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:09.434455] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4774 primary records. [2025-09-30T22:14:09.435400] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-30T22:14:09.465601] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:09.467984] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18278 primary records. [2025-09-30T22:14:09.468195] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-30T22:14:09.469864] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-30T22:14:09.470115] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-30T22:14:09.472835] [INFO ] [MAIN ] Derivative Progress: 1441/2009 symbols completed. PRH took 1.1s. Estimated remaining: 3m 54s. Rate: 145.8 symbols/min [2025-09-30T22:14:09.481380] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:09.492825] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-30T22:14:09.493046] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-30T22:14:09.495452] [INFO ] [MAIN ] Derivative Progress: 1442/2009 symbols completed. PRI took 1.2s. Estimated remaining: 3m 53s. Rate: 145.9 symbols/min [2025-09-30T22:14:09.495770] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:09.509442] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:09.510307] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44341 primary records. [2025-09-30T22:14:09.510534] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-30T22:14:09.528519] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-30T22:14:09.528687] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-30T22:14:09.531000] [INFO ] [MAIN ] Derivative Progress: 1443/2009 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 53s. Rate: 146.0 symbols/min [2025-09-30T22:14:09.531188] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:09.558972] [DEBUG] [LOCAL ] PRLB: Loaded 20503 existing records from primary storage. [2025-09-30T22:14:09.559311] [INFO ] [MAIN ] PRLB: Loaded 20503 primary data records. [2025-09-30T22:14:09.613414] [DEBUG] [LOCAL ] PRKS: Loaded 42482 existing records from primary storage. [2025-09-30T22:14:09.647052] [INFO ] [MAIN ] PRKS: Loaded 42482 primary data records. [2025-09-30T22:14:09.929784] [DEBUG] [LOCAL ] PRM: Loaded 44640 existing records from primary storage. [2025-09-30T22:14:09.992286] [INFO ] [MAIN ] PRM: Loaded 44640 primary data records. [2025-09-30T22:14:10.689625] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:10.690542] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20503 primary records. [2025-09-30T22:14:10.691195] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-30T22:14:10.713045] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:10.715053] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42482 primary records. [2025-09-30T22:14:10.717905] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-30T22:14:10.723142] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-30T22:14:10.723416] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-30T22:14:10.732788] [INFO ] [MAIN ] Derivative Progress: 1444/2009 symbols completed. PRLB took 1.2s. Estimated remaining: 3m 53s. Rate: 145.8 symbols/min [2025-09-30T22:14:10.733079] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:10.742896] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-30T22:14:10.743070] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-30T22:14:10.745362] [INFO ] [MAIN ] Derivative Progress: 1445/2009 symbols completed. PRKS took 1.3s. Estimated remaining: 3m 52s. Rate: 145.9 symbols/min [2025-09-30T22:14:10.745638] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:10.762064] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:10.762898] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44640 primary records. [2025-09-30T22:14:10.763018] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-30T22:14:10.781548] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-30T22:14:10.781682] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-30T22:14:10.784176] [INFO ] [MAIN ] Derivative Progress: 1446/2009 symbols completed. PRM took 1.3s. Estimated remaining: 3m 51s. Rate: 146.0 symbols/min [2025-09-30T22:14:10.784476] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:10.813940] [DEBUG] [LOCAL ] PRT: Loaded 5302 existing records from primary storage. [2025-09-30T22:14:10.814202] [INFO ] [MAIN ] PRT: Loaded 5302 primary data records. [2025-09-30T22:14:10.984763] [DEBUG] [LOCAL ] PRMB: Loaded 53145 existing records from primary storage. [2025-09-30T22:14:10.984952] [INFO ] [MAIN ] PRMB: Loaded 53145 primary data records. [2025-09-30T22:14:10.978837] [DEBUG] [LOCAL ] PRO: Loaded 38163 existing records from primary storage. [2025-09-30T22:14:10.995521] [INFO ] [MAIN ] PRO: Loaded 38163 primary data records. [2025-09-30T22:14:11.859528] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:11.861618] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5302 primary records. [2025-09-30T22:14:11.862127] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-30T22:14:11.881113] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-30T22:14:11.881281] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-30T22:14:11.883568] [INFO ] [MAIN ] Derivative Progress: 1447/2009 symbols completed. PRT took 1.1s. Estimated remaining: 3m 51s. Rate: 145.8 symbols/min [2025-09-30T22:14:11.883759] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:11.918788] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:11.916412] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:11.919774] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 38163 primary records. [2025-09-30T22:14:11.919888] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-30T22:14:11.921065] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53145 primary records. [2025-09-30T22:14:11.921497] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-30T22:14:11.938144] [DEBUG] [LOCAL ] PSBD: Loaded 7055 existing records from primary storage. [2025-09-30T22:14:11.938502] [INFO ] [MAIN ] PSBD: Loaded 7055 primary data records. [2025-09-30T22:14:12.001058] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-30T22:14:12.022468] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-30T22:14:12.031403] [INFO ] [MAIN ] Derivative Progress: 1448/2009 symbols completed. PRO took 1.3s. Estimated remaining: 3m 51s. Rate: 145.9 symbols/min [2025-09-30T22:14:12.044901] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:12.164760] [DEBUG] [LOCAL ] PSF: Loaded 6917 existing records from primary storage. [2025-09-30T22:14:12.128077] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-30T22:14:12.243452] [INFO ] [MAIN ] PSF: Loaded 6917 primary data records. [2025-09-30T22:14:12.335152] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-30T22:14:12.337998] [INFO ] [MAIN ] Derivative Progress: 1449/2009 symbols completed. PRMB took 1.6s. Estimated remaining: 3m 50s. Rate: 145.9 symbols/min [2025-09-30T22:14:12.353674] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:12.709029] [DEBUG] [LOCAL ] PSFE: Loaded 30067 existing records from primary storage. [2025-09-30T22:14:12.710686] [INFO ] [MAIN ] PSFE: Loaded 30067 primary data records. [2025-09-30T22:14:12.827742] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:12.865020] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 7055 primary records. [2025-09-30T22:14:12.869592] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-30T22:14:12.943276] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-09-30T22:14:12.988974] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-30T22:14:12.993020] [INFO ] [MAIN ] Derivative Progress: 1450/2009 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 50s. Rate: 145.8 symbols/min [2025-09-30T22:14:12.993909] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:12.993467] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:13.058371] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6917 primary records. [2025-09-30T22:14:13.123893] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-30T22:14:13.147508] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-30T22:14:13.147847] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-30T22:14:13.150683] [INFO ] [MAIN ] Derivative Progress: 1451/2009 symbols completed. PSF took 1.1s. Estimated remaining: 3m 49s. Rate: 145.9 symbols/min [2025-09-30T22:14:13.151391] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:13.185859] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:13.186634] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30067 primary records. [2025-09-30T22:14:13.186849] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-30T22:14:13.219458] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-30T22:14:13.219628] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-30T22:14:13.222292] [INFO ] [MAIN ] Derivative Progress: 1452/2009 symbols completed. PSFE took 0.9s. Estimated remaining: 3m 49s. Rate: 146.0 symbols/min [2025-09-30T22:14:13.222491] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:13.233015] [DEBUG] [LOCAL ] PSN: Loaded 46029 existing records from primary storage. [2025-09-30T22:14:13.233595] [INFO ] [MAIN ] PSN: Loaded 46029 primary data records. [2025-09-30T22:14:13.371456] [DEBUG] [LOCAL ] PSO: Loaded 37006 existing records from primary storage. [2025-09-30T22:14:13.387504] [INFO ] [MAIN ] PSO: Loaded 37006 primary data records. [2025-09-30T22:14:13.507254] [DEBUG] [LOCAL ] PSQH: Loaded 34894 existing records from primary storage. [2025-09-30T22:14:13.674318] [INFO ] [MAIN ] PSQH: Loaded 34894 primary data records. [2025-09-30T22:14:14.325723] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:14.327275] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46029 primary records. [2025-09-30T22:14:14.328143] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-30T22:14:14.347831] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-30T22:14:14.350298] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-30T22:14:14.353637] [INFO ] [MAIN ] Derivative Progress: 1453/2009 symbols completed. PSN took 1.4s. Estimated remaining: 3m 49s. Rate: 145.8 symbols/min [2025-09-30T22:14:14.367456] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:14.368218] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37006 primary records. [2025-09-30T22:14:14.368374] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-30T22:14:14.397304] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:14.399987] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34894 primary records. [2025-09-30T22:14:14.400549] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-30T22:14:14.400487] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-30T22:14:14.400680] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-30T22:14:14.403250] [INFO ] [MAIN ] Derivative Progress: 1454/2009 symbols completed. PSO took 1.3s. Estimated remaining: 3m 48s. Rate: 145.9 symbols/min [2025-09-30T22:14:14.419188] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-30T22:14:14.419258] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-30T22:14:14.421725] [INFO ] [MAIN ] Derivative Progress: 1455/2009 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 48s. Rate: 146.0 symbols/min [2025-09-30T22:14:14.422198] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:14.422137] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:14.422308] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:14.448296] [DEBUG] [LOCAL ] PSTL: Loaded 20068 existing records from primary storage. [2025-09-30T22:14:14.454788] [INFO ] [MAIN ] PSTL: Loaded 20068 primary data records. [2025-09-30T22:14:14.455378] [DEBUG] [LOCAL ] PTA: Loaded 14822 existing records from primary storage. [2025-09-30T22:14:14.466889] [INFO ] [MAIN ] PTA: Loaded 14822 primary data records. [2025-09-30T22:14:14.999347] [DEBUG] [LOCAL ] PSTG: Loaded 52841 existing records from primary storage. [2025-09-30T22:14:15.121701] [INFO ] [MAIN ] PSTG: Loaded 52841 primary data records. [2025-09-30T22:14:15.506686] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:15.508003] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:15.509056] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 14822 primary records. [2025-09-30T22:14:15.509159] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-30T22:14:15.509848] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20068 primary records. [2025-09-30T22:14:15.510030] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-30T22:14:15.548841] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-30T22:14:15.549189] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-30T22:14:15.547862] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-30T22:14:15.549352] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-30T22:14:15.552532] [INFO ] [MAIN ] Derivative Progress: 1456/2009 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 48s. Rate: 145.8 symbols/min [2025-09-30T22:14:15.555894] [INFO ] [MAIN ] Derivative Progress: 1457/2009 symbols completed. PTA took 1.1s. Estimated remaining: 3m 47s. Rate: 145.9 symbols/min [2025-09-30T22:14:15.556108] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:15.555731] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:15.577186] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:15.578161] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52841 primary records. [2025-09-30T22:14:15.578322] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-30T22:14:15.617605] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-30T22:14:15.617989] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-30T22:14:15.620602] [INFO ] [MAIN ] Derivative Progress: 1458/2009 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 46s. Rate: 146.0 symbols/min [2025-09-30T22:14:15.621021] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:15.640470] [DEBUG] [LOCAL ] PTY: Loaded 37302 existing records from primary storage. [2025-09-30T22:14:15.659352] [INFO ] [MAIN ] PTY: Loaded 37302 primary data records. [2025-09-30T22:14:15.665526] [DEBUG] [LOCAL ] PUK: Loaded 44765 existing records from primary storage. [2025-09-30T22:14:15.672730] [INFO ] [MAIN ] PUK: Loaded 44765 primary data records. [2025-09-30T22:14:16.094170] [DEBUG] [LOCAL ] PUMP: Loaded 49391 existing records from primary storage. [2025-09-30T22:14:16.143455] [INFO ] [MAIN ] PUMP: Loaded 49391 primary data records. [2025-09-30T22:14:16.778818] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:16.785307] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37302 primary records. [2025-09-30T22:14:16.786533] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-30T22:14:16.813846] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:16.817760] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44765 primary records. [2025-09-30T22:14:16.818157] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-30T22:14:16.819677] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-30T22:14:16.820398] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-30T22:14:16.823051] [INFO ] [MAIN ] Derivative Progress: 1459/2009 symbols completed. PTY took 1.3s. Estimated remaining: 3m 46s. Rate: 145.8 symbols/min [2025-09-30T22:14:16.823368] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:16.841625] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-30T22:14:16.841915] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-30T22:14:16.844742] [INFO ] [MAIN ] Derivative Progress: 1460/2009 symbols completed. PUK took 1.3s. Estimated remaining: 3m 46s. Rate: 145.9 symbols/min [2025-09-30T22:14:16.844980] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:16.862901] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:16.863853] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49391 primary records. [2025-09-30T22:14:16.863942] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-30T22:14:16.868986] [DEBUG] [LOCAL ] PVL: Loaded 4765 existing records from primary storage. [2025-09-30T22:14:16.878058] [INFO ] [MAIN ] PVL: Loaded 4765 primary data records. [2025-09-30T22:14:17.013136] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-30T22:14:17.013406] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-30T22:14:17.017005] [INFO ] [MAIN ] Derivative Progress: 1461/2009 symbols completed. PUMP took 1.4s. Estimated remaining: 3m 45s. Rate: 146.0 symbols/min [2025-09-30T22:14:17.028307] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:17.119962] [DEBUG] [LOCAL ] PVH: Loaded 50414 existing records from primary storage. [2025-09-30T22:14:17.240568] [INFO ] [MAIN ] PVH: Loaded 50414 primary data records. [2025-09-30T22:14:17.591199] [DEBUG] [LOCAL ] PX: Loaded 34583 existing records from primary storage. [2025-09-30T22:14:17.601341] [INFO ] [MAIN ] PX: Loaded 34583 primary data records. [2025-09-30T22:14:17.815091] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:17.821609] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4765 primary records. [2025-09-30T22:14:17.944776] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-30T22:14:17.972623] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-30T22:14:17.973348] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-30T22:14:17.988524] [INFO ] [MAIN ] Derivative Progress: 1462/2009 symbols completed. PVL took 1.1s. Estimated remaining: 3m 45s. Rate: 145.8 symbols/min [2025-09-30T22:14:17.993983] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:17.994353] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:17.997366] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50414 primary records. [2025-09-30T22:14:17.997702] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-30T22:14:18.019935] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-30T22:14:18.022156] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-30T22:14:18.024789] [INFO ] [MAIN ] Derivative Progress: 1463/2009 symbols completed. PVH took 1.2s. Estimated remaining: 3m 44s. Rate: 145.9 symbols/min [2025-09-30T22:14:18.025716] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:18.047568] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:18.048448] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34583 primary records. [2025-09-30T22:14:18.048516] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-30T22:14:18.074762] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-30T22:14:18.075000] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-30T22:14:18.077672] [INFO ] [MAIN ] Derivative Progress: 1464/2009 symbols completed. PX took 1.0s. Estimated remaining: 3m 44s. Rate: 146.0 symbols/min [2025-09-30T22:14:18.078692] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:18.078457] [DEBUG] [LOCAL ] QD: Loaded 27991 existing records from primary storage. [2025-09-30T22:14:18.079000] [INFO ] [MAIN ] QD: Loaded 27991 primary data records. [2025-09-30T22:14:18.434306] [DEBUG] [LOCAL ] QGEN: Loaded 49069 existing records from primary storage. [2025-09-30T22:14:18.449904] [INFO ] [MAIN ] QGEN: Loaded 49069 primary data records. [2025-09-30T22:14:18.467636] [DEBUG] [LOCAL ] QS: Loaded 53743 existing records from primary storage. [2025-09-30T22:14:18.489884] [INFO ] [MAIN ] QS: Loaded 53743 primary data records. [2025-09-30T22:14:19.174861] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:19.177529] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27991 primary records. [2025-09-30T22:14:19.177814] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-30T22:14:19.197521] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-30T22:14:19.198019] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-30T22:14:19.200857] [INFO ] [MAIN ] Derivative Progress: 1465/2009 symbols completed. QD took 1.2s. Estimated remaining: 3m 44s. Rate: 145.8 symbols/min [2025-09-30T22:14:19.201319] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:19.222126] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:19.222983] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49069 primary records. [2025-09-30T22:14:19.223138] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-30T22:14:19.236411] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:19.237183] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53743 primary records. [2025-09-30T22:14:19.237432] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-30T22:14:19.280504] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-30T22:14:19.280972] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-30T22:14:19.283151] [INFO ] [MAIN ] Derivative Progress: 1466/2009 symbols completed. QGEN took 1.3s. Estimated remaining: 3m 43s. Rate: 145.9 symbols/min [2025-09-30T22:14:19.284877] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-30T22:14:19.285031] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-30T22:14:19.284113] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:19.287908] [INFO ] [MAIN ] Derivative Progress: 1467/2009 symbols completed. QS took 1.2s. Estimated remaining: 3m 43s. Rate: 146.0 symbols/min [2025-09-30T22:14:19.288278] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:19.313494] [DEBUG] [LOCAL ] QSR: Loaded 52419 existing records from primary storage. [2025-09-30T22:14:19.319359] [INFO ] [MAIN ] QSR: Loaded 52419 primary data records. [2025-09-30T22:14:19.454141] [DEBUG] [LOCAL ] QUAD: Loaded 23347 existing records from primary storage. [2025-09-30T22:14:19.455292] [INFO ] [MAIN ] QUAD: Loaded 23347 primary data records. [2025-09-30T22:14:19.597253] [DEBUG] [LOCAL ] QTWO: Loaded 38997 existing records from primary storage. [2025-09-30T22:14:19.729449] [INFO ] [MAIN ] QTWO: Loaded 38997 primary data records. [2025-09-30T22:14:20.400607] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:20.403262] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52419 primary records. [2025-09-30T22:14:20.403724] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-30T22:14:20.424236] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-30T22:14:20.425127] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-30T22:14:20.428357] [INFO ] [MAIN ] Derivative Progress: 1468/2009 symbols completed. QSR took 1.2s. Estimated remaining: 3m 43s. Rate: 145.8 symbols/min [2025-09-30T22:14:20.450243] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:20.452008] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23347 primary records. [2025-09-30T22:14:20.452564] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-30T22:14:20.480066] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:20.481312] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 38997 primary records. [2025-09-30T22:14:20.481915] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-30T22:14:20.492400] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-30T22:14:20.495909] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-30T22:14:20.498963] [INFO ] [MAIN ] Derivative Progress: 1469/2009 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 42s. Rate: 145.9 symbols/min [2025-09-30T22:14:20.503563] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-30T22:14:20.503831] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-30T22:14:20.506277] [INFO ] [MAIN ] Derivative Progress: 1470/2009 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 41s. Rate: 146.0 symbols/min [2025-09-30T22:14:20.507080] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:20.507402] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:20.507245] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:20.520078] [DEBUG] [LOCAL ] QVCD: Loaded 4494 existing records from primary storage. [2025-09-30T22:14:20.520268] [INFO ] [MAIN ] QVCD: Loaded 4494 primary data records. [2025-09-30T22:14:20.563038] [DEBUG] [LOCAL ] QVCC: Loaded 8910 existing records from primary storage. [2025-09-30T22:14:20.593107] [INFO ] [MAIN ] QVCC: Loaded 8910 primary data records. [2025-09-30T22:14:21.268572] [DEBUG] [LOCAL ] QXO: Loaded 53245 existing records from primary storage. [2025-09-30T22:14:21.269581] [INFO ] [MAIN ] QXO: Loaded 53245 primary data records. [2025-09-30T22:14:21.629357] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:21.630713] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4494 primary records. [2025-09-30T22:14:21.630833] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-30T22:14:21.667542] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-09-30T22:14:21.673435] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:21.674080] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-30T22:14:21.675101] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8910 primary records. [2025-09-30T22:14:21.677807] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-30T22:14:21.677492] [INFO ] [MAIN ] Derivative Progress: 1471/2009 symbols completed. QVCD took 1.2s. Estimated remaining: 3m 41s. Rate: 145.8 symbols/min [2025-09-30T22:14:21.679280] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:21.697108] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-30T22:14:21.697385] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-30T22:14:21.701463] [INFO ] [MAIN ] Derivative Progress: 1472/2009 symbols completed. QVCC took 1.2s. Estimated remaining: 3m 41s. Rate: 145.9 symbols/min [2025-09-30T22:14:21.703149] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:21.719270] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:21.728702] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53245 primary records. [2025-09-30T22:14:21.728997] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-30T22:14:21.762588] [DEBUG] [LOCAL ] R: Loaded 29054 existing records from primary storage. [2025-09-30T22:14:21.770881] [INFO ] [MAIN ] R: Loaded 29054 primary data records. [2025-09-30T22:14:21.770786] [DEBUG] [LOCAL ] RA: Loaded 21757 existing records from primary storage. [2025-09-30T22:14:21.772572] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-30T22:14:21.785844] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-30T22:14:21.772802] [INFO ] [MAIN ] RA: Loaded 21757 primary data records. [2025-09-30T22:14:21.790295] [INFO ] [MAIN ] Derivative Progress: 1473/2009 symbols completed. QXO took 1.3s. Estimated remaining: 3m 40s. Rate: 146.0 symbols/min [2025-09-30T22:14:21.851423] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:22.465977] [DEBUG] [LOCAL ] RACE: Loaded 32575 existing records from primary storage. [2025-09-30T22:14:22.466363] [INFO ] [MAIN ] RACE: Loaded 32575 primary data records. [2025-09-30T22:14:22.929026] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:22.930515] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21757 primary records. [2025-09-30T22:14:22.945109] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-30T22:14:22.947182] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:22.960463] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29054 primary records. [2025-09-30T22:14:22.966610] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-30T22:14:22.967525] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-30T22:14:22.971841] [INFO ] [MAIN ] Derivative Progress: 1474/2009 symbols completed. RA took 1.3s. Estimated remaining: 3m 40s. Rate: 145.8 symbols/min [2025-09-30T22:14:22.972273] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:22.967372] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-30T22:14:22.998667] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-30T22:14:22.999245] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-30T22:14:23.002561] [INFO ] [MAIN ] Derivative Progress: 1475/2009 symbols completed. R took 1.3s. Estimated remaining: 3m 40s. Rate: 145.9 symbols/min [2025-09-30T22:14:23.003198] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:23.021325] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:23.022305] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32575 primary records. [2025-09-30T22:14:23.022378] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-30T22:14:23.054075] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-30T22:14:23.054292] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-30T22:14:23.058328] [INFO ] [MAIN ] Derivative Progress: 1476/2009 symbols completed. RACE took 1.2s. Estimated remaining: 3m 39s. Rate: 146.0 symbols/min [2025-09-30T22:14:23.059748] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:23.084186] [DEBUG] [LOCAL ] RAMP: Loaded 37507 existing records from primary storage. [2025-09-30T22:14:23.084774] [INFO ] [MAIN ] RAMP: Loaded 37507 primary data records. [2025-09-30T22:14:23.225760] [DEBUG] [LOCAL ] RBA: Loaded 45858 existing records from primary storage. [2025-09-30T22:14:23.265402] [DEBUG] [LOCAL ] RBC: Loaded 15117 existing records from primary storage. [2025-09-30T22:14:23.265568] [INFO ] [MAIN ] RBA: Loaded 45858 primary data records. [2025-09-30T22:14:23.266172] [INFO ] [MAIN ] RBC: Loaded 15117 primary data records. [2025-09-30T22:14:24.155803] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:24.158288] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37507 primary records. [2025-09-30T22:14:24.161089] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-30T22:14:24.180177] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-30T22:14:24.198031] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:24.197525] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-30T22:14:24.199507] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 45858 primary records. [2025-09-30T22:14:24.201971] [INFO ] [MAIN ] Derivative Progress: 1477/2009 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 39s. Rate: 145.8 symbols/min [2025-09-30T22:14:24.199844] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-30T22:14:24.215981] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:24.219207] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:24.232923] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15117 primary records. [2025-09-30T22:14:24.233769] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-30T22:14:24.254889] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-30T22:14:24.256116] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-30T22:14:24.256793] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-30T22:14:24.259927] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-30T22:14:24.259829] [INFO ] [MAIN ] Derivative Progress: 1478/2009 symbols completed. RBC took 1.2s. Estimated remaining: 3m 38s. Rate: 145.9 symbols/min [2025-09-30T22:14:24.262954] [INFO ] [MAIN ] Derivative Progress: 1479/2009 symbols completed. RBA took 1.3s. Estimated remaining: 3m 38s. Rate: 146.0 symbols/min [2025-09-30T22:14:24.262755] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:24.263110] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:24.272550] [DEBUG] [LOCAL ] RBOT: Loaded 5197 existing records from primary storage. [2025-09-30T22:14:24.272738] [INFO ] [MAIN ] RBOT: Loaded 5197 primary data records. [2025-09-30T22:14:24.479856] [DEBUG] [LOCAL ] RBLX: Loaded 53716 existing records from primary storage. [2025-09-30T22:14:24.532295] [INFO ] [MAIN ] RBLX: Loaded 53716 primary data records. [2025-09-30T22:14:24.794253] [DEBUG] [LOCAL ] RBRK: Loaded 53132 existing records from primary storage. [2025-09-30T22:14:24.795577] [INFO ] [MAIN ] RBRK: Loaded 53132 primary data records. [2025-09-30T22:14:25.447907] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:25.451025] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5197 primary records. [2025-09-30T22:14:25.451401] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-30T22:14:25.469954] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-30T22:14:25.470064] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-30T22:14:25.472730] [INFO ] [MAIN ] Derivative Progress: 1480/2009 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 38s. Rate: 145.8 symbols/min [2025-09-30T22:14:25.473405] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:25.495536] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:25.509094] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53716 primary records. [2025-09-30T22:14:25.509741] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-30T22:14:25.509590] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:25.510788] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53132 primary records. [2025-09-30T22:14:25.511516] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-30T22:14:25.558693] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-30T22:14:25.559675] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-30T22:14:25.559403] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-30T22:14:25.563206] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-30T22:14:25.562925] [INFO ] [MAIN ] Derivative Progress: 1481/2009 symbols completed. RBLX took 1.3s. Estimated remaining: 3m 37s. Rate: 145.9 symbols/min [2025-09-30T22:14:25.567811] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:25.568606] [INFO ] [MAIN ] Derivative Progress: 1482/2009 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 37s. Rate: 146.0 symbols/min [2025-09-30T22:14:25.568932] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:25.586473] [DEBUG] [LOCAL ] RC: Loaded 48947 existing records from primary storage. [2025-09-30T22:14:25.586883] [INFO ] [MAIN ] RC: Loaded 48947 primary data records. [2025-09-30T22:14:25.711721] [DEBUG] [LOCAL ] RCS: Loaded 11474 existing records from primary storage. [2025-09-30T22:14:25.729289] [INFO ] [MAIN ] RCS: Loaded 11474 primary data records. [2025-09-30T22:14:26.159063] [DEBUG] [LOCAL ] RCI: Loaded 48628 existing records from primary storage. [2025-09-30T22:14:26.163571] [INFO ] [MAIN ] RCI: Loaded 48628 primary data records. [2025-09-30T22:14:26.642579] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:26.644480] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48947 primary records. [2025-09-30T22:14:26.645063] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-30T22:14:26.682358] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:26.684422] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11474 primary records. [2025-09-30T22:14:26.684616] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-30T22:14:26.687385] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-30T22:14:26.688142] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-30T22:14:26.697978] [INFO ] [MAIN ] Derivative Progress: 1483/2009 symbols completed. RC took 1.2s. Estimated remaining: 3m 36s. Rate: 145.8 symbols/min [2025-09-30T22:14:26.710381] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-30T22:14:26.723858] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-30T22:14:26.727479] [INFO ] [MAIN ] Derivative Progress: 1484/2009 symbols completed. RCS took 1.2s. Estimated remaining: 3m 36s. Rate: 145.9 symbols/min [2025-09-30T22:14:26.728030] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:26.729036] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48628 primary records. [2025-09-30T22:14:26.729123] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-30T22:14:26.745396] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-30T22:14:26.745463] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-30T22:14:26.750216] [INFO ] [MAIN ] Derivative Progress: 1485/2009 symbols completed. RCI took 1.2s. Estimated remaining: 3m 35s. Rate: 146.0 symbols/min [2025-09-30T22:14:26.750789] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:26.751291] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:26.750740] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:26.835549] [DEBUG] [LOCAL ] RCUS: Loaded 42393 existing records from primary storage. [2025-09-30T22:14:26.836013] [INFO ] [MAIN ] RCUS: Loaded 42393 primary data records. [2025-09-30T22:14:26.910473] [DEBUG] [LOCAL ] RDN: Loaded 45113 existing records from primary storage. [2025-09-30T22:14:26.919750] [INFO ] [MAIN ] RDN: Loaded 45113 primary data records. [2025-09-30T22:14:27.052991] [DEBUG] [LOCAL ] RDDT: Loaded 53780 existing records from primary storage. [2025-09-30T22:14:27.083117] [INFO ] [MAIN ] RDDT: Loaded 53780 primary data records. [2025-09-30T22:14:27.926829] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:27.941290] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42393 primary records. [2025-09-30T22:14:27.941792] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-30T22:14:27.942168] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:27.944728] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45113 primary records. [2025-09-30T22:14:27.945024] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-30T22:14:27.977313] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-30T22:14:27.979295] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-30T22:14:27.982045] [INFO ] [MAIN ] Derivative Progress: 1486/2009 symbols completed. RCUS took 1.2s. Estimated remaining: 3m 35s. Rate: 145.8 symbols/min [2025-09-30T22:14:27.983277] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:27.999412] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:28.000834] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53780 primary records. [2025-09-30T22:14:28.000948] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-30T22:14:28.001358] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-30T22:14:28.002385] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-30T22:14:28.005096] [INFO ] [MAIN ] Derivative Progress: 1487/2009 symbols completed. RDN took 1.3s. Estimated remaining: 3m 35s. Rate: 145.9 symbols/min [2025-09-30T22:14:28.015126] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:28.023751] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-30T22:14:28.023911] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-30T22:14:28.026692] [INFO ] [MAIN ] Derivative Progress: 1488/2009 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 34s. Rate: 146.0 symbols/min [2025-09-30T22:14:28.026868] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:28.092508] [DEBUG] [LOCAL ] RDW: Loaded 52028 existing records from primary storage. [2025-09-30T22:14:28.092912] [INFO ] [MAIN ] RDW: Loaded 52028 primary data records. [2025-09-30T22:14:28.231142] [DEBUG] [LOCAL ] RELX: Loaded 47872 existing records from primary storage. [2025-09-30T22:14:28.237958] [INFO ] [MAIN ] RELX: Loaded 47872 primary data records. [2025-09-30T22:14:28.232490] [DEBUG] [LOCAL ] RDY: Loaded 46821 existing records from primary storage. [2025-09-30T22:14:28.253863] [INFO ] [MAIN ] RDY: Loaded 46821 primary data records. [2025-09-30T22:14:29.202378] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:29.204236] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52028 primary records. [2025-09-30T22:14:29.204441] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-30T22:14:29.223784] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-30T22:14:29.227336] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-30T22:14:29.229679] [INFO ] [MAIN ] Derivative Progress: 1489/2009 symbols completed. RDW took 1.2s. Estimated remaining: 3m 34s. Rate: 145.8 symbols/min [2025-09-30T22:14:29.230370] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:29.245591] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:29.246877] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47872 primary records. [2025-09-30T22:14:29.247072] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-30T22:14:29.283100] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:29.285258] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46821 primary records. [2025-09-30T22:14:29.285932] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-30T22:14:29.312450] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-30T22:14:29.313425] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-30T22:14:29.317534] [INFO ] [MAIN ] Derivative Progress: 1490/2009 symbols completed. RELX took 1.3s. Estimated remaining: 3m 33s. Rate: 145.9 symbols/min [2025-09-30T22:14:29.318076] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:29.336614] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-30T22:14:29.337051] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-30T22:14:29.342868] [INFO ] [MAIN ] Derivative Progress: 1491/2009 symbols completed. RDY took 1.3s. Estimated remaining: 3m 33s. Rate: 146.0 symbols/min [2025-09-30T22:14:29.337821] [DEBUG] [LOCAL ] RERE: Loaded 41062 existing records from primary storage. [2025-09-30T22:14:29.343320] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:29.343610] [INFO ] [MAIN ] RERE: Loaded 41062 primary data records. [2025-09-30T22:14:29.599288] [DEBUG] [LOCAL ] RES: Loaded 47433 existing records from primary storage. [2025-09-30T22:14:29.767935] [INFO ] [MAIN ] RES: Loaded 47433 primary data records. [2025-09-30T22:14:29.768845] [DEBUG] [LOCAL ] REVG: Loaded 40744 existing records from primary storage. [2025-09-30T22:14:29.774696] [INFO ] [MAIN ] REVG: Loaded 40744 primary data records. [2025-09-30T22:14:30.488219] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:30.490314] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41062 primary records. [2025-09-30T22:14:30.490624] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-30T22:14:30.519783] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-30T22:14:30.520677] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-30T22:14:30.523833] [INFO ] [MAIN ] Derivative Progress: 1492/2009 symbols completed. RERE took 1.3s. Estimated remaining: 3m 33s. Rate: 145.8 symbols/min [2025-09-30T22:14:30.525676] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:30.549768] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:30.555842] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47433 primary records. [2025-09-30T22:14:30.564411] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-30T22:14:30.579504] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:30.594201] [DEBUG] [LOCAL ] REX: Loaded 14075 existing records from primary storage. [2025-09-30T22:14:30.595970] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-30T22:14:30.595295] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40744 primary records. [2025-09-30T22:14:30.596310] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-30T22:14:30.596083] [INFO ] [MAIN ] REX: Loaded 14075 primary data records. [2025-09-30T22:14:30.601681] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-30T22:14:30.612421] [INFO ] [MAIN ] Derivative Progress: 1493/2009 symbols completed. RES took 1.3s. Estimated remaining: 3m 32s. Rate: 145.9 symbols/min [2025-09-30T22:14:30.661418] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:30.686122] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-30T22:14:30.686332] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-30T22:14:30.695115] [INFO ] [MAIN ] Derivative Progress: 1494/2009 symbols completed. REVG took 1.4s. Estimated remaining: 3m 32s. Rate: 145.9 symbols/min [2025-09-30T22:14:30.707580] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:30.990997] [DEBUG] [LOCAL ] REXR: Loaded 52091 existing records from primary storage. [2025-09-30T22:14:30.991387] [INFO ] [MAIN ] REXR: Loaded 52091 primary data records. [2025-09-30T22:14:31.089003] [DEBUG] [LOCAL ] REZI: Loaded 46920 existing records from primary storage. [2025-09-30T22:14:31.114517] [INFO ] [MAIN ] REZI: Loaded 46920 primary data records. [2025-09-30T22:14:31.199120] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:31.282496] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 14075 primary records. [2025-09-30T22:14:31.343509] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-30T22:14:31.601374] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-30T22:14:31.610675] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-30T22:14:31.612840] [INFO ] [MAIN ] Derivative Progress: 1495/2009 symbols completed. REX took 1.1s. Estimated remaining: 3m 31s. Rate: 145.8 symbols/min [2025-09-30T22:14:31.738600] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:31.764893] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-09-30T22:14:31.765685] [INFO ] [MAIN ] RFI: Loaded 10454 primary data records. [2025-09-30T22:14:31.875157] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:31.899348] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52091 primary records. [2025-09-30T22:14:31.910774] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-30T22:14:32.284083] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:32.145815] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-30T22:14:32.302845] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46920 primary records. [2025-09-30T22:14:32.303220] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-30T22:14:32.303503] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-30T22:14:32.314017] [INFO ] [MAIN ] Derivative Progress: 1496/2009 symbols completed. REXR took 1.7s. Estimated remaining: 3m 31s. Rate: 145.8 symbols/min [2025-09-30T22:14:32.314328] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:32.358007] [DEBUG] [LOCAL ] RFL: Loaded 11125 existing records from primary storage. [2025-09-30T22:14:32.359335] [INFO ] [MAIN ] RFL: Loaded 11125 primary data records. [2025-09-30T22:14:32.361810] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-30T22:14:32.380482] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-30T22:14:32.399864] [INFO ] [MAIN ] Derivative Progress: 1497/2009 symbols completed. REZI took 1.7s. Estimated remaining: 3m 31s. Rate: 145.8 symbols/min [2025-09-30T22:14:32.408132] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:32.506638] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:32.535355] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10454 primary records. [2025-09-30T22:14:32.523457] [DEBUG] [LOCAL ] RFM: Loaded 4155 existing records from primary storage. [2025-09-30T22:14:32.540795] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-30T22:14:32.560252] [INFO ] [MAIN ] RFM: Loaded 4155 primary data records. [2025-09-30T22:14:33.031407] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-30T22:14:33.055310] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-30T22:14:33.095454] [INFO ] [MAIN ] Derivative Progress: 1498/2009 symbols completed. RFI took 1.4s. Estimated remaining: 3m 30s. Rate: 145.8 symbols/min [2025-09-30T22:14:33.288845] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:33.290638] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11125 primary records. [2025-09-30T22:14:33.290957] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-30T22:14:33.307609] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-30T22:14:33.307957] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-30T22:14:33.310779] [INFO ] [MAIN ] Derivative Progress: 1499/2009 symbols completed. RFL took 1.0s. Estimated remaining: 3m 30s. Rate: 145.8 symbols/min [2025-09-30T22:14:33.327012] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:33.327760] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4155 primary records. [2025-09-30T22:14:33.327830] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-30T22:14:33.342720] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-30T22:14:33.342848] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-30T22:14:33.348053] [INFO ] [MAIN ] Derivative Progress: 1500/2009 symbols completed. RFM took 0.9s. Estimated remaining: 3m 29s. Rate: 145.9 symbols/min [2025-09-30T22:14:33.348846] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:33.348948] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:33.348722] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:33.362832] [DEBUG] [LOCAL ] RFMZ: Loaded 8740 existing records from primary storage. [2025-09-30T22:14:33.363076] [INFO ] [MAIN ] RFMZ: Loaded 8740 primary data records. [2025-09-30T22:14:33.507490] [DEBUG] [LOCAL ] RGR: Loaded 20604 existing records from primary storage. [2025-09-30T22:14:33.508190] [INFO ] [MAIN ] RGR: Loaded 20604 primary data records. [2025-09-30T22:14:33.508982] [DEBUG] [LOCAL ] RGA: Loaded 29726 existing records from primary storage. [2025-09-30T22:14:33.519808] [INFO ] [MAIN ] RGA: Loaded 29726 primary data records. [2025-09-30T22:14:34.477198] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:14:34.479539] [INFO ] [MAIN ] RFMZ: Generated 1793 derivative records from 8740 primary records. [2025-09-30T22:14:34.479996] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-30T22:14:34.517202] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1793 records). [2025-09-30T22:14:34.517783] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:34.518929] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 29726 primary records. [2025-09-30T22:14:34.518049] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-30T22:14:34.519102] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-30T22:14:34.521247] [INFO ] [MAIN ] Derivative Progress: 1501/2009 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 29s. Rate: 145.7 symbols/min [2025-09-30T22:14:34.522524] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:34.556274] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-30T22:14:34.556955] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-30T22:14:34.556721] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:34.561781] [INFO ] [MAIN ] Derivative Progress: 1502/2009 symbols completed. RGA took 1.2s. Estimated remaining: 3m 29s. Rate: 145.8 symbols/min [2025-09-30T22:14:34.563151] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20604 primary records. [2025-09-30T22:14:34.562194] [DEBUG] [LOCAL ] RGT: Loaded 2785 existing records from primary storage. [2025-09-30T22:14:34.563344] [INFO ] [MAIN ] RGT: Loaded 2785 primary data records. [2025-09-30T22:14:34.563484] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:34.569001] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-30T22:14:34.726078] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-30T22:14:34.742207] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-30T22:14:34.807420] [INFO ] [MAIN ] Derivative Progress: 1503/2009 symbols completed. RGR took 1.5s. Estimated remaining: 3m 28s. Rate: 145.8 symbols/min [2025-09-30T22:14:34.813816] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:34.973819] [DEBUG] [LOCAL ] RH: Loaded 47576 existing records from primary storage. [2025-09-30T22:14:34.974382] [INFO ] [MAIN ] RH: Loaded 47576 primary data records. [2025-09-30T22:14:35.135474] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:35.191461] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2785 primary records. [2025-09-30T22:14:35.281273] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-30T22:14:35.339071] [DEBUG] [LOCAL ] RHI: Loaded 49260 existing records from primary storage. [2025-09-30T22:14:35.343790] [INFO ] [MAIN ] RHI: Loaded 49260 primary data records. [2025-09-30T22:14:35.371810] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-30T22:14:35.403081] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-30T22:14:35.413741] [INFO ] [MAIN ] Derivative Progress: 1504/2009 symbols completed. RGT took 0.9s. Estimated remaining: 3m 28s. Rate: 145.8 symbols/min [2025-09-30T22:14:35.429895] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:35.711315] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:14:35.712821] [INFO ] [MAIN ] RH: Generated 1793 derivative records from 47576 primary records. [2025-09-30T22:14:35.723555] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-30T22:14:35.726343] [DEBUG] [LOCAL ] RHP: Loaded 41313 existing records from primary storage. [2025-09-30T22:14:35.727059] [INFO ] [MAIN ] RHP: Loaded 41313 primary data records. [2025-09-30T22:14:35.797539] [DEBUG] [LOCAL ] RH: Derivative data saved (1793 records). [2025-09-30T22:14:35.815207] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-30T22:14:35.830223] [INFO ] [MAIN ] Derivative Progress: 1505/2009 symbols completed. RH took 1.3s. Estimated remaining: 3m 27s. Rate: 145.8 symbols/min [2025-09-30T22:14:35.841038] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:36.100127] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:36.101348] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49260 primary records. [2025-09-30T22:14:36.101664] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-30T22:14:36.138860] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-30T22:14:36.139036] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-30T22:14:36.142302] [INFO ] [MAIN ] Derivative Progress: 1506/2009 symbols completed. RHI took 1.3s. Estimated remaining: 3m 27s. Rate: 145.8 symbols/min [2025-09-30T22:14:36.143152] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:36.163154] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-09-30T22:14:36.163685] [INFO ] [MAIN ] RIG: Loaded 53670 primary data records. [2025-09-30T22:14:36.302972] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:36.319777] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41313 primary records. [2025-09-30T22:14:36.334928] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-30T22:14:36.599577] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-30T22:14:36.598210] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-30T22:14:36.600920] [INFO ] [MAIN ] RIO: Loaded 53394 primary data records. [2025-09-30T22:14:36.601025] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-30T22:14:36.603239] [INFO ] [MAIN ] Derivative Progress: 1507/2009 symbols completed. RHP took 1.2s. Estimated remaining: 3m 27s. Rate: 145.8 symbols/min [2025-09-30T22:14:36.609376] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:36.960868] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:36.962637] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53670 primary records. [2025-09-30T22:14:36.962794] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-30T22:14:36.997518] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-30T22:14:36.997719] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-30T22:14:36.998785] [DEBUG] [LOCAL ] RITM: Loaded 52825 existing records from primary storage. [2025-09-30T22:14:37.001501] [INFO ] [MAIN ] RITM: Loaded 52825 primary data records. [2025-09-30T22:14:37.001393] [INFO ] [MAIN ] Derivative Progress: 1508/2009 symbols completed. RIG took 1.2s. Estimated remaining: 3m 26s. Rate: 145.8 symbols/min [2025-09-30T22:14:37.001704] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:37.139778] [DEBUG] [LOCAL ] RIV: Loaded 12159 existing records from primary storage. [2025-09-30T22:14:37.150630] [INFO ] [MAIN ] RIV: Loaded 12159 primary data records. [2025-09-30T22:14:37.275559] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:37.412631] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53394 primary records. [2025-09-30T22:14:37.461229] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-30T22:14:37.713673] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-30T22:14:37.713833] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-30T22:14:37.715964] [INFO ] [MAIN ] Derivative Progress: 1509/2009 symbols completed. RIO took 1.6s. Estimated remaining: 3m 26s. Rate: 145.7 symbols/min [2025-09-30T22:14:37.716564] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:37.742231] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:37.743327] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52825 primary records. [2025-09-30T22:14:37.743470] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-30T22:14:37.786066] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-30T22:14:37.785965] [DEBUG] [LOCAL ] RLI: Loaded 33400 existing records from primary storage. [2025-09-30T22:14:37.786958] [INFO ] [MAIN ] RLI: Loaded 33400 primary data records. [2025-09-30T22:14:37.787089] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-30T22:14:37.789415] [INFO ] [MAIN ] Derivative Progress: 1510/2009 symbols completed. RITM took 1.2s. Estimated remaining: 3m 25s. Rate: 145.8 symbols/min [2025-09-30T22:14:37.794885] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:37.875845] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:37.900963] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12159 primary records. [2025-09-30T22:14:37.923588] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-30T22:14:38.039003] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-30T22:14:38.154834] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-30T22:14:38.179176] [INFO ] [MAIN ] Derivative Progress: 1511/2009 symbols completed. RIV took 1.2s. Estimated remaining: 3m 25s. Rate: 145.8 symbols/min [2025-09-30T22:14:38.180742] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:38.182144] [DEBUG] [LOCAL ] RLJ: Loaded 48102 existing records from primary storage. [2025-09-30T22:14:38.182351] [INFO ] [MAIN ] RLJ: Loaded 48102 primary data records. [2025-09-30T22:14:38.282244] [DEBUG] [LOCAL ] RLTY: Loaded 11138 existing records from primary storage. [2025-09-30T22:14:38.307869] [INFO ] [MAIN ] RLTY: Loaded 11138 primary data records. [2025-09-30T22:14:38.916164] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:38.917462] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33400 primary records. [2025-09-30T22:14:38.917727] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-30T22:14:38.945340] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-30T22:14:38.945755] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-30T22:14:38.948424] [INFO ] [MAIN ] Derivative Progress: 1512/2009 symbols completed. RLI took 1.2s. Estimated remaining: 3m 25s. Rate: 145.7 symbols/min [2025-09-30T22:14:38.948942] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:38.969493] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:38.970748] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48102 primary records. [2025-09-30T22:14:38.970850] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-30T22:14:38.992071] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-30T22:14:38.992906] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-30T22:14:38.995054] [INFO ] [MAIN ] Derivative Progress: 1513/2009 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 24s. Rate: 145.8 symbols/min [2025-09-30T22:14:39.010211] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:39.010987] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11138 primary records. [2025-09-30T22:14:39.011140] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-30T22:14:39.039874] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-30T22:14:39.040086] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-30T22:14:39.042627] [INFO ] [MAIN ] Derivative Progress: 1514/2009 symbols completed. RLTY took 0.9s. Estimated remaining: 3m 24s. Rate: 145.9 symbols/min [2025-09-30T22:14:39.060302] [DEBUG] [LOCAL ] RLX: Loaded 48332 existing records from primary storage. [2025-09-30T22:14:39.060469] [INFO ] [MAIN ] RLX: Loaded 48332 primary data records. [2025-09-30T22:14:39.403367] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:39.404563] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48332 primary records. [2025-09-30T22:14:39.404727] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-30T22:14:39.421957] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-30T22:14:39.422116] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-30T22:14:39.424553] [INFO ] [MAIN ] Derivative Progress: 1515/2009 symbols completed. RLX took 0.5s. Estimated remaining: 3m 23s. Rate: 145.9 symbols/min [2025-09-30T22:14:39.425488] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:39.425543] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:39.425743] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:39.438961] [DEBUG] [LOCAL ] RMI: Loaded 4698 existing records from primary storage. [2025-09-30T22:14:39.439163] [INFO ] [MAIN ] RMI: Loaded 4698 primary data records. [2025-09-30T22:14:39.489671] [DEBUG] [LOCAL ] RM: Loaded 7611 existing records from primary storage. [2025-09-30T22:14:39.520985] [INFO ] [MAIN ] RM: Loaded 7611 primary data records. [2025-09-30T22:14:39.703909] [DEBUG] [LOCAL ] RMAX: Loaded 21475 existing records from primary storage. [2025-09-30T22:14:39.751544] [INFO ] [MAIN ] RMAX: Loaded 21475 primary data records. [2025-09-30T22:14:40.474631] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:14:40.475794] [INFO ] [MAIN ] RMI: Generated 1792 derivative records from 4698 primary records. [2025-09-30T22:14:40.477130] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-30T22:14:40.498954] [DEBUG] [LOCAL ] RMI: Derivative data saved (1792 records). [2025-09-30T22:14:40.512213] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-30T22:14:40.515323] [INFO ] [MAIN ] Derivative Progress: 1516/2009 symbols completed. RMI took 1.1s. Estimated remaining: 3m 23s. Rate: 145.8 symbols/min [2025-09-30T22:14:40.516034] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:40.517208] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7611 primary records. [2025-09-30T22:14:40.516224] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:40.517551] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-30T22:14:40.551523] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:40.551286] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-30T22:14:40.551753] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-30T22:14:40.552503] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21475 primary records. [2025-09-30T22:14:40.552604] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-30T22:14:40.554768] [INFO ] [MAIN ] Derivative Progress: 1517/2009 symbols completed. RM took 1.1s. Estimated remaining: 3m 22s. Rate: 145.8 symbols/min [2025-09-30T22:14:40.555002] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:40.572829] [DEBUG] [LOCAL ] RMM: Loaded 10526 existing records from primary storage. [2025-09-30T22:14:40.575468] [INFO ] [MAIN ] RMM: Loaded 10526 primary data records. [2025-09-30T22:14:40.578473] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-30T22:14:40.578608] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-30T22:14:40.586167] [INFO ] [MAIN ] Derivative Progress: 1518/2009 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 22s. Rate: 145.9 symbols/min [2025-09-30T22:14:40.593374] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:40.631265] [DEBUG] [LOCAL ] RMMZ: Loaded 4812 existing records from primary storage. [2025-09-30T22:14:40.636625] [INFO ] [MAIN ] RMMZ: Loaded 4812 primary data records. [2025-09-30T22:14:40.803886] [DEBUG] [LOCAL ] RMT: Loaded 17334 existing records from primary storage. [2025-09-30T22:14:40.868704] [INFO ] [MAIN ] RMT: Loaded 17334 primary data records. [2025-09-30T22:14:41.650945] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:41.652114] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10526 primary records. [2025-09-30T22:14:41.652390] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-30T22:14:41.667069] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:14:41.669138] [INFO ] [MAIN ] RMMZ: Generated 1793 derivative records from 4812 primary records. [2025-09-30T22:14:41.669465] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-30T22:14:41.714764] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:41.717943] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17334 primary records. [2025-09-30T22:14:41.718401] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-30T22:14:41.720181] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1793 records). [2025-09-30T22:14:41.720916] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-30T22:14:41.721376] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-30T22:14:41.723825] [INFO ] [MAIN ] Derivative Progress: 1519/2009 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 22s. Rate: 145.8 symbols/min [2025-09-30T22:14:41.723976] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-30T22:14:41.724360] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:41.733561] [INFO ] [MAIN ] Derivative Progress: 1520/2009 symbols completed. RMM took 1.2s. Estimated remaining: 3m 21s. Rate: 145.9 symbols/min [2025-09-30T22:14:41.733857] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:41.742996] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-30T22:14:41.743231] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-30T22:14:41.745995] [INFO ] [MAIN ] Derivative Progress: 1521/2009 symbols completed. RMT took 1.2s. Estimated remaining: 3m 21s. Rate: 146.0 symbols/min [2025-09-30T22:14:41.748797] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:41.772739] [DEBUG] [LOCAL ] RNGR: Loaded 20354 existing records from primary storage. [2025-09-30T22:14:41.772950] [INFO ] [MAIN ] RNGR: Loaded 20354 primary data records. [2025-09-30T22:14:41.827637] [DEBUG] [LOCAL ] RNP: Loaded 15706 existing records from primary storage. [2025-09-30T22:14:41.852079] [INFO ] [MAIN ] RNP: Loaded 15706 primary data records. [2025-09-30T22:14:42.083911] [DEBUG] [LOCAL ] RNG: Loaded 48009 existing records from primary storage. [2025-09-30T22:14:42.268071] [INFO ] [MAIN ] RNG: Loaded 48009 primary data records. [2025-09-30T22:14:42.897804] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:42.904135] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20354 primary records. [2025-09-30T22:14:42.904240] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-30T22:14:42.904804] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:42.906079] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15706 primary records. [2025-09-30T22:14:42.906406] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-30T22:14:42.953822] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-30T22:14:42.954152] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:42.955397] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-30T22:14:42.956727] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48009 primary records. [2025-09-30T22:14:42.957087] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-30T22:14:42.960897] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-30T22:14:42.959796] [INFO ] [MAIN ] Derivative Progress: 1522/2009 symbols completed. RNP took 1.2s. Estimated remaining: 3m 20s. Rate: 145.8 symbols/min [2025-09-30T22:14:42.961049] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-30T22:14:42.963899] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:42.964013] [INFO ] [MAIN ] Derivative Progress: 1523/2009 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 20s. Rate: 145.9 symbols/min [2025-09-30T22:14:42.964189] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:42.981778] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-30T22:14:42.981874] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-30T22:14:42.984422] [INFO ] [MAIN ] Derivative Progress: 1524/2009 symbols completed. RNG took 1.3s. Estimated remaining: 3m 19s. Rate: 146.0 symbols/min [2025-09-30T22:14:42.984635] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:43.025865] [DEBUG] [LOCAL ] ROG: Loaded 22976 existing records from primary storage. [2025-09-30T22:14:43.036631] [INFO ] [MAIN ] ROG: Loaded 22976 primary data records. [2025-09-30T22:14:43.037227] [DEBUG] [LOCAL ] RNR: Loaded 33936 existing records from primary storage. [2025-09-30T22:14:43.059102] [INFO ] [MAIN ] RNR: Loaded 33936 primary data records. [2025-09-30T22:14:43.254164] [DEBUG] [LOCAL ] RNST: Loaded 37066 existing records from primary storage. [2025-09-30T22:14:43.278555] [INFO ] [MAIN ] RNST: Loaded 37066 primary data records. [2025-09-30T22:14:44.124412] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:44.130767] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 22976 primary records. [2025-09-30T22:14:44.131079] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:44.132291] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 33936 primary records. [2025-09-30T22:14:44.131463] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-30T22:14:44.133321] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-30T22:14:44.165966] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-30T22:14:44.166392] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-30T22:14:44.169074] [INFO ] [MAIN ] Derivative Progress: 1525/2009 symbols completed. RNR took 1.2s. Estimated remaining: 3m 19s. Rate: 145.8 symbols/min [2025-09-30T22:14:44.180731] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-30T22:14:44.185799] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-30T22:14:44.169260] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:44.188312] [INFO ] [MAIN ] Derivative Progress: 1526/2009 symbols completed. ROG took 1.2s. Estimated remaining: 3m 19s. Rate: 145.9 symbols/min [2025-09-30T22:14:44.186204] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:44.189291] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37066 primary records. [2025-09-30T22:14:44.189401] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:44.190096] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-30T22:14:44.207761] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-30T22:14:44.207972] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-30T22:14:44.210529] [INFO ] [MAIN ] Derivative Progress: 1527/2009 symbols completed. RNST took 1.2s. Estimated remaining: 3m 18s. Rate: 146.0 symbols/min [2025-09-30T22:14:44.215581] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:44.226135] [DEBUG] [LOCAL ] RPT: Loaded 19160 existing records from primary storage. [2025-09-30T22:14:44.226285] [INFO ] [MAIN ] RPT: Loaded 19160 primary data records. [2025-09-30T22:14:44.414778] [DEBUG] [LOCAL ] RPM: Loaded 41394 existing records from primary storage. [2025-09-30T22:14:44.458834] [INFO ] [MAIN ] RPM: Loaded 41394 primary data records. [2025-09-30T22:14:44.618308] [DEBUG] [LOCAL ] RQI: Loaded 29124 existing records from primary storage. [2025-09-30T22:14:44.642421] [INFO ] [MAIN ] RQI: Loaded 29124 primary data records. [2025-09-30T22:14:45.305967] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:45.308028] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19160 primary records. [2025-09-30T22:14:45.308263] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-30T22:14:45.326811] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-09-30T22:14:45.326946] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-30T22:14:45.330553] [INFO ] [MAIN ] Derivative Progress: 1528/2009 symbols completed. RPT took 1.1s. Estimated remaining: 3m 18s. Rate: 145.8 symbols/min [2025-09-30T22:14:45.348038] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:45.348920] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41394 primary records. [2025-09-30T22:14:45.349275] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-30T22:14:45.369341] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-30T22:14:45.369517] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-30T22:14:45.384806] [INFO ] [MAIN ] Derivative Progress: 1529/2009 symbols completed. RPM took 1.2s. Estimated remaining: 3m 17s. Rate: 145.9 symbols/min [2025-09-30T22:14:45.385152] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:45.386117] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29124 primary records. [2025-09-30T22:14:45.386187] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-30T22:14:45.402513] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-30T22:14:45.402629] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-30T22:14:45.405206] [INFO ] [MAIN ] Derivative Progress: 1530/2009 symbols completed. RQI took 1.2s. Estimated remaining: 3m 17s. Rate: 146.0 symbols/min [2025-09-30T22:14:45.405637] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:45.405901] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:45.405812] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:45.434188] [DEBUG] [LOCAL ] RS: Loaded 25380 existing records from primary storage. [2025-09-30T22:14:45.434323] [INFO ] [MAIN ] RS: Loaded 25380 primary data records. [2025-09-30T22:14:45.683260] [DEBUG] [LOCAL ] RRX: Loaded 41071 existing records from primary storage. [2025-09-30T22:14:45.682132] [DEBUG] [LOCAL ] RRC: Loaded 52785 existing records from primary storage. [2025-09-30T22:14:45.788926] [INFO ] [MAIN ] RRX: Loaded 41071 primary data records. [2025-09-30T22:14:45.803007] [INFO ] [MAIN ] RRC: Loaded 52785 primary data records. [2025-09-30T22:14:46.490887] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:46.492235] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25380 primary records. [2025-09-30T22:14:46.492440] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-30T22:14:46.512850] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-30T22:14:46.514333] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-30T22:14:46.516681] [INFO ] [MAIN ] Derivative Progress: 1531/2009 symbols completed. RS took 1.1s. Estimated remaining: 3m 17s. Rate: 145.8 symbols/min [2025-09-30T22:14:46.518772] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:46.546291] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:46.546595] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:46.548571] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52785 primary records. [2025-09-30T22:14:46.549426] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-30T22:14:46.549242] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41071 primary records. [2025-09-30T22:14:46.549631] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-30T22:14:46.561558] [DEBUG] [LOCAL ] RSF: Loaded 4187 existing records from primary storage. [2025-09-30T22:14:46.565497] [INFO ] [MAIN ] RSF: Loaded 4187 primary data records. [2025-09-30T22:14:46.634575] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-30T22:14:46.647730] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-30T22:14:46.671493] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-30T22:14:46.679169] [INFO ] [MAIN ] Derivative Progress: 1532/2009 symbols completed. RRC took 1.3s. Estimated remaining: 3m 16s. Rate: 145.9 symbols/min [2025-09-30T22:14:46.662613] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-30T22:14:46.684524] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:46.702205] [INFO ] [MAIN ] Derivative Progress: 1533/2009 symbols completed. RRX took 1.3s. Estimated remaining: 3m 16s. Rate: 145.9 symbols/min [2025-09-30T22:14:46.706000] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:46.950585] [DEBUG] [LOCAL ] RSKD: Loaded 33520 existing records from primary storage. [2025-09-30T22:14:46.950976] [INFO ] [MAIN ] RSKD: Loaded 33520 primary data records. [2025-09-30T22:14:47.096619] [DEBUG] [LOCAL ] RSI: Loaded 46868 existing records from primary storage. [2025-09-30T22:14:47.114343] [INFO ] [MAIN ] RSI: Loaded 46868 primary data records. [2025-09-30T22:14:47.114264] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:47.132434] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4187 primary records. [2025-09-30T22:14:47.137718] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-30T22:14:47.517808] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-09-30T22:14:47.528663] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-30T22:14:47.535878] [INFO ] [MAIN ] Derivative Progress: 1534/2009 symbols completed. RSF took 1.0s. Estimated remaining: 3m 15s. Rate: 145.9 symbols/min [2025-09-30T22:14:47.537222] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:47.763794] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:47.764751] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33520 primary records. [2025-09-30T22:14:47.764891] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-30T22:14:47.794081] [DEBUG] [LOCAL ] RTO: Loaded 40020 existing records from primary storage. [2025-09-30T22:14:47.794936] [INFO ] [MAIN ] RTO: Loaded 40020 primary data records. [2025-09-30T22:14:47.840581] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-30T22:14:47.855071] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-30T22:14:47.864745] [INFO ] [MAIN ] Derivative Progress: 1535/2009 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 15s. Rate: 145.9 symbols/min [2025-09-30T22:14:47.865219] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:48.031443] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:48.154454] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 46868 primary records. [2025-09-30T22:14:48.155206] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-30T22:14:48.166631] [DEBUG] [LOCAL ] RVT: Loaded 26728 existing records from primary storage. [2025-09-30T22:14:48.179252] [INFO ] [MAIN ] RVT: Loaded 26728 primary data records. [2025-09-30T22:14:48.203187] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-30T22:14:48.209551] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-30T22:14:48.223984] [INFO ] [MAIN ] Derivative Progress: 1536/2009 symbols completed. RSI took 1.5s. Estimated remaining: 3m 15s. Rate: 145.9 symbols/min [2025-09-30T22:14:48.234813] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:48.550583] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:48.551683] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40020 primary records. [2025-09-30T22:14:48.551926] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-30T22:14:48.584414] [DEBUG] [LOCAL ] RWT: Loaded 40864 existing records from primary storage. [2025-09-30T22:14:48.585777] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-30T22:14:48.585845] [INFO ] [MAIN ] RWT: Loaded 40864 primary data records. [2025-09-30T22:14:48.587306] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-30T22:14:48.612165] [INFO ] [MAIN ] Derivative Progress: 1537/2009 symbols completed. RTO took 1.1s. Estimated remaining: 3m 14s. Rate: 145.9 symbols/min [2025-09-30T22:14:48.637208] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:48.956232] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:48.957267] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26728 primary records. [2025-09-30T22:14:48.957425] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-30T22:14:48.989442] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-30T22:14:48.990369] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-30T22:14:48.992614] [INFO ] [MAIN ] Derivative Progress: 1538/2009 symbols completed. RVT took 1.1s. Estimated remaining: 3m 14s. Rate: 145.9 symbols/min [2025-09-30T22:14:48.993046] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:49.013052] [DEBUG] [LOCAL ] RXO: Loaded 47822 existing records from primary storage. [2025-09-30T22:14:49.013712] [INFO ] [MAIN ] RXO: Loaded 47822 primary data records. [2025-09-30T22:14:49.238389] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:49.400804] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40864 primary records. [2025-09-30T22:14:49.415853] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-30T22:14:49.441152] [DEBUG] [LOCAL ] RY: Loaded 47856 existing records from primary storage. [2025-09-30T22:14:49.446463] [INFO ] [MAIN ] RY: Loaded 47856 primary data records. [2025-09-30T22:14:49.497736] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-30T22:14:49.510600] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-30T22:14:49.554769] [INFO ] [MAIN ] Derivative Progress: 1539/2009 symbols completed. RWT took 1.3s. Estimated remaining: 3m 13s. Rate: 145.9 symbols/min [2025-09-30T22:14:49.564029] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:49.812609] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:49.814104] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47822 primary records. [2025-09-30T22:14:49.814807] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-30T22:14:49.831607] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-30T22:14:49.832404] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-30T22:14:49.834766] [INFO ] [MAIN ] Derivative Progress: 1540/2009 symbols completed. RXO took 1.2s. Estimated remaining: 3m 13s. Rate: 145.9 symbols/min [2025-09-30T22:14:49.847384] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:49.849100] [DEBUG] [LOCAL ] RYAM: Loaded 35067 existing records from primary storage. [2025-09-30T22:14:49.849341] [INFO ] [MAIN ] RYAM: Loaded 35067 primary data records. [2025-09-30T22:14:50.087515] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:50.209830] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47856 primary records. [2025-09-30T22:14:50.210747] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-30T22:14:50.226884] [DEBUG] [LOCAL ] RYAN: Loaded 44426 existing records from primary storage. [2025-09-30T22:14:50.240523] [INFO ] [MAIN ] RYAN: Loaded 44426 primary data records. [2025-09-30T22:14:50.244580] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-30T22:14:50.267744] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-30T22:14:50.281735] [INFO ] [MAIN ] Derivative Progress: 1541/2009 symbols completed. RY took 1.3s. Estimated remaining: 3m 12s. Rate: 145.9 symbols/min [2025-09-30T22:14:50.317581] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:50.598944] [DEBUG] [LOCAL ] RYI: Loaded 21507 existing records from primary storage. [2025-09-30T22:14:50.613172] [INFO ] [MAIN ] RYI: Loaded 21507 primary data records. [2025-09-30T22:14:50.749480] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:50.750908] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35067 primary records. [2025-09-30T22:14:50.761535] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-30T22:14:50.987272] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-30T22:14:50.987715] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-30T22:14:50.990985] [INFO ] [MAIN ] Derivative Progress: 1542/2009 symbols completed. RYAM took 1.4s. Estimated remaining: 3m 12s. Rate: 145.8 symbols/min [2025-09-30T22:14:50.992105] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:51.021514] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:51.023274] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44426 primary records. [2025-09-30T22:14:51.023994] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-30T22:14:51.043375] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-30T22:14:51.045772] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-30T22:14:51.048895] [INFO ] [MAIN ] Derivative Progress: 1543/2009 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 12s. Rate: 145.9 symbols/min [2025-09-30T22:14:51.062834] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:51.063700] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21507 primary records. [2025-09-30T22:14:51.063838] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-30T22:14:51.107315] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-30T22:14:51.107538] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-30T22:14:51.110094] [INFO ] [MAIN ] Derivative Progress: 1544/2009 symbols completed. RYI took 0.8s. Estimated remaining: 3m 11s. Rate: 146.0 symbols/min [2025-09-30T22:14:51.111291] [DEBUG] [LOCAL ] RYN: Loaded 45615 existing records from primary storage. [2025-09-30T22:14:51.111742] [INFO ] [MAIN ] RYN: Loaded 45615 primary data records. [2025-09-30T22:14:51.479274] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:51.479967] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45615 primary records. [2025-09-30T22:14:51.480079] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-30T22:14:51.496369] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-30T22:14:51.496458] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-30T22:14:51.498586] [INFO ] [MAIN ] Derivative Progress: 1545/2009 symbols completed. RYN took 0.5s. Estimated remaining: 3m 11s. Rate: 146.0 symbols/min [2025-09-30T22:14:51.499339] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:51.499235] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:51.499540] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:51.511800] [DEBUG] [LOCAL ] RZB: Loaded 6225 existing records from primary storage. [2025-09-30T22:14:51.515984] [INFO ] [MAIN ] RZB: Loaded 6225 primary data records. [2025-09-30T22:14:51.515824] [DEBUG] [LOCAL ] RZC: Loaded 6778 existing records from primary storage. [2025-09-30T22:14:51.552044] [INFO ] [MAIN ] RZC: Loaded 6778 primary data records. [2025-09-30T22:14:52.208236] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-09-30T22:14:52.209191] [INFO ] [MAIN ] S: Loaded 53535 primary data records. [2025-09-30T22:14:52.558512] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:52.559932] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6225 primary records. [2025-09-30T22:14:52.560475] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-30T22:14:52.580197] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-09-30T22:14:52.580520] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-30T22:14:52.582684] [INFO ] [MAIN ] Derivative Progress: 1546/2009 symbols completed. RZB took 1.1s. Estimated remaining: 3m 11s. Rate: 145.8 symbols/min [2025-09-30T22:14:52.583478] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:52.598916] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:52.599879] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6778 primary records. [2025-09-30T22:14:52.600120] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-30T22:14:52.618256] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-30T22:14:52.618384] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-30T22:14:52.620770] [INFO ] [MAIN ] Derivative Progress: 1547/2009 symbols completed. RZC took 1.1s. Estimated remaining: 3m 10s. Rate: 145.9 symbols/min [2025-09-30T22:14:52.621242] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:52.638371] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:52.651579] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53535 primary records. [2025-09-30T22:14:52.651781] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-30T22:14:52.670317] [DEBUG] [LOCAL ] SABA: Loaded 9219 existing records from primary storage. [2025-09-30T22:14:52.670605] [INFO ] [MAIN ] SABA: Loaded 9219 primary data records. [2025-09-30T22:14:52.768205] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-30T22:14:52.797290] [DEBUG] [LOCAL ] SA: Loaded 43298 existing records from primary storage. [2025-09-30T22:14:52.797483] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-30T22:14:52.797605] [INFO ] [MAIN ] SA: Loaded 43298 primary data records. [2025-09-30T22:14:52.810934] [INFO ] [MAIN ] Derivative Progress: 1548/2009 symbols completed. S took 1.3s. Estimated remaining: 3m 10s. Rate: 146.0 symbols/min [2025-09-30T22:14:52.866244] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:53.364789] [DEBUG] [LOCAL ] SAFE: Loaded 30266 existing records from primary storage. [2025-09-30T22:14:53.365539] [INFO ] [MAIN ] SAFE: Loaded 30266 primary data records. [2025-09-30T22:14:53.658205] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:53.765753] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9219 primary records. [2025-09-30T22:14:53.766680] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-30T22:14:53.787290] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-30T22:14:53.787775] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-30T22:14:53.802125] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:53.804338] [INFO ] [MAIN ] Derivative Progress: 1549/2009 symbols completed. SABA took 1.2s. Estimated remaining: 3m 9s. Rate: 145.8 symbols/min [2025-09-30T22:14:53.805281] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43298 primary records. [2025-09-30T22:14:53.805451] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:53.806040] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-30T22:14:53.827229] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-30T22:14:53.827692] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-30T22:14:53.830204] [INFO ] [MAIN ] Derivative Progress: 1550/2009 symbols completed. SA took 1.2s. Estimated remaining: 3m 9s. Rate: 145.9 symbols/min [2025-09-30T22:14:53.836154] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:53.849803] [DEBUG] [LOCAL ] SAH: Loaded 21955 existing records from primary storage. [2025-09-30T22:14:53.850109] [INFO ] [MAIN ] SAH: Loaded 21955 primary data records. [2025-09-30T22:14:53.897882] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:53.926248] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30266 primary records. [2025-09-30T22:14:53.961628] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-30T22:14:54.016876] [DEBUG] [LOCAL ] SAM: Loaded 21341 existing records from primary storage. [2025-09-30T22:14:54.036174] [INFO ] [MAIN ] SAM: Loaded 21341 primary data records. [2025-09-30T22:14:54.160190] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-30T22:14:54.284308] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-30T22:14:54.312145] [INFO ] [MAIN ] Derivative Progress: 1551/2009 symbols completed. SAFE took 1.4s. Estimated remaining: 3m 8s. Rate: 145.9 symbols/min [2025-09-30T22:14:54.326788] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:54.590637] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:54.605958] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21955 primary records. [2025-09-30T22:14:54.606311] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-30T22:14:54.663447] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:54.664579] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21341 primary records. [2025-09-30T22:14:54.663711] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-30T22:14:54.661820] [DEBUG] [LOCAL ] SAN: Loaded 53004 existing records from primary storage. [2025-09-30T22:14:54.664896] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-30T22:14:54.664993] [INFO ] [MAIN ] SAN: Loaded 53004 primary data records. [2025-09-30T22:14:54.664829] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-30T22:14:54.667772] [INFO ] [MAIN ] Derivative Progress: 1552/2009 symbols completed. SAH took 0.9s. Estimated remaining: 3m 8s. Rate: 145.9 symbols/min [2025-09-30T22:14:54.682373] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:54.791417] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-30T22:14:54.811359] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-30T22:14:54.814769] [INFO ] [MAIN ] Derivative Progress: 1553/2009 symbols completed. SAM took 1.0s. Estimated remaining: 3m 7s. Rate: 146.0 symbols/min [2025-09-30T22:14:54.821011] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:55.062038] [DEBUG] [LOCAL ] SAND: Loaded 51807 existing records from primary storage. [2025-09-30T22:14:55.063426] [INFO ] [MAIN ] SAND: Loaded 51807 primary data records. [2025-09-30T22:14:55.283931] [DEBUG] [LOCAL ] SAP: Loaded 49997 existing records from primary storage. [2025-09-30T22:14:55.412515] [INFO ] [MAIN ] SAP: Loaded 49997 primary data records. [2025-09-30T22:14:55.418397] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:55.419585] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 53004 primary records. [2025-09-30T22:14:55.432519] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-30T22:14:55.652967] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-30T22:14:55.778865] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-30T22:14:55.851686] [INFO ] [MAIN ] Derivative Progress: 1554/2009 symbols completed. SAN took 1.5s. Estimated remaining: 3m 7s. Rate: 145.8 symbols/min [2025-09-30T22:14:55.853312] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:55.874321] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:55.876054] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51807 primary records. [2025-09-30T22:14:55.876572] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-30T22:14:55.897769] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-30T22:14:55.898028] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-30T22:14:55.900225] [INFO ] [MAIN ] Derivative Progress: 1555/2009 symbols completed. SAND took 1.2s. Estimated remaining: 3m 7s. Rate: 145.9 symbols/min [2025-09-30T22:14:55.900909] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:55.934070] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:55.935101] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49997 primary records. [2025-09-30T22:14:55.935230] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-30T22:14:55.967338] [DEBUG] [LOCAL ] SARO: Loaded 48623 existing records from primary storage. [2025-09-30T22:14:55.966548] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-30T22:14:55.967550] [INFO ] [MAIN ] SARO: Loaded 48623 primary data records. [2025-09-30T22:14:55.967614] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-30T22:14:55.971976] [INFO ] [MAIN ] Derivative Progress: 1556/2009 symbols completed. SAP took 1.2s. Estimated remaining: 3m 6s. Rate: 146.0 symbols/min [2025-09-30T22:14:55.994172] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:56.103801] [DEBUG] [LOCAL ] SB: Loaded 33140 existing records from primary storage. [2025-09-30T22:14:56.109603] [INFO ] [MAIN ] SB: Loaded 33140 primary data records. [2025-09-30T22:14:56.685277] [DEBUG] [LOCAL ] SBH: Loaded 49770 existing records from primary storage. [2025-09-30T22:14:56.686108] [INFO ] [MAIN ] SBH: Loaded 49770 primary data records. [2025-09-30T22:14:57.042241] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:57.044043] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48623 primary records. [2025-09-30T22:14:57.044225] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-30T22:14:57.068150] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-30T22:14:57.084366] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-30T22:14:57.087317] [INFO ] [MAIN ] Derivative Progress: 1557/2009 symbols completed. SARO took 1.2s. Estimated remaining: 3m 6s. Rate: 145.8 symbols/min [2025-09-30T22:14:57.088460] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:57.089008] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:57.090750] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33140 primary records. [2025-09-30T22:14:57.090968] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-30T22:14:57.115439] [DEBUG] [LOCAL ] SBI: Loaded 7612 existing records from primary storage. [2025-09-30T22:14:57.116090] [INFO ] [MAIN ] SBI: Loaded 7612 primary data records. [2025-09-30T22:14:57.154066] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-30T22:14:57.173867] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-30T22:14:57.183854] [INFO ] [MAIN ] Derivative Progress: 1558/2009 symbols completed. SB took 1.3s. Estimated remaining: 3m 5s. Rate: 145.9 symbols/min [2025-09-30T22:14:57.260731] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:57.272245] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49770 primary records. [2025-09-30T22:14:57.287747] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-30T22:14:57.479723] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-30T22:14:57.480429] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-30T22:14:57.483128] [INFO ] [MAIN ] Derivative Progress: 1559/2009 symbols completed. SBH took 1.5s. Estimated remaining: 3m 5s. Rate: 145.9 symbols/min [2025-09-30T22:14:57.506255] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:57.506992] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7612 primary records. [2025-09-30T22:14:57.507060] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-30T22:14:57.521371] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-30T22:14:57.521479] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-30T22:14:57.523709] [INFO ] [MAIN ] Derivative Progress: 1560/2009 symbols completed. SBI took 0.4s. Estimated remaining: 3m 5s. Rate: 146.0 symbols/min [2025-09-30T22:14:57.524525] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:57.524428] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:57.524314] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:57.535898] [DEBUG] [LOCAL ] SBR: Loaded 7345 existing records from primary storage. [2025-09-30T22:14:57.536082] [INFO ] [MAIN ] SBR: Loaded 7345 primary data records. [2025-09-30T22:14:57.641240] [DEBUG] [LOCAL ] SBSI: Loaded 14739 existing records from primary storage. [2025-09-30T22:14:57.690189] [INFO ] [MAIN ] SBSI: Loaded 14739 primary data records. [2025-09-30T22:14:57.800808] [DEBUG] [LOCAL ] SBS: Loaded 49479 existing records from primary storage. [2025-09-30T22:14:57.846728] [INFO ] [MAIN ] SBS: Loaded 49479 primary data records. [2025-09-30T22:14:58.674612] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:58.676305] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7345 primary records. [2025-09-30T22:14:58.676546] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-30T22:14:58.699952] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-30T22:14:58.700457] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-30T22:14:58.702859] [INFO ] [MAIN ] Derivative Progress: 1561/2009 symbols completed. SBR took 1.2s. Estimated remaining: 3m 4s. Rate: 145.8 symbols/min [2025-09-30T22:14:58.703242] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:58.717590] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:58.718980] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14739 primary records. [2025-09-30T22:14:58.719128] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-30T22:14:58.752408] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-30T22:14:58.753142] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-30T22:14:58.755479] [INFO ] [MAIN ] Derivative Progress: 1562/2009 symbols completed. SBSI took 1.2s. Estimated remaining: 3m 4s. Rate: 145.9 symbols/min [2025-09-30T22:14:58.755759] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:58.753046] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:58.757216] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49479 primary records. [2025-09-30T22:14:58.757937] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-30T22:14:58.789676] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-30T22:14:58.789874] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-30T22:14:58.792376] [INFO ] [MAIN ] Derivative Progress: 1563/2009 symbols completed. SBS took 1.3s. Estimated remaining: 3m 3s. Rate: 146.0 symbols/min [2025-09-30T22:14:58.792775] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:58.819435] [DEBUG] [LOCAL ] SBSW: Loaded 53001 existing records from primary storage. [2025-09-30T22:14:58.819757] [INFO ] [MAIN ] SBSW: Loaded 53001 primary data records. [2025-09-30T22:14:58.924001] [DEBUG] [LOCAL ] SCD: Loaded 12737 existing records from primary storage. [2025-09-30T22:14:58.935769] [INFO ] [MAIN ] SCD: Loaded 12737 primary data records. [2025-09-30T22:14:59.009302] [DEBUG] [LOCAL ] SCCO: Loaded 49403 existing records from primary storage. [2025-09-30T22:14:59.235632] [INFO ] [MAIN ] SCCO: Loaded 49403 primary data records. [2025-09-30T22:14:59.893159] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:59.895244] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53001 primary records. [2025-09-30T22:14:59.895517] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-30T22:14:59.913565] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-30T22:14:59.913873] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-30T22:14:59.916055] [INFO ] [MAIN ] Derivative Progress: 1564/2009 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 3s. Rate: 145.8 symbols/min [2025-09-30T22:14:59.916367] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:14:59.936818] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:59.937949] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12737 primary records. [2025-09-30T22:14:59.938088] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-30T22:14:59.971619] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-30T22:14:59.972138] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:14:59.973111] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-30T22:14:59.975518] [INFO ] [MAIN ] Derivative Progress: 1565/2009 symbols completed. SCD took 1.2s. Estimated remaining: 3m 3s. Rate: 145.9 symbols/min [2025-09-30T22:14:59.973031] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49403 primary records. [2025-09-30T22:14:59.975922] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-30T22:14:59.975859] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:00.018692] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-30T22:15:00.018907] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-30T22:15:00.021435] [INFO ] [MAIN ] Derivative Progress: 1566/2009 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 2s. Rate: 146.0 symbols/min [2025-09-30T22:15:00.026208] [DEBUG] [LOCAL ] SCI: Loaded 46449 existing records from primary storage. [2025-09-30T22:15:00.026387] [INFO ] [MAIN ] SCI: Loaded 46449 primary data records. [2025-09-30T22:15:00.026510] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:00.087456] [DEBUG] [LOCAL ] SCL: Loaded 14882 existing records from primary storage. [2025-09-30T22:15:00.130194] [INFO ] [MAIN ] SCL: Loaded 14882 primary data records. [2025-09-30T22:15:00.227775] [DEBUG] [LOCAL ] SCM: Loaded 19760 existing records from primary storage. [2025-09-30T22:15:00.253456] [INFO ] [MAIN ] SCM: Loaded 19760 primary data records. [2025-09-30T22:15:01.098502] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:01.100097] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46449 primary records. [2025-09-30T22:15:01.100312] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-30T22:15:01.122277] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:01.127457] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14882 primary records. [2025-09-30T22:15:01.127847] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-30T22:15:01.134161] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-30T22:15:01.145812] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-30T22:15:01.149473] [INFO ] [MAIN ] Derivative Progress: 1567/2009 symbols completed. SCI took 1.2s. Estimated remaining: 3m 2s. Rate: 145.8 symbols/min [2025-09-30T22:15:01.150736] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:01.168275] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:01.169371] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19760 primary records. [2025-09-30T22:15:01.170029] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-30T22:15:01.170577] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-30T22:15:01.171450] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-30T22:15:01.173829] [INFO ] [MAIN ] Derivative Progress: 1568/2009 symbols completed. SCL took 1.2s. Estimated remaining: 3m 1s. Rate: 145.9 symbols/min [2025-09-30T22:15:01.181549] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:01.192099] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-30T22:15:01.192332] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-30T22:15:01.194997] [INFO ] [MAIN ] Derivative Progress: 1569/2009 symbols completed. SCM took 1.2s. Estimated remaining: 3m 1s. Rate: 146.0 symbols/min [2025-09-30T22:15:01.195196] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:01.217534] [DEBUG] [LOCAL ] SDHC: Loaded 10404 existing records from primary storage. [2025-09-30T22:15:01.232092] [INFO ] [MAIN ] SDHC: Loaded 10404 primary data records. [2025-09-30T22:15:01.326494] [DEBUG] [LOCAL ] SD: Loaded 28653 existing records from primary storage. [2025-09-30T22:15:01.326740] [INFO ] [MAIN ] SD: Loaded 28653 primary data records. [2025-09-30T22:15:01.345034] [DEBUG] [LOCAL ] SCS: Loaded 43358 existing records from primary storage. [2025-09-30T22:15:01.444137] [INFO ] [MAIN ] SCS: Loaded 43358 primary data records. [2025-09-30T22:15:02.356107] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:02.358014] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28653 primary records. [2025-09-30T22:15:02.358701] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-30T22:15:02.372954] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:02.395740] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:02.395384] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10404 primary records. [2025-09-30T22:15:02.399222] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-30T22:15:02.399150] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43358 primary records. [2025-09-30T22:15:02.402773] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-30T22:15:02.404946] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-30T22:15:02.405375] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-30T22:15:02.414983] [INFO ] [MAIN ] Derivative Progress: 1570/2009 symbols completed. SD took 1.2s. Estimated remaining: 3m 1s. Rate: 145.8 symbols/min [2025-09-30T22:15:02.422570] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:02.441432] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-30T22:15:02.442131] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-30T22:15:02.442664] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-30T22:15:02.444925] [INFO ] [MAIN ] Derivative Progress: 1571/2009 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 0s. Rate: 145.9 symbols/min [2025-09-30T22:15:02.449777] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:02.450011] [DEBUG] [LOCAL ] SDHY: Loaded 10544 existing records from primary storage. [2025-09-30T22:15:02.445431] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-30T22:15:02.453623] [INFO ] [MAIN ] Derivative Progress: 1572/2009 symbols completed. SCS took 1.3s. Estimated remaining: 2m 60s. Rate: 146.0 symbols/min [2025-09-30T22:15:02.453763] [INFO ] [MAIN ] SDHY: Loaded 10544 primary data records. [2025-09-30T22:15:02.454075] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:02.826848] [DEBUG] [LOCAL ] SDRL: Loaded 41653 existing records from primary storage. [2025-09-30T22:15:02.827939] [INFO ] [MAIN ] SDRL: Loaded 41653 primary data records. [2025-09-30T22:15:02.956390] [DEBUG] [LOCAL ] SEE: Loaded 48284 existing records from primary storage. [2025-09-30T22:15:02.956803] [INFO ] [MAIN ] SEE: Loaded 48284 primary data records. [2025-09-30T22:15:03.523619] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:03.525452] [INFO ] [MAIN ] SDHY: Generated 1793 derivative records from 10544 primary records. [2025-09-30T22:15:03.525987] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-30T22:15:03.549349] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1793 records). [2025-09-30T22:15:03.550044] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-30T22:15:03.552415] [INFO ] [MAIN ] Derivative Progress: 1573/2009 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 59s. Rate: 145.9 symbols/min [2025-09-30T22:15:03.574621] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:03.575896] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41653 primary records. [2025-09-30T22:15:03.576113] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-30T22:15:03.609898] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-30T22:15:03.611163] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-30T22:15:03.613718] [INFO ] [MAIN ] Derivative Progress: 1574/2009 symbols completed. SDRL took 1.2s. Estimated remaining: 2m 59s. Rate: 145.9 symbols/min [2025-09-30T22:15:03.611533] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:03.614701] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48284 primary records. [2025-09-30T22:15:03.614784] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-30T22:15:03.631815] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-30T22:15:03.631930] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-30T22:15:03.634474] [INFO ] [MAIN ] Derivative Progress: 1575/2009 symbols completed. SEE took 1.2s. Estimated remaining: 2m 58s. Rate: 146.0 symbols/min [2025-09-30T22:15:03.635037] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:03.635107] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:03.634964] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:03.653050] [DEBUG] [LOCAL ] SEG: Loaded 13636 existing records from primary storage. [2025-09-30T22:15:03.653212] [INFO ] [MAIN ] SEG: Loaded 13636 primary data records. [2025-09-30T22:15:04.023416] [DEBUG] [LOCAL ] SEM: Loaded 42779 existing records from primary storage. [2025-09-30T22:15:04.024330] [DEBUG] [LOCAL ] SEI: Loaded 49645 existing records from primary storage. [2025-09-30T22:15:04.024713] [INFO ] [MAIN ] SEI: Loaded 49645 primary data records. [2025-09-30T22:15:04.024582] [INFO ] [MAIN ] SEM: Loaded 42779 primary data records. [2025-09-30T22:15:04.739688] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:04.742943] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13636 primary records. [2025-09-30T22:15:04.743276] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-30T22:15:04.764885] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-30T22:15:04.765301] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-30T22:15:04.768046] [INFO ] [MAIN ] Derivative Progress: 1576/2009 symbols completed. SEG took 1.1s. Estimated remaining: 2m 58s. Rate: 145.9 symbols/min [2025-09-30T22:15:04.768778] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:04.787236] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:04.791183] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49645 primary records. [2025-09-30T22:15:04.791398] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-30T22:15:04.817968] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:04.821026] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42779 primary records. [2025-09-30T22:15:04.823322] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-30T22:15:04.823429] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-30T22:15:04.823604] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-30T22:15:04.825636] [INFO ] [MAIN ] Derivative Progress: 1577/2009 symbols completed. SEI took 1.2s. Estimated remaining: 2m 58s. Rate: 145.9 symbols/min [2025-09-30T22:15:04.826727] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:04.855416] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-30T22:15:04.855684] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-30T22:15:04.858482] [INFO ] [MAIN ] Derivative Progress: 1578/2009 symbols completed. SEM took 1.2s. Estimated remaining: 2m 57s. Rate: 146.0 symbols/min [2025-09-30T22:15:04.858788] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:04.875884] [DEBUG] [LOCAL ] SEMR: Loaded 41502 existing records from primary storage. [2025-09-30T22:15:04.876415] [INFO ] [MAIN ] SEMR: Loaded 41502 primary data records. [2025-09-30T22:15:05.278861] [DEBUG] [LOCAL ] SF: Loaded 41564 existing records from primary storage. [2025-09-30T22:15:05.281423] [INFO ] [MAIN ] SF: Loaded 41564 primary data records. [2025-09-30T22:15:05.280904] [DEBUG] [LOCAL ] SES: Loaded 51560 existing records from primary storage. [2025-09-30T22:15:05.281796] [INFO ] [MAIN ] SES: Loaded 51560 primary data records. [2025-09-30T22:15:05.975316] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:05.977136] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41502 primary records. [2025-09-30T22:15:05.977289] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-30T22:15:06.001454] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-30T22:15:06.001848] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-30T22:15:06.004980] [INFO ] [MAIN ] Derivative Progress: 1579/2009 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 57s. Rate: 145.9 symbols/min [2025-09-30T22:15:06.005799] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:06.042950] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:06.043198] [DEBUG] [LOCAL ] SFB: Loaded 4105 existing records from primary storage. [2025-09-30T22:15:06.043555] [INFO ] [MAIN ] SFB: Loaded 4105 primary data records. [2025-09-30T22:15:06.043943] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:06.049886] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51560 primary records. [2025-09-30T22:15:06.079496] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41564 primary records. [2025-09-30T22:15:06.092607] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-30T22:15:06.106243] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-30T22:15:06.206404] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-30T22:15:06.238391] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-30T22:15:06.274718] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-30T22:15:06.282667] [INFO ] [MAIN ] Derivative Progress: 1580/2009 symbols completed. SES took 1.5s. Estimated remaining: 2m 56s. Rate: 145.9 symbols/min [2025-09-30T22:15:06.390399] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-30T22:15:06.398214] [INFO ] [MAIN ] Derivative Progress: 1581/2009 symbols completed. SF took 1.5s. Estimated remaining: 2m 56s. Rate: 146.0 symbols/min [2025-09-30T22:15:06.395838] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:06.407690] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:06.433195] [DEBUG] [LOCAL ] SFBS: Loaded 21044 existing records from primary storage. [2025-09-30T22:15:06.433527] [INFO ] [MAIN ] SFBS: Loaded 21044 primary data records. [2025-09-30T22:15:06.581222] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:06.634546] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4105 primary records. [2025-09-30T22:15:06.658094] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-30T22:15:06.822697] [DEBUG] [LOCAL ] SFL: Loaded 45266 existing records from primary storage. [2025-09-30T22:15:06.828112] [INFO ] [MAIN ] SFL: Loaded 45266 primary data records. [2025-09-30T22:15:06.972134] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-30T22:15:06.993334] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-30T22:15:07.042303] [INFO ] [MAIN ] Derivative Progress: 1582/2009 symbols completed. SFB took 1.0s. Estimated remaining: 2m 56s. Rate: 145.9 symbols/min [2025-09-30T22:15:07.186860] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:07.210754] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:07.211740] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21044 primary records. [2025-09-30T22:15:07.211876] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-30T22:15:07.232135] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-30T22:15:07.234204] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-30T22:15:07.236526] [INFO ] [MAIN ] Derivative Progress: 1583/2009 symbols completed. SFBS took 0.8s. Estimated remaining: 2m 55s. Rate: 146.0 symbols/min [2025-09-30T22:15:07.236725] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:07.266900] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:07.267841] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45266 primary records. [2025-09-30T22:15:07.267990] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-30T22:15:07.286607] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-30T22:15:07.286807] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-30T22:15:07.289197] [INFO ] [MAIN ] Derivative Progress: 1584/2009 symbols completed. SFL took 0.9s. Estimated remaining: 2m 55s. Rate: 146.0 symbols/min [2025-09-30T22:15:07.290284] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:07.309049] [DEBUG] [LOCAL ] SG: Loaded 53450 existing records from primary storage. [2025-09-30T22:15:07.309390] [INFO ] [MAIN ] SG: Loaded 53450 primary data records. [2025-09-30T22:15:07.402354] [DEBUG] [LOCAL ] SGU: Loaded 6718 existing records from primary storage. [2025-09-30T22:15:07.429523] [INFO ] [MAIN ] SGU: Loaded 6718 primary data records. [2025-09-30T22:15:07.603228] [DEBUG] [LOCAL ] SGHC: Loaded 45946 existing records from primary storage. [2025-09-30T22:15:07.667192] [INFO ] [MAIN ] SGHC: Loaded 45946 primary data records. [2025-09-30T22:15:08.409783] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:08.410886] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53450 primary records. [2025-09-30T22:15:08.411122] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-30T22:15:08.438442] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:08.442380] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6718 primary records. [2025-09-30T22:15:08.443846] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-30T22:15:08.443780] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-30T22:15:08.453147] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-30T22:15:08.459149] [INFO ] [MAIN ] Derivative Progress: 1585/2009 symbols completed. SG took 1.3s. Estimated remaining: 2m 54s. Rate: 145.9 symbols/min [2025-09-30T22:15:08.464542] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:08.465739] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-09-30T22:15:08.466372] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-30T22:15:08.468756] [INFO ] [MAIN ] Derivative Progress: 1586/2009 symbols completed. SGU took 1.2s. Estimated remaining: 2m 54s. Rate: 146.0 symbols/min [2025-09-30T22:15:08.478105] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:08.484475] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:08.485358] [INFO ] [MAIN ] SGHC: Generated 1793 derivative records from 45946 primary records. [2025-09-30T22:15:08.485544] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-30T22:15:08.503592] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1793 records). [2025-09-30T22:15:08.503831] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-30T22:15:08.506311] [INFO ] [MAIN ] Derivative Progress: 1587/2009 symbols completed. SGHC took 1.3s. Estimated remaining: 2m 53s. Rate: 146.0 symbols/min [2025-09-30T22:15:08.515062] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:08.529867] [DEBUG] [LOCAL ] SHCO: Loaded 25925 existing records from primary storage. [2025-09-30T22:15:08.530113] [INFO ] [MAIN ] SHCO: Loaded 25925 primary data records. [2025-09-30T22:15:08.693258] [DEBUG] [LOCAL ] SHAK: Loaded 48993 existing records from primary storage. [2025-09-30T22:15:08.704482] [INFO ] [MAIN ] SHAK: Loaded 48993 primary data records. [2025-09-30T22:15:09.100885] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-09-30T22:15:09.123965] [INFO ] [MAIN ] SHEL: Loaded 53671 primary data records. [2025-09-30T22:15:09.633508] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:09.635592] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25925 primary records. [2025-09-30T22:15:09.636020] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-30T22:15:09.656254] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-30T22:15:09.656956] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-30T22:15:09.672014] [INFO ] [MAIN ] Derivative Progress: 1588/2009 symbols completed. SHCO took 1.2s. Estimated remaining: 2m 53s. Rate: 145.9 symbols/min [2025-09-30T22:15:09.673701] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:09.674462] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48993 primary records. [2025-09-30T22:15:09.674545] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-30T22:15:09.706204] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:09.707635] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53671 primary records. [2025-09-30T22:15:09.708294] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-30T22:15:09.708458] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-30T22:15:09.711073] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-30T22:15:09.710988] [INFO ] [MAIN ] Derivative Progress: 1589/2009 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 53s. Rate: 146.0 symbols/min [2025-09-30T22:15:09.728351] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-30T22:15:09.728418] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-30T22:15:09.730749] [INFO ] [MAIN ] Derivative Progress: 1590/2009 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 52s. Rate: 146.0 symbols/min [2025-09-30T22:15:09.731163] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:09.731247] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:09.731365] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:09.737981] [DEBUG] [LOCAL ] SHOC: Loaded 3506 existing records from primary storage. [2025-09-30T22:15:09.738163] [INFO ] [MAIN ] SHOC: Loaded 3506 primary data records. [2025-09-30T22:15:09.962213] [DEBUG] [LOCAL ] SHG: Loaded 26602 existing records from primary storage. [2025-09-30T22:15:10.079564] [INFO ] [MAIN ] SHG: Loaded 26602 primary data records. [2025-09-30T22:15:10.217369] [DEBUG] [LOCAL ] SHO: Loaded 49720 existing records from primary storage. [2025-09-30T22:15:10.223120] [INFO ] [MAIN ] SHO: Loaded 49720 primary data records. [2025-09-30T22:15:10.840992] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:10.843818] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3506 primary records. [2025-09-30T22:15:10.844221] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-30T22:15:10.863146] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-30T22:15:10.864422] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-30T22:15:10.867041] [INFO ] [MAIN ] Derivative Progress: 1591/2009 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 52s. Rate: 145.9 symbols/min [2025-09-30T22:15:10.867631] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:10.893662] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:10.894617] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26602 primary records. [2025-09-30T22:15:10.895210] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-30T22:15:10.934540] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:10.936360] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49720 primary records. [2025-09-30T22:15:10.936879] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-30T22:15:10.949638] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-30T22:15:10.957077] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-30T22:15:10.964113] [INFO ] [MAIN ] Derivative Progress: 1592/2009 symbols completed. SHG took 1.2s. Estimated remaining: 2m 51s. Rate: 145.9 symbols/min [2025-09-30T22:15:10.969227] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-30T22:15:10.969343] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-30T22:15:10.967974] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:10.972238] [INFO ] [MAIN ] Derivative Progress: 1593/2009 symbols completed. SHO took 1.2s. Estimated remaining: 2m 51s. Rate: 146.0 symbols/min [2025-09-30T22:15:10.972689] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:10.993464] [DEBUG] [LOCAL ] SID: Loaded 42311 existing records from primary storage. [2025-09-30T22:15:10.993745] [INFO ] [MAIN ] SID: Loaded 42311 primary data records. [2025-09-30T22:15:11.237458] [DEBUG] [LOCAL ] SII: Loaded 23525 existing records from primary storage. [2025-09-30T22:15:11.349886] [INFO ] [MAIN ] SII: Loaded 23525 primary data records. [2025-09-30T22:15:11.432411] [DEBUG] [LOCAL ] SIG: Loaded 46241 existing records from primary storage. [2025-09-30T22:15:11.443708] [INFO ] [MAIN ] SIG: Loaded 46241 primary data records. [2025-09-30T22:15:12.117966] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:12.119836] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42311 primary records. [2025-09-30T22:15:12.120311] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-30T22:15:12.145074] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-30T22:15:12.145486] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-30T22:15:12.147992] [INFO ] [MAIN ] Derivative Progress: 1594/2009 symbols completed. SID took 1.3s. Estimated remaining: 2m 51s. Rate: 145.9 symbols/min [2025-09-30T22:15:12.149298] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:12.182173] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:12.183860] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46241 primary records. [2025-09-30T22:15:12.184046] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-30T22:15:12.184290] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:12.186296] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23525 primary records. [2025-09-30T22:15:12.193713] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-30T22:15:12.226823] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-30T22:15:12.237445] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-30T22:15:12.239975] [INFO ] [MAIN ] Derivative Progress: 1595/2009 symbols completed. SIG took 1.3s. Estimated remaining: 2m 50s. Rate: 145.9 symbols/min [2025-09-30T22:15:12.241253] [DEBUG] [LOCAL ] SILA: Loaded 30891 existing records from primary storage. [2025-09-30T22:15:12.240454] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-30T22:15:12.241377] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:12.241608] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-30T22:15:12.242282] [INFO ] [MAIN ] SILA: Loaded 30891 primary data records. [2025-09-30T22:15:12.244621] [INFO ] [MAIN ] Derivative Progress: 1596/2009 symbols completed. SII took 1.3s. Estimated remaining: 2m 50s. Rate: 146.0 symbols/min [2025-09-30T22:15:12.244909] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:12.622090] [DEBUG] [LOCAL ] SITC: Loaded 41568 existing records from primary storage. [2025-09-30T22:15:12.622887] [DEBUG] [LOCAL ] SITE: Loaded 35018 existing records from primary storage. [2025-09-30T22:15:12.622372] [INFO ] [MAIN ] SITC: Loaded 41568 primary data records. [2025-09-30T22:15:12.623093] [INFO ] [MAIN ] SITE: Loaded 35018 primary data records. [2025-09-30T22:15:13.347119] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:13.348310] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30891 primary records. [2025-09-30T22:15:13.348919] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-30T22:15:13.371172] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-30T22:15:13.371529] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-30T22:15:13.373985] [INFO ] [MAIN ] Derivative Progress: 1597/2009 symbols completed. SILA took 1.2s. Estimated remaining: 2m 49s. Rate: 145.9 symbols/min [2025-09-30T22:15:13.374588] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:13.411065] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:13.412585] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35018 primary records. [2025-09-30T22:15:13.411765] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:13.413355] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41568 primary records. [2025-09-30T22:15:13.413572] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-30T22:15:13.413688] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-30T22:15:13.466944] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-30T22:15:13.467098] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-30T22:15:13.466822] [DEBUG] [LOCAL ] SJT: Loaded 22341 existing records from primary storage. [2025-09-30T22:15:13.467253] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-30T22:15:13.469819] [INFO ] [MAIN ] Derivative Progress: 1598/2009 symbols completed. SITE took 1.2s. Estimated remaining: 2m 49s. Rate: 145.9 symbols/min [2025-09-30T22:15:13.470252] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-30T22:15:13.467361] [INFO ] [MAIN ] SJT: Loaded 22341 primary data records. [2025-09-30T22:15:13.473454] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:13.478894] [INFO ] [MAIN ] Derivative Progress: 1599/2009 symbols completed. SITC took 1.2s. Estimated remaining: 2m 48s. Rate: 146.0 symbols/min [2025-09-30T22:15:13.524229] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:13.657425] [DEBUG] [LOCAL ] SKIL: Loaded 6305 existing records from primary storage. [2025-09-30T22:15:13.692933] [INFO ] [MAIN ] SKIL: Loaded 6305 primary data records. [2025-09-30T22:15:13.958551] [DEBUG] [LOCAL ] SKE: Loaded 35873 existing records from primary storage. [2025-09-30T22:15:13.969194] [INFO ] [MAIN ] SKE: Loaded 35873 primary data records. [2025-09-30T22:15:14.520499] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:14.522468] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22341 primary records. [2025-09-30T22:15:14.523073] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-30T22:15:14.542440] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-30T22:15:14.542933] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-30T22:15:14.545291] [INFO ] [MAIN ] Derivative Progress: 1600/2009 symbols completed. SJT took 1.2s. Estimated remaining: 2m 48s. Rate: 145.9 symbols/min [2025-09-30T22:15:14.546202] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:14.565587] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:14.569780] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6305 primary records. [2025-09-30T22:15:14.570792] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-30T22:15:14.589699] [DEBUG] [LOCAL ] SKLZ: Loaded 11935 existing records from primary storage. [2025-09-30T22:15:14.590569] [INFO ] [MAIN ] SKLZ: Loaded 11935 primary data records. [2025-09-30T22:15:14.659464] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:14.687361] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35873 primary records. [2025-09-30T22:15:14.700169] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-30T22:15:14.681510] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-30T22:15:14.713402] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-30T22:15:14.737079] [INFO ] [MAIN ] Derivative Progress: 1601/2009 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 48s. Rate: 145.9 symbols/min [2025-09-30T22:15:14.746093] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:14.796894] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-30T22:15:14.839202] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-30T22:15:14.964130] [INFO ] [MAIN ] Derivative Progress: 1602/2009 symbols completed. SKE took 1.5s. Estimated remaining: 2m 47s. Rate: 146.0 symbols/min [2025-09-30T22:15:14.964454] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:15.005335] [DEBUG] [LOCAL ] SKM: Loaded 34975 existing records from primary storage. [2025-09-30T22:15:15.005666] [INFO ] [MAIN ] SKM: Loaded 34975 primary data records. [2025-09-30T22:15:15.047555] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:15.094863] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11935 primary records. [2025-09-30T22:15:15.106623] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-30T22:15:15.231827] [DEBUG] [LOCAL ] SKT: Loaded 42511 existing records from primary storage. [2025-09-30T22:15:15.238452] [INFO ] [MAIN ] SKT: Loaded 42511 primary data records. [2025-09-30T22:15:15.265637] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-30T22:15:15.343621] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-30T22:15:15.473111] [INFO ] [MAIN ] Derivative Progress: 1603/2009 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 47s. Rate: 146.0 symbols/min [2025-09-30T22:15:15.809540] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:15.810527] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 34975 primary records. [2025-09-30T22:15:15.811677] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-30T22:15:15.835045] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-30T22:15:15.835408] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-30T22:15:15.837760] [INFO ] [MAIN ] Derivative Progress: 1604/2009 symbols completed. SKM took 1.1s. Estimated remaining: 2m 46s. Rate: 146.0 symbols/min [2025-09-30T22:15:15.856223] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:15.856901] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42511 primary records. [2025-09-30T22:15:15.857018] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-30T22:15:15.874364] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-30T22:15:15.874462] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-30T22:15:15.877594] [INFO ] [MAIN ] Derivative Progress: 1605/2009 symbols completed. SKT took 0.9s. Estimated remaining: 2m 46s. Rate: 146.0 symbols/min [2025-09-30T22:15:15.878378] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:15.878198] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:15.878300] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:15.907021] [DEBUG] [LOCAL ] SKYH: Loaded 16576 existing records from primary storage. [2025-09-30T22:15:15.907185] [INFO ] [MAIN ] SKYH: Loaded 16576 primary data records. [2025-09-30T22:15:16.099885] [DEBUG] [LOCAL ] SKY: Loaded 37750 existing records from primary storage. [2025-09-30T22:15:16.146419] [DEBUG] [LOCAL ] SLF: Loaded 38760 existing records from primary storage. [2025-09-30T22:15:16.163211] [INFO ] [MAIN ] SLF: Loaded 38760 primary data records. [2025-09-30T22:15:16.146552] [INFO ] [MAIN ] SKY: Loaded 37750 primary data records. [2025-09-30T22:15:16.971538] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:16.972747] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16576 primary records. [2025-09-30T22:15:16.973138] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-30T22:15:17.006093] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:17.008047] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37750 primary records. [2025-09-30T22:15:17.008191] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-30T22:15:17.008401] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-30T22:15:17.008775] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-30T22:15:17.027092] [INFO ] [MAIN ] Derivative Progress: 1606/2009 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 46s. Rate: 145.9 symbols/min [2025-09-30T22:15:17.028765] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:17.043786] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:17.045962] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-30T22:15:17.046636] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38760 primary records. [2025-09-30T22:15:17.046892] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-30T22:15:17.046968] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-30T22:15:17.049830] [INFO ] [MAIN ] Derivative Progress: 1607/2009 symbols completed. SKY took 1.2s. Estimated remaining: 2m 45s. Rate: 146.0 symbols/min [2025-09-30T22:15:17.050353] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:17.067627] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-30T22:15:17.068010] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-30T22:15:17.071150] [INFO ] [MAIN ] Derivative Progress: 1608/2009 symbols completed. SLF took 1.2s. Estimated remaining: 2m 45s. Rate: 146.1 symbols/min [2025-09-30T22:15:17.071469] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:17.133486] [DEBUG] [LOCAL ] SLGN: Loaded 40385 existing records from primary storage. [2025-09-30T22:15:17.133751] [INFO ] [MAIN ] SLGN: Loaded 40385 primary data records. [2025-09-30T22:15:17.275613] [DEBUG] [LOCAL ] SLG: Loaded 45336 existing records from primary storage. [2025-09-30T22:15:17.280719] [INFO ] [MAIN ] SLG: Loaded 45336 primary data records. [2025-09-30T22:15:17.280563] [DEBUG] [LOCAL ] SLQT: Loaded 43498 existing records from primary storage. [2025-09-30T22:15:17.304691] [INFO ] [MAIN ] SLQT: Loaded 43498 primary data records. [2025-09-30T22:15:18.269438] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:18.270624] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40385 primary records. [2025-09-30T22:15:18.270979] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-30T22:15:18.305222] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:18.306801] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45336 primary records. [2025-09-30T22:15:18.307428] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-30T22:15:18.321448] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:18.320188] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-30T22:15:18.322370] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43498 primary records. [2025-09-30T22:15:18.333251] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-30T22:15:18.329686] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-30T22:15:18.344601] [INFO ] [MAIN ] Derivative Progress: 1609/2009 symbols completed. SLGN took 1.3s. Estimated remaining: 2m 45s. Rate: 145.9 symbols/min [2025-09-30T22:15:18.346184] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:18.354311] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-30T22:15:18.355480] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-30T22:15:18.356582] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-30T22:15:18.359619] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-30T22:15:18.359495] [INFO ] [MAIN ] Derivative Progress: 1610/2009 symbols completed. SLG took 1.3s. Estimated remaining: 2m 44s. Rate: 145.9 symbols/min [2025-09-30T22:15:18.362362] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:18.362615] [INFO ] [MAIN ] Derivative Progress: 1611/2009 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 44s. Rate: 146.0 symbols/min [2025-09-30T22:15:18.362752] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:18.374171] [DEBUG] [LOCAL ] SMBK: Loaded 8147 existing records from primary storage. [2025-09-30T22:15:18.374338] [INFO ] [MAIN ] SMBK: Loaded 8147 primary data records. [2025-09-30T22:15:18.525082] [DEBUG] [LOCAL ] SLVM: Loaded 27905 existing records from primary storage. [2025-09-30T22:15:18.581486] [INFO ] [MAIN ] SLVM: Loaded 27905 primary data records. [2025-09-30T22:15:18.835430] [DEBUG] [LOCAL ] SM: Loaded 52321 existing records from primary storage. [2025-09-30T22:15:18.840771] [INFO ] [MAIN ] SM: Loaded 52321 primary data records. [2025-09-30T22:15:19.486510] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:19.488137] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8147 primary records. [2025-09-30T22:15:19.488338] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-30T22:15:19.509467] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-30T22:15:19.511169] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-30T22:15:19.513825] [INFO ] [MAIN ] Derivative Progress: 1612/2009 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 43s. Rate: 145.9 symbols/min [2025-09-30T22:15:19.513994] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:19.529213] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:19.530007] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27905 primary records. [2025-09-30T22:15:19.530188] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-30T22:15:19.555935] [DEBUG] [LOCAL ] SMC: Loaded 11325 existing records from primary storage. [2025-09-30T22:15:19.557186] [INFO ] [MAIN ] SMC: Loaded 11325 primary data records. [2025-09-30T22:15:19.594240] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-30T22:15:19.623260] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:19.632029] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52321 primary records. [2025-09-30T22:15:19.654169] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-30T22:15:19.654236] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-30T22:15:19.674279] [INFO ] [MAIN ] Derivative Progress: 1613/2009 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 43s. Rate: 145.9 symbols/min [2025-09-30T22:15:19.687462] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:19.767712] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-30T22:15:19.795211] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-30T22:15:19.919131] [INFO ] [MAIN ] Derivative Progress: 1614/2009 symbols completed. SM took 1.6s. Estimated remaining: 2m 42s. Rate: 146.0 symbols/min [2025-09-30T22:15:19.920242] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:19.977581] [DEBUG] [LOCAL ] SMFG: Loaded 48125 existing records from primary storage. [2025-09-30T22:15:19.978128] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:19.979016] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11325 primary records. [2025-09-30T22:15:19.978317] [INFO ] [MAIN ] SMFG: Loaded 48125 primary data records. [2025-09-30T22:15:19.979128] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-30T22:15:20.159509] [DEBUG] [LOCAL ] SMG: Loaded 43737 existing records from primary storage. [2025-09-30T22:15:20.158335] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-30T22:15:20.169970] [INFO ] [MAIN ] SMG: Loaded 43737 primary data records. [2025-09-30T22:15:20.195925] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-30T22:15:20.256505] [INFO ] [MAIN ] Derivative Progress: 1615/2009 symbols completed. SMC took 0.7s. Estimated remaining: 2m 42s. Rate: 146.0 symbols/min [2025-09-30T22:15:20.365287] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:20.700592] [DEBUG] [LOCAL ] SMHI: Loaded 13229 existing records from primary storage. [2025-09-30T22:15:20.700810] [INFO ] [MAIN ] SMHI: Loaded 13229 primary data records. [2025-09-30T22:15:20.909750] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:20.922423] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48125 primary records. [2025-09-30T22:15:21.065512] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-30T22:15:21.100596] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-30T22:15:21.101269] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-30T22:15:21.118692] [INFO ] [MAIN ] Derivative Progress: 1616/2009 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 42s. Rate: 145.9 symbols/min [2025-09-30T22:15:21.119732] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:21.119540] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:21.121104] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43737 primary records. [2025-09-30T22:15:21.121315] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-30T22:15:21.145021] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-30T22:15:21.145210] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-30T22:15:21.147860] [INFO ] [MAIN ] Derivative Progress: 1617/2009 symbols completed. SMG took 1.2s. Estimated remaining: 2m 41s. Rate: 146.0 symbols/min [2025-09-30T22:15:21.148332] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:21.168202] [DEBUG] [LOCAL ] SMP: Loaded 19365 existing records from primary storage. [2025-09-30T22:15:21.168533] [INFO ] [MAIN ] SMP: Loaded 19365 primary data records. [2025-09-30T22:15:21.197075] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:21.236510] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13229 primary records. [2025-09-30T22:15:21.251106] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-30T22:15:21.330299] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-30T22:15:21.330688] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-30T22:15:21.333399] [INFO ] [MAIN ] Derivative Progress: 1618/2009 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 41s. Rate: 146.0 symbols/min [2025-09-30T22:15:21.413937] [DEBUG] [LOCAL ] SMRT: Loaded 43860 existing records from primary storage. [2025-09-30T22:15:21.434541] [INFO ] [MAIN ] SMRT: Loaded 43860 primary data records. [2025-09-30T22:15:22.047320] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:22.048560] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19365 primary records. [2025-09-30T22:15:22.049181] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-30T22:15:22.067566] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-30T22:15:22.068688] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-30T22:15:22.070766] [INFO ] [MAIN ] Derivative Progress: 1619/2009 symbols completed. SMP took 1.0s. Estimated remaining: 2m 40s. Rate: 145.9 symbols/min [2025-09-30T22:15:22.092076] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:22.093115] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43860 primary records. [2025-09-30T22:15:22.093212] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-30T22:15:22.113358] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-30T22:15:22.113512] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-30T22:15:22.116222] [INFO ] [MAIN ] Derivative Progress: 1620/2009 symbols completed. SMRT took 1.0s. Estimated remaining: 2m 40s. Rate: 146.0 symbols/min [2025-09-30T22:15:22.116751] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:22.116676] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:22.116913] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:22.181909] [DEBUG] [LOCAL ] SMWB: Loaded 32504 existing records from primary storage. [2025-09-30T22:15:22.182254] [INFO ] [MAIN ] SMWB: Loaded 32504 primary data records. [2025-09-30T22:15:22.346732] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-30T22:15:22.352512] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-30T22:15:22.367065] [DEBUG] [LOCAL ] SN: Loaded 49762 existing records from primary storage. [2025-09-30T22:15:22.373064] [INFO ] [MAIN ] SN: Loaded 49762 primary data records. [2025-09-30T22:15:23.332491] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:23.335790] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32504 primary records. [2025-09-30T22:15:23.337169] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-30T22:15:23.371408] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-30T22:15:23.371765] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-30T22:15:23.374255] [INFO ] [MAIN ] Derivative Progress: 1621/2009 symbols completed. SMWB took 1.3s. Estimated remaining: 2m 40s. Rate: 145.8 symbols/min [2025-09-30T22:15:23.396155] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:23.402288] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:23.404019] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-30T22:15:23.404242] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-30T22:15:23.402984] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:23.405715] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49762 primary records. [2025-09-30T22:15:23.406139] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-30T22:15:23.424574] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-30T22:15:23.434023] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-30T22:15:23.439672] [INFO ] [MAIN ] Derivative Progress: 1622/2009 symbols completed. SNAP took 1.3s. Estimated remaining: 2m 39s. Rate: 145.9 symbols/min [2025-09-30T22:15:23.440121] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:23.444707] [DEBUG] [LOCAL ] SNDA: Loaded 4543 existing records from primary storage. [2025-09-30T22:15:23.445084] [INFO ] [MAIN ] SNDA: Loaded 4543 primary data records. [2025-09-30T22:15:23.567894] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-30T22:15:23.568159] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-30T22:15:23.570676] [INFO ] [MAIN ] Derivative Progress: 1623/2009 symbols completed. SN took 1.5s. Estimated remaining: 2m 39s. Rate: 146.0 symbols/min [2025-09-30T22:15:23.570874] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:23.802699] [DEBUG] [LOCAL ] SNDR: Loaded 40697 existing records from primary storage. [2025-09-30T22:15:23.803081] [INFO ] [MAIN ] SNDR: Loaded 40697 primary data records. [2025-09-30T22:15:24.177233] [DEBUG] [LOCAL ] SNN: Loaded 44274 existing records from primary storage. [2025-09-30T22:15:24.185787] [INFO ] [MAIN ] SNN: Loaded 44274 primary data records. [2025-09-30T22:15:24.257550] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:24.264371] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4543 primary records. [2025-09-30T22:15:24.278440] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-30T22:15:24.522056] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-30T22:15:24.667577] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-30T22:15:24.682494] [INFO ] [MAIN ] Derivative Progress: 1624/2009 symbols completed. SNDA took 1.3s. Estimated remaining: 2m 38s. Rate: 145.8 symbols/min [2025-09-30T22:15:24.683705] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:24.724976] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:24.726013] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40697 primary records. [2025-09-30T22:15:24.726488] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-30T22:15:24.774731] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-30T22:15:24.793380] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-30T22:15:24.796511] [INFO ] [MAIN ] Derivative Progress: 1625/2009 symbols completed. SNDR took 1.4s. Estimated remaining: 2m 38s. Rate: 145.9 symbols/min [2025-09-30T22:15:24.796982] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:24.793884] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:24.798413] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44274 primary records. [2025-09-30T22:15:24.798991] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-30T22:15:24.848532] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-30T22:15:24.848753] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-30T22:15:24.852477] [INFO ] [MAIN ] Derivative Progress: 1626/2009 symbols completed. SNN took 1.3s. Estimated remaining: 2m 37s. Rate: 146.0 symbols/min [2025-09-30T22:15:24.852976] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:24.856978] [DEBUG] [LOCAL ] SNV: Loaded 48852 existing records from primary storage. [2025-09-30T22:15:24.857288] [INFO ] [MAIN ] SNV: Loaded 48852 primary data records. [2025-09-30T22:15:25.108471] [DEBUG] [LOCAL ] SNX: Loaded 39987 existing records from primary storage. [2025-09-30T22:15:25.130566] [DEBUG] [LOCAL ] SOBO: Loaded 39442 existing records from primary storage. [2025-09-30T22:15:25.119399] [INFO ] [MAIN ] SNX: Loaded 39987 primary data records. [2025-09-30T22:15:25.210971] [INFO ] [MAIN ] SOBO: Loaded 39442 primary data records. [2025-09-30T22:15:26.081382] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:26.082250] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48852 primary records. [2025-09-30T22:15:26.082349] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-30T22:15:26.101102] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-30T22:15:26.101383] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-30T22:15:26.103428] [INFO ] [MAIN ] Derivative Progress: 1627/2009 symbols completed. SNV took 1.4s. Estimated remaining: 2m 37s. Rate: 145.8 symbols/min [2025-09-30T22:15:26.103792] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:26.123084] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:26.125091] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39987 primary records. [2025-09-30T22:15:26.126728] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-30T22:15:26.152692] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:26.154054] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39442 primary records. [2025-09-30T22:15:26.154369] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-30T22:15:26.174341] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-30T22:15:26.174789] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-30T22:15:26.177471] [INFO ] [MAIN ] Derivative Progress: 1628/2009 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 37s. Rate: 145.9 symbols/min [2025-09-30T22:15:26.178246] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:26.179261] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-30T22:15:26.190959] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-30T22:15:26.193575] [INFO ] [MAIN ] Derivative Progress: 1629/2009 symbols completed. SNX took 1.4s. Estimated remaining: 2m 36s. Rate: 145.9 symbols/min [2025-09-30T22:15:26.193989] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:26.200817] [DEBUG] [LOCAL ] SOJC: Loaded 5058 existing records from primary storage. [2025-09-30T22:15:26.200999] [INFO ] [MAIN ] SOJC: Loaded 5058 primary data records. [2025-09-30T22:15:26.336065] [DEBUG] [LOCAL ] SOC: Loaded 50398 existing records from primary storage. [2025-09-30T22:15:26.342880] [INFO ] [MAIN ] SOC: Loaded 50398 primary data records. [2025-09-30T22:15:26.322734] [DEBUG] [LOCAL ] SOJD: Loaded 13075 existing records from primary storage. [2025-09-30T22:15:26.371474] [INFO ] [MAIN ] SOJD: Loaded 13075 primary data records. [2025-09-30T22:15:27.326827] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:27.329145] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5058 primary records. [2025-09-30T22:15:27.329671] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-30T22:15:27.348365] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-30T22:15:27.348946] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-30T22:15:27.351073] [INFO ] [MAIN ] Derivative Progress: 1630/2009 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 36s. Rate: 145.8 symbols/min [2025-09-30T22:15:27.351409] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:27.366577] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:27.367468] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50398 primary records. [2025-09-30T22:15:27.367784] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-30T22:15:27.402401] [DEBUG] [LOCAL ] SOJE: Loaded 9353 existing records from primary storage. [2025-09-30T22:15:27.405254] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:27.406515] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13075 primary records. [2025-09-30T22:15:27.406671] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-30T22:15:27.404948] [INFO ] [MAIN ] SOJE: Loaded 9353 primary data records. [2025-09-30T22:15:27.493989] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-30T22:15:27.507754] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-30T22:15:27.516014] [INFO ] [MAIN ] Derivative Progress: 1631/2009 symbols completed. SOC took 1.4s. Estimated remaining: 2m 36s. Rate: 145.8 symbols/min [2025-09-30T22:15:27.521635] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:27.567677] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-30T22:15:27.605200] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-30T22:15:27.634698] [INFO ] [MAIN ] Derivative Progress: 1632/2009 symbols completed. SOJD took 1.4s. Estimated remaining: 2m 35s. Rate: 145.9 symbols/min [2025-09-30T22:15:27.779185] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:27.787359] [DEBUG] [LOCAL ] SOL: Loaded 13394 existing records from primary storage. [2025-09-30T22:15:27.787709] [INFO ] [MAIN ] SOL: Loaded 13394 primary data records. [2025-09-30T22:15:28.152247] [DEBUG] [LOCAL ] SON: Loaded 43029 existing records from primary storage. [2025-09-30T22:15:28.152617] [INFO ] [MAIN ] SON: Loaded 43029 primary data records. [2025-09-30T22:15:28.304281] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:28.351433] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9353 primary records. [2025-09-30T22:15:28.506421] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-30T22:15:28.531456] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-30T22:15:28.543968] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-30T22:15:28.546191] [INFO ] [MAIN ] Derivative Progress: 1633/2009 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 35s. Rate: 145.8 symbols/min [2025-09-30T22:15:28.548259] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:28.549099] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13394 primary records. [2025-09-30T22:15:28.550074] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-30T22:15:28.567898] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-30T22:15:28.568037] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-30T22:15:28.570706] [INFO ] [MAIN ] Derivative Progress: 1634/2009 symbols completed. SOL took 1.0s. Estimated remaining: 2m 34s. Rate: 145.9 symbols/min [2025-09-30T22:15:28.586470] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:28.587076] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43029 primary records. [2025-09-30T22:15:28.587138] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-30T22:15:28.603292] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-30T22:15:28.603371] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-30T22:15:28.605833] [INFO ] [MAIN ] Derivative Progress: 1635/2009 symbols completed. SON took 0.8s. Estimated remaining: 2m 34s. Rate: 146.0 symbols/min [2025-09-30T22:15:28.606301] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:28.606414] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:28.606496] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:28.612545] [DEBUG] [LOCAL ] SOR: Loaded 2876 existing records from primary storage. [2025-09-30T22:15:28.612698] [INFO ] [MAIN ] SOR: Loaded 2876 primary data records. [2025-09-30T22:15:28.705442] [DEBUG] [LOCAL ] SOS: Loaded 8590 existing records from primary storage. [2025-09-30T22:15:28.716546] [INFO ] [MAIN ] SOS: Loaded 8590 primary data records. [2025-09-30T22:15:29.217197] [DEBUG] [LOCAL ] SONY: Loaded 53361 existing records from primary storage. [2025-09-30T22:15:29.340620] [INFO ] [MAIN ] SONY: Loaded 53361 primary data records. [2025-09-30T22:15:29.697942] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:29.699332] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2876 primary records. [2025-09-30T22:15:29.699464] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-30T22:15:29.716620] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-30T22:15:29.717670] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-30T22:15:29.720354] [INFO ] [MAIN ] Derivative Progress: 1636/2009 symbols completed. SOR took 1.1s. Estimated remaining: 2m 33s. Rate: 145.8 symbols/min [2025-09-30T22:15:29.720856] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:29.734587] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:29.735766] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 8590 primary records. [2025-09-30T22:15:29.736075] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-30T22:15:29.755627] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-09-30T22:15:29.756017] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-30T22:15:29.758718] [INFO ] [MAIN ] Derivative Progress: 1637/2009 symbols completed. SOS took 1.2s. Estimated remaining: 2m 33s. Rate: 145.9 symbols/min [2025-09-30T22:15:29.759025] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:29.779198] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:29.788974] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53361 primary records. [2025-09-30T22:15:29.789191] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-30T22:15:29.820719] [DEBUG] [LOCAL ] SPB: Loaded 34054 existing records from primary storage. [2025-09-30T22:15:29.821219] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-30T22:15:29.821316] [INFO ] [MAIN ] SPB: Loaded 34054 primary data records. [2025-09-30T22:15:29.821389] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-30T22:15:29.824391] [INFO ] [MAIN ] Derivative Progress: 1638/2009 symbols completed. SONY took 1.2s. Estimated remaining: 2m 33s. Rate: 146.0 symbols/min [2025-09-30T22:15:29.824588] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:29.959747] [DEBUG] [LOCAL ] SPE: Loaded 6352 existing records from primary storage. [2025-09-30T22:15:29.975805] [INFO ] [MAIN ] SPE: Loaded 6352 primary data records. [2025-09-30T22:15:30.018982] [DEBUG] [LOCAL ] SPCE: Loaded 49901 existing records from primary storage. [2025-09-30T22:15:30.127348] [INFO ] [MAIN ] SPCE: Loaded 49901 primary data records. [2025-09-30T22:15:30.931588] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:30.933241] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34054 primary records. [2025-09-30T22:15:30.933344] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-30T22:15:30.967888] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:30.970039] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6352 primary records. [2025-09-30T22:15:30.971162] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-30T22:15:30.970741] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-30T22:15:30.971303] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-30T22:15:30.974134] [INFO ] [MAIN ] Derivative Progress: 1639/2009 symbols completed. SPB took 1.3s. Estimated remaining: 2m 32s. Rate: 145.8 symbols/min [2025-09-30T22:15:30.974367] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:31.014494] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-30T22:15:31.015623] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:31.015880] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-30T22:15:31.019204] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49901 primary records. [2025-09-30T22:15:31.019423] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-30T22:15:31.019072] [INFO ] [MAIN ] Derivative Progress: 1640/2009 symbols completed. SPE took 1.2s. Estimated remaining: 2m 32s. Rate: 145.9 symbols/min [2025-09-30T22:15:31.020416] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:31.041415] [DEBUG] [LOCAL ] SPH: Loaded 17642 existing records from primary storage. [2025-09-30T22:15:31.042287] [INFO ] [MAIN ] SPH: Loaded 17642 primary data records. [2025-09-30T22:15:31.149247] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-30T22:15:31.155319] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-30T22:15:31.179841] [INFO ] [MAIN ] Derivative Progress: 1641/2009 symbols completed. SPCE took 1.4s. Estimated remaining: 2m 31s. Rate: 145.9 symbols/min [2025-09-30T22:15:31.195788] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:31.421793] [DEBUG] [LOCAL ] SPHR: Loaded 39994 existing records from primary storage. [2025-09-30T22:15:31.422327] [INFO ] [MAIN ] SPHR: Loaded 39994 primary data records. [2025-09-30T22:15:31.617629] [DEBUG] [LOCAL ] SPIR: Loaded 37168 existing records from primary storage. [2025-09-30T22:15:31.623969] [INFO ] [MAIN ] SPIR: Loaded 37168 primary data records. [2025-09-30T22:15:32.180548] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:32.181994] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 17642 primary records. [2025-09-30T22:15:32.182251] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-30T22:15:32.204729] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-30T22:15:32.205112] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-30T22:15:32.209874] [INFO ] [MAIN ] Derivative Progress: 1642/2009 symbols completed. SPH took 1.2s. Estimated remaining: 2m 31s. Rate: 145.8 symbols/min [2025-09-30T22:15:32.212178] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:32.227587] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:32.228554] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 39994 primary records. [2025-09-30T22:15:32.228921] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-30T22:15:32.249493] [DEBUG] [LOCAL ] SPMC: Loaded 5394 existing records from primary storage. [2025-09-30T22:15:32.250265] [INFO ] [MAIN ] SPMC: Loaded 5394 primary data records. [2025-09-30T22:15:32.331139] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:32.355615] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37168 primary records. [2025-09-30T22:15:32.366370] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-30T22:15:32.366298] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-30T22:15:32.381569] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-30T22:15:32.387561] [INFO ] [MAIN ] Derivative Progress: 1643/2009 symbols completed. SPHR took 1.4s. Estimated remaining: 2m 31s. Rate: 145.8 symbols/min [2025-09-30T22:15:32.394112] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:32.614870] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-30T22:15:32.615013] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-30T22:15:32.617722] [INFO ] [MAIN ] Derivative Progress: 1644/2009 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 30s. Rate: 145.9 symbols/min [2025-09-30T22:15:32.618067] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:32.651252] [DEBUG] [LOCAL ] SPNT: Loaded 34802 existing records from primary storage. [2025-09-30T22:15:32.651825] [INFO ] [MAIN ] SPNT: Loaded 34802 primary data records. [2025-09-30T22:15:32.792542] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:32.816729] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5394 primary records. [2025-09-30T22:15:32.833969] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-30T22:15:32.828683] [DEBUG] [LOCAL ] SPR: Loaded 41107 existing records from primary storage. [2025-09-30T22:15:32.885716] [INFO ] [MAIN ] SPR: Loaded 41107 primary data records. [2025-09-30T22:15:33.206974] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-09-30T22:15:33.245991] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-30T22:15:33.249761] [INFO ] [MAIN ] Derivative Progress: 1645/2009 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 30s. Rate: 145.8 symbols/min [2025-09-30T22:15:33.292432] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:33.444851] [DEBUG] [LOCAL ] SPRU: Loaded 8931 existing records from primary storage. [2025-09-30T22:15:33.445138] [INFO ] [MAIN ] SPRU: Loaded 8931 primary data records. [2025-09-30T22:15:33.516495] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:33.550525] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34802 primary records. [2025-09-30T22:15:33.566820] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-30T22:15:33.827873] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:33.830710] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-30T22:15:33.829924] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41107 primary records. [2025-09-30T22:15:33.830853] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-30T22:15:33.834308] [INFO ] [MAIN ] Derivative Progress: 1646/2009 symbols completed. SPNT took 1.4s. Estimated remaining: 2m 29s. Rate: 145.8 symbols/min [2025-09-30T22:15:33.834628] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:33.830974] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-30T22:15:33.863595] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-30T22:15:33.864073] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-30T22:15:33.866860] [INFO ] [MAIN ] Derivative Progress: 1647/2009 symbols completed. SPR took 1.2s. Estimated remaining: 2m 29s. Rate: 145.9 symbols/min [2025-09-30T22:15:33.867327] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:33.892829] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:15:33.893744] [INFO ] [MAIN ] SPRU: Generated 1792 derivative records from 8931 primary records. [2025-09-30T22:15:33.893825] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-30T22:15:33.916956] [DEBUG] [LOCAL ] SPXC: Loaded 23324 existing records from primary storage. [2025-09-30T22:15:33.917606] [INFO ] [MAIN ] SPXC: Loaded 23324 primary data records. [2025-09-30T22:15:34.035991] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1792 records). [2025-09-30T22:15:34.050613] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-30T22:15:34.073163] [INFO ] [MAIN ] Derivative Progress: 1648/2009 symbols completed. SPRU took 0.8s. Estimated remaining: 2m 28s. Rate: 145.9 symbols/min [2025-09-30T22:15:34.125558] [DEBUG] [LOCAL ] SQM: Loaded 48586 existing records from primary storage. [2025-09-30T22:15:34.149173] [INFO ] [MAIN ] SQM: Loaded 48586 primary data records. [2025-09-30T22:15:34.621966] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:34.622865] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23324 primary records. [2025-09-30T22:15:34.622964] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-30T22:15:34.644349] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-30T22:15:34.644545] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-30T22:15:34.646914] [INFO ] [MAIN ] Derivative Progress: 1649/2009 symbols completed. SPXC took 0.8s. Estimated remaining: 2m 28s. Rate: 145.9 symbols/min [2025-09-30T22:15:34.659614] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:34.660356] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48586 primary records. [2025-09-30T22:15:34.660419] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-30T22:15:34.675471] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-30T22:15:34.675544] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-30T22:15:34.678092] [INFO ] [MAIN ] Derivative Progress: 1650/2009 symbols completed. SQM took 0.8s. Estimated remaining: 2m 28s. Rate: 146.0 symbols/min [2025-09-30T22:15:34.678533] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:34.678598] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:34.678874] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:34.691873] [DEBUG] [LOCAL ] SREA: Loaded 10425 existing records from primary storage. [2025-09-30T22:15:34.692010] [INFO ] [MAIN ] SREA: Loaded 10425 primary data records. [2025-09-30T22:15:34.844408] [DEBUG] [LOCAL ] SQNS: Loaded 26313 existing records from primary storage. [2025-09-30T22:15:34.870134] [INFO ] [MAIN ] SQNS: Loaded 26313 primary data records. [2025-09-30T22:15:35.092702] [DEBUG] [LOCAL ] SR: Loaded 32887 existing records from primary storage. [2025-09-30T22:15:35.131707] [INFO ] [MAIN ] SR: Loaded 32887 primary data records. [2025-09-30T22:15:35.783776] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:35.785190] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10425 primary records. [2025-09-30T22:15:35.786207] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-30T22:15:35.820014] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:35.821307] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26313 primary records. [2025-09-30T22:15:35.821438] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-30T22:15:35.821539] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-30T22:15:35.824215] [INFO ] [MAIN ] Derivative Progress: 1651/2009 symbols completed. SREA took 1.1s. Estimated remaining: 2m 27s. Rate: 145.8 symbols/min [2025-09-30T22:15:35.825222] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-30T22:15:35.826515] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:35.854686] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:35.855986] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32887 primary records. [2025-09-30T22:15:35.856611] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-30T22:15:35.867082] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-30T22:15:35.871254] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-30T22:15:35.874167] [INFO ] [MAIN ] Derivative Progress: 1652/2009 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 27s. Rate: 145.9 symbols/min [2025-09-30T22:15:35.874589] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:35.877097] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-30T22:15:35.877199] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-30T22:15:35.880105] [INFO ] [MAIN ] Derivative Progress: 1653/2009 symbols completed. SR took 1.2s. Estimated remaining: 2m 26s. Rate: 146.0 symbols/min [2025-09-30T22:15:35.880866] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:35.910787] [DEBUG] [LOCAL ] SRFM: Loaded 36500 existing records from primary storage. [2025-09-30T22:15:35.918273] [INFO ] [MAIN ] SRFM: Loaded 36500 primary data records. [2025-09-30T22:15:35.979249] [DEBUG] [LOCAL ] SRG: Loaded 15509 existing records from primary storage. [2025-09-30T22:15:36.007215] [INFO ] [MAIN ] SRG: Loaded 15509 primary data records. [2025-09-30T22:15:36.095129] [DEBUG] [LOCAL ] SRI: Loaded 27270 existing records from primary storage. [2025-09-30T22:15:36.155466] [INFO ] [MAIN ] SRI: Loaded 27270 primary data records. [2025-09-30T22:15:36.957877] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:36.960316] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 36500 primary records. [2025-09-30T22:15:36.961131] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-30T22:15:36.987490] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:36.992433] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-30T22:15:36.992686] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15509 primary records. [2025-09-30T22:15:36.992770] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-30T22:15:36.993610] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-30T22:15:36.996467] [INFO ] [MAIN ] Derivative Progress: 1654/2009 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 26s. Rate: 145.8 symbols/min [2025-09-30T22:15:37.004919] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:37.035131] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:37.035713] [DEBUG] [LOCAL ] SRV: Loaded 7419 existing records from primary storage. [2025-09-30T22:15:37.036469] [INFO ] [MAIN ] SRV: Loaded 7419 primary data records. [2025-09-30T22:15:37.037054] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-30T22:15:37.055487] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27270 primary records. [2025-09-30T22:15:37.049184] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-30T22:15:37.079309] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-30T22:15:37.082776] [INFO ] [MAIN ] Derivative Progress: 1655/2009 symbols completed. SRG took 1.2s. Estimated remaining: 2m 26s. Rate: 145.9 symbols/min [2025-09-30T22:15:37.092443] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:37.152612] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-30T22:15:37.158134] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-30T22:15:37.161020] [INFO ] [MAIN ] Derivative Progress: 1656/2009 symbols completed. SRI took 1.3s. Estimated remaining: 2m 25s. Rate: 146.0 symbols/min [2025-09-30T22:15:37.161297] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:37.439249] [DEBUG] [LOCAL ] SSD: Loaded 22460 existing records from primary storage. [2025-09-30T22:15:37.439416] [INFO ] [MAIN ] SSD: Loaded 22460 primary data records. [2025-09-30T22:15:37.547826] [DEBUG] [LOCAL ] SSB: Loaded 42707 existing records from primary storage. [2025-09-30T22:15:37.575745] [INFO ] [MAIN ] SSB: Loaded 42707 primary data records. [2025-09-30T22:15:37.981497] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:38.007808] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7419 primary records. [2025-09-30T22:15:38.119066] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-30T22:15:38.153413] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-30T22:15:38.154956] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-30T22:15:38.157700] [INFO ] [MAIN ] Derivative Progress: 1657/2009 symbols completed. SRV took 1.2s. Estimated remaining: 2m 25s. Rate: 145.8 symbols/min [2025-09-30T22:15:38.158020] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:38.180758] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:38.183088] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22460 primary records. [2025-09-30T22:15:38.183278] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-30T22:15:38.211074] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:38.213247] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-30T22:15:38.214001] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42707 primary records. [2025-09-30T22:15:38.223004] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-30T22:15:38.223116] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-30T22:15:38.225491] [INFO ] [MAIN ] Derivative Progress: 1658/2009 symbols completed. SSD took 1.1s. Estimated remaining: 2m 24s. Rate: 145.9 symbols/min [2025-09-30T22:15:38.226675] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:38.246286] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-30T22:15:38.263174] [DEBUG] [LOCAL ] SST: Loaded 11924 existing records from primary storage. [2025-09-30T22:15:38.262876] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-30T22:15:38.263310] [INFO ] [MAIN ] SST: Loaded 11924 primary data records. [2025-09-30T22:15:38.264091] [DEBUG] [LOCAL ] SSL: Loaded 41129 existing records from primary storage. [2025-09-30T22:15:38.269390] [INFO ] [MAIN ] SSL: Loaded 41129 primary data records. [2025-09-30T22:15:38.300605] [INFO ] [MAIN ] Derivative Progress: 1659/2009 symbols completed. SSB took 1.2s. Estimated remaining: 2m 24s. Rate: 146.0 symbols/min [2025-09-30T22:15:38.300958] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:38.824345] [DEBUG] [LOCAL ] SSTK: Loaded 25974 existing records from primary storage. [2025-09-30T22:15:38.948799] [INFO ] [MAIN ] SSTK: Loaded 25974 primary data records. [2025-09-30T22:15:39.364598] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:39.366235] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11924 primary records. [2025-09-30T22:15:39.366337] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-30T22:15:39.393356] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:39.394778] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41129 primary records. [2025-09-30T22:15:39.395105] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-30T22:15:39.416544] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-30T22:15:39.416478] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-30T22:15:39.416708] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-30T22:15:39.416846] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-30T22:15:39.419134] [INFO ] [MAIN ] Derivative Progress: 1660/2009 symbols completed. SSL took 1.3s. Estimated remaining: 2m 24s. Rate: 145.8 symbols/min [2025-09-30T22:15:39.421774] [INFO ] [MAIN ] Derivative Progress: 1661/2009 symbols completed. SST took 1.2s. Estimated remaining: 2m 23s. Rate: 145.9 symbols/min [2025-09-30T22:15:39.419392] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:39.422693] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:39.441082] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:39.442014] [INFO ] [MAIN ] SSTK: Generated 1793 derivative records from 25974 primary records. [2025-09-30T22:15:39.442146] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-30T22:15:39.460922] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1793 records). [2025-09-30T22:15:39.461327] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-30T22:15:39.464444] [INFO ] [MAIN ] Derivative Progress: 1662/2009 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 23s. Rate: 146.0 symbols/min [2025-09-30T22:15:39.464682] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:39.505700] [DEBUG] [LOCAL ] ST: Loaded 49737 existing records from primary storage. [2025-09-30T22:15:39.505963] [INFO ] [MAIN ] ST: Loaded 49737 primary data records. [2025-09-30T22:15:39.577982] [DEBUG] [LOCAL ] STC: Loaded 17485 existing records from primary storage. [2025-09-30T22:15:39.590381] [INFO ] [MAIN ] STC: Loaded 17485 primary data records. [2025-09-30T22:15:40.010425] [DEBUG] [LOCAL ] STAG: Loaded 50054 existing records from primary storage. [2025-09-30T22:15:40.044009] [INFO ] [MAIN ] STAG: Loaded 50054 primary data records. [2025-09-30T22:15:40.554574] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:40.556623] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49737 primary records. [2025-09-30T22:15:40.557173] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-30T22:15:40.582663] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-30T22:15:40.583453] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-30T22:15:40.586334] [INFO ] [MAIN ] Derivative Progress: 1663/2009 symbols completed. ST took 1.2s. Estimated remaining: 2m 22s. Rate: 145.9 symbols/min [2025-09-30T22:15:40.600292] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:40.601084] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17485 primary records. [2025-09-30T22:15:40.601249] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-30T22:15:40.620079] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-30T22:15:40.620283] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-30T22:15:40.622635] [INFO ] [MAIN ] Derivative Progress: 1664/2009 symbols completed. STC took 1.2s. Estimated remaining: 2m 22s. Rate: 145.9 symbols/min [2025-09-30T22:15:40.635979] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:40.636760] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50054 primary records. [2025-09-30T22:15:40.636828] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-30T22:15:40.653163] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-30T22:15:40.653302] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-30T22:15:40.655912] [INFO ] [MAIN ] Derivative Progress: 1665/2009 symbols completed. STAG took 1.2s. Estimated remaining: 2m 21s. Rate: 146.0 symbols/min [2025-09-30T22:15:40.656503] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:40.656421] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:40.656928] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:40.677607] [DEBUG] [LOCAL ] STEW: Loaded 16033 existing records from primary storage. [2025-09-30T22:15:40.683207] [INFO ] [MAIN ] STEW: Loaded 16033 primary data records. [2025-09-30T22:15:40.811291] [DEBUG] [LOCAL ] STEL: Loaded 23231 existing records from primary storage. [2025-09-30T22:15:40.827312] [INFO ] [MAIN ] STEL: Loaded 23231 primary data records. [2025-09-30T22:15:40.849714] [DEBUG] [LOCAL ] STEM: Loaded 39380 existing records from primary storage. [2025-09-30T22:15:40.900307] [INFO ] [MAIN ] STEM: Loaded 39380 primary data records. [2025-09-30T22:15:41.763848] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:41.766511] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16033 primary records. [2025-09-30T22:15:41.769059] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-30T22:15:41.793014] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:41.798545] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23231 primary records. [2025-09-30T22:15:41.798977] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-30T22:15:41.825768] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-30T22:15:41.826238] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-30T22:15:41.829614] [INFO ] [MAIN ] Derivative Progress: 1666/2009 symbols completed. STEL took 1.2s. Estimated remaining: 2m 21s. Rate: 145.9 symbols/min [2025-09-30T22:15:41.829931] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:41.830532] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-30T22:15:41.844259] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-30T22:15:41.846823] [INFO ] [MAIN ] Derivative Progress: 1667/2009 symbols completed. STEW took 1.2s. Estimated remaining: 2m 21s. Rate: 145.9 symbols/min [2025-09-30T22:15:41.846979] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:41.847842] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:41.848591] [INFO ] [MAIN ] STEM: Generated 1793 derivative records from 39380 primary records. [2025-09-30T22:15:41.848860] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-30T22:15:41.869323] [DEBUG] [LOCAL ] STEM: Derivative data saved (1793 records). [2025-09-30T22:15:41.873961] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-30T22:15:41.876991] [INFO ] [MAIN ] Derivative Progress: 1668/2009 symbols completed. STEM took 1.2s. Estimated remaining: 2m 20s. Rate: 146.0 symbols/min [2025-09-30T22:15:41.873683] [DEBUG] [LOCAL ] STK: Loaded 9399 existing records from primary storage. [2025-09-30T22:15:41.877280] [INFO ] [MAIN ] STK: Loaded 9399 primary data records. [2025-09-30T22:15:41.882816] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:42.245985] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-09-30T22:15:42.246200] [INFO ] [MAIN ] STLA: Loaded 53542 primary data records. [2025-09-30T22:15:42.407600] [DEBUG] [LOCAL ] STM: Loaded 53581 existing records from primary storage. [2025-09-30T22:15:42.444546] [INFO ] [MAIN ] STM: Loaded 53581 primary data records. [2025-09-30T22:15:42.852384] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:42.860753] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9399 primary records. [2025-09-30T22:15:42.861232] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-30T22:15:43.011811] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-30T22:15:43.012353] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-30T22:15:43.015014] [INFO ] [MAIN ] Derivative Progress: 1669/2009 symbols completed. STK took 1.2s. Estimated remaining: 2m 20s. Rate: 145.9 symbols/min [2025-09-30T22:15:43.015502] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:43.042737] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:43.044844] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53542 primary records. [2025-09-30T22:15:43.045241] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-30T22:15:43.074167] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-09-30T22:15:43.074570] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-30T22:15:43.077057] [INFO ] [MAIN ] Derivative Progress: 1670/2009 symbols completed. STLA took 1.2s. Estimated remaining: 2m 19s. Rate: 145.9 symbols/min [2025-09-30T22:15:43.084292] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:43.086404] [DEBUG] [LOCAL ] STN: Loaded 22898 existing records from primary storage. [2025-09-30T22:15:43.086527] [INFO ] [MAIN ] STN: Loaded 22898 primary data records. [2025-09-30T22:15:43.217052] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:43.223096] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53581 primary records. [2025-09-30T22:15:43.223292] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-30T22:15:43.479142] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-30T22:15:43.479334] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-30T22:15:43.480241] [DEBUG] [LOCAL ] STNG: Loaded 43901 existing records from primary storage. [2025-09-30T22:15:43.484808] [INFO ] [MAIN ] Derivative Progress: 1671/2009 symbols completed. STM took 1.6s. Estimated remaining: 2m 19s. Rate: 145.9 symbols/min [2025-09-30T22:15:43.485011] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:43.485587] [INFO ] [MAIN ] STNG: Loaded 43901 primary data records. [2025-09-30T22:15:43.615453] [DEBUG] [LOCAL ] STRV: Loaded 11413 existing records from primary storage. [2025-09-30T22:15:43.626690] [INFO ] [MAIN ] STRV: Loaded 11413 primary data records. [2025-09-30T22:15:44.026044] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:44.033035] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22898 primary records. [2025-09-30T22:15:44.043844] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-30T22:15:44.258906] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-30T22:15:44.259561] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-30T22:15:44.263121] [INFO ] [MAIN ] Derivative Progress: 1672/2009 symbols completed. STN took 1.2s. Estimated remaining: 2m 19s. Rate: 145.9 symbols/min [2025-09-30T22:15:44.263496] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:44.284051] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:44.285059] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43901 primary records. [2025-09-30T22:15:44.285318] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-30T22:15:44.313098] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-30T22:15:44.313608] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-30T22:15:44.316731] [INFO ] [MAIN ] Derivative Progress: 1673/2009 symbols completed. STNG took 1.2s. Estimated remaining: 2m 18s. Rate: 145.9 symbols/min [2025-09-30T22:15:44.317280] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:44.331341] [DEBUG] [LOCAL ] STVN: Loaded 26313 existing records from primary storage. [2025-09-30T22:15:44.339501] [INFO ] [MAIN ] STVN: Loaded 26313 primary data records. [2025-09-30T22:15:44.345060] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:44.368310] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11413 primary records. [2025-09-30T22:15:44.379914] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-30T22:15:44.488882] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-09-30T22:15:44.497582] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-30T22:15:44.500581] [INFO ] [MAIN ] Derivative Progress: 1674/2009 symbols completed. STRV took 1.0s. Estimated remaining: 2m 18s. Rate: 146.0 symbols/min [2025-09-30T22:15:44.501522] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:44.591468] [DEBUG] [LOCAL ] STXD: Loaded 1287 existing records from primary storage. [2025-09-30T22:15:44.608912] [INFO ] [MAIN ] STXD: Loaded 1287 primary data records. [2025-09-30T22:15:44.805919] [DEBUG] [LOCAL ] STWD: Loaded 51880 existing records from primary storage. [2025-09-30T22:15:44.831920] [INFO ] [MAIN ] STWD: Loaded 51880 primary data records. [2025-09-30T22:15:45.423779] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:45.425585] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26313 primary records. [2025-09-30T22:15:45.425852] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-30T22:15:45.448678] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-30T22:15:45.456330] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-30T22:15:45.463901] [INFO ] [MAIN ] Derivative Progress: 1675/2009 symbols completed. STVN took 1.2s. Estimated remaining: 2m 17s. Rate: 145.9 symbols/min [2025-09-30T22:15:45.464245] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:45.465423] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:15:45.466369] [INFO ] [MAIN ] STXD: Generated 1792 derivative records from 1287 primary records. [2025-09-30T22:15:45.468087] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-30T22:15:45.483577] [DEBUG] [LOCAL ] STXE: Loaded 2181 existing records from primary storage. [2025-09-30T22:15:45.484575] [INFO ] [MAIN ] STXE: Loaded 2181 primary data records. [2025-09-30T22:15:45.517560] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:45.541546] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51880 primary records. [2025-09-30T22:15:45.556890] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-30T22:15:45.556792] [DEBUG] [LOCAL ] STXD: Derivative data saved (1792 records). [2025-09-30T22:15:45.584843] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-30T22:15:45.603212] [INFO ] [MAIN ] Derivative Progress: 1676/2009 symbols completed. STXD took 1.1s. Estimated remaining: 2m 17s. Rate: 145.9 symbols/min [2025-09-30T22:15:45.617316] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:45.648156] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-30T22:15:45.658684] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-30T22:15:45.661433] [INFO ] [MAIN ] Derivative Progress: 1677/2009 symbols completed. STWD took 1.3s. Estimated remaining: 2m 16s. Rate: 146.0 symbols/min [2025-09-30T22:15:45.681762] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:45.873403] [DEBUG] [LOCAL ] STXG: Loaded 2521 existing records from primary storage. [2025-09-30T22:15:45.883381] [INFO ] [MAIN ] STXG: Loaded 2521 primary data records. [2025-09-30T22:15:45.903638] [DEBUG] [LOCAL ] STXK: Loaded 1495 existing records from primary storage. [2025-09-30T22:15:45.926175] [INFO ] [MAIN ] STXK: Loaded 1495 primary data records. [2025-09-30T22:15:46.586437] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:46.588235] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2181 primary records. [2025-09-30T22:15:46.588427] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-30T22:15:46.607768] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-30T22:15:46.608311] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-30T22:15:46.610752] [INFO ] [MAIN ] Derivative Progress: 1678/2009 symbols completed. STXE took 1.1s. Estimated remaining: 2m 16s. Rate: 145.9 symbols/min [2025-09-30T22:15:46.635059] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:46.648903] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:46.648546] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2521 primary records. [2025-09-30T22:15:46.649704] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1495 primary records. [2025-09-30T22:15:46.649926] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-30T22:15:46.649835] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-30T22:15:46.679086] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-30T22:15:46.680196] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-30T22:15:46.683531] [INFO ] [MAIN ] Derivative Progress: 1679/2009 symbols completed. STXK took 1.0s. Estimated remaining: 2m 16s. Rate: 146.0 symbols/min [2025-09-30T22:15:46.685505] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-30T22:15:46.685576] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-30T22:15:46.688413] [INFO ] [MAIN ] Derivative Progress: 1680/2009 symbols completed. STXG took 1.1s. Estimated remaining: 2m 15s. Rate: 146.0 symbols/min [2025-09-30T22:15:46.688861] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:46.688958] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:46.689058] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:46.694402] [DEBUG] [LOCAL ] STXV: Loaded 1586 existing records from primary storage. [2025-09-30T22:15:46.696507] [DEBUG] [LOCAL ] STXT: Loaded 2534 existing records from primary storage. [2025-09-30T22:15:46.696730] [INFO ] [MAIN ] STXV: Loaded 1586 primary data records. [2025-09-30T22:15:46.696813] [INFO ] [MAIN ] STXT: Loaded 2534 primary data records. [2025-09-30T22:15:47.240919] [DEBUG] [LOCAL ] SU: Loaded 53451 existing records from primary storage. [2025-09-30T22:15:47.259529] [INFO ] [MAIN ] SU: Loaded 53451 primary data records. [2025-09-30T22:15:47.753821] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:47.756236] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1586 primary records. [2025-09-30T22:15:47.756777] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-30T22:15:47.781990] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:47.790381] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2534 primary records. [2025-09-30T22:15:47.791519] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-30T22:15:47.807527] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-30T22:15:47.810983] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-30T22:15:47.814535] [INFO ] [MAIN ] Derivative Progress: 1681/2009 symbols completed. STXV took 1.1s. Estimated remaining: 2m 15s. Rate: 145.9 symbols/min [2025-09-30T22:15:47.810909] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-30T22:15:47.815126] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:47.816044] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-30T22:15:47.819478] [INFO ] [MAIN ] Derivative Progress: 1682/2009 symbols completed. STXT took 1.1s. Estimated remaining: 2m 14s. Rate: 146.0 symbols/min [2025-09-30T22:15:47.819801] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:47.848484] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:47.849635] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53451 primary records. [2025-09-30T22:15:47.849871] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-30T22:15:47.890219] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-30T22:15:47.890368] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-30T22:15:47.893209] [INFO ] [MAIN ] Derivative Progress: 1683/2009 symbols completed. SU took 1.2s. Estimated remaining: 2m 14s. Rate: 146.0 symbols/min [2025-09-30T22:15:47.893526] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:47.910414] [DEBUG] [LOCAL ] SUN: Loaded 37478 existing records from primary storage. [2025-09-30T22:15:47.922407] [INFO ] [MAIN ] SUN: Loaded 37478 primary data records. [2025-09-30T22:15:47.928491] [DEBUG] [LOCAL ] SUI: Loaded 41735 existing records from primary storage. [2025-09-30T22:15:47.962215] [INFO ] [MAIN ] SUI: Loaded 41735 primary data records. [2025-09-30T22:15:48.313506] [DEBUG] [LOCAL ] SUPV: Loaded 47280 existing records from primary storage. [2025-09-30T22:15:48.458319] [INFO ] [MAIN ] SUPV: Loaded 47280 primary data records. [2025-09-30T22:15:49.026962] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:49.028550] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37478 primary records. [2025-09-30T22:15:49.028858] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-30T22:15:49.057226] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:49.059561] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41735 primary records. [2025-09-30T22:15:49.060837] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-30T22:15:49.083724] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-30T22:15:49.083846] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-30T22:15:49.087173] [INFO ] [MAIN ] Derivative Progress: 1684/2009 symbols completed. SUN took 1.3s. Estimated remaining: 2m 14s. Rate: 145.9 symbols/min [2025-09-30T22:15:49.087375] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:49.083617] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-30T22:15:49.088233] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-30T22:15:49.091172] [INFO ] [MAIN ] Derivative Progress: 1685/2009 symbols completed. SUI took 1.3s. Estimated remaining: 2m 13s. Rate: 146.0 symbols/min [2025-09-30T22:15:49.091710] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:49.110964] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:49.111942] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47280 primary records. [2025-09-30T22:15:49.112100] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-30T22:15:49.134639] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-30T22:15:49.134907] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-30T22:15:49.138378] [INFO ] [MAIN ] Derivative Progress: 1686/2009 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 13s. Rate: 146.0 symbols/min [2025-09-30T22:15:49.148282] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:49.191829] [DEBUG] [LOCAL ] SVV: Loaded 39703 existing records from primary storage. [2025-09-30T22:15:49.192101] [INFO ] [MAIN ] SVV: Loaded 39703 primary data records. [2025-09-30T22:15:49.198769] [DEBUG] [LOCAL ] SUZ: Loaded 45715 existing records from primary storage. [2025-09-30T22:15:49.218448] [INFO ] [MAIN ] SUZ: Loaded 45715 primary data records. [2025-09-30T22:15:49.575880] [DEBUG] [LOCAL ] SW: Loaded 53156 existing records from primary storage. [2025-09-30T22:15:49.691925] [INFO ] [MAIN ] SW: Loaded 53156 primary data records. [2025-09-30T22:15:50.339536] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:50.341032] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45715 primary records. [2025-09-30T22:15:50.341743] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-30T22:15:50.341621] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:50.353806] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39703 primary records. [2025-09-30T22:15:50.358804] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-30T22:15:50.365798] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-30T22:15:50.373691] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-30T22:15:50.378111] [INFO ] [MAIN ] Derivative Progress: 1687/2009 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 12s. Rate: 145.9 symbols/min [2025-09-30T22:15:50.378533] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:50.391050] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-30T22:15:50.404626] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:50.404356] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-30T22:15:50.405559] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53156 primary records. [2025-09-30T22:15:50.408476] [INFO ] [MAIN ] Derivative Progress: 1688/2009 symbols completed. SVV took 1.3s. Estimated remaining: 2m 12s. Rate: 146.0 symbols/min [2025-09-30T22:15:50.408981] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:50.408852] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-30T22:15:50.429495] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-30T22:15:50.429759] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-30T22:15:50.432792] [INFO ] [MAIN ] Derivative Progress: 1689/2009 symbols completed. SW took 1.3s. Estimated remaining: 2m 11s. Rate: 146.0 symbols/min [2025-09-30T22:15:50.433052] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:50.449878] [DEBUG] [LOCAL ] SWZ: Loaded 6014 existing records from primary storage. [2025-09-30T22:15:50.450082] [INFO ] [MAIN ] SWZ: Loaded 6014 primary data records. [2025-09-30T22:15:50.570958] [DEBUG] [LOCAL ] SWX: Loaded 31066 existing records from primary storage. [2025-09-30T22:15:50.583585] [INFO ] [MAIN ] SWX: Loaded 31066 primary data records. [2025-09-30T22:15:50.957985] [DEBUG] [LOCAL ] SWK: Loaded 52386 existing records from primary storage. [2025-09-30T22:15:50.962906] [INFO ] [MAIN ] SWK: Loaded 52386 primary data records. [2025-09-30T22:15:51.536983] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:15:51.537845] [INFO ] [MAIN ] SWZ: Generated 1793 derivative records from 6014 primary records. [2025-09-30T22:15:51.538459] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-30T22:15:51.559170] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1793 records). [2025-09-30T22:15:51.559399] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-30T22:15:51.562213] [INFO ] [MAIN ] Derivative Progress: 1690/2009 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 11s. Rate: 145.9 symbols/min [2025-09-30T22:15:51.562530] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:51.576826] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:51.577637] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31066 primary records. [2025-09-30T22:15:51.577901] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-30T22:15:51.609977] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:51.612590] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-30T22:15:51.611376] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52386 primary records. [2025-09-30T22:15:51.612762] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-30T22:15:51.612814] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-30T22:15:51.616159] [INFO ] [MAIN ] Derivative Progress: 1691/2009 symbols completed. SWX took 1.2s. Estimated remaining: 2m 11s. Rate: 146.0 symbols/min [2025-09-30T22:15:51.616903] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:51.644109] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-30T22:15:51.644365] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-30T22:15:51.647743] [INFO ] [MAIN ] Derivative Progress: 1692/2009 symbols completed. SWK took 1.3s. Estimated remaining: 2m 10s. Rate: 146.0 symbols/min [2025-09-30T22:15:51.648080] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:51.663591] [DEBUG] [LOCAL ] SXC: Loaded 41407 existing records from primary storage. [2025-09-30T22:15:51.666155] [INFO ] [MAIN ] SXC: Loaded 41407 primary data records. [2025-09-30T22:15:51.755577] [DEBUG] [LOCAL ] SXI: Loaded 11488 existing records from primary storage. [2025-09-30T22:15:51.788160] [INFO ] [MAIN ] SXI: Loaded 11488 primary data records. [2025-09-30T22:15:52.089027] [DEBUG] [LOCAL ] SXT: Loaded 29307 existing records from primary storage. [2025-09-30T22:15:52.129861] [INFO ] [MAIN ] SXT: Loaded 29307 primary data records. [2025-09-30T22:15:52.805688] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:52.806813] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41407 primary records. [2025-09-30T22:15:52.807348] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-30T22:15:52.842673] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:52.844321] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11488 primary records. [2025-09-30T22:15:52.845015] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-30T22:15:52.846569] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-30T22:15:52.846947] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-30T22:15:52.849530] [INFO ] [MAIN ] Derivative Progress: 1693/2009 symbols completed. SXC took 1.3s. Estimated remaining: 2m 10s. Rate: 145.9 symbols/min [2025-09-30T22:15:52.867579] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-30T22:15:52.869260] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-30T22:15:52.872167] [INFO ] [MAIN ] Derivative Progress: 1694/2009 symbols completed. SXI took 1.3s. Estimated remaining: 2m 9s. Rate: 146.0 symbols/min [2025-09-30T22:15:52.885817] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:52.886450] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29307 primary records. [2025-09-30T22:15:52.886513] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-30T22:15:52.902821] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-30T22:15:52.902917] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-30T22:15:52.905682] [INFO ] [MAIN ] Derivative Progress: 1695/2009 symbols completed. SXT took 1.3s. Estimated remaining: 2m 9s. Rate: 146.0 symbols/min [2025-09-30T22:15:52.906233] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:52.906363] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:52.906766] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:52.986790] [DEBUG] [LOCAL ] SYK: Loaded 46866 existing records from primary storage. [2025-09-30T22:15:53.001899] [INFO ] [MAIN ] SYK: Loaded 46866 primary data records. [2025-09-30T22:15:53.016812] [DEBUG] [LOCAL ] SYY: Loaded 53220 existing records from primary storage. [2025-09-30T22:15:53.040749] [INFO ] [MAIN ] SYY: Loaded 53220 primary data records. [2025-09-30T22:15:53.157143] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-09-30T22:15:53.206820] [INFO ] [MAIN ] SYF: Loaded 53442 primary data records. [2025-09-30T22:15:54.093614] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:54.095378] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53220 primary records. [2025-09-30T22:15:54.095736] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-30T22:15:54.094071] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:54.096779] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46866 primary records. [2025-09-30T22:15:54.097540] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-30T22:15:54.141395] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-30T22:15:54.142574] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-30T22:15:54.146019] [INFO ] [MAIN ] Derivative Progress: 1696/2009 symbols completed. SYY took 1.2s. Estimated remaining: 2m 9s. Rate: 145.9 symbols/min [2025-09-30T22:15:54.146831] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:54.163663] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:54.165539] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53442 primary records. [2025-09-30T22:15:54.166729] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-30T22:15:54.166976] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-30T22:15:54.167994] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-30T22:15:54.170568] [INFO ] [MAIN ] Derivative Progress: 1697/2009 symbols completed. SYK took 1.3s. Estimated remaining: 2m 8s. Rate: 145.9 symbols/min [2025-09-30T22:15:54.186991] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-30T22:15:54.182483] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:54.187726] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-30T22:15:54.191058] [INFO ] [MAIN ] Derivative Progress: 1698/2009 symbols completed. SYF took 1.3s. Estimated remaining: 2m 8s. Rate: 146.0 symbols/min [2025-09-30T22:15:54.191361] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:54.267245] [DEBUG] [LOCAL ] TAC: Loaded 42538 existing records from primary storage. [2025-09-30T22:15:54.267368] [INFO ] [MAIN ] TAC: Loaded 42538 primary data records. [2025-09-30T22:15:54.400167] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-30T22:15:54.430520] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-30T22:15:54.431522] [DEBUG] [LOCAL ] TAK: Loaded 49806 existing records from primary storage. [2025-09-30T22:15:54.431885] [INFO ] [MAIN ] TAK: Loaded 49806 primary data records. [2025-09-30T22:15:55.388562] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:55.389805] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42538 primary records. [2025-09-30T22:15:55.390078] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-30T22:15:55.410937] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-30T22:15:55.411683] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-30T22:15:55.428866] [INFO ] [MAIN ] Derivative Progress: 1699/2009 symbols completed. TAC took 1.2s. Estimated remaining: 2m 8s. Rate: 145.8 symbols/min [2025-09-30T22:15:55.426976] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:55.429281] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:55.430352] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49806 primary records. [2025-09-30T22:15:55.430619] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-30T22:15:55.444949] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:55.458566] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-30T22:15:55.466996] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-30T22:15:55.466929] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-30T22:15:55.467669] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-30T22:15:55.470779] [INFO ] [MAIN ] Derivative Progress: 1700/2009 symbols completed. TAK took 1.3s. Estimated remaining: 2m 7s. Rate: 145.9 symbols/min [2025-09-30T22:15:55.471018] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:55.491728] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-30T22:15:55.491918] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-30T22:15:55.495141] [INFO ] [MAIN ] Derivative Progress: 1701/2009 symbols completed. T took 1.3s. Estimated remaining: 2m 7s. Rate: 146.0 symbols/min [2025-09-30T22:15:55.495464] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:55.550547] [DEBUG] [LOCAL ] TALO: Loaded 50785 existing records from primary storage. [2025-09-30T22:15:55.551502] [INFO ] [MAIN ] TALO: Loaded 50785 primary data records. [2025-09-30T22:15:55.640967] [DEBUG] [LOCAL ] TAL: Loaded 51976 existing records from primary storage. [2025-09-30T22:15:55.673922] [INFO ] [MAIN ] TAL: Loaded 51976 primary data records. [2025-09-30T22:15:55.886585] [DEBUG] [LOCAL ] TAP: Loaded 52878 existing records from primary storage. [2025-09-30T22:15:56.038123] [INFO ] [MAIN ] TAP: Loaded 52878 primary data records. [2025-09-30T22:15:56.645488] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:56.646885] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50785 primary records. [2025-09-30T22:15:56.646996] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-30T22:15:56.668623] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-30T22:15:56.669248] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-30T22:15:56.671148] [INFO ] [MAIN ] Derivative Progress: 1702/2009 symbols completed. TALO took 1.2s. Estimated remaining: 2m 6s. Rate: 145.8 symbols/min [2025-09-30T22:15:56.671517] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:56.687613] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:56.688613] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51976 primary records. [2025-09-30T22:15:56.689109] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-30T22:15:56.712063] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-30T22:15:56.714951] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-30T22:15:56.724470] [INFO ] [MAIN ] Derivative Progress: 1703/2009 symbols completed. TAL took 1.3s. Estimated remaining: 2m 6s. Rate: 145.9 symbols/min [2025-09-30T22:15:56.725392] [DEBUG] [LOCAL ] TBB: Loaded 11735 existing records from primary storage. [2025-09-30T22:15:56.725690] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:56.726179] [INFO ] [MAIN ] TBB: Loaded 11735 primary data records. [2025-09-30T22:15:56.759927] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:56.792021] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52878 primary records. [2025-09-30T22:15:56.832578] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-30T22:15:57.178888] [DEBUG] [LOCAL ] TBBB: Loaded 35601 existing records from primary storage. [2025-09-30T22:15:57.179856] [INFO ] [MAIN ] TBBB: Loaded 35601 primary data records. [2025-09-30T22:15:57.179752] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-30T22:15:57.180105] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-30T22:15:57.206353] [INFO ] [MAIN ] Derivative Progress: 1704/2009 symbols completed. TAP took 1.7s. Estimated remaining: 2m 5s. Rate: 145.9 symbols/min [2025-09-30T22:15:57.225128] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:57.534759] [DEBUG] [LOCAL ] TBI: Loaded 22555 existing records from primary storage. [2025-09-30T22:15:57.536058] [INFO ] [MAIN ] TBI: Loaded 22555 primary data records. [2025-09-30T22:15:57.677208] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:57.704767] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11735 primary records. [2025-09-30T22:15:57.760227] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-30T22:15:57.903283] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-30T22:15:57.905972] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-30T22:15:57.908923] [INFO ] [MAIN ] Derivative Progress: 1705/2009 symbols completed. TBB took 1.2s. Estimated remaining: 2m 5s. Rate: 145.8 symbols/min [2025-09-30T22:15:57.910117] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:57.925858] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:57.927798] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35601 primary records. [2025-09-30T22:15:57.927978] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-30T22:15:57.944100] [DEBUG] [LOCAL ] TBN: Loaded 3242 existing records from primary storage. [2025-09-30T22:15:57.945874] [INFO ] [MAIN ] TBN: Loaded 3242 primary data records. [2025-09-30T22:15:58.049674] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-30T22:15:58.063731] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-30T22:15:58.077723] [INFO ] [MAIN ] Derivative Progress: 1706/2009 symbols completed. TBBB took 1.4s. Estimated remaining: 2m 5s. Rate: 145.9 symbols/min [2025-09-30T22:15:58.110420] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:58.167385] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:58.290322] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22555 primary records. [2025-09-30T22:15:58.291060] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-30T22:15:58.308567] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-30T22:15:58.308961] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-30T22:15:58.312202] [INFO ] [MAIN ] Derivative Progress: 1707/2009 symbols completed. TBI took 1.1s. Estimated remaining: 2m 4s. Rate: 145.9 symbols/min [2025-09-30T22:15:58.312742] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:58.353053] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:58.353993] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 3242 primary records. [2025-09-30T22:15:58.354204] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-30T22:15:58.368267] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-09-30T22:15:58.368435] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-30T22:15:58.370403] [INFO ] [MAIN ] Derivative Progress: 1708/2009 symbols completed. TBN took 0.5s. Estimated remaining: 2m 4s. Rate: 146.0 symbols/min [2025-09-30T22:15:58.396810] [DEBUG] [LOCAL ] TD: Loaded 52282 existing records from primary storage. [2025-09-30T22:15:58.397020] [INFO ] [MAIN ] TD: Loaded 52282 primary data records. [2025-09-30T22:15:58.536103] [DEBUG] [LOCAL ] TDC: Loaded 46646 existing records from primary storage. [2025-09-30T22:15:58.542031] [INFO ] [MAIN ] TDC: Loaded 46646 primary data records. [2025-09-30T22:15:59.139360] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:59.140112] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52282 primary records. [2025-09-30T22:15:59.140411] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-30T22:15:59.158782] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-30T22:15:59.158984] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-30T22:15:59.160953] [INFO ] [MAIN ] Derivative Progress: 1709/2009 symbols completed. TD took 1.1s. Estimated remaining: 2m 3s. Rate: 145.9 symbols/min [2025-09-30T22:15:59.176206] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:15:59.176876] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46646 primary records. [2025-09-30T22:15:59.176961] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-30T22:15:59.192268] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-30T22:15:59.192346] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-30T22:15:59.194740] [INFO ] [MAIN ] Derivative Progress: 1710/2009 symbols completed. TDC took 0.9s. Estimated remaining: 2m 3s. Rate: 146.0 symbols/min [2025-09-30T22:15:59.195299] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:59.195217] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:59.195853] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:15:59.208979] [DEBUG] [LOCAL ] TDF: Loaded 6441 existing records from primary storage. [2025-09-30T22:15:59.209186] [INFO ] [MAIN ] TDF: Loaded 6441 primary data records. [2025-09-30T22:15:59.347455] [DEBUG] [LOCAL ] TDG: Loaded 21923 existing records from primary storage. [2025-09-30T22:15:59.353325] [INFO ] [MAIN ] TDG: Loaded 21923 primary data records. [2025-09-30T22:15:59.757811] [DEBUG] [LOCAL ] TDOC: Loaded 53344 existing records from primary storage. [2025-09-30T22:15:59.913205] [INFO ] [MAIN ] TDOC: Loaded 53344 primary data records. [2025-09-30T22:16:00.283826] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:00.286773] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6441 primary records. [2025-09-30T22:16:00.286921] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-30T22:16:00.325126] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:00.327051] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 21923 primary records. [2025-09-30T22:16:00.327945] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-30T22:16:00.332460] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-30T22:16:00.332958] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-30T22:16:00.335706] [INFO ] [MAIN ] Derivative Progress: 1711/2009 symbols completed. TDF took 1.1s. Estimated remaining: 2m 3s. Rate: 145.9 symbols/min [2025-09-30T22:16:00.344313] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:00.357206] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-30T22:16:00.358508] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-30T22:16:00.360909] [INFO ] [MAIN ] Derivative Progress: 1712/2009 symbols completed. TDG took 1.2s. Estimated remaining: 2m 2s. Rate: 145.9 symbols/min [2025-09-30T22:16:00.361365] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:00.379227] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:00.380101] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53344 primary records. [2025-09-30T22:16:00.380223] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-30T22:16:00.407579] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-30T22:16:00.407853] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-30T22:16:00.410736] [INFO ] [MAIN ] Derivative Progress: 1713/2009 symbols completed. TDOC took 1.2s. Estimated remaining: 2m 2s. Rate: 146.0 symbols/min [2025-09-30T22:16:00.410952] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:00.430795] [DEBUG] [LOCAL ] TDS: Loaded 42781 existing records from primary storage. [2025-09-30T22:16:00.431168] [INFO ] [MAIN ] TDS: Loaded 42781 primary data records. [2025-09-30T22:16:00.590376] [DEBUG] [LOCAL ] TDY: Loaded 22582 existing records from primary storage. [2025-09-30T22:16:00.592062] [INFO ] [MAIN ] TDY: Loaded 22582 primary data records. [2025-09-30T22:16:00.591885] [DEBUG] [LOCAL ] TDW: Loaded 45366 existing records from primary storage. [2025-09-30T22:16:00.625767] [INFO ] [MAIN ] TDW: Loaded 45366 primary data records. [2025-09-30T22:16:01.554364] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:01.555891] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42781 primary records. [2025-09-30T22:16:01.556186] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-30T22:16:01.571709] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:01.573755] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22582 primary records. [2025-09-30T22:16:01.583340] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-30T22:16:01.594042] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-30T22:16:01.594957] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-30T22:16:01.607262] [INFO ] [MAIN ] Derivative Progress: 1714/2009 symbols completed. TDS took 1.3s. Estimated remaining: 2m 1s. Rate: 145.8 symbols/min [2025-09-30T22:16:01.629302] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:01.631607] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:01.633604] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45366 primary records. [2025-09-30T22:16:01.637844] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-30T22:16:01.638298] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-30T22:16:01.639598] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-30T22:16:01.642833] [INFO ] [MAIN ] Derivative Progress: 1715/2009 symbols completed. TDY took 1.2s. Estimated remaining: 2m 1s. Rate: 145.9 symbols/min [2025-09-30T22:16:01.643099] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:01.668682] [DEBUG] [LOCAL ] TEAF: Loaded 7566 existing records from primary storage. [2025-09-30T22:16:01.668814] [INFO ] [MAIN ] TEAF: Loaded 7566 primary data records. [2025-09-30T22:16:01.668302] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-30T22:16:01.668936] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-30T22:16:01.684283] [INFO ] [MAIN ] Derivative Progress: 1716/2009 symbols completed. TDW took 1.3s. Estimated remaining: 2m 0s. Rate: 146.0 symbols/min [2025-09-30T22:16:01.707248] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:02.088050] [DEBUG] [LOCAL ] TEF: Loaded 37336 existing records from primary storage. [2025-09-30T22:16:02.090677] [INFO ] [MAIN ] TEF: Loaded 37336 primary data records. [2025-09-30T22:16:02.090439] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-30T22:16:02.090943] [INFO ] [MAIN ] TECK: Loaded 53436 primary data records. [2025-09-30T22:16:02.809349] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:02.810691] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7566 primary records. [2025-09-30T22:16:02.812217] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-30T22:16:02.833272] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-30T22:16:02.833394] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-30T22:16:02.836276] [INFO ] [MAIN ] Derivative Progress: 1717/2009 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 0s. Rate: 145.8 symbols/min [2025-09-30T22:16:02.838119] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:02.875062] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:02.885478] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37336 primary records. [2025-09-30T22:16:02.892099] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-30T22:16:02.892543] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:02.895114] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53436 primary records. [2025-09-30T22:16:02.895305] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-30T22:16:02.934488] [DEBUG] [LOCAL ] TEI: Loaded 20995 existing records from primary storage. [2025-09-30T22:16:02.937014] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-30T22:16:02.940382] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-30T22:16:02.946475] [INFO ] [MAIN ] TEI: Loaded 20995 primary data records. [2025-09-30T22:16:02.946134] [INFO ] [MAIN ] Derivative Progress: 1718/2009 symbols completed. TEF took 1.2s. Estimated remaining: 1m 60s. Rate: 145.9 symbols/min [2025-09-30T22:16:02.960090] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:02.952744] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-30T22:16:02.988565] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-30T22:16:03.025896] [INFO ] [MAIN ] Derivative Progress: 1719/2009 symbols completed. TECK took 1.4s. Estimated remaining: 1m 59s. Rate: 146.0 symbols/min [2025-09-30T22:16:03.039536] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:03.320082] [DEBUG] [LOCAL ] TEN: Loaded 30736 existing records from primary storage. [2025-09-30T22:16:03.320280] [INFO ] [MAIN ] TEN: Loaded 30736 primary data records. [2025-09-30T22:16:03.438009] [DEBUG] [LOCAL ] TEL: Loaded 51113 existing records from primary storage. [2025-09-30T22:16:03.464405] [INFO ] [MAIN ] TEL: Loaded 51113 primary data records. [2025-09-30T22:16:03.902962] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:03.916683] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20995 primary records. [2025-09-30T22:16:03.939600] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-30T22:16:04.125179] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-30T22:16:04.125421] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-30T22:16:04.127636] [INFO ] [MAIN ] Derivative Progress: 1720/2009 symbols completed. TEI took 1.3s. Estimated remaining: 1m 59s. Rate: 145.8 symbols/min [2025-09-30T22:16:04.130469] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:04.181289] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:04.195580] [DEBUG] [LOCAL ] TEO: Loaded 22085 existing records from primary storage. [2025-09-30T22:16:04.195977] [INFO ] [MAIN ] TEO: Loaded 22085 primary data records. [2025-09-30T22:16:04.197352] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30736 primary records. [2025-09-30T22:16:04.216083] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-30T22:16:04.233088] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:04.299427] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51113 primary records. [2025-09-30T22:16:04.308154] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-30T22:16:04.319613] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-30T22:16:04.342352] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-30T22:16:04.362552] [INFO ] [MAIN ] Derivative Progress: 1721/2009 symbols completed. TEN took 1.3s. Estimated remaining: 1m 58s. Rate: 145.9 symbols/min [2025-09-30T22:16:04.374411] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-30T22:16:04.372789] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:04.374548] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-30T22:16:04.398724] [INFO ] [MAIN ] Derivative Progress: 1722/2009 symbols completed. TEL took 1.4s. Estimated remaining: 1m 58s. Rate: 146.0 symbols/min [2025-09-30T22:16:04.427068] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:04.641998] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:04.642882] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22085 primary records. [2025-09-30T22:16:04.643064] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-30T22:16:04.689295] [DEBUG] [LOCAL ] TEX: Loaded 44264 existing records from primary storage. [2025-09-30T22:16:04.690451] [INFO ] [MAIN ] TEX: Loaded 44264 primary data records. [2025-09-30T22:16:04.712310] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-30T22:16:04.707059] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-30T22:16:04.739956] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-30T22:16:04.739871] [INFO ] [MAIN ] TEVA: Loaded 53632 primary data records. [2025-09-30T22:16:04.758479] [INFO ] [MAIN ] Derivative Progress: 1723/2009 symbols completed. TEO took 0.6s. Estimated remaining: 1m 58s. Rate: 146.0 symbols/min [2025-09-30T22:16:05.412907] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:05.416011] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44264 primary records. [2025-09-30T22:16:05.416248] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-30T22:16:05.443922] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:05.447008] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53632 primary records. [2025-09-30T22:16:05.447112] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-30T22:16:05.448489] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-30T22:16:05.448935] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-30T22:16:05.451009] [INFO ] [MAIN ] Derivative Progress: 1724/2009 symbols completed. TEX took 1.0s. Estimated remaining: 1m 57s. Rate: 145.9 symbols/min [2025-09-30T22:16:05.467036] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-30T22:16:05.467146] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-30T22:16:05.469368] [INFO ] [MAIN ] Derivative Progress: 1725/2009 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 57s. Rate: 146.0 symbols/min [2025-09-30T22:16:05.469880] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:05.469965] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:05.470073] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:05.496434] [DEBUG] [LOCAL ] TFIN: Loaded 23505 existing records from primary storage. [2025-09-30T22:16:05.496592] [INFO ] [MAIN ] TFIN: Loaded 23505 primary data records. [2025-09-30T22:16:05.659566] [DEBUG] [LOCAL ] TFII: Loaded 33790 existing records from primary storage. [2025-09-30T22:16:05.665829] [INFO ] [MAIN ] TFII: Loaded 33790 primary data records. [2025-09-30T22:16:05.836775] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-30T22:16:05.999208] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-30T22:16:06.652053] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:06.654050] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23505 primary records. [2025-09-30T22:16:06.654706] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-30T22:16:06.690729] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-30T22:16:06.690602] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:06.692045] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-30T22:16:06.694105] [INFO ] [MAIN ] Derivative Progress: 1726/2009 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 56s. Rate: 145.8 symbols/min [2025-09-30T22:16:06.695266] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:06.696169] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33790 primary records. [2025-09-30T22:16:06.697213] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-30T22:16:06.724806] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:06.726170] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-30T22:16:06.726583] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-30T22:16:06.751396] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-30T22:16:06.751921] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-30T22:16:06.754533] [INFO ] [MAIN ] Derivative Progress: 1727/2009 symbols completed. TFII took 1.3s. Estimated remaining: 1m 56s. Rate: 145.9 symbols/min [2025-09-30T22:16:06.755086] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:06.756247] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-30T22:16:06.756888] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-30T22:16:06.759680] [INFO ] [MAIN ] Derivative Progress: 1728/2009 symbols completed. TFC took 1.3s. Estimated remaining: 1m 56s. Rate: 146.0 symbols/min [2025-09-30T22:16:06.759924] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:06.780692] [DEBUG] [LOCAL ] TG: Loaded 10417 existing records from primary storage. [2025-09-30T22:16:06.781587] [INFO ] [MAIN ] TG: Loaded 10417 primary data records. [2025-09-30T22:16:06.885717] [DEBUG] [LOCAL ] TFPM: Loaded 37785 existing records from primary storage. [2025-09-30T22:16:06.905438] [INFO ] [MAIN ] TFPM: Loaded 37785 primary data records. [2025-09-30T22:16:07.022073] [DEBUG] [LOCAL ] TFX: Loaded 37113 existing records from primary storage. [2025-09-30T22:16:07.095875] [INFO ] [MAIN ] TFX: Loaded 37113 primary data records. [2025-09-30T22:16:07.887438] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:07.888628] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10417 primary records. [2025-09-30T22:16:07.889282] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-30T22:16:07.909868] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-30T22:16:07.910213] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-30T22:16:07.913900] [INFO ] [MAIN ] Derivative Progress: 1729/2009 symbols completed. TG took 1.2s. Estimated remaining: 1m 55s. Rate: 145.8 symbols/min [2025-09-30T22:16:07.914453] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:07.929560] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:07.930538] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37785 primary records. [2025-09-30T22:16:07.931549] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-30T22:16:07.950480] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-30T22:16:07.950716] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-30T22:16:07.967090] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:07.968219] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37113 primary records. [2025-09-30T22:16:07.966671] [INFO ] [MAIN ] Derivative Progress: 1730/2009 symbols completed. TFPM took 1.3s. Estimated remaining: 1m 55s. Rate: 145.9 symbols/min [2025-09-30T22:16:07.976091] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-30T22:16:07.976286] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:08.002441] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-30T22:16:08.002607] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-30T22:16:08.006454] [DEBUG] [LOCAL ] TGLS: Loaded 28070 existing records from primary storage. [2025-09-30T22:16:08.006686] [INFO ] [MAIN ] TGLS: Loaded 28070 primary data records. [2025-09-30T22:16:08.005405] [INFO ] [MAIN ] Derivative Progress: 1731/2009 symbols completed. TFX took 1.3s. Estimated remaining: 1m 54s. Rate: 146.0 symbols/min [2025-09-30T22:16:08.006898] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:08.378516] [DEBUG] [LOCAL ] TGS: Loaded 32763 existing records from primary storage. [2025-09-30T22:16:08.378690] [INFO ] [MAIN ] TGS: Loaded 32763 primary data records. [2025-09-30T22:16:08.502028] [DEBUG] [LOCAL ] TGNA: Loaded 48665 existing records from primary storage. [2025-09-30T22:16:08.512696] [INFO ] [MAIN ] TGNA: Loaded 48665 primary data records. [2025-09-30T22:16:09.168234] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:09.169220] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28070 primary records. [2025-09-30T22:16:09.169470] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-30T22:16:09.189560] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-30T22:16:09.189886] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-30T22:16:09.192162] [INFO ] [MAIN ] Derivative Progress: 1732/2009 symbols completed. TGLS took 1.3s. Estimated remaining: 1m 54s. Rate: 145.8 symbols/min [2025-09-30T22:16:09.192791] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:09.213723] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:09.214869] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32763 primary records. [2025-09-30T22:16:09.215124] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-30T22:16:09.249753] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-30T22:16:09.250043] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-30T22:16:09.252118] [INFO ] [MAIN ] Derivative Progress: 1733/2009 symbols completed. TGS took 1.2s. Estimated remaining: 1m 54s. Rate: 145.9 symbols/min [2025-09-30T22:16:09.252571] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:09.252987] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:09.254368] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48665 primary records. [2025-09-30T22:16:09.254624] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-30T22:16:09.286502] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-30T22:16:09.286639] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-30T22:16:09.289530] [INFO ] [MAIN ] Derivative Progress: 1734/2009 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 53s. Rate: 146.0 symbols/min [2025-09-30T22:16:09.290031] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:09.309835] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-30T22:16:09.310099] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-30T22:16:09.459035] [DEBUG] [LOCAL ] THG: Loaded 21678 existing records from primary storage. [2025-09-30T22:16:09.469606] [INFO ] [MAIN ] THG: Loaded 21678 primary data records. [2025-09-30T22:16:09.547126] [DEBUG] [LOCAL ] THC: Loaded 47711 existing records from primary storage. [2025-09-30T22:16:09.606765] [INFO ] [MAIN ] THC: Loaded 47711 primary data records. [2025-09-30T22:16:10.412297] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:10.413516] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-30T22:16:10.414674] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-30T22:16:10.433887] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-30T22:16:10.434366] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-30T22:16:10.436387] [INFO ] [MAIN ] Derivative Progress: 1735/2009 symbols completed. TGT took 1.2s. Estimated remaining: 1m 53s. Rate: 145.8 symbols/min [2025-09-30T22:16:10.436960] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:10.460799] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:10.460457] [DEBUG] [LOCAL ] THIR: Loaded 2194 existing records from primary storage. [2025-09-30T22:16:10.475919] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21678 primary records. [2025-09-30T22:16:10.476062] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-30T22:16:10.474837] [INFO ] [MAIN ] THIR: Loaded 2194 primary data records. [2025-09-30T22:16:10.477255] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:10.508920] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47711 primary records. [2025-09-30T22:16:10.526926] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-30T22:16:10.643127] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-30T22:16:10.649302] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-30T22:16:10.651818] [INFO ] [MAIN ] Derivative Progress: 1736/2009 symbols completed. THG took 1.4s. Estimated remaining: 1m 52s. Rate: 145.8 symbols/min [2025-09-30T22:16:10.663055] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:10.864708] [DEBUG] [LOCAL ] THLV: Loaded 1546 existing records from primary storage. [2025-09-30T22:16:10.862107] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-30T22:16:10.865621] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-30T22:16:10.865730] [INFO ] [MAIN ] THLV: Loaded 1546 primary data records. [2025-09-30T22:16:10.874079] [INFO ] [MAIN ] Derivative Progress: 1737/2009 symbols completed. THC took 1.6s. Estimated remaining: 1m 52s. Rate: 145.9 symbols/min [2025-09-30T22:16:10.893036] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:11.255874] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:16:11.256927] [DEBUG] [LOCAL ] THO: Loaded 42038 existing records from primary storage. [2025-09-30T22:16:11.258282] [INFO ] [MAIN ] THIR: Generated 1792 derivative records from 2194 primary records. [2025-09-30T22:16:11.258439] [INFO ] [MAIN ] THO: Loaded 42038 primary data records. [2025-09-30T22:16:11.258543] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-30T22:16:11.397736] [DEBUG] [LOCAL ] THIR: Derivative data saved (1792 records). [2025-09-30T22:16:11.430373] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-30T22:16:11.433394] [INFO ] [MAIN ] Derivative Progress: 1738/2009 symbols completed. THIR took 1.0s. Estimated remaining: 1m 51s. Rate: 145.9 symbols/min [2025-09-30T22:16:11.618534] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:16:11.619447] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1546 primary records. [2025-09-30T22:16:11.619526] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-30T22:16:11.637937] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-09-30T22:16:11.638334] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-30T22:16:11.641064] [INFO ] [MAIN ] Derivative Progress: 1739/2009 symbols completed. THLV took 1.0s. Estimated remaining: 1m 51s. Rate: 145.9 symbols/min [2025-09-30T22:16:11.661577] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:11.662361] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42038 primary records. [2025-09-30T22:16:11.662436] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-30T22:16:11.678384] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-30T22:16:11.678522] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-30T22:16:11.680700] [INFO ] [MAIN ] Derivative Progress: 1740/2009 symbols completed. THO took 0.8s. Estimated remaining: 1m 51s. Rate: 146.0 symbols/min [2025-09-30T22:16:11.681177] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:11.681274] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:11.681872] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:11.721255] [DEBUG] [LOCAL ] THQ: Loaded 24858 existing records from primary storage. [2025-09-30T22:16:11.730106] [INFO ] [MAIN ] THQ: Loaded 24858 primary data records. [2025-09-30T22:16:11.730012] [DEBUG] [LOCAL ] THR: Loaded 19835 existing records from primary storage. [2025-09-30T22:16:11.742228] [INFO ] [MAIN ] THR: Loaded 19835 primary data records. [2025-09-30T22:16:11.886460] [DEBUG] [LOCAL ] THS: Loaded 38125 existing records from primary storage. [2025-09-30T22:16:11.899517] [INFO ] [MAIN ] THS: Loaded 38125 primary data records. [2025-09-30T22:16:12.832875] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:12.835603] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24858 primary records. [2025-09-30T22:16:12.835841] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-30T22:16:12.864672] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:12.868850] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19835 primary records. [2025-09-30T22:16:12.869860] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-30T22:16:12.870413] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-30T22:16:12.871964] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-30T22:16:12.882053] [INFO ] [MAIN ] Derivative Progress: 1741/2009 symbols completed. THQ took 1.2s. Estimated remaining: 1m 50s. Rate: 145.8 symbols/min [2025-09-30T22:16:12.886219] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:12.895110] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-30T22:16:12.913283] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-30T22:16:12.916033] [INFO ] [MAIN ] Derivative Progress: 1742/2009 symbols completed. THR took 1.2s. Estimated remaining: 1m 50s. Rate: 145.9 symbols/min [2025-09-30T22:16:12.916258] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:12.913550] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:12.917701] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38125 primary records. [2025-09-30T22:16:12.918018] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-30T22:16:12.944962] [DEBUG] [LOCAL ] THW: Loaded 19361 existing records from primary storage. [2025-09-30T22:16:12.948129] [INFO ] [MAIN ] THW: Loaded 19361 primary data records. [2025-09-30T22:16:12.949445] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-30T22:16:12.949561] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-30T22:16:12.952687] [INFO ] [MAIN ] Derivative Progress: 1743/2009 symbols completed. THS took 1.3s. Estimated remaining: 1m 49s. Rate: 146.0 symbols/min [2025-09-30T22:16:12.987568] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:13.086778] [DEBUG] [LOCAL ] TISI: Loaded 3714 existing records from primary storage. [2025-09-30T22:16:13.087050] [INFO ] [MAIN ] TISI: Loaded 3714 primary data records. [2025-09-30T22:16:13.440077] [DEBUG] [LOCAL ] TIMB: Loaded 36151 existing records from primary storage. [2025-09-30T22:16:13.456092] [INFO ] [MAIN ] TIMB: Loaded 36151 primary data records. [2025-09-30T22:16:14.015416] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:14.016491] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19361 primary records. [2025-09-30T22:16:14.016756] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-30T22:16:14.054611] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:14.057471] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3714 primary records. [2025-09-30T22:16:14.058488] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-30T22:16:14.059850] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-30T22:16:14.060176] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-30T22:16:14.068430] [INFO ] [MAIN ] Derivative Progress: 1744/2009 symbols completed. THW took 1.2s. Estimated remaining: 1m 49s. Rate: 145.8 symbols/min [2025-09-30T22:16:14.073195] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:14.078338] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-30T22:16:14.078604] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-30T22:16:14.084207] [INFO ] [MAIN ] Derivative Progress: 1745/2009 symbols completed. TISI took 1.1s. Estimated remaining: 1m 49s. Rate: 145.9 symbols/min [2025-09-30T22:16:14.085141] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:14.100275] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:14.100996] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36151 primary records. [2025-09-30T22:16:14.101126] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-30T22:16:14.117890] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-30T22:16:14.118269] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-30T22:16:14.130199] [INFO ] [MAIN ] Derivative Progress: 1746/2009 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 48s. Rate: 146.0 symbols/min [2025-09-30T22:16:14.130597] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:14.148431] [DEBUG] [LOCAL ] TIXT: Loaded 31376 existing records from primary storage. [2025-09-30T22:16:14.148707] [INFO ] [MAIN ] TIXT: Loaded 31376 primary data records. [2025-09-30T22:16:14.514028] [DEBUG] [LOCAL ] TK: Loaded 39498 existing records from primary storage. [2025-09-30T22:16:14.530141] [INFO ] [MAIN ] TK: Loaded 39498 primary data records. [2025-09-30T22:16:14.572879] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-09-30T22:16:14.607186] [INFO ] [MAIN ] TJX: Loaded 53669 primary data records. [2025-09-30T22:16:15.258157] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:15.260045] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31376 primary records. [2025-09-30T22:16:15.260274] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-30T22:16:15.284679] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-30T22:16:15.285101] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-30T22:16:15.287967] [INFO ] [MAIN ] Derivative Progress: 1747/2009 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 48s. Rate: 145.8 symbols/min [2025-09-30T22:16:15.288563] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:15.309014] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:15.311184] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39498 primary records. [2025-09-30T22:16:15.312550] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-30T22:16:15.340717] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:15.356028] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-30T22:16:15.356258] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-30T22:16:15.345205] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53669 primary records. [2025-09-30T22:16:15.359453] [INFO ] [MAIN ] Derivative Progress: 1748/2009 symbols completed. TK took 1.2s. Estimated remaining: 1m 47s. Rate: 145.9 symbols/min [2025-09-30T22:16:15.359928] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:15.359795] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-30T22:16:15.391941] [DEBUG] [LOCAL ] TKC: Loaded 38850 existing records from primary storage. [2025-09-30T22:16:15.392748] [INFO ] [MAIN ] TKC: Loaded 38850 primary data records. [2025-09-30T22:16:15.450201] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-30T22:16:15.469217] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-30T22:16:15.472195] [INFO ] [MAIN ] Derivative Progress: 1749/2009 symbols completed. TJX took 1.4s. Estimated remaining: 1m 47s. Rate: 146.0 symbols/min [2025-09-30T22:16:15.485941] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:15.756183] [DEBUG] [LOCAL ] TKO: Loaded 44052 existing records from primary storage. [2025-09-30T22:16:15.756477] [INFO ] [MAIN ] TKO: Loaded 44052 primary data records. [2025-09-30T22:16:15.986355] [DEBUG] [LOCAL ] TKR: Loaded 40075 existing records from primary storage. [2025-09-30T22:16:16.113024] [INFO ] [MAIN ] TKR: Loaded 40075 primary data records. [2025-09-30T22:16:16.337817] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:16.471745] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38850 primary records. [2025-09-30T22:16:16.483307] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-30T22:16:16.522928] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:16.522365] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-30T22:16:16.523214] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-30T22:16:16.524028] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44052 primary records. [2025-09-30T22:16:16.526715] [INFO ] [MAIN ] Derivative Progress: 1750/2009 symbols completed. TKC took 1.2s. Estimated remaining: 1m 47s. Rate: 145.8 symbols/min [2025-09-30T22:16:16.528049] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:16.528272] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-30T22:16:16.547563] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-30T22:16:16.547900] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-30T22:16:16.550331] [INFO ] [MAIN ] Derivative Progress: 1751/2009 symbols completed. TKO took 1.2s. Estimated remaining: 1m 46s. Rate: 145.9 symbols/min [2025-09-30T22:16:16.550781] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:16.569260] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:16.570090] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40075 primary records. [2025-09-30T22:16:16.570226] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-30T22:16:16.604173] [DEBUG] [LOCAL ] TLYS: Loaded 16716 existing records from primary storage. [2025-09-30T22:16:16.605024] [INFO ] [MAIN ] TLYS: Loaded 16716 primary data records. [2025-09-30T22:16:16.672823] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-30T22:16:16.703120] [DEBUG] [LOCAL ] TLK: Loaded 39189 existing records from primary storage. [2025-09-30T22:16:16.708493] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-30T22:16:16.714061] [INFO ] [MAIN ] TLK: Loaded 39189 primary data records. [2025-09-30T22:16:16.717227] [INFO ] [MAIN ] Derivative Progress: 1752/2009 symbols completed. TKR took 1.2s. Estimated remaining: 1m 46s. Rate: 146.0 symbols/min [2025-09-30T22:16:16.756391] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:17.442620] [DEBUG] [LOCAL ] TM: Loaded 36435 existing records from primary storage. [2025-09-30T22:16:17.442897] [INFO ] [MAIN ] TM: Loaded 36435 primary data records. [2025-09-30T22:16:17.595452] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:17.599217] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16716 primary records. [2025-09-30T22:16:17.607251] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-30T22:16:17.751810] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-30T22:16:17.752003] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-30T22:16:17.754865] [INFO ] [MAIN ] Derivative Progress: 1753/2009 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 45s. Rate: 145.8 symbols/min [2025-09-30T22:16:17.761619] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:17.762924] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39189 primary records. [2025-09-30T22:16:17.763070] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-30T22:16:17.895125] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-30T22:16:17.913595] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-30T22:16:17.929920] [INFO ] [MAIN ] Derivative Progress: 1754/2009 symbols completed. TLK took 1.4s. Estimated remaining: 1m 45s. Rate: 145.9 symbols/min [2025-09-30T22:16:18.130068] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:18.130938] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36435 primary records. [2025-09-30T22:16:18.131069] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-30T22:16:18.148293] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-30T22:16:18.148452] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-30T22:16:18.150969] [INFO ] [MAIN ] Derivative Progress: 1755/2009 symbols completed. TM took 1.4s. Estimated remaining: 1m 44s. Rate: 145.9 symbols/min [2025-09-30T22:16:18.151713] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:18.151826] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:18.151900] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:18.261421] [DEBUG] [LOCAL ] TMO: Loaded 52339 existing records from primary storage. [2025-09-30T22:16:18.262231] [DEBUG] [LOCAL ] TMHC: Loaded 45443 existing records from primary storage. [2025-09-30T22:16:18.262726] [INFO ] [MAIN ] TMHC: Loaded 45443 primary data records. [2025-09-30T22:16:18.262466] [INFO ] [MAIN ] TMO: Loaded 52339 primary data records. [2025-09-30T22:16:18.346600] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-09-30T22:16:18.404957] [INFO ] [MAIN ] TME: Loaded 53194 primary data records. [2025-09-30T22:16:19.492612] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:19.494159] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52339 primary records. [2025-09-30T22:16:19.494519] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:19.495617] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-30T22:16:19.495490] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45443 primary records. [2025-09-30T22:16:19.496970] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-30T22:16:19.535020] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-30T22:16:19.536835] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-30T22:16:19.539600] [INFO ] [MAIN ] Derivative Progress: 1756/2009 symbols completed. TMO took 1.4s. Estimated remaining: 1m 44s. Rate: 145.7 symbols/min [2025-09-30T22:16:19.550110] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:19.558208] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:19.559220] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53194 primary records. [2025-09-30T22:16:19.560706] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-30T22:16:19.577571] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-30T22:16:19.578701] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-30T22:16:19.581560] [INFO ] [MAIN ] Derivative Progress: 1757/2009 symbols completed. TMHC took 1.4s. Estimated remaining: 1m 44s. Rate: 145.8 symbols/min [2025-09-30T22:16:19.590397] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-30T22:16:19.590557] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-30T22:16:19.594013] [INFO ] [MAIN ] Derivative Progress: 1758/2009 symbols completed. TME took 1.4s. Estimated remaining: 1m 43s. Rate: 145.9 symbols/min [2025-09-30T22:16:19.586584] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:19.594481] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:19.603744] [DEBUG] [LOCAL ] TNC: Loaded 14904 existing records from primary storage. [2025-09-30T22:16:19.603984] [INFO ] [MAIN ] TNC: Loaded 14904 primary data records. [2025-09-30T22:16:19.896255] [DEBUG] [LOCAL ] TNK: Loaded 35161 existing records from primary storage. [2025-09-30T22:16:19.887161] [DEBUG] [LOCAL ] TNET: Loaded 28638 existing records from primary storage. [2025-09-30T22:16:19.896471] [INFO ] [MAIN ] TNK: Loaded 35161 primary data records. [2025-09-30T22:16:20.032165] [INFO ] [MAIN ] TNET: Loaded 28638 primary data records. [2025-09-30T22:16:20.773389] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:20.776049] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14904 primary records. [2025-09-30T22:16:20.776599] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-30T22:16:20.798905] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-30T22:16:20.799880] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-30T22:16:20.802575] [INFO ] [MAIN ] Derivative Progress: 1759/2009 symbols completed. TNC took 1.3s. Estimated remaining: 1m 43s. Rate: 145.7 symbols/min [2025-09-30T22:16:20.803130] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:20.824050] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:20.825097] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35161 primary records. [2025-09-30T22:16:20.825269] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-30T22:16:20.843793] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-30T22:16:20.843945] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-30T22:16:20.846349] [INFO ] [MAIN ] Derivative Progress: 1760/2009 symbols completed. TNK took 1.3s. Estimated remaining: 1m 42s. Rate: 145.8 symbols/min [2025-09-30T22:16:20.846590] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:20.877338] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:20.878328] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28638 primary records. [2025-09-30T22:16:20.878418] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-30T22:16:20.896310] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-30T22:16:20.896593] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-30T22:16:20.916269] [INFO ] [MAIN ] Derivative Progress: 1761/2009 symbols completed. TNET took 1.3s. Estimated remaining: 1m 42s. Rate: 145.9 symbols/min [2025-09-30T22:16:20.918377] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:20.919821] [DEBUG] [LOCAL ] TNL: Loaded 41767 existing records from primary storage. [2025-09-30T22:16:20.920047] [INFO ] [MAIN ] TNL: Loaded 41767 primary data records. [2025-09-30T22:16:21.171356] [DEBUG] [LOCAL ] TOL: Loaded 50887 existing records from primary storage. [2025-09-30T22:16:21.297456] [INFO ] [MAIN ] TOL: Loaded 50887 primary data records. [2025-09-30T22:16:21.451164] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-30T22:16:21.472455] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-30T22:16:22.068184] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:22.069783] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41767 primary records. [2025-09-30T22:16:22.070177] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-30T22:16:22.095787] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-30T22:16:22.096090] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-30T22:16:22.098499] [INFO ] [MAIN ] Derivative Progress: 1762/2009 symbols completed. TNL took 1.3s. Estimated remaining: 1m 42s. Rate: 145.7 symbols/min [2025-09-30T22:16:22.107185] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:22.113855] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:22.114734] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50887 primary records. [2025-09-30T22:16:22.115102] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-30T22:16:22.158623] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-30T22:16:22.159001] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-30T22:16:22.169998] [INFO ] [MAIN ] Derivative Progress: 1763/2009 symbols completed. TOL took 1.3s. Estimated remaining: 1m 41s. Rate: 145.8 symbols/min [2025-09-30T22:16:22.166535] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:22.170821] [DEBUG] [LOCAL ] TPB: Loaded 25036 existing records from primary storage. [2025-09-30T22:16:22.171907] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:22.171717] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-30T22:16:22.172142] [INFO ] [MAIN ] TPB: Loaded 25036 primary data records. [2025-09-30T22:16:22.172573] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-30T22:16:22.335440] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-30T22:16:22.395003] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-30T22:16:22.522406] [INFO ] [MAIN ] Derivative Progress: 1764/2009 symbols completed. TOST took 1.6s. Estimated remaining: 1m 41s. Rate: 145.8 symbols/min [2025-09-30T22:16:22.538964] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:22.540592] [DEBUG] [LOCAL ] TPC: Loaded 38730 existing records from primary storage. [2025-09-30T22:16:22.540912] [INFO ] [MAIN ] TPC: Loaded 38730 primary data records. [2025-09-30T22:16:22.931722] [DEBUG] [LOCAL ] TPH: Loaded 45002 existing records from primary storage. [2025-09-30T22:16:22.930418] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:22.931962] [INFO ] [MAIN ] TPH: Loaded 45002 primary data records. [2025-09-30T22:16:22.932825] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25036 primary records. [2025-09-30T22:16:22.932927] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-30T22:16:23.052129] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-30T22:16:23.061181] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-30T22:16:23.077343] [INFO ] [MAIN ] Derivative Progress: 1765/2009 symbols completed. TPB took 1.0s. Estimated remaining: 1m 40s. Rate: 145.7 symbols/min [2025-09-30T22:16:23.089261] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:23.311830] [DEBUG] [LOCAL ] TPL: Loaded 12274 existing records from primary storage. [2025-09-30T22:16:23.312731] [INFO ] [MAIN ] TPL: Loaded 12274 primary data records. [2025-09-30T22:16:23.381888] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:23.411961] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38730 primary records. [2025-09-30T22:16:23.425457] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-30T22:16:23.495440] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-30T22:16:23.522151] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-30T22:16:23.561628] [INFO ] [MAIN ] Derivative Progress: 1766/2009 symbols completed. TPC took 1.4s. Estimated remaining: 1m 40s. Rate: 145.7 symbols/min [2025-09-30T22:16:23.666256] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:23.705541] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:23.706600] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45002 primary records. [2025-09-30T22:16:23.707755] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-30T22:16:23.726903] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-30T22:16:23.727210] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-30T22:16:23.731439] [INFO ] [MAIN ] Derivative Progress: 1767/2009 symbols completed. TPH took 1.2s. Estimated remaining: 1m 40s. Rate: 145.8 symbols/min [2025-09-30T22:16:23.732960] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:23.761952] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:23.762991] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12274 primary records. [2025-09-30T22:16:23.763136] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-30T22:16:23.805738] [DEBUG] [LOCAL ] TPR: Loaded 53468 existing records from primary storage. [2025-09-30T22:16:23.806351] [INFO ] [MAIN ] TPR: Loaded 53468 primary data records. [2025-09-30T22:16:23.842693] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-30T22:16:23.888352] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-30T22:16:23.894030] [DEBUG] [LOCAL ] TPVG: Loaded 26983 existing records from primary storage. [2025-09-30T22:16:23.901925] [INFO ] [MAIN ] TPVG: Loaded 26983 primary data records. [2025-09-30T22:16:23.909553] [INFO ] [MAIN ] Derivative Progress: 1768/2009 symbols completed. TPL took 0.8s. Estimated remaining: 1m 39s. Rate: 145.8 symbols/min [2025-09-30T22:16:24.585234] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:24.586244] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53468 primary records. [2025-09-30T22:16:24.586438] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-30T22:16:24.619579] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:24.621593] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26983 primary records. [2025-09-30T22:16:24.621717] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-30T22:16:24.620813] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-30T22:16:24.622556] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-30T22:16:24.625002] [INFO ] [MAIN ] Derivative Progress: 1769/2009 symbols completed. TPR took 1.0s. Estimated remaining: 1m 39s. Rate: 145.8 symbols/min [2025-09-30T22:16:24.641138] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-30T22:16:24.641259] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-30T22:16:24.643820] [INFO ] [MAIN ] Derivative Progress: 1770/2009 symbols completed. TPVG took 0.9s. Estimated remaining: 1m 38s. Rate: 145.8 symbols/min [2025-09-30T22:16:24.644331] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:24.644276] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:24.644430] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:24.659263] [DEBUG] [LOCAL ] TPZ: Loaded 4975 existing records from primary storage. [2025-09-30T22:16:24.659058] [DEBUG] [LOCAL ] TPYP: Loaded 7918 existing records from primary storage. [2025-09-30T22:16:24.659404] [INFO ] [MAIN ] TPYP: Loaded 7918 primary data records. [2025-09-30T22:16:24.659480] [INFO ] [MAIN ] TPZ: Loaded 4975 primary data records. [2025-09-30T22:16:24.833400] [DEBUG] [LOCAL ] TR: Loaded 18422 existing records from primary storage. [2025-09-30T22:16:24.865418] [INFO ] [MAIN ] TR: Loaded 18422 primary data records. [2025-09-30T22:16:25.706341] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:25.707555] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7918 primary records. [2025-09-30T22:16:25.715877] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-30T22:16:25.730103] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:16:25.735079] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4975 primary records. [2025-09-30T22:16:25.736685] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-30T22:16:25.754749] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-30T22:16:25.756396] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-30T22:16:25.760694] [INFO ] [MAIN ] Derivative Progress: 1771/2009 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 38s. Rate: 145.7 symbols/min [2025-09-30T22:16:25.762446] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-30T22:16:25.761880] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:25.762767] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-30T22:16:25.765494] [INFO ] [MAIN ] Derivative Progress: 1772/2009 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 38s. Rate: 145.8 symbols/min [2025-09-30T22:16:25.779152] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:25.780438] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:25.781481] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18422 primary records. [2025-09-30T22:16:25.781621] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-30T22:16:25.805418] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-30T22:16:25.805617] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-30T22:16:25.808697] [INFO ] [MAIN ] Derivative Progress: 1773/2009 symbols completed. TR took 1.2s. Estimated remaining: 1m 37s. Rate: 145.9 symbols/min [2025-09-30T22:16:25.809390] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:25.814133] [DEBUG] [LOCAL ] TRAK: Loaded 9319 existing records from primary storage. [2025-09-30T22:16:25.814309] [INFO ] [MAIN ] TRAK: Loaded 9319 primary data records. [2025-09-30T22:16:25.872271] [DEBUG] [LOCAL ] TRC: Loaded 15798 existing records from primary storage. [2025-09-30T22:16:25.890880] [INFO ] [MAIN ] TRC: Loaded 15798 primary data records. [2025-09-30T22:16:26.555477] [DEBUG] [LOCAL ] TREX: Loaded 49961 existing records from primary storage. [2025-09-30T22:16:26.555920] [INFO ] [MAIN ] TREX: Loaded 49961 primary data records. [2025-09-30T22:16:26.903832] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:26.905183] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9319 primary records. [2025-09-30T22:16:26.905469] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-30T22:16:26.920573] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:26.921607] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15798 primary records. [2025-09-30T22:16:26.932701] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-30T22:16:26.954529] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-30T22:16:26.956486] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-30T22:16:26.955881] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-30T22:16:26.956602] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-30T22:16:26.958818] [INFO ] [MAIN ] Derivative Progress: 1774/2009 symbols completed. TRAK took 1.2s. Estimated remaining: 1m 37s. Rate: 145.7 symbols/min [2025-09-30T22:16:26.959159] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:26.961753] [INFO ] [MAIN ] Derivative Progress: 1775/2009 symbols completed. TRC took 1.2s. Estimated remaining: 1m 36s. Rate: 145.8 symbols/min [2025-09-30T22:16:26.962431] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:26.983027] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:26.983937] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49961 primary records. [2025-09-30T22:16:26.984160] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-30T22:16:27.007340] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-30T22:16:27.007546] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-30T22:16:27.019034] [INFO ] [MAIN ] Derivative Progress: 1776/2009 symbols completed. TREX took 1.2s. Estimated remaining: 1m 36s. Rate: 145.9 symbols/min [2025-09-30T22:16:27.019502] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:27.036573] [DEBUG] [LOCAL ] TRN: Loaded 37089 existing records from primary storage. [2025-09-30T22:16:27.053778] [INFO ] [MAIN ] TRN: Loaded 37089 primary data records. [2025-09-30T22:16:27.209351] [DEBUG] [LOCAL ] TRGP: Loaded 50701 existing records from primary storage. [2025-09-30T22:16:27.210543] [INFO ] [MAIN ] TRGP: Loaded 50701 primary data records. [2025-09-30T22:16:27.329495] [DEBUG] [LOCAL ] TRNO: Loaded 43946 existing records from primary storage. [2025-09-30T22:16:27.358409] [INFO ] [MAIN ] TRNO: Loaded 43946 primary data records. [2025-09-30T22:16:28.207345] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:28.223028] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37089 primary records. [2025-09-30T22:16:28.224036] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:28.224198] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-30T22:16:28.225474] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50701 primary records. [2025-09-30T22:16:28.225892] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-30T22:16:28.267777] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-30T22:16:28.269010] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-30T22:16:28.272634] [INFO ] [MAIN ] Derivative Progress: 1777/2009 symbols completed. TRN took 1.3s. Estimated remaining: 1m 36s. Rate: 145.7 symbols/min [2025-09-30T22:16:28.273977] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:28.289098] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:28.290397] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43946 primary records. [2025-09-30T22:16:28.288522] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-30T22:16:28.290621] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-30T22:16:28.291150] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-30T22:16:28.294379] [INFO ] [MAIN ] Derivative Progress: 1778/2009 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 35s. Rate: 145.8 symbols/min [2025-09-30T22:16:28.295223] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:28.315906] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-30T22:16:28.316349] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-30T22:16:28.319638] [INFO ] [MAIN ] Derivative Progress: 1779/2009 symbols completed. TRNO took 1.3s. Estimated remaining: 1m 35s. Rate: 145.9 symbols/min [2025-09-30T22:16:28.320014] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:28.406887] [DEBUG] [LOCAL ] TROX: Loaded 51863 existing records from primary storage. [2025-09-30T22:16:28.405298] [DEBUG] [LOCAL ] TRP: Loaded 52096 existing records from primary storage. [2025-09-30T22:16:28.407206] [INFO ] [MAIN ] TROX: Loaded 51863 primary data records. [2025-09-30T22:16:28.407274] [INFO ] [MAIN ] TRP: Loaded 52096 primary data records. [2025-09-30T22:16:28.584993] [DEBUG] [LOCAL ] TRTX: Loaded 37480 existing records from primary storage. [2025-09-30T22:16:28.619589] [INFO ] [MAIN ] TRTX: Loaded 37480 primary data records. [2025-09-30T22:16:29.458271] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:29.459738] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52096 primary records. [2025-09-30T22:16:29.473757] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:29.473447] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-30T22:16:29.474984] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51863 primary records. [2025-09-30T22:16:29.476222] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-30T22:16:29.522185] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-30T22:16:29.522907] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-30T22:16:29.525882] [INFO ] [MAIN ] Derivative Progress: 1780/2009 symbols completed. TROX took 1.3s. Estimated remaining: 1m 34s. Rate: 145.7 symbols/min [2025-09-30T22:16:29.526434] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:29.523218] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:29.528162] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37480 primary records. [2025-09-30T22:16:29.529505] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-30T22:16:29.548927] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-30T22:16:29.549030] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-30T22:16:29.544771] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-30T22:16:29.551801] [INFO ] [MAIN ] Derivative Progress: 1781/2009 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 34s. Rate: 145.8 symbols/min [2025-09-30T22:16:29.552058] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:29.552284] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-30T22:16:29.555771] [INFO ] [MAIN ] Derivative Progress: 1782/2009 symbols completed. TRP took 1.3s. Estimated remaining: 1m 33s. Rate: 145.9 symbols/min [2025-09-30T22:16:29.556041] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:29.651463] [DEBUG] [LOCAL ] TRV: Loaded 47872 existing records from primary storage. [2025-09-30T22:16:29.651710] [INFO ] [MAIN ] TRV: Loaded 47872 primary data records. [2025-09-30T22:16:29.658789] [DEBUG] [LOCAL ] TRU: Loaded 51214 existing records from primary storage. [2025-09-30T22:16:29.701811] [INFO ] [MAIN ] TRU: Loaded 51214 primary data records. [2025-09-30T22:16:29.838346] [DEBUG] [LOCAL ] TS: Loaded 51673 existing records from primary storage. [2025-09-30T22:16:29.843851] [INFO ] [MAIN ] TS: Loaded 51673 primary data records. [2025-09-30T22:16:30.749783] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:30.750680] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47872 primary records. [2025-09-30T22:16:30.750976] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-30T22:16:30.772168] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-30T22:16:30.785406] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-30T22:16:30.788069] [INFO ] [MAIN ] Derivative Progress: 1783/2009 symbols completed. TRV took 1.2s. Estimated remaining: 1m 33s. Rate: 145.7 symbols/min [2025-09-30T22:16:30.788809] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:30.789825] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51214 primary records. [2025-09-30T22:16:30.790625] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-30T22:16:30.819155] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:30.821755] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51673 primary records. [2025-09-30T22:16:30.824676] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-30T22:16:30.824837] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-30T22:16:30.827429] [INFO ] [MAIN ] Derivative Progress: 1784/2009 symbols completed. TRU took 1.3s. Estimated remaining: 1m 33s. Rate: 145.8 symbols/min [2025-09-30T22:16:30.824765] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-30T22:16:30.844284] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-30T22:16:30.844394] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-30T22:16:30.847343] [INFO ] [MAIN ] Derivative Progress: 1785/2009 symbols completed. TS took 1.3s. Estimated remaining: 1m 32s. Rate: 145.8 symbols/min [2025-09-30T22:16:30.847949] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:30.848130] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:30.847836] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:30.858520] [DEBUG] [LOCAL ] TSI: Loaded 7508 existing records from primary storage. [2025-09-30T22:16:30.858813] [INFO ] [MAIN ] TSI: Loaded 7508 primary data records. [2025-09-30T22:16:31.036420] [DEBUG] [LOCAL ] TSE: Loaded 28411 existing records from primary storage. [2025-09-30T22:16:31.071156] [INFO ] [MAIN ] TSE: Loaded 28411 primary data records. [2025-09-30T22:16:31.140131] [DEBUG] [LOCAL ] TSLX: Loaded 35140 existing records from primary storage. [2025-09-30T22:16:31.288024] [INFO ] [MAIN ] TSLX: Loaded 35140 primary data records. [2025-09-30T22:16:31.954988] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:31.956948] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7508 primary records. [2025-09-30T22:16:31.957151] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-30T22:16:31.977160] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-30T22:16:31.985709] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-30T22:16:31.992606] [INFO ] [MAIN ] Derivative Progress: 1786/2009 symbols completed. TSI took 1.1s. Estimated remaining: 1m 32s. Rate: 145.7 symbols/min [2025-09-30T22:16:31.993731] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:31.995091] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28411 primary records. [2025-09-30T22:16:31.995200] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-30T22:16:31.993940] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:32.029225] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:32.030587] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35140 primary records. [2025-09-30T22:16:32.029771] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-30T22:16:32.030817] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-30T22:16:32.030925] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-30T22:16:32.034306] [INFO ] [MAIN ] Derivative Progress: 1787/2009 symbols completed. TSE took 1.2s. Estimated remaining: 1m 31s. Rate: 145.8 symbols/min [2025-09-30T22:16:32.034472] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:32.055095] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-30T22:16:32.055399] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-30T22:16:32.058335] [INFO ] [MAIN ] Derivative Progress: 1788/2009 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 31s. Rate: 145.8 symbols/min [2025-09-30T22:16:32.058774] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:32.089006] [DEBUG] [LOCAL ] TSQ: Loaded 11991 existing records from primary storage. [2025-09-30T22:16:32.089173] [INFO ] [MAIN ] TSQ: Loaded 11991 primary data records. [2025-09-30T22:16:32.235500] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-30T22:16:32.240529] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-30T22:16:32.362473] [DEBUG] [LOCAL ] TSN: Loaded 52902 existing records from primary storage. [2025-09-30T22:16:32.418473] [INFO ] [MAIN ] TSN: Loaded 52902 primary data records. [2025-09-30T22:16:33.210257] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:33.211237] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11991 primary records. [2025-09-30T22:16:33.211450] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-30T22:16:33.246139] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-30T22:16:33.246054] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:33.247114] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-30T22:16:33.246272] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-30T22:16:33.247410] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-30T22:16:33.249420] [INFO ] [MAIN ] Derivative Progress: 1789/2009 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 31s. Rate: 145.7 symbols/min [2025-09-30T22:16:33.250279] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:33.270801] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-30T22:16:33.271191] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-30T22:16:33.273713] [INFO ] [MAIN ] Derivative Progress: 1790/2009 symbols completed. TSM took 1.3s. Estimated remaining: 1m 30s. Rate: 145.8 symbols/min [2025-09-30T22:16:33.274074] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:33.287671] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:33.288500] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52902 primary records. [2025-09-30T22:16:33.288667] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-30T22:16:33.307479] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-30T22:16:33.307703] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-30T22:16:33.310377] [INFO ] [MAIN ] Derivative Progress: 1791/2009 symbols completed. TSN took 1.3s. Estimated remaining: 1m 30s. Rate: 145.8 symbols/min [2025-09-30T22:16:33.310698] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:33.351936] [DEBUG] [LOCAL ] TT: Loaded 47747 existing records from primary storage. [2025-09-30T22:16:33.352552] [INFO ] [MAIN ] TT: Loaded 47747 primary data records. [2025-09-30T22:16:33.413217] [DEBUG] [LOCAL ] TTC: Loaded 42167 existing records from primary storage. [2025-09-30T22:16:33.438106] [INFO ] [MAIN ] TTC: Loaded 42167 primary data records. [2025-09-30T22:16:33.817425] [DEBUG] [LOCAL ] TTE: Loaded 51628 existing records from primary storage. [2025-09-30T22:16:33.847835] [INFO ] [MAIN ] TTE: Loaded 51628 primary data records. [2025-09-30T22:16:34.394840] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:16:34.396158] [INFO ] [MAIN ] TT: Generated 1793 derivative records from 47747 primary records. [2025-09-30T22:16:34.397079] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-30T22:16:34.411412] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:34.420899] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42167 primary records. [2025-09-30T22:16:34.423711] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-30T22:16:34.446898] [DEBUG] [LOCAL ] TT: Derivative data saved (1793 records). [2025-09-30T22:16:34.447817] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-30T22:16:34.450969] [INFO ] [MAIN ] Derivative Progress: 1792/2009 symbols completed. TT took 1.2s. Estimated remaining: 1m 29s. Rate: 145.7 symbols/min [2025-09-30T22:16:34.452271] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:34.468958] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:34.469766] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51628 primary records. [2025-09-30T22:16:34.469946] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-30T22:16:34.468634] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-30T22:16:34.479478] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-30T22:16:34.484769] [INFO ] [MAIN ] Derivative Progress: 1793/2009 symbols completed. TTC took 1.2s. Estimated remaining: 1m 29s. Rate: 145.8 symbols/min [2025-09-30T22:16:34.485231] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:34.498196] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-30T22:16:34.498376] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-30T22:16:34.501410] [INFO ] [MAIN ] Derivative Progress: 1794/2009 symbols completed. TTE took 1.2s. Estimated remaining: 1m 28s. Rate: 145.9 symbols/min [2025-09-30T22:16:34.501702] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:34.540350] [DEBUG] [LOCAL ] TTI: Loaded 45500 existing records from primary storage. [2025-09-30T22:16:34.550262] [INFO ] [MAIN ] TTI: Loaded 45500 primary data records. [2025-09-30T22:16:34.698031] [DEBUG] [LOCAL ] TUYA: Loaded 46223 existing records from primary storage. [2025-09-30T22:16:34.712627] [INFO ] [MAIN ] TUYA: Loaded 46223 primary data records. [2025-09-30T22:16:34.746448] [DEBUG] [LOCAL ] TU: Loaded 49845 existing records from primary storage. [2025-09-30T22:16:34.832432] [INFO ] [MAIN ] TU: Loaded 49845 primary data records. [2025-09-30T22:16:35.694132] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:35.695415] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45500 primary records. [2025-09-30T22:16:35.696824] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-30T22:16:35.729133] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:35.731737] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46223 primary records. [2025-09-30T22:16:35.733038] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-30T22:16:35.733494] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-30T22:16:35.733601] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-30T22:16:35.736187] [INFO ] [MAIN ] Derivative Progress: 1795/2009 symbols completed. TTI took 1.3s. Estimated remaining: 1m 28s. Rate: 145.7 symbols/min [2025-09-30T22:16:35.736576] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:35.775152] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-30T22:16:35.775431] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:35.775768] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-30T22:16:35.776715] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49845 primary records. [2025-09-30T22:16:35.780289] [INFO ] [MAIN ] Derivative Progress: 1796/2009 symbols completed. TUYA took 1.3s. Estimated remaining: 1m 28s. Rate: 145.8 symbols/min [2025-09-30T22:16:35.780843] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:35.780701] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-30T22:16:35.811593] [DEBUG] [LOCAL ] TVC: Loaded 3392 existing records from primary storage. [2025-09-30T22:16:35.812265] [INFO ] [MAIN ] TVC: Loaded 3392 primary data records. [2025-09-30T22:16:35.906477] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-30T22:16:35.940486] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-30T22:16:35.945370] [DEBUG] [LOCAL ] TV: Loaded 42730 existing records from primary storage. [2025-09-30T22:16:35.959888] [INFO ] [MAIN ] TV: Loaded 42730 primary data records. [2025-09-30T22:16:35.949178] [INFO ] [MAIN ] Derivative Progress: 1797/2009 symbols completed. TU took 1.5s. Estimated remaining: 1m 27s. Rate: 145.8 symbols/min [2025-09-30T22:16:35.960375] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:36.250424] [DEBUG] [LOCAL ] TVE: Loaded 2810 existing records from primary storage. [2025-09-30T22:16:36.286160] [INFO ] [MAIN ] TVE: Loaded 2810 primary data records. [2025-09-30T22:16:36.921007] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:36.922217] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3392 primary records. [2025-09-30T22:16:36.922410] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-30T22:16:36.957757] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:36.957274] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-30T22:16:36.958788] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42730 primary records. [2025-09-30T22:16:36.958896] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-30T22:16:36.958689] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-30T22:16:36.961914] [INFO ] [MAIN ] Derivative Progress: 1798/2009 symbols completed. TVC took 1.2s. Estimated remaining: 1m 27s. Rate: 145.7 symbols/min [2025-09-30T22:16:36.982202] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-30T22:16:36.983141] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-30T22:16:36.986414] [INFO ] [MAIN ] Derivative Progress: 1799/2009 symbols completed. TV took 1.2s. Estimated remaining: 1m 26s. Rate: 145.8 symbols/min [2025-09-30T22:16:37.000425] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:37.001142] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2810 primary records. [2025-09-30T22:16:37.001208] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-30T22:16:37.015792] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-09-30T22:16:37.015891] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-30T22:16:37.018943] [INFO ] [MAIN ] Derivative Progress: 1800/2009 symbols completed. TVE took 1.1s. Estimated remaining: 1m 26s. Rate: 145.8 symbols/min [2025-09-30T22:16:37.019431] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:37.019668] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:37.019574] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:37.025768] [DEBUG] [LOCAL ] TWN: Loaded 3147 existing records from primary storage. [2025-09-30T22:16:37.025904] [INFO ] [MAIN ] TWN: Loaded 3147 primary data records. [2025-09-30T22:16:37.419798] [DEBUG] [LOCAL ] TWI: Loaded 34200 existing records from primary storage. [2025-09-30T22:16:37.421224] [INFO ] [MAIN ] TWI: Loaded 34200 primary data records. [2025-09-30T22:16:37.497672] [DEBUG] [LOCAL ] TWLO: Loaded 52710 existing records from primary storage. [2025-09-30T22:16:37.540603] [INFO ] [MAIN ] TWLO: Loaded 52710 primary data records. [2025-09-30T22:16:38.144969] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:38.149119] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3147 primary records. [2025-09-30T22:16:38.149386] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-30T22:16:38.169849] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-30T22:16:38.170165] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-30T22:16:38.173609] [INFO ] [MAIN ] Derivative Progress: 1801/2009 symbols completed. TWN took 1.2s. Estimated remaining: 1m 26s. Rate: 145.7 symbols/min [2025-09-30T22:16:38.175471] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:38.192905] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:38.195481] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34200 primary records. [2025-09-30T22:16:38.195738] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-30T22:16:38.223765] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:38.225378] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52710 primary records. [2025-09-30T22:16:38.228319] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-30T22:16:38.228225] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-30T22:16:38.228406] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-30T22:16:38.232490] [INFO ] [MAIN ] Derivative Progress: 1802/2009 symbols completed. TWI took 1.2s. Estimated remaining: 1m 25s. Rate: 145.8 symbols/min [2025-09-30T22:16:38.232979] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:38.261966] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-30T22:16:38.262185] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-30T22:16:38.264736] [INFO ] [MAIN ] Derivative Progress: 1803/2009 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 25s. Rate: 145.8 symbols/min [2025-09-30T22:16:38.265130] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:38.295512] [DEBUG] [LOCAL ] TX: Loaded 23324 existing records from primary storage. [2025-09-30T22:16:38.295770] [INFO ] [MAIN ] TX: Loaded 23324 primary data records. [2025-09-30T22:16:38.308285] [DEBUG] [LOCAL ] TWO: Loaded 48314 existing records from primary storage. [2025-09-30T22:16:38.342737] [INFO ] [MAIN ] TWO: Loaded 48314 primary data records. [2025-09-30T22:16:38.864102] [DEBUG] [LOCAL ] TXNM: Loaded 43548 existing records from primary storage. [2025-09-30T22:16:39.005460] [INFO ] [MAIN ] TXNM: Loaded 43548 primary data records. [2025-09-30T22:16:39.443157] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:39.457558] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23324 primary records. [2025-09-30T22:16:39.458460] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:39.459411] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48314 primary records. [2025-09-30T22:16:39.458737] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-30T22:16:39.460025] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-30T22:16:39.495541] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-30T22:16:39.496574] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-30T22:16:39.498857] [INFO ] [MAIN ] Derivative Progress: 1804/2009 symbols completed. TX took 1.3s. Estimated remaining: 1m 24s. Rate: 145.7 symbols/min [2025-09-30T22:16:39.500617] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-30T22:16:39.501063] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-30T22:16:39.500966] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:39.504338] [INFO ] [MAIN ] Derivative Progress: 1805/2009 symbols completed. TWO took 1.3s. Estimated remaining: 1m 24s. Rate: 145.8 symbols/min [2025-09-30T22:16:39.505176] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:39.524885] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:39.525833] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43548 primary records. [2025-09-30T22:16:39.525901] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-30T22:16:39.558314] [DEBUG] [LOCAL ] TXO: Loaded 18916 existing records from primary storage. [2025-09-30T22:16:39.559249] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-30T22:16:39.559384] [INFO ] [MAIN ] TXO: Loaded 18916 primary data records. [2025-09-30T22:16:39.564836] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-30T22:16:39.574693] [INFO ] [MAIN ] Derivative Progress: 1806/2009 symbols completed. TXNM took 1.3s. Estimated remaining: 1m 24s. Rate: 145.8 symbols/min [2025-09-30T22:16:39.602939] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:39.706837] [DEBUG] [LOCAL ] TY: Loaded 7560 existing records from primary storage. [2025-09-30T22:16:39.746922] [INFO ] [MAIN ] TY: Loaded 7560 primary data records. [2025-09-30T22:16:39.772191] [DEBUG] [LOCAL ] TXT: Loaded 49719 existing records from primary storage. [2025-09-30T22:16:39.792619] [INFO ] [MAIN ] TXT: Loaded 49719 primary data records. [2025-09-30T22:16:40.702037] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:40.703487] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18916 primary records. [2025-09-30T22:16:40.704892] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-30T22:16:40.737574] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:40.739067] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7560 primary records. [2025-09-30T22:16:40.739500] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-30T22:16:40.765051] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:40.771460] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-30T22:16:40.772307] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-30T22:16:40.770704] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49719 primary records. [2025-09-30T22:16:40.773029] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-30T22:16:40.772958] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-30T22:16:40.773156] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-30T22:16:40.776507] [INFO ] [MAIN ] Derivative Progress: 1807/2009 symbols completed. TY took 1.2s. Estimated remaining: 1m 23s. Rate: 145.7 symbols/min [2025-09-30T22:16:40.779453] [INFO ] [MAIN ] Derivative Progress: 1808/2009 symbols completed. TXO took 1.3s. Estimated remaining: 1m 23s. Rate: 145.7 symbols/min [2025-09-30T22:16:40.779378] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:40.792510] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:40.800183] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-30T22:16:40.800383] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-30T22:16:40.803187] [INFO ] [MAIN ] Derivative Progress: 1809/2009 symbols completed. TXT took 1.3s. Estimated remaining: 1m 22s. Rate: 145.8 symbols/min [2025-09-30T22:16:40.807186] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:40.815039] [DEBUG] [LOCAL ] TYG: Loaded 14191 existing records from primary storage. [2025-09-30T22:16:40.815285] [INFO ] [MAIN ] TYG: Loaded 14191 primary data records. [2025-09-30T22:16:40.938990] [DEBUG] [LOCAL ] TYL: Loaded 22196 existing records from primary storage. [2025-09-30T22:16:40.945232] [INFO ] [MAIN ] TYL: Loaded 22196 primary data records. [2025-09-30T22:16:41.312964] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-30T22:16:41.325196] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-30T22:16:41.927875] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:41.929261] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14191 primary records. [2025-09-30T22:16:41.929447] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-30T22:16:41.967634] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:41.967217] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-30T22:16:41.967983] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-30T22:16:41.971385] [INFO ] [MAIN ] Derivative Progress: 1810/2009 symbols completed. TYG took 1.2s. Estimated remaining: 1m 22s. Rate: 145.7 symbols/min [2025-09-30T22:16:41.971609] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:41.968933] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22196 primary records. [2025-09-30T22:16:41.971920] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-30T22:16:42.007292] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:42.008857] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-30T22:16:42.009755] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-30T22:16:42.009686] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-30T22:16:42.009867] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-30T22:16:42.012711] [INFO ] [MAIN ] Derivative Progress: 1811/2009 symbols completed. TYL took 1.2s. Estimated remaining: 1m 22s. Rate: 145.7 symbols/min [2025-09-30T22:16:42.015256] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:42.036005] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-30T22:16:42.036787] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-30T22:16:42.051575] [INFO ] [MAIN ] Derivative Progress: 1812/2009 symbols completed. U took 1.2s. Estimated remaining: 1m 21s. Rate: 145.8 symbols/min [2025-09-30T22:16:42.052042] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:42.089679] [DEBUG] [LOCAL ] UAN: Loaded 5387 existing records from primary storage. [2025-09-30T22:16:42.090018] [INFO ] [MAIN ] UAN: Loaded 5387 primary data records. [2025-09-30T22:16:42.116038] [DEBUG] [LOCAL ] UA: Loaded 50459 existing records from primary storage. [2025-09-30T22:16:42.153033] [INFO ] [MAIN ] UA: Loaded 50459 primary data records. [2025-09-30T22:16:42.335009] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-09-30T22:16:42.390840] [INFO ] [MAIN ] UAA: Loaded 53507 primary data records. [2025-09-30T22:16:43.126318] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:43.127246] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5387 primary records. [2025-09-30T22:16:43.130911] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-30T22:16:43.156751] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:43.158096] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50459 primary records. [2025-09-30T22:16:43.158821] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-30T22:16:43.175863] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-30T22:16:43.178340] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-30T22:16:43.181511] [INFO ] [MAIN ] Derivative Progress: 1813/2009 symbols completed. UAN took 1.1s. Estimated remaining: 1m 21s. Rate: 145.7 symbols/min [2025-09-30T22:16:43.183907] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-30T22:16:43.184045] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-30T22:16:43.186813] [INFO ] [MAIN ] Derivative Progress: 1814/2009 symbols completed. UA took 1.2s. Estimated remaining: 1m 20s. Rate: 145.8 symbols/min [2025-09-30T22:16:43.200178] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:43.200805] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53507 primary records. [2025-09-30T22:16:43.200867] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-30T22:16:43.215942] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-30T22:16:43.216014] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-30T22:16:43.218753] [INFO ] [MAIN ] Derivative Progress: 1815/2009 symbols completed. UAA took 1.2s. Estimated remaining: 1m 20s. Rate: 145.8 symbols/min [2025-09-30T22:16:43.219230] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:43.219161] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:43.219459] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:43.258717] [DEBUG] [LOCAL ] UCB: Loaded 37859 existing records from primary storage. [2025-09-30T22:16:43.258858] [INFO ] [MAIN ] UCB: Loaded 37859 primary data records. [2025-09-30T22:16:43.638014] [DEBUG] [LOCAL ] UBS: Loaded 52407 existing records from primary storage. [2025-09-30T22:16:43.566349] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-30T22:16:43.652838] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-30T22:16:43.643510] [INFO ] [MAIN ] UBS: Loaded 52407 primary data records. [2025-09-30T22:16:44.383358] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:44.384314] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37859 primary records. [2025-09-30T22:16:44.385733] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-30T22:16:44.409919] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-30T22:16:44.410955] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-30T22:16:44.415685] [INFO ] [MAIN ] Derivative Progress: 1816/2009 symbols completed. UCB took 1.2s. Estimated remaining: 1m 19s. Rate: 145.7 symbols/min [2025-09-30T22:16:44.417047] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:44.438621] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:44.452213] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52407 primary records. [2025-09-30T22:16:44.452495] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:44.453224] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-30T22:16:44.452684] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-30T22:16:44.453412] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-30T22:16:44.488349] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-30T22:16:44.489163] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-30T22:16:44.492876] [INFO ] [MAIN ] Derivative Progress: 1817/2009 symbols completed. UBER took 1.3s. Estimated remaining: 1m 19s. Rate: 145.7 symbols/min [2025-09-30T22:16:44.493613] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:44.494619] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-30T22:16:44.494787] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-30T22:16:44.497945] [INFO ] [MAIN ] Derivative Progress: 1818/2009 symbols completed. UBS took 1.3s. Estimated remaining: 1m 19s. Rate: 145.8 symbols/min [2025-09-30T22:16:44.498515] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:44.526079] [DEBUG] [LOCAL ] UFI: Loaded 8082 existing records from primary storage. [2025-09-30T22:16:44.526362] [INFO ] [MAIN ] UFI: Loaded 8082 primary data records. [2025-09-30T22:16:44.675579] [DEBUG] [LOCAL ] UDR: Loaded 51821 existing records from primary storage. [2025-09-30T22:16:44.715858] [INFO ] [MAIN ] UDR: Loaded 51821 primary data records. [2025-09-30T22:16:44.929422] [DEBUG] [LOCAL ] UE: Loaded 42788 existing records from primary storage. [2025-09-30T22:16:44.957157] [INFO ] [MAIN ] UE: Loaded 42788 primary data records. [2025-09-30T22:16:45.621309] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:45.623016] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8082 primary records. [2025-09-30T22:16:45.623320] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-30T22:16:45.648741] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-30T22:16:45.649712] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-30T22:16:45.652726] [INFO ] [MAIN ] Derivative Progress: 1819/2009 symbols completed. UFI took 1.2s. Estimated remaining: 1m 18s. Rate: 145.7 symbols/min [2025-09-30T22:16:45.653677] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:45.673041] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:45.674405] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51821 primary records. [2025-09-30T22:16:45.675960] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-30T22:16:45.708365] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:45.709994] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42788 primary records. [2025-09-30T22:16:45.711001] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-30T22:16:45.711117] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-30T22:16:45.713541] [INFO ] [MAIN ] Derivative Progress: 1820/2009 symbols completed. UDR took 1.3s. Estimated remaining: 1m 18s. Rate: 145.8 symbols/min [2025-09-30T22:16:45.713617] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-30T22:16:45.714605] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:45.732866] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-30T22:16:45.733125] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-30T22:16:45.736123] [INFO ] [MAIN ] Derivative Progress: 1821/2009 symbols completed. UE took 1.2s. Estimated remaining: 1m 17s. Rate: 145.8 symbols/min [2025-09-30T22:16:45.736407] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:45.786045] [DEBUG] [LOCAL ] UHAL: Loaded 16541 existing records from primary storage. [2025-09-30T22:16:45.806494] [INFO ] [MAIN ] UHAL: Loaded 16541 primary data records. [2025-09-30T22:16:45.878702] [DEBUG] [LOCAL ] UGI: Loaded 50512 existing records from primary storage. [2025-09-30T22:16:45.914035] [INFO ] [MAIN ] UGI: Loaded 50512 primary data records. [2025-09-30T22:16:45.936239] [DEBUG] [LOCAL ] UGP: Loaded 42899 existing records from primary storage. [2025-09-30T22:16:45.948090] [INFO ] [MAIN ] UGP: Loaded 42899 primary data records. [2025-09-30T22:16:46.843941] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:46.845197] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16541 primary records. [2025-09-30T22:16:46.845717] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-30T22:16:46.863555] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-30T22:16:46.867342] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-30T22:16:46.869538] [INFO ] [MAIN ] Derivative Progress: 1822/2009 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 17s. Rate: 145.7 symbols/min [2025-09-30T22:16:46.869814] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:46.896626] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:46.896446] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:46.898135] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42899 primary records. [2025-09-30T22:16:46.897512] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50512 primary records. [2025-09-30T22:16:46.898257] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-30T22:16:46.898337] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-30T22:16:46.927382] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-30T22:16:46.928026] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-30T22:16:46.931274] [INFO ] [MAIN ] Derivative Progress: 1823/2009 symbols completed. UGI took 1.3s. Estimated remaining: 1m 17s. Rate: 145.8 symbols/min [2025-09-30T22:16:46.933244] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:46.938670] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-30T22:16:46.938907] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-30T22:16:46.942064] [INFO ] [MAIN ] Derivative Progress: 1824/2009 symbols completed. UGP took 1.2s. Estimated remaining: 1m 16s. Rate: 145.8 symbols/min [2025-09-30T22:16:46.942395] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:46.960910] [DEBUG] [LOCAL ] UHT: Loaded 9964 existing records from primary storage. [2025-09-30T22:16:46.961080] [INFO ] [MAIN ] UHT: Loaded 9964 primary data records. [2025-09-30T22:16:47.096488] [DEBUG] [LOCAL ] UHS: Loaded 40923 existing records from primary storage. [2025-09-30T22:16:47.096992] [DEBUG] [LOCAL ] UI: Loaded 13038 existing records from primary storage. [2025-09-30T22:16:47.097394] [INFO ] [MAIN ] UHS: Loaded 40923 primary data records. [2025-09-30T22:16:47.097542] [INFO ] [MAIN ] UI: Loaded 13038 primary data records. [2025-09-30T22:16:48.068706] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:48.071877] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9964 primary records. [2025-09-30T22:16:48.072098] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-30T22:16:48.092190] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-30T22:16:48.092795] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-30T22:16:48.095271] [INFO ] [MAIN ] Derivative Progress: 1825/2009 symbols completed. UHT took 1.2s. Estimated remaining: 1m 16s. Rate: 145.7 symbols/min [2025-09-30T22:16:48.095742] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:48.118625] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:48.127471] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40923 primary records. [2025-09-30T22:16:48.132294] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-30T22:16:48.133743] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:48.134769] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13038 primary records. [2025-09-30T22:16:48.135257] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-30T22:16:48.174972] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-30T22:16:48.175514] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-30T22:16:48.179203] [INFO ] [MAIN ] Derivative Progress: 1826/2009 symbols completed. UHS took 1.3s. Estimated remaining: 1m 15s. Rate: 145.8 symbols/min [2025-09-30T22:16:48.180768] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:48.181943] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-30T22:16:48.192146] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-30T22:16:48.196183] [INFO ] [MAIN ] Derivative Progress: 1827/2009 symbols completed. UI took 1.3s. Estimated remaining: 1m 15s. Rate: 145.8 symbols/min [2025-09-30T22:16:48.196458] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:48.199455] [DEBUG] [LOCAL ] UIS: Loaded 36971 existing records from primary storage. [2025-09-30T22:16:48.199687] [INFO ] [MAIN ] UIS: Loaded 36971 primary data records. [2025-09-30T22:16:48.558674] [DEBUG] [LOCAL ] ULS: Loaded 39433 existing records from primary storage. [2025-09-30T22:16:48.559476] [INFO ] [MAIN ] ULS: Loaded 39433 primary data records. [2025-09-30T22:16:48.684741] [DEBUG] [LOCAL ] UL: Loaded 53057 existing records from primary storage. [2025-09-30T22:16:48.692286] [INFO ] [MAIN ] UL: Loaded 53057 primary data records. [2025-09-30T22:16:49.279730] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:49.280690] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36971 primary records. [2025-09-30T22:16:49.280788] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-30T22:16:49.304344] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-30T22:16:49.304976] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-30T22:16:49.307137] [INFO ] [MAIN ] Derivative Progress: 1828/2009 symbols completed. UIS took 1.2s. Estimated remaining: 1m 15s. Rate: 145.7 symbols/min [2025-09-30T22:16:49.327594] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:49.329201] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39433 primary records. [2025-09-30T22:16:49.329440] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-30T22:16:49.366111] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-30T22:16:49.365992] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:49.367222] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53057 primary records. [2025-09-30T22:16:49.367358] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-30T22:16:49.367500] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-30T22:16:49.371763] [INFO ] [MAIN ] Derivative Progress: 1829/2009 symbols completed. ULS took 1.2s. Estimated remaining: 1m 14s. Rate: 145.8 symbols/min [2025-09-30T22:16:49.388031] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-30T22:16:49.388150] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-30T22:16:49.390966] [INFO ] [MAIN ] Derivative Progress: 1830/2009 symbols completed. UL took 1.2s. Estimated remaining: 1m 14s. Rate: 145.8 symbols/min [2025-09-30T22:16:49.391578] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:49.391814] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:49.392162] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:49.408403] [DEBUG] [LOCAL ] UNF: Loaded 12028 existing records from primary storage. [2025-09-30T22:16:49.408732] [INFO ] [MAIN ] UNF: Loaded 12028 primary data records. [2025-09-30T22:16:49.642536] [DEBUG] [LOCAL ] UMH: Loaded 33624 existing records from primary storage. [2025-09-30T22:16:49.767239] [INFO ] [MAIN ] UMH: Loaded 33624 primary data records. [2025-09-30T22:16:49.860223] [DEBUG] [LOCAL ] UMC: Loaded 52711 existing records from primary storage. [2025-09-30T22:16:49.897681] [INFO ] [MAIN ] UMC: Loaded 52711 primary data records. [2025-09-30T22:16:50.602382] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:50.603388] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 12028 primary records. [2025-09-30T22:16:50.605308] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-30T22:16:50.631034] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-30T22:16:50.631252] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-30T22:16:50.634525] [INFO ] [MAIN ] Derivative Progress: 1831/2009 symbols completed. UNF took 1.2s. Estimated remaining: 1m 13s. Rate: 145.7 symbols/min [2025-09-30T22:16:50.635128] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:50.660528] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:50.661465] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33624 primary records. [2025-09-30T22:16:50.661601] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-30T22:16:50.714327] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:50.715176] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-30T22:16:50.716307] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52711 primary records. [2025-09-30T22:16:50.716435] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-30T22:16:50.716682] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-30T22:16:50.722295] [INFO ] [MAIN ] Derivative Progress: 1832/2009 symbols completed. UMH took 1.3s. Estimated remaining: 1m 13s. Rate: 145.7 symbols/min [2025-09-30T22:16:50.722726] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:50.742677] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-30T22:16:50.763579] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-30T22:16:50.766377] [INFO ] [MAIN ] Derivative Progress: 1833/2009 symbols completed. UMC took 1.4s. Estimated remaining: 1m 12s. Rate: 145.8 symbols/min [2025-09-30T22:16:50.766622] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:50.768391] [DEBUG] [LOCAL ] UNFI: Loaded 41874 existing records from primary storage. [2025-09-30T22:16:50.769112] [INFO ] [MAIN ] UNFI: Loaded 41874 primary data records. [2025-09-30T22:16:51.180008] [DEBUG] [LOCAL ] UNM: Loaded 48524 existing records from primary storage. [2025-09-30T22:16:51.180451] [INFO ] [MAIN ] UNM: Loaded 48524 primary data records. [2025-09-30T22:16:51.195517] [DEBUG] [LOCAL ] UNH: Loaded 53795 existing records from primary storage. [2025-09-30T22:16:51.233867] [INFO ] [MAIN ] UNH: Loaded 53795 primary data records. [2025-09-30T22:16:51.904413] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:51.906618] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41874 primary records. [2025-09-30T22:16:51.908369] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-30T22:16:51.930033] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-30T22:16:51.930599] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-30T22:16:51.933418] [INFO ] [MAIN ] Derivative Progress: 1834/2009 symbols completed. UNFI took 1.3s. Estimated remaining: 1m 12s. Rate: 145.7 symbols/min [2025-09-30T22:16:51.933803] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:51.944928] [DEBUG] [LOCAL ] UNMA: Loaded 3536 existing records from primary storage. [2025-09-30T22:16:51.945458] [INFO ] [MAIN ] UNMA: Loaded 3536 primary data records. [2025-09-30T22:16:52.027465] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:52.051984] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48524 primary records. [2025-09-30T22:16:52.096339] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:52.096479] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-30T22:16:52.115177] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53795 primary records. [2025-09-30T22:16:52.179877] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-30T22:16:52.353362] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-30T22:16:52.356148] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-30T22:16:52.356245] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-30T22:16:52.361079] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-30T22:16:52.360295] [INFO ] [MAIN ] Derivative Progress: 1835/2009 symbols completed. UNM took 1.6s. Estimated remaining: 1m 12s. Rate: 145.7 symbols/min [2025-09-30T22:16:52.361344] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:52.366398] [INFO ] [MAIN ] Derivative Progress: 1836/2009 symbols completed. UNH took 1.6s. Estimated remaining: 1m 11s. Rate: 145.7 symbols/min [2025-09-30T22:16:52.367334] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:52.397536] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:52.398415] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3536 primary records. [2025-09-30T22:16:52.398602] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-30T22:16:52.434284] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-30T22:16:52.434580] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-30T22:16:52.437108] [INFO ] [MAIN ] Derivative Progress: 1837/2009 symbols completed. UNMA took 0.5s. Estimated remaining: 1m 11s. Rate: 145.8 symbols/min [2025-09-30T22:16:52.437426] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:52.454138] [DEBUG] [LOCAL ] UP: Loaded 43136 existing records from primary storage. [2025-09-30T22:16:52.454560] [INFO ] [MAIN ] UP: Loaded 43136 primary data records. [2025-09-30T22:16:52.706019] [DEBUG] [LOCAL ] UNP: Loaded 53267 existing records from primary storage. [2025-09-30T22:16:52.729897] [INFO ] [MAIN ] UNP: Loaded 53267 primary data records. [2025-09-30T22:16:53.027306] [DEBUG] [LOCAL ] UPS: Loaded 53712 existing records from primary storage. [2025-09-30T22:16:53.049687] [INFO ] [MAIN ] UPS: Loaded 53712 primary data records. [2025-09-30T22:16:53.585924] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:53.586957] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43136 primary records. [2025-09-30T22:16:53.587136] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-30T22:16:53.607897] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-30T22:16:53.608751] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-30T22:16:53.611923] [INFO ] [MAIN ] Derivative Progress: 1838/2009 symbols completed. UP took 1.2s. Estimated remaining: 1m 10s. Rate: 145.7 symbols/min [2025-09-30T22:16:53.612766] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:53.635212] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:53.636702] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53267 primary records. [2025-09-30T22:16:53.636884] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-30T22:16:53.659413] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-30T22:16:53.659848] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-30T22:16:53.662299] [INFO ] [MAIN ] Derivative Progress: 1839/2009 symbols completed. UNP took 1.3s. Estimated remaining: 1m 10s. Rate: 145.7 symbols/min [2025-09-30T22:16:53.675546] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:53.676228] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:53.677544] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53712 primary records. [2025-09-30T22:16:53.687140] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-30T22:16:53.714154] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-30T22:16:53.714395] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-30T22:16:53.731547] [INFO ] [MAIN ] Derivative Progress: 1840/2009 symbols completed. UPS took 1.3s. Estimated remaining: 1m 10s. Rate: 145.8 symbols/min [2025-09-30T22:16:53.733031] [DEBUG] [LOCAL ] URI: Loaded 35767 existing records from primary storage. [2025-09-30T22:16:53.733303] [INFO ] [MAIN ] URI: Loaded 35767 primary data records. [2025-09-30T22:16:53.733570] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:53.877180] [DEBUG] [LOCAL ] USA: Loaded 35964 existing records from primary storage. [2025-09-30T22:16:53.877466] [INFO ] [MAIN ] USA: Loaded 35964 primary data records. [2025-09-30T22:16:54.233691] [DEBUG] [LOCAL ] USAC: Loaded 22418 existing records from primary storage. [2025-09-30T22:16:54.234919] [INFO ] [MAIN ] USAC: Loaded 22418 primary data records. [2025-09-30T22:16:54.871960] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:54.873746] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 35767 primary records. [2025-09-30T22:16:54.874122] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-30T22:16:54.895464] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-30T22:16:54.895862] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-30T22:16:54.910855] [INFO ] [MAIN ] Derivative Progress: 1841/2009 symbols completed. URI took 1.3s. Estimated remaining: 1m 9s. Rate: 145.6 symbols/min [2025-09-30T22:16:54.911773] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:54.912015] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:54.913368] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35964 primary records. [2025-09-30T22:16:54.914261] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-30T22:16:54.935247] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-30T22:16:54.935448] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-30T22:16:54.938529] [INFO ] [MAIN ] Derivative Progress: 1842/2009 symbols completed. USA took 1.3s. Estimated remaining: 1m 9s. Rate: 145.7 symbols/min [2025-09-30T22:16:54.946536] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:54.952472] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:54.953407] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22418 primary records. [2025-09-30T22:16:54.953695] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-30T22:16:54.970660] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-30T22:16:54.970908] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-30T22:16:54.973467] [INFO ] [MAIN ] Derivative Progress: 1843/2009 symbols completed. USAC took 1.2s. Estimated remaining: 1m 8s. Rate: 145.8 symbols/min [2025-09-30T22:16:55.027193] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-30T22:16:55.027360] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-30T22:16:55.156730] [DEBUG] [LOCAL ] USFD: Loaded 51183 existing records from primary storage. [2025-09-30T22:16:55.162627] [INFO ] [MAIN ] USFD: Loaded 51183 primary data records. [2025-09-30T22:16:55.730956] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:55.732050] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-30T22:16:55.732155] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-30T22:16:55.763909] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:55.765093] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51183 primary records. [2025-09-30T22:16:55.765382] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-30T22:16:55.765764] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-30T22:16:55.766136] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-30T22:16:55.769243] [INFO ] [MAIN ] Derivative Progress: 1844/2009 symbols completed. USB took 0.9s. Estimated remaining: 1m 8s. Rate: 145.7 symbols/min [2025-09-30T22:16:55.785155] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-30T22:16:55.785317] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-30T22:16:55.788068] [INFO ] [MAIN ] Derivative Progress: 1845/2009 symbols completed. USFD took 0.8s. Estimated remaining: 1m 7s. Rate: 145.8 symbols/min [2025-09-30T22:16:55.788557] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:55.788718] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:55.788808] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:55.827740] [DEBUG] [LOCAL ] USPH: Loaded 16572 existing records from primary storage. [2025-09-30T22:16:55.827256] [DEBUG] [LOCAL ] USNA: Loaded 17910 existing records from primary storage. [2025-09-30T22:16:55.827937] [INFO ] [MAIN ] USPH: Loaded 16572 primary data records. [2025-09-30T22:16:55.828255] [INFO ] [MAIN ] USNA: Loaded 17910 primary data records. [2025-09-30T22:16:56.034533] [DEBUG] [LOCAL ] UTF: Loaded 29075 existing records from primary storage. [2025-09-30T22:16:56.068129] [INFO ] [MAIN ] UTF: Loaded 29075 primary data records. [2025-09-30T22:16:56.895178] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:56.897049] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16572 primary records. [2025-09-30T22:16:56.898871] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-30T22:16:56.928363] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:56.931580] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17910 primary records. [2025-09-30T22:16:56.933524] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-30T22:16:56.933672] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-30T22:16:56.937398] [INFO ] [MAIN ] Derivative Progress: 1846/2009 symbols completed. USPH took 1.1s. Estimated remaining: 1m 7s. Rate: 145.7 symbols/min [2025-09-30T22:16:56.935234] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-30T22:16:56.937732] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:56.969003] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:56.969100] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-30T22:16:56.970100] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 29075 primary records. [2025-09-30T22:16:56.970173] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-30T22:16:56.969269] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-30T22:16:56.973409] [INFO ] [MAIN ] Derivative Progress: 1847/2009 symbols completed. USNA took 1.2s. Estimated remaining: 1m 7s. Rate: 145.7 symbols/min [2025-09-30T22:16:56.973719] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:56.991409] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-30T22:16:56.991670] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-30T22:16:56.994328] [INFO ] [MAIN ] Derivative Progress: 1848/2009 symbols completed. UTF took 1.2s. Estimated remaining: 1m 6s. Rate: 145.8 symbols/min [2025-09-30T22:16:56.994598] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:57.005974] [DEBUG] [LOCAL ] UTL: Loaded 11256 existing records from primary storage. [2025-09-30T22:16:57.006309] [INFO ] [MAIN ] UTL: Loaded 11256 primary data records. [2025-09-30T22:16:57.179051] [DEBUG] [LOCAL ] UTI: Loaded 40477 existing records from primary storage. [2025-09-30T22:16:57.213119] [INFO ] [MAIN ] UTI: Loaded 40477 primary data records. [2025-09-30T22:16:57.505800] [DEBUG] [LOCAL ] UTZ: Loaded 44723 existing records from primary storage. [2025-09-30T22:16:57.517540] [INFO ] [MAIN ] UTZ: Loaded 44723 primary data records. [2025-09-30T22:16:58.065872] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:16:58.067956] [INFO ] [MAIN ] UTL: Generated 1793 derivative records from 11256 primary records. [2025-09-30T22:16:58.068824] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-30T22:16:58.094943] [DEBUG] [LOCAL ] UTL: Derivative data saved (1793 records). [2025-09-30T22:16:58.096047] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-30T22:16:58.098684] [INFO ] [MAIN ] Derivative Progress: 1849/2009 symbols completed. UTL took 1.1s. Estimated remaining: 1m 6s. Rate: 145.7 symbols/min [2025-09-30T22:16:58.099157] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:58.113779] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:58.114564] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40477 primary records. [2025-09-30T22:16:58.114689] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-30T22:16:58.147074] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:58.154733] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44723 primary records. [2025-09-30T22:16:58.155115] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-30T22:16:58.155183] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-30T22:16:58.155341] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-30T22:16:58.158423] [INFO ] [MAIN ] Derivative Progress: 1850/2009 symbols completed. UTI took 1.2s. Estimated remaining: 1m 5s. Rate: 145.7 symbols/min [2025-09-30T22:16:58.159187] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:58.184379] [DEBUG] [LOCAL ] UVE: Loaded 21795 existing records from primary storage. [2025-09-30T22:16:58.185194] [INFO ] [MAIN ] UVE: Loaded 21795 primary data records. [2025-09-30T22:16:58.197993] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-30T22:16:58.198120] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-30T22:16:58.201062] [INFO ] [MAIN ] Derivative Progress: 1851/2009 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 5s. Rate: 145.8 symbols/min [2025-09-30T22:16:58.222758] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:58.314264] [DEBUG] [LOCAL ] UVV: Loaded 22456 existing records from primary storage. [2025-09-30T22:16:58.314788] [INFO ] [MAIN ] UVV: Loaded 22456 primary data records. [2025-09-30T22:16:58.890757] [DEBUG] [LOCAL ] UWMC: Loaded 52765 existing records from primary storage. [2025-09-30T22:16:58.891758] [INFO ] [MAIN ] UWMC: Loaded 52765 primary data records. [2025-09-30T22:16:59.281686] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:59.282881] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21795 primary records. [2025-09-30T22:16:59.283033] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-30T22:16:59.320893] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:59.322460] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-30T22:16:59.323295] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22456 primary records. [2025-09-30T22:16:59.323566] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-30T22:16:59.323665] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-30T22:16:59.326036] [INFO ] [MAIN ] Derivative Progress: 1852/2009 symbols completed. UVE took 1.2s. Estimated remaining: 1m 5s. Rate: 145.7 symbols/min [2025-09-30T22:16:59.326566] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:59.344344] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-30T22:16:59.346365] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-30T22:16:59.349248] [INFO ] [MAIN ] Derivative Progress: 1853/2009 symbols completed. UVV took 1.2s. Estimated remaining: 1m 4s. Rate: 145.7 symbols/min [2025-09-30T22:16:59.349725] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:16:59.356913] [DEBUG] [LOCAL ] UZD: Loaded 6448 existing records from primary storage. [2025-09-30T22:16:59.357249] [INFO ] [MAIN ] UZD: Loaded 6448 primary data records. [2025-09-30T22:16:59.433379] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:16:59.464283] [DEBUG] [LOCAL ] UZE: Loaded 7436 existing records from primary storage. [2025-09-30T22:16:59.464429] [INFO ] [MAIN ] UZE: Loaded 7436 primary data records. [2025-09-30T22:16:59.477197] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52765 primary records. [2025-09-30T22:16:59.485366] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-30T22:16:59.621908] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-30T22:16:59.660496] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-30T22:16:59.679775] [INFO ] [MAIN ] Derivative Progress: 1854/2009 symbols completed. UWMC took 1.5s. Estimated remaining: 1m 4s. Rate: 145.8 symbols/min [2025-09-30T22:16:59.849445] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:00.050024] [DEBUG] [LOCAL ] UZF: Loaded 6467 existing records from primary storage. [2025-09-30T22:17:00.051385] [INFO ] [MAIN ] UZF: Loaded 6467 primary data records. [2025-09-30T22:17:00.396279] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:00.398069] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6448 primary records. [2025-09-30T22:17:00.398420] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-30T22:17:00.431597] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:00.434018] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-09-30T22:17:00.433376] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7436 primary records. [2025-09-30T22:17:00.434219] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-30T22:17:00.434299] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-30T22:17:00.437662] [INFO ] [MAIN ] Derivative Progress: 1855/2009 symbols completed. UZD took 1.1s. Estimated remaining: 1m 3s. Rate: 145.7 symbols/min [2025-09-30T22:17:00.438825] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:00.456015] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-09-30T22:17:00.456325] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-30T22:17:00.459046] [INFO ] [MAIN ] Derivative Progress: 1856/2009 symbols completed. UZE took 1.1s. Estimated remaining: 1m 3s. Rate: 145.8 symbols/min [2025-09-30T22:17:00.459422] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:00.477090] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:00.477936] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6467 primary records. [2025-09-30T22:17:00.478146] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-30T22:17:00.494385] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-30T22:17:00.494529] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-30T22:17:00.497127] [INFO ] [MAIN ] Derivative Progress: 1857/2009 symbols completed. UZF took 0.6s. Estimated remaining: 1m 3s. Rate: 145.8 symbols/min [2025-09-30T22:17:00.497412] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:00.542554] [DEBUG] [LOCAL ] VAC: Loaded 34398 existing records from primary storage. [2025-09-30T22:17:00.559135] [INFO ] [MAIN ] VAC: Loaded 34398 primary data records. [2025-09-30T22:17:00.581878] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-09-30T22:17:00.632810] [INFO ] [MAIN ] V: Loaded 53755 primary data records. [2025-09-30T22:17:00.808697] [DEBUG] [LOCAL ] VAL: Loaded 50312 existing records from primary storage. [2025-09-30T22:17:00.814032] [INFO ] [MAIN ] VAL: Loaded 50312 primary data records. [2025-09-30T22:17:01.684458] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:01.698685] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34398 primary records. [2025-09-30T22:17:01.698796] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-30T22:17:01.697870] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:01.700187] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53755 primary records. [2025-09-30T22:17:01.700504] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-30T22:17:01.734498] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-30T22:17:01.745164] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-30T22:17:01.754546] [INFO ] [MAIN ] Derivative Progress: 1858/2009 symbols completed. VAC took 1.3s. Estimated remaining: 1m 2s. Rate: 145.7 symbols/min [2025-09-30T22:17:01.751978] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:01.755630] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50312 primary records. [2025-09-30T22:17:01.755803] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-30T22:17:01.755919] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-30T22:17:01.755981] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-30T22:17:01.758597] [INFO ] [MAIN ] Derivative Progress: 1859/2009 symbols completed. V took 1.3s. Estimated remaining: 1m 2s. Rate: 145.8 symbols/min [2025-09-30T22:17:01.776253] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-30T22:17:01.776379] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-30T22:17:01.779529] [INFO ] [MAIN ] Derivative Progress: 1860/2009 symbols completed. VAL took 1.3s. Estimated remaining: 1m 1s. Rate: 145.8 symbols/min [2025-09-30T22:17:01.780146] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:01.780247] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:01.780360] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:01.791432] [DEBUG] [LOCAL ] VATE: Loaded 5321 existing records from primary storage. [2025-09-30T22:17:01.794807] [DEBUG] [LOCAL ] VBF: Loaded 6945 existing records from primary storage. [2025-09-30T22:17:01.794568] [INFO ] [MAIN ] VATE: Loaded 5321 primary data records. [2025-09-30T22:17:01.806479] [INFO ] [MAIN ] VBF: Loaded 6945 primary data records. [2025-09-30T22:17:02.492421] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-30T22:17:02.493874] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-30T22:17:02.855691] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:02.857337] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5321 primary records. [2025-09-30T22:17:02.857750] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-30T22:17:02.888811] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:02.891216] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6945 primary records. [2025-09-30T22:17:02.893787] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-30T22:17:02.894052] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-30T22:17:02.893864] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-30T22:17:02.896760] [INFO ] [MAIN ] Derivative Progress: 1861/2009 symbols completed. VATE took 1.1s. Estimated remaining: 1m 1s. Rate: 145.7 symbols/min [2025-09-30T22:17:02.898187] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:02.925414] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-30T22:17:02.925662] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-30T22:17:02.928406] [INFO ] [MAIN ] Derivative Progress: 1862/2009 symbols completed. VBF took 1.1s. Estimated remaining: 1m 1s. Rate: 145.8 symbols/min [2025-09-30T22:17:02.928848] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:02.937511] [DEBUG] [LOCAL ] VCV: Loaded 13695 existing records from primary storage. [2025-09-30T22:17:02.939414] [INFO ] [MAIN ] VCV: Loaded 13695 primary data records. [2025-09-30T22:17:03.012747] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:03.027991] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-30T22:17:03.028207] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-30T22:17:03.345568] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-30T22:17:03.345759] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-30T22:17:03.348774] [INFO ] [MAIN ] Derivative Progress: 1863/2009 symbols completed. VALE took 1.6s. Estimated remaining: 1m 0s. Rate: 145.8 symbols/min [2025-09-30T22:17:03.350101] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:03.367839] [DEBUG] [LOCAL ] VEEV: Loaded 47070 existing records from primary storage. [2025-09-30T22:17:03.368285] [INFO ] [MAIN ] VEEV: Loaded 47070 primary data records. [2025-09-30T22:17:03.524463] [DEBUG] [LOCAL ] VEL: Loaded 12826 existing records from primary storage. [2025-09-30T22:17:03.540711] [INFO ] [MAIN ] VEL: Loaded 12826 primary data records. [2025-09-30T22:17:03.897209] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:03.938351] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13695 primary records. [2025-09-30T22:17:03.959407] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-30T22:17:04.100222] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-30T22:17:04.100727] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-30T22:17:04.104008] [INFO ] [MAIN ] Derivative Progress: 1864/2009 symbols completed. VCV took 1.2s. Estimated remaining: 59.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:04.104569] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:04.124743] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:04.125451] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47070 primary records. [2025-09-30T22:17:04.125665] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-30T22:17:04.144593] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-30T22:17:04.146358] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-30T22:17:04.148662] [INFO ] [MAIN ] Derivative Progress: 1865/2009 symbols completed. VEEV took 1.2s. Estimated remaining: 59.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:04.148853] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:04.163018] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:04.163743] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12826 primary records. [2025-09-30T22:17:04.163904] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-30T22:17:04.192272] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-09-30T22:17:04.204997] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-30T22:17:04.208035] [INFO ] [MAIN ] Derivative Progress: 1866/2009 symbols completed. VEL took 0.9s. Estimated remaining: 58.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:04.208233] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:04.209797] [DEBUG] [LOCAL ] VET: Loaded 43932 existing records from primary storage. [2025-09-30T22:17:04.210064] [INFO ] [MAIN ] VET: Loaded 43932 primary data records. [2025-09-30T22:17:04.341561] [DEBUG] [LOCAL ] VGI: Loaded 5138 existing records from primary storage. [2025-09-30T22:17:04.341776] [INFO ] [MAIN ] VGI: Loaded 5138 primary data records. [2025-09-30T22:17:04.531665] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-09-30T22:17:04.680538] [INFO ] [MAIN ] VFC: Loaded 53611 primary data records. [2025-09-30T22:17:05.251447] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:05.252511] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 43932 primary records. [2025-09-30T22:17:05.253874] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-30T22:17:05.284152] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:05.285936] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5138 primary records. [2025-09-30T22:17:05.286679] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-30T22:17:05.288791] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-30T22:17:05.289040] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-30T22:17:05.291693] [INFO ] [MAIN ] Derivative Progress: 1867/2009 symbols completed. VET took 1.2s. Estimated remaining: 58.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:05.292215] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:05.308475] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-30T22:17:05.309639] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-30T22:17:05.313502] [INFO ] [MAIN ] Derivative Progress: 1868/2009 symbols completed. VGI took 1.1s. Estimated remaining: 58.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:05.314854] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:05.333444] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:05.335135] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53611 primary records. [2025-09-30T22:17:05.335388] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-30T22:17:05.338710] [DEBUG] [LOCAL ] VHI: Loaded 2768 existing records from primary storage. [2025-09-30T22:17:05.356095] [INFO ] [MAIN ] VHI: Loaded 2768 primary data records. [2025-09-30T22:17:05.356478] [DEBUG] [LOCAL ] VGM: Loaded 18249 existing records from primary storage. [2025-09-30T22:17:05.378275] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-30T22:17:05.387314] [INFO ] [MAIN ] VGM: Loaded 18249 primary data records. [2025-09-30T22:17:05.387472] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-30T22:17:05.395158] [INFO ] [MAIN ] Derivative Progress: 1869/2009 symbols completed. VFC took 1.2s. Estimated remaining: 57.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:05.452699] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:06.079751] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-09-30T22:17:06.080605] [INFO ] [MAIN ] VICI: Loaded 53647 primary data records. [2025-09-30T22:17:06.249117] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7826 incomplete bins [2025-09-30T22:17:06.319088] [INFO ] [MAIN ] VHI: Generated 1788 derivative records from 2768 primary records. [2025-09-30T22:17:06.428544] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-30T22:17:06.428462] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:06.442976] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18249 primary records. [2025-09-30T22:17:06.443686] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-30T22:17:06.477376] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-30T22:17:06.479586] [DEBUG] [LOCAL ] VHI: Derivative data saved (1788 records). [2025-09-30T22:17:06.479985] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-30T22:17:06.483226] [INFO ] [MAIN ] Derivative Progress: 1870/2009 symbols completed. VGM took 1.2s. Estimated remaining: 57.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:06.483447] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-30T22:17:06.483576] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:06.486686] [INFO ] [MAIN ] Derivative Progress: 1871/2009 symbols completed. VHI took 1.2s. Estimated remaining: 56.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:06.487383] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:06.512456] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:06.513452] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53647 primary records. [2025-09-30T22:17:06.513614] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-30T22:17:06.540806] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-30T22:17:06.541024] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-30T22:17:06.543505] [INFO ] [MAIN ] Derivative Progress: 1872/2009 symbols completed. VICI took 1.1s. Estimated remaining: 56.4s. Rate: 145.9 symbols/min [2025-09-30T22:17:06.543844] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:06.614833] [DEBUG] [LOCAL ] VIK: Loaded 52483 existing records from primary storage. [2025-09-30T22:17:06.615787] [DEBUG] [LOCAL ] VIPS: Loaded 51330 existing records from primary storage. [2025-09-30T22:17:06.615984] [INFO ] [MAIN ] VIPS: Loaded 51330 primary data records. [2025-09-30T22:17:06.616163] [INFO ] [MAIN ] VIK: Loaded 52483 primary data records. [2025-09-30T22:17:06.884340] [DEBUG] [LOCAL ] VIRT: Loaded 46656 existing records from primary storage. [2025-09-30T22:17:06.930766] [INFO ] [MAIN ] VIRT: Loaded 46656 primary data records. [2025-09-30T22:17:07.739525] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:07.740209] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:07.741989] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51330 primary records. [2025-09-30T22:17:07.743005] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52483 primary records. [2025-09-30T22:17:07.743308] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-30T22:17:07.743549] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-30T22:17:07.777932] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-30T22:17:07.781099] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-30T22:17:07.783558] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-30T22:17:07.786481] [INFO ] [MAIN ] Derivative Progress: 1873/2009 symbols completed. VIPS took 1.3s. Estimated remaining: 56.0s. Rate: 145.7 symbols/min [2025-09-30T22:17:07.787104] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-30T22:17:07.790858] [INFO ] [MAIN ] Derivative Progress: 1874/2009 symbols completed. VIK took 1.3s. Estimated remaining: 55.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:07.803771] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:07.804421] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46656 primary records. [2025-09-30T22:17:07.804484] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-30T22:17:07.819849] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-30T22:17:07.819928] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-30T22:17:07.822703] [INFO ] [MAIN ] Derivative Progress: 1875/2009 symbols completed. VIRT took 1.3s. Estimated remaining: 55.1s. Rate: 145.9 symbols/min [2025-09-30T22:17:07.823258] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:07.823342] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:07.823553] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:07.850999] [DEBUG] [LOCAL ] VKQ: Loaded 17592 existing records from primary storage. [2025-09-30T22:17:07.851266] [INFO ] [MAIN ] VKQ: Loaded 17592 primary data records. [2025-09-30T22:17:08.024165] [DEBUG] [LOCAL ] VIV: Loaded 45002 existing records from primary storage. [2025-09-30T22:17:08.069050] [INFO ] [MAIN ] VIV: Loaded 45002 primary data records. [2025-09-30T22:17:08.123869] [DEBUG] [LOCAL ] VIST: Loaded 45959 existing records from primary storage. [2025-09-30T22:17:08.300494] [INFO ] [MAIN ] VIST: Loaded 45959 primary data records. [2025-09-30T22:17:08.934838] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:08.936048] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17592 primary records. [2025-09-30T22:17:08.936335] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-30T22:17:08.961709] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-30T22:17:08.961912] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-30T22:17:08.964278] [INFO ] [MAIN ] Derivative Progress: 1876/2009 symbols completed. VKQ took 1.1s. Estimated remaining: 54.8s. Rate: 145.7 symbols/min [2025-09-30T22:17:08.972625] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:08.978952] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:08.979990] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45002 primary records. [2025-09-30T22:17:08.982346] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-30T22:17:09.016160] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:09.018269] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-30T22:17:09.019220] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45959 primary records. [2025-09-30T22:17:09.019344] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-30T22:17:09.020277] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-30T22:17:09.022925] [INFO ] [MAIN ] Derivative Progress: 1877/2009 symbols completed. VIV took 1.2s. Estimated remaining: 54.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:09.023126] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:09.042470] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-30T22:17:09.051569] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-30T22:17:09.054444] [INFO ] [MAIN ] Derivative Progress: 1878/2009 symbols completed. VIST took 1.2s. Estimated remaining: 53.9s. Rate: 145.9 symbols/min [2025-09-30T22:17:09.054842] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:09.070917] [DEBUG] [LOCAL ] VLN: Loaded 28918 existing records from primary storage. [2025-09-30T22:17:09.071289] [INFO ] [MAIN ] VLN: Loaded 28918 primary data records. [2025-09-30T22:17:09.372000] [DEBUG] [LOCAL ] VLRS: Loaded 40400 existing records from primary storage. [2025-09-30T22:17:09.372318] [INFO ] [MAIN ] VLRS: Loaded 40400 primary data records. [2025-09-30T22:17:09.472393] [DEBUG] [LOCAL ] VLO: Loaded 53077 existing records from primary storage. [2025-09-30T22:17:09.582876] [INFO ] [MAIN ] VLO: Loaded 53077 primary data records. [2025-09-30T22:17:10.491045] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:10.492045] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28918 primary records. [2025-09-30T22:17:10.492282] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-30T22:17:10.516186] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-30T22:17:10.517031] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-30T22:17:10.519187] [INFO ] [MAIN ] Derivative Progress: 1879/2009 symbols completed. VLN took 1.5s. Estimated remaining: 53.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:10.519995] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:10.531050] [DEBUG] [LOCAL ] VLT: Loaded 4554 existing records from primary storage. [2025-09-30T22:17:10.531595] [INFO ] [MAIN ] VLT: Loaded 4554 primary data records. [2025-09-30T22:17:10.662319] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:10.673996] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53077 primary records. [2025-09-30T22:17:10.702442] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:10.697041] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-30T22:17:10.761225] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40400 primary records. [2025-09-30T22:17:10.761549] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-30T22:17:10.915129] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-30T22:17:10.916054] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-30T22:17:10.918852] [INFO ] [MAIN ] Derivative Progress: 1880/2009 symbols completed. VLO took 1.9s. Estimated remaining: 53.1s. Rate: 145.7 symbols/min [2025-09-30T22:17:10.919553] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:10.926711] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-30T22:17:10.927077] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-30T22:17:10.929918] [INFO ] [MAIN ] Derivative Progress: 1881/2009 symbols completed. VLRS took 1.9s. Estimated remaining: 52.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:10.930310] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:10.953946] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:10.954827] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4554 primary records. [2025-09-30T22:17:10.954976] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-30T22:17:10.991793] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-30T22:17:10.991968] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-30T22:17:10.994193] [INFO ] [MAIN ] Derivative Progress: 1882/2009 symbols completed. VLT took 0.5s. Estimated remaining: 52.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:10.994541] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:11.028710] [DEBUG] [LOCAL ] VLTO: Loaded 45995 existing records from primary storage. [2025-09-30T22:17:11.030164] [INFO ] [MAIN ] VLTO: Loaded 45995 primary data records. [2025-09-30T22:17:11.030904] [DEBUG] [LOCAL ] VMC: Loaded 43331 existing records from primary storage. [2025-09-30T22:17:11.076772] [INFO ] [MAIN ] VMC: Loaded 43331 primary data records. [2025-09-30T22:17:11.243464] [DEBUG] [LOCAL ] VMI: Loaded 15382 existing records from primary storage. [2025-09-30T22:17:11.272396] [INFO ] [MAIN ] VMI: Loaded 15382 primary data records. [2025-09-30T22:17:12.122215] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:12.123105] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 45995 primary records. [2025-09-30T22:17:12.123314] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-30T22:17:12.166093] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-30T22:17:12.166921] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-30T22:17:12.166444] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:12.170956] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43331 primary records. [2025-09-30T22:17:12.169936] [INFO ] [MAIN ] Derivative Progress: 1883/2009 symbols completed. VLTO took 1.3s. Estimated remaining: 51.9s. Rate: 145.7 symbols/min [2025-09-30T22:17:12.171280] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:12.171694] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-30T22:17:12.204043] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:17:12.206115] [INFO ] [MAIN ] VMI: Generated 1793 derivative records from 15382 primary records. [2025-09-30T22:17:12.206787] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-30T22:17:12.206202] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-30T22:17:12.207703] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-30T22:17:12.210327] [INFO ] [MAIN ] Derivative Progress: 1884/2009 symbols completed. VMC took 1.3s. Estimated remaining: 51.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:12.219025] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:12.233499] [DEBUG] [LOCAL ] VMI: Derivative data saved (1793 records). [2025-09-30T22:17:12.233597] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-30T22:17:12.236385] [INFO ] [MAIN ] Derivative Progress: 1885/2009 symbols completed. VMI took 1.2s. Estimated remaining: 51.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:12.238859] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:12.251728] [DEBUG] [LOCAL ] VNCE: Loaded 7820 existing records from primary storage. [2025-09-30T22:17:12.251885] [INFO ] [MAIN ] VNCE: Loaded 7820 primary data records. [2025-09-30T22:17:12.264881] [DEBUG] [LOCAL ] VMO: Loaded 21036 existing records from primary storage. [2025-09-30T22:17:12.275630] [INFO ] [MAIN ] VMO: Loaded 21036 primary data records. [2025-09-30T22:17:12.935676] [DEBUG] [LOCAL ] VNO: Loaded 48866 existing records from primary storage. [2025-09-30T22:17:12.936031] [INFO ] [MAIN ] VNO: Loaded 48866 primary data records. [2025-09-30T22:17:13.291784] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:13.306373] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:13.305981] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 7820 primary records. [2025-09-30T22:17:13.306526] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-30T22:17:13.307604] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21036 primary records. [2025-09-30T22:17:13.307841] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-30T22:17:13.341772] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-30T22:17:13.340480] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-30T22:17:13.342131] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-30T22:17:13.344533] [INFO ] [MAIN ] Derivative Progress: 1886/2009 symbols completed. VNCE took 1.1s. Estimated remaining: 50.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:13.342044] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-30T22:17:13.347750] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:13.347944] [INFO ] [MAIN ] Derivative Progress: 1887/2009 symbols completed. VMO took 1.2s. Estimated remaining: 50.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:13.348625] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:13.373188] [DEBUG] [LOCAL ] VOC: Loaded 8915 existing records from primary storage. [2025-09-30T22:17:13.372920] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:13.373571] [INFO ] [MAIN ] VOC: Loaded 8915 primary data records. [2025-09-30T22:17:13.406597] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48866 primary records. [2025-09-30T22:17:13.419344] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-30T22:17:13.501308] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-30T22:17:13.501631] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-30T22:17:13.509993] [INFO ] [MAIN ] Derivative Progress: 1888/2009 symbols completed. VNO took 1.3s. Estimated remaining: 49.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:13.738499] [DEBUG] [LOCAL ] VNT: Loaded 43548 existing records from primary storage. [2025-09-30T22:17:13.738706] [INFO ] [MAIN ] VNT: Loaded 43548 primary data records. [2025-09-30T22:17:14.080848] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:14.081964] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8915 primary records. [2025-09-30T22:17:14.082213] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-30T22:17:14.102136] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-30T22:17:14.102526] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-30T22:17:14.105117] [INFO ] [MAIN ] Derivative Progress: 1889/2009 symbols completed. VOC took 0.8s. Estimated remaining: 49.4s. Rate: 145.8 symbols/min [2025-09-30T22:17:14.120764] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:14.121475] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43548 primary records. [2025-09-30T22:17:14.121540] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-30T22:17:14.137360] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-30T22:17:14.137436] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-30T22:17:14.139795] [INFO ] [MAIN ] Derivative Progress: 1890/2009 symbols completed. VNT took 0.8s. Estimated remaining: 49.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:14.140444] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:14.140632] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:14.140357] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:14.149196] [DEBUG] [LOCAL ] VPV: Loaded 5428 existing records from primary storage. [2025-09-30T22:17:14.149336] [INFO ] [MAIN ] VPV: Loaded 5428 primary data records. [2025-09-30T22:17:14.266637] [DEBUG] [LOCAL ] VPG: Loaded 17041 existing records from primary storage. [2025-09-30T22:17:14.270615] [INFO ] [MAIN ] VPG: Loaded 17041 primary data records. [2025-09-30T22:17:14.749130] [DEBUG] [LOCAL ] VOYA: Loaded 42561 existing records from primary storage. [2025-09-30T22:17:14.876399] [INFO ] [MAIN ] VOYA: Loaded 42561 primary data records. [2025-09-30T22:17:15.223268] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-30T22:17:15.224810] [INFO ] [MAIN ] VPV: Generated 1792 derivative records from 5428 primary records. [2025-09-30T22:17:15.225125] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-30T22:17:15.246794] [DEBUG] [LOCAL ] VPV: Derivative data saved (1792 records). [2025-09-30T22:17:15.247320] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-30T22:17:15.263691] [INFO ] [MAIN ] Derivative Progress: 1891/2009 symbols completed. VPV took 1.1s. Estimated remaining: 48.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:15.261316] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:15.265472] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17041 primary records. [2025-09-30T22:17:15.264188] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:15.265720] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-30T22:17:15.288414] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-30T22:17:15.288828] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-30T22:17:15.291591] [INFO ] [MAIN ] Derivative Progress: 1892/2009 symbols completed. VPG took 1.2s. Estimated remaining: 48.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:15.300875] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:15.307155] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:15.307897] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42561 primary records. [2025-09-30T22:17:15.308155] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-30T22:17:15.333984] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-30T22:17:15.334118] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-30T22:17:15.336796] [INFO ] [MAIN ] Derivative Progress: 1893/2009 symbols completed. VOYA took 1.2s. Estimated remaining: 47.7s. Rate: 145.8 symbols/min [2025-09-30T22:17:15.337086] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:15.357930] [DEBUG] [LOCAL ] VRE: Loaded 34907 existing records from primary storage. [2025-09-30T22:17:15.358146] [INFO ] [MAIN ] VRE: Loaded 34907 primary data records. [2025-09-30T22:17:15.403152] [DEBUG] [LOCAL ] VRTS: Loaded 9286 existing records from primary storage. [2025-09-30T22:17:15.415667] [INFO ] [MAIN ] VRTS: Loaded 9286 primary data records. [2025-09-30T22:17:16.042690] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-30T22:17:16.043169] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-30T22:17:16.446951] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:16.448956] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34907 primary records. [2025-09-30T22:17:16.451805] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-30T22:17:16.484983] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-30T22:17:16.481078] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:16.485979] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9286 primary records. [2025-09-30T22:17:16.486419] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-30T22:17:16.486343] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-30T22:17:16.490119] [INFO ] [MAIN ] Derivative Progress: 1894/2009 symbols completed. VRE took 1.2s. Estimated remaining: 47.4s. Rate: 145.7 symbols/min [2025-09-30T22:17:16.491013] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:16.509672] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-09-30T22:17:16.509816] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-30T22:17:16.513664] [INFO ] [MAIN ] Derivative Progress: 1895/2009 symbols completed. VRTS took 1.2s. Estimated remaining: 46.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:16.513975] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:16.529323] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:16.530087] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-30T22:17:16.530224] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-30T22:17:16.548518] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-30T22:17:16.548695] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-30T22:17:16.551381] [INFO ] [MAIN ] Derivative Progress: 1896/2009 symbols completed. VRT took 1.3s. Estimated remaining: 46.5s. Rate: 145.8 symbols/min [2025-09-30T22:17:16.551558] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:16.600354] [DEBUG] [LOCAL ] VSCO: Loaded 52767 existing records from primary storage. [2025-09-30T22:17:16.601198] [INFO ] [MAIN ] VSCO: Loaded 52767 primary data records. [2025-09-30T22:17:16.708138] [DEBUG] [LOCAL ] VSH: Loaded 48382 existing records from primary storage. [2025-09-30T22:17:16.727739] [INFO ] [MAIN ] VSH: Loaded 48382 primary data records. [2025-09-30T22:17:17.190676] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-09-30T22:17:17.315251] [INFO ] [MAIN ] VST: Loaded 53718 primary data records. [2025-09-30T22:17:17.686948] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:17.688881] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52767 primary records. [2025-09-30T22:17:17.689314] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-30T22:17:17.713199] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-30T22:17:17.713558] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-30T22:17:17.730291] [INFO ] [MAIN ] Derivative Progress: 1897/2009 symbols completed. VSCO took 1.2s. Estimated remaining: 46.1s. Rate: 145.7 symbols/min [2025-09-30T22:17:17.731489] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:17.731332] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:17.733804] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48382 primary records. [2025-09-30T22:17:17.734222] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-30T22:17:17.769905] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-30T22:17:17.769472] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:17.770046] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-30T22:17:17.770763] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53718 primary records. [2025-09-30T22:17:17.773979] [INFO ] [MAIN ] Derivative Progress: 1898/2009 symbols completed. VSH took 1.3s. Estimated remaining: 45.7s. Rate: 145.8 symbols/min [2025-09-30T22:17:17.770853] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-30T22:17:17.775088] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:17.796807] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-30T22:17:17.809119] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-30T22:17:17.812511] [INFO ] [MAIN ] Derivative Progress: 1899/2009 symbols completed. VST took 1.3s. Estimated remaining: 45.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:17.812990] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:17.853538] [DEBUG] [LOCAL ] VSTS: Loaded 49011 existing records from primary storage. [2025-09-30T22:17:17.853928] [INFO ] [MAIN ] VSTS: Loaded 49011 primary data records. [2025-09-30T22:17:18.005416] [DEBUG] [LOCAL ] VTEX: Loaded 43294 existing records from primary storage. [2025-09-30T22:17:18.005986] [INFO ] [MAIN ] VTEX: Loaded 43294 primary data records. [2025-09-30T22:17:18.343110] [DEBUG] [LOCAL ] VTLE: Loaded 48502 existing records from primary storage. [2025-09-30T22:17:18.349056] [INFO ] [MAIN ] VTLE: Loaded 48502 primary data records. [2025-09-30T22:17:18.984334] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:18.985518] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49011 primary records. [2025-09-30T22:17:18.985836] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-30T22:17:19.019877] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:19.020627] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-30T22:17:19.021402] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-30T22:17:19.024979] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43294 primary records. [2025-09-30T22:17:19.024113] [INFO ] [MAIN ] Derivative Progress: 1900/2009 symbols completed. VSTS took 1.3s. Estimated remaining: 44.9s. Rate: 145.7 symbols/min [2025-09-30T22:17:19.025470] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-30T22:17:19.026606] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:19.054366] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:19.056460] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48502 primary records. [2025-09-30T22:17:19.059752] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-30T22:17:19.064687] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-30T22:17:19.067306] [INFO ] [MAIN ] Derivative Progress: 1901/2009 symbols completed. VTEX took 1.3s. Estimated remaining: 44.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:19.064592] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-30T22:17:19.067531] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:19.089314] [DEBUG] [LOCAL ] VTMX: Loaded 17513 existing records from primary storage. [2025-09-30T22:17:19.092231] [INFO ] [MAIN ] VTMX: Loaded 17513 primary data records. [2025-09-30T22:17:19.145313] [DEBUG] [LOCAL ] VTN: Loaded 7051 existing records from primary storage. [2025-09-30T22:17:19.151462] [INFO ] [MAIN ] VTN: Loaded 7051 primary data records. [2025-09-30T22:17:19.173015] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-30T22:17:19.204997] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-30T22:17:19.240477] [INFO ] [MAIN ] Derivative Progress: 1902/2009 symbols completed. VTLE took 1.4s. Estimated remaining: 44.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:19.291394] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:19.777726] [DEBUG] [LOCAL ] VTOL: Loaded 19562 existing records from primary storage. [2025-09-30T22:17:19.778714] [INFO ] [MAIN ] VTOL: Loaded 19562 primary data records. [2025-09-30T22:17:20.142692] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:20.143616] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17513 primary records. [2025-09-30T22:17:20.143882] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-30T22:17:20.167085] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:20.172442] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7051 primary records. [2025-09-30T22:17:20.173521] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-30T22:17:20.191528] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-30T22:17:20.193318] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-30T22:17:20.196637] [INFO ] [MAIN ] Derivative Progress: 1903/2009 symbols completed. VTMX took 1.2s. Estimated remaining: 43.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:20.199836] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-30T22:17:20.200174] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-30T22:17:20.202900] [INFO ] [MAIN ] Derivative Progress: 1904/2009 symbols completed. VTN took 1.1s. Estimated remaining: 43.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:20.218494] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:20.219199] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19562 primary records. [2025-09-30T22:17:20.219267] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-30T22:17:20.235389] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-30T22:17:20.235534] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-30T22:17:20.238051] [INFO ] [MAIN ] Derivative Progress: 1905/2009 symbols completed. VTOL took 0.9s. Estimated remaining: 42.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:20.238697] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:20.238535] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:20.238836] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:20.290498] [DEBUG] [LOCAL ] VTS: Loaded 30509 existing records from primary storage. [2025-09-30T22:17:20.290796] [INFO ] [MAIN ] VTS: Loaded 30509 primary data records. [2025-09-30T22:17:20.291448] [DEBUG] [LOCAL ] VVR: Loaded 31144 existing records from primary storage. [2025-09-30T22:17:20.353686] [INFO ] [MAIN ] VVR: Loaded 31144 primary data records. [2025-09-30T22:17:20.563239] [DEBUG] [LOCAL ] VTR: Loaded 52816 existing records from primary storage. [2025-09-30T22:17:20.582225] [INFO ] [MAIN ] VTR: Loaded 52816 primary data records. [2025-09-30T22:17:21.381913] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:21.383249] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30509 primary records. [2025-09-30T22:17:21.383866] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-30T22:17:21.429490] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-30T22:17:21.431272] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-30T22:17:21.433755] [INFO ] [MAIN ] Derivative Progress: 1906/2009 symbols completed. VTS took 1.2s. Estimated remaining: 42.4s. Rate: 145.7 symbols/min [2025-09-30T22:17:21.434176] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:21.443194] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:21.449751] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31144 primary records. [2025-09-30T22:17:21.449992] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-30T22:17:21.451547] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:21.452681] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52816 primary records. [2025-09-30T22:17:21.463708] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-30T22:17:21.492662] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-30T22:17:21.495730] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-30T22:17:21.496156] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-30T22:17:21.500141] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-30T22:17:21.499981] [INFO ] [MAIN ] Derivative Progress: 1907/2009 symbols completed. VVR took 1.3s. Estimated remaining: 42.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:21.503363] [INFO ] [MAIN ] Derivative Progress: 1908/2009 symbols completed. VTR took 1.3s. Estimated remaining: 41.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:21.503611] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:21.503276] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:21.547879] [DEBUG] [LOCAL ] VVV: Loaded 50177 existing records from primary storage. [2025-09-30T22:17:21.548095] [INFO ] [MAIN ] VVV: Loaded 50177 primary data records. [2025-09-30T22:17:21.648961] [DEBUG] [LOCAL ] VVX: Loaded 23117 existing records from primary storage. [2025-09-30T22:17:21.660978] [INFO ] [MAIN ] VVX: Loaded 23117 primary data records. [2025-09-30T22:17:21.787357] [DEBUG] [LOCAL ] VYX: Loaded 48784 existing records from primary storage. [2025-09-30T22:17:21.807551] [INFO ] [MAIN ] VYX: Loaded 48784 primary data records. [2025-09-30T22:17:22.608983] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:22.610163] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50177 primary records. [2025-09-30T22:17:22.610307] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-30T22:17:22.646098] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-30T22:17:22.646421] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-30T22:17:22.648829] [INFO ] [MAIN ] Derivative Progress: 1909/2009 symbols completed. VVV took 1.2s. Estimated remaining: 41.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:22.648985] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:22.649507] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:22.650575] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23117 primary records. [2025-09-30T22:17:22.659116] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-30T22:17:22.665941] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:22.677402] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48784 primary records. [2025-09-30T22:17:22.680944] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-30T22:17:22.701673] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-30T22:17:22.705019] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-30T22:17:22.707830] [INFO ] [MAIN ] Derivative Progress: 1910/2009 symbols completed. VVX took 1.2s. Estimated remaining: 40.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:22.708047] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:22.705126] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-30T22:17:22.708738] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-30T22:17:22.711663] [INFO ] [MAIN ] Derivative Progress: 1911/2009 symbols completed. VYX took 1.2s. Estimated remaining: 40.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:22.711964] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:22.771333] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-30T22:17:22.771599] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-30T22:17:22.924443] [DEBUG] [LOCAL ] WAB: Loaded 44146 existing records from primary storage. [2025-09-30T22:17:22.936147] [DEBUG] [LOCAL ] W: Loaded 53485 existing records from primary storage. [2025-09-30T22:17:22.946626] [INFO ] [MAIN ] WAB: Loaded 44146 primary data records. [2025-09-30T22:17:22.951918] [INFO ] [MAIN ] W: Loaded 53485 primary data records. [2025-09-30T22:17:23.875720] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:23.876775] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-30T22:17:23.877047] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-30T22:17:23.913385] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-30T22:17:23.915402] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-30T22:17:23.918030] [INFO ] [MAIN ] Derivative Progress: 1912/2009 symbols completed. VZ took 1.3s. Estimated remaining: 39.9s. Rate: 145.7 symbols/min [2025-09-30T22:17:23.915732] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:23.918360] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:23.919300] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44146 primary records. [2025-09-30T22:17:23.919402] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-30T22:17:23.934809] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:23.946602] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53485 primary records. [2025-09-30T22:17:23.947435] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-30T22:17:23.968047] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-30T22:17:23.968731] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-30T22:17:23.972532] [INFO ] [MAIN ] Derivative Progress: 1913/2009 symbols completed. WAB took 1.3s. Estimated remaining: 39.5s. Rate: 145.8 symbols/min [2025-09-30T22:17:23.973533] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:23.974133] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-30T22:17:23.974768] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-30T22:17:23.977799] [INFO ] [MAIN ] Derivative Progress: 1914/2009 symbols completed. W took 1.3s. Estimated remaining: 39.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:23.978162] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:24.021609] [DEBUG] [LOCAL ] WAL: Loaded 45236 existing records from primary storage. [2025-09-30T22:17:24.021927] [INFO ] [MAIN ] WAL: Loaded 45236 primary data records. [2025-09-30T22:17:24.251416] [DEBUG] [LOCAL ] WBS: Loaded 48701 existing records from primary storage. [2025-09-30T22:17:24.267622] [INFO ] [MAIN ] WBS: Loaded 48701 primary data records. [2025-09-30T22:17:24.252708] [DEBUG] [LOCAL ] WAT: Loaded 35132 existing records from primary storage. [2025-09-30T22:17:24.274758] [INFO ] [MAIN ] WAT: Loaded 35132 primary data records. [2025-09-30T22:17:25.169097] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:25.170726] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45236 primary records. [2025-09-30T22:17:25.171074] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-30T22:17:25.196463] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-30T22:17:25.196708] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-30T22:17:25.198974] [INFO ] [MAIN ] Derivative Progress: 1915/2009 symbols completed. WAL took 1.3s. Estimated remaining: 38.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:25.212432] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:25.225704] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:25.226058] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:25.227173] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48701 primary records. [2025-09-30T22:17:25.228122] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35132 primary records. [2025-09-30T22:17:25.228336] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-30T22:17:25.228855] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-30T22:17:25.261209] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-30T22:17:25.268887] [DEBUG] [LOCAL ] WBX: Loaded 11669 existing records from primary storage. [2025-09-30T22:17:25.269697] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-30T22:17:25.269567] [INFO ] [MAIN ] WBX: Loaded 11669 primary data records. [2025-09-30T22:17:25.274024] [INFO ] [MAIN ] Derivative Progress: 1916/2009 symbols completed. WAT took 1.3s. Estimated remaining: 38.3s. Rate: 145.7 symbols/min [2025-09-30T22:17:25.274424] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:25.287971] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-30T22:17:25.288198] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-30T22:17:25.295133] [INFO ] [MAIN ] Derivative Progress: 1917/2009 symbols completed. WBS took 1.3s. Estimated remaining: 37.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:25.307078] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:25.662399] [DEBUG] [LOCAL ] WCC: Loaded 39644 existing records from primary storage. [2025-09-30T22:17:25.663042] [INFO ] [MAIN ] WCC: Loaded 39644 primary data records. [2025-09-30T22:17:25.799369] [DEBUG] [LOCAL ] WCN: Loaded 47935 existing records from primary storage. [2025-09-30T22:17:25.805631] [INFO ] [MAIN ] WCN: Loaded 47935 primary data records. [2025-09-30T22:17:26.192252] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:26.219268] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11669 primary records. [2025-09-30T22:17:26.224502] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-30T22:17:26.426247] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-30T22:17:26.427338] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-30T22:17:26.429683] [INFO ] [MAIN ] Derivative Progress: 1918/2009 symbols completed. WBX took 1.2s. Estimated remaining: 37.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:26.443184] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:26.445152] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39644 primary records. [2025-09-30T22:17:26.445255] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-30T22:17:26.462350] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-30T22:17:26.462474] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-30T22:17:26.464501] [INFO ] [MAIN ] Derivative Progress: 1919/2009 symbols completed. WCC took 1.2s. Estimated remaining: 37.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:26.481063] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:26.481739] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47935 primary records. [2025-09-30T22:17:26.481809] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-30T22:17:26.497706] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-30T22:17:26.497774] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-30T22:17:26.501112] [INFO ] [MAIN ] Derivative Progress: 1920/2009 symbols completed. WCN took 1.2s. Estimated remaining: 36.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:26.501516] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:26.501625] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:26.501719] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:26.525882] [DEBUG] [LOCAL ] WDH: Loaded 17502 existing records from primary storage. [2025-09-30T22:17:26.526401] [INFO ] [MAIN ] WDH: Loaded 17502 primary data records. [2025-09-30T22:17:26.585188] [DEBUG] [LOCAL ] WDI: Loaded 21089 existing records from primary storage. [2025-09-30T22:17:26.655187] [DEBUG] [LOCAL ] WD: Loaded 23200 existing records from primary storage. [2025-09-30T22:17:26.659097] [INFO ] [MAIN ] WD: Loaded 23200 primary data records. [2025-09-30T22:17:26.654427] [INFO ] [MAIN ] WDI: Loaded 21089 primary data records. [2025-09-30T22:17:27.598347] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:27.600153] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17502 primary records. [2025-09-30T22:17:27.600920] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-30T22:17:27.632609] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:27.633984] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-30T22:17:27.634830] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-30T22:17:27.634729] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21089 primary records. [2025-09-30T22:17:27.637349] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-30T22:17:27.637113] [INFO ] [MAIN ] Derivative Progress: 1921/2009 symbols completed. WDH took 1.1s. Estimated remaining: 36.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:27.651569] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:27.652109] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:27.653319] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23200 primary records. [2025-09-30T22:17:27.653427] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-30T22:17:27.684117] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-09-30T22:17:27.684922] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-30T22:17:27.687448] [INFO ] [MAIN ] Derivative Progress: 1922/2009 symbols completed. WDI took 1.2s. Estimated remaining: 35.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:27.687894] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:27.694946] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-30T22:17:27.695323] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-30T22:17:27.698530] [INFO ] [MAIN ] Derivative Progress: 1923/2009 symbols completed. WD took 1.2s. Estimated remaining: 35.4s. Rate: 145.8 symbols/min [2025-09-30T22:17:27.698774] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:27.703702] [DEBUG] [LOCAL ] WEA: Loaded 7280 existing records from primary storage. [2025-09-30T22:17:27.703875] [INFO ] [MAIN ] WEA: Loaded 7280 primary data records. [2025-09-30T22:17:27.866028] [DEBUG] [LOCAL ] WDS: Loaded 43377 existing records from primary storage. [2025-09-30T22:17:27.866408] [INFO ] [MAIN ] WDS: Loaded 43377 primary data records. [2025-09-30T22:17:28.133344] [DEBUG] [LOCAL ] WEAV: Loaded 41876 existing records from primary storage. [2025-09-30T22:17:28.219803] [INFO ] [MAIN ] WEAV: Loaded 41876 primary data records. [2025-09-30T22:17:28.804814] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:28.805754] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7280 primary records. [2025-09-30T22:17:28.806037] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-30T22:17:28.839094] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-30T22:17:28.839492] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-30T22:17:28.842004] [INFO ] [MAIN ] Derivative Progress: 1924/2009 symbols completed. WEA took 1.2s. Estimated remaining: 35.0s. Rate: 145.7 symbols/min [2025-09-30T22:17:28.843075] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:28.843522] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:28.845979] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43377 primary records. [2025-09-30T22:17:28.846077] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-30T22:17:28.872718] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:28.875020] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41876 primary records. [2025-09-30T22:17:28.875804] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-30T22:17:28.892431] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-30T22:17:28.892668] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-30T22:17:28.895899] [INFO ] [MAIN ] Derivative Progress: 1925/2009 symbols completed. WDS took 1.2s. Estimated remaining: 34.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:28.896534] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:28.898877] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-30T22:17:28.899520] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-30T22:17:28.902146] [INFO ] [MAIN ] Derivative Progress: 1926/2009 symbols completed. WEAV took 1.2s. Estimated remaining: 34.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:28.902558] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:28.947264] [DEBUG] [LOCAL ] WEC: Loaded 52179 existing records from primary storage. [2025-09-30T22:17:28.947750] [INFO ] [MAIN ] WEC: Loaded 52179 primary data records. [2025-09-30T22:17:29.106791] [DEBUG] [LOCAL ] WES: Loaded 48038 existing records from primary storage. [2025-09-30T22:17:29.153965] [DEBUG] [LOCAL ] WELL: Loaded 52361 existing records from primary storage. [2025-09-30T22:17:29.147938] [INFO ] [MAIN ] WES: Loaded 48038 primary data records. [2025-09-30T22:17:29.165912] [INFO ] [MAIN ] WELL: Loaded 52361 primary data records. [2025-09-30T22:17:30.033916] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:30.035321] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52179 primary records. [2025-09-30T22:17:30.036855] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-30T22:17:30.055370] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-30T22:17:30.055811] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-30T22:17:30.058293] [INFO ] [MAIN ] Derivative Progress: 1927/2009 symbols completed. WEC took 1.2s. Estimated remaining: 33.8s. Rate: 145.7 symbols/min [2025-09-30T22:17:30.058949] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:30.080620] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:30.089448] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52361 primary records. [2025-09-30T22:17:30.094629] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-30T22:17:30.095179] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:30.097323] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48038 primary records. [2025-09-30T22:17:30.109479] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-30T22:17:30.139848] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-30T22:17:30.151426] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-30T22:17:30.152320] [DEBUG] [LOCAL ] WEX: Loaded 34688 existing records from primary storage. [2025-09-30T22:17:30.152460] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-30T22:17:30.150165] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-30T22:17:30.152618] [INFO ] [MAIN ] WEX: Loaded 34688 primary data records. [2025-09-30T22:17:30.155346] [INFO ] [MAIN ] Derivative Progress: 1928/2009 symbols completed. WES took 1.3s. Estimated remaining: 33.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:30.163745] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:30.163908] [INFO ] [MAIN ] Derivative Progress: 1929/2009 symbols completed. WELL took 1.3s. Estimated remaining: 32.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:30.171589] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:30.283606] [DEBUG] [LOCAL ] WF: Loaded 10714 existing records from primary storage. [2025-09-30T22:17:30.294585] [INFO ] [MAIN ] WF: Loaded 10714 primary data records. [2025-09-30T22:17:30.709506] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-30T22:17:30.709790] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-30T22:17:31.217723] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:31.218809] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 34688 primary records. [2025-09-30T22:17:31.219043] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-30T22:17:31.240976] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-30T22:17:31.241135] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-30T22:17:31.243360] [INFO ] [MAIN ] Derivative Progress: 1930/2009 symbols completed. WEX took 1.2s. Estimated remaining: 32.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:31.243628] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:31.258343] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:31.259567] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10714 primary records. [2025-09-30T22:17:31.259710] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-30T22:17:31.281743] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-30T22:17:31.282043] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-30T22:17:31.289951] [INFO ] [MAIN ] Derivative Progress: 1931/2009 symbols completed. WF took 1.1s. Estimated remaining: 32.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:31.302979] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:31.303985] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:31.304822] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-30T22:17:31.305070] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-30T22:17:31.327171] [DEBUG] [LOCAL ] WFG: Loaded 24753 existing records from primary storage. [2025-09-30T22:17:31.328117] [INFO ] [MAIN ] WFG: Loaded 24753 primary data records. [2025-09-30T22:17:31.447323] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-30T22:17:31.460278] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-30T22:17:31.463176] [INFO ] [MAIN ] Derivative Progress: 1932/2009 symbols completed. WFC took 1.3s. Estimated remaining: 31.7s. Rate: 145.8 symbols/min [2025-09-30T22:17:31.473756] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:31.718582] [DEBUG] [LOCAL ] WGO: Loaded 39011 existing records from primary storage. [2025-09-30T22:17:31.718813] [INFO ] [MAIN ] WGO: Loaded 39011 primary data records. [2025-09-30T22:17:32.086704] [DEBUG] [LOCAL ] WH: Loaded 45500 existing records from primary storage. [2025-09-30T22:17:32.087124] [INFO ] [MAIN ] WH: Loaded 45500 primary data records. [2025-09-30T22:17:32.298079] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:32.310089] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24753 primary records. [2025-09-30T22:17:32.325767] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-30T22:17:32.474450] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-30T22:17:32.475691] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-30T22:17:32.478247] [INFO ] [MAIN ] Derivative Progress: 1933/2009 symbols completed. WFG took 1.2s. Estimated remaining: 31.3s. Rate: 145.7 symbols/min [2025-09-30T22:17:32.491773] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:32.492473] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39011 primary records. [2025-09-30T22:17:32.492549] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-30T22:17:32.510079] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-30T22:17:32.510168] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-30T22:17:32.512700] [INFO ] [MAIN ] Derivative Progress: 1934/2009 symbols completed. WGO took 1.2s. Estimated remaining: 30.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:32.528569] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:32.529223] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45500 primary records. [2025-09-30T22:17:32.529297] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-30T22:17:32.544807] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-30T22:17:32.544870] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-30T22:17:32.547710] [INFO ] [MAIN ] Derivative Progress: 1935/2009 symbols completed. WH took 1.1s. Estimated remaining: 30.4s. Rate: 145.8 symbols/min [2025-09-30T22:17:32.548181] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:32.548307] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:32.548239] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:32.555436] [DEBUG] [LOCAL ] WHG: Loaded 3306 existing records from primary storage. [2025-09-30T22:17:32.555605] [INFO ] [MAIN ] WHG: Loaded 3306 primary data records. [2025-09-30T22:17:32.903430] [DEBUG] [LOCAL ] WHD: Loaded 40334 existing records from primary storage. [2025-09-30T22:17:32.904222] [INFO ] [MAIN ] WHD: Loaded 40334 primary data records. [2025-09-30T22:17:33.035922] [DEBUG] [LOCAL ] WHR: Loaded 48172 existing records from primary storage. [2025-09-30T22:17:33.036462] [INFO ] [MAIN ] WHR: Loaded 48172 primary data records. [2025-09-30T22:17:33.612310] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7826 incomplete bins [2025-09-30T22:17:33.613377] [INFO ] [MAIN ] WHG: Generated 1788 derivative records from 3306 primary records. [2025-09-30T22:17:33.613468] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-30T22:17:33.631073] [DEBUG] [LOCAL ] WHG: Derivative data saved (1788 records). [2025-09-30T22:17:33.631714] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-30T22:17:33.634288] [INFO ] [MAIN ] Derivative Progress: 1936/2009 symbols completed. WHG took 1.1s. Estimated remaining: 30.1s. Rate: 145.7 symbols/min [2025-09-30T22:17:33.635219] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:33.646000] [DEBUG] [LOCAL ] WIA: Loaded 4823 existing records from primary storage. [2025-09-30T22:17:33.647339] [INFO ] [MAIN ] WIA: Loaded 4823 primary data records. [2025-09-30T22:17:33.719413] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:33.760597] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40334 primary records. [2025-09-30T22:17:33.786974] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-30T22:17:33.879261] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:33.883560] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-30T22:17:33.884414] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48172 primary records. [2025-09-30T22:17:33.884518] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-30T22:17:33.890451] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-30T22:17:33.892821] [INFO ] [MAIN ] Derivative Progress: 1937/2009 symbols completed. WHD took 1.3s. Estimated remaining: 29.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:33.900445] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:33.943782] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-30T22:17:33.944026] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-30T22:17:33.947330] [INFO ] [MAIN ] Derivative Progress: 1938/2009 symbols completed. WHR took 1.4s. Estimated remaining: 29.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:33.973664] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:34.111894] [DEBUG] [LOCAL ] WINN: Loaded 11622 existing records from primary storage. [2025-09-30T22:17:34.112253] [INFO ] [MAIN ] WINN: Loaded 11622 primary data records. [2025-09-30T22:17:34.477628] [DEBUG] [LOCAL ] WIT: Loaded 52344 existing records from primary storage. [2025-09-30T22:17:34.479163] [INFO ] [MAIN ] WIT: Loaded 52344 primary data records. [2025-09-30T22:17:34.624612] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:34.672194] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4823 primary records. [2025-09-30T22:17:34.697005] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-30T22:17:34.859015] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-30T22:17:34.861138] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:17:34.860676] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-30T22:17:34.864615] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11622 primary records. [2025-09-30T22:17:34.863674] [INFO ] [MAIN ] Derivative Progress: 1939/2009 symbols completed. WIA took 1.2s. Estimated remaining: 28.8s. Rate: 145.7 symbols/min [2025-09-30T22:17:34.864817] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:34.865025] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-30T22:17:34.884947] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-30T22:17:34.885180] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-30T22:17:34.887503] [INFO ] [MAIN ] Derivative Progress: 1940/2009 symbols completed. WINN took 1.0s. Estimated remaining: 28.4s. Rate: 145.8 symbols/min [2025-09-30T22:17:34.887884] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:34.906798] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:34.907595] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52344 primary records. [2025-09-30T22:17:34.907699] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-30T22:17:34.934628] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-30T22:17:34.935510] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-30T22:17:34.938483] [INFO ] [MAIN ] Derivative Progress: 1941/2009 symbols completed. WIT took 1.0s. Estimated remaining: 28.0s. Rate: 145.9 symbols/min [2025-09-30T22:17:34.938895] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:34.960148] [DEBUG] [LOCAL ] WK: Loaded 37053 existing records from primary storage. [2025-09-30T22:17:34.960989] [INFO ] [MAIN ] WK: Loaded 37053 primary data records. [2025-09-30T22:17:35.079241] [DEBUG] [LOCAL ] WKC: Loaded 34884 existing records from primary storage. [2025-09-30T22:17:35.093453] [INFO ] [MAIN ] WKC: Loaded 34884 primary data records. [2025-09-30T22:17:35.522555] [DEBUG] [LOCAL ] WLK: Loaded 45491 existing records from primary storage. [2025-09-30T22:17:35.533117] [INFO ] [MAIN ] WLK: Loaded 45491 primary data records. [2025-09-30T22:17:36.077683] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:36.080356] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37053 primary records. [2025-09-30T22:17:36.080676] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-30T22:17:36.112614] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:36.114189] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34884 primary records. [2025-09-30T22:17:36.115000] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-30T22:17:36.115138] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-30T22:17:36.114310] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-30T22:17:36.117397] [INFO ] [MAIN ] Derivative Progress: 1942/2009 symbols completed. WK took 1.3s. Estimated remaining: 27.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:36.119212] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:36.138239] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-30T22:17:36.140954] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-30T22:17:36.144909] [INFO ] [MAIN ] Derivative Progress: 1943/2009 symbols completed. WKC took 1.3s. Estimated remaining: 27.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:36.145323] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:36.149472] [DEBUG] [LOCAL ] WLKP: Loaded 6810 existing records from primary storage. [2025-09-30T22:17:36.149676] [INFO ] [MAIN ] WLKP: Loaded 6810 primary data records. [2025-09-30T22:17:36.169031] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:36.216447] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45491 primary records. [2025-09-30T22:17:36.233969] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-30T22:17:36.377361] [DEBUG] [LOCAL ] WLY: Loaded 29706 existing records from primary storage. [2025-09-30T22:17:36.401441] [INFO ] [MAIN ] WLY: Loaded 29706 primary data records. [2025-09-30T22:17:36.560293] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-30T22:17:36.586751] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-30T22:17:36.615031] [INFO ] [MAIN ] Derivative Progress: 1944/2009 symbols completed. WLK took 1.7s. Estimated remaining: 26.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:36.625603] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:36.894405] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:36.895230] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6810 primary records. [2025-09-30T22:17:36.910153] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-30T22:17:36.930760] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-30T22:17:36.931686] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-30T22:17:36.934169] [INFO ] [MAIN ] Derivative Progress: 1945/2009 symbols completed. WLKP took 0.8s. Estimated remaining: 26.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:36.934578] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:36.964575] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:36.966614] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29706 primary records. [2025-09-30T22:17:36.966840] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-30T22:17:36.965626] [DEBUG] [LOCAL ] WM: Loaded 50915 existing records from primary storage. [2025-09-30T22:17:36.967257] [INFO ] [MAIN ] WM: Loaded 50915 primary data records. [2025-09-30T22:17:37.130029] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-30T22:17:37.157521] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-30T22:17:37.215893] [INFO ] [MAIN ] Derivative Progress: 1946/2009 symbols completed. WLY took 1.1s. Estimated remaining: 25.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:37.338355] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:37.357583] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-30T22:17:37.358210] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-30T22:17:37.480674] [DEBUG] [LOCAL ] WMK: Loaded 14524 existing records from primary storage. [2025-09-30T22:17:37.491720] [INFO ] [MAIN ] WMK: Loaded 14524 primary data records. [2025-09-30T22:17:38.091563] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:38.092759] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50915 primary records. [2025-09-30T22:17:38.094022] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-30T22:17:38.117391] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-30T22:17:38.118400] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-30T22:17:38.120991] [INFO ] [MAIN ] Derivative Progress: 1947/2009 symbols completed. WM took 1.5s. Estimated remaining: 25.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:38.121507] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:38.142844] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:38.143883] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-30T22:17:38.144216] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-30T22:17:38.165145] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-30T22:17:38.165320] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-30T22:17:38.167454] [INFO ] [MAIN ] Derivative Progress: 1948/2009 symbols completed. WMB took 1.2s. Estimated remaining: 25.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:38.181380] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:38.191705] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14524 primary records. [2025-09-30T22:17:38.191823] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-30T22:17:38.207523] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-30T22:17:38.207709] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-30T22:17:38.210392] [INFO ] [MAIN ] Derivative Progress: 1949/2009 symbols completed. WMK took 0.9s. Estimated remaining: 24.7s. Rate: 145.9 symbols/min [2025-09-30T22:17:38.224136] [DEBUG] [LOCAL ] WMS: Loaded 39528 existing records from primary storage. [2025-09-30T22:17:38.224337] [INFO ] [MAIN ] WMS: Loaded 39528 primary data records. [2025-09-30T22:17:38.598698] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:38.599425] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39528 primary records. [2025-09-30T22:17:38.599492] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-30T22:17:38.616260] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-30T22:17:38.616349] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-30T22:17:38.618734] [INFO ] [MAIN ] Derivative Progress: 1950/2009 symbols completed. WMS took 0.5s. Estimated remaining: 24.3s. Rate: 145.9 symbols/min [2025-09-30T22:17:38.619362] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:38.619467] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:38.619596] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:38.703082] [DEBUG] [LOCAL ] WNC: Loaded 39463 existing records from primary storage. [2025-09-30T22:17:38.703419] [INFO ] [MAIN ] WNC: Loaded 39463 primary data records. [2025-09-30T22:17:38.704038] [DEBUG] [LOCAL ] WNS: Loaded 40001 existing records from primary storage. [2025-09-30T22:17:38.709625] [INFO ] [MAIN ] WNS: Loaded 40001 primary data records. [2025-09-30T22:17:38.931988] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-30T22:17:38.953857] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-30T22:17:39.760891] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:39.774600] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:39.774224] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 39463 primary records. [2025-09-30T22:17:39.775639] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-30T22:17:39.775564] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40001 primary records. [2025-09-30T22:17:39.776519] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-30T22:17:39.822731] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:39.825133] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-30T22:17:39.825984] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-30T22:17:39.828169] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-30T22:17:39.828846] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-30T22:17:39.828956] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-30T22:17:39.842106] [INFO ] [MAIN ] Derivative Progress: 1951/2009 symbols completed. WNS took 1.2s. Estimated remaining: 23.9s. Rate: 145.7 symbols/min [2025-09-30T22:17:39.836427] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-30T22:17:39.844781] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:39.844867] [INFO ] [MAIN ] Derivative Progress: 1952/2009 symbols completed. WNC took 1.2s. Estimated remaining: 23.5s. Rate: 145.8 symbols/min [2025-09-30T22:17:39.846473] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:39.850897] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-30T22:17:39.851151] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-30T22:17:39.855231] [INFO ] [MAIN ] Derivative Progress: 1953/2009 symbols completed. WMT took 1.2s. Estimated remaining: 23.0s. Rate: 145.9 symbols/min [2025-09-30T22:17:39.855441] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:39.887886] [DEBUG] [LOCAL ] WOR: Loaded 24907 existing records from primary storage. [2025-09-30T22:17:39.889410] [INFO ] [MAIN ] WOR: Loaded 24907 primary data records. [2025-09-30T22:17:40.046703] [DEBUG] [LOCAL ] WOW: Loaded 30470 existing records from primary storage. [2025-09-30T22:17:40.065983] [INFO ] [MAIN ] WOW: Loaded 30470 primary data records. [2025-09-30T22:17:40.362168] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-09-30T22:17:40.397488] [INFO ] [MAIN ] WOLF: Loaded 53184 primary data records. [2025-09-30T22:17:41.006278] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:41.008445] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24907 primary records. [2025-09-30T22:17:41.010084] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-30T22:17:41.038681] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-30T22:17:41.043757] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-30T22:17:41.046029] [INFO ] [MAIN ] Derivative Progress: 1954/2009 symbols completed. WOR took 1.2s. Estimated remaining: 22.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:41.046332] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:41.046823] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:41.048062] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30470 primary records. [2025-09-30T22:17:41.048330] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-30T22:17:41.086791] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-30T22:17:41.087069] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:41.087256] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-30T22:17:41.090191] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53184 primary records. [2025-09-30T22:17:41.090335] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-30T22:17:41.089236] [INFO ] [MAIN ] Derivative Progress: 1955/2009 symbols completed. WOW took 1.2s. Estimated remaining: 22.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:41.091532] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:41.112293] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-30T22:17:41.122866] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-30T22:17:41.127863] [INFO ] [MAIN ] Derivative Progress: 1956/2009 symbols completed. WOLF took 1.3s. Estimated remaining: 21.8s. Rate: 145.9 symbols/min [2025-09-30T22:17:41.128354] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:41.151510] [DEBUG] [LOCAL ] WPC: Loaded 48369 existing records from primary storage. [2025-09-30T22:17:41.151839] [INFO ] [MAIN ] WPC: Loaded 48369 primary data records. [2025-09-30T22:17:41.515675] [DEBUG] [LOCAL ] WPP: Loaded 33932 existing records from primary storage. [2025-09-30T22:17:41.517343] [INFO ] [MAIN ] WPP: Loaded 33932 primary data records. [2025-09-30T22:17:41.612356] [DEBUG] [LOCAL ] WPM: Loaded 52725 existing records from primary storage. [2025-09-30T22:17:41.637378] [INFO ] [MAIN ] WPM: Loaded 52725 primary data records. [2025-09-30T22:17:42.228914] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:42.231428] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48369 primary records. [2025-09-30T22:17:42.231750] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-30T22:17:42.249516] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-30T22:17:42.249740] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-30T22:17:42.251931] [INFO ] [MAIN ] Derivative Progress: 1957/2009 symbols completed. WPC took 1.2s. Estimated remaining: 21.4s. Rate: 145.7 symbols/min [2025-09-30T22:17:42.252206] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:42.273879] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:42.274952] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33932 primary records. [2025-09-30T22:17:42.275225] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-30T22:17:42.297571] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-30T22:17:42.297785] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-30T22:17:42.300094] [INFO ] [MAIN ] Derivative Progress: 1958/2009 symbols completed. WPP took 1.2s. Estimated remaining: 21.0s. Rate: 145.8 symbols/min [2025-09-30T22:17:42.300351] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:42.317673] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:42.318587] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52725 primary records. [2025-09-30T22:17:42.318755] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-30T22:17:42.356051] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-30T22:17:42.359565] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-30T22:17:42.362298] [INFO ] [MAIN ] Derivative Progress: 1959/2009 symbols completed. WPM took 1.3s. Estimated remaining: 20.6s. Rate: 145.9 symbols/min [2025-09-30T22:17:42.362503] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:42.395293] [DEBUG] [LOCAL ] WRB: Loaded 50558 existing records from primary storage. [2025-09-30T22:17:42.395684] [INFO ] [MAIN ] WRB: Loaded 50558 primary data records. [2025-09-30T22:17:42.532090] [DEBUG] [LOCAL ] WRBY: Loaded 50792 existing records from primary storage. [2025-09-30T22:17:42.551916] [INFO ] [MAIN ] WRBY: Loaded 50792 primary data records. [2025-09-30T22:17:42.574525] [DEBUG] [LOCAL ] WS: Loaded 24022 existing records from primary storage. [2025-09-30T22:17:42.580018] [INFO ] [MAIN ] WS: Loaded 24022 primary data records. [2025-09-30T22:17:43.506258] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:43.507186] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50558 primary records. [2025-09-30T22:17:43.507448] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-30T22:17:43.525455] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-30T22:17:43.525902] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-30T22:17:43.528023] [INFO ] [MAIN ] Derivative Progress: 1960/2009 symbols completed. WRB took 1.3s. Estimated remaining: 20.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:43.528334] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:43.549216] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:43.550203] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 24022 primary records. [2025-09-30T22:17:43.562773] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-30T22:17:43.563887] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:43.572304] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50792 primary records. [2025-09-30T22:17:43.573589] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-30T22:17:43.589533] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-30T22:17:43.593794] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-30T22:17:43.597465] [INFO ] [MAIN ] Derivative Progress: 1961/2009 symbols completed. WS took 1.2s. Estimated remaining: 19.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:43.597985] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:43.603244] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-30T22:17:43.603371] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-30T22:17:43.606039] [INFO ] [MAIN ] Derivative Progress: 1962/2009 symbols completed. WRBY took 1.3s. Estimated remaining: 19.3s. Rate: 145.9 symbols/min [2025-09-30T22:17:43.618128] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:43.641803] [DEBUG] [LOCAL ] WSO: Loaded 24617 existing records from primary storage. [2025-09-30T22:17:43.642232] [INFO ] [MAIN ] WSO: Loaded 24617 primary data records. [2025-09-30T22:17:43.711761] [DEBUG] [LOCAL ] WSM: Loaded 49690 existing records from primary storage. [2025-09-30T22:17:43.754891] [INFO ] [MAIN ] WSM: Loaded 49690 primary data records. [2025-09-30T22:17:43.755388] [DEBUG] [LOCAL ] WSR: Loaded 23021 existing records from primary storage. [2025-09-30T22:17:43.760709] [INFO ] [MAIN ] WSR: Loaded 23021 primary data records. [2025-09-30T22:17:44.727368] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:44.737348] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49690 primary records. [2025-09-30T22:17:44.744752] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:44.744169] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-30T22:17:44.745984] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24617 primary records. [2025-09-30T22:17:44.758936] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-30T22:17:44.760529] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:44.789266] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-30T22:17:44.785095] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23021 primary records. [2025-09-30T22:17:44.791880] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-30T22:17:44.793112] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-30T22:17:44.796076] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-30T22:17:44.795967] [INFO ] [MAIN ] Derivative Progress: 1963/2009 symbols completed. WSM took 1.3s. Estimated remaining: 18.9s. Rate: 145.7 symbols/min [2025-09-30T22:17:44.793308] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-30T22:17:44.798339] [INFO ] [MAIN ] Derivative Progress: 1964/2009 symbols completed. WSO took 1.2s. Estimated remaining: 18.5s. Rate: 145.8 symbols/min [2025-09-30T22:17:44.815215] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-30T22:17:44.815325] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-30T22:17:44.818061] [INFO ] [MAIN ] Derivative Progress: 1965/2009 symbols completed. WSR took 1.2s. Estimated remaining: 18.1s. Rate: 145.9 symbols/min [2025-09-30T22:17:44.818487] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:44.818578] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:44.819003] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:44.869040] [DEBUG] [LOCAL ] WST: Loaded 37284 existing records from primary storage. [2025-09-30T22:17:44.869370] [INFO ] [MAIN ] WST: Loaded 37284 primary data records. [2025-09-30T22:17:45.007269] [DEBUG] [LOCAL ] WTI: Loaded 43900 existing records from primary storage. [2025-09-30T22:17:45.007938] [INFO ] [MAIN ] WTI: Loaded 43900 primary data records. [2025-09-30T22:17:45.088988] [DEBUG] [LOCAL ] WT: Loaded 47662 existing records from primary storage. [2025-09-30T22:17:45.115838] [INFO ] [MAIN ] WT: Loaded 47662 primary data records. [2025-09-30T22:17:45.945013] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:45.946050] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37284 primary records. [2025-09-30T22:17:45.946170] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-30T22:17:45.979426] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-30T22:17:45.980015] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:45.981013] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43900 primary records. [2025-09-30T22:17:45.980225] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-30T22:17:45.981111] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-30T22:17:45.983375] [INFO ] [MAIN ] Derivative Progress: 1966/2009 symbols completed. WST took 1.2s. Estimated remaining: 17.7s. Rate: 145.7 symbols/min [2025-09-30T22:17:45.984490] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:46.001457] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-30T22:17:46.001773] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-30T22:17:46.004042] [INFO ] [MAIN ] Derivative Progress: 1967/2009 symbols completed. WTI took 1.2s. Estimated remaining: 17.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:46.006089] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:46.020878] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:46.021606] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47662 primary records. [2025-09-30T22:17:46.021788] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-30T22:17:46.043679] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-30T22:17:46.043849] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-30T22:17:46.046534] [INFO ] [MAIN ] Derivative Progress: 1968/2009 symbols completed. WT took 1.2s. Estimated remaining: 16.9s. Rate: 145.9 symbols/min [2025-09-30T22:17:46.046821] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:46.068114] [DEBUG] [LOCAL ] WTS: Loaded 18197 existing records from primary storage. [2025-09-30T22:17:46.068403] [INFO ] [MAIN ] WTS: Loaded 18197 primary data records. [2025-09-30T22:17:46.247853] [DEBUG] [LOCAL ] WTRG: Loaded 50892 existing records from primary storage. [2025-09-30T22:17:46.278873] [INFO ] [MAIN ] WTRG: Loaded 50892 primary data records. [2025-09-30T22:17:46.489088] [DEBUG] [LOCAL ] WTTR: Loaded 44935 existing records from primary storage. [2025-09-30T22:17:46.521033] [INFO ] [MAIN ] WTTR: Loaded 44935 primary data records. [2025-09-30T22:17:47.161721] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:47.163037] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18197 primary records. [2025-09-30T22:17:47.163331] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-30T22:17:47.187130] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-30T22:17:47.187456] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-30T22:17:47.190673] [INFO ] [MAIN ] Derivative Progress: 1969/2009 symbols completed. WTS took 1.2s. Estimated remaining: 16.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:47.191317] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:47.209096] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:47.210997] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50892 primary records. [2025-09-30T22:17:47.211286] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-30T22:17:47.237767] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:47.242290] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-30T22:17:47.242494] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-30T22:17:47.245016] [INFO ] [MAIN ] Derivative Progress: 1970/2009 symbols completed. WTRG took 1.3s. Estimated remaining: 16.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:47.245203] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:47.246300] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44935 primary records. [2025-09-30T22:17:47.246950] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-30T22:17:47.266268] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-30T22:17:47.266462] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-30T22:17:47.270352] [INFO ] [MAIN ] Derivative Progress: 1971/2009 symbols completed. WTTR took 1.2s. Estimated remaining: 15.6s. Rate: 145.9 symbols/min [2025-09-30T22:17:47.270782] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:47.328953] [DEBUG] [LOCAL ] WU: Loaded 53452 existing records from primary storage. [2025-09-30T22:17:47.342980] [INFO ] [MAIN ] WU: Loaded 53452 primary data records. [2025-09-30T22:17:47.366008] [DEBUG] [LOCAL ] WWW: Loaded 49112 existing records from primary storage. [2025-09-30T22:17:47.415435] [INFO ] [MAIN ] WWW: Loaded 49112 primary data records. [2025-09-30T22:17:47.585205] [DEBUG] [LOCAL ] WY: Loaded 53122 existing records from primary storage. [2025-09-30T22:17:47.596247] [INFO ] [MAIN ] WY: Loaded 53122 primary data records. [2025-09-30T22:17:48.383978] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:48.385258] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53452 primary records. [2025-09-30T22:17:48.386348] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-30T22:17:48.418429] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:48.427814] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49112 primary records. [2025-09-30T22:17:48.436975] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-30T22:17:48.436912] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-30T22:17:48.437138] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-30T22:17:48.439254] [INFO ] [MAIN ] Derivative Progress: 1972/2009 symbols completed. WU took 1.2s. Estimated remaining: 15.2s. Rate: 145.7 symbols/min [2025-09-30T22:17:48.440688] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:48.441027] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:48.442300] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53122 primary records. [2025-09-30T22:17:48.450050] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-30T22:17:48.473147] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-30T22:17:48.473314] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-30T22:17:48.475979] [INFO ] [MAIN ] Derivative Progress: 1973/2009 symbols completed. WY took 1.2s. Estimated remaining: 14.8s. Rate: 145.8 symbols/min [2025-09-30T22:17:48.476617] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:48.480955] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-30T22:17:48.481259] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-30T22:17:48.491769] [INFO ] [MAIN ] Derivative Progress: 1974/2009 symbols completed. WWW took 1.2s. Estimated remaining: 14.4s. Rate: 145.9 symbols/min [2025-09-30T22:17:48.492108] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:48.506630] [DEBUG] [LOCAL ] XFLT: Loaded 29795 existing records from primary storage. [2025-09-30T22:17:48.506848] [INFO ] [MAIN ] XFLT: Loaded 29795 primary data records. [2025-09-30T22:17:48.870061] [DEBUG] [LOCAL ] XHR: Loaded 43760 existing records from primary storage. [2025-09-30T22:17:48.870855] [INFO ] [MAIN ] XHR: Loaded 43760 primary data records. [2025-09-30T22:17:48.991989] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-30T22:17:49.005435] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-30T22:17:49.590157] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:49.591792] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29795 primary records. [2025-09-30T22:17:49.593405] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-30T22:17:49.611383] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-30T22:17:49.613328] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-30T22:17:49.616634] [INFO ] [MAIN ] Derivative Progress: 1975/2009 symbols completed. XFLT took 1.2s. Estimated remaining: 14.0s. Rate: 145.7 symbols/min [2025-09-30T22:17:49.617247] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:49.636853] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:49.637633] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43760 primary records. [2025-09-30T22:17:49.637824] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-30T22:17:49.678190] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:49.679403] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-30T22:17:49.679805] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-30T22:17:49.681316] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-30T22:17:49.681502] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-30T22:17:49.692632] [INFO ] [MAIN ] Derivative Progress: 1976/2009 symbols completed. XHR took 1.2s. Estimated remaining: 13.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:49.701807] [DEBUG] [LOCAL ] XPER: Loaded 29705 existing records from primary storage. [2025-09-30T22:17:49.705477] [INFO ] [MAIN ] XPER: Loaded 29705 primary data records. [2025-09-30T22:17:49.693319] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:49.836133] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-30T22:17:49.841544] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-30T22:17:49.854571] [INFO ] [MAIN ] Derivative Progress: 1977/2009 symbols completed. XOM took 1.4s. Estimated remaining: 13.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:49.881775] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:50.067212] [DEBUG] [LOCAL ] XPEV: Loaded 53637 existing records from primary storage. [2025-09-30T22:17:50.067425] [INFO ] [MAIN ] XPEV: Loaded 53637 primary data records. [2025-09-30T22:17:50.414585] [DEBUG] [LOCAL ] XPO: Loaded 47829 existing records from primary storage. [2025-09-30T22:17:50.414922] [INFO ] [MAIN ] XPO: Loaded 47829 primary data records. [2025-09-30T22:17:50.474221] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:50.496958] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29705 primary records. [2025-09-30T22:17:50.526166] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-30T22:17:50.779084] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-30T22:17:50.779557] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-30T22:17:50.781779] [INFO ] [MAIN ] Derivative Progress: 1978/2009 symbols completed. XPER took 1.2s. Estimated remaining: 12.8s. Rate: 145.7 symbols/min [2025-09-30T22:17:50.803300] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:50.804199] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53637 primary records. [2025-09-30T22:17:50.804368] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-30T22:17:50.824407] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-30T22:17:50.824586] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-30T22:17:50.840692] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:50.840138] [INFO ] [MAIN ] Derivative Progress: 1979/2009 symbols completed. XPEV took 1.1s. Estimated remaining: 12.3s. Rate: 145.8 symbols/min [2025-09-30T22:17:50.841639] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47829 primary records. [2025-09-30T22:17:50.841790] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-30T22:17:50.858572] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-30T22:17:50.858674] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-30T22:17:50.861244] [INFO ] [MAIN ] Derivative Progress: 1980/2009 symbols completed. XPO took 1.0s. Estimated remaining: 11.9s. Rate: 145.9 symbols/min [2025-09-30T22:17:50.861668] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:50.861801] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:50.861896] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:50.916925] [DEBUG] [LOCAL ] XPOF: Loaded 38259 existing records from primary storage. [2025-09-30T22:17:50.917221] [INFO ] [MAIN ] XPOF: Loaded 38259 primary data records. [2025-09-30T22:17:51.045514] [DEBUG] [LOCAL ] XYF: Loaded 28441 existing records from primary storage. [2025-09-30T22:17:51.060443] [DEBUG] [LOCAL ] XPRO: Loaded 45857 existing records from primary storage. [2025-09-30T22:17:51.066071] [INFO ] [MAIN ] XPRO: Loaded 45857 primary data records. [2025-09-30T22:17:51.071307] [INFO ] [MAIN ] XYF: Loaded 28441 primary data records. [2025-09-30T22:17:51.990257] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:51.991057] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38259 primary records. [2025-09-30T22:17:51.991155] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-30T22:17:52.040592] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:52.044442] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:52.043611] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28441 primary records. [2025-09-30T22:17:52.045412] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45857 primary records. [2025-09-30T22:17:52.044086] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-30T22:17:52.045741] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-30T22:17:52.045815] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-30T22:17:52.045580] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-30T22:17:52.049740] [INFO ] [MAIN ] Derivative Progress: 1981/2009 symbols completed. XPOF took 1.2s. Estimated remaining: 11.5s. Rate: 145.7 symbols/min [2025-09-30T22:17:52.050114] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:52.083410] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-30T22:17:52.084437] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-30T22:17:52.084149] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-30T22:17:52.087550] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-30T22:17:52.087372] [INFO ] [MAIN ] Derivative Progress: 1982/2009 symbols completed. XPRO took 1.2s. Estimated remaining: 11.1s. Rate: 145.8 symbols/min [2025-09-30T22:17:52.090234] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:52.090622] [INFO ] [MAIN ] Derivative Progress: 1983/2009 symbols completed. XYF took 1.2s. Estimated remaining: 10.7s. Rate: 145.9 symbols/min [2025-09-30T22:17:52.091127] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:52.153309] [DEBUG] [LOCAL ] YALA: Loaded 37240 existing records from primary storage. [2025-09-30T22:17:52.153694] [INFO ] [MAIN ] YALA: Loaded 37240 primary data records. [2025-09-30T22:17:52.254940] [DEBUG] [LOCAL ] XYL: Loaded 47982 existing records from primary storage. [2025-09-30T22:17:52.267351] [INFO ] [MAIN ] XYL: Loaded 47982 primary data records. [2025-09-30T22:17:52.284848] [DEBUG] [LOCAL ] YELP: Loaded 45270 existing records from primary storage. [2025-09-30T22:17:52.339203] [INFO ] [MAIN ] YELP: Loaded 45270 primary data records. [2025-09-30T22:17:53.251252] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:53.252421] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37240 primary records. [2025-09-30T22:17:53.252778] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-30T22:17:53.273140] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-30T22:17:53.273379] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-30T22:17:53.276955] [INFO ] [MAIN ] Derivative Progress: 1984/2009 symbols completed. YALA took 1.2s. Estimated remaining: 10.3s. Rate: 145.7 symbols/min [2025-09-30T22:17:53.277389] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:53.305120] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:53.305480] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:53.306374] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47982 primary records. [2025-09-30T22:17:53.307545] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45270 primary records. [2025-09-30T22:17:53.306697] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-30T22:17:53.307720] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-30T22:17:53.341273] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-30T22:17:53.343289] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-30T22:17:53.343524] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-30T22:17:53.343628] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-30T22:17:53.346406] [INFO ] [MAIN ] Derivative Progress: 1985/2009 symbols completed. YELP took 1.3s. Estimated remaining: 9.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:53.349312] [INFO ] [MAIN ] Derivative Progress: 1986/2009 symbols completed. XYL took 1.3s. Estimated remaining: 9.5s. Rate: 145.9 symbols/min [2025-09-30T22:17:53.349671] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:53.346609] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:53.390337] [DEBUG] [LOCAL ] YETI: Loaded 52484 existing records from primary storage. [2025-09-30T22:17:53.390727] [INFO ] [MAIN ] YETI: Loaded 52484 primary data records. [2025-09-30T22:17:53.547170] [DEBUG] [LOCAL ] YEXT: Loaded 43136 existing records from primary storage. [2025-09-30T22:17:53.568969] [INFO ] [MAIN ] YEXT: Loaded 43136 primary data records. [2025-09-30T22:17:53.846969] [DEBUG] [LOCAL ] YMM: Loaded 52647 existing records from primary storage. [2025-09-30T22:17:53.866455] [INFO ] [MAIN ] YMM: Loaded 52647 primary data records. [2025-09-30T22:17:54.455082] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:54.456421] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52484 primary records. [2025-09-30T22:17:54.456678] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-30T22:17:54.476467] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-30T22:17:54.476678] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-30T22:17:54.479639] [INFO ] [MAIN ] Derivative Progress: 1987/2009 symbols completed. YETI took 1.2s. Estimated remaining: 9.1s. Rate: 145.7 symbols/min [2025-09-30T22:17:54.480722] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:54.502081] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:54.503627] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43136 primary records. [2025-09-30T22:17:54.503861] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-30T22:17:54.522628] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-30T22:17:54.523008] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-30T22:17:54.525205] [INFO ] [MAIN ] Derivative Progress: 1988/2009 symbols completed. YEXT took 1.2s. Estimated remaining: 8.6s. Rate: 145.8 symbols/min [2025-09-30T22:17:54.527091] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:54.562996] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:54.564174] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52647 primary records. [2025-09-30T22:17:54.564359] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-30T22:17:54.590899] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-30T22:17:54.605886] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-30T22:17:54.610074] [INFO ] [MAIN ] Derivative Progress: 1989/2009 symbols completed. YMM took 1.3s. Estimated remaining: 8.2s. Rate: 145.9 symbols/min [2025-09-30T22:17:54.611181] [DEBUG] [LOCAL ] YOU: Loaded 49684 existing records from primary storage. [2025-09-30T22:17:54.611321] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:54.611697] [INFO ] [MAIN ] YOU: Loaded 49684 primary data records. [2025-09-30T22:17:54.760545] [DEBUG] [LOCAL ] YRD: Loaded 12580 existing records from primary storage. [2025-09-30T22:17:54.771094] [INFO ] [MAIN ] YRD: Loaded 12580 primary data records. [2025-09-30T22:17:55.096719] [DEBUG] [LOCAL ] YPF: Loaded 50489 existing records from primary storage. [2025-09-30T22:17:55.108357] [INFO ] [MAIN ] YPF: Loaded 50489 primary data records. [2025-09-30T22:17:55.743696] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:55.745981] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49684 primary records. [2025-09-30T22:17:55.746252] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-30T22:17:55.769759] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-30T22:17:55.770479] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-30T22:17:55.773380] [INFO ] [MAIN ] Derivative Progress: 1990/2009 symbols completed. YOU took 1.3s. Estimated remaining: 7.8s. Rate: 145.7 symbols/min [2025-09-30T22:17:55.786786] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:55.788077] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:55.789198] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12580 primary records. [2025-09-30T22:17:55.789416] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-30T22:17:55.806540] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-30T22:17:55.808996] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-30T22:17:55.812061] [INFO ] [MAIN ] Derivative Progress: 1991/2009 symbols completed. YRD took 1.2s. Estimated remaining: 7.4s. Rate: 145.8 symbols/min [2025-09-30T22:17:55.812535] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:55.830155] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:55.831197] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50489 primary records. [2025-09-30T22:17:55.839003] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-30T22:17:55.866466] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-30T22:17:55.866634] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-30T22:17:55.869386] [INFO ] [MAIN ] Derivative Progress: 1992/2009 symbols completed. YPF took 1.3s. Estimated remaining: 7.0s. Rate: 145.9 symbols/min [2025-09-30T22:17:55.869546] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:55.866348] [DEBUG] [LOCAL ] YSG: Loaded 25331 existing records from primary storage. [2025-09-30T22:17:55.870118] [INFO ] [MAIN ] YSG: Loaded 25331 primary data records. [2025-09-30T22:17:56.198149] [DEBUG] [LOCAL ] YUM: Loaded 51176 existing records from primary storage. [2025-09-30T22:17:56.226618] [INFO ] [MAIN ] YUM: Loaded 51176 primary data records. [2025-09-30T22:17:56.383232] [DEBUG] [LOCAL ] YUMC: Loaded 52682 existing records from primary storage. [2025-09-30T22:17:56.448526] [INFO ] [MAIN ] YUMC: Loaded 52682 primary data records. [2025-09-30T22:17:56.774477] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:56.812141] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25331 primary records. [2025-09-30T22:17:56.926911] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-30T22:17:56.955920] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-09-30T22:17:56.956524] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-30T22:17:56.959748] [INFO ] [MAIN ] Derivative Progress: 1993/2009 symbols completed. YSG took 1.2s. Estimated remaining: 6.6s. Rate: 145.7 symbols/min [2025-09-30T22:17:56.979584] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:56.980409] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51176 primary records. [2025-09-30T22:17:56.980609] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-30T22:17:56.998784] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-30T22:17:56.998899] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-30T22:17:57.004547] [INFO ] [MAIN ] Derivative Progress: 1994/2009 symbols completed. YUM took 1.2s. Estimated remaining: 6.2s. Rate: 145.8 symbols/min [2025-09-30T22:17:57.020366] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:57.021101] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52682 primary records. [2025-09-30T22:17:57.021167] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-30T22:17:57.036945] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-30T22:17:57.037038] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-30T22:17:57.040568] [INFO ] [MAIN ] Derivative Progress: 1995/2009 symbols completed. YUMC took 1.2s. Estimated remaining: 5.8s. Rate: 145.9 symbols/min [2025-09-30T22:17:57.041167] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:57.041445] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:57.041329] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:57.062933] [DEBUG] [LOCAL ] ZEPP: Loaded 17569 existing records from primary storage. [2025-09-30T22:17:57.063286] [INFO ] [MAIN ] ZEPP: Loaded 17569 primary data records. [2025-09-30T22:17:57.463788] [DEBUG] [LOCAL ] ZBH: Loaded 51129 existing records from primary storage. [2025-09-30T22:17:57.464592] [INFO ] [MAIN ] ZBH: Loaded 51129 primary data records. [2025-09-30T22:17:57.470904] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-30T22:17:57.517136] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-30T22:17:58.209605] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:58.210810] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 17569 primary records. [2025-09-30T22:17:58.211184] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-30T22:17:58.230112] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-30T22:17:58.230726] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-30T22:17:58.233620] [INFO ] [MAIN ] Derivative Progress: 1996/2009 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.4s. Rate: 145.7 symbols/min [2025-09-30T22:17:58.233942] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:58.252796] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:58.253958] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51129 primary records. [2025-09-30T22:17:58.254246] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-30T22:17:58.290107] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-30T22:17:58.290332] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:58.291241] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-30T22:17:58.291324] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-30T22:17:58.293310] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-30T22:17:58.293230] [INFO ] [MAIN ] Derivative Progress: 1997/2009 symbols completed. ZBH took 1.3s. Estimated remaining: 4.9s. Rate: 145.8 symbols/min [2025-09-30T22:17:58.293978] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:58.320210] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-30T22:17:58.320360] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-30T22:17:58.323030] [INFO ] [MAIN ] Derivative Progress: 1998/2009 symbols completed. ZETA took 1.3s. Estimated remaining: 4.5s. Rate: 145.9 symbols/min [2025-09-30T22:17:58.323293] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:58.344323] [DEBUG] [LOCAL ] ZGN: Loaded 40703 existing records from primary storage. [2025-09-30T22:17:58.344571] [INFO ] [MAIN ] ZGN: Loaded 40703 primary data records. [2025-09-30T22:17:58.460955] [DEBUG] [LOCAL ] ZH: Loaded 26655 existing records from primary storage. [2025-09-30T22:17:58.465052] [INFO ] [MAIN ] ZH: Loaded 26655 primary data records. [2025-09-30T22:17:58.857329] [DEBUG] [LOCAL ] ZIM: Loaded 53516 existing records from primary storage. [2025-09-30T22:17:58.884611] [INFO ] [MAIN ] ZIM: Loaded 53516 primary data records. [2025-09-30T22:17:59.392833] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:59.394206] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40703 primary records. [2025-09-30T22:17:59.394331] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-30T22:17:59.413995] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-30T22:17:59.415450] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-30T22:17:59.419282] [INFO ] [MAIN ] Derivative Progress: 1999/2009 symbols completed. ZGN took 1.2s. Estimated remaining: 4.1s. Rate: 145.7 symbols/min [2025-09-30T22:17:59.420695] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:59.436802] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:59.437719] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26655 primary records. [2025-09-30T22:17:59.437953] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-30T22:17:59.455380] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-30T22:17:59.455517] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-30T22:17:59.457978] [INFO ] [MAIN ] Derivative Progress: 2000/2009 symbols completed. ZH took 1.2s. Estimated remaining: 3.7s. Rate: 145.8 symbols/min [2025-09-30T22:17:59.458509] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:59.490580] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:17:59.491744] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53516 primary records. [2025-09-30T22:17:59.492013] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-30T22:17:59.535243] [DEBUG] [LOCAL ] ZIP: Loaded 44095 existing records from primary storage. [2025-09-30T22:17:59.535775] [INFO ] [MAIN ] ZIP: Loaded 44095 primary data records. [2025-09-30T22:17:59.560135] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-30T22:17:59.600032] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-30T22:17:59.625440] [INFO ] [MAIN ] Derivative Progress: 2001/2009 symbols completed. ZIM took 1.3s. Estimated remaining: 3.3s. Rate: 145.9 symbols/min [2025-09-30T22:17:59.662595] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:17:59.667006] [DEBUG] [LOCAL ] ZK: Loaded 39656 existing records from primary storage. [2025-09-30T22:17:59.667304] [INFO ] [MAIN ] ZK: Loaded 39656 primary data records. [2025-09-30T22:17:59.923929] [DEBUG] [LOCAL ] ZKH: Loaded 7937 existing records from primary storage. [2025-09-30T22:18:00.028755] [INFO ] [MAIN ] ZKH: Loaded 7937 primary data records. [2025-09-30T22:18:00.591785] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:00.593153] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44095 primary records. [2025-09-30T22:18:00.593280] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-30T22:18:00.613124] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-30T22:18:00.626827] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-30T22:18:00.626771] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:00.631033] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39656 primary records. [2025-09-30T22:18:00.630057] [INFO ] [MAIN ] Derivative Progress: 2002/2009 symbols completed. ZIP took 1.2s. Estimated remaining: 2.9s. Rate: 145.8 symbols/min [2025-09-30T22:18:00.631201] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-30T22:18:00.631495] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:18:00.652133] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-30T22:18:00.652364] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-30T22:18:00.667637] [INFO ] [MAIN ] Derivative Progress: 2003/2009 symbols completed. ZK took 1.2s. Estimated remaining: 2.5s. Rate: 145.8 symbols/min [2025-09-30T22:18:00.668502] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-30T22:18:00.669367] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7937 primary records. [2025-09-30T22:18:00.669436] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-30T22:18:00.668154] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:18:00.685604] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-09-30T22:18:00.685796] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-30T22:18:00.688702] [INFO ] [MAIN ] Derivative Progress: 2004/2009 symbols completed. ZKH took 1.0s. Estimated remaining: 2.1s. Rate: 145.9 symbols/min [2025-09-30T22:18:00.689001] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:18:00.705525] [DEBUG] [LOCAL ] ZTR: Loaded 16662 existing records from primary storage. [2025-09-30T22:18:00.705701] [INFO ] [MAIN ] ZTR: Loaded 16662 primary data records. [2025-09-30T22:18:01.059260] [DEBUG] [LOCAL ] ZTO: Loaded 49965 existing records from primary storage. [2025-09-30T22:18:01.068431] [INFO ] [MAIN ] ZTO: Loaded 49965 primary data records. [2025-09-30T22:18:01.144046] [DEBUG] [LOCAL ] ZTS: Loaded 52994 existing records from primary storage. [2025-09-30T22:18:01.154603] [INFO ] [MAIN ] ZTS: Loaded 52994 primary data records. [2025-09-30T22:18:01.798278] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:01.799982] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16662 primary records. [2025-09-30T22:18:01.800209] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-30T22:18:01.825475] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-30T22:18:01.825860] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-30T22:18:01.828397] [INFO ] [MAIN ] Derivative Progress: 2005/2009 symbols completed. ZTR took 1.2s. Estimated remaining: 1.6s. Rate: 145.8 symbols/min [2025-09-30T22:18:01.828911] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:18:01.848393] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:01.849168] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49965 primary records. [2025-09-30T22:18:01.849356] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-30T22:18:01.889167] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:01.900707] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 52994 primary records. [2025-09-30T22:18:01.901437] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-30T22:18:01.902136] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-30T22:18:01.902240] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-30T22:18:01.905403] [INFO ] [MAIN ] Derivative Progress: 2006/2009 symbols completed. ZTO took 1.3s. Estimated remaining: 1.2s. Rate: 145.8 symbols/min [2025-09-30T22:18:01.905576] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-30T22:18:01.935393] [DEBUG] [LOCAL ] ZVIA: Loaded 35429 existing records from primary storage. [2025-09-30T22:18:01.935875] [INFO ] [MAIN ] ZVIA: Loaded 35429 primary data records. [2025-09-30T22:18:01.942048] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-30T22:18:01.948831] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-30T22:18:01.963015] [INFO ] [MAIN ] Derivative Progress: 2007/2009 symbols completed. ZTS took 1.3s. Estimated remaining: 0.8s. Rate: 145.9 symbols/min [2025-09-30T22:18:02.181297] [DEBUG] [LOCAL ] ZWS: Loaded 42322 existing records from primary storage. [2025-09-30T22:18:02.302876] [INFO ] [MAIN ] ZWS: Loaded 42322 primary data records. [2025-09-30T22:18:02.650992] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:02.652059] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35429 primary records. [2025-09-30T22:18:02.652257] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-30T22:18:02.672355] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-30T22:18:02.672625] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-30T22:18:02.674902] [INFO ] [MAIN ] Derivative Progress: 2008/2009 symbols completed. ZVIA took 0.8s. Estimated remaining: 0.4s. Rate: 145.8 symbols/min [2025-09-30T22:18:02.687865] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-30T22:18:02.688559] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42322 primary records. [2025-09-30T22:18:02.688627] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-30T22:18:02.704026] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-30T22:18:02.704095] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-30T22:18:02.706583] [INFO ] [MAIN ] Derivative Progress: 2009/2009 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 145.9 symbols/min [2025-09-30T22:18:02.707402] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 46s [2025-09-30T22:18:02.707477] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2009/2009 symbols) [2025-09-30T22:18:03.372520] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2009/2009 @ 100.00%)' [2025-09-30T22:18:03.373053] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-09-30T22:18:03.374443] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-30T22:18:03.374745] [INFO ] [STATE ] Last completion updated: 2025-09-30T22:18:03.374522